Commit Graph

52302 Commits

Author SHA1 Message Date
Vasily Nemkov
e166aae3f9 Using CSV-like strings for list of columns to deduplicate by instead of JSON-like notation. 2020-12-18 13:44:56 +02:00
Vasily Nemkov
90041babe1 Fixed compilation 2020-12-15 14:35:11 +03:00
Vasily Nemkov
bf8c7cd685 Checking that columns from PARTITION BY are present in DEDUPLICATE BY 2020-12-15 13:41:00 +03:00
Vasily Nemkov
a2f85a03f3 Enforcing all sorting keys to be present in DEDUPLICATE BY columns
Updated test and minor cleanup
2020-12-09 18:08:37 +03:00
Vasily Nemkov
59fc301344 Fixed test to be less flaky
Also logging expanded list of columns passed from `DEDUPLICATE BY` to actual deduplication routines.
2020-12-08 19:44:34 +03:00
Vasily Nemkov
8c5daf0925 Fixed building tests with GCC-10
Also a minor cleanup of the test code.
2020-12-08 13:15:18 +03:00
Vasily Nemkov
168155eeec Minor: cleanup 2020-12-07 18:07:40 +03:00
Vasily Nemkov
f01a566646 Updated tests 2020-12-07 17:42:49 +03:00
Vasily Nemkov
dbdc018ab8 Fixed and refined unite-test
* no more undefined values for attributes in ReplicatedMergeTreeLogEntry
* validation of string serialization format
2020-12-07 17:38:25 +03:00
Vasily Nemkov
957bbfc7b0 Fixed parsing invalid cases: prohibit empty lists and APPLY/REPLACE column transformers 2020-12-07 13:18:54 +03:00
Vasily Nemkov
70ea507dae OPTIMIZE DEDUPLICATE BY columns
Extended OPTIMIZE ... DEDUPLICATE syntax to allow explicit (or implicit with asterisk/column transformers) list of columns to check for duplicates on.

Following syntax variants are now supported:

OPTIMIZE TABLE table DEDUPLICATE; -- the old one
OPTIMIZE TABLE table DEDUPLICATE BY *;
OPTIMIZE TABLE table DEDUPLICATE BY * EXCEPT colX;
OPTIMIZE TABLE table DEDUPLICATE BY * EXCEPT (colX, colY);
OPTIMIZE TABLE table DEDUPLICATE BY col1,col2,col3;
OPTIMIZE TABLE table DEDUPLICATE BY COLUMNS('column-matched-by-regex');
OPTIMIZE TABLE table DEDUPLICATE BY COLUMNS('column-matched-by-regex') EXCEPT colX;
OPTIMIZE TABLE table DEDUPLICATE BY COLUMNS('column-matched-by-regex') EXCEPT (colX, colY);

Note that * behaves just like in SELECT: MATERIALIZED, and ALIAS columns are not used for expansion.
Also, it is an error to specify empty list of columns, or write an expression that results in an empty list of columns, or deduplicate by an ALIAS column.
Column transformers other than EXCEPT are not supported.
2020-12-07 09:44:07 +03:00
alexey-milovidov
a3bcf60298
Merge pull request #17833 from ucasFL/fix-maxs
fix incorrect initialize MergeTreeWriterSettings
2020-12-06 16:43:16 +03:00
alexey-milovidov
614420feb9
Merge pull request #17794 from excitoon-favorites/s3testiostream
Attempt to use IOStream in AWS SDK
2020-12-06 16:42:12 +03:00
feng lv
a634e4ed80 fix incorrect initialize MergeTreeWriterSettings 2020-12-06 08:57:02 +00:00
alesapin
67c82eb61b
Merge pull request #17818 from PerformanceVision/init_docker
Override value for running scripts on docker-entrypoint-initdb.d with CLICKHOUSE_INIT_TIMEOUT
2020-12-05 16:24:21 +03:00
alesapin
27c3301083
Merge pull request #17800 from nvartolomei/nv/waitForAllReplicasToProcessLogEntry-foreign-shard
Update StorageReplicatedMergeTree::waitForAllReplicasToProcessLogEntry to support waiting on foreign shards / tables
2020-12-05 16:15:46 +03:00
alesapin
0eec52b1fd
Merge pull request #17737 from ClickHouse/fix_segfault_in_distributed_out_stream
Fix segfault when 'not enough space'
2020-12-05 16:14:30 +03:00
Guillaume Tassery
4920bba7de Override value for running scripts on docker-entrypoint-initdb.d with CLICKHOUSE_INIT_TIMEOUT 2020-12-05 09:53:15 +07:00
Anton Popov
d1ef6a897e
Merge pull request #17802 from detailyang/patch-1
hotfix:check in_memory_parts_enable_wal
2020-12-05 03:05:38 +03:00
Anton Popov
60b0cbb1c1
Merge pull request #15939 from Avogar/optimize_final_optimization
Optimize final optimization
2020-12-05 02:26:27 +03:00
alexey-milovidov
37accc3d2c
Merge pull request #17804 from MyroTk/tfs_pr_access_management
Testflows RBAC ACCESS MANAGEMENT tests.
2020-12-05 01:56:56 +03:00
alexey-milovidov
8ade3bdfa9
Merge pull request #17770 from ClickHouse/play-better-history
Improvement of Web UI: do not add empty query to browser history.
2020-12-05 01:54:09 +03:00
alexey-milovidov
61a53f38fd
Merge pull request #17805 from azat/fix-test_ttl_move-flaky
Fix flaky test_ttl_move
2020-12-05 01:53:24 +03:00
Alexander Kuzmenkov
b54d50fa7f
Merge pull request #17459 from azat/countMatches-pull
Add countMatches function
2020-12-05 00:01:47 +03:00
Azat Khuzhin
ea64ec390f Fix flaky test_ttl_move
- replace sleep() with waiting for the message in log
- due to previous paragaph, use unique table names
- increase sleep timeout in some places
2020-12-04 21:27:50 +03:00
Anna
ac0ebd515e
DOCSUP-4193: Document the EXPLAIN statement (#17734)
* Add EXPLAIN query description

* Check examples

* update

* Update docs/en/sql-reference/statements/explain.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/en/sql-reference/statements/explain.md

Co-authored-by: Nikolai Kochetov <KochetovNicolai@users.noreply.github.com>

Co-authored-by: BayoNet <da-daos@yandex.ru>
Co-authored-by: Nikolai Kochetov <KochetovNicolai@users.noreply.github.com>
2020-12-04 21:24:05 +03:00
sevirov
c23e376474
DOCSUP-4435: Allow nullable key in MergeTree (#17345)
* Update settings.md and mergetree.md

Задокументировал настройку allow_nullable_key. Добавил пару предложений в mergetree.md.

* Update mergetree.md

Исправляю битую ссылку.

* Update mergetree.md

Вставил ссылку на allow_nullable_key.

* Update mergetree.md

Правлю битую ссылку.

* Update mergetree.md

Исправляю битую ссылку.

* Update settings.md

Правлю битую ссылку.

* Update mergetree.md and settings.md

Выполнил перевод на русский язык и поправил немного английскую версию.

* Update mergetree.md

Убрал выражение 'для семейства mergetree'.

* Update settings.md

Внес поправки в русскую версию.

* Update mergetree.md and settings.md

Сделал поправки в английскую версию на основе комментарий в PR.

Co-authored-by: Dmitriy <sevirov@yandex-team.ru>
2020-12-04 21:17:58 +03:00
MyroTk
e2c6430a6e Testflows RBAC ACCESS MANAGEMENT tests. 2020-12-04 18:36:32 +01:00
detailyang
e7a151fd1e
hotfix:check in_memory_parts_enable_wal 2020-12-04 23:14:27 +08:00
alesapin
42544a9833 Merge branch 'master' into fix_segfault_in_distributed_out_stream 2020-12-04 17:41:10 +03:00
Pavel Kruglov
9dbced0474 Pass setting instead of context 2020-12-04 17:01:59 +03:00
Nicolae Vartolomei
796aee032d Update StorageReplicatedMergeTree::waitForAllReplicasToProcessLogEntry to support waiting on foreign shards / tables
This is not used anywhere yet but needed for an upcoming PR for part movement between shards.
2020-12-04 13:01:12 +00:00
alesapin
7c2a04d77d
Merge pull request #17671 from ClickHouse/update_integration_tests_image
Update docker image in integration tests runner
2020-12-04 15:51:08 +03:00
alexey-milovidov
18d5f6dc47
Merge pull request #17751 from zhangjmruc/master
Fix over-translation, update contents to latest and some translation errors on random-functions, encoding-functions, conditional-functions and misc.
2020-12-04 14:58:31 +03:00
Ilya Yatsishin
6957e0de87
Merge pull request #17452 from sevirov/sevirov-DOCSUP-4266-document_alter_update_delete_partition
DOCSUP-4266: Document the SQL-statement ALTER UPDATE/DELETE ... IN PARTITION
2020-12-04 14:40:51 +03:00
Ilya Yatsishin
2e9f10ab3e
Merge pull request #17767 from bharatnc/ncb/refact-zk-path
Improve zookeeper path concatenation inside DDLWorker
2020-12-04 14:34:05 +03:00
Vladimir Chebotarev
a5e3d89649 Attempt to use IOStream in AWS SDK. 2020-12-04 13:37:08 +03:00
alexey-milovidov
07f914769e
Merge pull request #17739 from spongedu/check_systemlog_table_engine_define
add check for systemlog tables' engine definition
2020-12-04 13:01:17 +03:00
alexey-milovidov
57b12f4fc1
Merge pull request #17760 from MasterOdin/patch-1
Fix note display on alter/index doc
2020-12-04 12:56:08 +03:00
alexey-milovidov
18f0f63ffe
Merge pull request #17786 from bharatnc/ncb/doc-system-tables
docs -  add missing examples for various system tables
2020-12-04 12:50:24 +03:00
alexey-milovidov
b514b9544b
Merge pull request #17791 from achimbab/master
Fix a typo
2020-12-04 12:32:52 +03:00
philip.han
93ec2db45b Fix typo 2020-12-04 18:24:42 +09:00
Azat Khuzhin
68c4da1203 Use max_threads=2 for countMatches to keep it under 2 seconds
Although I don't like this idea.
2020-12-04 07:54:34 +03:00
jianmei zhang
764b06f28b Fix over-translation and update contents to latest on random-functions, encoding-functions and conditional-functions 2020-12-04 11:18:44 +08:00
Ivan
315ff4f0d9
ANTLR4 Grammar for ClickHouse and new parser (#11298) 2020-12-04 05:15:44 +03:00
Ivan
6a48d25b74
Fix arcadian build (#17781) 2020-12-04 02:32:17 +03:00
bharatnc
4f33a6b044 few fixes and formatting 2020-12-03 13:48:02 -08:00
bharatnc
67e6cc8faf docs - add more examples for systems tables 2020-12-03 13:47:56 -08:00
Alexander Kazakov
81d9d3237f
In mysqlxx::Pool: fix for reconnection problem (#17681)
Remove stalled unrecoverable connections from myqsl connections pool
2020-12-03 23:36:10 +03:00
Alexey Milovidov
1e943babcc Do not add empty query to browser history 2020-12-03 23:20:09 +03:00