Commit Graph

2612 Commits

Author SHA1 Message Date
Alexey Milovidov
60d660e263 Merge branch 'master' into merge-constraints 2019-08-26 16:13:44 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Alexey Milovidov
2a3e0eb1f1 Merge branch 'master' into merge-constraints 2019-08-26 04:30:31 +03:00
Nikita Vasilev
2dbfabd08c fix Set index check useless (#6651)
* fixed useless detection

* fixed useless detection

* fix

* fix

* fix
2019-08-25 01:01:36 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
alexey-milovidov
eeeaf8fbee
Merge pull request #6643 from yandex/double-whitespaces
Added a check for double whitespaces
2019-08-23 23:10:12 +03:00
alexey-milovidov
012a5f8911
Merge pull request #6596 from Enmk/hasToken
hasToken function implementation
2019-08-23 21:41:33 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
alexey-milovidov
7012a421c6
Merge branch 'master' into alter_table_drop_detached_part 2019-08-23 05:22:07 +03:00
alexey-milovidov
3a237b4375
Merge pull request #6617 from yandex/fix_too_many_parts_while_mutation_6502
Fix too many parts while mutation
2019-08-23 04:27:43 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
Alexander Tokmakov
acce56095f limit number of background threads for mutations 2019-08-22 22:35:46 +03:00
Vasily Nemkov
6d78e3be94 hasToken function implementation
* Function to check if given token is present in a string;
* Special case for hasToken to 'tokenbf_v1' index;
* Test cases for hasToken()
* Test case for hasToken() + 'tokenbf_v1' integration
2019-08-22 18:00:35 +03:00
alesapin
be5dd3b994 Remove stupid logic 2019-08-21 16:15:44 +03:00
Alexander Tokmakov
5cb8605f61 limit number of mutations in the queue 2019-08-21 16:10:33 +03:00
alesapin
d2fe947535 Add test for race condition, found it and fix it 2019-08-21 15:32:48 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
d848009827 Fixed false data race in "MergeTreeDataPart::is_frozen" field 2019-08-21 06:16:59 +03:00
alesapin
e44ab4f4cd Add tests for partitions alter 2019-08-20 22:04:58 +03:00
alesapin
8417eb9d95 Remove old tests 2019-08-20 21:35:35 +03:00
Alexey Milovidov
c8859febcb Merge branch 'master' into added-test-for-race-conditions 2019-08-20 21:05:25 +03:00
alesapin
120e27a385 Lock parts with dirty hack 2019-08-20 21:00:48 +03:00
alesapin
9c8ec6e4fc Fixes for replicated merge tree 2019-08-20 20:16:32 +03:00
alesapin
00bdd6c680 Support move partition 2019-08-20 12:59:19 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
alesapin
8408ffbfa6 Almost working replicated MT 2019-08-20 11:38:02 +03:00
Alexey Milovidov
22a11343e8 Attempt to fix race condition 2019-08-19 22:02:20 +03:00
Alexey Milovidov
d2e5789f82 Fixed strange code in mutations that may lead to memory corruption 2019-08-19 21:12:22 +03:00
alesapin
e9e67a2688 Almost compilable 2019-08-19 20:59:16 +03:00
Alexander Tokmakov
c62eb7a3ae check columns count and types 2019-08-19 19:51:50 +03:00
alesapin
4ccdb8f92e Better code 2019-08-19 17:40:12 +03:00
alesapin
f2a8c18c1f Simplify lock 2019-08-19 14:18:58 +03:00
alesapin
69015f292e Fix wrong merge 2019-08-19 14:18:39 +03:00
alesapin
6d29ed99d9 Fix bug with enable_mixed_granularity_parts and mutations 2019-08-19 13:37:04 +03:00
alesapin
a85cdc91a6 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-08-19 11:34:02 +03:00
alesapin
99e85ff753 Fix build 2019-08-19 11:25:07 +03:00
alesapin
e7542810bb Merge with master 2019-08-19 11:20:48 +03:00
alexey-milovidov
e2687fc2d5
Merge pull request #6513 from yandex/parts-race-condition
Fix race condition in system.parts vs. ALTER
2019-08-17 22:30:16 +03:00
alesapin
defc1e30ca Some improvements 2019-08-16 18:57:19 +03:00
alesapin
6333f4b074 Better 2019-08-16 12:20:44 +03:00
Alexey Milovidov
b66719725f Fix race condition in system.parts vs. ALTER 2019-08-16 03:49:33 +03:00
alexey-milovidov
01a046e8ca
Merge pull request #5053 from nikvas0/nikvas0/index_mutate
indices and mutations
2019-08-16 02:44:48 +03:00
alexey-milovidov
a466c7aebd
Merge pull request #6299 from CurtizJ/order-by-efficient
Optimizations of ranges selection while reading with enabled optimize_read_in_order.
2019-08-16 02:39:53 +03:00
alexey-milovidov
a70bfa13d4
Merge pull request #6467 from nikitamikhaylov/system_metric_log
system.metric_log table
2019-08-16 02:28:53 +03:00
alesapin
f988ff538b Less code 2019-08-15 20:02:04 +03:00
Nikita Vasilev
00a5fe7836 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-15 19:48:57 +03:00
alesapin
d81961c4ca Fix strange code 2019-08-15 12:43:31 +03:00
Gleb Novikov
ab1c4139de Added ReplicatedMergeTree support and test for constraints, also added VIOLATED_CONSTRAINT error 2019-08-14 22:51:03 +03:00
CurtizJ
0b3d7d8032 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 21:26:25 +03:00
alesapin
e391ce813d refactoring 2019-08-14 18:20:52 +03:00
chertus
ddde50c542 minor fixes in includes 2019-08-14 17:06:16 +03:00
alesapin
6a283b6bde Remove segfault 2019-08-14 14:59:45 +03:00
alesapin
949890ee90 Merged 2019-08-14 12:46:30 +03:00
CurtizJ
94bca8315d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 01:41:38 +03:00
alesapin
96f62fefcc Add mutex for settings 2019-08-13 19:34:52 +03:00
alesapin
031bfc7bf3 Remove reference 2019-08-13 17:46:18 +03:00
Nikita Mikhaylov
bbe20b3f9f done 2019-08-13 17:31:46 +03:00
alesapin
f988090111 Remove redundant move 2019-08-13 15:10:58 +03:00
alesapin
b00903330f Remove empty block 2019-08-13 15:03:42 +03:00
alesapin
bf5ec73582 Fix clang build 2019-08-13 14:40:45 +03:00
alesapin
7b1039568c Revert old changed 2019-08-13 14:24:18 +03:00
alesapin
ad81c743c1 Buildable code 2019-08-13 13:29:31 +03:00
alesapin
428c753ed7 Merge with master 2019-08-13 11:37:47 +03:00
alesapin
8e72d4c2ec Tryin COW settings 2019-08-13 11:35:49 +03:00
alesapin
98d38e041f Fix recreation of replicated table with fixed granularity 2019-08-12 16:30:29 +03:00
Alexey Milovidov
fbaf6b9a4b Parallel loading of data parts #6074 2019-08-11 23:02:51 +03:00
Alexey Milovidov
0b1a4420cb More simple 2019-08-11 22:30:39 +03:00
Alexey Milovidov
006a5e51b7 Merge branch 'master' into speed-up-parts-removal 2019-08-11 22:26:24 +03:00
Alexey Milovidov
1cd87078c2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-11 22:24:53 +03:00
Alexey Milovidov
2f73b72007 Style 2019-08-11 22:24:42 +03:00
Alexey Milovidov
ed7db76c94 Speed-up parts removal #6372 2019-08-11 22:14:42 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
alexey-milovidov
8520288044
Merge pull request #6416 from 4ertus2/some
Refactoring: move collectUsedColumns() to SyntaxAnalyzer
2019-08-11 05:16:22 +03:00
Nikita Vasilev
75e381bde4 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-10 23:07:50 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
chertus
e06c994b0e refactoring: move collectUsedColumns from ExpressionAnalyzer to SyntaxAnalyzer 2019-08-09 17:50:04 +03:00
alesapin
2803fcc2ba Make atomic settings 2019-08-09 16:07:19 +03:00
Alexey Milovidov
2ba185b4aa Addition to prev. revision 2019-08-08 23:10:58 +03:00
Alexey Milovidov
a6e4b34ab4 Fixed unpleasant code #6401 2019-08-08 23:02:30 +03:00
Alexander Tokmakov
ae6efb23b4 Merge branch 'master' into alter_table_drop_detached_part 2019-08-08 22:31:31 +03:00
alesapin
a03fcd9f12 Make settings values atomic to avoid race conditions 2019-08-08 22:29:56 +03:00
alesapin
e0d18c0fe8 Merge branch 'master' into merge_tree_settings_alter 2019-08-08 18:16:22 +03:00
alexey-milovidov
355b1e5594
Merge pull request #6352 from yandex/no_space_left_on_device_message
Print extra info in exception message for "no space left on device"
2019-08-07 22:28:38 +03:00
alesapin
7409f1a3de More comments 2019-08-07 18:33:10 +03:00
alesapin
13e4581317 More general 2019-08-07 18:21:45 +03:00
Alexander Tokmakov
5cf183cbe3 fixes after review 2019-08-07 15:55:27 +03:00
Alexander Tokmakov
aefc664819 refactor throwFromErrno 2019-08-06 21:54:06 +03:00
Nikita Vasilev
90ce4608fb Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-06 21:07:13 +03:00
alesapin
e62101b8e8 Better comment 2019-08-06 19:29:31 +03:00
Alexander Tokmakov
c3039196da fixes 2019-08-06 17:51:27 +03:00
alesapin
ca29343f54 Uniq settings 2019-08-06 17:09:36 +03:00
alesapin
303c4e5a58 Make index_granularity_bytes immutable 2019-08-06 16:06:09 +03:00
alesapin
84fd4906ca Changes for engines 2019-08-06 16:04:29 +03:00
alesapin
52b9658bcf Merge with master 2019-08-06 15:55:12 +03:00
Alexander Tokmakov
c96b10be9f style fixes 2019-08-06 15:51:10 +03:00
Alexander Tokmakov
75d10f4160 print extra info in exception message 2019-08-05 22:41:20 +03:00
Nikita Vasilev
7b8c0f1750 experiment 2019-08-05 21:06:05 +03:00
CurtizJ
cfe32ad89b Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-04 21:43:00 +03:00
Nikita Vasilev
4c53b90e66 fixed MergedColumnOnlyOutputStream 2019-08-04 21:28:46 +03:00
Nikolai Kochetov
b0b7ed791d Merge branch 'master' into processors-and-output-formats 2019-08-04 19:47:26 +03:00
Nikita Vasilev
4a39538625 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-04 16:58:21 +03:00
alexey-milovidov
261abd6c41
Merge pull request #6319 from nikvas0/nikvas0/fix_set_index
Add Comments for set index functions
2019-08-04 16:39:57 +03:00
Nikita Vasilev
5d47a858c5 add comments 2019-08-04 16:03:38 +03:00
Nikolai Kochetov
599f3ddf6e Merged with master. 2019-08-04 15:35:21 +03:00
alexey-milovidov
e61f647492
Merge pull request #6282 from nikvas0/nikvas0/fix_set_index
fix operators in set index
2019-08-04 02:52:57 +03:00
alexey-milovidov
d3e4249420
Merge branch 'master' into ttldropparts 2019-08-03 02:17:29 +03:00
Alexey Milovidov
21cb7de777 More validation of part_name 2019-08-02 23:21:31 +03:00
alexey-milovidov
f8980e691e
Merge pull request #6274 from CurtizJ/ttl-old-parts
TTL improvements.
2019-08-02 22:51:28 +03:00
Nikita Vasilev
bfa9a2c86f fixed index condition 2019-08-02 22:21:55 +03:00
CurtizJ
e06a53a5d9 fix ranges selection at reading in order 2019-08-02 20:34:29 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
CurtizJ
a6e85a331a more optimal ranges selection at reading in order 2019-08-02 19:37:43 +03:00
CurtizJ
5f7ebb18ed more optimal ranges selection at reading in order 2019-08-02 19:16:18 +03:00
Nikita Vasilev
7aacbbdc5a fix bug 2019-08-01 22:18:36 +03:00
CurtizJ
b8dff6ebb1 more optimal ranges selection at reading in order 2019-08-01 22:03:39 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
CurtizJ
c30bdecf6d add missing comments 2019-08-01 15:00:35 +03:00
CurtizJ
f224269d41 filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query 2019-08-01 14:10:42 +03:00
Igr Mineev
0f1e8404dc Merge branch 'master' of github.com:yandex/ClickHouse into feature_multiple_disks 2019-08-01 13:42:59 +03:00
Igr Mineev
fc79ed86ef Ready for review 2019-08-01 13:29:14 +03:00
Alexey Milovidov
12f6b75284 Fixed error 2019-08-01 05:34:58 +03:00
Alexey Milovidov
bc9d620155 Fixed the case when malicious ClickHouse replica can force clickhouse-server to write to arbitrary path 2019-07-31 22:31:04 +03:00
Alexander Tokmakov
f0836553d4 drop detached partition 2019-07-31 18:27:21 +03:00
Alexander Tokmakov
c6717e0d3f refactor attachPartition 2019-07-30 22:11:15 +03:00
Alexander Tokmakov
2f33df1b2e rename all parts before attaching 2019-07-30 20:24:40 +03:00
Igr Mineev
7f7b47fc0a Add check of RW access to paths on start. Add multiple disks tests. 2019-07-30 19:15:57 +03:00
Igr Mineev
31c36efa25 Merge branch 'master' of github.com:yandex/ClickHouse into feature_multiple_disks 2019-07-30 19:13:58 +03:00
Alexander Tokmakov
3c15b87003 Merge branch 'master' into alter_table_drop_detached_part 2019-07-29 14:29:23 +03:00
alesapin
86831fe500 Add ability to create immutable settings 2019-07-29 14:03:50 +03:00
Alexander Tokmakov
0fc47fbbe4 fixes 2019-07-29 13:27:37 +03:00
alesapin
d9a2ac123a Fix small typo and merge 2019-07-29 12:17:37 +03:00
Nikita Vasilev
4c5003b3b9 const & 2019-07-28 14:45:50 +03:00
Nikita Vasilev
908623c029 style 2019-07-28 14:32:03 +03:00
Nikita Vasilev
63fe714420 fix 2019-07-28 14:10:35 +03:00
Sergi Vladykin
c5a42a6948 TTL: Only drop altogether the expired parts and not partially prune them.
Though in regular merges eviction of expired values still must happen.
2019-07-28 13:30:46 +03:00
CurtizJ
d69d68f065 rename setting 'optimize_pk_order' and some functions 2019-07-28 04:16:56 +03:00
CurtizJ
95a6b85267 fix reading in order of sorting_key 2019-07-28 03:41:26 +03:00
Nikita Vasilev
1118ce04b9 fixed 2019-07-27 18:36:40 +03:00
CurtizJ
08d5ebb54d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-27 10:38:10 +03:00
Nikita Vasilev
7efb1bcb12 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-07-27 10:30:43 +03:00
CurtizJ
12dcfe1f25 reduce number of read rows while reading in reverse order 2019-07-27 03:33:47 +03:00
CurtizJ
b1d981ec3a better pipeline while reading in pk_order 2019-07-27 01:18:27 +03:00
alexey-milovidov
71cef7beac
Merge pull request #6156 from dimarub2000/master
ISSUE-6136: Fix DB::Exception throwed by bitmapContains
2019-07-25 23:00:42 +03:00
Igr Mineev
7a31feeec0 Add tests for multiple disks. Fix Alter query. 2019-07-25 21:21:01 +03:00
Alexander Tokmakov
3ba26aba43 tests 2019-07-25 19:28:08 +03:00
Alexander Tokmakov
e4212bfe59 add full part name to detached_parts 2019-07-25 19:26:36 +03:00
dimarub2000
f53f22fd17 ISSUE-6136: Fix DB::Exception throwed by bitmapContains 2019-07-25 18:56:20 +03:00
Igr Mineev
e7e2627201 Checking unique names for volumes. 2019-07-25 14:42:48 +03:00
Alexander Tokmakov
1805ab5736 attach 2019-07-25 13:46:07 +03:00
alexey-milovidov
56131a7fe7
Merge pull request #6080 from abyss7/issue-6071
Check background_task_handle before use
2019-07-25 04:16:47 +03:00
CurtizJ
3d706ec20e support 'order by' optimiation with simple monotonic functions 2019-07-24 17:23:57 +03:00
alesapin
8a00ce5ff1 Intermediate step 2019-07-24 15:56:39 +03:00
Alexander Tokmakov
ad787938f5 better detached part name parsing 2019-07-23 22:43:33 +03:00
Ivan Lezhankin
e8ef13edfa Check background_task_handle 2019-07-23 20:34:57 +03:00
alesapin
6e458a6a68 Fix secondary indices write with adaptive granularity 2019-07-23 18:27:36 +03:00
Igr
3e017ec69c
Merge branch 'master' into feature_multiple_disks 2019-07-23 16:38:20 +03:00
Igr Mineev
e967c23adb Add Space interface for reservation. Add move to volume command 2019-07-23 16:34:17 +03:00
CurtizJ
e559c8f949 fix build 2019-07-21 21:17:28 +03:00
CurtizJ
1bec5a8241 refactor MergeTree select streams 2019-07-19 17:56:00 +03:00
CurtizJ
2797c16930 fix prewhere at fetching columns 2019-07-19 13:14:27 +03:00
CurtizJ
b9dc472071 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-19 01:09:59 +03:00
CurtizJ
12b3560def build fixes 2019-07-18 21:34:15 +03:00
Igr Mineev
52bca488dc Add alter move part command 2019-07-18 18:19:03 +03:00
CurtizJ
a3d25790bd basic implementation of reading in pk order and 'order by' optimization 2019-07-18 17:41:11 +03:00
Amos Bird
71233e11a9 minor updates. 2019-07-17 14:17:34 +08:00
Amos Bird
9fa955403b Optimize count()
Choose the smallest column to count if possible.
2019-07-17 02:29:17 +08:00
Igr Mineev
770b74ac17 Add names for volumes 2019-07-16 21:20:47 +03:00
alexey-milovidov
45b7588ab1
Merge pull request #6025 from dimarub2000/master
Minor fixes for FullTextIndex string functions
2019-07-16 19:30:32 +03:00
Igr Mineev
ad497fbaa1 Fix bug with duplication of parts on restart 2019-07-16 16:06:23 +03:00
Dmitry Rubashkin
dcd8696466 Minor fixes 2019-07-16 14:40:11 +03:00
Igr Mineev
90fab48cd7 Stylefixes 2019-07-16 14:07:04 +03:00
Igr Mineev
21e0bec3d0 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-07-16 13:45:07 +03:00
alexey-milovidov
ceffbf39d6
Merge pull request #5965 from dimarub2000/master
Primary key, MergeTreeIndexFullText and MergeTreeIndexSet support for string functions
2019-07-16 03:36:42 +03:00
Alexey Milovidov
27b9f79cba Fixed error after refactoring 2019-07-15 23:26:55 +03:00
Gleb Novikov
c1d91222d5 Ranamed setPrimaryKeyIndicesAndColumns to setProperties 2019-07-13 13:42:52 +03:00
alexey-milovidov
a93c76837e
Merge pull request #5953 from abyss7/fix-filter-table
Implement getDatabaseName() and rename() for all storages
2019-07-13 00:51:39 +03:00
dimarub2000
4005987fc4 multiSearchAny fixed, tests added, minor syle changes 2019-07-12 14:35:17 +03:00
dimarub2000
e5d4f11c73 Deleted some extra implementations, fixed style. multiSearchAny still not working. 2019-07-11 16:44:44 +03:00
dimarub2000
1480b8e62c Actually set index already woks for everything. Here are some tests. 2019-07-11 15:31:24 +03:00
dimarub2000
88778b0f5b minor style changes 2019-07-10 18:12:02 +03:00
dimarub2000
f5ba5e3ca9 Merge branch 'master' of github.com:dimarub2000/ClickHouse 2019-07-10 18:08:10 +03:00
dimarub2000
c9a5b3c9ab primary key and MergeTreeIndexFullText support for string functions 2019-07-10 17:53:57 +03:00
Vitaly Baranov
3a74f326a8 Fix unused variable in checkDataPart.cpp 2019-07-10 15:13:10 +03:00
Ivan Lezhankin
befb3ce15b Merge branch 'master' into fix-filter-table 2019-07-10 13:27:26 +03:00
Ivan Lezhankin
9f01fa7aaa Implement getDatabaseName() and rename() for all storages 2019-07-09 18:40:21 +03:00
alesapin
6a3b543e10 Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 11:21:44 +03:00
Alexey Milovidov
19059ef650 One more fix for PVS-Studio 2019-07-08 02:29:54 +03:00
alexey-milovidov
8d4358f19c
Merge pull request #5919 from dimarub2000/master
startsWith now uses PK index
2019-07-08 02:06:05 +03:00
alexey-milovidov
0480706ff4
Update KeyCondition.cpp 2019-07-08 00:28:03 +03:00
dimarub2000
0b756c48a8 also style changes 2019-07-07 18:56:15 +03:00
dimarub2000
95118a5fa3 also style changes 2019-07-07 18:54:13 +03:00
dimarub2000
94523c00cd minor style changes 2019-07-07 18:52:20 +03:00
dimarub2000
2693ce27ff startsWith now uses PK index 2019-07-07 18:48:34 +03:00
CurtizJ
a49112a14e Merge branch 'master' of https://github.com/yandex/ClickHouse into order-by-efficient 2019-07-05 16:41:48 +03:00
CurtizJ
410b62f7fa Merge branch 'clickhouse-4013' of https://github.com/anrodigina/ClickHouse into order-by-efficient 2019-07-05 13:48:04 +03:00
Gleb Novikov
71c2ca0fe9 Merge branch 'master' into table-constraints 2019-07-04 22:40:00 +03:00
alesapin
65437d2289 Fix final mark and tests 2019-07-04 13:21:14 +03:00