Commit Graph

2612 Commits

Author SHA1 Message Date
alesapin
a0496da05f Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-04 12:46:54 +03:00
CurtizJ
187812a00e cleanup 2019-07-03 21:34:37 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
CurtizJ
35ad1a3b6b implement dns cache with asynchronous update 2019-07-03 19:26:22 +03:00
alesapin
3925a3bd13 Generalize check query 2019-07-03 16:17:19 +03:00
alexey-milovidov
50c22ef71a
Merge pull request #5628 from yandex/index_granularity_by_default
Enable adaptive index granularity by default
2019-07-03 02:15:33 +03:00
alexey-milovidov
d81ae49f2c
Merge pull request #5755 from 4ertus2/bugs
Fix wrong ColumnConst.isColumnNullable()
2019-07-03 02:06:07 +03:00
alexey-milovidov
1bda6994ad
Merge pull request #5832 from yandex/fix_low_cardinality_check
Fix low cardinality check
2019-07-02 17:06:06 +03:00
alesapin
cbb0d640f4 Add comments 2019-07-02 14:34:16 +03:00
alesapin
f68b5216a8 Fix prefix reading and skip check for low cardinality dictionary 2019-07-02 13:55:47 +03:00
Nikita Lapkov
9641d058d0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-07-01 21:11:26 +00:00
chertus
5df4ad0f28 Merge branch 'master' into bugs 2019-07-01 14:49:01 +03:00
Gleb Novikov
a146b7383e Merge branch 'master' into table-constraints 2019-06-30 11:32:02 +02:00
Alexey Milovidov
88fc72f0b9 Merge branch 'feature/bloom_filter' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/bloom_filter 2019-06-29 20:44:11 +03:00
Nikita Lapkov
2a131185b0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-06-28 18:20:23 +00:00
Nikita Lapkov
f8d2b5effd introduce Backtrace class 2019-06-28 18:06:38 +00:00
chertus
f19dee706a move IColumn.isColumnConst() outside of interface 2019-06-27 22:28:52 +03:00
chertus
db7c8748e9 remove IColumn.isColumnNullable() 2019-06-27 21:50:20 +03:00
Maxim Akhmedov
2cacc3cfd2 CHYT-142: extend KeyCondition interface so that it returns BoolMask. 2019-06-27 16:31:33 +03:00
chertus
65c0d23efa better casts to ColumnNullable 2019-06-26 20:20:33 +03:00
Nikita Vasilev
7079c91a0e Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-25 16:34:11 +03:00
Nikita Vasilev
9873b04611 StringRef -> String (race cond) 2019-06-25 16:10:09 +03:00
alesapin
4a8a70a079
Merge pull request #5720 from coraxster/fix-5377
MergedColumnOnlyOutputStream. Skip empty blocks. Fix 5377
2019-06-25 13:35:09 +03:00
dmitry kuzmin
c72e4dfe08 5337: clang compiler fix 2019-06-24 18:07:01 +03:00
Nikita Vasilev
7b7517ff85 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-24 16:44:44 +03:00
dmitry kuzmin
c988293e1e 5337 fix: MergedColumn. skip empty blocks 2019-06-23 07:30:29 +03:00
alesapin
efc0f7f65e Remove unused method 2019-06-21 18:19:47 +03:00
alexey-milovidov
606b074a4b
Merge pull request #5659 from yandex/ignore-mutation-limits
Ignore query execution limits and limits for max parts size for merge while executing mutations.
2019-06-21 02:14:41 +03:00
alesapin
3f7892ef50 Fix typo 2019-06-20 22:21:17 +03:00
alesapin
80f27968ac Add test for interaction of tables with different granularity and different versions 2019-06-20 19:25:32 +03:00
alesapin
4ae502eaa6 Fix bug with wrong granularity detection 2019-06-20 11:48:56 +03:00
zhang2014
8221dd2a1a fix build and test failure 2019-06-20 08:33:37 +08:00
Igr Mineev
23049ac9e8 Add mergetree part move in background. 2019-06-19 20:56:41 +03:00
zhang2014
374aac3501 fix build & chmod shell test 2019-06-20 00:32:20 +08:00
alesapin
dd37370aab Fix test and add one 2019-06-19 19:16:13 +03:00
zhang2014
166018e41e fix code style & rename minmax, set 2019-06-19 23:30:48 +08:00
zhang2014
a50aea09f1 fix float in bloom filter 2019-06-19 23:13:21 +08:00
zhang2014
d145295163 convert type with condition 2019-06-19 23:12:06 +08:00
zhang2014
6c8ff6dc31 add some test 2019-06-19 23:12:05 +08:00
zhang2014
f52b16e1e1 support bloom filter for any type 2019-06-19 23:12:05 +08:00
alesapin
fefce49c8f Mixed parts by setting 2019-06-19 17:46:06 +03:00
alesapin
dd2e4fd805 Bug fixes 2019-06-19 15:30:56 +03:00
alesapin
f0c273ee4c More correct version 2019-06-19 14:59:08 +03:00
alesapin
d1de7431e1 Compilable 2019-06-19 13:26:26 +03:00
alesapin
7e11c3c78b Merge branch 'master' into index_granularity_by_default 2019-06-19 13:08:12 +03:00
alesapin
b544b62e44 A log of bugs 2019-06-19 13:07:56 +03:00
alesapin
4f98f875c3
Add ability to write final mark for *MergeTree engines family (#5624)
Add the ability to write final mark to *MergeTree engines family.
2019-06-18 15:54:27 +03:00
alesapin
0bfb7b18ce Fix directory check 2019-06-18 14:38:04 +03:00
CurtizJ
e6dd92f9e1 ignore max part size for merge setting while executing mutations 2019-06-17 22:41:48 +03:00
proller
dae5087fcf Build and test fixes 2019-06-17 19:50:31 +03:00
alesapin
fb22200890 Fix name hidding and stupid bug 2019-06-17 18:35:53 +03:00
alesapin
9e7d23b22e Style fix 2019-06-17 16:29:10 +03:00
alesapin
3a4dcfbacd Fix inconsistency in zookeeper metadata and disable adaptive granularity for old format 2019-06-17 13:34:25 +03:00
alesapin
e73cdbae90 Fix name hidding 2019-06-17 12:22:44 +03:00
alesapin
02af85411c Merge branch 'master' into index_granularity_by_default 2019-06-17 12:02:03 +03:00
alexey-milovidov
5fd319d0e9
Merge pull request #5648 from yandex/remove-number-of-stat-calls
Reduce number of "stat" syscalls for MergeTree data parts
2019-06-17 09:30:29 +03:00
Alexey Milovidov
62a3d00772 Added comment 2019-06-16 23:50:06 +03:00
Alexey Milovidov
ee5dcd50a0 Lowered CPU overhead for small data parts 2019-06-16 23:42:03 +03:00
Alexey Milovidov
14be0ca281 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:13:54 +03:00
Alexey Milovidov
49c4f2ffed Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:11:30 +03:00
Alexey Milovidov
e3b21be1bb Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:02:45 +03:00
Alexey Milovidov
0ad13ca3d1 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:59:30 +03:00
Alexey Milovidov
c1aa767a04 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:53:05 +03:00
Alexey Milovidov
e4f314f88d Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:49:12 +03:00
Alexey Milovidov
801f34d325 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:42:05 +03:00
Alexey Milovidov
b6acb29625 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:36:15 +03:00
Alexey Milovidov
b494d17ca6 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:32:52 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
Gleb Novikov
15004ce055 Merge branch 'master' into table-constraints 2019-06-14 23:10:48 +03:00
Alexey Milovidov
10722f53c7 Fixed performance degradation in SELECT from MergeTree tables #5631 2019-06-14 22:11:41 +03:00
alesapin
22026e0333 Enable adaptive index granularity by default 2019-06-14 18:39:21 +03:00
alexey-milovidov
bc387e865f
Merge pull request #5549 from yandex/fix_deduplication_bug
Fix complex bug in deduplication
2019-06-14 09:23:15 +03:00
Igr Mineev
842c72bb6d Merge branch 'master' into feature_multiple_disks 2019-06-09 15:38:54 +03:00
Igr Mineev
54b688e559 Stylefix 2019-06-09 15:31:03 +03:00
Igr Mineev
0eba56c4a7 Added move command. 2019-06-07 22:16:42 +03:00
alesapin
53e62b83d2 Fix complex bug in deduplication 2019-06-06 18:28:02 +03:00
CurtizJ
27d8b90dd9 fixed alter modify ttl on ReplicatedMergeTree and test added 2019-06-05 19:22:41 +03:00
Anastasiya Rodigina
77fa9c30ee fix little misprint 2019-06-03 07:36:55 +00:00
Anastasiya Rodigina
4ff02cff4d Fix some problems with tests, add more tests, more syntetic tests are coming today 2019-06-03 06:00:54 +00:00
Gleb Novikov
e7293486bd Added ALTER TABLE support to constraints (ADD CONSTRAINT, DROP CONSTRAINT) 2019-06-02 17:41:12 +03:00
Gleb Novikov
2b5cf46842 Merge branch 'master' into table-constraints 2019-06-02 08:33:36 +03:00
proller
1b0d1a4450 Info about frozen parts in system.parts (#5471)
* wip

*    wip

* wip

* Clean

* fix test

* clean

* fix test

* fix test
2019-05-31 07:03:46 +03:00
Gleb Novikov
337897c4b8 Merge branch 'master' into table-constraints 2019-05-26 12:36:02 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
2019-05-25 20:20:35 +03:00
alexey-milovidov
e0e35f3258
Merge pull request #5246 from nikvas0/nikvas0/fix_minmax_null
[wip] fix null minmax
2019-05-25 16:11:23 +03:00
alexey-milovidov
cb89e506a4
Merge pull request #5353 from yandex/aku/detached-parts-5164
Add system.detached_parts table.
2019-05-25 16:08:33 +03:00
Gleb Novikov
c401d282da Merge branch 'master' into table-constraints 2019-05-25 14:26:08 +03:00
Anastasiya Rodigina
6c779e63b0 Edit reverse order 2019-05-25 14:09:23 +03:00
Igor Mineev
15ee6207ab Chg 'Schema' to 'StoragePolicy'. Add system.disks. Add system.storage_politics. Add disk to system.parts. Add policy to system.tables. 2019-05-24 22:03:07 +03:00
chertus
9eca696e82 actualize isNumber for Decimal 2019-05-24 15:11:03 +03:00
Igor Mineev
4f61c9d30f Const Schema fix 2019-05-22 22:20:10 +03:00
Igor Mineev
a209f45f62 Add keep_free_space_ratio param 2019-05-21 20:57:17 +03:00
Igor Mineev
320d509b42 Fix default data path 2019-05-21 20:27:43 +03:00
Igor Mineev
f504c21229 Fetch fix. Style fix 2019-05-21 17:06:33 +03:00
Alexander Kuzmenkov
43655a8db7 Add system.detached_parts table.
https://github.com/yandex/ClickHouse/issues/5164
2019-05-21 15:06:36 +03:00
Igor Mineev
645ce7c9a4 Bugfix 2019-05-21 14:09:57 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Gleb Novikov
2e7b6af137 Merge branch 'master' into table-constraints 2019-05-19 09:03:04 +03:00
Anastasiya Rodigina
b3d811a199 Fix some tests 2019-05-18 19:46:29 +03:00
Anastasiya Rodigina
6132b57beb Fix style issues 2019-05-18 16:22:49 +03:00
anrodigina
d7ee2cb907
Merge branch 'master' into clickhouse-4013 2019-05-18 15:34:23 +03:00
Anastasiya Rodigina
bc09b51316 Add reading in pk_order 2019-05-18 15:21:40 +03:00
Gleb Novikov
ce93896608 Added constraints description to MergeTree and related storages 2019-05-18 11:05:52 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage.
Also a couple of massive include-refactorings with better forwarding
2019-05-17 17:34:25 +03:00
Igor Mineev
f74b7331f5 Minor fixes 2019-05-15 19:49:55 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
Igor Mineev
74466de6d8 Minor fixes. 2019-05-13 23:58:22 +03:00
Nikita Vasilev
ee3c50e1a0 mayBeTrueOnGranule 2019-05-12 20:08:28 +03:00
Nikita Vasilev
3e02eaf28d fix null minmax 2019-05-12 20:01:36 +03:00
Igor Mineev
6596c3f6e0 DataPartsExchange new protocol with data size. StorageReplicatedMergeTree::fetchPartition multipath fix. Choosing on mutate any disk to write mutation file. 2019-05-12 17:57:23 +03:00
alexey-milovidov
f7343ecb6f
Merge pull request #4639 from IvanKush/feat/parallel-alter-modify
feat alter:  parallelize processing of parts in alter modify
2019-05-12 00:39:46 +03:00
Igor Mineev
af300c667b Bugfix 2019-05-11 23:44:43 +03:00
Igor Mineev
b4b000bf84 Merge branch 'master' into feature_multiple_disks 2019-05-11 21:50:29 +03:00
Igor Mineev
a3f513914b Schemas names fix. 2019-05-11 21:00:43 +03:00
ivan-kush
ab6558b8b4 add spaces amp 2019-05-10 17:34:02 +03:00
Nikita Vasilev
05f9373af0 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-09 21:59:22 +03:00
Nikita Vasilev
6c0722db04 fix mutations with parts 2019-05-09 20:27:20 +03:00
Nikita Vasilev
8d2b32fda8 clear index 2019-05-09 17:25:18 +03:00
proller
deddb40bf2 fix 2019-05-08 17:25:17 +03:00
proller
10c349e398 Fix macos build 2019-05-08 15:26:35 +03:00
Ivan Kush
2a356791ab Merge branch 'master' into feat/parallel-alter-modify 2019-05-07 23:53:14 +03:00
alexey-milovidov
63b3d7dbdb
Update MergeTreeData.h 2019-05-06 01:13:07 +03:00
alexey-milovidov
c04c614bc0
Merge branch 'master' into clickhouse-4013 2019-05-05 23:22:45 +03:00
Nikita Vasilev
18593391b4 materialize query 2019-05-05 21:53:48 +03:00
Nikita Vasilev
27aeb3a36d fix 2019-05-05 21:19:07 +03:00
Nikita Vasilev
87131d9e99 fix 2019-05-05 15:17:30 +03:00
Nikita Vasilev
85564c3a84 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-05 14:34:10 +03:00
Nikita Vasilev
11d2785e8e parts drop 2019-05-05 10:59:07 +03:00
Alexey Milovidov
b2443f6aa6 Removed huge chunk of bad code 2019-05-04 06:45:58 +03:00
Alexey Milovidov
24dc2c858a Removed huge chunk of bad code 2019-05-03 21:07:59 +03:00
Alexey Milovidov
ad355897f7 Removed huge chunk of bad code 2019-05-03 05:09:41 +03:00
Alexey Milovidov
a6ca9f266f Removed huge chunk of bad code 2019-05-03 05:00:57 +03:00
Alexey Milovidov
41a32d8693 Removed bad code 2019-05-03 03:27:11 +03:00
Alexey Milovidov
0a8e888671 Fixed bad code 2019-05-03 03:26:46 +03:00
Alexey Milovidov
9537ff0594 Miscellaneous 2019-05-03 01:51:39 +03:00
alexey-milovidov
0dd0611873
Merge pull request #5173 from yandex/rename-method
Rename method for consistency
2019-05-03 00:58:51 +03:00
ivan-kush
9ce742e040 Merge remote-tracking branch 'upstream/master' into feat/parallel-alter-modify 2019-05-03 00:25:56 +03:00
Alexey Milovidov
270a31abb5 Rename method for consistency 2019-05-02 19:07:23 +03:00
Alexey Milovidov
6a271adad3 Added max_parts_in_total threshold to MergeTree tables 2019-05-02 17:48:54 +03:00
ivan-kush
3ecb66d965 debug stress address 2019-05-02 16:42:09 +03:00
ivan-kush
6ac5aa5e49 restart performance 2019-05-01 18:46:17 +03:00
ivan-kush
4a3a1fc6d9 return transactions cleaning 2019-05-01 15:43:43 +03:00
Ivan Kushnarenko
e38f6e08d8 debug tsan refactor trash 2019-05-01 13:26:49 +03:00
Vitaly Baranov
28d9a80072 Rename macro APPLY_FOR_SETTINGS => LIST_OF_SETTINGS. 2019-04-29 03:22:59 +03:00
Igor Mineev
e7faa04726 Fix. 2019-04-28 17:49:41 +03:00
Vitaly Baranov
1b8c01e940 Transform comments for MergeTreeSettings into descriptions. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
8277e9d8f1 Refactoring of Settings based on new template class SettingsCollection.
Add new class SettingsConstraints.
2019-04-26 19:11:05 +03:00
Vitaly Baranov
b24c69743e Use the same parameters in all APPLY_FOR_SETTINGS macros. 2019-04-26 19:11:05 +03:00
Igor Mineev
8edcae5530 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-04-24 15:35:08 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Igor Mineev
e4c8467b49 Default disk initialization bug fix. Stylefix. 2019-04-21 23:23:02 +03:00
Igor Mineev
79abe85328 New data path: disk_path + db_name + table_name. Removed default path from MergeTree Constructor 2019-04-21 21:38:44 +03:00
alesapin
d812ae7024 Use fixed_granularity as upper bound for adaptive granularity 2019-04-18 18:06:45 +03:00
Anastasiya Rodigina
0c1735f1b1 ReverseBlockInputStream, optimization of group by, tests 2019-04-18 00:20:51 +03:00
Nikita Vasilev
8e8c77a46b added indices to mutationsInterpreter 2019-04-17 20:07:07 +03:00
proller
1b020827f0 Move Poco/Ext/ThreadNumber.h to common/getThreadNumber.h (#5016) 2019-04-17 17:53:54 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212)
Add TTL for columns and tables.
2019-04-15 12:30:45 +03:00
Nikita Vasilev
20f0b17cf4 mutations 2019-04-10 20:44:39 +03:00
chertus
82dc1fb1db rewrite ASTSelectQuery (consistent children) 2019-04-09 17:22:35 +03:00
alesapin
a53b002973 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-08 14:29:33 +03:00
Igor Mineev
d05c23bd1d Clang build fix. 2019-04-06 18:21:29 +03:00
Alexey Milovidov
460b58379a Fixed bad whitespaces 2019-04-06 03:36:04 +03:00
Alexey Milovidov
571bc7065a Removed unused code related to MemoryTracker 2019-04-06 01:35:56 +03:00
Igor Mineev
563ab2a5ec Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-04-05 23:07:24 +03:00
Igor Mineev
2d805679ae Stylefixes. 2019-04-05 22:58:59 +03:00
Igor Mineev
3a38b16da1 Add rename MergeTreeData function. Add shared_ptr to disks in Volumes. 2019-04-05 22:45:59 +03:00
Igor Mineev
968b7286e2 Stylefixes. 2019-04-05 20:37:27 +03:00
Igor Mineev
e426f3bd4c MergeTree schema settings 2019-04-05 16:04:03 +03:00
Igor Mineev
0b1a33c722 Format file moved to default. Add default Storage configuration 2019-04-05 15:30:26 +03:00
Igor Mineev
7824aa528f Add Schemes to config. Parse scheme as default on MergeTreeData init 2019-04-04 20:19:11 +03:00
Igor Mineev
0441480502 Storage getDataPath -> getDataPaths 2019-04-04 16:13:59 +03:00
Igor Mineev
341e3f1c5b Add space reservation for each new MargeTreeDataPart. 2019-04-03 15:52:09 +03:00
Igor Mineev
8047d16a96 Add Path chooser. Add DiskMonitort multiple disks support 2019-04-01 21:41:19 +03:00
alesapin
f7f29fa3e7 Style fix 2019-04-01 15:10:32 +03:00
alesapin
e204be3877 Remove debug prints 2019-04-01 14:40:13 +03:00
alesapin
69b623c47c Return logic for cache 2019-04-01 14:09:30 +03:00
alesapin
37427077b8 Remove average granularity logic from code 2019-04-01 13:34:22 +03:00
alesapin
7b67200258 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-01 11:54:19 +03:00
alesapin
78e09a221a Remove debug prints, little refactoring 2019-03-30 17:43:43 +03:00
alesapin
d6293d432c Commit missed files 2019-03-30 16:49:29 +03:00
alesapin
cdc18aa801 Rename IndexGranularity to MergeTreeIndexGranularity 2019-03-30 16:44:23 +03:00
Alexey Milovidov
88e94bad74 Removed "assumeMutable" usage in one case 2019-03-29 17:17:29 +03:00
alexey-milovidov
d10b256a8a
Merge pull request #4845 from yandex/max_partitions_per_insert_block
Implement "max_partitions_per_insert_block" setting
2019-03-29 16:20:46 +03:00
Alexey Milovidov
72d021c3d7 Implement "max_partitions_per_insert_block" setting #4700 2019-03-29 12:45:55 +03:00
Alexey Milovidov
8cb1619607 Implement "max_partitions_per_insert_block" setting #4700 2019-03-29 12:34:07 +03:00
Alexey Milovidov
8d3ef5df19 Fixed data race in clearOldTemporaryDirectories 2019-03-29 12:28:16 +03:00
Alexey Milovidov
34c0682353 Removed useless method 2019-03-29 11:37:05 +03:00
alesapin
2b9e261ab2 Better naming 2019-03-29 11:24:38 +03:00
Alexey Milovidov
350a0fe129 Miscellaneous 2019-03-28 22:58:41 +03:00
alesapin
18d19aa346 More precise estimation of rows 2019-03-28 18:03:49 +03:00
alesapin
594f91dd9d Save index granularity bytes into zookeeper 2019-03-28 15:44:14 +03:00
alesapin
1b8392a3d0 Style fixed 2019-03-28 12:02:56 +03:00
alesapin
5332642fee CI Fails fixes and little performance improvement 2019-03-28 11:52:09 +03:00
alesapin
3abf5e4ac0 Better code 2019-03-28 10:45:42 +03:00
alesapin
b3210550cb Fix stupid bug 2019-03-28 10:37:46 +03:00
alesapin
77554fd644 Remove unused variable 2019-03-27 21:02:19 +03:00
alesapin
ad16c7c931 Slightly better performance on index granularity 2019-03-27 20:33:55 +03:00
alesapin
e449760fde Remove debug print 2019-03-27 19:50:01 +03:00
alesapin
5528edea93 Fix build warnings 2019-03-27 19:23:38 +03:00
alesapin
22a75196ab Slightly more faster 2019-03-27 18:57:14 +03:00
alesapin
7c8236e145 Accident change 2019-03-27 17:14:27 +03:00
alesapin
2b27b7f702 Fix indices 2019-03-26 17:40:03 +03:00
alesapin
48fb090cda Small fixes 2019-03-26 15:37:42 +03:00
alesapin
0378400972 Move all vertically possible streams to stopcondition 2019-03-26 14:37:32 +03:00
alesapin
2d0224aab4 Add average blocks size for ReplacingBlockInputStream 2019-03-26 13:23:14 +03:00
alesapin
2dfd6779f6 Remove exception 2019-03-26 12:46:09 +03:00
alesapin
bfbe1263ac Allow empty parts 2019-03-26 12:12:48 +03:00
alesapin
c0e29d3fb4 Fix first time read from mark 2019-03-25 19:55:48 +03:00
alesapin
aba51a11ba Large refactoring (only compilable) 2019-03-25 16:55:24 +03:00
alesapin
673a72eac6 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-03-25 11:41:38 +03:00
Alexey Milovidov
25ab402d21 ParserCreateQuery: moved code to cpp 2019-03-24 01:45:28 +03:00
Alexey Milovidov
ba474ab21a Merge branch 'master' of github.com:yandex/ClickHouse 2019-03-23 04:27:16 +03:00
Alexey Milovidov
5a7237cc13 Miscellaneous 2019-03-23 04:27:08 +03:00
alexey-milovidov
69340528ff
Merge pull request #4772 from yandex/fix-force-recheck-parts
Recheck parts in ReplicatedMergeTreeAlterThread in case of error
2019-03-23 04:22:55 +03:00
Nikolai Kochetov
2311bbd95c Restore recheck parts in ReplicatedMergeTreeAlterThread in case of error. 2019-03-22 20:24:35 +03:00
alesapin
5aea16e2a0 Fix mutations bug 2019-03-22 15:56:58 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
alesapin
2a455af214 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-03-21 16:39:50 +03:00
alesapin
ef5162e2e3 Some fixes 2019-03-20 23:01:15 +03:00
alesapin
fb555359e7 Read by block size only in case of Vertical merge 2019-03-20 20:20:10 +03:00
alesapin
0848380c19 Fix missed mark position inc 2019-03-20 20:11:43 +03:00
alesapin
b5d6813604 Fix vertical merge again 2019-03-20 20:04:34 +03:00
Nikita Vasilev
c10f10cc0b Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-20 19:39:18 +03:00
alesapin
95a8be569d Check marks for adaptive granularity 2019-03-20 19:18:13 +03:00
Nikita Vasilev
09b9fe9491 _v1 2019-03-20 17:52:05 +03:00
alesapin
ec474472e4 Make avg block size for stream optional 2019-03-19 17:36:42 +03:00
alesapin
2f037bad58 Fix bug in merging algorithm 2019-03-19 16:10:24 +03:00
alesapin
6c91bf8ba3 Remove redundant file 2019-03-19 13:26:53 +03:00
alesapin
76c31a7764 More tests on alter 2019-03-19 13:19:40 +03:00
alesapin
d8aa5c7c49 Slightly clearer debug and fix alter 2019-03-19 12:57:29 +03:00
alesapin
4ad4fc3f7b Fix granule size less than row size 2019-03-18 19:21:52 +03:00
alesapin
05215b181f More simpliest test 2019-03-18 19:09:31 +03:00
alesapin
2b2a637a38 Simpliest write/merge/select test works 2019-03-18 18:54:58 +03:00
alesapin
ce03636f05 Merge master 2019-03-18 15:02:33 +03:00
Alexey Zatelepin
304c67da99 Merge branch 'master' into fix-add-materialized-column-after
Conflicts:
	dbms/src/Interpreters/InterpreterCreateQuery.cpp
	dbms/src/Interpreters/InterpreterDescribeQuery.cpp
	dbms/src/Interpreters/interpretSubquery.cpp
	dbms/src/Storages/ColumnsDescription.cpp
2019-03-17 00:46:53 +03:00
Alexey Milovidov
a1dd8fb831 Merge branch 'master' of github.com:yandex/ClickHouse 2019-03-16 01:50:54 +03:00
Alexey Milovidov
babb4f7b73 Miscellaneous 2019-03-16 01:50:46 +03:00
Ivan
8ac3e89628
Merge pull request #4649 from abyss7/iast-as
Implement and use method IAST::as<Derived>()
2019-03-15 23:22:46 +03:00
Alexey Zatelepin
b5a0a3fa23 store all kinds of columns in the same list in ColumnsDescription [#CLICKHOUSE-3101] 2019-03-15 19:37:52 +03:00
Ivan Lezhankin
4f6a494af8 Revert references where they were before refactoring. 2019-03-15 19:14:13 +03:00
Alexey Milovidov
a459b2c298 Fixed insufficient type checking in hasAll, hasAny functions 2019-03-15 02:10:51 +03:00
proller
1a33f4da40
Optional current_thread and memory_tracker (#4664) 2019-03-14 21:03:35 +03:00
Nikita Vasilev
0c0c693c93 fix 2019-03-12 18:20:54 +03:00
Nikita Vasilev
ad8b714ba3 fix 2019-03-12 16:36:15 +03:00
Nikita Vasilev
42078a6c97 improved token extractor 2019-03-12 16:17:22 +03:00
Nikita Vasilev
df68abe893 fix 2019-03-11 21:00:51 +03:00
Nikita Vasilev
d7e18db7f6 aggregator 2019-03-11 20:59:36 +03:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-11 16:11:22 +03:00
Ivan Lezhankin
a7e838e328 Replace all other casts to method IAST::As<Derived>
Also remove some redundant methods like IsIdentifier() et. al.
2019-03-11 15:49:39 +03:00
Nikita Vasilev
d171330599 Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-11 13:06:09 +03:00
alexey-milovidov
edb72e09ae
Merge pull request #4640 from nikvas0/nikvas0/set_opt
Improved data skipping indices calculation
2019-03-11 00:26:48 +03:00
alexey-milovidov
617a0a8938
Merge pull request #4592 from yandex/fix-concurrent-alters2
Fix a race condition during concurrent ALTER COLUMN queries
2019-03-10 19:11:49 +03:00
alexey-milovidov
c7c58785b5
Merge pull request #4637 from digitalist/use_sampling-fix-for-parallel-replicas
fix use_sampling for parallel replicas (mpetrov/madmike)
2019-03-10 19:02:40 +03:00
Nikita Vasilev
8615834804 fix 2019-03-10 11:23:59 +03:00
Nikita Vasilev
d7892e9ec7 Merge remote-tracking branch 'upstream/master' into nikvas0/set_opt 2019-03-10 11:23:01 +03:00
alexey-milovidov
6db73152d2
Hardening debug build (experimental) (#4632)
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index

* Addition to prev. revision

* Addition to prev. revision

* Addition to prev. revision
2019-03-10 06:16:51 +03:00
alexey-milovidov
128fd20adf
Update registerStorageMergeTree.cpp 2019-03-10 04:30:42 +03:00
Nikita Vasilev
d969b64237 set(0) 2019-03-09 21:17:29 +03:00
Nikita Vasilev
7f281327d9 fix 2019-03-09 18:26:52 +03:00
Alexey Elymanov
9bb64bd6d2 remove excessive check/exception 2019-03-09 17:51:10 +03:00
Alexey Elymanov
b1052cb72e fix use_sampling for parallel replicas (mpetrov/madmike) 2019-03-09 17:30:55 +03:00
Nikita Vasilev
b9d258dc99 new set 2019-03-09 17:03:41 +03:00
Nikita Vasilev
a2480d7812 aggregation 2019-03-08 22:52:21 +03:00
Mikhail f. Shiryaev
2d27331f0c Merge remote-tracking branch 'origin/master' into system.graphite_retentions 2019-03-08 17:41:40 +01:00
Nikita Vasilev
c2fa53d9d4 aggregator 2019-03-08 18:36:39 +03:00
Ivan Lezhankin
0e325c7a4a Replace const typeid_casts with As<Derived>() method invocations 2019-03-08 12:48:20 +03:00
Nikita Vasilev
6a86a901b4 return KeyCondition 2019-03-08 11:29:48 +03:00
Nikita Vasilev
a77d20e56d Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-08 11:13:48 +03:00
Mikhail f. Shiryaev
9e82b44b62 Review adjustment 2019-03-08 08:00:46 +01:00
Alexey Zatelepin
3344955154 separate Read and Write lock holders, better method names 2019-03-07 21:10:21 +03:00
Alexey Milovidov
d53da3d497 Fixed typo 2019-03-07 20:58:28 +03:00
Alexey Zatelepin
ab025805a3 alter intention lock 2019-03-07 20:21:18 +03:00
Nikita Vasilev
fcb82ba901 Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-07 16:55:38 +03:00
Nikita Vasilev
d82ce5ddb3 move 2019-03-07 16:54:56 +03:00
Nikita Vasilev
01e682d23c fix 2019-03-07 14:31:23 +03:00
Nikita Vasilev
a555918fca rpnbuilder 2019-03-07 12:15:58 +03:00
Mikhail f. Shiryaev
bccbd52d78 Rework system.graphite_retentions table 2019-03-07 01:05:24 +01:00
alexey-milovidov
7e4c497e19
Merge pull request #4594 from yandex/fix-low-cardinality_serialization-for-set-index
Fix Nullable and LowCardinality serialization for set index
2019-03-06 21:57:26 +03:00
Nikita Vasilev
565633fb2b limited like for tokenbf 2019-03-06 18:30:27 +03:00
Nikita Vasilev
c428d9a64c Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-06 16:36:34 +03:00
alexey-milovidov
1df9c1720e
Merge pull request #4426 from Felixoid/graphite-rollup
Graphite rollup: combined rules
2019-03-06 03:10:45 +03:00
Nikolai Kochetov
3bcab12966 Fix test. 2019-03-05 19:52:29 +03:00
Nikolai Kochetov
4b18b7dcdc Support Nullable columns for Set index. #4486 2019-03-05 15:17:54 +03:00
Nikolai Kochetov
52c9d4e1ad (De)Serialize set index with multiple bulks. #4486 2019-03-05 15:17:37 +03:00
alexey-milovidov
3924207040
Merge pull request #4405 from yandex/move-to-prewhere-improvement
Move to prewhere improvement
2019-03-03 19:06:43 +03:00
Alexey Milovidov
b8ff976ee9 Merge branch 'master' into move-to-prewhere-improvement 2019-03-02 04:34:49 +03:00
Alexey Milovidov
dbab34e21f Fixed error #4526 2019-03-02 04:05:36 +03:00
Alexey Milovidov
526e6488e0 Merge branch 'master' into fix-aio-threshold 2019-03-02 02:39:25 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
Alexey Zatelepin
c5dde2c9fd get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789] 2019-02-28 12:37:05 +03:00
Alexey Milovidov
62b246c5a4 Avoid excessive "stat" syscall\ 2019-02-27 23:02:48 +03:00
Alexey Milovidov
c3623f7bb6 Fixed error with underestimation of data size to read when choosing O_DIRECT mode 2019-02-27 22:32:54 +03:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
Nikita Vasilev
0b20d634cd fix 2019-02-26 23:36:15 +03:00
Nikita Vasilev
d6f227ece7 fix build 2019-02-26 22:37:07 +03:00
Mikhail f. Shiryaev
88d63a0b3a Use pair of patterns to make combined RollupRules 2019-02-26 10:49:39 +01:00
Nikita Vasilev
e5a4ecfc84 fixed style 2019-02-25 21:46:54 +03:00
Nikita Vasilev
58446d5145 fix 2019-02-25 21:38:57 +03:00
Nikita Vasilev
4b04c4bdde improved read 2019-02-25 21:30:02 +03:00
Nikita Vasilev
ef0de1b53e refactoring 2019-02-25 21:23:21 +03:00
Nikita Vasilev
289a6cb3d3 support like 2019-02-25 21:04:25 +03:00
Nikita Vasilev
69e6dea848 removed logs 2019-02-25 20:16:20 +03:00
Nikita Vasilev
72f5bdc485 tokenbf fix 2019-02-25 20:12:09 +03:00
Nikita Vasilev
4c3ed613e3 fix 2019-02-25 19:34:49 +03:00
Nikita Vasilev
c9e4657aae tokenbf 2019-02-25 17:23:19 +03:00
Nikita Vasilev
09e64be605 fix 2019-02-25 13:12:05 +03:00
Nikita Vasilev
c19a767433 fixed in 2019-02-25 11:43:19 +03:00
Nikita Vasilev
d02e1c0cdb in 2019-02-25 00:17:52 +03:00
Nikita Vasilev
ed28340a4c fixed string 2019-02-24 22:26:42 +03:00
Nikita Vasilev
c656045f96 fix 2019-02-24 22:07:45 +03:00
Nikita Vasilev
c8e8f14bf9 4 args 2019-02-24 21:55:56 +03:00
Nikita Vasilev
bb5a5932b4 fix 2019-02-23 17:12:15 +03:00
Nikita Vasilev
ca4d1e137c fix like 2019-02-23 16:06:23 +03:00
Nikita Vasilev
970f93d3c4 fix 2019-02-23 12:26:32 +03:00
Nikita Vasilev
81fdd13420 many columns 2019-02-22 22:59:40 +03:00
Nikita Vasilev
7f93057650 fix 2019-02-22 13:51:19 +03:00
Nikita Vasilev
16a1fd6692 fix 2019-02-22 11:15:52 +03:00
Nikita Vasilev
4ca9c02431 utf-8 2019-02-22 10:59:07 +03:00
Nikita Vasilev
9a28161414 fixed token extractor 2019-02-22 00:29:24 +03:00
Nikita Vasilev
34e2e2623e like 2019-02-21 23:32:36 +03:00
Nikita Vasilev
f66cef68ff fix in atom_map 2019-02-20 23:17:44 +03:00
Nikita Vasilev
ef55e93016 == 2019-02-20 22:27:23 +03:00
Nikita Vasilev
4e5bbc8176 fix 2019-02-20 20:17:31 +03:00
Nikita Vasilev
c35c671f4e key condition 2019-02-20 19:24:46 +03:00
Nikita Vasilev
5b1f443195 fix 2019-02-20 16:18:15 +03:00
Nikita Vasilev
f7c091d497 utf8 + fixes 2019-02-20 15:48:50 +03:00
Nikita Vasilev
4343ede944 bloom filter creator 2019-02-20 15:12:41 +03:00
Nikita Vasilev
fb002ab17c fix 2019-02-20 14:24:31 +03:00
Nikita Vasilev
3c3cc597ab added granule 2019-02-20 14:22:07 +03:00
Vitaly Baranov
ad377d421f MergingSortedBlockInputStream class constructor, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
Vitaly Baranov
309df832ec IStorage::read() function, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
Alexey Milovidov
b5b0c3eb28 Allow to move more than a single condition to PREWHERE 2019-02-15 22:25:29 +03:00
Alexey Milovidov
eb54d43c14 Do not move conditions on all queried columns to PREWHERE 2019-02-15 22:00:19 +03:00
alexey-milovidov
85a5ece942
Merge pull request #4407 from nikvas0/nikvas0/index_fix2
indices fix
2019-02-15 18:56:14 +03:00
Nikita Vasilev
4fb7abfeff removed logs 2019-02-15 08:58:29 +03:00
Nikita Vasilev
83d37a6f83 removed logs 2019-02-15 08:56:37 +03:00
Alexey Milovidov
e758caa7a9 Better "optimize_move_to_prewhere" heuristic; simpler code 2019-02-15 02:51:17 +03:00
Alexey Milovidov
793b92987f Better "optimize_move_to_prewhere" heuristic 2019-02-14 23:09:44 +03:00
Alexey Milovidov
f30c05ed94 Better prewhere (incomplete) 2019-02-14 22:59:51 +03:00
Nikita Vasilev
77d8fe0aee fix 2019-02-14 20:35:50 +03:00
Nikita Vasilev
610534e5ff fix 2019-02-14 19:59:26 +03:00
Alexey Milovidov
a216cba3c4 Better "optimize_move_to_prewhere" heuristic 2019-02-14 19:48:41 +03:00
Alexey Milovidov
b7a4456007 Avoid "Memory limit exceeded" during ATTACH TABLE query 2019-02-14 16:05:44 +03:00
Nikita Vasilev
64e0732b4a fixed 2019-02-14 12:13:04 +03:00
Nikita Vasilev
683314b69b fix set 2019-02-14 12:06:32 +03:00
Nikita Vasilev
28840c79ed Merge branch 'master' into nikvas0/set_index_args 2019-02-14 10:44:57 +03:00
Nikita Vasilev
ca1484ae95 set exactly one arg 2019-02-13 22:26:24 +03:00
Alexey Zatelepin
15d0adaf5a add info about replicated_can_become_leader to logs and system.replicas [#CLICKHOUSE-4309] 2019-02-13 16:08:34 +03:00
Alexey Milovidov
e2d4dae5e1 Fixed race condition in removal of data parts #3531 2019-02-13 15:53:06 +03:00
Alexey Milovidov
d558cf345c Faster calcelling of vertical merges 2019-02-12 22:04:13 +03:00
alexey-milovidov
48280074c4
Merge pull request #4369 from yandex/fix-race-condition-merge-tree-clear-old-temporary-directories
Fixed rare race condition on startup of non-replicated MergeTree tables: concurrent attempt to remove a temporary directory [#CLICKHOUSE-4296]
2019-02-12 21:37:48 +03:00
Nikita Vasilev
5279c7ff81 setting 2019-02-12 20:54:52 +03:00
Alexey Milovidov
7d1e755a7c Fixed rare race condition on startup of non-replicated MergeTree tables: concurrent attempt to remove a temporary directory [#CLICKHOUSE-4296] 2019-02-12 19:41:06 +03:00
Alexey Milovidov
0861af12a3 Fixed thread names 2019-02-11 00:15:14 +03:00
Alexey Milovidov
58a6accee5 Updated test #4246 2019-02-10 19:55:12 +03:00
Alexey Milovidov
c603d270f4 Cleanups #4246 2019-02-10 18:17:45 +03:00
alexey-milovidov
9650c4a0da
Merge pull request #4286 from nikvas0/nikvas0/index_fix
Data Skipping Indices fix
2019-02-10 00:53:04 +03:00
alexey-milovidov
2777e54a57
Merge pull request #4287 from yandex/mutations-introspection
KILL MUTATION
2019-02-10 00:51:30 +03:00
Nikita Vasilev
cecbd5d0ac Merge remote-tracking branch 'upstream/master' into nikvas0/index_fix 2019-02-08 00:17:35 +03:00
Nikita Vasilev
a675ba2323 unique -> set 2019-02-06 23:05:50 +03:00
KochetovNicolai
9f971c276f
Merge pull request #3669 from Enmk/ipv4_and_ipv6_domains
Ipv4 and ipv6 domains
2019-02-06 18:16:58 +03:00
Alexey Zatelepin
3ec6f508f1 Merge branch 'master' into mutations-introspection
Conflicts:
	dbms/src/Interpreters/InterpreterKillQueryQuery.cpp
2019-02-06 15:22:48 +03:00
Nikita Vasilev
a618c7f334 fixed unique 2019-02-06 14:08:04 +03:00
Nikita Vasilev
28870b4d50 fixed indices register 2019-02-06 12:05:05 +03:00
Nikita Vasilev
fa1e46f8a7 granularity 2019-02-06 11:43:54 +03:00
Nikita Vasilev
e3879c0933 fix 2019-02-06 11:24:16 +03:00
Nikita Vasilev
c3f7344824 style 2019-02-06 11:17:57 +03:00
Nikita Vasilev
258367c1dd ASTs 2019-02-06 10:51:35 +03:00
Nikita Vasilev
ef154a4bb2 r fix 2019-02-06 10:49:18 +03:00
Nikita Vasilev
9eaabcbf3f Merge remote-tracking branch 'upstream/master' into nikvas0/index_fix 2019-02-05 22:19:47 +03:00
Nikita Vasilev
9921fc6719 removed toString 2019-02-05 21:46:35 +03:00
Nikita Vasilev
3bea03529b fixed bug in unique_index 2019-02-05 21:34:10 +03:00
Alexey Zatelepin
8e437b191e try executing other mutations immediately after KILL MUTATION [#CLICKHOUSE-3912] 2019-02-05 21:09:16 +03:00
Alexey Zatelepin
e32f153328 KILL MUTATION for StorageReplicatedMergeTree [#CLICKHOUSE-3912] 2019-02-05 21:09:15 +03:00
Alexey Zatelepin
059c1b3589 write part_log.partition_id everywhere 2019-02-05 21:09:15 +03:00
Alexey Zatelepin
ca93fd483a kill ordinary MergeTree mutations [#CLICKHOUSE-3912] 2019-02-05 21:09:10 +03:00
Alexey Zatelepin
5832e474a4 is_mutation flag in system.merges [#CLICKHOUSE-3912] 2019-02-05 21:09:05 +03:00
Alexey Zatelepin
92a4342c31 system.merges element for mutations [#CLICKHOUSE-3912] 2019-02-05 21:09:00 +03:00
Alexey Milovidov
9dd2e75b71 Fixed warnings in clang 8 #4143 2019-02-05 19:43:52 +03:00
Nikita Vasilev
89913b9188 fix 2019-02-05 18:22:47 +03:00
Nikita Vasilev
a1b0dede07 Data Skipping Indices (#4143)
* made index parser

* added index parsing

* some fixes

* added index interface and factory

* fixed compilation

* ptrs

* added indexParts

* indextypes

* index condition

* IndexCondition

* added indexes in selectexecutor

* fix

* changed comment

* fix

* added granularity

* comments

* fix

* fix

* added writing indexes

* removed indexpart class

* fix

* added setSkipIndexes

* add rw for MergeTreeIndexes

* fixes

* upd error

* fix

* fix

* reading

* test index

* fixed nullptr error

* fixed

* fix

* unique names

* asts -> exprlist

* minmax index

* fix

* fixed select

* fixed merging

* fixed mutation

* working minmax

* removed test index

* fixed style

* added indexes to checkDataPart

* added tests for minmax index

* fixed constructor

* fix style

* fixed includes

* fixed setSkipIndexes

* added indexes meta to zookeeper

* added parsing

* removed throw

* alter cmds parse

* fix

* added alter

* fix

* alters fix

* fix alters

* fix "after"

* fixed alter

* alter fix + test

* fixes

* upd setSkipIndexes

* fixed alter bug with drop all indices

* fix metadata editing

* new test and repl fix

* rm test files

* fixed repl alter

* fix

* fix

* indices

* MTReadStream

* upd test for bug

* fix

* added useful parsers and ast classes

* fix

* fix comments

* replaced columns

* fix

* fixed parsing

* fixed printing

* fix err

* basic IndicesDescription

* go to IndicesDescr

* moved indices

* go to indicesDescr

* fix test minmax_index*

* fixed MT alter

* fixed bug with replMT indices storing in zk

* rename

* refactoring

* docs ru

* docs ru

* docs en

* refactor

* rename tests

* fix docs

* refactoring

* fix

* fix

* fix

* fixed style

* unique idx

* unique

* fix

* better minmax calculation

* upd

* added getBlock

* unique_condition

* added termForAST

* unique

* fixed not

* uniqueCondition::mayBeTrueOnGranule

* fix

* fixed bug with double column

* is always true

* fix

* key set

* spaces

* test

* tests

* fix

* unique

* fix

* fix

* fixed bug with duplicate column

* removed unused data

* fix

* fixes

* __bitSwapLastTwo

* fix
2019-02-05 17:50:25 +03:00
Nikita Vasilev
263b390c52 removed unnecessary actions 2019-02-05 16:59:43 +03:00
Nikita Vasilev
87a80a4361 fixed create as 2019-02-05 16:52:45 +03:00
Alexey Zatelepin
1512e17ab8 info about failed parts for ReplicatedMergeTree [#CLICKHOUSE-3912] 2019-02-05 16:37:16 +03:00
Alexey Zatelepin
b8ee63fa3a save information about failed parts for ordinary MergeTree mutations [#CLICKHOUSE-3192] 2019-02-05 16:04:58 +03:00
Alexey Milovidov
29c3195742 Removed bad code; fixed error 2019-02-05 02:18:04 +03:00
Nikita Vasilev
5a7ca354a5 unknown field 2019-02-04 16:42:13 +03:00
Nikita Vasilev
fa07d1cf86 replace andBit 2019-02-04 13:42:30 +03:00
Vasily Nemkov
2716df8ab2 IPv4 and IPv6 Domain implementation.
Added:
 * IDataTypeDomain interface;
 * method DataTypeFactory::registerDataTypeDomain for registering domains;
 * DataTypeDomainWithSimpleSerialization domain base class with simple serialization/deserialization;
 * Concrete IPv4 and IPv6 domain implementations: DataTypeDomanIPv6 and DataTypeDomanIPv4;

Updated:
 * IDataType text serialization/deserialization methods;
 * IDataType implementation to use domain for text serialization/deserialization;
 * Refactored implementation of the IPv4/IPv6 functions to use formatIPv4/v6 and parseIPv4/v6 from Common/formatIPv6.h;

Tests:
 * Added test cases for IPv4 and IPv6 domains.
 * Updated IPv4/v6 functions tests to validate more cases;
 * Added performance tests for IPv4 and IPv6 related functions;
2019-02-04 12:37:46 +03:00
alexey-milovidov
012bd5267b
Merge pull request #4195 from yandex/convert-parts-from-old-format
А tool to convert an old month-partition part to the custom-partitioned format
2019-01-31 22:45:44 +03:00
Nikita Vasilev
094ae0f810 fix 2019-01-30 22:48:24 +03:00
Nikita Vasilev
476f33f9a3 __bitSwapLastTwo 2019-01-30 22:40:01 +03:00
Nikita Vasilev
0492ed780f fixes 2019-01-30 18:04:24 +03:00
Alexey Zatelepin
063366307f fix build 2019-01-30 18:03:43 +03:00
Alexey Zatelepin
8957e73681 a tool to convert an old month-partition part to the custom-partitioned format [#CLICKHOUSE-4231] 2019-01-30 16:51:39 +03:00
Nikita Vasilev
bcd07a4074 fix 2019-01-30 16:34:28 +03:00