Commit Graph

4623 Commits

Author SHA1 Message Date
Ivan Lezhankin
7f762aee88 Move some code from header to source file. 2019-05-17 17:48:03 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage.
Also a couple of massive include-refactorings with better forwarding
2019-05-17 17:34:25 +03:00
Alexey Milovidov
09073e1229 More tests 2019-05-17 01:55:29 +03:00
Alexey Milovidov
b075de45d6 Fixed test 2019-05-17 01:51:26 +03:00
Alexey Milovidov
dd9e993a87 Fixed issue #3540 (in progress) 2019-05-17 00:09:06 +03:00
Alexey Milovidov
5352b53671 Added missing file 2019-05-16 22:57:20 +03:00
Alexey Milovidov
d2bb2a9892 Added failing test 2019-05-16 22:00:46 +03:00
Ivan Lezhankin
a14013dff7 Add setting to regulate Kafka committing policy. 2019-05-16 18:20:30 +03:00
alexey-milovidov
8e2bdde93b
Update StorageKafka.cpp 2019-05-15 23:57:24 +03:00
proller
51ca4cbaa4
Build fixes (#5278) 2019-05-15 20:19:39 +03:00
Ivan
1ea9e3019d
Freeze the Kafka buffer after first empty response (#5283)
* Check inside inferior streams for cancellation while reading.
* Stop reading from Kafka buffer after first empty read.
2019-05-15 19:11:50 +03:00
Ivan Lezhankin
337ddf5047 Catch cppkafka exceptions about consumer creation failures 2019-05-15 17:23:52 +03:00
Artem Zuikov
98359a6a09
Merge pull request #5267 from 4ertus2/row_ref_list
RowRefList improvements
2019-05-15 13:38:48 +03:00
alexey-milovidov
88b34999fe
Merge pull request #5247 from zhang2014/fix/rename_data_race
fix data race in rename query
2019-05-14 22:07:52 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
chertus
6200d20dc2 RowRefList refactoring 2019-05-14 17:39:03 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
zhang2014
2206ba464f fix data race in rename query 2019-05-13 15:54:38 +08:00
Nikita Vasilev
ee3c50e1a0 mayBeTrueOnGranule 2019-05-12 20:08:28 +03:00
Nikita Vasilev
3e02eaf28d fix null minmax 2019-05-12 20:01:36 +03:00
alexey-milovidov
f7343ecb6f
Merge pull request #4639 from IvanKush/feat/parallel-alter-modify
feat alter:  parallelize processing of parts in alter modify
2019-05-12 00:39:46 +03:00
ivan-kush
ab6558b8b4 add spaces amp 2019-05-10 17:34:02 +03:00
alexey-milovidov
8ef7f3589a
Merge pull request #4936 from TCeason/feature/support_settings_for_async
Suport settings for async distributed inserts (#4852)
2019-05-09 23:59:29 +03:00
alexey-milovidov
001e4bfe76
Merge pull request #5209 from PerformanceVision/rename_mv
Support rename operation for MaterializeView storage
2019-05-09 23:10:41 +03:00
alexey-milovidov
4853b06f95
Merge pull request #5223 from proller/fix26
Build fixes
2019-05-09 11:38:20 +03:00
Guillaume Tassery
c8bf190f84 add unsafe function member for (add|remove)dependency for calling manually the context locking 2019-05-09 13:12:02 +07:00
proller
deddb40bf2 fix 2019-05-08 17:25:17 +03:00
proller
10c349e398 Fix macos build 2019-05-08 15:26:35 +03:00
chertus
4969ad2f98 correct comment & some renames 2019-05-08 13:53:45 +03:00
Ivan Kush
2a356791ab Merge branch 'master' into feat/parallel-alter-modify 2019-05-07 23:53:14 +03:00
ivan-kush
5bde1c69ab last try? 2019-05-07 23:41:15 +03:00
Guillaume Tassery
4cfb2859aa set generateInnerTableName function as inline 2019-05-07 14:38:10 +07:00
Guillaume Tassery
55dc86ef74 Support rename operation for MaterializeView storage 2019-05-07 13:54:55 +07:00
alexey-milovidov
63b3d7dbdb
Update MergeTreeData.h 2019-05-06 01:13:07 +03:00
alexey-milovidov
3e461e92c8
Update SelectQueryInfo.h 2019-05-05 23:35:05 +03:00
alexey-milovidov
c04c614bc0
Merge branch 'master' into clickhouse-4013 2019-05-05 23:22:45 +03:00
Alexey Milovidov
aca0195468 Miscellaneous 2019-05-04 19:17:11 +03:00
Alexey Milovidov
b2443f6aa6 Removed huge chunk of bad code 2019-05-04 06:45:58 +03:00
Alexey Milovidov
24dc2c858a Removed huge chunk of bad code 2019-05-03 21:07:59 +03:00
Alexey Milovidov
ad355897f7 Removed huge chunk of bad code 2019-05-03 05:09:41 +03:00
Alexey Milovidov
a6ca9f266f Removed huge chunk of bad code 2019-05-03 05:00:57 +03:00
Alexey Milovidov
41a32d8693 Removed bad code 2019-05-03 03:27:11 +03:00
Alexey Milovidov
0a8e888671 Fixed bad code 2019-05-03 03:26:46 +03:00
Alexey Milovidov
9537ff0594 Miscellaneous 2019-05-03 01:51:39 +03:00
alexey-milovidov
0dd0611873
Merge pull request #5173 from yandex/rename-method
Rename method for consistency
2019-05-03 00:58:51 +03:00
ivan-kush
abfb681a04 hz 2019-05-03 00:43:24 +03:00
ivan-kush
9ce742e040 Merge remote-tracking branch 'upstream/master' into feat/parallel-alter-modify 2019-05-03 00:25:56 +03:00
ivan-kush
d555a165a4 debug stress address 2019-05-02 21:48:38 +03:00
Alexey Milovidov
270a31abb5 Rename method for consistency 2019-05-02 19:07:23 +03:00
ivan-kush
ea82760463 add reset 2019-05-02 18:12:57 +03:00
Alexey Milovidov
6a271adad3 Added max_parts_in_total threshold to MergeTree tables 2019-05-02 17:48:54 +03:00
ivan-kush
3ecb66d965 debug stress address 2019-05-02 16:42:09 +03:00
ivan-kush
591325468b make_unique 2019-05-02 14:54:34 +03:00
Alexey Milovidov
1be21e3cb6 Removed bad and useless code in ColumnsDescription 2019-05-02 00:43:05 +03:00
ivan-kush
6ac5aa5e49 restart performance 2019-05-01 18:46:17 +03:00
ivan-kush
4a3a1fc6d9 return transactions cleaning 2019-05-01 15:43:43 +03:00
Ivan Kushnarenko
e38f6e08d8 debug tsan refactor trash 2019-05-01 13:26:49 +03:00
proller
83a35d7644 Update contributors 2019-04-30 22:46:07 +03:00
Ivan
dede124449
Fixes after premature merge of #5139 (#5143)
* Implement move-constructor via move-assignment operator.
* Reimplement copy-ctor via copy-assignment operator too.
2019-04-30 19:05:39 +03:00
Ivan
6291c4098f
Revert "Merge pull request #5139 from abyss7/fix-self-move" (#5150)
This reverts commit bd1f8fe97a, reversing
changes made to 5d1091bfee.
2019-04-29 23:33:26 +03:00
alexey-milovidov
bd1f8fe97a
Merge pull request #5139 from abyss7/fix-self-move
Remove move-assignment to prevent possible self-move
2019-04-29 17:08:23 +03:00
Ivan Lezhankin
9a1aee4c2e Remove move-assignment to prevent possible self-move 2019-04-29 16:47:28 +03:00
tai
b394a79af3 try fix batch async insert settings for Distributed 2019-04-29 17:02:23 +08:00
tai
0d39968233 Suport settings for async(#4852)
There is no hash operation on Settings. Because it is less valuable for hash operations.

And I dont know how to write a testcase.
2019-04-29 17:02:23 +08:00
Vitaly Baranov
28d9a80072 Rename macro APPLY_FOR_SETTINGS => LIST_OF_SETTINGS. 2019-04-29 03:22:59 +03:00
Ivan Kushnarenko
bdbe97276c remove groups 2019-04-27 23:15:10 +03:00
ivan-kush
26b3910b7d tsan debug 2019-04-27 20:01:30 +03:00
Ivan Kushnarenko
cb51558bdf check build clang7 splitted 2019-04-27 11:24:50 +03:00
Vitaly Baranov
1b8c01e940 Transform comments for MergeTreeSettings into descriptions. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
738a49f534 Use iterators instead of macros APPLY_FOR_SETTINGS and others. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
8277e9d8f1 Refactoring of Settings based on new template class SettingsCollection.
Add new class SettingsConstraints.
2019-04-26 19:11:05 +03:00
Vitaly Baranov
b24c69743e Use the same parameters in all APPLY_FOR_SETTINGS macros. 2019-04-26 19:11:05 +03:00
ivan-kush
ba61e16093 style 2019-04-26 00:37:57 +03:00
ivan-kush
86af5fc0c2 Merge remote-tracking branch 'upstream/master' into feat/parallel-alter-modify 2019-04-25 22:48:44 +03:00
ivan-kush
af02fe4a96 Merge remote-tracking branch 'origin/feat/parallel-alter-modify' into feat/parallel-alter-modify 2019-04-25 22:33:09 +03:00
ivan-kush
33201fa9a8 rev 2019-04-25 21:57:43 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
alexey-milovidov
0cf40e0029
Merge pull request #5082 from yandex/pvs-studio-fixes-3
Resolved some of PVS-Studio warnings
2019-04-22 22:06:07 +03:00
alexey-milovidov
b1cf026b5b
Merge pull request #5080 from abyss7/issue-4736
Do not drop Kafka Consumer buffers after deletion of stream
2019-04-22 19:18:33 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Ivan Lezhankin
94bba1918f Do not drop Kafka consumer buffers after closing stream 2019-04-22 16:23:05 +03:00
alesapin
33b228c276 Fix own test 2019-04-18 19:33:28 +03:00
alesapin
d812ae7024 Use fixed_granularity as upper bound for adaptive granularity 2019-04-18 18:06:45 +03:00
Anastasiya Rodigina
0c1735f1b1 ReverseBlockInputStream, optimization of group by, tests 2019-04-18 00:20:51 +03:00
proller
1b020827f0 Move Poco/Ext/ThreadNumber.h to common/getThreadNumber.h (#5016) 2019-04-17 17:53:54 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
alesapin
8cd18c0723
Merge pull request #4991 from yandex/fix_ddl_on_relicated_table
Do not send queries received from DDLWorker to leader replica
2019-04-15 13:07:55 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212)
Add TTL for columns and tables.
2019-04-15 12:30:45 +03:00
Danila Kutenin
18a6b3123f Randomization in lfalloc 2019-04-13 17:45:01 +03:00
Danila Kutenin
622b2c8472 Enable LFAlloc for MarkCache and UncompressedCache 2019-04-13 15:07:43 +03:00
alesapin
f47e3292e1 Do not send queries to leader replica received from DDLWorker 2019-04-12 14:06:05 +03:00
alexey-milovidov
d083976b88
Merge pull request #4952 from 4ertus2/ast
Rewrite ASTSelectQuery (consistent children)
2019-04-11 13:38:44 +03:00
Alexey Milovidov
d591c7187f Simplified expression 2019-04-10 23:16:04 +03:00
chertus
a698700faf fix tests (external storages) 2019-04-10 14:44:58 +03:00
chertus
82dc1fb1db rewrite ASTSelectQuery (consistent children) 2019-04-09 17:22:35 +03:00
alesapin
a53b002973 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-08 14:29:33 +03:00
Alexey Milovidov
460b58379a Fixed bad whitespaces 2019-04-06 03:36:04 +03:00
Alexey Milovidov
571bc7065a Removed unused code related to MemoryTracker 2019-04-06 01:35:56 +03:00
alexey-milovidov
a6797a9fba
Merge pull request #4883 from yandex/fix_codec_delta_alter
Fix alter modify of codec when column type is not specified
2019-04-04 22:16:22 +03:00
Danila Kutenin
029dd107e4 Typos for many factories 2019-04-03 14:13:22 +03:00
alesapin
42a0c2f194 Fix alter modify of codec when column type is not specified 2019-04-02 15:51:31 +03:00
alesapin
f7f29fa3e7 Style fix 2019-04-01 15:10:32 +03:00
alesapin
e204be3877 Remove debug prints 2019-04-01 14:40:13 +03:00
alesapin
69b623c47c Return logic for cache 2019-04-01 14:09:30 +03:00
alesapin
37427077b8 Remove average granularity logic from code 2019-04-01 13:34:22 +03:00
alesapin
7b67200258 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-01 11:54:19 +03:00
alesapin
78e09a221a Remove debug prints, little refactoring 2019-03-30 17:43:43 +03:00
alesapin
d6293d432c Commit missed files 2019-03-30 16:49:29 +03:00
alesapin
cdc18aa801 Rename IndexGranularity to MergeTreeIndexGranularity 2019-03-30 16:44:23 +03:00
Ivan
957d23267b
Minimal implementation of row-level security CLICKHOUSE-4315 (#4792)
For detailed description see the related PR
2019-03-29 23:31:06 +03:00
alesapin
2764401d0f Fix exception 'No message received' 2019-03-29 21:10:03 +03:00
Alexey Milovidov
88e94bad74 Removed "assumeMutable" usage in one case 2019-03-29 17:17:29 +03:00
alexey-milovidov
d10b256a8a
Merge pull request #4845 from yandex/max_partitions_per_insert_block
Implement "max_partitions_per_insert_block" setting
2019-03-29 16:20:46 +03:00
alexey-milovidov
976ee8a7ca
Merge pull request #4844 from yandex/fix-data-race-in-clear-old-temporary-directories
Fixed data race in clearOldTemporaryDirectories
2019-03-29 14:35:44 +03:00
Alexey Milovidov
8e8b5c40e2 Fixed error 2019-03-29 14:24:37 +03:00
Artem Zuikov
03cd41fbc7
Merge pull request #4774 from Gladdy/martijn-asof-join
Request for feedback on implementation of ASOF join
2019-03-29 13:19:31 +03:00
Alexey Milovidov
72d021c3d7 Implement "max_partitions_per_insert_block" setting #4700 2019-03-29 12:45:55 +03:00
Alexey Milovidov
8cb1619607 Implement "max_partitions_per_insert_block" setting #4700 2019-03-29 12:34:07 +03:00
Alexey Milovidov
8d3ef5df19 Fixed data race in clearOldTemporaryDirectories 2019-03-29 12:28:16 +03:00
Alexey Milovidov
34c0682353 Removed useless method 2019-03-29 11:37:05 +03:00
alesapin
2b9e261ab2 Better naming 2019-03-29 11:24:38 +03:00
Alexey Milovidov
a2e0f5d29c Merge branch 'master' into fix-race-condition-in-fetch-data-part 2019-03-29 04:22:20 +03:00
alexey-milovidov
72f27f4dec
Merge pull request #4836 from yandex/fix-race-condition-in-system-tables
Fixed TSan report in StorageSystemTables
2019-03-29 04:15:00 +03:00
Alexey Milovidov
46be1608a6 Fixed error #4836 2019-03-29 02:17:22 +03:00
Alexey Milovidov
3fb9814e3e Fixed race condition in fetchPart 2019-03-28 22:59:07 +03:00
Alexey Milovidov
350a0fe129 Miscellaneous 2019-03-28 22:58:41 +03:00
Alexey Milovidov
4645422176 Fixed TSan report in StorageSystemTables 2019-03-28 22:13:59 +03:00
alesapin
18d19aa346 More precise estimation of rows 2019-03-28 18:03:49 +03:00
Alexey Milovidov
4417705f32 Merge branch 'master' into cow-ptr-compositions 2019-03-28 17:47:59 +03:00
alesapin
594f91dd9d Save index granularity bytes into zookeeper 2019-03-28 15:44:14 +03:00
alesapin
1b8392a3d0 Style fixed 2019-03-28 12:02:56 +03:00
alesapin
5332642fee CI Fails fixes and little performance improvement 2019-03-28 11:52:09 +03:00
alesapin
3abf5e4ac0 Better code 2019-03-28 10:45:42 +03:00
alesapin
b3210550cb Fix stupid bug 2019-03-28 10:37:46 +03:00
alesapin
77554fd644 Remove unused variable 2019-03-27 21:02:19 +03:00
alesapin
ad16c7c931 Slightly better performance on index granularity 2019-03-27 20:33:55 +03:00
alesapin
e449760fde Remove debug print 2019-03-27 19:50:01 +03:00
alesapin
5528edea93 Fix build warnings 2019-03-27 19:23:38 +03:00
alesapin
22a75196ab Slightly more faster 2019-03-27 18:57:14 +03:00
alesapin
7c8236e145 Accident change 2019-03-27 17:14:27 +03:00
Martijn Bakker
ac68fc8088 pass the half-enforced style checks such that they cannot be run on a whole file automatically :( 2019-03-26 22:05:51 +00:00
Martijn Bakker
f6987cfa52 have the parser recognize asof joins and feed them through to the executor
insert the time series into a struct ready for joining

working version that inserts the data into the hash table using the existing dispatching machinery for various types

working asof left join in clickhouse

add a test for the asof join

do some asof join cleanup

revisit the logic in case the values match between left and right side
2019-03-26 19:17:21 +00:00
alexey-milovidov
aab7c79220
Merge pull request #4671 from LiuYangkuan/Buffer-supportsPrewhere
change supportsPrewhere() of Buffer and return its destination_table supportsPrewhere
2019-03-26 19:55:27 +03:00
alexey-milovidov
c2e4942009
Merge pull request #4705 from 4ertus2/ast
SelectQueryOptions + fix duplicates in GLOBAL JOIN with asterisks
2019-03-26 19:45:27 +03:00
alexey-milovidov
d047a62e31
Merge pull request #4790 from TCeason/fix_crash
Fix crash when distributed modify order by
2019-03-26 19:41:00 +03:00
alesapin
2b27b7f702 Fix indices 2019-03-26 17:40:03 +03:00
alesapin
48fb090cda Small fixes 2019-03-26 15:37:42 +03:00
alesapin
0378400972 Move all vertically possible streams to stopcondition 2019-03-26 14:37:32 +03:00
alesapin
2d0224aab4 Add average blocks size for ReplacingBlockInputStream 2019-03-26 13:23:14 +03:00
alesapin
2dfd6779f6 Remove exception 2019-03-26 12:46:09 +03:00
alesapin
bfbe1263ac Allow empty parts 2019-03-26 12:12:48 +03:00
tai
9d232778fc Fix crash when distributed modify order by
Did not determine if order_by_ast is empty.
If it is null, it will clone a null pointer and cause server crash.
2019-03-26 13:33:39 +08:00
proller
1584fd4367
Fix hyperscan library find and use (#4798) 2019-03-26 00:31:00 +03:00
alesapin
c0e29d3fb4 Fix first time read from mark 2019-03-25 19:55:48 +03:00
alesapin
aba51a11ba Large refactoring (only compilable) 2019-03-25 16:55:24 +03:00
alesapin
673a72eac6 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-03-25 11:41:38 +03:00
Alexey Milovidov
fb19cf1eec Attempt to make compositions with COWPtr more convenient 2019-03-25 04:43:54 +03:00
Alexey Milovidov
25ab402d21 ParserCreateQuery: moved code to cpp 2019-03-24 01:45:28 +03:00
Alexey Milovidov
ba474ab21a Merge branch 'master' of github.com:yandex/ClickHouse 2019-03-23 04:27:16 +03:00
Alexey Milovidov
5a7237cc13 Miscellaneous 2019-03-23 04:27:08 +03:00
alexey-milovidov
69340528ff
Merge pull request #4772 from yandex/fix-force-recheck-parts
Recheck parts in ReplicatedMergeTreeAlterThread in case of error
2019-03-23 04:22:55 +03:00
Nikolai Kochetov
2311bbd95c Restore recheck parts in ReplicatedMergeTreeAlterThread in case of error. 2019-03-22 20:24:35 +03:00
chertus
0cc90cf2db rename insert_sample_with_metadata setting 2019-03-22 19:15:44 +03:00
alesapin
5aea16e2a0 Fix mutations bug 2019-03-22 15:56:58 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
proller
d6d83d4a5c
Allow build without ssl (#4525) (#4750) 2019-03-22 14:18:24 +03:00
alesapin
2a455af214 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-03-21 16:39:50 +03:00
alesapin
ef5162e2e3 Some fixes 2019-03-20 23:01:15 +03:00
alesapin
fb555359e7 Read by block size only in case of Vertical merge 2019-03-20 20:20:10 +03:00
alesapin
0848380c19 Fix missed mark position inc 2019-03-20 20:11:43 +03:00
alesapin
b5d6813604 Fix vertical merge again 2019-03-20 20:04:34 +03:00
Nikita Vasilev
c10f10cc0b Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-20 19:39:18 +03:00
alesapin
95a8be569d Check marks for adaptive granularity 2019-03-20 19:18:13 +03:00
Nikita Vasilev
09b9fe9491 _v1 2019-03-20 17:52:05 +03:00
liuyangkuan
fbcf82c4df add interpretation of PREWHERE in StorageBuffer::read 2019-03-20 14:45:04 +08:00
alesapin
ec474472e4 Make avg block size for stream optional 2019-03-19 17:36:42 +03:00
alesapin
2f037bad58 Fix bug in merging algorithm 2019-03-19 16:10:24 +03:00
alesapin
6c91bf8ba3 Remove redundant file 2019-03-19 13:26:53 +03:00
alesapin
76c31a7764 More tests on alter 2019-03-19 13:19:40 +03:00
alesapin
d8aa5c7c49 Slightly clearer debug and fix alter 2019-03-19 12:57:29 +03:00
alesapin
4ad4fc3f7b Fix granule size less than row size 2019-03-18 19:21:52 +03:00
alesapin
3fb494fea1 Unit test 2019-03-18 19:09:47 +03:00
alesapin
05215b181f More simpliest test 2019-03-18 19:09:31 +03:00
alesapin
2b2a637a38 Simpliest write/merge/select test works 2019-03-18 18:54:58 +03:00
chertus
bd559f8db8 SelectQueryOptions v3 (no inheritance) 2019-03-18 15:05:51 +03:00
alesapin
ce03636f05 Merge master 2019-03-18 15:02:33 +03:00
chertus
b6e2697101 Merge branch 'master' into ast 2019-03-18 13:36:13 +03:00
Alexey Zatelepin
304c67da99 Merge branch 'master' into fix-add-materialized-column-after
Conflicts:
	dbms/src/Interpreters/InterpreterCreateQuery.cpp
	dbms/src/Interpreters/InterpreterDescribeQuery.cpp
	dbms/src/Interpreters/interpretSubquery.cpp
	dbms/src/Storages/ColumnsDescription.cpp
2019-03-17 00:46:53 +03:00
Alexey Zatelepin
0526542ce2 fix Nested columns inplace flatten [#CLICKHOUSE-3101] 2019-03-16 18:07:08 +03:00
Alexey Milovidov
a1dd8fb831 Merge branch 'master' of github.com:yandex/ClickHouse 2019-03-16 01:50:54 +03:00
Alexey Milovidov
babb4f7b73 Miscellaneous 2019-03-16 01:50:46 +03:00
Ivan
8ac3e89628
Merge pull request #4649 from abyss7/iast-as
Implement and use method IAST::as<Derived>()
2019-03-15 23:22:46 +03:00
Alexey Zatelepin
a2debdb724 fix use-after-free [#CLICKHOUSE-3101] 2019-03-15 21:52:45 +03:00
Alexey Zatelepin
a030ce90b5 fix build 2019-03-15 20:40:16 +03:00
Ivan Lezhankin
61954d855d More reverts 2019-03-15 20:09:14 +03:00
Alexey Milovidov
86b803350d Updated contributors 2019-03-15 19:47:46 +03:00
chertus
5104665a05 Merge branch 'master' into ast 2019-03-15 19:40:26 +03:00
Alexey Zatelepin
dac1c0a6c3 fix formatting of column comments 2019-03-15 19:37:52 +03:00
Alexey Zatelepin
b5a0a3fa23 store all kinds of columns in the same list in ColumnsDescription [#CLICKHOUSE-3101] 2019-03-15 19:37:52 +03:00
Ivan Lezhankin
4f6a494af8 Revert references where they were before refactoring. 2019-03-15 19:14:13 +03:00
chertus
ffc3974934 SelectQueryOptions v2 2019-03-15 18:57:18 +03:00
chertus
53abdccb95 refactoring: extract SelectQueryOptions 2019-03-15 16:49:58 +03:00
alexey-milovidov
40944ca356
Merge pull request #4698 from yandex/fixed-insufficient-type-check-in-has-all-any-function
Fixed insufficient type checking in hasAll, hasAny functions
2019-03-15 04:55:26 +03:00
alexey-milovidov
94d2c35f1d
Merge pull request #4691 from yandex/improvements_in_replication_without_zookeeper
Add ability to start replicated table without metadata in zookeeper
2019-03-15 04:55:07 +03:00
Alexey Milovidov
a459b2c298 Fixed insufficient type checking in hasAll, hasAny functions 2019-03-15 02:10:51 +03:00
proller
4532218456 Fix insert(NULL) in StorageSystemGraphite 2019-03-14 23:55:34 +03:00
alesapin
47dbaca52b Fix stupid error 2019-03-14 21:22:04 +03:00
proller
1a33f4da40
Optional current_thread and memory_tracker (#4664) 2019-03-14 21:03:35 +03:00
alesapin
28a3e78aa5 Remove 'Adding of unexpected local part to zookeeper' logic because it's redundant. 2019-03-14 17:46:28 +03:00
Ivan Lezhankin
a6ca8bcb10 Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-14 16:05:09 +03:00
alesapin
4f43893a35 Add ability to start table without metadata in zookeeper 2019-03-14 14:49:44 +03:00
Amos Bird
b405c7456f Refinement 2019-03-14 09:44:15 +08:00
alexey-milovidov
1cd7c91404
Merge pull request #4683 from amosbird/fixempty
Do not wait when there is not log entry.
2019-03-14 04:16:02 +03:00
Amos Bird
a69fa003bb Do not wait when there is not log entry. 2019-03-14 09:08:06 +08:00
liuyangkuan
80e37baff8 change supportsPrewhere() of table engine Buffer and return its destination_table supportsPrewhere() or not 2019-03-13 23:15:01 +08:00
Ivan Lezhankin
0dd31b587e Fix typo 2019-03-13 14:53:31 +03:00
Nikita Vasilev
0c0c693c93 fix 2019-03-12 18:20:54 +03:00
Nikita Vasilev
ad8b714ba3 fix 2019-03-12 16:36:15 +03:00
alexey-milovidov
24d0315f1e
Update StorageMergeTree.h 2019-03-12 16:26:48 +03:00
alexey-milovidov
fc3cb57881
Update StorageMergeTree.cpp 2019-03-12 16:26:26 +03:00
alexey-milovidov
72f785bd1d
Update StorageMergeTree.cpp 2019-03-12 16:24:56 +03:00
alexey-milovidov
6daee801fa
Update StorageMergeTree.cpp 2019-03-12 16:24:03 +03:00
Nikita Vasilev
42078a6c97 improved token extractor 2019-03-12 16:17:22 +03:00
Ivan Lezhankin
4c1a0ca255 Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-12 15:51:18 +03:00
proller
8227f5fe63 Arcadia fix 2019-03-12 15:06:17 +03:00
ivan-kush
3f01882310 format2 2019-03-12 08:56:02 +03:00
ivan-kush
6acb39032f format 2019-03-11 23:17:50 +03:00
Alexey Zatelepin
b9c4908edb add the missing part of the comment 2019-03-11 22:07:09 +03:00
Nikita Vasilev
df68abe893 fix 2019-03-11 21:00:51 +03:00
Nikita Vasilev
d7e18db7f6 aggregator 2019-03-11 20:59:36 +03:00
Ivan Lezhankin
a3a8b2bbf7 Include IAST_fwd.h for using ASTPtr 2019-03-11 17:01:45 +03:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-11 16:11:22 +03:00
Ivan Lezhankin
a7e838e328 Replace all other casts to method IAST::As<Derived>
Also remove some redundant methods like IsIdentifier() et. al.
2019-03-11 15:49:39 +03:00
Nikita Vasilev
d171330599 Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-11 13:06:09 +03:00
alexey-milovidov
edb72e09ae
Merge pull request #4640 from nikvas0/nikvas0/set_opt
Improved data skipping indices calculation
2019-03-11 00:26:48 +03:00
ivan-kush
c3182d4ae6 fix erase 2019-03-10 23:29:58 +03:00
alexey-milovidov
617a0a8938
Merge pull request #4592 from yandex/fix-concurrent-alters2
Fix a race condition during concurrent ALTER COLUMN queries
2019-03-10 19:11:49 +03:00
alexey-milovidov
c7c58785b5
Merge pull request #4637 from digitalist/use_sampling-fix-for-parallel-replicas
fix use_sampling for parallel replicas (mpetrov/madmike)
2019-03-10 19:02:40 +03:00
Nikita Vasilev
8615834804 fix 2019-03-10 11:23:59 +03:00
Nikita Vasilev
d7892e9ec7 Merge remote-tracking branch 'upstream/master' into nikvas0/set_opt 2019-03-10 11:23:01 +03:00
alexey-milovidov
6db73152d2
Hardening debug build (experimental) (#4632)
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index

* Addition to prev. revision

* Addition to prev. revision

* Addition to prev. revision
2019-03-10 06:16:51 +03:00
alexey-milovidov
24bec290b5
Merge pull request #4584 from Felixoid/system.graphite_retentions
Rework system.graphite_retentions
2019-03-10 04:30:53 +03:00
alexey-milovidov
128fd20adf
Update registerStorageMergeTree.cpp 2019-03-10 04:30:42 +03:00
ivan-kush
521e897a92 init 2019-03-10 00:36:00 +03:00
Nikita Vasilev
d969b64237 set(0) 2019-03-09 21:17:29 +03:00
Nikita Vasilev
7f281327d9 fix 2019-03-09 18:26:52 +03:00
Alexey Elymanov
9bb64bd6d2 remove excessive check/exception 2019-03-09 17:51:10 +03:00
Alexey Elymanov
b1052cb72e fix use_sampling for parallel replicas (mpetrov/madmike) 2019-03-09 17:30:55 +03:00
Nikita Vasilev
b9d258dc99 new set 2019-03-09 17:03:41 +03:00
Nikita Vasilev
8e65c9a094 Merge remote-tracking branch 'upstream/master' into nikvas0/set_opt 2019-03-09 14:28:31 +03:00
Nikita Vasilev
a2480d7812 aggregation 2019-03-08 22:52:21 +03:00
Mikhail f. Shiryaev
2d27331f0c Merge remote-tracking branch 'origin/master' into system.graphite_retentions 2019-03-08 17:41:40 +01:00
Nikita Vasilev
c2fa53d9d4 aggregator 2019-03-08 18:36:39 +03:00
Mikhail Filimonov
5f626dc99e Fix broken progress in 19.3 (regression in 92769a2460)
Introduce total_rows for table function `numbers()`.

fixes https://github.com/yandex/ClickHouse/issues/4429
resolves https://github.com/yandex/ClickHouse/issues/4284
2019-03-08 15:36:40 +01:00
Ivan Lezhankin
0e325c7a4a Replace const typeid_casts with As<Derived>() method invocations 2019-03-08 12:48:20 +03:00
Nikita Vasilev
6a86a901b4 return KeyCondition 2019-03-08 11:29:48 +03:00
Nikita Vasilev
a77d20e56d Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-08 11:13:48 +03:00
Mikhail f. Shiryaev
9e82b44b62 Review adjustment 2019-03-08 08:00:46 +01:00
Alex Zatelepin
896b8b15f6 fix build 2019-03-07 23:52:25 +03:00
Alexey Zatelepin
f3ea9541fc add comments 2019-03-07 21:34:46 +03:00
Alexey Zatelepin
3344955154 separate Read and Write lock holders, better method names 2019-03-07 21:10:21 +03:00
Alexey Milovidov
d53da3d497 Fixed typo 2019-03-07 20:58:28 +03:00
Alexey Zatelepin
ab025805a3 alter intention lock 2019-03-07 20:21:18 +03:00
alexey-milovidov
8b0d8644c8
Update StorageSystemGraphite.cpp 2019-03-07 19:55:53 +03:00
Nikita Vasilev
fcb82ba901 Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-07 16:55:38 +03:00
Nikita Vasilev
d82ce5ddb3 move 2019-03-07 16:54:56 +03:00
Nikita Vasilev
01e682d23c fix 2019-03-07 14:31:23 +03:00
Nikita Vasilev
a555918fca rpnbuilder 2019-03-07 12:15:58 +03:00
Mikhail f. Shiryaev
bccbd52d78 Rework system.graphite_retentions table 2019-03-07 01:05:24 +01:00
alexey-milovidov
7e4c497e19
Merge pull request #4594 from yandex/fix-low-cardinality_serialization-for-set-index
Fix Nullable and LowCardinality serialization for set index
2019-03-06 21:57:26 +03:00
Nikita Vasilev
565633fb2b limited like for tokenbf 2019-03-06 18:30:27 +03:00
Nikita Vasilev
c428d9a64c Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-06 16:36:34 +03:00
alexey-milovidov
1df9c1720e
Merge pull request #4426 from Felixoid/graphite-rollup
Graphite rollup: combined rules
2019-03-06 03:10:45 +03:00
Nikolai Kochetov
3bcab12966 Fix test. 2019-03-05 19:52:29 +03:00
Nikolai Kochetov
4b18b7dcdc Support Nullable columns for Set index. #4486 2019-03-05 15:17:54 +03:00
Nikolai Kochetov
52c9d4e1ad (De)Serialize set index with multiple bulks. #4486 2019-03-05 15:17:37 +03:00
alexey-milovidov
3924207040
Merge pull request #4405 from yandex/move-to-prewhere-improvement
Move to prewhere improvement
2019-03-03 19:06:43 +03:00
Alexey Milovidov
b8ff976ee9 Merge branch 'master' into move-to-prewhere-improvement 2019-03-02 04:34:49 +03:00
Alexey Milovidov
dbab34e21f Fixed error #4526 2019-03-02 04:05:36 +03:00
Alexey Milovidov
526e6488e0 Merge branch 'master' into fix-aio-threshold 2019-03-02 02:39:25 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Alexey Zatelepin
5b850bad47 fix build 2019-03-01 14:42:41 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
alexey-milovidov
137f800423
Update StorageSystemColumns.cpp 2019-03-01 04:08:12 +03:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
Alexey Zatelepin
c5dde2c9fd get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789] 2019-02-28 12:37:05 +03:00
alexey-milovidov
40d8abbc34
Merge pull request #4523 from yandex/fix_column_description_parse
Fix column description parse. Now creation of replicated MT table wit…
2019-02-28 01:18:31 +03:00
Alexey Milovidov
62b246c5a4 Avoid excessive "stat" syscall\ 2019-02-27 23:02:48 +03:00
Alexey Milovidov
c3623f7bb6 Fixed error with underestimation of data size to read when choosing O_DIRECT mode 2019-02-27 22:32:54 +03:00
Alexey Zatelepin
5ac1d4dd4e rename LockHandler -> LockHolder [#CLICKHOUSE-3789] 2019-02-27 21:34:38 +03:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
alesapin
1909c87885 Fix column description parse. Now creation of replicated MT table with codecs and comments is possible without default 2019-02-27 19:41:51 +03:00
Nikita Vasilev
0b20d634cd fix 2019-02-26 23:36:15 +03:00
Nikita Vasilev
d6f227ece7 fix build 2019-02-26 22:37:07 +03:00
Mikhail f. Shiryaev
88d63a0b3a Use pair of patterns to make combined RollupRules 2019-02-26 10:49:39 +01:00
Nikita Vasilev
e5a4ecfc84 fixed style 2019-02-25 21:46:54 +03:00
Nikita Vasilev
58446d5145 fix 2019-02-25 21:38:57 +03:00
Nikita Vasilev
4b04c4bdde improved read 2019-02-25 21:30:02 +03:00
Nikita Vasilev
ef0de1b53e refactoring 2019-02-25 21:23:21 +03:00
Nikita Vasilev
289a6cb3d3 support like 2019-02-25 21:04:25 +03:00
Nikita Vasilev
69e6dea848 removed logs 2019-02-25 20:16:20 +03:00
Nikita Vasilev
72f5bdc485 tokenbf fix 2019-02-25 20:12:09 +03:00
Nikita Vasilev
4c3ed613e3 fix 2019-02-25 19:34:49 +03:00
Nikita Vasilev
c9e4657aae tokenbf 2019-02-25 17:23:19 +03:00
Nikita Vasilev
09e64be605 fix 2019-02-25 13:12:05 +03:00
Nikita Vasilev
c19a767433 fixed in 2019-02-25 11:43:19 +03:00
Nikita Vasilev
d02e1c0cdb in 2019-02-25 00:17:52 +03:00
Nikita Vasilev
ed28340a4c fixed string 2019-02-24 22:26:42 +03:00
Nikita Vasilev
c656045f96 fix 2019-02-24 22:07:45 +03:00
Nikita Vasilev
c8e8f14bf9 4 args 2019-02-24 21:55:56 +03:00
Nikita Vasilev
bb5a5932b4 fix 2019-02-23 17:12:15 +03:00
Nikita Vasilev
ca4d1e137c fix like 2019-02-23 16:06:23 +03:00
Nikita Vasilev
970f93d3c4 fix 2019-02-23 12:26:32 +03:00
Nikita Vasilev
81fdd13420 many columns 2019-02-22 22:59:40 +03:00
Nikita Vasilev
7f93057650 fix 2019-02-22 13:51:19 +03:00
Nikita Vasilev
16a1fd6692 fix 2019-02-22 11:15:52 +03:00
Nikita Vasilev
4ca9c02431 utf-8 2019-02-22 10:59:07 +03:00
Nikita Vasilev
9a28161414 fixed token extractor 2019-02-22 00:29:24 +03:00
Nikita Vasilev
34e2e2623e like 2019-02-21 23:32:36 +03:00
Nikita Vasilev
f66cef68ff fix in atom_map 2019-02-20 23:17:44 +03:00
Nikita Vasilev
ef55e93016 == 2019-02-20 22:27:23 +03:00
Nikita Vasilev
4e5bbc8176 fix 2019-02-20 20:17:31 +03:00
Nikita Vasilev
c35c671f4e key condition 2019-02-20 19:24:46 +03:00
Nikita Vasilev
5b1f443195 fix 2019-02-20 16:18:15 +03:00
Nikita Vasilev
f7c091d497 utf8 + fixes 2019-02-20 15:48:50 +03:00
Nikita Vasilev
4343ede944 bloom filter creator 2019-02-20 15:12:41 +03:00
Nikita Vasilev
fb002ab17c fix 2019-02-20 14:24:31 +03:00
Nikita Vasilev
3c3cc597ab added granule 2019-02-20 14:22:07 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
Alexey Milovidov
9c23486551 Fixed backward incompatibility of table function "remote" introduced with column comments 2019-02-19 20:02:51 +03:00
Vitaly Baranov
ad377d421f MergingSortedBlockInputStream class constructor, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
Vitaly Baranov
536edf7721 StorageSystemNumber class constructor, "offset" and "limit" parameters: change type size_t -> UInt64. 2019-02-19 14:56:08 +03:00
Vitaly Baranov
37e726c311 IStorageURLBase::getReadURIParams() and IStorageURLBase::getReadPOSTDataCallback() functions, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:17 +03:00
Vitaly Baranov
309df832ec IStorage::read() function, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
Vitaly Baranov
ab7e7507a4 Revert incorrect fix compilation on Mac.
This reverts commit ef6b20030c.
2019-02-18 20:31:18 +03:00
Alexey Milovidov
b5b0c3eb28 Allow to move more than a single condition to PREWHERE 2019-02-15 22:25:29 +03:00
Alexey Milovidov
eb54d43c14 Do not move conditions on all queried columns to PREWHERE 2019-02-15 22:00:19 +03:00
alexey-milovidov
85a5ece942
Merge pull request #4407 from nikvas0/nikvas0/index_fix2
indices fix
2019-02-15 18:56:14 +03:00
proller
263e69e861
Build fixes (FreeBSD port) (#4397) 2019-02-15 14:46:07 +03:00
Nikita Vasilev
4fb7abfeff removed logs 2019-02-15 08:58:29 +03:00
Nikita Vasilev
83d37a6f83 removed logs 2019-02-15 08:56:37 +03:00
Alexey Milovidov
e758caa7a9 Better "optimize_move_to_prewhere" heuristic; simpler code 2019-02-15 02:51:17 +03:00
Alexey Milovidov
793b92987f Better "optimize_move_to_prewhere" heuristic 2019-02-14 23:09:44 +03:00
Alexey Milovidov
f30c05ed94 Better prewhere (incomplete) 2019-02-14 22:59:51 +03:00
alexey-milovidov
ed3a8a66a2
Merge pull request #4399 from yandex/better-replica-repair
Better replica repair
2019-02-14 21:50:20 +03:00
Nikita Vasilev
77d8fe0aee fix 2019-02-14 20:35:50 +03:00
Nikita Vasilev
610534e5ff fix 2019-02-14 19:59:26 +03:00
Alexey Milovidov
a216cba3c4 Better "optimize_move_to_prewhere" heuristic 2019-02-14 19:48:41 +03:00