Commit Graph

12932 Commits

Author SHA1 Message Date
Nikolai Kochetov
4552bc1a74 Fix clang build. 2019-04-05 16:07:04 +03:00
Nikolai Kochetov
ff53ee1b11 Fix clang build. 2019-04-05 15:46:00 +03:00
Nikolai Kochetov
f405f927c0 Fix clang build. 2019-04-05 15:44:25 +03:00
Nikolai Kochetov
cadc6decde Fix clang build. 2019-04-05 15:39:51 +03:00
Nikolai Kochetov
b76b0ebd05 Fix clang build. 2019-04-05 15:36:26 +03:00
Nikolai Kochetov
5e4dbf1226 Fix clang build. 2019-04-05 15:32:47 +03:00
Nikolai Kochetov
5e8fc30ce8 Fix clang build. 2019-04-05 15:29:17 +03:00
Nikolai Kochetov
f473c21b9d Fix clang build. 2019-04-05 14:43:28 +03:00
Nikolai Kochetov
ec65b4c229 Check num columns in Block::cloneWithColumns. 2019-04-05 14:39:07 +03:00
Nikolai Kochetov
33b176f2da Fix style. 2019-04-05 14:34:11 +03:00
Nikolai Kochetov
1470fe0a72 Fix clang build. 2019-04-05 14:27:08 +03:00
Nikolai Kochetov
7626b1b267 Multiple fixes. 2019-04-05 13:52:07 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
Nikolai Kochetov
c88be5ce9c Added CreatingSetsTransform 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
4b068ebd9c Added ConvertingTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
827511c96d Added MaterializingTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
b2e7903992 Added DistinctTransform 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
88dbe52bbe Added TotalsHavingTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
a4e83a85d0 Added Rollup and Cube transforms. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
1293e2d62c Added IInflatingTransform 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
18133a4948 Added processors_test_aggregation. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
f08a10542e Updated AggregatingTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
6cedacb055 Added MergingAggregatedSimpleTransform. 2019-04-03 13:14:30 +03:00
Nikolai Kochetov
b85e554c49 Updated AggregatingTransform for multiple sources case. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
6976b65b2d Added MergingAggregatedTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
dd74e82d47 Added AggregatingTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
f17edfd98f Added test for MergeSortingTransform. 2019-04-03 13:14:08 +03:00
Nikolai Kochetov
c388e57a40 Fix MergingSortedTransform. Update PipelineExecutor. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
49d1899aed Added processors_test_merging_sorted_transform. 2019-04-03 13:14:02 +03:00
Nikolai Kochetov
fd25fab652 Updated MergeSortingTransform. 2019-04-03 13:13:57 +03:00
Nikolai Kochetov
19fa17fd84 Added ExpandPipeline to PipelineExecutor.
Added expanding pipeline test.
2019-04-03 13:13:37 +03:00
Nikolai Kochetov
1e3ca041a2 Added ExpandPipeline processor status. Changed types of InputPorts and OutputPorts from vector to list. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
30d3496c36
Merge pull request #4871 from yandex/fix-array-intersect-impl
Fix array intersect
2019-04-02 17:05:01 +03:00
proller
45591c9d83
Build and test fixes (#4873) 2019-04-02 12:43:53 +03:00
Alexey Milovidov
4cfcdd0f52 Removed useless method #4874 2019-04-01 23:51:32 +03:00
Alexey Milovidov
c9d5885c69 Merge branch 'master' of github.com:yandex/ClickHouse 2019-04-01 22:28:21 +03:00
Nikolai Kochetov
e8a8da1a4f Fix array intersect. 2019-04-01 16:27:07 +03:00
Nikolai Kochetov
736e3c0f46
Merge pull request #4847 from fancyqlx/master
Fixed segment fault of arrayIntersect
2019-04-01 16:06:56 +03:00
Artem Zuikov
b6b9be7b8f
Merge pull request #4867 from Gladdy/martijn-asof-working-bt
Return the correct timestamp for the right-hand table of the ASOF join
2019-04-01 15:36:27 +03:00
Artem Zuikov
019c6ca591
Merge pull request #4794 from zhang2014/fix/crash_when_predicate
fix crash when predicate optimzer & join on
2019-04-01 15:09:50 +03:00
Martijn Bakker
d4ec3bbf70 fix style 2019-04-01 11:35:37 +01:00
Danila Kutenin
fca67c8820 Fix clang build 2019-04-01 08:05:52 +03:00
Martijn Bakker
a64b8afc7e cleanup 2019-04-01 00:09:00 +01:00
Martijn Bakker
27776ca929 fix up wrong assumption that the sample_block_with_keys has same ordering as key_names_right 2019-03-31 22:56:37 +01:00
Martijn Bakker
7ea03f6fa7 appears to work and get the correct timestamps 2019-03-31 22:14:43 +01:00
Danila Kutenin
3ce9686bc4 Some cosmetics 2019-04-01 00:04:45 +03:00
Danila Kutenin
8edb5c5b2d Some cosmetics 2019-03-31 23:59:18 +03:00
Danila Kutenin
d509c226ab Pool was not doing what I expected, great improvement of compilation 2019-03-31 23:55:36 +03:00
Danila Kutenin
f80fb09b81 Hyperscan better usage of scratch space and error handling 2019-03-31 23:19:22 +03:00
Martijn Bakker
4a7393cfc6 include the asof column in the block stored. overall not working yet but at least doesnt crash anymore 2019-03-31 20:03:57 +01:00
chertus
11997ed772 fix build 2019-03-31 13:56:54 +03:00
Artem Zuikov
f87e3ae4c8
Merge pull request #4863 from Gladdy/martijn-asof-nomap
Perform ASOF join with sorting PODArray once and support multiple column types
2019-03-31 13:40:15 +03:00
qianlixiang
bd6bc86ceb Fixed style check errors 2019-03-31 13:03:08 +08:00
qianlixiang
32692fb0dd Fixed style check errors 2019-03-31 12:52:24 +08:00
qianlixiang
dad023ea48 Fixed style check errors 2019-03-31 12:00:11 +08:00
qianlixiang
a1d2732d4c Fixed segment fault of arrayIntersect and add a test 2019-03-31 11:44:05 +08:00
alexey-milovidov
cf492a4401
Merge pull request #4862 from danlark1/master
Optimize Volnitsky by inlining compare function
2019-03-31 02:24:33 +03:00
Martijn Bakker
6695e304af fix style 2019-03-30 21:55:40 +00:00
Martijn Bakker
4709b744bb address the code review issues 2019-03-30 21:30:21 +00:00
Alexey Milovidov
a2e756287e Whitespaces 2019-03-30 23:52:36 +03:00
Vitaly Baranov
37b904b8f5
Merge pull request #4808 from vitlibar/kafka-with-protobuf-format
Kafka with protobuf format
2019-03-30 19:00:57 +03:00
Martijn Bakker
3ac66dfdb6 set default asof type value 2019-03-30 13:09:03 +00:00
Martijn Bakker
20e5fb61c4 fix style 2019-03-30 13:02:30 +00:00
Martijn Bakker
4a94545882 add test for multiple supported asof types 2019-03-30 12:52:48 +00:00
alexey-milovidov
14b8e64992
Disable usage of "mremap" when compiled with Thread Sanitizer. (#4859)
* Disable mremap under Thread Sanitizer

* Disable mremap under Thread Sanitizer

* Disable mremap under Thread Sanitizer
2019-03-30 13:47:25 +03:00
alexey-milovidov
254369324b
Miscellanous changes in ColumnArray (#4857)
* Miscellanous

* Miscellanous

* Miscellanous
2019-03-30 13:46:17 +03:00
Danila Kutenin
18d3813ff9 Optimize Volnitsky by inlining compare function 2019-03-30 12:39:45 +03:00
Martijn Bakker
7c5febb6aa Merge branch 'master' into martijn-asof-nomap 2019-03-30 02:02:48 +00:00
Martijn Bakker
389f108807 working multi type asof join columns 2019-03-30 01:32:08 +00:00
alexey-milovidov
0dee8cf79c
Merge pull request #4855 from 4ertus2/joins
Fix crash when joining nulluble vs not nullable
2019-03-30 02:15:50 +03:00
Martijn Bakker
89515861df asof join without using std::map, but still only on u32 2019-03-29 21:20:23 +00:00
Ivan
957d23267b
Minimal implementation of row-level security CLICKHOUSE-4315 (#4792)
For detailed description see the related PR
2019-03-29 23:31:06 +03:00
alexey-milovidov
5588618c64
Merge pull request #4856 from yandex/fix_no_message_received_keepalive
Fix exception 'No message received'
2019-03-29 23:08:28 +03:00
Vitaly Baranov
378c6f7a23 Improve the error message when format schema isn't set. 2019-03-29 22:36:10 +03:00
alexey-milovidov
cb486da9cd
Merge pull request #4852 from zhang2014/improvement/const_interpreter
Const context for insert interpreter
2019-03-29 21:42:35 +03:00
alesapin
2764401d0f Fix exception 'No message received' 2019-03-29 21:10:03 +03:00
chertus
6bdbf75e30 fix crash when joining nulluble vs not nullable 2019-03-29 21:07:22 +03:00
Alexey Milovidov
61832964e1 Revert "ColumnFunction: better code (incomplete)"
This reverts commit 327f527d33.
2019-03-29 19:42:26 +03:00
Alexey Milovidov
5dddee50eb Merge branch 'master' of github.com:yandex/ClickHouse 2019-03-29 19:41:59 +03:00
alexey-milovidov
296731dd85
Merge pull request #4850 from yandex/fix-reading-from-empty-low-cardinality-arrays
Fixed reading from Array(LowCardinality) with long block of empty arrays.
2019-03-29 19:38:32 +03:00
zhang2014
aab314f154 const insert interpreter 2019-03-29 23:47:16 +08:00
Alexey Milovidov
ff0c269847 Merge branch 'master' of github.com:yandex/ClickHouse 2019-03-29 18:35:58 +03:00
Alexey Milovidov
327f527d33 ColumnFunction: better code (incomplete) 2019-03-29 18:35:53 +03:00
alexey-milovidov
4c9ad05781
Merge pull request #4851 from yandex/remove-assume-mutable-1
Removed "assumeMutable" usage in one case
2019-03-29 18:34:03 +03:00
alexey-milovidov
de07b70178
Merge pull request #4849 from yandex/remove-unsafe-method-column-function
Removed unsafe methods from ColumnFunction
2019-03-29 18:23:33 +03:00
Nikolai Kochetov
5bd46508e8 Fix comments. 2019-03-29 18:07:53 +03:00
Alexey Milovidov
f86abeb8df Fixed comments 2019-03-29 18:06:35 +03:00
Vitaly Baranov
a78e067c70 Allow empty row_delimiter when using Kafka. 2019-03-29 17:38:52 +03:00
zhang2014
0096ef3524 try fix 2019-03-29 22:25:37 +08:00
Alexey Milovidov
88e94bad74 Removed "assumeMutable" usage in one case 2019-03-29 17:17:29 +03:00
Nikolai Kochetov
53319e2d6e Fixed reading from Array(LowCardinality) column with long block of empty array. 2019-03-29 17:06:46 +03:00
Alexey Milovidov
fdb0747219 Removed unsafe methods from ColumnFunction 2019-03-29 16:46:36 +03:00
alexey-milovidov
d10b256a8a
Merge pull request #4845 from yandex/max_partitions_per_insert_block
Implement "max_partitions_per_insert_block" setting
2019-03-29 16:20:46 +03:00
alexey-milovidov
976ee8a7ca
Merge pull request #4844 from yandex/fix-data-race-in-clear-old-temporary-directories
Fixed data race in clearOldTemporaryDirectories
2019-03-29 14:35:44 +03:00
Alexey Milovidov
8e8b5c40e2 Fixed error 2019-03-29 14:24:37 +03:00
qianlixiang
bdb420cdfd Fixed segment fault of arrayIntersect 2019-03-29 18:53:50 +08:00
zhang2014
1eb5713a74 fix crash when predicate optimzer & join on 2019-03-29 18:41:26 +08:00
Artem Zuikov
03cd41fbc7
Merge pull request #4774 from Gladdy/martijn-asof-join
Request for feedback on implementation of ASOF join
2019-03-29 13:19:31 +03:00
Alexey Milovidov
8a31d998fd Merge remote-tracking branch 'origin/master' into max_partitions_per_insert_block 2019-03-29 12:50:41 +03:00
Alexey Milovidov
72d021c3d7 Implement "max_partitions_per_insert_block" setting #4700 2019-03-29 12:45:55 +03:00
alexey-milovidov
7aefd6663f
Merge pull request #4841 from danlark1/master
Added hyperscan fuzzy search
2019-03-29 12:39:25 +03:00
Alexey Milovidov
8cb1619607 Implement "max_partitions_per_insert_block" setting #4700 2019-03-29 12:34:07 +03:00
Alexey Milovidov
8d3ef5df19 Fixed data race in clearOldTemporaryDirectories 2019-03-29 12:28:16 +03:00
Alexey Milovidov
34c0682353 Removed useless method 2019-03-29 11:37:05 +03:00
Danila Kutenin
cd850f6f98 Fix clang build 2019-03-29 10:04:44 +03:00
Danila Kutenin
b822923f5a Better renamings of fuzzy string search 2019-03-29 04:27:17 +03:00
Alexey Milovidov
a2e0f5d29c Merge branch 'master' into fix-race-condition-in-fetch-data-part 2019-03-29 04:22:20 +03:00
alexey-milovidov
72f27f4dec
Merge pull request #4836 from yandex/fix-race-condition-in-system-tables
Fixed TSan report in StorageSystemTables
2019-03-29 04:15:00 +03:00
Danila Kutenin
ef0d622a5f Added hyperscan fuzzy search 2019-03-29 04:02:05 +03:00
Alexey Milovidov
46be1608a6 Fixed error #4836 2019-03-29 02:17:22 +03:00
alexey-milovidov
e3c5da0a69
Merge pull request #4783 from yandex/cow-ptr-compositions
WIP. Attempt to make compositions with COWPtr more convenient
2019-03-29 02:09:39 +03:00
Martijn Bakker
9ac52b9368 fix master merge 2019-03-28 21:06:49 +00:00
Martijn Bakker
46f4557944 Merge branch 'master' into martijn-asof-join 2019-03-28 20:20:17 +00:00
Alexey Milovidov
3fb9814e3e Fixed race condition in fetchPart 2019-03-28 22:59:07 +03:00
Alexey Milovidov
350a0fe129 Miscellaneous 2019-03-28 22:58:41 +03:00
Martijn Bakker
e7a10b8a3e add inner asof join with tests 2019-03-28 19:31:11 +00:00
Alexey Milovidov
4645422176 Fixed TSan report in StorageSystemTables 2019-03-28 22:13:59 +03:00
Alexey Milovidov
4aaf9eccce Fixed error 2019-03-28 22:12:37 +03:00
Martijn Bakker
817a9244c0 fix up code style 2019-03-28 19:03:57 +00:00
Martijn Bakker
b0fd915724 remove the ASOFSplit struct 2019-03-28 18:35:50 +00:00
alexey-milovidov
8f9c8defc5
Merge pull request #4834 from danlark1/master
String search restrictions added
2019-03-28 21:22:38 +03:00
Alexey Milovidov
0a5b1d0a24 Merge branch 'master' into cow-ptr-compositions 2019-03-28 21:18:20 +03:00
Alexey Milovidov
3c29b5f611 Fixed bad code 2019-03-28 21:17:44 +03:00
Danila Kutenin
d22d66a552 Fix exception message 2019-03-28 20:06:04 +03:00
Danila Kutenin
d4e67fa64c Another bug fixed to the comparison 2019-03-28 19:58:16 +03:00
Alexey Milovidov
c8bc4d6e26 Fixed error 2019-03-28 19:48:14 +03:00
Danila Kutenin
70a7f4805d Test to the restriction added, fix bug 2019-03-28 19:41:11 +03:00
Alexey Milovidov
fa598d427d Fixed error 2019-03-28 19:28:54 +03:00
Danila Kutenin
cae4a426c5 Hyperscan restriction 2019-03-28 17:59:25 +03:00
Alexey Milovidov
4417705f32 Merge branch 'master' into cow-ptr-compositions 2019-03-28 17:47:59 +03:00
alexey-milovidov
203e36c2fa
Merge pull request #4824 from proller/fix26
CLICKHOUSE-4386 Version in exceptions
2019-03-28 17:45:02 +03:00
proller
e4d45b7e50 Fix test include 2019-03-28 16:10:42 +03:00
proller
cbffebc22c Print with version 2019-03-28 16:08:38 +03:00
proller
ccd5db786c Merge remote-tracking branch 'upstream/master' into fix26 2019-03-28 13:39:03 +03:00
alexey-milovidov
d731b437d3
Merge pull request #4782 from yandex/always-backquote-column-names
Always backquote column names
2019-03-28 00:23:02 +03:00
Alexey Milovidov
faf9462c37 Added support for constant-constant case in multi-search functions 2019-03-27 22:25:58 +03:00
alexey-milovidov
0a01a2f2d9
Merge pull request #4816 from yandex/add-setting-to-disable-hyperscan
Added a setting to disallow Hyperscan.
2019-03-27 22:02:30 +03:00
proller
7d1be03a16 CLICKHOUSE-4386 Version in exceptions 2019-03-27 18:46:46 +03:00
chertus
2a5b4b3b31 fix ANY JOIN nulls in right key (ALL JOIN is still affected) 2019-03-27 16:37:11 +03:00
chertus
e92dcd4774 fix clang release build 2019-03-27 01:47:38 +03:00
Martijn Bakker
ac68fc8088 pass the half-enforced style checks such that they cannot be run on a whole file automatically :( 2019-03-26 22:05:51 +00:00
Alexey Milovidov
42dd521e45 Added a setting to disallow Hyperscan 2019-03-27 00:56:46 +03:00
Martijn Bakker
84f40ddf02 fix build as cpp does not do partial function specialization 2019-03-26 20:13:15 +00:00
chertus
274916d944 Merge branch 'master' into nulls 2019-03-26 23:04:39 +03:00
chertus
0a0e986f75 fix crash on join not nullable with nullable 2019-03-26 22:46:03 +03:00
Martijn Bakker
f6987cfa52 have the parser recognize asof joins and feed them through to the executor
insert the time series into a struct ready for joining

working version that inserts the data into the hash table using the existing dispatching machinery for various types

working asof left join in clickhouse

add a test for the asof join

do some asof join cleanup

revisit the logic in case the values match between left and right side
2019-03-26 19:17:21 +00:00
Alexey Milovidov
80a523f470 Merge branch 'master' into always-backquote-column-names 2019-03-26 21:29:33 +03:00
alexey-milovidov
aab7c79220
Merge pull request #4671 from LiuYangkuan/Buffer-supportsPrewhere
change supportsPrewhere() of Buffer and return its destination_table supportsPrewhere
2019-03-26 19:55:27 +03:00
alexey-milovidov
b8d9ed6f54
Merge pull request #4723 from 4ertus2/joins
Fix LEFT JOIN with const column + lots of Join.cpp refactoring
2019-03-26 19:46:46 +03:00