Commit Graph

535 Commits

Author SHA1 Message Date
Nikolai Kochetov
9ddd7b98cc Fix tests. 2020-06-19 12:47:15 +03:00
Mikhail Filimonov
9609bd9dee Kafka better states, formats based on PeekableReadBuffer, and other minor fixes.
Add formats tests, fixes for JSONCompactEachRowWithNamesAndTypes, TSVWithNamesAndTypes. Some CR fixes
Add sanitizing for kafka_max_block_size and kafka_poll_max_batch_size
2020-06-19 10:49:05 +02:00
Nikolai Kochetov
cda4de40d7 Merge branch 'master' into query-plan 2020-06-19 11:29:15 +03:00
Nikolai Kochetov
1f013208db Fix style. 2020-06-18 23:11:42 +03:00
Nikolai Kochetov
de6ef17d27 Fix QueryPipeline::unitePipelines 2020-06-18 22:42:28 +03:00
Nikolai Kochetov
26161aac8a Fix ReadFromStorageStep 2020-06-18 22:17:21 +03:00
Nikolai Kochetov
6cbdb6da00 Fix build. 2020-06-18 22:03:21 +03:00
Nikolai Kochetov
0ba7ff85e1 Fix build. 2020-06-18 21:45:27 +03:00
Nikolai Kochetov
b7bed87a7f Use QueryPlan in InterpreterSelectQuery [part 3]. 2020-06-18 21:29:33 +03:00
Avogar
71b5d267ce Set compression to None 2020-06-18 21:02:13 +03:00
Nikolai Kochetov
45adacf0bc Use QueryPlan in InterpreterSelectQuery [part 2]. 2020-06-18 20:45:00 +03:00
alesapin
d79982f497 Better locks in Storages 2020-06-18 19:10:47 +03:00
Nikolai Kochetov
e0841360db Use QueryPlan in InterpreterSelectQuery [part 1]. 2020-06-18 16:38:45 +03:00
Nikolai Kochetov
35ab9ad051 Merge branch 'master' into fix-parallel-final-stuck 2020-06-18 16:04:14 +03:00
Nikolai Kochetov
5bb2ddc6f9 Add DISTINCT trait for QueryPlanStep. 2020-06-18 16:00:16 +03:00
Avogar
75a66fbba3 Fix errors 2 2020-06-18 15:52:46 +03:00
Nikolai Kochetov
21d9c7fcc8 Fix build. 2020-06-18 12:22:29 +03:00
Nikolai Kochetov
c111836ada Update PartialSortingTransform. 2020-06-18 12:08:25 +03:00
alesapin
ebb36bec8a Merge branch 'master' into atomic_metadata5 2020-06-18 11:57:16 +03:00
alexey-milovidov
c9924b8aa1
Merge pull request #11697 from CurtizJ/fix-with-fill
Fix 'ORDER BY ... WITH FILL' over const columns.
2020-06-18 06:38:24 +03:00
Avogar
4fd3bcd823 Fix build errors 2020-06-18 03:17:08 +03:00
Anton Popov
8ba5bd8530 Merge remote-tracking branch 'upstream/master' into distinct-combinator 2020-06-18 01:44:36 +03:00
Nikolai Kochetov
9ad00187e3 Update InterpreterSelectQuery.. 2020-06-17 23:19:55 +03:00
Nikolai Kochetov
169ad5e805 Add FinishSortingStep. 2020-06-17 22:57:13 +03:00
Nikolai Kochetov
e8049d34c5 Add OffsetsStep. 2020-06-17 22:38:45 +03:00
Anton Popov
88b325dcdc rework distinct combinator 2020-06-17 22:36:27 +03:00
Avogar
7780a74bd8 Update ORCBlockOutputFormat and add orc include directory in include path 2020-06-17 22:32:11 +03:00
Nikolai Kochetov
69ff3a8f7d Add ExtremesStep. 2020-06-17 22:30:36 +03:00
Nikolai Kochetov
d795b2b037 Add FillingStep 2020-06-17 22:20:30 +03:00
Nikolai Kochetov
7fcea660de Fix ya.make/ 2020-06-17 22:08:30 +03:00
Nikolai Kochetov
38bebfb20d Merge remote-tracking branch 'origin' into provert-master 2020-06-17 22:05:45 +03:00
Nikolai Kochetov
d41db3622f Add RollupStep and CubeStep. 2020-06-17 20:15:24 +03:00
Nikolai Kochetov
c5d9379df0 Add TotalsHavingStep. 2020-06-17 19:54:51 +03:00
Nikolai Kochetov
ce7c8782e2
Update PartialSortingTransform.cpp 2020-06-17 19:13:44 +03:00
Nikolai Kochetov
1ad4f2c0fd Add CreatingSets step. 2020-06-17 18:50:21 +03:00
Nikolai Kochetov
f279df6015 Added AggregatingStep. 2020-06-17 17:21:48 +03:00
Nikolai Kochetov
582ea24469 Added AddingDelayedStreamStep 2020-06-17 16:38:17 +03:00
Alexander Tokmakov
3938b051c2 fix type duduction in values format 2020-06-17 16:21:06 +03:00
Nikolai Kochetov
6c477d06ad Review fixes. 2020-06-17 14:43:55 +03:00
Nikolai Kochetov
0829d1d16d Fix ya.make 2020-06-17 12:16:01 +03:00
alesapin
2fac3290f0 Merge branch 'master' into atomic_metadata5 2020-06-17 11:14:03 +03:00
Alexey Milovidov
a655765040 Merge branch 'master' into return-not-nullable-from-count-distinct-2 2020-06-17 01:15:57 +03:00
Artem Zuikov
857d84bf7c
Buffer left blocks optimisation for MergeJoin (#10601) 2020-06-16 23:13:18 +03:00
Nikolai Kochetov
fdacc9f90e Add MergingAggregatedStep. 2020-06-16 21:57:21 +03:00
Nikolai Kochetov
148257abb5 Add LimitStep. 2020-06-16 21:23:01 +03:00
Nikolai Kochetov
5bb1d5cc43 Add LimitByStep. 2020-06-16 19:49:49 +03:00
Nikolai Kochetov
603bcdde2d Add DistinctStep. 2020-06-16 19:13:07 +03:00
Nikolai Kochetov
cfe87a77ea Add MergingSortedStep. 2020-06-16 18:49:09 +03:00
Nikolai Kochetov
08e9ce8661 Add MergingSortedStep. 2020-06-16 18:47:40 +03:00
Nikolai Kochetov
a0a1445da9 Fix build. 2020-06-16 18:10:40 +03:00
Nikolai Kochetov
f563193967 Add MergeSortingStep. 2020-06-16 18:08:01 +03:00
Nikolai Kochetov
815ac03892 Add PartialSortingStep. 2020-06-16 17:45:52 +03:00
Nikolai Kochetov
ab452e9391 Added source steps. 2020-06-16 17:14:14 +03:00
Nikolai Kochetov
4407bd7daa Added source steps. 2020-06-16 17:11:19 +03:00
Nikolai Kochetov
be8029e54f Expression and Filter steps. 2020-06-16 15:02:10 +03:00
Nikolai Kochetov
e28552ec71 Fix build. 2020-06-16 12:53:59 +03:00
Nikolai Kochetov
1bb72205bd Expression and Filter steps. 2020-06-16 12:42:25 +03:00
Nikolai Kochetov
61070a03cd Fix build. 2020-06-16 10:56:22 +03:00
Anton Popov
03058c3c25 fix 'ORDER BY WITH FILL' over const columns 2020-06-16 05:56:16 +03:00
Nikolai Kochetov
03e0a5ddbc Merge branch 'master' into query-plan 2020-06-15 23:38:35 +03:00
Nikolai Kochetov
da11190677 Fix tests. 2020-06-15 23:20:45 +03:00
Nikolai Kochetov
dbef88e073 Fix tests. 2020-06-15 22:33:24 +03:00
alesapin
36ba0192df Metadata in read and write methods of IStorage 2020-06-15 22:08:58 +03:00
Nikolai Kochetov
012fb819db Fix build. 2020-06-15 21:49:41 +03:00
Nikolai Kochetov
68f8372c12 Fix build. 2020-06-15 21:41:47 +03:00
Nikolai Kochetov
b456a3cc77 Fix tests. 2020-06-15 20:48:04 +03:00
Nikolai Kochetov
5436ef38bf Fix MergingSortedAlgorithm. 2020-06-15 18:21:10 +03:00
Nikolai Kochetov
b725df6366 Added ReadFromStorageStep. 2020-06-15 18:17:44 +03:00
Nikolai Kochetov
b5ecef6adf Fix tests. 2020-06-15 16:56:38 +03:00
Nikolai Kochetov
ccf2ceb876 Fix pipeline stuck for parallel final. 2020-06-15 14:02:47 +03:00
Alexey Milovidov
394fb64a9c Better way of implementation 2020-06-14 20:42:11 +03:00
Avogar
93aee32ae4 Add ORCBlockOutputFormat 2020-06-14 18:35:32 +03:00
Dmitry
e5897bbfb6 size_t -> ssize_t 2020-06-12 18:59:11 +03:00
Nikolai Kochetov
595fc9eff6
Merge pull request #11440 from ClickHouse/add-remote-source
Add remote source
2020-06-09 19:27:28 +03:00
Nikolai Kochetov
4c179e454a Add QueryPlan. 2020-06-08 12:14:58 +03:00
Alexey Milovidov
d3d02a67f4 Speed up build by removing old example programs 2020-06-06 19:19:16 +03:00
Anton Popov
5c42408add
Merge pull request #9113 from dimarub2000/group_by_in_order_optimization
[WIP] Optimization of GROUP BY with respect to table sorting key.
2020-06-06 14:25:59 +03:00
alexey-milovidov
050ef9eb54
Merge pull request #11455 from azat/INSERT-SELECT-FINAL-pipeline-stuck
Fix Pipeline stuck for INSERT SELECT FINAL
2020-06-06 12:36:07 +03:00
Nikolai Kochetov
108575c8ad Added IQueryPlanStep. 2020-06-05 18:38:03 +03:00
Nikolai Kochetov
5fea34d0e1 Use Resize instead of Concat in InterpreterInsertQuery. 2020-06-05 12:30:16 +03:00
Azat Khuzhin
1887e343ec Fix Pipeline stuck for INSERT SELECT FINAL
INSERT SELECT FINAL where SELECT (max_threads>1) has multiple streams
but INSERT has only one (max_insert_threads==0) will add ConcatProcessor
that will stuck the pipeline in this case.
2020-06-05 01:14:30 +03:00
Nikolai Kochetov
d87b474665 Remove debug output. 2020-06-04 23:42:59 +03:00
Nikolai Kochetov
31ad5d7e5d Remove debug output. 2020-06-04 23:42:03 +03:00
Alexander Kuzmenkov
435f53e05a Improve error messages
Also support fmt for exception messages, the same way we use it in
logging macros.
2020-06-04 20:50:29 +03:00
Albert Kidrachev
60b86f524f add perf-test and fix 2020-06-04 20:10:52 +03:00
Nikolai Kochetov
18516ba09f Fix DelayedSource. 2020-06-04 16:46:27 +03:00
Nikolai Kochetov
563fe4ea35 Fix DelayedSource. 2020-06-04 16:45:23 +03:00
Nikolai Kochetov
dcf9b9ef39 Fix build. 2020-06-04 16:08:09 +03:00
Nikolai Kochetov
f54f948162 Added DelayedSource. 2020-06-04 15:17:35 +03:00
Albert Kidrachev
ae7bad368b run optimization for limit >= 1500 and hint for comparing ColumnString 2020-06-04 01:50:58 +03:00
Anton Popov
5348e5a746
Fix build 2020-06-04 00:58:51 +03:00
Nikolai Kochetov
83b6467308 Added RemoteSource. 2020-06-03 22:50:11 +03:00
Alexander Kuzmenkov
8bf8b44510
Merge pull request #11366 from ClickHouse/fix-SortingTransform-bug
Fix sorting transform bug
2020-06-03 12:11:57 +03:00
alexey-milovidov
6864016e22
Merge pull request #11324 from ClickHouse/improve-performance-of-client-interactive-mode
Add setting "output_format_pretty_max_value_width".
2020-06-03 00:17:29 +03:00
Dmitry
5391d26703 better logging 2020-06-02 23:38:10 +03:00
Alexey Milovidov
6fea843d88 Fix Mac OS build 2020-06-02 16:56:03 +03:00
Alexey Milovidov
933644b8e4 Fix clang-tidy 2020-06-02 16:53:34 +03:00
Nikolai Kochetov
46493b9878 Fix PartialSortingTransform. 2020-06-02 14:56:58 +03:00
Nikolai Kochetov
ecdbd888cf Clase all inputs in SortingTransform. 2020-06-02 13:50:27 +03:00
Nikolai Kochetov
cc3abb12d3 Disable filtration for PartialSortingTransform 2020-06-02 11:28:57 +03:00
Nikolai Kochetov
fded020cdc Fix build. 2020-06-02 10:53:55 +03:00
Alexey Milovidov
cd07d61ce7 Updated tests 2020-06-02 05:39:21 +03:00
Alexey Milovidov
d34b1a8791 Merge branch 'master' into improve-performance-of-client-interactive-mode 2020-06-02 04:24:17 +03:00
Albert Kidrachev
d717919c0c some improvements of vectorization compare 2020-06-02 03:23:41 +03:00
Nikolai Kochetov
53d12f5ab8 Try fix build. 2020-06-01 20:06:21 +03:00
Nikolai Kochetov
3a0acb00c1 Remove some streams. 2020-06-01 19:31:06 +03:00
Albert Kidrachev
02611de051 merge 2020-06-01 15:11:36 +03:00
Albert Kidrachev
fe170508bd devirtualize compareAt calls 2020-06-01 15:10:32 +03:00
Alexey Milovidov
c901a657f8 Improvement 2020-06-01 01:17:40 +03:00
Alexey Milovidov
a76bd99e84 Added setting "output_format_pretty_max_value_width" 2020-06-01 01:12:13 +03:00
Alexey Milovidov
2895cfb480 Limit value width in Pretty formats 2020-05-31 22:22:59 +03:00
Alexey Milovidov
25f941020b Remove namespace pollution 2020-05-31 00:57:37 +03:00
Alexey Milovidov
5aff138956 Preparation for structured logging 2020-05-31 00:35:52 +03:00
Dmitry
4b0d32f026 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-31 00:21:02 +03:00
alexey-milovidov
a5770fe041
Update PullingPipelineExecutor.cpp 2020-05-30 21:05:05 +03:00
MovElb
b4b5c90343 squash 2020-05-30 20:05:05 +03:00
Nikolai Kochetov
f7e0e87c7d Try fix tests. 2020-05-29 19:35:09 +03:00
Albert Kidrachev
43c0499e87 merging 2020-05-29 17:53:33 +03:00
Albert Kidrachev
c91ca6fd4b fix optimization, add comments and performance test 2020-05-29 04:50:02 +03:00
Nikolai Kochetov
a9c6fa1ca7 Try fix tests. 2020-05-28 23:05:07 +03:00
Dmitry
871539e4cc test and ya.make 2020-05-28 20:30:21 +03:00
tavplubix
801c1c1240
Merge pull request #11205 from ClickHouse/fix-view-totals
Fix totals and extremes header for view.
2020-05-28 15:05:34 +03:00
Nikolai Kochetov
2a217e64e0
Merge pull request #11171 from Provet/master
Optimized partial sort transformer
2020-05-28 12:28:50 +03:00
Albert Kidrachev
c38caafe93 fix tests 2020-05-28 11:55:20 +03:00
Albert Kidrachev
fedf1f5dd2 more relaxation 2020-05-28 11:55:20 +03:00
Albert Kidrachev
c301471c53 fix 2020-05-28 11:55:20 +03:00
Albert Kidrachev
e24e6257c7 fix 2020-05-28 11:55:20 +03:00
Albert Kidrachev
e51e828d5c init 2020-05-28 11:55:20 +03:00
Alexander Kuzmenkov
a697560738
Merge pull request #11224 from ClickHouse/aku/merge-arrow-stream
Merge ArrowStream format #11088
2020-05-28 09:37:40 +03:00
Nikolai Kochetov
2dcee3db5c Merge branch 'master' into remove-experimental-use-processors-flag-3 2020-05-27 21:25:34 +03:00
Nikolai Kochetov
e93882c977 Insert select using PipelineExecutor. 2020-05-27 21:20:26 +03:00
Albert Kidrachev
4c5324600b fix tests 2020-05-27 18:38:29 +03:00
Albert Kidrachev
a727e1fb1b more relaxation 2020-05-27 15:57:14 +03:00
Alexander Kuzmenkov
ac263f921e Merge remote-tracking branch 'origin/master' into HEAD 2020-05-27 15:51:03 +03:00
Alexander Kuzmenkov
ad93644254 make single if 2020-05-27 15:50:12 +03:00
Alexander Kuzmenkov
c1cfc68cd6 revert accidental changes 2020-05-27 15:46:49 +03:00
Alexander Kuzmenkov
f54c892b49
Update src/Processors/Formats/Impl/ArrowBlockInputFormat.h 2020-05-27 15:41:59 +03:00
Alexander Kuzmenkov
61f833efc1
Update src/Processors/Formats/Impl/ArrowBlockInputFormat.h 2020-05-27 15:41:52 +03:00
Alexander Kuzmenkov
81a5af1938
Update src/Processors/Formats/Impl/ArrowBlockInputFormat.h 2020-05-27 15:41:45 +03:00
Albert Kidrachev
a0f99fde70 fix 2020-05-27 14:56:01 +03:00
Albert Kidrachev
d24286d5da fix 2020-05-27 14:52:45 +03:00
Dmitry
112e86b134 small fix 2020-05-26 22:20:02 +03:00
Nikolai Kochetov
361b92f083
Merge pull request #11200 from ClickHouse/fix-strict-resize-finishing
Fix StrictResize
2020-05-26 21:31:44 +03:00
Dmitry
38c585f867 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-26 21:27:50 +03:00
Nikolai Kochetov
12384551da Fix totals and extremes header for views. 2020-05-26 16:19:24 +03:00
Nikolai Kochetov
e9d348ebf9
Merge pull request #11198 from ClickHouse/fix-step-by-step-pipeline-execution
Fix PipelineExecutor::executeStepImpl
2020-05-26 15:27:56 +03:00
Nikolai Kochetov
709f705886 Fix PipelineExecutor::executeStepImpl 2020-05-26 13:26:38 +03:00
Nikolai Kochetov
54f50745ec Fix StrictResizeProcessor. 2020-05-26 13:19:56 +03:00
Nikolai Kochetov
1f9e4996c7 Fix PipelineExecutor::executeStepImpl 2020-05-26 10:51:53 +03:00
hcz
f2e3bcdd15 Improve code style in src and test files of Arrow formats 2020-05-25 10:50:55 +08:00