Commit Graph

4897 Commits

Author SHA1 Message Date
alexey-milovidov
e1104135c8
Merge pull request #13939 from fastio/master
Multithreading implementation of Kafka engine
2020-09-07 20:12:06 +03:00
tavplubix
1f1b570832
Merge pull request #14523 from BohuTANG/mysql_replication_1
Remove dryrun event to update position
2020-09-07 15:49:33 +03:00
BohuTANG
576c6e9757 Remove dryrun event to update position 2020-09-07 13:18:28 +08:00
alexey-milovidov
8b0a6d5609
Merge pull request #14404 from dimarub2000/system_events_show_zero_values
system_events_show_zero_values setting added
2020-09-07 06:40:36 +03:00
Dmitry
9639846ca9 Merge branch 'master' into system_events_show_zero_values 2020-09-06 14:55:14 +03:00
alexey-milovidov
a78b04b56a
Merge pull request #14455 from ClickHouse/prepare-clang-11
Prepare for clang 11
2020-09-06 11:02:58 +03:00
Peng Jian
ac25c41f22 Update docs for Kafka engine 2020-09-06 11:17:19 +08:00
Peng Jian
fd82272cfe Fix code style, and update docs for Kafka engine 2020-09-06 11:17:19 +08:00
Peng Jian
e6bfd9d586 1. Add new setting for Kafka engine, named kafka_thread_per_consumer which default value is false. 2. Create separate thread pool for Kafka engine. 2020-09-06 11:17:19 +08:00
Peng Jian
de0a40aedc fix code style 2020-09-06 11:17:19 +08:00
Peng Jian
61ac52cf29 Multithreading implementation of Kafka engine 2020-09-06 11:17:18 +08:00
alexey-milovidov
d61dda36ef
Update Sources.h 2020-09-06 01:09:59 +03:00
bharatnc
425c4d0634 fix style check - declare error code ILLEGAL_TYPE_OF_ARGUMENT 2020-09-04 21:26:51 -07:00
bharatnc
25080f3a88 additional checks for empty tz for toStartOfMonth|Quarter|Year 2020-09-04 20:15:37 -07:00
bharatnc
8fd00ff77b rename test files and fix tests - add ; at the end 2020-09-04 18:42:43 -07:00
bharatnc
cf110f4eb0 toStartOfInterval* functions - disallow empty timezone 2020-09-04 17:32:38 -07:00
Nikolai Kochetov
01d0f6e5c5
Merge pull request #14402 from ClickHouse/stop-threads-if-exception-in-pipeline-executor
Stop query execution if exception happened in PipelineExecutor itself.
2020-09-04 23:40:22 +03:00
Artem Zuikov
7c20aa2c62
Another 256-bit integers (strict 32 bytes) (#14229) 2020-09-04 16:33:02 +03:00
Nikolai Kochetov
7f88e3de1f Review fix. 2020-09-04 15:54:31 +03:00
alesapin
f8aa6cfe8a
Merge pull request #14438 from ClickHouse/apply_ttl_if_not_calculated
Apply TTL if it's not calculated for part
2020-09-04 15:32:50 +03:00
Nikolai Kochetov
40768593c3
Merge pull request #14469 from BohuTANG/mysql_set_@@var
Support MySQL handler 'set @@xx' settting
2020-09-04 14:18:57 +03:00
Nikolai Kochetov
0bf0fb0e55
Merge pull request #14468 from BohuTANG/mysql_replication_gtid_format
Fix mysql replication GTID event dump format
2020-09-04 13:19:05 +03:00
alesapin
c96a2b4f22
Merge pull request #14444 from ClickHouse/fix_select_parts_for_merge
Fix select parts for merge
2020-09-04 09:55:48 +03:00
alexey-milovidov
54ede2e1bb
Merge pull request #14467 from ClickHouse/topk-check-overflow
Check for array size overflow in topK
2020-09-04 09:15:33 +03:00
alexey-milovidov
d623048dd1
Merge pull request #14454 from amosbird/im1
Remove redundant conditions
2020-09-04 09:14:35 +03:00
BohuTANG
c094ff7eca ISSUES-9336 support MySQL handler 'set @@xx' settting 2020-09-04 12:51:15 +08:00
BohuTANG
4b0264c2a8 Fix mysql replication GTID event dump format 2020-09-04 12:00:37 +08:00
Alexey Milovidov
1cee6d5a31 Check for array size overflow in topK #14452 2020-09-04 04:05:57 +03:00
alexey-milovidov
12a21cb1a4
Merge pull request #14440 from matwey/fix/missed-atomic
Add missed #include <atomic>
2020-09-04 03:47:15 +03:00
Alexey Milovidov
4b3220f79a Prepare for clang 11 2020-09-04 03:39:56 +03:00
alexey-milovidov
4f9df21d3e
Merge pull request #10373 from azat/dist-SELECT-optimization
Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key
2020-09-04 01:38:56 +03:00
Alexey Milovidov
796e3ae87d Prepare for clang 11 2020-09-03 22:40:21 +03:00
Amos Bird
3817c0efa7
Remove redundant conditions 2020-09-04 02:13:57 +08:00
alesapin
bd24c3a059 Fix build useless binary 2020-09-03 17:38:56 +03:00
Vitaly Baranov
dda884d6d0
Update AccessControlManager.h
Add "override" for the destructor of AccessControlManager
2020-09-03 17:20:14 +03:00
alesapin
55adb6f9f2
Update src/Storages/MergeTree/MergeSelector.h
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2020-09-03 16:55:34 +03:00
alexey-milovidov
6a32d30578
Merge pull request #14431 from ClickHouse/fix-lazy-database
Fix for Lazy database
2020-09-03 16:38:59 +03:00
alesapin
e48e4309b2 Better names 2020-09-03 16:29:18 +03:00
alesapin
565555e55c Fix bug in parts selection 2020-09-03 16:04:28 +03:00
alesapin
acc0ee0657 Apply TTL if it's not calculated for part 2020-09-03 11:59:41 +03:00
Ilya Yatsishin
2b8ad576cc
Merge pull request #14323 from qoega/try-dns-fix
Add tag pass for integration base image. Add explicit dns options for docker-compose.
2020-09-03 11:27:24 +03:00
alexey-milovidov
edea940e17
Update StorageDistributed.cpp 2020-09-03 04:39:36 +03:00
Alexey Milovidov
96038e9d54 Fix for Lazy database 2020-09-03 04:06:12 +03:00
alexey-milovidov
1c2435d4f7
Merge pull request #14233 from amosbird/apply
Introduce columns transformers.
2020-09-03 01:37:40 +03:00
alexey-milovidov
72417d2716
Merge pull request #14368 from BohuTANG/materialize_mysql_query_filter_1
change string.rfind to string starts_with and add some tests
2020-09-03 01:09:53 +03:00
alexey-milovidov
4b1b744644
Revert "Less number of threads in builder" 2020-09-03 01:00:41 +03:00
Azat Khuzhin
fffeeeba06 Force WithMergeableStateAfterAggregation via distributed_group_by_no_merge (convert to UInt64)
Possible values:
- 1 - Do not merge aggregation states from different servers for distributed query processing - in case it is for certain that there are different keys on different shards.
- 2 - same as 1 but also apply ORDER BY and LIMIT stages
2020-09-03 00:52:51 +03:00
Azat Khuzhin
10b4f3b41f Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key
Previous set of QueryProcessingStage does not allow to do this.
But after WithMergeableStateAfterAggregation had been introduced the
following queries can be optimized too under
optimize_distributed_group_by_sharding_key:
- GROUP BY sharding_key LIMIT
- GROUP BY sharding_key LIMIT BY
- GROUP BY sharding_key ORDER BY

And right now it is still not supports:
- WITH TOTALS (looks like it can be supported)
- WITH ROLLUP (looks like it can be supported)
- WITH CUBE
- SETTINGS extremes=1 (looks like it can be supported)
But will be implemented separatelly.

vX: fixes
v2: fix WITH *
v3: fix extremes
v4: fix LIMIT OFFSET (and make a little bit cleaner)
v5: fix HAVING
v6: fix ORDER BY
v7: rebase against 20.7
v8: move out WithMergeableStateAfterAggregation
v9: add optimize_distributed_group_by_sharding_key into test names
2020-09-03 00:52:51 +03:00
Azat Khuzhin
4043be3121 Add new query processing stage WithMergeableStateAfterAggregation
Process query until the stage where the aggregate functions were
calculated and finalized.

It will be used for optimize_distributed_group_by_sharding_key.

v2: fix aliases
v3: Fix protocol ABI breakage due to WithMergeableStateAfterAggregation
    Conditions >= for QueryProcessingStage::Enum has been verified, and they
    are ok (in InterpreterSelectQuery).
2020-09-03 00:51:08 +03:00
alexey-milovidov
7bd31fb3d3
Merge pull request #14313 from ClickHouse/fix-fuzz-test6
Better check for tuple size in SSD cache complex key external dictionaries
2020-09-03 00:50:24 +03:00