Aleksei Semiglazov
921518db0a
CLICKHOUSE-606: query deduplication based on parts' UUID
...
* add the query data deduplication excluding duplicated parts in MergeTree family engines.
query deduplication is based on parts' UUID which should be enabled first with merge_tree setting
assign_part_uuids=1
allow_experimental_query_deduplication setting is to enable part deduplication, default ot false.
data part UUID is a mechanism of giving a data part a unique identifier.
Having UUID and deduplication mechanism provides a potential of moving parts
between shards preserving data consistency on a read path:
duplicated UUIDs will cause root executor to retry query against on of the replica explicitly
asking to exclude encountered duplicated fingerprints during a distributed query execution.
NOTE: this implementation don't provide any knobs to lock part and hence its UUID. Any mutations/merge will
update part's UUID.
* add _part_uuid virtual column, allowing to use UUIDs in predicates.
Signed-off-by: Aleksei Semiglazov <asemiglazov@cloudflare.com>
address comments
2021-02-02 16:53:39 +00:00
Maksim Kita
d0151de4bb
Merge pull request #19608 from kreuzerkrieg/Add_IStoragePolicy_interface
...
Add IStoragePolicy interface
2021-02-02 11:03:20 +03:00
Azat Khuzhin
acde56ff8a
Add separate pool for message brokers (RabbitMQ and Kafka)
...
background_message_broker_schedule_pool_size was introduced in #13939 ,
but never used actually, use it for RabbitMQ and Kafka.
2021-01-27 21:08:41 +03:00
kreuzerkrieg
29a2ef3089
Add IStoragePolicy interface
2021-01-26 10:55:28 +02:00
alexey-milovidov
ba3e064a63
Merge pull request #19371 from kssenii/test-coverage-with-factories
...
test coverage with factories
2021-01-25 07:11:09 +03:00
kssenii
0d940c6137
Add AggregateFunctionCombinatorFactory, better names
2021-01-23 12:07:37 +00:00
kssenii
daab2c91bb
Better
2021-01-21 21:15:11 +00:00
Nikita Mikhaylov
dca0cbf4eb
Merge pull request #19313 from nikitamikhaylov/another-race-cache-dictionary
...
Fixed race between copy-constructor and addQueryAccessInfo
2021-01-21 21:02:36 +03:00
kssenii
c1702f34ee
Add factories info into system.query_log
2021-01-21 15:46:37 +00:00
Nikita Mikhailov
1d1e53f5d3
style
2021-01-20 15:37:53 +03:00
Nikita Mikhailov
cf88874088
done
2021-01-20 15:30:41 +03:00
alesapin
6c6bf60937
Rename function
2021-01-19 18:23:32 +03:00
alesapin
ac64a13392
Split storage and requests processing
2021-01-19 17:22:28 +03:00
Nikita Mikhailov
c5f92e5096
better formatfactory
2020-12-30 06:07:30 +03:00
Nikita Mikhailov
dcfbe782c6
Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel-parsing-input-format
2020-12-23 05:20:22 +03:00
Amos Bird
2a28c127eb
Better code for real
2020-12-18 14:13:59 +08:00
Amos Bird
2f92d57af9
Better code.
2020-12-18 14:13:58 +08:00
Amos Bird
272311f6bd
Extensive information in system.query_log
2020-12-18 14:13:58 +08:00
nikitamikhaylov
12e624fd9a
fix tests
2020-12-15 00:56:48 +03:00
alesapin
3d0dbbe411
Fix build
2020-12-08 17:49:18 +03:00
Alexey Milovidov
4ecfe8fef4
Remove unused headers
2020-12-08 02:10:22 +03:00
alesapin
d199a2bf76
Merge branch 'master' into complete_zk_api
2020-11-27 14:55:55 +03:00
alexey-milovidov
dfae1efbbd
Merge pull request #17070 from fastio/master
...
Support multiple ZooKeeper clusters
2020-11-27 10:38:01 +03:00
Alexander Kuzmenkov
1d7dcef4a0
Merge remote-tracking branch 'origin/master' into HEAD
2020-11-24 21:45:10 +03:00
alesapin
b8fb44a7b9
Merge with master
2020-11-23 11:05:50 +03:00
Amos Bird
1d9d586e20
Make global_context consistent.
2020-11-20 18:23:14 +08:00
alesapin
1aba61be7f
Merge branch 'master' into complete_zk_api
2020-11-19 13:32:15 +03:00
Peng Jian
a0683ce460
Support mulitple ZooKeeper clusters
2020-11-19 15:44:47 +08:00
Alexander Kuzmenkov
1570320e20
fixes for context hierarchy
2020-11-18 20:43:18 +03:00
nikitamikhaylov
6f4e5bcaac
style
2020-11-17 17:39:34 +03:00
nikitamikhaylov
ee8b3339a1
done
2020-11-17 17:39:34 +03:00
alesapin
6398271432
Merge branch 'master' into complete_zk_api
2020-11-11 16:57:24 +03:00
alesapin
932ea0ef8b
Merge branch 'master' into complete_zk_api
2020-11-10 13:56:11 +03:00
Amos Bird
aa8e6db786
reload auxiliary zookeepers configuration
2020-11-10 15:56:37 +08:00
alesapin
a02b4322b6
Merge branch 'master' into complete_zk_api
2020-11-03 13:13:07 +03:00
alesapin
101aa9e931
Merge branch 'master' into no_background_pool_no_more
2020-11-02 10:49:19 +03:00
alesapin
c2525ef211
Server and client pinging each other
2020-10-30 17:16:47 +03:00
alesapin
40fc512e79
Merge branch 'master' into no_background_pool_no_more
2020-10-29 12:53:34 +03:00
alesapin
1c9e24b5e2
Merge branch 'master' into system_fetches_table
2020-10-28 10:20:04 +03:00
alesapin
880f4bbd05
System fetches
2020-10-26 19:38:35 +03:00
Alexander Kuzmenkov
5a70e26c70
Merge remote-tracking branch 'origin/master' into HEAD
2020-10-26 19:21:13 +03:00
alesapin
d5d0819698
Merge branch 'master' into no_background_pool_no_more
2020-10-26 12:58:51 +03:00
alesapin
f97e6beb70
Remove message broker pool from context
2020-10-25 15:34:18 +03:00
Alexander Kuzmenkov
145e2b012f
cleanup
2020-10-22 19:47:20 +03:00
alesapin
7edbe4d276
Add some comments
2020-10-16 13:12:31 +03:00
alesapin
3394c22c03
Fix race and clang-tidy
2020-10-15 10:39:27 +03:00
alesapin
a535a089d1
Some style fixes
2020-10-14 19:09:18 +03:00
alesapin
0b14a31ba9
Get rid of background processing pool
2020-10-14 15:44:10 +03:00
Alexander Kuzmenkov
218d86de7e
Merge remote-tracking branch 'origin/master' into tmp
2020-09-28 16:29:51 +03:00
alesapin
97671a1771
Ugly fix for default database race
2020-09-25 14:27:00 +03:00
