1410 Commits

Author	SHA1	Message	Date
Mike Kot	cd32803709	Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local	2021-02-15 15:42:17 +03:00
Mike Kot	feff4c6a22	Started adding the new "ATTACH_PART" command into the replicated log ... The original ticket idea was to search for the possibly available data into the /detached folders for the GET_PART command, but @tavplubix pointed out this would be quite expensive for an every fetch. So a new command is going to be introduced, ATTACH_PART, which will cover ALTER TABLE ATTACH PART and only for which the search will start.	2021-02-15 01:59:13 +03:00
Azat Khuzhin	68f23b7087	Improve logging during MergeTree reading ... - Remove "Not using primary index on part {}" message (too noisy) - Add number of total marks before filtering by primary key into the common message - Make "Index {} has dropped {} / {} granules." not per-part, but per-query	2021-02-13 18:08:55 +03:00
alesapin	a2bb586170	Merge pull request #20335 from ClickHouse/fix_scheduling_of_non_successful_background_tasks ... Fix backoff for failed background tasks in replicated merge tree	2021-02-12 10:06:04 +03:00
alexey-milovidov	7b55eb8c58	Merge pull request #20178 from amosbird/delayinactive ... Delay or throw insertion when too many inactive parts	2021-02-11 20:52:04 +03:00
alesapin	3253638969	Fix backoff for failed background tasks in replicated merge tree	2021-02-11 14:46:18 +03:00
alesapin	56453256b7	Merge pull request #20300 from ClickHouse/restrict_to_drop_version_column ... Don't allow to drop or rename version column	2021-02-11 11:04:00 +03:00
alesapin	121c5c9605	Merge pull request #20279 from ClickHouse/relax_check_in_data_writer ... Relax check in data writer for non adaptive tables	2021-02-11 10:57:07 +03:00
alesapin	c2bb2c2902	Merge pull request #20097 from ClickHouse/remove-adding-missed-step ... Build actions dag to evaluate missing defaults.	2021-02-11 10:51:21 +03:00
alexey-milovidov	e33477a16e	Merge pull request #20282 from ClickHouse/dont_allow_ttl_for_old_syntax ... Don't allow TTL in old syntax	2021-02-11 00:46:30 +03:00
Anton Popov	365e2fb746	Merge pull request #20231 from fuwhu/refine-loadDataParts-code ... refine code in MergeTreeData::loadDataParts to avoid parsing WAL file as data part	2021-02-10 22:42:31 +03:00
alesapin	891fce3275	Don't allow to drop or rename version column	2021-02-10 22:23:48 +03:00
alesapin	a63d73db58	Don't allow TTL in old syntax	2021-02-10 15:09:12 +03:00
alesapin	420f2958e2	Merge pull request #19991 from ClickHouse/constant-propagation-fix ... Do not use inputs which values are known constants in ActionsDAG.	2021-02-10 14:13:52 +03:00
alesapin	21faea1f68	Relax check in data writer for non adaptive tables	2021-02-10 13:43:31 +03:00
Amos Bird	afb5846a24	refactor	2021-02-10 11:22:24 +08:00
HuFuwang	4ac8860cea	refine code in MergeTreeData::loadDataParts to avoid parsing WAL file as data part.	2021-02-10 10:13:43 +08:00
tavplubix	86530e603c	Merge pull request #20027 from bharatnc/ncb/event_time_micro_part_log ... add event_time_microseconds field to system.part_log table	2021-02-09 14:46:40 +03:00
Nikolai Kochetov	229acbad5d	Merge pull request #20077 from ClickHouse/remove-adding-const-column-transform ... Remove AddingConstColumn step and transform.	2021-02-09 11:28:44 +03:00
Nicolae Vartolomei	c336cac306	Remove dead code	2021-02-08 17:36:58 +00:00
Nicolae Vartolomei	a8f37e7704	Remove dead code	2021-02-08 17:19:35 +00:00
bharatnc	60c8dfa22c	PartLog - populate event_time_microseconds for MergeParts	2021-02-08 07:25:44 -08:00
Nikolai Kochetov	d7fa440356	Merge branch 'master' into remove-adding-const-column-transform	2021-02-08 15:49:23 +03:00
Amos Bird	109a392e0c	Fix ubsan	2021-02-08 19:41:16 +08:00
Amos Bird	ab5c7b75a4	Delay or throw insertion when too many inactive parts	2021-02-07 19:03:55 +08:00
Maxim Akhmedov	0cd3601928	Allow using MergeTreeWhereOptimizer not only with MergeTree-based storages	2021-02-06 18:08:42 +03:00
alesapin	011109c82a	Merge pull request #17348 from xjewer/alex/CLICKHOUSE-606_deduplication_UUID ... CLICKHOUSE-606: query deduplication based on parts' UUID	2021-02-05 22:47:34 +03:00
Nikolai Kochetov	85c175883e	Rename functions.	2021-02-05 18:11:26 +03:00
alesapin	7cbc135e72	More isolated code	2021-02-05 12:54:34 +03:00
Nikolai Kochetov	d9aa1096cf	Build actions dag to evaluate missing defaults.	2021-02-04 23:36:50 +03:00
vdimir	30f98795bc	Merge remote-tracking branch 'upstream/master' into disk-s3-backup-restore-metadata	2021-02-04 18:38:28 +03:00
Nikolai Kochetov	e3d6ffd9dc	Remove AddingConstColumn step and transform.	2021-02-04 17:25:11 +03:00
Alexey Milovidov	474f151707	More docs for MergeTreeSettings	2021-02-04 08:26:22 +03:00
Alexey Milovidov	dc2afc4795	Fix double whitespace #18383	2021-02-03 21:12:14 +03:00
Pavel Kovalenko	b7151aa754	Merge remote-tracking branch 'origin/master' into disk-s3-backup-restore-metadata ... # Conflicts: # src/Disks/DiskDecorator.h # src/Disks/IDisk.h # src/Disks/S3/DiskS3.cpp	2021-02-03 14:22:18 +03:00
Alexey Milovidov	12485eee6b	Fix some of the issues found by Coverity	2021-02-02 22:07:23 +03:00
Aleksei Semiglazov	921518db0a	CLICKHOUSE-606: query deduplication based on parts' UUID ... * add the query data deduplication excluding duplicated parts in MergeTree family engines. query deduplication is based on parts' UUID which should be enabled first with merge_tree setting assign_part_uuids=1 allow_experimental_query_deduplication setting is to enable part deduplication, default ot false. data part UUID is a mechanism of giving a data part a unique identifier. Having UUID and deduplication mechanism provides a potential of moving parts between shards preserving data consistency on a read path: duplicated UUIDs will cause root executor to retry query against on of the replica explicitly asking to exclude encountered duplicated fingerprints during a distributed query execution. NOTE: this implementation don't provide any knobs to lock part and hence its UUID. Any mutations/merge will update part's UUID. * add _part_uuid virtual column, allowing to use UUIDs in predicates. Signed-off-by: Aleksei Semiglazov <asemiglazov@cloudflare.com> address comments	2021-02-02 16:53:39 +00:00
Nikolai Kochetov	b2d7790794	Fix test.	2021-02-02 17:30:54 +03:00
Maksim Kita	d0151de4bb	Merge pull request #19608 from kreuzerkrieg/Add_IStoragePolicy_interface ... Add IStoragePolicy interface	2021-02-02 11:03:20 +03:00
Pavel Kruglov	a3f1b825cc	Fix build	2021-02-01 21:17:12 +03:00
alexey-milovidov	6b2f0435c8	Merge pull request #19375 from Avogar/select-final ... Improve do_not_merge_across_partitions_select_final optimization.	2021-02-01 20:31:08 +03:00
alesapin	2aa8a6304b	Merge pull request #15450 from CurtizJ/fix-ttl-group-by ... Fix some cases of TTL expressions	2021-02-01 16:48:07 +03:00
Nikolai Kochetov	19e4a33f9d	Merge pull request #19544 from amosbird/limitconcurrency ... Per MergeTree table query limit	2021-02-01 16:09:12 +03:00
alesapin	d9598c47b4	Merge pull request #19702 from ClickHouse/fix_rare_bug_after_part_corruption ... Fix incorrect virtual_parts after part corruption	2021-02-01 10:09:48 +03:00
alexey-milovidov	d19feb724b	Merge pull request #19799 from CurtizJ/fix-uint8-filtering ... Fix filtering by Uint8 greater than 127	2021-01-29 21:34:42 +03:00
Pavel Kruglov	78371e15dc	Update test, reduce num_threads_for_lonely_parts if data is small	2021-01-29 21:00:08 +03:00
alesapin	f4236fd765	Fix style	2021-01-29 20:12:53 +03:00
alesapin	c373d92a80	Less strict check	2021-01-29 18:50:08 +03:00
Pavel Kruglov	71f4acd48b	Use one pool for lonely parts, update tests	2021-01-29 17:30:14 +03:00
Pavel Kruglov	a437ee4e31	Merge branch 'master' of github.com:ClickHouse/ClickHouse into select-final	2021-01-29 14:25:47 +03:00