200 Commits

Author	SHA1	Message	Date
Anton Popov	1be39fddac	fix subcolumns with some storages	2020-12-22 19:42:37 +03:00
flynn	4e580f7b7c	Add asynchronous metrics on MergeTree tables data volume (#17639) ... Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>	2020-12-22 13:34:35 +03:00
Alexey Milovidov	9a017b77df	Merge branch 'master' into relax-too-many-parts-1	2020-12-17 04:40:39 +03:00
Anton Ivashkin	0f0500ca0c	Merge master	2020-12-16 18:31:13 +03:00
Alexander Kuzmenkov	d757f32300	Remove some redundant includes to speed up build	2020-12-11 02:58:11 +03:00
Alexey Milovidov	2e6bedce91	Relax "Too many parts" threshold, part 1	2020-11-29 18:08:02 +03:00
feng lv	7e3524caa1	fix spelling errors	2020-11-28 08:17:20 +00:00
Nicolae Vartolomei	040aba9f85	Add uuid.txt to checksums for parts stored on disk ... We are breaking backwards compatibility anyway (but agted by a setting)	2020-11-20 13:49:17 +00:00
Anton Popov	4cecd89e84	fix dropping of empty parts	2020-11-12 20:37:54 +03:00
Anton Popov	0aa35d53c7	Merge remote-tracking branch 'upstream/master' into HEAD	2020-11-12 14:31:58 +03:00
Anton Popov	0a6d93d929	Update MergeTreeData.h	2020-11-11 21:17:41 +03:00
Anton Popov	2497598a49	Remove empty parts after they were pruned by TTL	2020-11-11 19:19:43 +03:00
Anton Popov	c01870076d	Update MergeTreeData.h	2020-11-11 19:09:01 +03:00
Anton Popov	6f0dc08ba7	avoid code duplication in alterPartition	2020-11-11 16:34:07 +03:00
alesapin	72046313d4	Merge branch 'master' into nvartolomei-drop-part	2020-11-09 10:02:02 +03:00
alexey-milovidov	ee3e289ec2	Merge pull request #15983 from ClickHouse/no_background_pool_no_more ... Replace BackgroundProcessingPool with SchedulePool task and ThreadPool.	2020-11-05 21:38:22 +03:00
alesapin	20043e77bb	Merge branch 'master' into nvartolomei-drop-part	2020-11-04 10:22:23 +03:00
alexey-milovidov	11fc6fd8c9	Merge pull request #16584 from ClickHouse/drop_table_task_better_scheduling ... Better scheduling of drop table task	2020-11-03 14:22:51 +03:00
Anton Ivashkin	1742fb3256	Merge master	2020-11-03 12:27:16 +03:00
alesapin	dac6705995	DROP PART and clear blocks in a single zookeeper op	2020-11-02 20:30:59 +03:00
Alexander Tokmakov	ac32809b6a	fix #16482	2020-11-02 19:40:39 +03:00
alesapin	101aa9e931	Merge branch 'master' into no_background_pool_no_more	2020-11-02 10:49:19 +03:00
alesapin	9ed4668dbb	Refactor common part of background list	2020-10-26 15:40:55 +03:00
alesapin	7edbe4d276	Add some comments	2020-10-16 13:12:31 +03:00
Anton Ivashkin	b877459cf7	Zero copy replication over S3: check s3 storage	2020-10-14 18:05:59 +03:00
alesapin	4014e0f08d	Something very similar to working code	2020-10-14 15:32:35 +03:00
alesapin	efd3126b5d	Moving pool	2020-10-14 10:22:48 +03:00
alesapin	fd35368c59	First simple implementation	2020-10-13 17:25:42 +03:00
alesapin	8ec58c17f3	More consistent metadata usage	2020-10-05 19:41:46 +03:00
alesapin	f5c38b34ae	Fix race condition during write ahead log cleanup and rename	2020-09-25 15:07:38 +03:00
alexey-milovidov	1fcebce926	Merge pull request #15000 from Jokser/disable-ttl-move-on-insert ... Option to disable TTL move on data part insert	2020-09-19 13:45:02 +03:00
Pavel Kovalenko	6b4b5898a7	Renaming.	2020-09-18 18:41:14 +03:00
Pavel Kovalenko	0da19ab46d	Add option to disable ttl move on data part insert	2020-09-18 18:30:00 +03:00
alesapin	dc677b93fb	Comments and fix test	2020-09-17 22:30:17 +03:00
alesapin	b07c00ef7c	Ugly, but probably working implementation	2020-09-17 18:33:50 +03:00
alesapin	40b2f203b6	Merge branch 'master' into manual-write-duplicate-parts-to-replicas	2020-09-17 13:21:00 +03:00
alesapin	f274ffc9d1	Add comments	2020-09-07 10:59:14 +03:00
alesapin	4079636f81	Merge	2020-09-04 13:52:51 +03:00
alesapin	82c56349a5	Some comments	2020-09-04 13:08:09 +03:00
alesapin	128cb7ce22	Don't select already selected parts	2020-09-02 15:16:12 +03:00
alesapin	46f833b7df	Some changes	2020-08-31 22:50:42 +03:00
alesapin	2fc80189af	Add default compression codec to merge tree data part	2020-08-26 18:29:46 +03:00
Alexey Milovidov	5059d1f441	Merge branch 'master' into manual-write-duplicate-parts-to-replicas	2020-08-16 15:58:57 +03:00
Alexey Milovidov	edd89a8610	Fix half of typos	2020-08-08 03:47:03 +03:00
alesapin	c75830e878	Alter table freeze with verbose output	2020-07-28 18:10:36 +03:00
alesapin	014bb070ec	Fix tests	2020-07-14 11:19:39 +03:00
alesapin	1f576ee039	Some intermediate solution	2020-07-13 20:27:52 +03:00
alesapin	4a53264a86	Remove redundant and duplicated code	2020-07-13 19:19:08 +03:00
alexey-milovidov	ae7eff98ed	Merge pull request #12433 from amosbird/np ... Allow nullable key in MergeTree	2020-07-13 04:36:00 +03:00
Amos Bird	cac5a89169	Allow nullable key in MergeTree	2020-07-12 22:21:51 +08:00
Alexey Milovidov	4b86f36d37	Check arguments of bloom filter index	2020-07-10 11:13:21 +03:00
alesapin	84f8bf1e14	Merge pull request #10697 from CurtizJ/polymorphic-parts ... Polymorphic parts (in-memory format)	2020-07-08 13:25:45 +03:00
Anton Popov	416d9648c2	remove questionable functionality	2020-07-07 12:58:14 +03:00
Nikita Mikhaylov	d31ed58f01	done	2020-07-06 17:33:31 +03:00
Anton Popov	4422df2e37	Merge remote-tracking branch 'upstream/master' into HEAD	2020-07-02 20:18:21 +03:00
Anton Popov	d45697a1b5	in-memory-parts: lazy creation of WAL	2020-06-30 21:47:12 +03:00
Vladimir Chebotarev	bb8da71eff	Moves task shall be started if new storage policy needs them.	2020-06-30 15:36:44 +03:00
Alexey Milovidov	cc597bb30b	Implement for ReplicatedMergeTree	2020-06-28 22:39:31 +03:00
Alexey Milovidov	1462a66d1e	Fix typos	2020-06-27 22:05:00 +03:00
alesapin	6f1824f0ea	Correct merge with master	2020-06-26 14:30:23 +03:00
alesapin	e9c47dc89c	Merge branch 'master' into CurtizJ-polymorphic-parts	2020-06-26 14:27:19 +03:00
alesapin	292016e045	Add missed lock	2020-06-23 11:04:43 +03:00
Alexey Milovidov	0e6fb617aa	Merge branch 'master' into manual-write-duplicate-parts-to-replicas	2020-06-22 01:54:03 +03:00
alesapin	a2e7e9f232	Remove unused constructor and rename method	2020-06-19 18:21:48 +03:00
alesapin	3c47faa9da	Move partition key initialization into registerMergeTree	2020-06-19 18:14:08 +03:00
alesapin	e888dafdc2	Remove unused method	2020-06-18 20:03:42 +03:00
alesapin	d79982f497	Better locks in Storages	2020-06-18 19:10:47 +03:00
alesapin	ed8f3b2fc4	TTL in storage in memory metadata	2020-06-17 16:39:26 +03:00
alesapin	1afdebeebd	Primary key in storage metadata	2020-06-17 15:39:20 +03:00
alesapin	ab61abccc1	Partition key in StorageInMemoryMetadata	2020-06-17 13:34:23 +03:00
alesapin	62f2c17a66	Secondary indices in StorageInMemoryMetadata	2020-06-17 12:38:47 +03:00
alesapin	eae901f58d	Merge branch 'master' into atomic_metadata5	2020-06-16 14:44:45 +03:00
alesapin	605c904fc6	Add method for compatibility	2020-06-16 11:39:12 +03:00
Anton Popov	b19d48a11c	Merge remote-tracking branch 'upstream/master' into HEAD	2020-06-16 06:37:55 +03:00
Anton Popov	a3ac224ae4	in-memory parts: sync insert to replicated	2020-06-15 22:57:12 +03:00
Alexey Milovidov	e44e1ad0d4	Don't ignore duplicate parts written to replicas	2020-06-15 21:57:38 +03:00
alesapin	e667eb57b2	Working set*Keys methods	2020-06-15 20:24:49 +03:00
alesapin	18b58e8483	Revert too strict lock	2020-06-13 12:12:45 +03:00
alesapin	465c4b65b7	Slightly better interfaces and comments	2020-06-12 12:37:52 +03:00
alesapin	a39d010f94	Merge branch 'master' into consistent_metadata4	2020-06-11 18:47:41 +03:00
Alexey Milovidov	b72a095e99	Fix race conditions in CREATE/DROP of different replicas of ReplicatedMergeTree	2020-06-11 06:24:52 +03:00
alesapin	8be957ecb5	Better checks around metadata	2020-06-10 14:16:31 +03:00
alesapin	ec933d9d03	Better naming	2020-06-10 12:09:51 +03:00
alesapin	d2fcf5aea5	Fixes for gcc	2020-06-09 20:28:29 +03:00
alesapin	4c2e0561f5	Fix primary key update	2020-06-09 20:21:38 +03:00
alesapin	abaf47f0cd	Make metadata single structure	2020-06-05 20:29:40 +03:00
alesapin	5bc7f67e61	Better metadata for select query and renames	2020-06-05 14:54:54 +03:00
Anton Popov	1ce09e1faa	Merge remote-tracking branch 'upstream/master' into polymorphic-parts	2020-06-03 16:27:54 +03:00
Anton Popov	caf1e4e8cc	in-memory-parts: fixes	2020-06-03 12:51:23 +03:00
alesapin	e0e77194f4	Remove redundant parts from MergeTree	2020-06-01 15:39:20 +03:00
alesapin	d9a817f578	Less virtual methods in IStorage	2020-06-01 14:17:18 +03:00
alesapin	3847ea892d	Merge branch 'master' into consistent_metadata3	2020-06-01 13:17:59 +03:00
alexey-milovidov	9984e989c1	Merge pull request #11317 from ClickHouse/logger-fmt-2 ... Preparation for structured logging	2020-06-01 00:11:29 +03:00
alexey-milovidov	8accde79b5	Merge pull request #11162 from azat/data-skip-index-merging-params-fix ... [RFC] Fix data skipping indexes for columns with additional actions during merge	2020-05-31 19:10:53 +03:00
Alexey Milovidov	25f941020b	Remove namespace pollution	2020-05-31 00:57:37 +03:00
alesapin	860dc2c814	Merge with consistent_metadata2	2020-05-28 19:45:51 +03:00
alesapin	61aff798d3	Compileable code	2020-05-28 18:33:44 +03:00
Anton Popov	d8342e5b12	in-memory parts: better restore and clear stale wal files	2020-05-27 23:05:55 +03:00
alesapin	380c60a33f	Intermediate stage (doesn't compile)	2020-05-27 21:38:34 +03:00
Nikolai Sorokin	eeaf608aa9	Refactor code; support prefix of PK as GROUP BY key	2020-05-27 12:53:15 +03:00