594 Commits

Author	SHA1	Message	Date
feng lv	7e3524caa1	fix spelling errors	2020-11-28 08:17:20 +00:00
Nicolae Vartolomei	040aba9f85	Add uuid.txt to checksums for parts stored on disk ... We are breaking backwards compatibility anyway (but agted by a setting)	2020-11-20 13:49:17 +00:00
Anton Popov	4cecd89e84	fix dropping of empty parts	2020-11-12 20:37:54 +03:00
Anton Popov	0aa35d53c7	Merge remote-tracking branch 'upstream/master' into HEAD	2020-11-12 14:31:58 +03:00
Anton Popov	0a6d93d929	Update MergeTreeData.h	2020-11-11 21:17:41 +03:00
Anton Popov	2497598a49	Remove empty parts after they were pruned by TTL	2020-11-11 19:19:43 +03:00
Anton Popov	c01870076d	Update MergeTreeData.h	2020-11-11 19:09:01 +03:00
Anton Popov	6f0dc08ba7	avoid code duplication in alterPartition	2020-11-11 16:34:07 +03:00
alesapin	72046313d4	Merge branch 'master' into nvartolomei-drop-part	2020-11-09 10:02:02 +03:00
alexey-milovidov	ee3e289ec2	Merge pull request #15983 from ClickHouse/no_background_pool_no_more ... Replace BackgroundProcessingPool with SchedulePool task and ThreadPool.	2020-11-05 21:38:22 +03:00
alesapin	20043e77bb	Merge branch 'master' into nvartolomei-drop-part	2020-11-04 10:22:23 +03:00
alexey-milovidov	11fc6fd8c9	Merge pull request #16584 from ClickHouse/drop_table_task_better_scheduling ... Better scheduling of drop table task	2020-11-03 14:22:51 +03:00
Anton Ivashkin	1742fb3256	Merge master	2020-11-03 12:27:16 +03:00
alesapin	dac6705995	DROP PART and clear blocks in a single zookeeper op	2020-11-02 20:30:59 +03:00
Alexander Tokmakov	ac32809b6a	fix #16482	2020-11-02 19:40:39 +03:00
alesapin	101aa9e931	Merge branch 'master' into no_background_pool_no_more	2020-11-02 10:49:19 +03:00
alesapin	9ed4668dbb	Refactor common part of background list	2020-10-26 15:40:55 +03:00
alesapin	7edbe4d276	Add some comments	2020-10-16 13:12:31 +03:00
Anton Ivashkin	b877459cf7	Zero copy replication over S3: check s3 storage	2020-10-14 18:05:59 +03:00
alesapin	4014e0f08d	Something very similar to working code	2020-10-14 15:32:35 +03:00
alesapin	efd3126b5d	Moving pool	2020-10-14 10:22:48 +03:00
alesapin	fd35368c59	First simple implementation	2020-10-13 17:25:42 +03:00
alesapin	8ec58c17f3	More consistent metadata usage	2020-10-05 19:41:46 +03:00
alesapin	f5c38b34ae	Fix race condition during write ahead log cleanup and rename	2020-09-25 15:07:38 +03:00
alexey-milovidov	1fcebce926	Merge pull request #15000 from Jokser/disable-ttl-move-on-insert ... Option to disable TTL move on data part insert	2020-09-19 13:45:02 +03:00
Pavel Kovalenko	6b4b5898a7	Renaming.	2020-09-18 18:41:14 +03:00
Pavel Kovalenko	0da19ab46d	Add option to disable ttl move on data part insert	2020-09-18 18:30:00 +03:00
alesapin	dc677b93fb	Comments and fix test	2020-09-17 22:30:17 +03:00
alesapin	b07c00ef7c	Ugly, but probably working implementation	2020-09-17 18:33:50 +03:00
alesapin	40b2f203b6	Merge branch 'master' into manual-write-duplicate-parts-to-replicas	2020-09-17 13:21:00 +03:00
alesapin	f274ffc9d1	Add comments	2020-09-07 10:59:14 +03:00
alesapin	4079636f81	Merge	2020-09-04 13:52:51 +03:00
alesapin	82c56349a5	Some comments	2020-09-04 13:08:09 +03:00
alesapin	128cb7ce22	Don't select already selected parts	2020-09-02 15:16:12 +03:00
alesapin	46f833b7df	Some changes	2020-08-31 22:50:42 +03:00
alesapin	2fc80189af	Add default compression codec to merge tree data part	2020-08-26 18:29:46 +03:00
Alexey Milovidov	5059d1f441	Merge branch 'master' into manual-write-duplicate-parts-to-replicas	2020-08-16 15:58:57 +03:00
Alexey Milovidov	edd89a8610	Fix half of typos	2020-08-08 03:47:03 +03:00
alesapin	c75830e878	Alter table freeze with verbose output	2020-07-28 18:10:36 +03:00
alesapin	014bb070ec	Fix tests	2020-07-14 11:19:39 +03:00
alesapin	1f576ee039	Some intermediate solution	2020-07-13 20:27:52 +03:00
alesapin	4a53264a86	Remove redundant and duplicated code	2020-07-13 19:19:08 +03:00
alexey-milovidov	ae7eff98ed	Merge pull request #12433 from amosbird/np ... Allow nullable key in MergeTree	2020-07-13 04:36:00 +03:00
Amos Bird	cac5a89169	Allow nullable key in MergeTree	2020-07-12 22:21:51 +08:00
Alexey Milovidov	4b86f36d37	Check arguments of bloom filter index	2020-07-10 11:13:21 +03:00
alesapin	84f8bf1e14	Merge pull request #10697 from CurtizJ/polymorphic-parts ... Polymorphic parts (in-memory format)	2020-07-08 13:25:45 +03:00
Anton Popov	416d9648c2	remove questionable functionality	2020-07-07 12:58:14 +03:00
Nikita Mikhaylov	d31ed58f01	done	2020-07-06 17:33:31 +03:00
Anton Popov	4422df2e37	Merge remote-tracking branch 'upstream/master' into HEAD	2020-07-02 20:18:21 +03:00
Anton Popov	d45697a1b5	in-memory-parts: lazy creation of WAL	2020-06-30 21:47:12 +03:00
Vladimir Chebotarev	bb8da71eff	Moves task shall be started if new storage policy needs them.	2020-06-30 15:36:44 +03:00
Alexey Milovidov	cc597bb30b	Implement for ReplicatedMergeTree	2020-06-28 22:39:31 +03:00
Alexey Milovidov	1462a66d1e	Fix typos	2020-06-27 22:05:00 +03:00
alesapin	6f1824f0ea	Correct merge with master	2020-06-26 14:30:23 +03:00
alesapin	e9c47dc89c	Merge branch 'master' into CurtizJ-polymorphic-parts	2020-06-26 14:27:19 +03:00
alesapin	292016e045	Add missed lock	2020-06-23 11:04:43 +03:00
Alexey Milovidov	0e6fb617aa	Merge branch 'master' into manual-write-duplicate-parts-to-replicas	2020-06-22 01:54:03 +03:00
alesapin	a2e7e9f232	Remove unused constructor and rename method	2020-06-19 18:21:48 +03:00
alesapin	3c47faa9da	Move partition key initialization into registerMergeTree	2020-06-19 18:14:08 +03:00
alesapin	e888dafdc2	Remove unused method	2020-06-18 20:03:42 +03:00
alesapin	d79982f497	Better locks in Storages	2020-06-18 19:10:47 +03:00
alesapin	ed8f3b2fc4	TTL in storage in memory metadata	2020-06-17 16:39:26 +03:00
alesapin	1afdebeebd	Primary key in storage metadata	2020-06-17 15:39:20 +03:00
alesapin	ab61abccc1	Partition key in StorageInMemoryMetadata	2020-06-17 13:34:23 +03:00
alesapin	62f2c17a66	Secondary indices in StorageInMemoryMetadata	2020-06-17 12:38:47 +03:00
alesapin	eae901f58d	Merge branch 'master' into atomic_metadata5	2020-06-16 14:44:45 +03:00
alesapin	605c904fc6	Add method for compatibility	2020-06-16 11:39:12 +03:00
Anton Popov	b19d48a11c	Merge remote-tracking branch 'upstream/master' into HEAD	2020-06-16 06:37:55 +03:00
Anton Popov	a3ac224ae4	in-memory parts: sync insert to replicated	2020-06-15 22:57:12 +03:00
Alexey Milovidov	e44e1ad0d4	Don't ignore duplicate parts written to replicas	2020-06-15 21:57:38 +03:00
alesapin	e667eb57b2	Working set*Keys methods	2020-06-15 20:24:49 +03:00
alesapin	18b58e8483	Revert too strict lock	2020-06-13 12:12:45 +03:00
alesapin	465c4b65b7	Slightly better interfaces and comments	2020-06-12 12:37:52 +03:00
alesapin	a39d010f94	Merge branch 'master' into consistent_metadata4	2020-06-11 18:47:41 +03:00
Alexey Milovidov	b72a095e99	Fix race conditions in CREATE/DROP of different replicas of ReplicatedMergeTree	2020-06-11 06:24:52 +03:00
alesapin	8be957ecb5	Better checks around metadata	2020-06-10 14:16:31 +03:00
alesapin	ec933d9d03	Better naming	2020-06-10 12:09:51 +03:00
alesapin	d2fcf5aea5	Fixes for gcc	2020-06-09 20:28:29 +03:00
alesapin	4c2e0561f5	Fix primary key update	2020-06-09 20:21:38 +03:00
alesapin	abaf47f0cd	Make metadata single structure	2020-06-05 20:29:40 +03:00
alesapin	5bc7f67e61	Better metadata for select query and renames	2020-06-05 14:54:54 +03:00
Anton Popov	1ce09e1faa	Merge remote-tracking branch 'upstream/master' into polymorphic-parts	2020-06-03 16:27:54 +03:00
Anton Popov	caf1e4e8cc	in-memory-parts: fixes	2020-06-03 12:51:23 +03:00
alesapin	e0e77194f4	Remove redundant parts from MergeTree	2020-06-01 15:39:20 +03:00
alesapin	d9a817f578	Less virtual methods in IStorage	2020-06-01 14:17:18 +03:00
alesapin	3847ea892d	Merge branch 'master' into consistent_metadata3	2020-06-01 13:17:59 +03:00
alexey-milovidov	9984e989c1	Merge pull request #11317 from ClickHouse/logger-fmt-2 ... Preparation for structured logging	2020-06-01 00:11:29 +03:00
alexey-milovidov	8accde79b5	Merge pull request #11162 from azat/data-skip-index-merging-params-fix ... [RFC] Fix data skipping indexes for columns with additional actions during merge	2020-05-31 19:10:53 +03:00
Alexey Milovidov	25f941020b	Remove namespace pollution	2020-05-31 00:57:37 +03:00
alesapin	860dc2c814	Merge with consistent_metadata2	2020-05-28 19:45:51 +03:00
alesapin	61aff798d3	Compileable code	2020-05-28 18:33:44 +03:00
Anton Popov	d8342e5b12	in-memory parts: better restore and clear stale wal files	2020-05-27 23:05:55 +03:00
alesapin	380c60a33f	Intermediate stage (doesn't compile)	2020-05-27 21:38:34 +03:00
Nikolai Sorokin	eeaf608aa9	Refactor code; support prefix of PK as GROUP BY key	2020-05-27 12:53:15 +03:00
Nikolai Sorokin	61974e0047	TTL Expressions WHERE and GROUP BY draft	2020-05-27 12:53:15 +03:00
alesapin	7bbb064b34	Fix metadata update	2020-05-26 11:58:32 +03:00
alesapin	c3a6571036	Compilable code	2020-05-25 20:22:20 +03:00
alesapin	9b3cc9e525	Almost working ttl in IStorage	2020-05-25 20:07:14 +03:00
alesapin	6281dd6893	Merge pull request #11115 from ClickHouse/consistent_metadata ... Refactoring in storage metadata (more consistent keys)	2020-05-25 13:09:56 +03:00
Azat Khuzhin	c36708caf9	Split data skipping indexes from the order by to evaluate order by before merge	2020-05-24 16:12:08 +03:00
alesapin	f026fa7de1	Rename PartDestinationType to DataDestionationType, because there is no part-specific information	2020-05-22 16:29:33 +03:00
alesapin	09034157cd	Remove comments	2020-05-21 22:53:46 +03:00
Alexander Kuzmenkov	f98ffdbc4c	Merge pull request #11087 from azat/context-fwd-decl ... [RFC] Forward declaration for Context as much as possible.	2020-05-21 19:43:29 +03:00
alesapin	87eab514fb	Merge branch 'master' into consistent_metadata	2020-05-21 18:54:52 +03:00
BohuTANG	c9d315654c	Fix Storages/MergeTree typo	2020-05-21 17:00:44 +08:00
Azat Khuzhin	d93b9a57f6	Forward declaration for Context as much as possible. ... Now after changing Context.h 488 modules will be recompiled instead of 582.	2020-05-21 01:53:18 +03:00
alesapin	616902a995	Sorting and primary key (broken)	2020-05-20 21:11:38 +03:00
alesapin	9fb28f5ac0	Add sampling key	2020-05-20 18:16:39 +03:00
alesapin	8bc527eecd	Compile partition key	2020-05-20 15:16:55 +03:00
Anton Popov	4fb6492b08	in-memory parts: delay merges	2020-05-20 15:02:02 +03:00
Gleb Novikov	1a25ac6e1f	Merge branch 'master' into refactor-reservations	2020-05-16 23:34:45 +03:00
Anton Popov	14e1a46a8c	Merge remote-tracking branch 'upstream/master' into polymorphic-parts	2020-05-15 03:48:27 +03:00
alesapin	f209052519	Better comments	2020-05-13 14:04:27 +03:00
Gleb Novikov	390b39b272	VolumePtr instead of DiskPtr in MergeTreeData*	2020-05-10 00:24:15 +03:00
Anton Popov	387041a97e	Merge remote-tracking branch 'upstream/master' into polymorphic-parts	2020-05-06 19:22:07 +03:00
Anton Popov	4878c91d07	in-memory parts: better restore from wal	2020-05-06 14:57:38 +03:00
Gleb Novikov	c637d99e07	Volumes and storages refactoring: ... 1. Moved Volume to separate file 2. Created IVolume interface and implemented current behaviour in implementation of new interface — VolumeJBOD 3. Replaced all old volume usages with new VolumeJBOD. Where it is unnecessary to have JBOD — left just IVolume. 4. Removed old Volume completely 5. Moved StoragePolicy to separated files 6. Moved DiskSelector to separated files 7. Removed DiskSpaceMonitor file	2020-05-04 23:15:38 +03:00
alexey-milovidov	db4c2352e1	Merge pull request #10569 from zhang2014/fix/ISSUES-10551 ... ISSUES-10551 add backward compatibility for create bloom filter index	2020-05-02 22:25:29 +03:00
Anton Popov	aa723d245f	Merge remote-tracking branch 'upstream/master' into polymorphic-parts	2020-04-30 18:27:39 +03:00
zhang2014	8ac709b5d3	ISSUES-10551 add backward compatibility for create bloom filter index	2020-04-29 11:57:28 +08:00
alesapin	f981649213	Fix pushing to views stream and refactor virtuals	2020-04-28 13:38:57 +03:00
alesapin	18c550df15	Better virtuals logic	2020-04-27 16:55:30 +03:00
alesapin	2829774105	Merge branch 'master' into refactor_istorage	2020-04-27 15:34:21 +03:00
alesapin	dc2dd77d2e	Remove redundant overrides from IStorage	2020-04-24 12:20:09 +03:00
Alexander Tokmakov	04d6b59ac0	Merge branch 'master' into database_atomic	2020-04-23 17:31:37 +03:00
Alexey Milovidov	1e325a9fd9	Checkpoint	2020-04-22 09:22:14 +03:00
Alexander Tokmakov	b29bddac12	Merge branch 'master' into database_atomic	2020-04-20 14:09:09 +03:00
Alexey Milovidov	d7264b292d	Merge branch 'master' into sorting-processors	2020-04-20 09:29:41 +03:00
Anton Popov	4069dbcc58	in-memory parts: add waiting for insert	2020-04-20 04:38:38 +03:00
alexey-milovidov	aac7cc7330	Merge pull request #10126 from Jokser/replicated-merge-tree-s3 ... Support ReplicatedMergeTree over S3	2020-04-18 16:13:04 +03:00
alexey-milovidov	46a5c75beb	Update MergeTreeData.h	2020-04-18 16:11:57 +03:00
Anton Popov	391f7c34be	in memory parts: basic read/write	2020-04-17 20:30:46 +03:00
Nikolai Kochetov	153f795ebe	Merge branch 'master' into sorting-processors	2020-04-15 12:07:05 +03:00
Nikolai Kochetov	434a13a8bd	Move algorithm to separate files.	2020-04-14 12:21:24 +03:00
Alexander Tokmakov	5e6d4b9449	Merge branch 'master' into database_atomic	2020-04-12 16:35:44 +03:00
Anton Popov	d018977f4b	fix 'ALTER CLEAR INDEX/COLUMN' queries with compact parts	2020-04-10 16:36:51 +03:00
Nikolai Kochetov	868f7e9aea	Move Graphite params to separate file.	2020-04-10 12:16:23 +03:00
Nikolai Kochetov	1b6d80bfae	Merge branch 'master' into sorting-processors	2020-04-10 12:07:21 +03:00
Alexander Tokmakov	dd1590830b	Merge branch 'master' into database_atomic	2020-04-08 22:00:46 +03:00
Pavel Kovalenko	5b2b8d38fa	Download part trough disk interface.	2020-04-08 11:41:13 +03:00
Alexander Tokmakov	4c48b7dd80	better rename	2020-04-07 18:31:33 +03:00
alesapin	1cb072d58a	Merge branch 'master' into alter_rename_column	2020-04-06 11:40:27 +03:00
Nikolai Kochetov	e23fda80aa	Merge with master	2020-04-04 19:02:17 +03:00
Ivan Lezhankin	06446b4f08	dbms/ → src/	2020-04-03 18:14:31 +03:00