921 Commits

Author	SHA1	Message	Date
alesapin	d341b648d2	Better alter	2019-12-26 21:17:05 +03:00
Alexander Tokmakov	2e5d61cd81	better constructors of storages	2019-12-26 20:04:08 +03:00
Alexander Tokmakov	cf5c998b30	refactor storage name	2019-12-26 19:23:38 +03:00
Vladimir Chebotarev	64b2b18d5b	Added a check for bad disk/volume as a destination of move TTL expression.	2019-12-26 18:04:55 +03:00
alesapin	093d56f474	Merge pull request #8382 from ClickHouse/relative_paths_in_storages ... Use relative paths in Storages	2019-12-26 13:05:37 +03:00
Vladimir Chebotarev	c4e9784464	Fixed skipping parts algorithm while checking parts on other disks.	2019-12-26 01:12:17 +03:00
Vladimir Chebotarev	ab5171f403	Fixed tests.	2019-12-25 23:32:15 +03:00
Vladimir Chebotarev	29068663ea	Fixed build.	2019-12-25 23:32:15 +03:00
Vladimir Chebotarev	80056551ce	Check extra parts of MergeTree at different disks, in order to not allow to miss data parts at undefined disks.	2019-12-25 23:32:15 +03:00
CurtizJ	c8393f2c8b	fix mutations with mixed-granularity parts	2019-12-25 16:05:46 +03:00
CurtizJ	206cb1afa9	fix broken by refactoring functionality with wide parts	2019-12-25 01:49:39 +03:00
alesapin	05b933b1d3	Better	2019-12-24 21:07:51 +03:00
Alexander Tokmakov	514868cebc	use relative paths in IStorage::rename(...)	2019-12-24 16:35:50 +03:00
alesapin	25ecc38615	More correct separation between metadata and data alters for non replicated MergeTree.	2019-12-23 19:44:50 +03:00
Alexander Tokmakov	5fab732408	use arbitrary relative path in *MergeTree	2019-12-23 18:37:55 +03:00
CurtizJ	ba2a630a13	merging with master	2019-12-19 16:10:57 +03:00
CurtizJ	9db2f2ccbc	Merge remote-tracking branch 'upstream/master' into polymorphic-parts	2019-12-19 14:46:43 +03:00
CurtizJ	258e8d61fb	polymorphic parts (development) cleanup	2019-12-18 19:41:11 +03:00
CurtizJ	59faa4927b	polymorphic parts (development) alter update	2019-12-18 16:09:58 +03:00
alesapin	b2979546c3	Fix mutation number by default	2019-12-17 15:23:17 +03:00
Guillaume Tassery	dca0c83809	Merge branch 'master' into move_partition	2019-12-17 13:49:18 +07:00
CurtizJ	831f39a3df	polymorphic parts (development) alter	2019-12-16 17:51:19 +03:00
alexey-milovidov	399995d60b	Merge pull request #7812 from infinivision/fix_part_mutation ... fix part mutation	2019-12-13 03:45:59 +03:00
CurtizJ	26d159e889	polymorphic parts (development) alter	2019-12-12 21:55:19 +03:00
Alexander Burmak	1f69a7a015	Fixed merge issues	2019-12-12 14:10:18 +03:00
Alexander Burmak	2ce6136de5	Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs	2019-12-12 12:10:50 +03:00
Vladimir Chebotarev	0ff0a52249	Missed review fixes.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	7fd1668fde	Review fixes.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	e3ed311273	Fixed Clang build.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	67aa268bbb	Finally fixed tests and logic for extended TTL syntax.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	f83b28a1c1	Fixed a typo in MergeTreeData::selectMoveDestination().	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	618a39cc8c	Don't move anything if part already belongs their destination.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	8ed37801ca	Finally fixed selection of destination of move TTL.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	15fb64f54b	Fixed move TTL expiration logic.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	df002f20b1	Fixed move TTL metadata.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	14cf530542	Added move TTL rules to metadata of ReplicatedMergeTree.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	7407f7c39d	Placed move TTL rules to a vector.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	ce851fc782	Fixed MergeTreeData::hasTableTTL() method according to extended TTLs.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	62016feab0	Renamed TTLDestinationType to PartDestinationType.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	ce066d3bb0	Style fixes.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	88c7220256	Fixed Clang build.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	342ea5c30a	Removed TODO comments.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	58e824b6a1	Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	575de5ada6	Attempt to add background moves by TTL expressions.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	33ded274a3	First attempt to store min/max for move ttl expressions.	2019-12-11 13:24:20 +03:00
Vladimir Chebotarev	3e984609fb	Fixed ClickHouse after changing syntax.	2019-12-11 13:24:20 +03:00
Zhichang Yu	ff1b8d46e2	fixed part mutation, added test_backup_restore integration test case	2019-12-11 09:31:37 +08:00
Vladimir Chebotarev	269a0246aa	Added explicit check for existence of part and pair of log messages.	2019-12-10 12:47:23 +03:00
CurtizJ	d3b0800a63	polymorphic parts (development) alter	2019-12-10 00:21:17 +03:00
Vladimir Chebotarev	6afd8d7805	Added test_multiple_disk::test_kill_while_insert, reworked log message and fixed logic of treating stale copies.	2019-12-09 23:29:44 +03:00
Vladimir Chebotarev	a2f238d8da	Added more logging and switched to detaching stale part instead of removing.	2019-12-09 23:29:44 +03:00
Vladimir Chebotarev	9cf7ef03af	Fixed handling of MergeTreeData::DataPartPtr's in MergeTreeData::swapActivePart().	2019-12-09 23:29:44 +03:00
Vladimir Chebotarev	374e0f7bb5	Finally fixed tests.	2019-12-09 23:29:44 +03:00
Vladimir Chebotarev	c283776e84	Really fixed tests.	2019-12-09 23:29:44 +03:00
Vladimir Chebotarev	89659a9129	Fixed a typo.	2019-12-09 23:29:44 +03:00
Vladimir Chebotarev	fe3e89fb38	Fixed tests.	2019-12-09 23:29:44 +03:00
Vladimir Chebotarev	efa73608b8	Separated constant path to DeleteOnDestroy marker.	2019-12-09 23:29:44 +03:00
Vladimir Chebotarev	13c5c621c1	Attempt to ignore redundant copies of parts after move and restart.	2019-12-09 23:29:44 +03:00
Alexander Burmak	edd11abad1	Addressed code review comments	2019-12-08 19:47:51 +03:00
Alexey Milovidov	060e4db596	Fixed build	2019-12-03 01:37:24 +03:00
Alexey Milovidov	8916b8f2e6	Make data skipping indices non-experimental. Make settings about data skipping indices, multiple JOINs and CROSS to INNER JOIN conversion obsolete,	2019-11-30 23:41:02 +03:00
Alexander Burmak	e5ffdc0224	Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs	2019-11-29 18:27:56 +03:00
Nikolai Kochetov	7a32ca057d	Merge pull request #7670 from excitoon-favorites/move_pool ... Separated pool for background moves	2019-11-29 11:08:51 +03:00
Alexander Burmak	3e5ef56644	Filesystem abstraction layer	2019-11-27 14:33:27 +03:00
Vladimir Chebotarev	c396af7c40	Removed check for using Date or DateTime column from TTL expressions.	2019-11-27 13:11:17 +03:00
Vladimir Chebotarev	37bebd1370	Improved BackgroundProcessingPool to use with background moves task.	2019-11-26 16:09:57 +03:00
Olga Khvostikova	47e499d71b	Merge pull request #7833 from excitoon-favorites/detachedparts ... Added disk info to `system.detached_parts`	2019-11-26 11:56:50 +03:00
CurtizJ	9e7adf4cbe	polymorphic parts (development)	2019-11-25 23:19:43 +03:00
CurtizJ	49982ad18c	polymorphic parts (development)	2019-11-22 15:51:00 +03:00
CurtizJ	94abf3691c	polymorphic parts (development)	2019-11-21 19:10:22 +03:00
Vladimir Chebotarev	2b4f6af736	Fixed errors with space reservation introduced in #7558 and #7602.	2019-11-21 12:09:43 +03:00
Vladimir Chebotarev	5cbbcd9cdb	Added disk info to system.detached_parts.	2019-11-19 09:44:10 +03:00
CurtizJ	6cd6af7ec6	polymorphic parts (development)	2019-11-18 15:22:27 +03:00
CurtizJ	c070254279	polymorphic parts (development)	2019-11-08 17:36:10 +03:00
Guillaume Tassery	5994d551a6	rebase from master	2019-11-07 08:38:55 +01:00
alexey-milovidov	b261e6033a	Merge pull request #7602 from excitoon-favorites/cloneAndLoadDataPartOnSameDisk ... Made `MergeTreeData::cloneAndLoadDataPart` only work for the same disk.	2019-11-04 14:42:30 +03:00
Vladimir Chebotarev	e76bbfc5ad	Made MergeTreeData::cloneAndLoadDataPart only work for the same disk.	2019-11-04 01:27:05 +03:00
Alexander Burmak	9b8fc9a899	Fixed missing file name escaping in FREEZE command	2019-11-01 16:17:08 +03:00
CurtizJ	35b7363802	polymorphic parts (development)	2019-10-31 17:44:17 +03:00
Amos Bird	2c75a51d4f	Instant count() for MergeTree ... Use (Replicated)MergeTree's metadata to do trivial count()	2019-10-29 17:45:47 +08:00
alesapin	5d8d1df802	Merge pull request #7434 from excitoon-favorites/fix-7424 ... Allowed to have some parts on destination disk or volume in MOVE PARTITION	2019-10-24 19:45:22 +03:00
Vladimir Chebotarev	64f158ff28	Fixed message for ALTER MOVE PART.	2019-10-24 13:56:32 +03:00
Vladimir Chebotarev	255da8f5e0	Fixed style.	2019-10-24 12:11:06 +03:00
Vladimir Chebotarev	3debdc2119	Added integration tests for ALTER MOVE PARTITION and fixed minor things.	2019-10-24 11:52:33 +03:00
Colum	a413770a97	Fixed spelling error in error message	2019-10-22 10:02:51 -07:00
Vladimir Chebotarev	9446fd2c4d	Allowed to have some parts on destination disk or volume in MOVE PARTITION. #7424	2019-10-22 17:45:01 +03:00
Guillaume Tassery	552e3b8400	update	2019-10-22 08:03:49 +02:00
CurtizJ	8df8bcea94	polymorphic parts (development)	2019-10-21 18:33:59 +03:00
tavplubix	0046b9f137	Wait for jobs to finish on exception (fixes rare segfaults) (#7350)	2019-10-17 17:41:27 +03:00
Vladimir Chebotarev	512e97ddb3	Improved readability a little bit (MergeTreeData::getActiveContainingPart).	2019-10-16 22:01:50 +03:00
CurtizJ	8ba37da2ef	polymorphic parts (development)	2019-10-16 21:27:53 +03:00
CurtizJ	b433add65c	polymorphic parts (development)	2019-10-10 19:30:30 +03:00
alesapin	4e83f65089	Fix bug with segmentation fault in ATTACH PART query	2019-10-03 21:07:47 +03:00
Guillaume Tassery	f54c90ccce	Merge branch 'master' of github.com:PerformanceVision/ClickHouse into move_partition	2019-10-03 10:24:39 +02:00
Vladimir Chebotarev	e79a15c39c	Fixed time calculation in MergeTreeData.	2019-10-02 10:46:53 +03:00
Alexey Milovidov	42b739550b	Renamed "storage_policy_name" to "storage_policy"	2019-09-20 23:35:50 +03:00
Guillaume Tassery	8920f36d96	merge master	2019-09-16 09:27:38 +02:00
alesapin	b0fce77c3d	Fix path to data on disk	2019-09-11 20:17:10 +03:00
alesapin	0b8aec469f	Make absolute path on disks start from /clickhouse/data, fix freeze and rename, add tests	2019-09-11 13:57:32 +03:00
alesapin	34a454aa62	Remove redundant code, that caused race for part object	2019-09-10 20:17:10 +03:00
alesapin	5a45265344	Create global dir	2019-09-10 17:32:32 +03:00
alesapin	65851e27d0	Fix freeze partition	2019-09-10 16:06:26 +03:00
alesapin	ac4ab3ca2b	Fix rename bug	2019-09-10 15:23:18 +03:00
alesapin	189644e743	Better logging	2019-09-09 20:01:19 +03:00
alesapin	27419c965e	Merge with master	2019-09-09 14:13:36 +03:00
alesapin	cfd753a1f3	Add test and found bugs	2019-09-06 18:09:20 +03:00
alesapin	ab518d7787	Split code to parts	2019-09-05 18:53:23 +03:00
alesapin	f576cbb8a4	Simplify code	2019-09-05 16:12:29 +03:00
alesapin	66362cedbc	Refactoring	2019-09-04 21:26:18 +03:00
alesapin	c003f443f9	Refactor	2019-09-04 20:26:53 +03:00
alesapin	8d76febe02	Add moves to part log	2019-09-03 14:32:25 +03:00
alesapin	d08d99954f	Ugly working code	2019-09-03 11:48:43 +03:00
alesapin	27b0a06005	Fix stupid bug	2019-09-03 11:30:59 +03:00
alesapin	e7ee9b7a67	Merge master	2019-09-02 11:46:00 +03:00
Guillaume Tassery	f727580483	Merge branch 'master' of https://github.com/yandex/ClickHouse into move_partition	2019-09-02 08:45:52 +02:00
alesapin	7382a9f3c3	Rename method for settings check	2019-09-01 00:15:40 +03:00
alesapin	2647d4ca15	Rename immutable to readonly	2019-08-30 23:12:26 +03:00
alesapin	6f30338c08	Fixes	2019-08-30 21:31:35 +03:00
alesapin	808f4d0b8a	Intermediate refactoring	2019-08-30 19:50:59 +03:00
alesapin	d7e54d3c14	Merge branch 'master' of github.com:yandex/ClickHouse into ObjatieGroba-feature_multiple_disks	2019-08-30 12:53:24 +03:00
alesapin	1813b96f82	Finally build, possible trash.	2019-08-29 19:17:47 +03:00
alesapin	702b47ae5b	Remove redundant changes	2019-08-29 13:56:43 +03:00
alesapin	0899b3818d	Remove redundant changes	2019-08-29 13:49:26 +03:00
alesapin	67f9753775	Merge branch 'master' into bad_size_of_marks_skip_idx_bug	2019-08-29 11:07:56 +03:00
alesapin	b4d98f6e13	Trying to fix vertical merge	2019-08-28 21:23:20 +03:00
Alexey Milovidov	285d66cee1	Improve table locks (incomplete)	2019-08-27 23:43:08 +03:00
alesapin	106b9717cd	Refactoring of immutable settings	2019-08-27 16:14:19 +03:00
alesapin	7851d8fe0a	Add ability to alter settings with other types of alter	2019-08-27 12:34:53 +03:00
Guillaume Tassery	6f5969e1b5	Merge branch 'master' into move_partition	2019-08-27 15:54:21 +07:00
alesapin	cf31187254	Resolve conflicts	2019-08-26 21:08:58 +03:00
alesapin	0d0ebf885f	Remove two redundant arguments from alter	2019-08-26 17:50:34 +03:00
alesapin	dff0cc1e1c	Remove COW and add MultiVersion	2019-08-26 17:24:29 +03:00
Alexey Milovidov	60d660e263	Merge branch 'master' into merge-constraints	2019-08-26 16:13:44 +03:00
alesapin	062034dfd8	Eventually merged with master	2019-08-26 13:07:32 +03:00
Alexey Milovidov	3fef8e92ad	Merging CONSTRAINTS support	2019-08-25 00:20:20 +03:00
Alexey Milovidov	4366791b63	Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints	2019-08-23 07:49:10 +03:00
Alexander Tokmakov	81022bb3e9	Merge branch 'master' into alter_table_drop_detached_part	2019-08-22 23:38:58 +03:00
alesapin	d2fe947535	Add test for race condition, found it and fix it	2019-08-21 15:32:48 +03:00
alesapin	eb5e052855	merge and fixes	2019-08-21 13:09:29 +03:00
alesapin	70ca7f4156	Merge with master	2019-08-21 11:57:35 +03:00
alexey-milovidov	308baa182e	Merge branch 'master' into table-constraints	2019-08-21 06:33:08 +03:00
Alexey Milovidov	d848009827	Fixed false data race in "MergeTreeDataPart::is_frozen" field	2019-08-21 06:16:59 +03:00
alesapin	e44ab4f4cd	Add tests for partitions alter	2019-08-20 22:04:58 +03:00
alesapin	00bdd6c680	Support move partition	2019-08-20 12:59:19 +03:00
Gleb Novikov	86fecc7501	Merge branch 'master' into table-constraints	2019-08-20 12:17:56 +03:00
alesapin	4ccdb8f92e	Better code	2019-08-19 17:40:12 +03:00
alesapin	f2a8c18c1f	Simplify lock	2019-08-19 14:18:58 +03:00
alesapin	6d29ed99d9	Fix bug with enable_mixed_granularity_parts and mutations	2019-08-19 13:37:04 +03:00
alesapin	a85cdc91a6	Merge branch 'master' into ObjatieGroba-feature_multiple_disks	2019-08-19 11:34:02 +03:00
alesapin	e7542810bb	Merge with master	2019-08-19 11:20:48 +03:00