Commit Graph

1229 Commits

Author SHA1 Message Date
alesapin
974e9a6b7a Broke things 2020-01-28 20:15:22 +03:00
alesapin
736711d21c Merge branch 'master' into alter_on_top_of_mutations 2020-01-28 17:10:34 +03:00
CurtizJ
a5d9975e37 better checking if table has TTL 2020-01-27 14:53:50 +03:00
CurtizJ
14f0b9e137 add query 'ALTER ... MATERIALIZE TTL' 2020-01-24 13:53:14 +03:00
CurtizJ
b5d8baee71 fix alters if ttl is set 2020-01-23 16:04:06 +03:00
CurtizJ
9275225527 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-01-21 17:21:52 +03:00
alesapin
47578b8dc1 Remove some garbage 2020-01-20 17:28:51 +03:00
alesapin
3716d4f7e3 Merge with master 2020-01-20 12:21:05 +03:00
alexey-milovidov
52e8252653
Merge pull request #8650 from ClickHouse/remove_istorage_weak_ptr
Get rid of StorageWeakPtr
2020-01-18 20:28:53 +03:00
alesapin
d2e9ed3898 Commented tons of debug prints 2020-01-17 17:48:56 +03:00
alesapin
58b9e73a7a Better working on files names 2020-01-17 16:54:22 +03:00
CurtizJ
2797873921 code cleanup 2020-01-16 19:19:03 +03:00
CurtizJ
27750f0cd4 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-01-15 19:36:35 +03:00
alesapin
2a8873a9b7 Better 2020-01-15 19:18:11 +03:00
alesapin
92648955c4 Almost working drop 2020-01-15 16:47:00 +03:00
alesapin
2abf4bbc95 Not working state 2020-01-15 16:00:08 +03:00
Alexander Tokmakov
5e2badd9b8 Merge branch 'master' into table_name_in_istorage 2020-01-15 14:55:20 +03:00
Nikita Mikhaylov
0e0dd80abf
Merge pull request #6168 from PerformanceVision/move_partition
Alter command for move a specific partition from MergeTree table
2020-01-14 22:32:10 +04:00
Alexander Tokmakov
ff1b7e1386 get rid of StorageWeakPtr 2020-01-14 19:54:25 +03:00
alesapin
e7aa209bf3 Merge branch 'master' into alter_on_top_of_mutations 2020-01-14 11:26:27 +03:00
alesapin
a90ab99282 Maybe it will compile better 2020-01-13 19:40:30 +03:00
alesapin
bc59e473e8 Some thoughts on non blocking alter 2020-01-13 19:39:20 +03:00
Alexander Tokmakov
9389c83d4d Merge branch 'master' into table_name_in_istorage 2020-01-13 14:41:42 +03:00
Guillaume Tassery
377d20185e Merge branch 'master' of github.com:ClickHouse/ClickHouse into move_partition 2020-01-13 04:16:27 +01:00
Guillaume Tassery
33698588d7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove_partition 2020-01-13 04:13:58 +01:00
alexey-milovidov
6ef19d3630
Merge pull request #8549 from excitoon-favorites/mergedownwards
Do not allow to merge data moving it against storage policy volume order
2020-01-10 19:21:21 +03:00
Alexander Tokmakov
902615a2f7 Merge branch 'master' into table_name_in_istorage 2020-01-10 14:51:21 +03:00
Guillaume Tassery
121d651914 remove local partition on replicated storage as well 2020-01-10 12:08:56 +01:00
alexey-milovidov
8d9f85cf22
Merge pull request #8314 from javisantana/fix/no_wait_for_no_active_replicas
check for active replicas when waiting for commands
2020-01-09 19:54:07 +03:00
Alexander Tokmakov
9b75ee2378 Merge branch 'master' into table_name_in_istorage 2020-01-09 17:33:58 +03:00
CurtizJ
33ae97894b Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-01-09 15:54:37 +03:00
Guillaume Tassery
d176abb7c0 Check the storage policy of table on the move partition table 2020-01-08 10:57:27 +01:00
Javi santana bot
776ceeb427 Wait only on optimize commands 2020-01-07 19:16:37 +01:00
Vladimir Chebotarev
7de9eb4bdc Do not allow to merge data moving it against storage policy volume order. 2020-01-07 10:17:11 +03:00
Guillaume Tassery
8b2938a8fb
Merge branch 'master' into move_partition 2020-01-07 13:25:35 +07:00
alexey-milovidov
00ba767f5d Merge pull request #8318 from excitoon-favorites/replicatedalterttl
Fixed ALTER TTL for replicated tables
2020-01-04 20:42:39 +03:00
Alexander Tokmakov
3687900848 Merge branch 'master' into table_name_in_istorage 2019-12-30 21:30:24 +03:00
Alexander Tokmakov
250f170a69 Merge branch 'master' into table_name_in_istorage 2019-12-30 14:08:09 +03:00
alesapin
247906a4d7 Move check alter to alter interpreter 2019-12-29 14:09:10 +03:00
Alexander Tokmakov
94931f059d minor improvements 2019-12-27 22:30:22 +03:00
alesapin
2d40b33120 More usage of metadata 2019-12-27 19:34:50 +03:00
alesapin
d610bb215a Remove cerr 2019-12-27 18:05:23 +03:00
alesapin
6916ac08c2 Rename fields 2019-12-27 17:46:11 +03:00
alesapin
716648bfa4 Something working 2019-12-27 17:36:59 +03:00
alesapin
d341b648d2 Better alter 2019-12-26 21:17:05 +03:00
Alexander Tokmakov
42296cc80a remove separate getTableName() and getDatabaseName() 2019-12-26 21:11:49 +03:00
Alexander Tokmakov
2e5d61cd81 better constructors of storages 2019-12-26 20:04:08 +03:00
Alexander Tokmakov
cf5c998b30 refactor storage name 2019-12-26 19:23:38 +03:00
alesapin
093d56f474
Merge pull request #8382 from ClickHouse/relative_paths_in_storages
Use relative paths in Storages
2019-12-26 13:05:37 +03:00
alesapin
d4987f86d3 Merge branch 'master' into immutable_parts 2019-12-25 11:44:47 +03:00
CurtizJ
4bd4ac715c Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2019-12-25 03:10:24 +03:00
Alexander Tokmakov
60a47c3453 Merge branch 'master' into relative_paths_in_storages 2019-12-24 19:58:34 +03:00
Alexander Tokmakov
514868cebc use relative paths in IStorage::rename(...) 2019-12-24 16:35:50 +03:00
alesapin
25ecc38615 More correct separation between metadata and data alters for non replicated MergeTree. 2019-12-23 19:44:50 +03:00
Alexander Tokmakov
5fab732408 use arbitrary relative path in *MergeTree 2019-12-23 18:37:55 +03:00
alesapin
73c9f0e71c Remove redundant code 2019-12-23 17:46:00 +03:00
Javi santana bot
dd5435501a check for active replicas when waiting for commands 2019-12-20 11:04:16 +01:00
alesapin
9fea941009 Make wait endless 2019-12-19 18:27:56 +03:00
CurtizJ
ba2a630a13 merging with master 2019-12-19 16:10:57 +03:00
CurtizJ
9db2f2ccbc Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2019-12-19 14:46:43 +03:00
Guillaume Tassery
dca0c83809
Merge branch 'master' into move_partition 2019-12-17 13:49:18 +07:00
alesapin
2695aa13c4 Add ability to execute mutations asynchronously 2019-12-16 18:51:15 +03:00
Alexander Burmak
2ce6136de5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-12 12:10:50 +03:00
Vladimir Chebotarev
0ff0a52249 Missed review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7fd1668fde Review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
618a39cc8c Don't move anything if part already belongs their destination. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1 Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Alexander Burmak
5a93441445 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-09 17:18:47 +03:00
Vladimir Chebotarev
1fbfb50fba Fixed updating result_part_path while merging and mutating. 2019-12-07 12:54:05 +03:00
Vladimir Chebotarev
ef5c4fb5a4 Remake of result_part_path. 2019-12-01 20:41:35 +03:00
Alexander Burmak
e5ffdc0224 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-11-29 18:27:56 +03:00
Alexander Burmak
3e5ef56644 Filesystem abstraction layer 2019-11-27 14:33:27 +03:00
Vladimir Chebotarev
37bebd1370 Improved BackgroundProcessingPool to use with background moves task. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
e96c24786b Separated pool for background moves. 2019-11-26 16:08:59 +03:00
Vladimir Chebotarev
2b4f6af736 Fixed errors with space reservation introduced in #7558 and #7602. 2019-11-21 12:09:43 +03:00
Guillaume Tassery
ebee0ab09a release lock 2019-11-21 09:04:22 +01:00
Guillaume Tassery
5994d551a6 rebase from master 2019-11-07 08:38:55 +01:00
alexey-milovidov
b261e6033a
Merge pull request #7602 from excitoon-favorites/cloneAndLoadDataPartOnSameDisk
Made `MergeTreeData::cloneAndLoadDataPart` only work for the same disk.
2019-11-04 14:42:30 +03:00
Vladimir Chebotarev
e76bbfc5ad Made MergeTreeData::cloneAndLoadDataPart only work for the same disk. 2019-11-04 01:27:05 +03:00
alesapin
6ef0a92535
Merge pull request #7558 from excitoon/patch-1
Made mutation to choose the same disk in `ReplicatedMergeTree`.
2019-11-01 13:52:45 +03:00
Vladimir Chebotarev
faf1b070ac
Typo was fixed. 2019-10-31 16:26:11 +03:00
Vladimir Chebotarev
0dea6f5458
Added comment for selecting disk for mutation. 2019-10-31 16:19:38 +03:00
Vladimir Chebotarev
f44cee623a
Made mutation to choose the same disk in ReplicatedMergeTree. 2019-10-31 15:22:25 +03:00
Nikolai Kochetov
18378417df Fix build. 2019-10-31 14:48:35 +03:00
Nikolai Kochetov
a80338e066 Merged with master 2019-10-31 14:41:29 +03:00
Amos Bird
2c75a51d4f
Instant count() for MergeTree
Use (Replicated)MergeTree's metadata to do trivial count()
2019-10-29 17:45:47 +08:00
Guillaume Tassery
3dee295f9a Set neutral lock 2019-10-22 09:15:58 +02:00
Guillaume Tassery
d38bc27c05 put back lock 2019-10-22 08:30:51 +02:00
Guillaume Tassery
88491abd7b add tests 2019-10-11 12:42:25 +02:00
Guillaume Tassery
c91f5fbd6d sync 2019-10-11 10:42:43 +02:00
Guillaume Tassery
145df0bb65 Fix lock 2019-10-11 08:11:53 +02:00
CurtizJ
b433add65c polymorphic parts (development) 2019-10-10 19:30:30 +03:00
Nikolai Kochetov
95ec0f7c2d Merged with master. 2019-10-04 20:53:21 +03:00
Nikolai Kochetov
1689576770 Update MergeTreeDataSelectExecutor. 2019-10-04 20:49:14 +03:00
Guillaume Tassery
0f66da0e91 Resolve lock issue after review 2019-10-04 06:37:19 +02:00
Guillaume Tassery
4f26f3fcfa Fix style 2019-10-03 12:52:32 +02:00
Guillaume Tassery
f54c90ccce Merge branch 'master' of github.com:PerformanceVision/ClickHouse into move_partition 2019-10-03 10:24:39 +02:00
Nikita Mikhaylov
13e2034084
fix possible dataraces in ReplicatedMergeTree 2019-10-02 12:59:44 +03:00
Akazz
4ae3db45c6 Fixed timeout reading in SYNC REPLICA 2019-09-19 14:04:57 +03:00
Guillaume Tassery
acaa9cdbad Rename move partition to partition_expr to move partition to table partition_expr 2019-09-17 13:59:09 +02:00
Guillaume Tassery
713cc6c825 Add lock before every function call 2019-09-17 11:00:20 +02:00
Guillaume Tassery
8920f36d96 merge master 2019-09-16 09:27:38 +02:00
alesapin
193049293a More comments, more readable code 2019-09-10 14:21:59 +03:00
alesapin
ab518d7787 Split code to parts 2019-09-05 18:53:23 +03:00
alesapin
f576cbb8a4 Simplify code 2019-09-05 16:12:29 +03:00
alesapin
c003f443f9 Refactor 2019-09-04 20:26:53 +03:00
alesapin
13bbae5860 Remove trash 2019-09-04 19:00:20 +03:00
alesapin
a4c3937153 Small refactoring 2019-09-04 16:24:55 +03:00
alesapin
e6e6c11ba3 Better test and NOTHING_TO_DO 2019-09-03 20:06:36 +03:00
alesapin
52442cf549 Add system stop moves query 2019-09-03 17:50:49 +03:00
alesapin
48004e9b7b Style fixes 2019-09-03 15:25:58 +03:00
alesapin
8d76febe02 Add moves to part log 2019-09-03 14:32:25 +03:00
alesapin
0e47bbca4d Fix style check 2019-09-03 12:18:02 +03:00
alesapin
f0c5ee5877 Merge with master 2019-09-02 20:34:18 +03:00
alesapin
198031f787 Refactoring 2019-09-02 14:35:53 +03:00
Guillaume Tassery
fcb9a31f7b Fix build 2019-09-02 09:50:48 +02:00
Guillaume Tassery
f727580483 Merge branch 'master' of https://github.com/yandex/ClickHouse into move_partition 2019-09-02 08:45:52 +02:00
Guillaume Tassery
87b8f89600 cosmetic 2019-08-30 06:36:01 +02:00
Guillaume Tassery
d752b1c143 Fix synchronisation bug 2019-08-30 06:24:05 +02:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
Guillaume Tassery
62e302d689 Implement ReplicatedMergeTree move to operation 2019-08-28 10:24:17 +02:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
Alexey Milovidov
c385c950ba Merge branch 'master' into replicate-merge-tree-minor-lock-improvement 2019-08-27 17:30:48 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Guillaume Tassery
6f5969e1b5
Merge branch 'master' into move_partition 2019-08-27 15:54:21 +07:00
Alexey Milovidov
57fa4e1dd7 Minor lock improvement for ReplicatedMergeTree 2019-08-27 00:40:29 +03:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00
alesapin
dff0cc1e1c Remove COW and add MultiVersion 2019-08-26 17:24:29 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
alexey-milovidov
7012a421c6
Merge branch 'master' into alter_table_drop_detached_part 2019-08-23 05:22:07 +03:00
alexey-milovidov
3a237b4375
Merge pull request #6617 from yandex/fix_too_many_parts_while_mutation_6502
Fix too many parts while mutation
2019-08-23 04:27:43 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
Alexander Tokmakov
acce56095f limit number of background threads for mutations 2019-08-22 22:35:46 +03:00
alesapin
b9d3d04c57 Move tasks in schedule pool 2019-08-21 19:02:13 +03:00
Alexander Tokmakov
5cb8605f61 limit number of mutations in the queue 2019-08-21 16:10:33 +03:00
alesapin
d2fe947535 Add test for race condition, found it and fix it 2019-08-21 15:32:48 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
alexey-milovidov
58358ec856
Merge pull request #6514 from yandex/added-test-for-race-conditions
Added a test for race conditions.
2019-08-21 01:33:34 +03:00
alesapin
8417eb9d95 Remove old tests 2019-08-20 21:35:35 +03:00
Alexey Milovidov
c8859febcb Merge branch 'master' into added-test-for-race-conditions 2019-08-20 21:05:25 +03:00
alesapin
120e27a385 Lock parts with dirty hack 2019-08-20 21:00:48 +03:00
alesapin
9c8ec6e4fc Fixes for replicated merge tree 2019-08-20 20:16:32 +03:00
filimonov
8d0c2eacfd
remove doubled const TABLE_IS_READ_ONLY 2019-08-20 13:18:08 +02:00
alesapin
00bdd6c680 Support move partition 2019-08-20 12:59:19 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
alesapin
8408ffbfa6 Almost working replicated MT 2019-08-20 11:38:02 +03:00