Commit Graph

1193 Commits

Author SHA1 Message Date
Alexander Tokmakov
3687900848 Merge branch 'master' into table_name_in_istorage 2019-12-30 21:30:24 +03:00
Alexander Tokmakov
250f170a69 Merge branch 'master' into table_name_in_istorage 2019-12-30 14:08:09 +03:00
alesapin
247906a4d7 Move check alter to alter interpreter 2019-12-29 14:09:10 +03:00
Alexander Tokmakov
94931f059d minor improvements 2019-12-27 22:30:22 +03:00
alesapin
2d40b33120 More usage of metadata 2019-12-27 19:34:50 +03:00
alesapin
d610bb215a Remove cerr 2019-12-27 18:05:23 +03:00
alesapin
6916ac08c2 Rename fields 2019-12-27 17:46:11 +03:00
alesapin
716648bfa4 Something working 2019-12-27 17:36:59 +03:00
alesapin
d341b648d2 Better alter 2019-12-26 21:17:05 +03:00
Alexander Tokmakov
42296cc80a remove separate getTableName() and getDatabaseName() 2019-12-26 21:11:49 +03:00
Alexander Tokmakov
2e5d61cd81 better constructors of storages 2019-12-26 20:04:08 +03:00
Alexander Tokmakov
cf5c998b30 refactor storage name 2019-12-26 19:23:38 +03:00
alesapin
093d56f474
Merge pull request #8382 from ClickHouse/relative_paths_in_storages
Use relative paths in Storages
2019-12-26 13:05:37 +03:00
alesapin
d4987f86d3 Merge branch 'master' into immutable_parts 2019-12-25 11:44:47 +03:00
CurtizJ
4bd4ac715c Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2019-12-25 03:10:24 +03:00
Alexander Tokmakov
60a47c3453 Merge branch 'master' into relative_paths_in_storages 2019-12-24 19:58:34 +03:00
Alexander Tokmakov
514868cebc use relative paths in IStorage::rename(...) 2019-12-24 16:35:50 +03:00
alesapin
25ecc38615 More correct separation between metadata and data alters for non replicated MergeTree. 2019-12-23 19:44:50 +03:00
Alexander Tokmakov
5fab732408 use arbitrary relative path in *MergeTree 2019-12-23 18:37:55 +03:00
alesapin
73c9f0e71c Remove redundant code 2019-12-23 17:46:00 +03:00
Javi santana bot
dd5435501a check for active replicas when waiting for commands 2019-12-20 11:04:16 +01:00
alesapin
9fea941009 Make wait endless 2019-12-19 18:27:56 +03:00
CurtizJ
ba2a630a13 merging with master 2019-12-19 16:10:57 +03:00
CurtizJ
9db2f2ccbc Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2019-12-19 14:46:43 +03:00
Guillaume Tassery
dca0c83809
Merge branch 'master' into move_partition 2019-12-17 13:49:18 +07:00
alesapin
2695aa13c4 Add ability to execute mutations asynchronously 2019-12-16 18:51:15 +03:00
Alexander Burmak
2ce6136de5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-12 12:10:50 +03:00
Vladimir Chebotarev
0ff0a52249 Missed review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7fd1668fde Review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
618a39cc8c Don't move anything if part already belongs their destination. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1 Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Alexander Burmak
5a93441445 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-09 17:18:47 +03:00
Vladimir Chebotarev
1fbfb50fba Fixed updating result_part_path while merging and mutating. 2019-12-07 12:54:05 +03:00
Vladimir Chebotarev
ef5c4fb5a4 Remake of result_part_path. 2019-12-01 20:41:35 +03:00
Alexander Burmak
e5ffdc0224 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-11-29 18:27:56 +03:00
Alexander Burmak
3e5ef56644 Filesystem abstraction layer 2019-11-27 14:33:27 +03:00
Vladimir Chebotarev
37bebd1370 Improved BackgroundProcessingPool to use with background moves task. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
e96c24786b Separated pool for background moves. 2019-11-26 16:08:59 +03:00
Vladimir Chebotarev
2b4f6af736 Fixed errors with space reservation introduced in #7558 and #7602. 2019-11-21 12:09:43 +03:00
Guillaume Tassery
ebee0ab09a release lock 2019-11-21 09:04:22 +01:00
Guillaume Tassery
5994d551a6 rebase from master 2019-11-07 08:38:55 +01:00
alexey-milovidov
b261e6033a
Merge pull request #7602 from excitoon-favorites/cloneAndLoadDataPartOnSameDisk
Made `MergeTreeData::cloneAndLoadDataPart` only work for the same disk.
2019-11-04 14:42:30 +03:00
Vladimir Chebotarev
e76bbfc5ad Made MergeTreeData::cloneAndLoadDataPart only work for the same disk. 2019-11-04 01:27:05 +03:00
alesapin
6ef0a92535
Merge pull request #7558 from excitoon/patch-1
Made mutation to choose the same disk in `ReplicatedMergeTree`.
2019-11-01 13:52:45 +03:00
Vladimir Chebotarev
faf1b070ac
Typo was fixed. 2019-10-31 16:26:11 +03:00
Vladimir Chebotarev
0dea6f5458
Added comment for selecting disk for mutation. 2019-10-31 16:19:38 +03:00
Vladimir Chebotarev
f44cee623a
Made mutation to choose the same disk in ReplicatedMergeTree. 2019-10-31 15:22:25 +03:00
Nikolai Kochetov
18378417df Fix build. 2019-10-31 14:48:35 +03:00
Nikolai Kochetov
a80338e066 Merged with master 2019-10-31 14:41:29 +03:00
Amos Bird
2c75a51d4f
Instant count() for MergeTree
Use (Replicated)MergeTree's metadata to do trivial count()
2019-10-29 17:45:47 +08:00
Guillaume Tassery
3dee295f9a Set neutral lock 2019-10-22 09:15:58 +02:00
Guillaume Tassery
d38bc27c05 put back lock 2019-10-22 08:30:51 +02:00
Guillaume Tassery
88491abd7b add tests 2019-10-11 12:42:25 +02:00
Guillaume Tassery
c91f5fbd6d sync 2019-10-11 10:42:43 +02:00
Guillaume Tassery
145df0bb65 Fix lock 2019-10-11 08:11:53 +02:00
CurtizJ
b433add65c polymorphic parts (development) 2019-10-10 19:30:30 +03:00
Nikolai Kochetov
95ec0f7c2d Merged with master. 2019-10-04 20:53:21 +03:00
Nikolai Kochetov
1689576770 Update MergeTreeDataSelectExecutor. 2019-10-04 20:49:14 +03:00
Guillaume Tassery
0f66da0e91 Resolve lock issue after review 2019-10-04 06:37:19 +02:00
Guillaume Tassery
4f26f3fcfa Fix style 2019-10-03 12:52:32 +02:00
Guillaume Tassery
f54c90ccce Merge branch 'master' of github.com:PerformanceVision/ClickHouse into move_partition 2019-10-03 10:24:39 +02:00
Nikita Mikhaylov
13e2034084
fix possible dataraces in ReplicatedMergeTree 2019-10-02 12:59:44 +03:00
Akazz
4ae3db45c6 Fixed timeout reading in SYNC REPLICA 2019-09-19 14:04:57 +03:00
Guillaume Tassery
acaa9cdbad Rename move partition to partition_expr to move partition to table partition_expr 2019-09-17 13:59:09 +02:00
Guillaume Tassery
713cc6c825 Add lock before every function call 2019-09-17 11:00:20 +02:00
Guillaume Tassery
8920f36d96 merge master 2019-09-16 09:27:38 +02:00
alesapin
193049293a More comments, more readable code 2019-09-10 14:21:59 +03:00
alesapin
ab518d7787 Split code to parts 2019-09-05 18:53:23 +03:00
alesapin
f576cbb8a4 Simplify code 2019-09-05 16:12:29 +03:00
alesapin
c003f443f9 Refactor 2019-09-04 20:26:53 +03:00
alesapin
13bbae5860 Remove trash 2019-09-04 19:00:20 +03:00
alesapin
a4c3937153 Small refactoring 2019-09-04 16:24:55 +03:00
alesapin
e6e6c11ba3 Better test and NOTHING_TO_DO 2019-09-03 20:06:36 +03:00
alesapin
52442cf549 Add system stop moves query 2019-09-03 17:50:49 +03:00
alesapin
48004e9b7b Style fixes 2019-09-03 15:25:58 +03:00
alesapin
8d76febe02 Add moves to part log 2019-09-03 14:32:25 +03:00
alesapin
0e47bbca4d Fix style check 2019-09-03 12:18:02 +03:00
alesapin
f0c5ee5877 Merge with master 2019-09-02 20:34:18 +03:00
alesapin
198031f787 Refactoring 2019-09-02 14:35:53 +03:00
Guillaume Tassery
fcb9a31f7b Fix build 2019-09-02 09:50:48 +02:00
Guillaume Tassery
f727580483 Merge branch 'master' of https://github.com/yandex/ClickHouse into move_partition 2019-09-02 08:45:52 +02:00
Guillaume Tassery
87b8f89600 cosmetic 2019-08-30 06:36:01 +02:00
Guillaume Tassery
d752b1c143 Fix synchronisation bug 2019-08-30 06:24:05 +02:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
Guillaume Tassery
62e302d689 Implement ReplicatedMergeTree move to operation 2019-08-28 10:24:17 +02:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
Alexey Milovidov
c385c950ba Merge branch 'master' into replicate-merge-tree-minor-lock-improvement 2019-08-27 17:30:48 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Guillaume Tassery
6f5969e1b5
Merge branch 'master' into move_partition 2019-08-27 15:54:21 +07:00
Alexey Milovidov
57fa4e1dd7 Minor lock improvement for ReplicatedMergeTree 2019-08-27 00:40:29 +03:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00
alesapin
dff0cc1e1c Remove COW and add MultiVersion 2019-08-26 17:24:29 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
alexey-milovidov
7012a421c6
Merge branch 'master' into alter_table_drop_detached_part 2019-08-23 05:22:07 +03:00
alexey-milovidov
3a237b4375
Merge pull request #6617 from yandex/fix_too_many_parts_while_mutation_6502
Fix too many parts while mutation
2019-08-23 04:27:43 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
Alexander Tokmakov
acce56095f limit number of background threads for mutations 2019-08-22 22:35:46 +03:00
alesapin
b9d3d04c57 Move tasks in schedule pool 2019-08-21 19:02:13 +03:00
Alexander Tokmakov
5cb8605f61 limit number of mutations in the queue 2019-08-21 16:10:33 +03:00
alesapin
d2fe947535 Add test for race condition, found it and fix it 2019-08-21 15:32:48 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
alexey-milovidov
58358ec856
Merge pull request #6514 from yandex/added-test-for-race-conditions
Added a test for race conditions.
2019-08-21 01:33:34 +03:00
alesapin
8417eb9d95 Remove old tests 2019-08-20 21:35:35 +03:00
Alexey Milovidov
c8859febcb Merge branch 'master' into added-test-for-race-conditions 2019-08-20 21:05:25 +03:00
alesapin
120e27a385 Lock parts with dirty hack 2019-08-20 21:00:48 +03:00
alesapin
9c8ec6e4fc Fixes for replicated merge tree 2019-08-20 20:16:32 +03:00
filimonov
8d0c2eacfd
remove doubled const TABLE_IS_READ_ONLY 2019-08-20 13:18:08 +02:00
alesapin
00bdd6c680 Support move partition 2019-08-20 12:59:19 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
alesapin
8408ffbfa6 Almost working replicated MT 2019-08-20 11:38:02 +03:00
Alexey Milovidov
a574727269 Attempt to fix deadlock 2019-08-20 04:24:53 +03:00
Alexey Milovidov
22a11343e8 Attempt to fix race condition 2019-08-19 22:02:20 +03:00
alesapin
e9e67a2688 Almost compilable 2019-08-19 20:59:16 +03:00
Alexander Tokmakov
be5df60c7a Merge branch 'master' into fix_inconsistent_parts_after_clone_replica 2019-08-19 17:34:22 +03:00
Alexander Tokmakov
6991683a5f remove local parts which source replica doesnt have 2019-08-19 15:08:45 +03:00
alesapin
a85cdc91a6 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-08-19 11:34:02 +03:00
alesapin
e7542810bb Merge with master 2019-08-19 11:20:48 +03:00
alesapin
defc1e30ca Some improvements 2019-08-16 18:57:19 +03:00
Nikita Vasilev
00a5fe7836 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-15 19:48:57 +03:00
Gleb Novikov
ab1c4139de Added ReplicatedMergeTree support and test for constraints, also added VIOLATED_CONSTRAINT error 2019-08-14 22:51:03 +03:00
alesapin
949890ee90 Merged 2019-08-14 12:46:30 +03:00
alesapin
ad81c743c1 Buildable code 2019-08-13 13:29:31 +03:00
alesapin
428c753ed7 Merge with master 2019-08-13 11:37:47 +03:00
alesapin
98d38e041f Fix recreation of replicated table with fixed granularity 2019-08-12 16:30:29 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
Nikita Vasilev
75e381bde4 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-10 23:07:50 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Alexander Tokmakov
ae6efb23b4 Merge branch 'master' into alter_table_drop_detached_part 2019-08-08 22:31:31 +03:00
alesapin
e62101b8e8 Better comment 2019-08-06 19:29:31 +03:00
alesapin
84fd4906ca Changes for engines 2019-08-06 16:04:29 +03:00
alesapin
52b9658bcf Merge with master 2019-08-06 15:55:12 +03:00
Nikita Vasilev
4a39538625 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-04 16:58:21 +03:00
alexey-milovidov
f8980e691e
Merge pull request #6274 from CurtizJ/ttl-old-parts
TTL improvements.
2019-08-02 22:51:28 +03:00
CurtizJ
d169f42b36 fix build 2019-08-01 22:07:31 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
CurtizJ
f224269d41 filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query 2019-08-01 14:10:42 +03:00
Igr Mineev
0f1e8404dc Merge branch 'master' of github.com:yandex/ClickHouse into feature_multiple_disks 2019-08-01 13:42:59 +03:00
Alexander Tokmakov
f0836553d4 drop detached partition 2019-07-31 18:27:21 +03:00
Alexander Tokmakov
c6717e0d3f refactor attachPartition 2019-07-30 22:11:15 +03:00
Alexander Tokmakov
2f33df1b2e rename all parts before attaching 2019-07-30 20:24:40 +03:00
Alexander Tokmakov
3c15b87003 Merge branch 'master' into alter_table_drop_detached_part 2019-07-29 14:29:23 +03:00
Alexander Tokmakov
0fc47fbbe4 fixes 2019-07-29 13:27:37 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
Nikita Vasilev
39b40f8e42 fix replicated indices mutations 2019-07-28 17:55:51 +03:00
Nikita Vasilev
7efb1bcb12 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-07-27 10:30:43 +03:00
Guillaume Tassery
c633dfa5c0 Use to_database instead of from_database for move partition feature 2019-07-26 13:12:18 +02:00