Commit Graph

883 Commits

Author SHA1 Message Date
Vladimir Chebotarev
62016feab0 Renamed TTLDestinationType to PartDestinationType. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce066d3bb0 Style fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
88c7220256 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
342ea5c30a Removed TODO comments. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1 Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
575de5ada6 Attempt to add background moves by TTL expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
33ded274a3 First attempt to store min/max for move ttl expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e984609fb Fixed ClickHouse after changing syntax. 2019-12-11 13:24:20 +03:00
Zhichang Yu
ff1b8d46e2 fixed part mutation, added test_backup_restore integration test case 2019-12-11 09:31:37 +08:00
Vladimir Chebotarev
269a0246aa Added explicit check for existence of part and pair of log messages. 2019-12-10 12:47:23 +03:00
CurtizJ
d3b0800a63 polymorphic parts (development) alter 2019-12-10 00:21:17 +03:00
Vladimir Chebotarev
6afd8d7805 Added test_multiple_disk::test_kill_while_insert, reworked log message and fixed logic of treating stale copies. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
a2f238d8da Added more logging and switched to detaching stale part instead of removing. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
9cf7ef03af Fixed handling of MergeTreeData::DataPartPtr's in MergeTreeData::swapActivePart(). 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
374e0f7bb5 Finally fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
c283776e84 Really fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
89659a9129 Fixed a typo. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
fe3e89fb38 Fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
efa73608b8 Separated constant path to DeleteOnDestroy marker. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
13c5c621c1 Attempt to ignore redundant copies of parts after move and restart. 2019-12-09 23:29:44 +03:00
Alexander Burmak
edd11abad1 Addressed code review comments 2019-12-08 19:47:51 +03:00
Alexey Milovidov
060e4db596 Fixed build 2019-12-03 01:37:24 +03:00
Alexey Milovidov
8916b8f2e6 Make data skipping indices non-experimental. Make settings about data skipping indices, multiple JOINs and CROSS to INNER JOIN conversion obsolete, 2019-11-30 23:41:02 +03:00
Alexander Burmak
e5ffdc0224 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-11-29 18:27:56 +03:00
Nikolai Kochetov
7a32ca057d
Merge pull request #7670 from excitoon-favorites/move_pool
Separated pool for background moves
2019-11-29 11:08:51 +03:00
Alexander Burmak
3e5ef56644 Filesystem abstraction layer 2019-11-27 14:33:27 +03:00
Vladimir Chebotarev
c396af7c40 Removed check for using Date or DateTime column from TTL expressions. 2019-11-27 13:11:17 +03:00
Vladimir Chebotarev
37bebd1370 Improved BackgroundProcessingPool to use with background moves task. 2019-11-26 16:09:57 +03:00
Olga Khvostikova
47e499d71b
Merge pull request #7833 from excitoon-favorites/detachedparts
Added disk info to `system.detached_parts`
2019-11-26 11:56:50 +03:00
CurtizJ
9e7adf4cbe polymorphic parts (development) 2019-11-25 23:19:43 +03:00
CurtizJ
49982ad18c polymorphic parts (development) 2019-11-22 15:51:00 +03:00
CurtizJ
94abf3691c polymorphic parts (development) 2019-11-21 19:10:22 +03:00
Vladimir Chebotarev
2b4f6af736 Fixed errors with space reservation introduced in #7558 and #7602. 2019-11-21 12:09:43 +03:00
Vladimir Chebotarev
5cbbcd9cdb Added disk info to system.detached_parts. 2019-11-19 09:44:10 +03:00
CurtizJ
6cd6af7ec6 polymorphic parts (development) 2019-11-18 15:22:27 +03:00
CurtizJ
c070254279 polymorphic parts (development) 2019-11-08 17:36:10 +03:00
Guillaume Tassery
5994d551a6 rebase from master 2019-11-07 08:38:55 +01:00
alexey-milovidov
b261e6033a
Merge pull request #7602 from excitoon-favorites/cloneAndLoadDataPartOnSameDisk
Made `MergeTreeData::cloneAndLoadDataPart` only work for the same disk.
2019-11-04 14:42:30 +03:00
Vladimir Chebotarev
e76bbfc5ad Made MergeTreeData::cloneAndLoadDataPart only work for the same disk. 2019-11-04 01:27:05 +03:00
Alexander Burmak
9b8fc9a899 Fixed missing file name escaping in FREEZE command 2019-11-01 16:17:08 +03:00
CurtizJ
35b7363802 polymorphic parts (development) 2019-10-31 17:44:17 +03:00
Amos Bird
2c75a51d4f
Instant count() for MergeTree
Use (Replicated)MergeTree's metadata to do trivial count()
2019-10-29 17:45:47 +08:00
alesapin
5d8d1df802
Merge pull request #7434 from excitoon-favorites/fix-7424
Allowed to have some parts on destination disk or volume in MOVE PARTITION
2019-10-24 19:45:22 +03:00
Vladimir Chebotarev
64f158ff28 Fixed message for ALTER MOVE PART. 2019-10-24 13:56:32 +03:00
Vladimir Chebotarev
255da8f5e0 Fixed style. 2019-10-24 12:11:06 +03:00
Vladimir Chebotarev
3debdc2119 Added integration tests for ALTER MOVE PARTITION and fixed minor things. 2019-10-24 11:52:33 +03:00
Colum
a413770a97 Fixed spelling error in error message 2019-10-22 10:02:51 -07:00
Vladimir Chebotarev
9446fd2c4d Allowed to have some parts on destination disk or volume in MOVE PARTITION. #7424 2019-10-22 17:45:01 +03:00
Guillaume Tassery
552e3b8400 update 2019-10-22 08:03:49 +02:00
CurtizJ
8df8bcea94 polymorphic parts (development) 2019-10-21 18:33:59 +03:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Vladimir Chebotarev
512e97ddb3
Improved readability a little bit (MergeTreeData::getActiveContainingPart). 2019-10-16 22:01:50 +03:00
CurtizJ
8ba37da2ef polymorphic parts (development) 2019-10-16 21:27:53 +03:00
CurtizJ
b433add65c polymorphic parts (development) 2019-10-10 19:30:30 +03:00
alesapin
4e83f65089 Fix bug with segmentation fault in ATTACH PART query 2019-10-03 21:07:47 +03:00
Guillaume Tassery
f54c90ccce Merge branch 'master' of github.com:PerformanceVision/ClickHouse into move_partition 2019-10-03 10:24:39 +02:00
Vladimir Chebotarev
e79a15c39c
Fixed time calculation in MergeTreeData. 2019-10-02 10:46:53 +03:00
Alexey Milovidov
42b739550b Renamed "storage_policy_name" to "storage_policy" 2019-09-20 23:35:50 +03:00
Guillaume Tassery
8920f36d96 merge master 2019-09-16 09:27:38 +02:00
alesapin
b0fce77c3d Fix path to data on disk 2019-09-11 20:17:10 +03:00
alesapin
0b8aec469f Make absolute path on disks start from /clickhouse/data, fix freeze and rename, add tests 2019-09-11 13:57:32 +03:00
alesapin
34a454aa62 Remove redundant code, that caused race for part object 2019-09-10 20:17:10 +03:00
alesapin
5a45265344 Create global dir 2019-09-10 17:32:32 +03:00
alesapin
65851e27d0 Fix freeze partition 2019-09-10 16:06:26 +03:00
alesapin
ac4ab3ca2b Fix rename bug 2019-09-10 15:23:18 +03:00
alesapin
189644e743 Better logging 2019-09-09 20:01:19 +03:00
alesapin
27419c965e Merge with master 2019-09-09 14:13:36 +03:00
alesapin
cfd753a1f3 Add test and found bugs 2019-09-06 18:09:20 +03:00
alesapin
ab518d7787 Split code to parts 2019-09-05 18:53:23 +03:00
alesapin
f576cbb8a4 Simplify code 2019-09-05 16:12:29 +03:00
alesapin
66362cedbc Refactoring 2019-09-04 21:26:18 +03:00
alesapin
c003f443f9 Refactor 2019-09-04 20:26:53 +03:00
alesapin
8d76febe02 Add moves to part log 2019-09-03 14:32:25 +03:00
alesapin
d08d99954f Ugly working code 2019-09-03 11:48:43 +03:00
alesapin
27b0a06005 Fix stupid bug 2019-09-03 11:30:59 +03:00
alesapin
e7ee9b7a67 Merge master 2019-09-02 11:46:00 +03:00
Guillaume Tassery
f727580483 Merge branch 'master' of https://github.com/yandex/ClickHouse into move_partition 2019-09-02 08:45:52 +02:00
alesapin
7382a9f3c3 Rename method for settings check 2019-09-01 00:15:40 +03:00
alesapin
2647d4ca15 Rename immutable to readonly 2019-08-30 23:12:26 +03:00
alesapin
6f30338c08 Fixes 2019-08-30 21:31:35 +03:00
alesapin
808f4d0b8a Intermediate refactoring 2019-08-30 19:50:59 +03:00
alesapin
d7e54d3c14 Merge branch 'master' of github.com:yandex/ClickHouse into ObjatieGroba-feature_multiple_disks 2019-08-30 12:53:24 +03:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
alesapin
702b47ae5b Remove redundant changes 2019-08-29 13:56:43 +03:00
alesapin
0899b3818d Remove redundant changes 2019-08-29 13:49:26 +03:00
alesapin
67f9753775 Merge branch 'master' into bad_size_of_marks_skip_idx_bug 2019-08-29 11:07:56 +03:00
alesapin
b4d98f6e13 Trying to fix vertical merge 2019-08-28 21:23:20 +03:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
alesapin
106b9717cd Refactoring of immutable settings 2019-08-27 16:14:19 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Guillaume Tassery
6f5969e1b5
Merge branch 'master' into move_partition 2019-08-27 15:54:21 +07:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00
alesapin
dff0cc1e1c Remove COW and add MultiVersion 2019-08-26 17:24:29 +03:00
Alexey Milovidov
60d660e263 Merge branch 'master' into merge-constraints 2019-08-26 16:13:44 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
alesapin
d2fe947535 Add test for race condition, found it and fix it 2019-08-21 15:32:48 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
d848009827 Fixed false data race in "MergeTreeDataPart::is_frozen" field 2019-08-21 06:16:59 +03:00
alesapin
e44ab4f4cd Add tests for partitions alter 2019-08-20 22:04:58 +03:00
alesapin
00bdd6c680 Support move partition 2019-08-20 12:59:19 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
alesapin
4ccdb8f92e Better code 2019-08-19 17:40:12 +03:00
alesapin
f2a8c18c1f Simplify lock 2019-08-19 14:18:58 +03:00
alesapin
6d29ed99d9 Fix bug with enable_mixed_granularity_parts and mutations 2019-08-19 13:37:04 +03:00
alesapin
a85cdc91a6 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-08-19 11:34:02 +03:00
alesapin
e7542810bb Merge with master 2019-08-19 11:20:48 +03:00
alesapin
defc1e30ca Some improvements 2019-08-16 18:57:19 +03:00
alesapin
f988ff538b Less code 2019-08-15 20:02:04 +03:00
Nikita Vasilev
00a5fe7836 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-15 19:48:57 +03:00
alesapin
d81961c4ca Fix strange code 2019-08-15 12:43:31 +03:00
alesapin
e391ce813d refactoring 2019-08-14 18:20:52 +03:00
alesapin
6a283b6bde Remove segfault 2019-08-14 14:59:45 +03:00
alesapin
949890ee90 Merged 2019-08-14 12:46:30 +03:00
alesapin
96f62fefcc Add mutex for settings 2019-08-13 19:34:52 +03:00
alesapin
f988090111 Remove redundant move 2019-08-13 15:10:58 +03:00
alesapin
b00903330f Remove empty block 2019-08-13 15:03:42 +03:00
alesapin
ad81c743c1 Buildable code 2019-08-13 13:29:31 +03:00
alesapin
428c753ed7 Merge with master 2019-08-13 11:37:47 +03:00
alesapin
8e72d4c2ec Tryin COW settings 2019-08-13 11:35:49 +03:00
Alexey Milovidov
fbaf6b9a4b Parallel loading of data parts #6074 2019-08-11 23:02:51 +03:00
Alexey Milovidov
0b1a4420cb More simple 2019-08-11 22:30:39 +03:00
Alexey Milovidov
006a5e51b7 Merge branch 'master' into speed-up-parts-removal 2019-08-11 22:26:24 +03:00
Alexey Milovidov
1cd87078c2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-11 22:24:53 +03:00
Alexey Milovidov
2f73b72007 Style 2019-08-11 22:24:42 +03:00
Alexey Milovidov
ed7db76c94 Speed-up parts removal #6372 2019-08-11 22:14:42 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
chertus
e06c994b0e refactoring: move collectUsedColumns from ExpressionAnalyzer to SyntaxAnalyzer 2019-08-09 17:50:04 +03:00
Alexander Tokmakov
ae6efb23b4 Merge branch 'master' into alter_table_drop_detached_part 2019-08-08 22:31:31 +03:00
alesapin
13e4581317 More general 2019-08-07 18:21:45 +03:00
Nikita Vasilev
90ce4608fb Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-06 21:07:13 +03:00
alesapin
e62101b8e8 Better comment 2019-08-06 19:29:31 +03:00
alesapin
ca29343f54 Uniq settings 2019-08-06 17:09:36 +03:00
alesapin
84fd4906ca Changes for engines 2019-08-06 16:04:29 +03:00
alesapin
52b9658bcf Merge with master 2019-08-06 15:55:12 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Igr Mineev
fc79ed86ef Ready for review 2019-08-01 13:29:14 +03:00
Alexander Tokmakov
f0836553d4 drop detached partition 2019-07-31 18:27:21 +03:00
Alexander Tokmakov
c6717e0d3f refactor attachPartition 2019-07-30 22:11:15 +03:00
Alexander Tokmakov
2f33df1b2e rename all parts before attaching 2019-07-30 20:24:40 +03:00
Igr Mineev
7f7b47fc0a Add check of RW access to paths on start. Add multiple disks tests. 2019-07-30 19:15:57 +03:00
Alexander Tokmakov
0fc47fbbe4 fixes 2019-07-29 13:27:37 +03:00
Nikita Vasilev
7efb1bcb12 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-07-27 10:30:43 +03:00
Guillaume Tassery
6fdedfc0e5 Cosmetic change for move partition feature 2019-07-26 12:04:28 +02:00
Guillaume Tassery
f52fed5cea Let the user able to move a partition to an another table 2019-07-26 10:42:17 +02:00