Commit Graph

855 Commits

Author SHA1 Message Date
Vladimir Chebotarev
13c5c621c1 Attempt to ignore redundant copies of parts after move and restart. 2019-12-09 23:29:44 +03:00
Alexander Burmak
edd11abad1 Addressed code review comments 2019-12-08 19:47:51 +03:00
Alexey Milovidov
060e4db596 Fixed build 2019-12-03 01:37:24 +03:00
Alexey Milovidov
8916b8f2e6 Make data skipping indices non-experimental. Make settings about data skipping indices, multiple JOINs and CROSS to INNER JOIN conversion obsolete, 2019-11-30 23:41:02 +03:00
Alexander Burmak
e5ffdc0224 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-11-29 18:27:56 +03:00
Nikolai Kochetov
7a32ca057d
Merge pull request #7670 from excitoon-favorites/move_pool
Separated pool for background moves
2019-11-29 11:08:51 +03:00
Alexander Burmak
3e5ef56644 Filesystem abstraction layer 2019-11-27 14:33:27 +03:00
Vladimir Chebotarev
c396af7c40 Removed check for using Date or DateTime column from TTL expressions. 2019-11-27 13:11:17 +03:00
Vladimir Chebotarev
37bebd1370 Improved BackgroundProcessingPool to use with background moves task. 2019-11-26 16:09:57 +03:00
Olga Khvostikova
47e499d71b
Merge pull request #7833 from excitoon-favorites/detachedparts
Added disk info to `system.detached_parts`
2019-11-26 11:56:50 +03:00
Vladimir Chebotarev
2b4f6af736 Fixed errors with space reservation introduced in #7558 and #7602. 2019-11-21 12:09:43 +03:00
Vladimir Chebotarev
5cbbcd9cdb Added disk info to system.detached_parts. 2019-11-19 09:44:10 +03:00
Guillaume Tassery
5994d551a6 rebase from master 2019-11-07 08:38:55 +01:00
alexey-milovidov
b261e6033a
Merge pull request #7602 from excitoon-favorites/cloneAndLoadDataPartOnSameDisk
Made `MergeTreeData::cloneAndLoadDataPart` only work for the same disk.
2019-11-04 14:42:30 +03:00
Vladimir Chebotarev
e76bbfc5ad Made MergeTreeData::cloneAndLoadDataPart only work for the same disk. 2019-11-04 01:27:05 +03:00
Alexander Burmak
9b8fc9a899 Fixed missing file name escaping in FREEZE command 2019-11-01 16:17:08 +03:00
Amos Bird
2c75a51d4f
Instant count() for MergeTree
Use (Replicated)MergeTree's metadata to do trivial count()
2019-10-29 17:45:47 +08:00
alesapin
5d8d1df802
Merge pull request #7434 from excitoon-favorites/fix-7424
Allowed to have some parts on destination disk or volume in MOVE PARTITION
2019-10-24 19:45:22 +03:00
Vladimir Chebotarev
64f158ff28 Fixed message for ALTER MOVE PART. 2019-10-24 13:56:32 +03:00
Vladimir Chebotarev
255da8f5e0 Fixed style. 2019-10-24 12:11:06 +03:00
Vladimir Chebotarev
3debdc2119 Added integration tests for ALTER MOVE PARTITION and fixed minor things. 2019-10-24 11:52:33 +03:00
Colum
a413770a97 Fixed spelling error in error message 2019-10-22 10:02:51 -07:00
Vladimir Chebotarev
9446fd2c4d Allowed to have some parts on destination disk or volume in MOVE PARTITION. #7424 2019-10-22 17:45:01 +03:00
Guillaume Tassery
552e3b8400 update 2019-10-22 08:03:49 +02:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Vladimir Chebotarev
512e97ddb3
Improved readability a little bit (MergeTreeData::getActiveContainingPart). 2019-10-16 22:01:50 +03:00
alesapin
4e83f65089 Fix bug with segmentation fault in ATTACH PART query 2019-10-03 21:07:47 +03:00
Guillaume Tassery
f54c90ccce Merge branch 'master' of github.com:PerformanceVision/ClickHouse into move_partition 2019-10-03 10:24:39 +02:00
Vladimir Chebotarev
e79a15c39c
Fixed time calculation in MergeTreeData. 2019-10-02 10:46:53 +03:00
Alexey Milovidov
42b739550b Renamed "storage_policy_name" to "storage_policy" 2019-09-20 23:35:50 +03:00
Guillaume Tassery
8920f36d96 merge master 2019-09-16 09:27:38 +02:00
alesapin
b0fce77c3d Fix path to data on disk 2019-09-11 20:17:10 +03:00
alesapin
0b8aec469f Make absolute path on disks start from /clickhouse/data, fix freeze and rename, add tests 2019-09-11 13:57:32 +03:00
alesapin
34a454aa62 Remove redundant code, that caused race for part object 2019-09-10 20:17:10 +03:00
alesapin
5a45265344 Create global dir 2019-09-10 17:32:32 +03:00
alesapin
65851e27d0 Fix freeze partition 2019-09-10 16:06:26 +03:00
alesapin
ac4ab3ca2b Fix rename bug 2019-09-10 15:23:18 +03:00
alesapin
189644e743 Better logging 2019-09-09 20:01:19 +03:00
alesapin
27419c965e Merge with master 2019-09-09 14:13:36 +03:00
alesapin
cfd753a1f3 Add test and found bugs 2019-09-06 18:09:20 +03:00
alesapin
ab518d7787 Split code to parts 2019-09-05 18:53:23 +03:00
alesapin
f576cbb8a4 Simplify code 2019-09-05 16:12:29 +03:00
alesapin
66362cedbc Refactoring 2019-09-04 21:26:18 +03:00
alesapin
c003f443f9 Refactor 2019-09-04 20:26:53 +03:00
alesapin
8d76febe02 Add moves to part log 2019-09-03 14:32:25 +03:00
alesapin
d08d99954f Ugly working code 2019-09-03 11:48:43 +03:00
alesapin
27b0a06005 Fix stupid bug 2019-09-03 11:30:59 +03:00
alesapin
e7ee9b7a67 Merge master 2019-09-02 11:46:00 +03:00
Guillaume Tassery
f727580483 Merge branch 'master' of https://github.com/yandex/ClickHouse into move_partition 2019-09-02 08:45:52 +02:00
alesapin
7382a9f3c3 Rename method for settings check 2019-09-01 00:15:40 +03:00
alesapin
2647d4ca15 Rename immutable to readonly 2019-08-30 23:12:26 +03:00
alesapin
6f30338c08 Fixes 2019-08-30 21:31:35 +03:00
alesapin
808f4d0b8a Intermediate refactoring 2019-08-30 19:50:59 +03:00
alesapin
d7e54d3c14 Merge branch 'master' of github.com:yandex/ClickHouse into ObjatieGroba-feature_multiple_disks 2019-08-30 12:53:24 +03:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
alesapin
702b47ae5b Remove redundant changes 2019-08-29 13:56:43 +03:00
alesapin
0899b3818d Remove redundant changes 2019-08-29 13:49:26 +03:00
alesapin
67f9753775 Merge branch 'master' into bad_size_of_marks_skip_idx_bug 2019-08-29 11:07:56 +03:00
alesapin
b4d98f6e13 Trying to fix vertical merge 2019-08-28 21:23:20 +03:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
alesapin
106b9717cd Refactoring of immutable settings 2019-08-27 16:14:19 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Guillaume Tassery
6f5969e1b5
Merge branch 'master' into move_partition 2019-08-27 15:54:21 +07:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00
alesapin
dff0cc1e1c Remove COW and add MultiVersion 2019-08-26 17:24:29 +03:00
Alexey Milovidov
60d660e263 Merge branch 'master' into merge-constraints 2019-08-26 16:13:44 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
alesapin
d2fe947535 Add test for race condition, found it and fix it 2019-08-21 15:32:48 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
d848009827 Fixed false data race in "MergeTreeDataPart::is_frozen" field 2019-08-21 06:16:59 +03:00
alesapin
e44ab4f4cd Add tests for partitions alter 2019-08-20 22:04:58 +03:00
alesapin
00bdd6c680 Support move partition 2019-08-20 12:59:19 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
alesapin
4ccdb8f92e Better code 2019-08-19 17:40:12 +03:00
alesapin
f2a8c18c1f Simplify lock 2019-08-19 14:18:58 +03:00
alesapin
6d29ed99d9 Fix bug with enable_mixed_granularity_parts and mutations 2019-08-19 13:37:04 +03:00
alesapin
a85cdc91a6 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-08-19 11:34:02 +03:00
alesapin
e7542810bb Merge with master 2019-08-19 11:20:48 +03:00
alesapin
defc1e30ca Some improvements 2019-08-16 18:57:19 +03:00
alesapin
f988ff538b Less code 2019-08-15 20:02:04 +03:00
Nikita Vasilev
00a5fe7836 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-15 19:48:57 +03:00
alesapin
d81961c4ca Fix strange code 2019-08-15 12:43:31 +03:00
alesapin
e391ce813d refactoring 2019-08-14 18:20:52 +03:00
alesapin
6a283b6bde Remove segfault 2019-08-14 14:59:45 +03:00
alesapin
949890ee90 Merged 2019-08-14 12:46:30 +03:00
alesapin
96f62fefcc Add mutex for settings 2019-08-13 19:34:52 +03:00
alesapin
f988090111 Remove redundant move 2019-08-13 15:10:58 +03:00
alesapin
b00903330f Remove empty block 2019-08-13 15:03:42 +03:00
alesapin
ad81c743c1 Buildable code 2019-08-13 13:29:31 +03:00
alesapin
428c753ed7 Merge with master 2019-08-13 11:37:47 +03:00
alesapin
8e72d4c2ec Tryin COW settings 2019-08-13 11:35:49 +03:00
Alexey Milovidov
fbaf6b9a4b Parallel loading of data parts #6074 2019-08-11 23:02:51 +03:00
Alexey Milovidov
0b1a4420cb More simple 2019-08-11 22:30:39 +03:00
Alexey Milovidov
006a5e51b7 Merge branch 'master' into speed-up-parts-removal 2019-08-11 22:26:24 +03:00
Alexey Milovidov
1cd87078c2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-11 22:24:53 +03:00
Alexey Milovidov
2f73b72007 Style 2019-08-11 22:24:42 +03:00
Alexey Milovidov
ed7db76c94 Speed-up parts removal #6372 2019-08-11 22:14:42 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
chertus
e06c994b0e refactoring: move collectUsedColumns from ExpressionAnalyzer to SyntaxAnalyzer 2019-08-09 17:50:04 +03:00
Alexander Tokmakov
ae6efb23b4 Merge branch 'master' into alter_table_drop_detached_part 2019-08-08 22:31:31 +03:00
alesapin
13e4581317 More general 2019-08-07 18:21:45 +03:00
Nikita Vasilev
90ce4608fb Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-06 21:07:13 +03:00
alesapin
e62101b8e8 Better comment 2019-08-06 19:29:31 +03:00
alesapin
ca29343f54 Uniq settings 2019-08-06 17:09:36 +03:00
alesapin
84fd4906ca Changes for engines 2019-08-06 16:04:29 +03:00
alesapin
52b9658bcf Merge with master 2019-08-06 15:55:12 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Igr Mineev
fc79ed86ef Ready for review 2019-08-01 13:29:14 +03:00
Alexander Tokmakov
f0836553d4 drop detached partition 2019-07-31 18:27:21 +03:00
Alexander Tokmakov
c6717e0d3f refactor attachPartition 2019-07-30 22:11:15 +03:00
Alexander Tokmakov
2f33df1b2e rename all parts before attaching 2019-07-30 20:24:40 +03:00
Igr Mineev
7f7b47fc0a Add check of RW access to paths on start. Add multiple disks tests. 2019-07-30 19:15:57 +03:00
Alexander Tokmakov
0fc47fbbe4 fixes 2019-07-29 13:27:37 +03:00
Nikita Vasilev
7efb1bcb12 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-07-27 10:30:43 +03:00
Guillaume Tassery
6fdedfc0e5 Cosmetic change for move partition feature 2019-07-26 12:04:28 +02:00
Guillaume Tassery
f52fed5cea Let the user able to move a partition to an another table 2019-07-26 10:42:17 +02:00
Alexander Tokmakov
1805ab5736 attach 2019-07-25 13:46:07 +03:00
alesapin
8a00ce5ff1 Intermediate step 2019-07-24 15:56:39 +03:00
Alexander Tokmakov
ad787938f5 better detached part name parsing 2019-07-23 22:43:33 +03:00
Igr
3e017ec69c
Merge branch 'master' into feature_multiple_disks 2019-07-23 16:38:20 +03:00
Igr Mineev
e967c23adb Add Space interface for reservation. Add move to volume command 2019-07-23 16:34:17 +03:00
Igr Mineev
52bca488dc Add alter move part command 2019-07-18 18:19:03 +03:00
Amos Bird
9fa955403b Optimize count()
Choose the smallest column to count if possible.
2019-07-17 02:29:17 +08:00
Igr Mineev
ad497fbaa1 Fix bug with duplication of parts on restart 2019-07-16 16:06:23 +03:00
Igr Mineev
21e0bec3d0 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-07-16 13:45:07 +03:00
Gleb Novikov
c1d91222d5 Ranamed setPrimaryKeyIndicesAndColumns to setProperties 2019-07-13 13:42:52 +03:00
Gleb Novikov
71c2ca0fe9 Merge branch 'master' into table-constraints 2019-07-04 22:40:00 +03:00
alexey-milovidov
50c22ef71a
Merge pull request #5628 from yandex/index_granularity_by_default
Enable adaptive index granularity by default
2019-07-03 02:15:33 +03:00
Gleb Novikov
a146b7383e Merge branch 'master' into table-constraints 2019-06-30 11:32:02 +02:00
chertus
f19dee706a move IColumn.isColumnConst() outside of interface 2019-06-27 22:28:52 +03:00
Nikita Vasilev
9873b04611 StringRef -> String (race cond) 2019-06-25 16:10:09 +03:00
Nikita Vasilev
7b7517ff85 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-24 16:44:44 +03:00
Igr Mineev
23049ac9e8 Add mergetree part move in background. 2019-06-19 20:56:41 +03:00
alesapin
dd37370aab Fix test and add one 2019-06-19 19:16:13 +03:00
alesapin
fefce49c8f Mixed parts by setting 2019-06-19 17:46:06 +03:00
alesapin
d1de7431e1 Compilable 2019-06-19 13:26:26 +03:00
alesapin
b544b62e44 A log of bugs 2019-06-19 13:07:56 +03:00
alesapin
4f98f875c3
Add ability to write final mark for *MergeTree engines family (#5624)
Add the ability to write final mark to *MergeTree engines family.
2019-06-18 15:54:27 +03:00
alesapin
0bfb7b18ce Fix directory check 2019-06-18 14:38:04 +03:00
alesapin
fb22200890 Fix name hidding and stupid bug 2019-06-17 18:35:53 +03:00
alesapin
9e7d23b22e Style fix 2019-06-17 16:29:10 +03:00
alesapin
3a4dcfbacd Fix inconsistency in zookeeper metadata and disable adaptive granularity for old format 2019-06-17 13:34:25 +03:00
alesapin
e73cdbae90 Fix name hidding 2019-06-17 12:22:44 +03:00
alesapin
02af85411c Merge branch 'master' into index_granularity_by_default 2019-06-17 12:02:03 +03:00