Commit Graph

896 Commits

Author SHA1 Message Date
alexey-milovidov
b261e6033a
Merge pull request #7602 from excitoon-favorites/cloneAndLoadDataPartOnSameDisk
Made `MergeTreeData::cloneAndLoadDataPart` only work for the same disk.
2019-11-04 14:42:30 +03:00
Vladimir Chebotarev
e76bbfc5ad Made MergeTreeData::cloneAndLoadDataPart only work for the same disk. 2019-11-04 01:27:05 +03:00
Alexander Burmak
9b8fc9a899 Fixed missing file name escaping in FREEZE command 2019-11-01 16:17:08 +03:00
CurtizJ
35b7363802 polymorphic parts (development) 2019-10-31 17:44:17 +03:00
Amos Bird
2c75a51d4f
Instant count() for MergeTree
Use (Replicated)MergeTree's metadata to do trivial count()
2019-10-29 17:45:47 +08:00
alesapin
5d8d1df802
Merge pull request #7434 from excitoon-favorites/fix-7424
Allowed to have some parts on destination disk or volume in MOVE PARTITION
2019-10-24 19:45:22 +03:00
Vladimir Chebotarev
64f158ff28 Fixed message for ALTER MOVE PART. 2019-10-24 13:56:32 +03:00
Vladimir Chebotarev
255da8f5e0 Fixed style. 2019-10-24 12:11:06 +03:00
Vladimir Chebotarev
3debdc2119 Added integration tests for ALTER MOVE PARTITION and fixed minor things. 2019-10-24 11:52:33 +03:00
Colum
a413770a97 Fixed spelling error in error message 2019-10-22 10:02:51 -07:00
Vladimir Chebotarev
9446fd2c4d Allowed to have some parts on destination disk or volume in MOVE PARTITION. #7424 2019-10-22 17:45:01 +03:00
Guillaume Tassery
552e3b8400 update 2019-10-22 08:03:49 +02:00
CurtizJ
8df8bcea94 polymorphic parts (development) 2019-10-21 18:33:59 +03:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Vladimir Chebotarev
512e97ddb3
Improved readability a little bit (MergeTreeData::getActiveContainingPart). 2019-10-16 22:01:50 +03:00
CurtizJ
8ba37da2ef polymorphic parts (development) 2019-10-16 21:27:53 +03:00
CurtizJ
b433add65c polymorphic parts (development) 2019-10-10 19:30:30 +03:00
alesapin
4e83f65089 Fix bug with segmentation fault in ATTACH PART query 2019-10-03 21:07:47 +03:00
Guillaume Tassery
f54c90ccce Merge branch 'master' of github.com:PerformanceVision/ClickHouse into move_partition 2019-10-03 10:24:39 +02:00
Vladimir Chebotarev
e79a15c39c
Fixed time calculation in MergeTreeData. 2019-10-02 10:46:53 +03:00
Alexey Milovidov
42b739550b Renamed "storage_policy_name" to "storage_policy" 2019-09-20 23:35:50 +03:00
Guillaume Tassery
8920f36d96 merge master 2019-09-16 09:27:38 +02:00
alesapin
b0fce77c3d Fix path to data on disk 2019-09-11 20:17:10 +03:00
alesapin
0b8aec469f Make absolute path on disks start from /clickhouse/data, fix freeze and rename, add tests 2019-09-11 13:57:32 +03:00
alesapin
34a454aa62 Remove redundant code, that caused race for part object 2019-09-10 20:17:10 +03:00
alesapin
5a45265344 Create global dir 2019-09-10 17:32:32 +03:00
alesapin
65851e27d0 Fix freeze partition 2019-09-10 16:06:26 +03:00
alesapin
ac4ab3ca2b Fix rename bug 2019-09-10 15:23:18 +03:00
alesapin
189644e743 Better logging 2019-09-09 20:01:19 +03:00
alesapin
27419c965e Merge with master 2019-09-09 14:13:36 +03:00
alesapin
cfd753a1f3 Add test and found bugs 2019-09-06 18:09:20 +03:00
alesapin
ab518d7787 Split code to parts 2019-09-05 18:53:23 +03:00
alesapin
f576cbb8a4 Simplify code 2019-09-05 16:12:29 +03:00
alesapin
66362cedbc Refactoring 2019-09-04 21:26:18 +03:00
alesapin
c003f443f9 Refactor 2019-09-04 20:26:53 +03:00
alesapin
8d76febe02 Add moves to part log 2019-09-03 14:32:25 +03:00
alesapin
d08d99954f Ugly working code 2019-09-03 11:48:43 +03:00
alesapin
27b0a06005 Fix stupid bug 2019-09-03 11:30:59 +03:00
alesapin
e7ee9b7a67 Merge master 2019-09-02 11:46:00 +03:00
Guillaume Tassery
f727580483 Merge branch 'master' of https://github.com/yandex/ClickHouse into move_partition 2019-09-02 08:45:52 +02:00
alesapin
7382a9f3c3 Rename method for settings check 2019-09-01 00:15:40 +03:00
alesapin
2647d4ca15 Rename immutable to readonly 2019-08-30 23:12:26 +03:00
alesapin
6f30338c08 Fixes 2019-08-30 21:31:35 +03:00
alesapin
808f4d0b8a Intermediate refactoring 2019-08-30 19:50:59 +03:00
alesapin
d7e54d3c14 Merge branch 'master' of github.com:yandex/ClickHouse into ObjatieGroba-feature_multiple_disks 2019-08-30 12:53:24 +03:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
alesapin
702b47ae5b Remove redundant changes 2019-08-29 13:56:43 +03:00
alesapin
0899b3818d Remove redundant changes 2019-08-29 13:49:26 +03:00
alesapin
67f9753775 Merge branch 'master' into bad_size_of_marks_skip_idx_bug 2019-08-29 11:07:56 +03:00
alesapin
b4d98f6e13 Trying to fix vertical merge 2019-08-28 21:23:20 +03:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
alesapin
106b9717cd Refactoring of immutable settings 2019-08-27 16:14:19 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Guillaume Tassery
6f5969e1b5
Merge branch 'master' into move_partition 2019-08-27 15:54:21 +07:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00
alesapin
dff0cc1e1c Remove COW and add MultiVersion 2019-08-26 17:24:29 +03:00
Alexey Milovidov
60d660e263 Merge branch 'master' into merge-constraints 2019-08-26 16:13:44 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
alesapin
d2fe947535 Add test for race condition, found it and fix it 2019-08-21 15:32:48 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
d848009827 Fixed false data race in "MergeTreeDataPart::is_frozen" field 2019-08-21 06:16:59 +03:00
alesapin
e44ab4f4cd Add tests for partitions alter 2019-08-20 22:04:58 +03:00
alesapin
00bdd6c680 Support move partition 2019-08-20 12:59:19 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
alesapin
4ccdb8f92e Better code 2019-08-19 17:40:12 +03:00
alesapin
f2a8c18c1f Simplify lock 2019-08-19 14:18:58 +03:00
alesapin
6d29ed99d9 Fix bug with enable_mixed_granularity_parts and mutations 2019-08-19 13:37:04 +03:00
alesapin
a85cdc91a6 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-08-19 11:34:02 +03:00
alesapin
e7542810bb Merge with master 2019-08-19 11:20:48 +03:00
alesapin
defc1e30ca Some improvements 2019-08-16 18:57:19 +03:00
alesapin
f988ff538b Less code 2019-08-15 20:02:04 +03:00
Nikita Vasilev
00a5fe7836 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-15 19:48:57 +03:00
alesapin
d81961c4ca Fix strange code 2019-08-15 12:43:31 +03:00
alesapin
e391ce813d refactoring 2019-08-14 18:20:52 +03:00
alesapin
6a283b6bde Remove segfault 2019-08-14 14:59:45 +03:00
alesapin
949890ee90 Merged 2019-08-14 12:46:30 +03:00
alesapin
96f62fefcc Add mutex for settings 2019-08-13 19:34:52 +03:00
alesapin
f988090111 Remove redundant move 2019-08-13 15:10:58 +03:00
alesapin
b00903330f Remove empty block 2019-08-13 15:03:42 +03:00
alesapin
ad81c743c1 Buildable code 2019-08-13 13:29:31 +03:00
alesapin
428c753ed7 Merge with master 2019-08-13 11:37:47 +03:00
alesapin
8e72d4c2ec Tryin COW settings 2019-08-13 11:35:49 +03:00
Alexey Milovidov
fbaf6b9a4b Parallel loading of data parts #6074 2019-08-11 23:02:51 +03:00
Alexey Milovidov
0b1a4420cb More simple 2019-08-11 22:30:39 +03:00
Alexey Milovidov
006a5e51b7 Merge branch 'master' into speed-up-parts-removal 2019-08-11 22:26:24 +03:00
Alexey Milovidov
1cd87078c2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-11 22:24:53 +03:00
Alexey Milovidov
2f73b72007 Style 2019-08-11 22:24:42 +03:00
Alexey Milovidov
ed7db76c94 Speed-up parts removal #6372 2019-08-11 22:14:42 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
chertus
e06c994b0e refactoring: move collectUsedColumns from ExpressionAnalyzer to SyntaxAnalyzer 2019-08-09 17:50:04 +03:00
Alexander Tokmakov
ae6efb23b4 Merge branch 'master' into alter_table_drop_detached_part 2019-08-08 22:31:31 +03:00
alesapin
13e4581317 More general 2019-08-07 18:21:45 +03:00
Nikita Vasilev
90ce4608fb Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-06 21:07:13 +03:00
alesapin
e62101b8e8 Better comment 2019-08-06 19:29:31 +03:00
alesapin
ca29343f54 Uniq settings 2019-08-06 17:09:36 +03:00
alesapin
84fd4906ca Changes for engines 2019-08-06 16:04:29 +03:00
alesapin
52b9658bcf Merge with master 2019-08-06 15:55:12 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Igr Mineev
fc79ed86ef Ready for review 2019-08-01 13:29:14 +03:00
Alexander Tokmakov
f0836553d4 drop detached partition 2019-07-31 18:27:21 +03:00
Alexander Tokmakov
c6717e0d3f refactor attachPartition 2019-07-30 22:11:15 +03:00
Alexander Tokmakov
2f33df1b2e rename all parts before attaching 2019-07-30 20:24:40 +03:00
Igr Mineev
7f7b47fc0a Add check of RW access to paths on start. Add multiple disks tests. 2019-07-30 19:15:57 +03:00
Alexander Tokmakov
0fc47fbbe4 fixes 2019-07-29 13:27:37 +03:00
Nikita Vasilev
7efb1bcb12 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-07-27 10:30:43 +03:00
Guillaume Tassery
6fdedfc0e5 Cosmetic change for move partition feature 2019-07-26 12:04:28 +02:00
Guillaume Tassery
f52fed5cea Let the user able to move a partition to an another table 2019-07-26 10:42:17 +02:00
Alexander Tokmakov
1805ab5736 attach 2019-07-25 13:46:07 +03:00
alesapin
8a00ce5ff1 Intermediate step 2019-07-24 15:56:39 +03:00
Alexander Tokmakov
ad787938f5 better detached part name parsing 2019-07-23 22:43:33 +03:00
Igr
3e017ec69c
Merge branch 'master' into feature_multiple_disks 2019-07-23 16:38:20 +03:00
Igr Mineev
e967c23adb Add Space interface for reservation. Add move to volume command 2019-07-23 16:34:17 +03:00
Igr Mineev
52bca488dc Add alter move part command 2019-07-18 18:19:03 +03:00
Amos Bird
9fa955403b Optimize count()
Choose the smallest column to count if possible.
2019-07-17 02:29:17 +08:00
Igr Mineev
ad497fbaa1 Fix bug with duplication of parts on restart 2019-07-16 16:06:23 +03:00
Igr Mineev
21e0bec3d0 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-07-16 13:45:07 +03:00
Gleb Novikov
c1d91222d5 Ranamed setPrimaryKeyIndicesAndColumns to setProperties 2019-07-13 13:42:52 +03:00
Gleb Novikov
71c2ca0fe9 Merge branch 'master' into table-constraints 2019-07-04 22:40:00 +03:00
alexey-milovidov
50c22ef71a
Merge pull request #5628 from yandex/index_granularity_by_default
Enable adaptive index granularity by default
2019-07-03 02:15:33 +03:00
Gleb Novikov
a146b7383e Merge branch 'master' into table-constraints 2019-06-30 11:32:02 +02:00
chertus
f19dee706a move IColumn.isColumnConst() outside of interface 2019-06-27 22:28:52 +03:00
Nikita Vasilev
9873b04611 StringRef -> String (race cond) 2019-06-25 16:10:09 +03:00
Nikita Vasilev
7b7517ff85 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-24 16:44:44 +03:00
Igr Mineev
23049ac9e8 Add mergetree part move in background. 2019-06-19 20:56:41 +03:00
alesapin
dd37370aab Fix test and add one 2019-06-19 19:16:13 +03:00
alesapin
fefce49c8f Mixed parts by setting 2019-06-19 17:46:06 +03:00
alesapin
d1de7431e1 Compilable 2019-06-19 13:26:26 +03:00
alesapin
b544b62e44 A log of bugs 2019-06-19 13:07:56 +03:00
alesapin
4f98f875c3
Add ability to write final mark for *MergeTree engines family (#5624)
Add the ability to write final mark to *MergeTree engines family.
2019-06-18 15:54:27 +03:00
alesapin
0bfb7b18ce Fix directory check 2019-06-18 14:38:04 +03:00
alesapin
fb22200890 Fix name hidding and stupid bug 2019-06-17 18:35:53 +03:00
alesapin
9e7d23b22e Style fix 2019-06-17 16:29:10 +03:00
alesapin
3a4dcfbacd Fix inconsistency in zookeeper metadata and disable adaptive granularity for old format 2019-06-17 13:34:25 +03:00
alesapin
e73cdbae90 Fix name hidding 2019-06-17 12:22:44 +03:00
alesapin
02af85411c Merge branch 'master' into index_granularity_by_default 2019-06-17 12:02:03 +03:00
Alexey Milovidov
e3b21be1bb Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:02:45 +03:00
Alexey Milovidov
0ad13ca3d1 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:59:30 +03:00
Alexey Milovidov
b494d17ca6 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:32:52 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
alesapin
22026e0333 Enable adaptive index granularity by default 2019-06-14 18:39:21 +03:00
Igr Mineev
842c72bb6d Merge branch 'master' into feature_multiple_disks 2019-06-09 15:38:54 +03:00
Igr Mineev
0eba56c4a7 Added move command. 2019-06-07 22:16:42 +03:00
Gleb Novikov
e7293486bd Added ALTER TABLE support to constraints (ADD CONSTRAINT, DROP CONSTRAINT) 2019-06-02 17:41:12 +03:00
Gleb Novikov
2b5cf46842 Merge branch 'master' into table-constraints 2019-06-02 08:33:36 +03:00
proller
1b0d1a4450 Info about frozen parts in system.parts (#5471)
* wip

*    wip

* wip

* Clean

* fix test

* clean

* fix test

* fix test
2019-05-31 07:03:46 +03:00
Gleb Novikov
337897c4b8 Merge branch 'master' into table-constraints 2019-05-26 12:36:02 +03:00
Igor Mineev
15ee6207ab Chg 'Schema' to 'StoragePolicy'. Add system.disks. Add system.storage_politics. Add disk to system.parts. Add policy to system.tables. 2019-05-24 22:03:07 +03:00
Igor Mineev
4f61c9d30f Const Schema fix 2019-05-22 22:20:10 +03:00
Igor Mineev
a209f45f62 Add keep_free_space_ratio param 2019-05-21 20:57:17 +03:00
Igor Mineev
320d509b42 Fix default data path 2019-05-21 20:27:43 +03:00
Alexander Kuzmenkov
43655a8db7 Add system.detached_parts table.
https://github.com/yandex/ClickHouse/issues/5164
2019-05-21 15:06:36 +03:00
Gleb Novikov
ce93896608 Added constraints description to MergeTree and related storages 2019-05-18 11:05:52 +03:00
Igor Mineev
74466de6d8 Minor fixes. 2019-05-13 23:58:22 +03:00
Igor Mineev
af300c667b Bugfix 2019-05-11 23:44:43 +03:00
Igor Mineev
b4b000bf84 Merge branch 'master' into feature_multiple_disks 2019-05-11 21:50:29 +03:00
ivan-kush
ab6558b8b4 add spaces amp 2019-05-10 17:34:02 +03:00
Ivan Kush
2a356791ab Merge branch 'master' into feat/parallel-alter-modify 2019-05-07 23:53:14 +03:00
Nikita Vasilev
85564c3a84 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-05 14:34:10 +03:00
Alexey Milovidov
b2443f6aa6 Removed huge chunk of bad code 2019-05-04 06:45:58 +03:00
Alexey Milovidov
ad355897f7 Removed huge chunk of bad code 2019-05-03 05:09:41 +03:00
Alexey Milovidov
a6ca9f266f Removed huge chunk of bad code 2019-05-03 05:00:57 +03:00
Alexey Milovidov
0a8e888671 Fixed bad code 2019-05-03 03:26:46 +03:00
Alexey Milovidov
9537ff0594 Miscellaneous 2019-05-03 01:51:39 +03:00
alexey-milovidov
0dd0611873
Merge pull request #5173 from yandex/rename-method
Rename method for consistency
2019-05-03 00:58:51 +03:00
ivan-kush
9ce742e040 Merge remote-tracking branch 'upstream/master' into feat/parallel-alter-modify 2019-05-03 00:25:56 +03:00
Alexey Milovidov
270a31abb5 Rename method for consistency 2019-05-02 19:07:23 +03:00
Alexey Milovidov
6a271adad3 Added max_parts_in_total threshold to MergeTree tables 2019-05-02 17:48:54 +03:00
ivan-kush
3ecb66d965 debug stress address 2019-05-02 16:42:09 +03:00
ivan-kush
6ac5aa5e49 restart performance 2019-05-01 18:46:17 +03:00
Ivan Kushnarenko
e38f6e08d8 debug tsan refactor trash 2019-05-01 13:26:49 +03:00
Igor Mineev
e7faa04726 Fix. 2019-04-28 17:49:41 +03:00
Igor Mineev
8edcae5530 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-04-24 15:35:08 +03:00
Igor Mineev
e4c8467b49 Default disk initialization bug fix. Stylefix. 2019-04-21 23:23:02 +03:00
Igor Mineev
79abe85328 New data path: disk_path + db_name + table_name. Removed default path from MergeTree Constructor 2019-04-21 21:38:44 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212)
Add TTL for columns and tables.
2019-04-15 12:30:45 +03:00
Nikita Vasilev
20f0b17cf4 mutations 2019-04-10 20:44:39 +03:00
Igor Mineev
d05c23bd1d Clang build fix. 2019-04-06 18:21:29 +03:00
Igor Mineev
563ab2a5ec Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-04-05 23:07:24 +03:00
Igor Mineev
2d805679ae Stylefixes. 2019-04-05 22:58:59 +03:00
Igor Mineev
3a38b16da1 Add rename MergeTreeData function. Add shared_ptr to disks in Volumes. 2019-04-05 22:45:59 +03:00
Igor Mineev
968b7286e2 Stylefixes. 2019-04-05 20:37:27 +03:00
Igor Mineev
e426f3bd4c MergeTree schema settings 2019-04-05 16:04:03 +03:00
Igor Mineev
0b1a33c722 Format file moved to default. Add default Storage configuration 2019-04-05 15:30:26 +03:00
Igor Mineev
7824aa528f Add Schemes to config. Parse scheme as default on MergeTreeData init 2019-04-04 20:19:11 +03:00
Igor Mineev
341e3f1c5b Add space reservation for each new MargeTreeDataPart. 2019-04-03 15:52:09 +03:00
Igor Mineev
8047d16a96 Add Path chooser. Add DiskMonitort multiple disks support 2019-04-01 21:41:19 +03:00
alesapin
7b67200258 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-01 11:54:19 +03:00
alesapin
78e09a221a Remove debug prints, little refactoring 2019-03-30 17:43:43 +03:00
Alexey Milovidov
34c0682353 Removed useless method 2019-03-29 11:37:05 +03:00
Alexey Milovidov
350a0fe129 Miscellaneous 2019-03-28 22:58:41 +03:00
alesapin
5332642fee CI Fails fixes and little performance improvement 2019-03-28 11:52:09 +03:00
alesapin
e449760fde Remove debug print 2019-03-27 19:50:01 +03:00
alesapin
aba51a11ba Large refactoring (only compilable) 2019-03-25 16:55:24 +03:00