Commit Graph

5982 Commits

Author SHA1 Message Date
Alexey Milovidov
2084d26238 Removed useless code, added comments 2020-01-08 13:20:55 +03:00
Guillaume Tassery
d176abb7c0 Check the storage policy of table on the move partition table 2020-01-08 10:57:27 +01:00
Guillaume Tassery
4a04a1a2ec Merge branch 'master' of github.com:ClickHouse/ClickHouse into move_partition 2020-01-08 08:11:53 +01:00
Vladimir Chebotarev
6f2a4bf5ce Added fallback behavior of reserving space on a volumes with smaller indices when volumes with greater or equal indices are full. 2020-01-07 22:26:14 +03:00
Javi santana bot
776ceeb427 Wait only on optimize commands 2020-01-07 19:16:37 +01:00
Alexey Milovidov
8432cbb5c6 Removed debug output 2020-01-07 15:26:44 +03:00
Vladimir Chebotarev
7de9eb4bdc Do not allow to merge data moving it against storage policy volume order. 2020-01-07 10:17:11 +03:00
Guillaume Tassery
8b2938a8fb
Merge branch 'master' into move_partition 2020-01-07 13:25:35 +07:00
Vitaliy Zakaznikov
f0d2ef5bf7 Removing tabs. 2020-01-06 08:23:05 -05:00
Alexey Milovidov
31f4fd0e4b Fixed test 2020-01-05 23:11:26 +03:00
Alexey Milovidov
5620fb1561 Added tests 2020-01-05 10:22:08 +03:00
Alexey Milovidov
9a6531fc1c Workaround for bug in zlib-ng; using zlib level 3 by default 2020-01-05 09:39:40 +03:00
Alexey Milovidov
ba6a56a485 Added a comment 2020-01-05 08:45:13 +03:00
Alexey Milovidov
ac163ce6c6 Added method "truncate" to StorageFile 2020-01-05 05:57:09 +03:00
Nikolai Kochetov
63014126c2 Support reading from DirectoryMonitor. 2020-01-04 21:37:31 +03:00
Nikolai Kochetov
f094e8f565 Support reading from DirectoryMonitor. 2020-01-04 21:33:16 +03:00
Nikolai Kochetov
cf7b16d333 Support reading from DirectoryMonitor. 2020-01-04 21:05:42 +03:00
Nikolai Kochetov
253c6cd59a Support reading from DirectoryMonitor. 2020-01-04 20:45:56 +03:00
Alexey Milovidov
46c37f2c94 Merge branch 'master' into general-compression-rework 2020-01-04 20:45:45 +03:00
alexey-milovidov
00ba767f5d Merge pull request #8318 from excitoon-favorites/replicatedalterttl
Fixed ALTER TTL for replicated tables
2020-01-04 20:42:39 +03:00
Nikolai Kochetov
5869d6708b Support reading from DirectoryMonitor. 2020-01-04 17:45:11 +03:00
Alexey Milovidov
0f4a58ecaa Removed bad code around general compression methods 2020-01-04 10:31:00 +03:00
alexey-milovidov
42226b1a96
Added setting "min_bytes_to_use_mmap_io" (#8520)
* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io": better error message

* Added setting "min_bytes_to_use_mmap_io": fixed error
2020-01-04 08:46:50 +03:00
Nikolai Kochetov
d884ab4318
Merge pull request #7792 from vzakaznikov/live_view_support_for_subquery
Live view support for subquery
2020-01-03 15:49:44 +03:00
Vitaliy Zakaznikov
25458a4865 Updates to make all live view tests to pass. 2020-01-03 02:48:15 +01:00
Vitaliy Zakaznikov
2c4bf0581f Fixing compilation errors. 2020-01-02 20:31:04 +01:00
Vitaliy Zakaznikov
d43eae2db8 First changes. 2020-01-02 12:24:55 -05:00
Alexander Burmak
70b3a1a0d8 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2020-01-02 18:01:41 +03:00
Alexander Burmak
05869e6049 Addressed review comments 2020-01-02 17:37:31 +03:00
zhang2014
9364397597 try fix some predicate optimizer bug 2020-01-02 21:14:48 +08:00
Alexey Milovidov
67afaa9d93 Stack trace for every exception (experimental) 2020-01-02 09:56:53 +03:00
Vitaliy Zakaznikov
d0f7a2f3da Fixing styling error. 2020-01-01 18:01:43 -05:00
Vitaliy Zakaznikov
aeeb4457ed Updates to simply extractDependentTable 2020-01-01 23:57:18 +01:00
Vitaliy Zakaznikov
00d5997612 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into live_view_support_for_subquery 2020-01-01 17:59:59 +01:00
Vitaliy Zakaznikov
2e36fd417d Adding changes from https://github.com/ClickHouse/ClickHouse/pull/8217 2020-01-01 11:44:45 -05:00
alexey-milovidov
14563da602
Merge pull request #8447 from amosbird/c++20
C++20
2019-12-31 21:06:41 +03:00
alexey-milovidov
fdcf971dce
Merge pull request #8486 from amosbird/betterprewhere
Add prewhere test
2019-12-31 21:01:12 +03:00
alexey-milovidov
e712b22dda
Merge pull request #8484 from ClickHouse/obsolete-mark-cache-min-lifetime
Make "mark_cache_min_lifetime" setting obsolete
2019-12-31 20:56:54 +03:00
Amos Bird
05a420ab20
Add prewhere test 2019-12-31 16:09:37 +08:00
alexey-milovidov
3adf6853d5
Merge pull request #7769 from amosbird/betterprewhere
Optimize PREWHERE
2019-12-31 09:07:02 +03:00
alexey-milovidov
17b413fd2e
Merge pull request #8458 from vitlibar/separate-variables-for-database-and-name
Separate variables for database and name in dictionaries.
2019-12-31 07:39:01 +03:00
Alexey Milovidov
3339b8e0e5 Make "mark_cache_min_lifetime" setting obsolete 2019-12-31 05:47:10 +03:00
alexey-milovidov
fc41fc7b9d
Merge pull request #8479 from 4ertus2/joins
Fix crash in StorageJoin (add restriction)
2019-12-31 03:02:55 +03:00
Vitaly Baranov
037eb85972 Automatic removing of config repositories to simplify the code. 2019-12-31 06:30:27 +07:00
alexey-milovidov
6c10fc5578
Update StorageJoin.cpp 2019-12-31 00:30:25 +03:00
alexey-milovidov
96c9567449
Update StorageJoin.cpp 2019-12-30 23:24:02 +03:00
chertus
928057c71f better fix 2019-12-30 23:08:03 +03:00
chertus
6b80ba52be fix crash in StorageJoin (add restriction) 2019-12-30 22:43:40 +03:00
Alexander Tokmakov
3687900848 Merge branch 'master' into table_name_in_istorage 2019-12-30 21:30:24 +03:00
Alexander Tokmakov
f19bb041b4 add asserts on invalid StorageID 2019-12-30 21:20:43 +03:00
alesapin
55c47106d4
Merge pull request #8456 from ClickHouse/refactor_alter_addition
Refactor alter addition
2019-12-30 17:50:34 +03:00
Alexander Tokmakov
250f170a69 Merge branch 'master' into table_name_in_istorage 2019-12-30 14:08:09 +03:00
alexey-milovidov
458f596e18
Merge pull request #8455 from amosbird/perfformat
Perf test format io without disk
2019-12-30 02:45:52 +03:00
Amos Bird
84c7589c9a
whitelist /dev/null in StorageFile 2019-12-30 02:37:55 +08:00
Vitaly Baranov
1fa64a2a86 Use separate variables for the database and name in dictionaries. 2019-12-29 23:48:10 +07:00
alesapin
e95fbecf03 Lock structure by default for generic alter implementation 2019-12-29 19:34:32 +03:00
alexey-milovidov
1b47aec9b5
Merge branch 'master' into enable_use_minimalistic_part_header_in_zookeeper 2019-12-29 19:30:34 +03:00
alesapin
44370467f0 More comments 2019-12-29 14:25:26 +03:00
alesapin
247906a4d7 Move check alter to alter interpreter 2019-12-29 14:09:10 +03:00
alesapin
9ee7807f45 Remove redundant file 2019-12-29 14:04:42 +03:00
alexey-milovidov
15c67f0a0e
Merge branch 'master' into refactor_databases 2019-12-29 03:52:07 +03:00
alexey-milovidov
6830d7fa2d
Merge pull request #8440 from excitoon-favorites/bettercheckforpartsonanotherdisks
Improved check for parts on different disks
2019-12-29 00:10:47 +03:00
Amos Bird
bbc736f2d9
c++20! 2019-12-29 03:08:25 +08:00
alesapin
9c42801c94 Fix stupid bug 2019-12-28 12:21:09 +03:00
Vladimir Chebotarev
1ad0c92873 Fixed logic error introduced in previous commit. 2019-12-28 10:30:12 +03:00
CurtizJ
ccb15e6332 better granularity computing 2019-12-28 00:32:55 +03:00
CurtizJ
74d5c6edc7 better writer for compact parts 2019-12-28 00:17:53 +03:00
alesapin
c48f892e13 Merge with master 2019-12-27 23:12:54 +03:00
alesapin
fef681acfe Fix style 2019-12-27 23:10:30 +03:00
Alexander Tokmakov
94931f059d minor improvements 2019-12-27 22:30:22 +03:00
alesapin
5334103690 More usage of StorageInMemoryMetadata 2019-12-27 22:04:30 +03:00
Vladimir Chebotarev
3c2ddc5a81 Improved check for parts on different disks. 2019-12-27 21:58:59 +03:00
Alexey Milovidov
cb3a5b26f7 Merge branch 'master' into enable-experimental-indices-and-make-settings-obsolete 2019-12-27 21:12:30 +03:00
alesapin
2d40b33120 More usage of metadata 2019-12-27 19:34:50 +03:00
alesapin
fcf3552750 Better changes 2019-12-27 18:07:53 +03:00
alesapin
d610bb215a Remove cerr 2019-12-27 18:05:23 +03:00
alesapin
166c1da6c9 Removed redundat changes 2019-12-27 18:03:49 +03:00
alesapin
7ad59edf8f Slightly more comments 2019-12-27 18:01:41 +03:00
alesapin
6916ac08c2 Rename fields 2019-12-27 17:46:11 +03:00
alesapin
716648bfa4 Something working 2019-12-27 17:36:59 +03:00
Ivan Lezhankin
bf22e12e4e Initial replacement readline → replxx 2019-12-27 16:17:36 +03:00
Alexander Tokmakov
a2a155dcbd Merge branch 'master' into table_name_in_istorage 2019-12-27 15:47:29 +03:00
chertus
3e13157994 better engine Join tests 2019-12-27 15:41:55 +03:00
Alexander Tokmakov
8987b027ba fixes 2019-12-27 15:18:49 +03:00
Alexander Burmak
9df9983641 Added fileName and parentPath utility functions 2019-12-27 13:42:30 +03:00
alesapin
ccb4ad450c Merge branch 'master' into refactor_alter 2019-12-27 12:07:20 +03:00
Alexander Burmak
170bcf041a Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2019-12-27 09:55:54 +03:00
Vitaly Baranov
b75771be61
Merge pull request #7808 from vitlibar/RBAC-3
RBAC-3
2019-12-27 09:44:24 +07:00
alexey-milovidov
d021d5e0ec
Merge pull request #8419 from apbodrov/url_fix
[ISSUE-8157] incorrect parsing of file extension in URL
2019-12-27 02:25:39 +03:00
alexey-milovidov
d2e5827307
Merge pull request #8410 from excitoon-favorites/ttlcheckvaliddeestination
Added check for valid destination in a move TTL rule
2019-12-27 00:29:55 +03:00
alexey-milovidov
89eeaa50e9
Merge branch 'master' into enable-experimental-indices-and-make-settings-obsolete 2019-12-26 22:16:50 +03:00
alexey-milovidov
1adc3cfb88
Merge pull request #8118 from excitoon-favorites/scan_all_disks
Check extra parts of `MergeTree` at different disks, in order to not allow to miss data parts at undefined disks
2019-12-26 22:10:53 +03:00
alexey-milovidov
938100dbe2
Update MergeTreeData.cpp 2019-12-26 22:10:04 +03:00
alesapin
d341b648d2 Better alter 2019-12-26 21:17:05 +03:00
Alexander Tokmakov
42296cc80a remove separate getTableName() and getDatabaseName() 2019-12-26 21:11:49 +03:00
Alexander Tokmakov
ef129b4b7c use StorageID in views 2019-12-26 20:59:47 +03:00
Alexander Tokmakov
9319863a59 refactor table dependencies 2019-12-26 20:23:24 +03:00
Alexander Tokmakov
2e5d61cd81 better constructors of storages 2019-12-26 20:04:08 +03:00
Andrei Bodrov
1516a252ee one line 2019-12-26 19:51:17 +03:00
Alexander Burmak
682b72551f Fixed merge issues 2019-12-26 19:38:10 +03:00
Alexander Tokmakov
cf5c998b30 refactor storage name 2019-12-26 19:23:38 +03:00
Artem Zuikov
b282cbcc91
Merge pull request #8400 from 4ertus2/joins
New ANY JOIN + SEMI, ANTI JOIN for StorageJoin
2019-12-26 18:35:50 +03:00
Vladimir Chebotarev
64b2b18d5b Added a check for bad disk/volume as a destination of move TTL expression. 2019-12-26 18:04:55 +03:00
Alexander Burmak
3f1832355f Added WriteMode enumeration 2019-12-26 17:28:22 +03:00
Alexander Burmak
764b506fd5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2019-12-26 17:03:32 +03:00
Alexander Tokmakov
50200e245b Merge branch 'master' into refactor_databases 2019-12-26 15:00:07 +03:00
alesapin
6f28e69e97
Merge pull request #8345 from azat/fix-flaky-test--Buffer_and_max_memory_usage
Fix buffer overcommit and 01019_Buffer_and_max_memory_usage flakiness
2019-12-26 13:21:47 +03:00
alesapin
093d56f474
Merge pull request #8382 from ClickHouse/relative_paths_in_storages
Use relative paths in Storages
2019-12-26 13:05:37 +03:00
Vladimir Chebotarev
c4e9784464 Fixed skipping parts algorithm while checking parts on other disks. 2019-12-26 01:12:17 +03:00
Vladimir Chebotarev
ab5171f403 Fixed tests. 2019-12-25 23:32:15 +03:00
Vladimir Chebotarev
29068663ea Fixed build. 2019-12-25 23:32:15 +03:00
Vladimir Chebotarev
80056551ce Check extra parts of MergeTree at different disks, in order to not allow to miss data parts at undefined disks. 2019-12-25 23:32:15 +03:00
CurtizJ
0b99df9aed better column initialization in data parts 2019-12-25 23:06:16 +03:00
CurtizJ
c298616eac reduce number of seeks in ReaderCompact 2019-12-25 20:34:23 +03:00
chertus
4fd7340416 New ANY JOIN for StorageJoin + SEMI, ANTI 2019-12-25 20:32:55 +03:00
CurtizJ
aadb948c09 temporarly store all parts in compact format 2019-12-25 20:08:12 +03:00
Alexander Tokmakov
7c48396689 refactor databases: inherit from DatabaseOnDisk 2019-12-25 16:23:38 +03:00
CurtizJ
c8393f2c8b fix mutations with mixed-granularity parts 2019-12-25 16:05:46 +03:00
alesapin
3b6e3db0c2 Remove redundant alter_lock, because parts cannot be altered concurrently. 2019-12-25 15:34:04 +03:00
alesapin
d4987f86d3 Merge branch 'master' into immutable_parts 2019-12-25 11:44:47 +03:00
Alexander Burmak
544bfd105b Corrected naming based on review feedback 2019-12-25 11:24:13 +03:00
CurtizJ
4bd4ac715c Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2019-12-25 03:10:24 +03:00
CurtizJ
206cb1afa9 fix broken by refactoring functionality with wide parts 2019-12-25 01:49:39 +03:00
alesapin
34d2afa354 Fix obvious bug 2019-12-24 23:03:33 +03:00
Nikolai Kochetov
6a1dccd27c Change initialization order for StorageDistributedDirectoryMonitor members. 2019-12-24 21:25:00 +03:00
alesapin
05b933b1d3 Better 2019-12-24 21:07:51 +03:00
Alexander Tokmakov
6325f8507c fixes 2019-12-24 20:41:24 +03:00
Alexander Tokmakov
60a47c3453 Merge branch 'master' into relative_paths_in_storages 2019-12-24 19:58:34 +03:00
tavplubix
7c1a6c726d
Merge pull request #8359 from ClickHouse/more_readable_interpreter_create
Refactor table creation
2019-12-24 18:07:43 +03:00
Alexander Tokmakov
514868cebc use relative paths in IStorage::rename(...) 2019-12-24 16:35:50 +03:00
Alexander Burmak
97f03ab064 Fixed CI errors 2019-12-24 13:25:14 +03:00
alexey-milovidov
28c7e78d36
Merge pull request #8344 from ClickHouse/system-stack-trace
Added system.stack_trace table.
2019-12-24 12:15:48 +03:00
Alexander Tokmakov
ac3f53f300 refactor StorageFile construction 2019-12-23 23:07:31 +03:00
Alexey Milovidov
3b7f3b07cd Better handling of signals 2019-12-23 22:23:54 +03:00
Alexey Milovidov
e907ce103e Fixed warning 2019-12-23 21:58:42 +03:00
Alexey Milovidov
9da4b63fe9 Fixed Darwin build 2019-12-23 21:56:57 +03:00
Alexey Milovidov
56870c6b3b Fixed -Wshadow 2019-12-23 19:49:06 +03:00
alesapin
25ecc38615 More correct separation between metadata and data alters for non replicated MergeTree. 2019-12-23 19:44:50 +03:00
Alexander Tokmakov
5fab732408 use arbitrary relative path in *MergeTree 2019-12-23 18:37:55 +03:00
Alexander Tokmakov
4f58d662f7 make data path relative 2019-12-23 18:20:08 +03:00
alesapin
73c9f0e71c Remove redundant code 2019-12-23 17:46:00 +03:00
alesapin
f168977b9a Merge branch 'master' into synchronous_mutations 2019-12-23 16:24:50 +03:00
Alexander Burmak
0894ed9f33 Integration of log storages with IDisk interface 2019-12-23 16:11:56 +03:00
Azat Khuzhin
58055e6a94 Do not overcommit Buffer memory usage
During INSERT the check against existing rows and rows from the INSERT
block is performed and if they exceeded threshold the Buffer should be
flushed to avoid overcommit, while before this patch the second check
(in flushBuffer()) will ignore rows from INSERT block.
2019-12-23 01:39:37 +03:00
Alexey Milovidov
4d349e9ed0 Added TODO 2019-12-23 00:01:12 +03:00
Alexey Milovidov
ca25e2f30f Added query_id to "system.stack_trace" 2019-12-22 23:37:29 +03:00
Alexey Milovidov
9c868c910a Simplification 2019-12-22 23:17:16 +03:00
Alexey Milovidov
e0000bef98 Added "system.stack_trace" table (development) 2019-12-22 20:20:33 +03:00
alexey-milovidov
fee9fda34c
Merge pull request #8130 from CurtizJ/optimize-storage-merge
Implement ORDER BY optimization for Storage Merge.
2019-12-22 12:43:18 +03:00
alexey-milovidov
980cf16873
Merge pull request #8323 from ClickHouse/minor-improvements-backquote
Added quoting of db and table names where appropriate
2019-12-20 22:14:35 +03:00
alexey-milovidov
0d119a40eb
Merge pull request #8240 from vitlibar/sync-system-reload-dictionary
Synchronous system reload dictionary
2019-12-20 20:00:03 +03:00
Alexey Milovidov
41ed1ed471 Added quoting of db and table names where appropriate 2019-12-20 19:53:37 +03:00
proller
521e2e709e Build fixes. Arm, minimal build 2019-12-20 17:46:00 +03:00
CurtizJ
75c5e02ec2 improve input order analyzing and turn on order by optimization with left/inner joins 2019-12-20 16:15:17 +03:00
Alexander Tokmakov
10ad22faea refactor InterpreterCreateQuery::createTable(...) 2019-12-20 15:51:51 +03:00
alexey-milovidov
7f10630873
Merge pull request #8308 from ClickHouse/deprecate-merge_tree_uniform_read_distribution
Deprecate "merge_tree_uniform_read_distribution" setting
2019-12-20 15:28:34 +03:00
Javi santana bot
dd5435501a check for active replicas when waiting for commands 2019-12-20 11:04:16 +01:00
alexey-milovidov
de01dd12b5
Merge pull request #8306 from ClickHouse/fix_rename_distributed
Fix rename distributed
2019-12-20 04:38:21 +03:00
Alexey Milovidov
0ac868ed48 Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 04:11:37 +03:00
Alexey Milovidov
371aef532c Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 02:49:41 +03:00
Alexey Milovidov
9ce8d5fe54 Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 01:38:05 +03:00
chertus
b5658ef1a3 remove qualification in StorageJoin JOIN case 2019-12-19 23:37:10 +03:00
Alexander Tokmakov
d1568c1614 fix rename distributed 2019-12-19 22:51:12 +03:00
chertus
c72b0d4e2a fix engine join crash [wip] 2019-12-19 18:50:28 +03:00
Vitaly Baranov
6baccb963d Add functions currentRowPolicies() and system table 'system.row_policies'. 2019-12-19 18:40:15 +03:00
alesapin
0cc7ccfc2e Remove unintended diff 2019-12-19 18:30:52 +03:00
alesapin
9fea941009 Make wait endless 2019-12-19 18:27:56 +03:00
CurtizJ
ba2a630a13 merging with master 2019-12-19 16:10:57 +03:00
alesapin
88033a4333 Merge branch 'master' into synchronous_mutations 2019-12-19 15:44:02 +03:00
CurtizJ
9db2f2ccbc Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2019-12-19 14:46:43 +03:00
alexey-milovidov
f5a16b1229
Update KeyCondition.cpp 2019-12-18 22:04:33 +03:00
alexey-milovidov
b5cab7c721
Update KeyCondition.cpp 2019-12-18 22:03:57 +03:00
Alexey Milovidov
90795b7d4b Added asserts to KeyCondition while evaluating RPN 2019-12-18 22:00:09 +03:00
CurtizJ
258e8d61fb polymorphic parts (development) cleanup 2019-12-18 19:41:11 +03:00
CurtizJ
6f673407ff polymorphic parts (development) cleanup 2019-12-18 19:27:49 +03:00
CurtizJ
55b7db716a polymorphic parts (development) cleanup 2019-12-18 18:54:45 +03:00
CurtizJ
ae74d28f87 polymorphic parts (development) fix alter 2019-12-18 17:23:27 +03:00
CurtizJ
59faa4927b polymorphic parts (development) alter update 2019-12-18 16:09:58 +03:00
alesapin
f110b70ad8 Merge branch 'master' into synchronous_mutations 2019-12-18 12:00:14 +03:00
alexey-milovidov
a7384b4d07
Merge branch 'master' into MoreGCCWarnings 2019-12-18 02:01:39 +03:00
alesapin
9a005d27ea Merge branch 'master' into synchronous_mutations 2019-12-17 15:27:36 +03:00
alesapin
b2979546c3 Fix mutation number by default 2019-12-17 15:23:17 +03:00
Vitaly Baranov
d0d5c72e4d Reloading of a dictionary now waits for results and shows errors.
Clearer names for load and reload functions in ExternalLoader.
2019-12-17 13:45:47 +03:00
Guillaume Tassery
bdcee8b382 Merge branch 'master' of github.com:ClickHouse/ClickHouse into move_partition 2019-12-17 11:18:11 +01:00
Olga Khvostikova
b47863a0c6
Fix segfault in table function file while inserting into it (#8177)
* Fix segfault in table function file while inserting into it
2019-12-17 11:06:39 +03:00
Guillaume Tassery
de9ab66935 fix merge conflict 2019-12-17 08:20:54 +01:00
Guillaume Tassery
595815bdf5 Add table as part destination type 2019-12-17 07:51:40 +01:00
Guillaume Tassery
dca0c83809
Merge branch 'master' into move_partition 2019-12-17 13:49:18 +07:00
Vxider
f564d524e5 parallel insert support for ReplicatedMergeTree 2019-12-17 12:22:58 +08:00
Vxider
2a94832ef6 parallel INSERT in INSERT SELECT query 2019-12-17 12:22:58 +08:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
alesapin
2695aa13c4 Add ability to execute mutations asynchronously 2019-12-16 18:51:15 +03:00
CurtizJ
831f39a3df polymorphic parts (development) alter 2019-12-16 17:51:19 +03:00
alexey-milovidov
d0ef4b6b96
Merge branch 'master' into more-accurate-using-load-reload 2019-12-16 02:42:45 +03:00
Vitaliy Zakaznikov
cf22cde702 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into live_view_support_for_subquery 2019-12-14 19:21:44 +01:00
Vitaliy Zakaznikov
0f9450433f * Reverting back to the old logic.
* Removing redundant catch clauses.
* Updating createStorage function signature in StorageBlocks.h.
2019-12-14 18:29:34 +01:00
Nikolai Kochetov
28fcc6902f Try to simplify code in StorageLiveView 2019-12-13 20:08:21 +03:00
Mikhail Filimonov
f3fa71c707 Init query context for Kafka to make subqueries work 2019-12-13 02:21:40 +01:00
alexey-milovidov
399995d60b
Merge pull request #7812 from infinivision/fix_part_mutation
fix part mutation
2019-12-13 03:45:59 +03:00
alexey-milovidov
d0cf282204
Merge pull request #8179 from ClickHouse/parts_to_do_names
Add parts_to_do_names column to system.mutations.
2019-12-13 02:30:03 +03:00
alexey-milovidov
69535078fd
Merge pull request #8192 from excitoon-favorites/better-logging-disks
Better logging in background move task.
2019-12-13 02:27:38 +03:00
alexey-milovidov
32f42c4e92
Merge pull request #8194 from excitoon-favorites/fixed-move-pool
Fixed metrics in `BackgroundProcessingPool`
2019-12-13 02:26:52 +03:00
Artem Zuikov
5783142f39
Merge pull request #8178 from 4ertus2/some
Refactoring: extract getTableExpressions() variants into own file
2019-12-13 01:09:47 +03:00
Vladimir Chebotarev
e413cd6e6c Fixed metrics in BackgroundProcessingPool. 2019-12-13 01:08:54 +03:00
Vladimir Chebotarev
9882c7c5ad Minor fix in logging. 2019-12-13 00:38:05 +03:00
Vladimir Chebotarev
9393bb0f12 Better logging in background move task. 2019-12-13 00:34:57 +03:00
CurtizJ
26d159e889 polymorphic parts (development) alter 2019-12-12 21:55:19 +03:00
Vitaly Baranov
4c157007f5 Refactoring of using ExternalLoader in dictionary DDL:
Instead of using ExternalLoader::reload() now it's used reloadConfig() which reloads only what necessary.
Functions attachDictionary() and detachDictionary() are simplified and have lesser number of parameters.
Instead of injecting into LoadablesConfigReader's internals for creating dictionary a temp repository is used.
2019-12-12 21:45:58 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration
AWS SDK S3 integration
2019-12-12 20:43:16 +03:00
alesapin
b7622c8fd9 Add parts_to_do_names column to system.mutations 2019-12-12 19:24:03 +03:00
chertus
68a33863ab extract getTableExpressions variants into own file 2019-12-12 19:06:18 +03:00
Alexander Burmak
1f69a7a015 Fixed merge issues 2019-12-12 14:10:18 +03:00
Alexander Burmak
2ce6136de5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-12 12:10:50 +03:00
CurtizJ
890bfeb4eb fix order description analyzing 2019-12-11 21:52:59 +03:00
Pavel Kovalenko
c7f016fc4e AWS SDK integration - code cleanup. 2019-12-11 17:21:48 +03:00
CurtizJ
6834fbf03d implement ORDER BY optimization for some other meta-storages 2019-12-11 16:09:46 +03:00
alesapin
2940aeff23 Fix style 2019-12-11 13:24:20 +03:00
alesapin
fd9483efbe Just trigger CI 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0ff0a52249 Missed review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f2aee64072 Minor style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e41deb5848 Added comment to MergeTreePartsMover::selectPartsForMove(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7fd1668fde Review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e3ed311273 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
67aa268bbb Finally fixed tests and logic for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f83b28a1c1 Fixed a typo in MergeTreeData::selectMoveDestination(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
618a39cc8c Don't move anything if part already belongs their destination. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f72da4ab0c Removing expired rows shall not be triggered on move TTL expiration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
8ed37801ca Finally fixed selection of destination of move TTL. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
15fb64f54b Fixed move TTL expiration logic. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
df002f20b1 Fixed move TTL metadata. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
14cf530542 Added move TTL rules to metadata of ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7407f7c39d Placed move TTL rules to a vector. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
108e2b33eb Fixed a bug with erasing columns with same name. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0da7234d99 Added few FIXMEs to not forget. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce851fc782 Fixed MergeTreeData::hasTableTTL() method according to extended TTLs. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cb777f6c50 Removed redundant template from updateTTL() method. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
62016feab0 Renamed TTLDestinationType to PartDestinationType. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc0c21604f Fixed Clang build one more time. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce066d3bb0 Style fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
88c7220256 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e3e9ac56f Moved settings for BackgroundProcessingPool to configuration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e519c04bbe Minor fix of JSON handling in MergeTreeDataPartTTLInfo. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
342ea5c30a Removed TODO comments. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1 Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
dfe0edc03f Style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
76c4ac9f60 Fixed ttl move logic in background move task and added ttl enforcement on inserts. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
575de5ada6 Attempt to add background moves by TTL expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
893e0de37a Minor fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
33ded274a3 First attempt to store min/max for move ttl expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e984609fb Fixed ClickHouse after changing syntax. 2019-12-11 13:24:20 +03:00