Commit Graph

5661 Commits

Author SHA1 Message Date
Alexander Tokmakov
514868cebc use relative paths in IStorage::rename(...) 2019-12-24 16:35:50 +03:00
alexey-milovidov
28c7e78d36
Merge pull request #8344 from ClickHouse/system-stack-trace
Added system.stack_trace table.
2019-12-24 12:15:48 +03:00
Alexander Tokmakov
ac3f53f300 refactor StorageFile construction 2019-12-23 23:07:31 +03:00
Alexey Milovidov
3b7f3b07cd Better handling of signals 2019-12-23 22:23:54 +03:00
Alexey Milovidov
e907ce103e Fixed warning 2019-12-23 21:58:42 +03:00
Alexey Milovidov
9da4b63fe9 Fixed Darwin build 2019-12-23 21:56:57 +03:00
Alexey Milovidov
56870c6b3b Fixed -Wshadow 2019-12-23 19:49:06 +03:00
alesapin
25ecc38615 More correct separation between metadata and data alters for non replicated MergeTree. 2019-12-23 19:44:50 +03:00
Alexander Tokmakov
5fab732408 use arbitrary relative path in *MergeTree 2019-12-23 18:37:55 +03:00
Alexander Tokmakov
4f58d662f7 make data path relative 2019-12-23 18:20:08 +03:00
alesapin
73c9f0e71c Remove redundant code 2019-12-23 17:46:00 +03:00
alesapin
f168977b9a Merge branch 'master' into synchronous_mutations 2019-12-23 16:24:50 +03:00
Azat Khuzhin
58055e6a94 Do not overcommit Buffer memory usage
During INSERT the check against existing rows and rows from the INSERT
block is performed and if they exceeded threshold the Buffer should be
flushed to avoid overcommit, while before this patch the second check
(in flushBuffer()) will ignore rows from INSERT block.
2019-12-23 01:39:37 +03:00
Alexey Milovidov
4d349e9ed0 Added TODO 2019-12-23 00:01:12 +03:00
Alexey Milovidov
ca25e2f30f Added query_id to "system.stack_trace" 2019-12-22 23:37:29 +03:00
Alexey Milovidov
9c868c910a Simplification 2019-12-22 23:17:16 +03:00
Alexey Milovidov
e0000bef98 Added "system.stack_trace" table (development) 2019-12-22 20:20:33 +03:00
alexey-milovidov
fee9fda34c
Merge pull request #8130 from CurtizJ/optimize-storage-merge
Implement ORDER BY optimization for Storage Merge.
2019-12-22 12:43:18 +03:00
alexey-milovidov
980cf16873
Merge pull request #8323 from ClickHouse/minor-improvements-backquote
Added quoting of db and table names where appropriate
2019-12-20 22:14:35 +03:00
alexey-milovidov
0d119a40eb
Merge pull request #8240 from vitlibar/sync-system-reload-dictionary
Synchronous system reload dictionary
2019-12-20 20:00:03 +03:00
Alexey Milovidov
41ed1ed471 Added quoting of db and table names where appropriate 2019-12-20 19:53:37 +03:00
proller
521e2e709e Build fixes. Arm, minimal build 2019-12-20 17:46:00 +03:00
CurtizJ
75c5e02ec2 improve input order analyzing and turn on order by optimization with left/inner joins 2019-12-20 16:15:17 +03:00
Alexander Tokmakov
10ad22faea refactor InterpreterCreateQuery::createTable(...) 2019-12-20 15:51:51 +03:00
alexey-milovidov
7f10630873
Merge pull request #8308 from ClickHouse/deprecate-merge_tree_uniform_read_distribution
Deprecate "merge_tree_uniform_read_distribution" setting
2019-12-20 15:28:34 +03:00
Javi santana bot
dd5435501a check for active replicas when waiting for commands 2019-12-20 11:04:16 +01:00
alexey-milovidov
de01dd12b5
Merge pull request #8306 from ClickHouse/fix_rename_distributed
Fix rename distributed
2019-12-20 04:38:21 +03:00
Alexey Milovidov
0ac868ed48 Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 04:11:37 +03:00
Alexey Milovidov
371aef532c Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 02:49:41 +03:00
Alexey Milovidov
9ce8d5fe54 Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 01:38:05 +03:00
chertus
b5658ef1a3 remove qualification in StorageJoin JOIN case 2019-12-19 23:37:10 +03:00
Alexander Tokmakov
d1568c1614 fix rename distributed 2019-12-19 22:51:12 +03:00
chertus
c72b0d4e2a fix engine join crash [wip] 2019-12-19 18:50:28 +03:00
Vitaly Baranov
6baccb963d Add functions currentRowPolicies() and system table 'system.row_policies'. 2019-12-19 18:40:15 +03:00
alesapin
0cc7ccfc2e Remove unintended diff 2019-12-19 18:30:52 +03:00
alesapin
9fea941009 Make wait endless 2019-12-19 18:27:56 +03:00
alesapin
88033a4333 Merge branch 'master' into synchronous_mutations 2019-12-19 15:44:02 +03:00
alexey-milovidov
f5a16b1229
Update KeyCondition.cpp 2019-12-18 22:04:33 +03:00
alexey-milovidov
b5cab7c721
Update KeyCondition.cpp 2019-12-18 22:03:57 +03:00
Alexey Milovidov
90795b7d4b Added asserts to KeyCondition while evaluating RPN 2019-12-18 22:00:09 +03:00
alesapin
f110b70ad8 Merge branch 'master' into synchronous_mutations 2019-12-18 12:00:14 +03:00
alexey-milovidov
a7384b4d07
Merge branch 'master' into MoreGCCWarnings 2019-12-18 02:01:39 +03:00
alesapin
9a005d27ea Merge branch 'master' into synchronous_mutations 2019-12-17 15:27:36 +03:00
alesapin
b2979546c3 Fix mutation number by default 2019-12-17 15:23:17 +03:00
Vitaly Baranov
d0d5c72e4d Reloading of a dictionary now waits for results and shows errors.
Clearer names for load and reload functions in ExternalLoader.
2019-12-17 13:45:47 +03:00
Olga Khvostikova
b47863a0c6
Fix segfault in table function file while inserting into it (#8177)
* Fix segfault in table function file while inserting into it
2019-12-17 11:06:39 +03:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
alesapin
2695aa13c4 Add ability to execute mutations asynchronously 2019-12-16 18:51:15 +03:00
alexey-milovidov
d0ef4b6b96
Merge branch 'master' into more-accurate-using-load-reload 2019-12-16 02:42:45 +03:00
Vitaliy Zakaznikov
cf22cde702 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into live_view_support_for_subquery 2019-12-14 19:21:44 +01:00
Vitaliy Zakaznikov
0f9450433f * Reverting back to the old logic.
* Removing redundant catch clauses.
* Updating createStorage function signature in StorageBlocks.h.
2019-12-14 18:29:34 +01:00
Nikolai Kochetov
28fcc6902f Try to simplify code in StorageLiveView 2019-12-13 20:08:21 +03:00
Mikhail Filimonov
f3fa71c707 Init query context for Kafka to make subqueries work 2019-12-13 02:21:40 +01:00
alexey-milovidov
399995d60b
Merge pull request #7812 from infinivision/fix_part_mutation
fix part mutation
2019-12-13 03:45:59 +03:00
alexey-milovidov
d0cf282204
Merge pull request #8179 from ClickHouse/parts_to_do_names
Add parts_to_do_names column to system.mutations.
2019-12-13 02:30:03 +03:00
alexey-milovidov
69535078fd
Merge pull request #8192 from excitoon-favorites/better-logging-disks
Better logging in background move task.
2019-12-13 02:27:38 +03:00
alexey-milovidov
32f42c4e92
Merge pull request #8194 from excitoon-favorites/fixed-move-pool
Fixed metrics in `BackgroundProcessingPool`
2019-12-13 02:26:52 +03:00
Artem Zuikov
5783142f39
Merge pull request #8178 from 4ertus2/some
Refactoring: extract getTableExpressions() variants into own file
2019-12-13 01:09:47 +03:00
Vladimir Chebotarev
e413cd6e6c Fixed metrics in BackgroundProcessingPool. 2019-12-13 01:08:54 +03:00
Vladimir Chebotarev
9882c7c5ad Minor fix in logging. 2019-12-13 00:38:05 +03:00
Vladimir Chebotarev
9393bb0f12 Better logging in background move task. 2019-12-13 00:34:57 +03:00
Vitaly Baranov
4c157007f5 Refactoring of using ExternalLoader in dictionary DDL:
Instead of using ExternalLoader::reload() now it's used reloadConfig() which reloads only what necessary.
Functions attachDictionary() and detachDictionary() are simplified and have lesser number of parameters.
Instead of injecting into LoadablesConfigReader's internals for creating dictionary a temp repository is used.
2019-12-12 21:45:58 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration
AWS SDK S3 integration
2019-12-12 20:43:16 +03:00
alesapin
b7622c8fd9 Add parts_to_do_names column to system.mutations 2019-12-12 19:24:03 +03:00
chertus
68a33863ab extract getTableExpressions variants into own file 2019-12-12 19:06:18 +03:00
Alexander Burmak
1f69a7a015 Fixed merge issues 2019-12-12 14:10:18 +03:00
Alexander Burmak
2ce6136de5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-12 12:10:50 +03:00
CurtizJ
890bfeb4eb fix order description analyzing 2019-12-11 21:52:59 +03:00
Pavel Kovalenko
c7f016fc4e AWS SDK integration - code cleanup. 2019-12-11 17:21:48 +03:00
CurtizJ
6834fbf03d implement ORDER BY optimization for some other meta-storages 2019-12-11 16:09:46 +03:00
alesapin
2940aeff23 Fix style 2019-12-11 13:24:20 +03:00
alesapin
fd9483efbe Just trigger CI 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0ff0a52249 Missed review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f2aee64072 Minor style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e41deb5848 Added comment to MergeTreePartsMover::selectPartsForMove(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7fd1668fde Review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e3ed311273 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
67aa268bbb Finally fixed tests and logic for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f83b28a1c1 Fixed a typo in MergeTreeData::selectMoveDestination(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
618a39cc8c Don't move anything if part already belongs their destination. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f72da4ab0c Removing expired rows shall not be triggered on move TTL expiration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
8ed37801ca Finally fixed selection of destination of move TTL. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
15fb64f54b Fixed move TTL expiration logic. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
df002f20b1 Fixed move TTL metadata. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
14cf530542 Added move TTL rules to metadata of ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7407f7c39d Placed move TTL rules to a vector. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
108e2b33eb Fixed a bug with erasing columns with same name. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0da7234d99 Added few FIXMEs to not forget. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce851fc782 Fixed MergeTreeData::hasTableTTL() method according to extended TTLs. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cb777f6c50 Removed redundant template from updateTTL() method. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
62016feab0 Renamed TTLDestinationType to PartDestinationType. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc0c21604f Fixed Clang build one more time. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce066d3bb0 Style fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
88c7220256 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e3e9ac56f Moved settings for BackgroundProcessingPool to configuration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e519c04bbe Minor fix of JSON handling in MergeTreeDataPartTTLInfo. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
342ea5c30a Removed TODO comments. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1 Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
dfe0edc03f Style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
76c4ac9f60 Fixed ttl move logic in background move task and added ttl enforcement on inserts. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
575de5ada6 Attempt to add background moves by TTL expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
893e0de37a Minor fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
33ded274a3 First attempt to store min/max for move ttl expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e984609fb Fixed ClickHouse after changing syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7a37c4f6a9 Parser for extended TTL expressions. 2019-12-11 13:24:20 +03:00
Alexey Milovidov
4f9cd8a3c8 Update contributors 2019-12-11 06:13:33 +03:00
CurtizJ
fd5b23730e implement order by optimization for storage Merge 2019-12-11 04:35:47 +03:00
CurtizJ
45a9751c31 refactoring of order by optimization 2019-12-11 04:34:39 +03:00
Zhichang Yu
ff1b8d46e2 fixed part mutation, added test_backup_restore integration test case 2019-12-11 09:31:37 +08:00
CurtizJ
9e75892516 refactoring of order by optimization 2019-12-11 02:18:24 +03:00
Vladimir Chebotarev
269a0246aa Added explicit check for existence of part and pair of log messages. 2019-12-10 12:47:23 +03:00
Vladimir Chebotarev
6afd8d7805 Added test_multiple_disk::test_kill_while_insert, reworked log message and fixed logic of treating stale copies. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
a2f238d8da Added more logging and switched to detaching stale part instead of removing. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
9cf7ef03af Fixed handling of MergeTreeData::DataPartPtr's in MergeTreeData::swapActivePart(). 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
374e0f7bb5 Finally fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
c283776e84 Really fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
89659a9129 Fixed a typo. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
fe3e89fb38 Fixed tests. 2019-12-09 23:29:44 +03:00
filimonov
f545da40e6 style 2019-12-09 23:29:44 +03:00
filimonov
0ab67c7b1f Log when part is removed after move 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
efa73608b8 Separated constant path to DeleteOnDestroy marker. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
13c5c621c1 Attempt to ignore redundant copies of parts after move and restart. 2019-12-09 23:29:44 +03:00
Alexander Burmak
5a93441445 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-09 17:18:47 +03:00
Pavel Kovalenko
ba59991912 AWS SDK integration - added new lines at the end of files. 2019-12-09 15:36:06 +03:00
Pavel Kovalenko
94e9638006 AWS SDK integration added url checking. 2019-12-09 13:58:57 +03:00
alexey-milovidov
cf194edfaf
Merge pull request #8016 from filimonov/kafka_fixes
Kafka fixes
2019-12-09 00:03:36 +03:00
alexey-milovidov
ee7d675f86
Update KafkaBlockInputStream.cpp 2019-12-09 00:03:09 +03:00
alexey-milovidov
16754bfff5
Merge pull request #8043 from excitoon-favorites/systemmergespaths
Added information about paths to `system.merges`.
2019-12-08 23:30:39 +03:00
Alexander Burmak
edd11abad1 Addressed code review comments 2019-12-08 19:47:51 +03:00
Alexander Burmak
8104395dd2 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-08 11:45:18 +03:00
alesapin
af7b8f9274
Merge pull request #8051 from ClickHouse/fix_collations_behaviour
Fix several bugs with collations.
2019-12-08 11:10:23 +03:00
Vladimir Chebotarev
984e81876a Fixed Clang build. 2019-12-07 22:30:37 +03:00
Vladimir Chebotarev
1fbfb50fba Fixed updating result_part_path while merging and mutating. 2019-12-07 12:54:05 +03:00
Vladimir Chebotarev
05a05b5fb6 Fixed result_part_part of a mutation. 2019-12-07 11:10:08 +03:00
alesapin
3881a85c39 Review fixes 2019-12-07 01:22:12 +03:00
Pavel Kovalenko
c840fdefc0 Merge branch 'master' into aws-s3-sdk-integration
# Conflicts:
#	dbms/src/Common/ErrorCodes.cpp
#	dbms/src/IO/ReadBufferFromS3.cpp
#	dbms/src/IO/ReadBufferFromS3.h
#	dbms/src/IO/WriteBufferFromS3.cpp
#	dbms/src/IO/WriteBufferFromS3.h
#	dbms/src/Storages/StorageS3.cpp
2019-12-06 17:52:29 +03:00
alexey-milovidov
3d279499d0
Merge pull request #7632 from hczhcz/patch-2
Allow relative user_files_path
2019-12-06 17:44:18 +03:00
Pavel Kovalenko
a9dfefd37f AWS SDK integration rework. 2019-12-06 17:37:21 +03:00
robot-clickhouse
6d56509109 Auto version update to [19.19.1.1] [54430] 2019-12-06 17:22:00 +03:00
Vitaly Baranov
8bd9709d1d
Merge pull request #8044 from vitlibar/simplify-format-of-header-of-distributed-send
Simplify format of the header of data sent to a shard in a distributed query.
2019-12-06 15:46:00 +03:00
Vitaliy Zakaznikov
435ce84939 Setting table alias when replacing subquery with a table.
Adding extra tests that use table aliases.
2019-12-06 13:31:08 +01:00
Mikhail Filimonov
4e4957e052 returning allowNext() to the proper position 2019-12-06 12:22:36 +01:00
Vitaly Baranov
2133492598
Merge pull request #7257 from vitlibar/RBAC-2
RBAC-2
2019-12-06 03:19:39 +03:00
Vitaliy Zakaznikov
ae3749d764 Fixing clang error in dbms/src/Storages/LiveView/StorageBlocks.h 2019-12-05 19:08:40 -05:00
Vitaliy Zakaznikov
2d6645cc1b Fixing clang error. 2019-12-05 17:04:55 -05:00
Vitaliy Zakaznikov
613c343c09 Fixing styling issues. 2019-12-05 16:48:25 -05:00
Vitaliy Zakaznikov
32fe9ea9d5 Fixing issue with support for nested subqueries.
Adding additional live view with subquery tests.
2019-12-05 22:42:00 +01:00
Mikhail Filimonov
7d760a964d Fix for timestamp & style 2019-12-05 22:21:15 +01:00
alesapin
6afafef86c
Merge pull request #8047 from ClickHouse/fix_check_query_again
Fix bug in checkDataPart
2019-12-05 21:31:36 +03:00
Vitaly Baranov
d9b1a733fc Add table system.quotas. 2019-12-05 21:03:57 +03:00