Alexander Tokmakov
514868cebc
use relative paths in IStorage::rename(...)
2019-12-24 16:35:50 +03:00
alexey-milovidov
28c7e78d36
Merge pull request #8344 from ClickHouse/system-stack-trace
...
Added system.stack_trace table.
2019-12-24 12:15:48 +03:00
Alexander Tokmakov
ac3f53f300
refactor StorageFile construction
2019-12-23 23:07:31 +03:00
Alexey Milovidov
3b7f3b07cd
Better handling of signals
2019-12-23 22:23:54 +03:00
Alexey Milovidov
e907ce103e
Fixed warning
2019-12-23 21:58:42 +03:00
Alexey Milovidov
9da4b63fe9
Fixed Darwin build
2019-12-23 21:56:57 +03:00
Alexey Milovidov
56870c6b3b
Fixed -Wshadow
2019-12-23 19:49:06 +03:00
alesapin
25ecc38615
More correct separation between metadata and data alters for non replicated MergeTree.
2019-12-23 19:44:50 +03:00
Alexander Tokmakov
5fab732408
use arbitrary relative path in *MergeTree
2019-12-23 18:37:55 +03:00
Alexander Tokmakov
4f58d662f7
make data path relative
2019-12-23 18:20:08 +03:00
alesapin
73c9f0e71c
Remove redundant code
2019-12-23 17:46:00 +03:00
alesapin
f168977b9a
Merge branch 'master' into synchronous_mutations
2019-12-23 16:24:50 +03:00
Azat Khuzhin
58055e6a94
Do not overcommit Buffer memory usage
...
During INSERT the check against existing rows and rows from the INSERT
block is performed and if they exceeded threshold the Buffer should be
flushed to avoid overcommit, while before this patch the second check
(in flushBuffer()) will ignore rows from INSERT block.
2019-12-23 01:39:37 +03:00
Alexey Milovidov
4d349e9ed0
Added TODO
2019-12-23 00:01:12 +03:00
Alexey Milovidov
ca25e2f30f
Added query_id to "system.stack_trace"
2019-12-22 23:37:29 +03:00
Alexey Milovidov
9c868c910a
Simplification
2019-12-22 23:17:16 +03:00
Alexey Milovidov
e0000bef98
Added "system.stack_trace" table (development)
2019-12-22 20:20:33 +03:00
alexey-milovidov
fee9fda34c
Merge pull request #8130 from CurtizJ/optimize-storage-merge
...
Implement ORDER BY optimization for Storage Merge.
2019-12-22 12:43:18 +03:00
alexey-milovidov
980cf16873
Merge pull request #8323 from ClickHouse/minor-improvements-backquote
...
Added quoting of db and table names where appropriate
2019-12-20 22:14:35 +03:00
alexey-milovidov
0d119a40eb
Merge pull request #8240 from vitlibar/sync-system-reload-dictionary
...
Synchronous system reload dictionary
2019-12-20 20:00:03 +03:00
Alexey Milovidov
41ed1ed471
Added quoting of db and table names where appropriate
2019-12-20 19:53:37 +03:00
proller
521e2e709e
Build fixes. Arm, minimal build
2019-12-20 17:46:00 +03:00
CurtizJ
75c5e02ec2
improve input order analyzing and turn on order by optimization with left/inner joins
2019-12-20 16:15:17 +03:00
Alexander Tokmakov
10ad22faea
refactor InterpreterCreateQuery::createTable(...)
2019-12-20 15:51:51 +03:00
alexey-milovidov
7f10630873
Merge pull request #8308 from ClickHouse/deprecate-merge_tree_uniform_read_distribution
...
Deprecate "merge_tree_uniform_read_distribution" setting
2019-12-20 15:28:34 +03:00
Javi santana bot
dd5435501a
check for active replicas when waiting for commands
2019-12-20 11:04:16 +01:00
alexey-milovidov
de01dd12b5
Merge pull request #8306 from ClickHouse/fix_rename_distributed
...
Fix rename distributed
2019-12-20 04:38:21 +03:00
Alexey Milovidov
0ac868ed48
Deprecate "merge_tree_uniform_read_distribution" setting
2019-12-20 04:11:37 +03:00
Alexey Milovidov
371aef532c
Deprecate "merge_tree_uniform_read_distribution" setting
2019-12-20 02:49:41 +03:00
Alexey Milovidov
9ce8d5fe54
Deprecate "merge_tree_uniform_read_distribution" setting
2019-12-20 01:38:05 +03:00
chertus
b5658ef1a3
remove qualification in StorageJoin JOIN case
2019-12-19 23:37:10 +03:00
Alexander Tokmakov
d1568c1614
fix rename distributed
2019-12-19 22:51:12 +03:00
chertus
c72b0d4e2a
fix engine join crash [wip]
2019-12-19 18:50:28 +03:00
Vitaly Baranov
6baccb963d
Add functions currentRowPolicies() and system table 'system.row_policies'.
2019-12-19 18:40:15 +03:00
alesapin
0cc7ccfc2e
Remove unintended diff
2019-12-19 18:30:52 +03:00
alesapin
9fea941009
Make wait endless
2019-12-19 18:27:56 +03:00
alesapin
88033a4333
Merge branch 'master' into synchronous_mutations
2019-12-19 15:44:02 +03:00
alexey-milovidov
f5a16b1229
Update KeyCondition.cpp
2019-12-18 22:04:33 +03:00
alexey-milovidov
b5cab7c721
Update KeyCondition.cpp
2019-12-18 22:03:57 +03:00
Alexey Milovidov
90795b7d4b
Added asserts to KeyCondition while evaluating RPN
2019-12-18 22:00:09 +03:00
alesapin
f110b70ad8
Merge branch 'master' into synchronous_mutations
2019-12-18 12:00:14 +03:00
alexey-milovidov
a7384b4d07
Merge branch 'master' into MoreGCCWarnings
2019-12-18 02:01:39 +03:00
alesapin
9a005d27ea
Merge branch 'master' into synchronous_mutations
2019-12-17 15:27:36 +03:00
alesapin
b2979546c3
Fix mutation number by default
2019-12-17 15:23:17 +03:00
Vitaly Baranov
d0d5c72e4d
Reloading of a dictionary now waits for results and shows errors.
...
Clearer names for load and reload functions in ExternalLoader.
2019-12-17 13:45:47 +03:00
Olga Khvostikova
b47863a0c6
Fix segfault in table function file while inserting into it ( #8177 )
...
* Fix segfault in table function file while inserting into it
2019-12-17 11:06:39 +03:00
kreuzerkrieg
9612bb0e79
More GCC warnings
2019-12-16 23:19:50 +02:00
alesapin
2695aa13c4
Add ability to execute mutations asynchronously
2019-12-16 18:51:15 +03:00
alexey-milovidov
d0ef4b6b96
Merge branch 'master' into more-accurate-using-load-reload
2019-12-16 02:42:45 +03:00
Vitaliy Zakaznikov
cf22cde702
Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into live_view_support_for_subquery
2019-12-14 19:21:44 +01:00
Vitaliy Zakaznikov
0f9450433f
* Reverting back to the old logic.
...
* Removing redundant catch clauses.
* Updating createStorage function signature in StorageBlocks.h.
2019-12-14 18:29:34 +01:00
Nikolai Kochetov
28fcc6902f
Try to simplify code in StorageLiveView
2019-12-13 20:08:21 +03:00
Mikhail Filimonov
f3fa71c707
Init query context for Kafka to make subqueries work
2019-12-13 02:21:40 +01:00
alexey-milovidov
399995d60b
Merge pull request #7812 from infinivision/fix_part_mutation
...
fix part mutation
2019-12-13 03:45:59 +03:00
alexey-milovidov
d0cf282204
Merge pull request #8179 from ClickHouse/parts_to_do_names
...
Add parts_to_do_names column to system.mutations.
2019-12-13 02:30:03 +03:00
alexey-milovidov
69535078fd
Merge pull request #8192 from excitoon-favorites/better-logging-disks
...
Better logging in background move task.
2019-12-13 02:27:38 +03:00
alexey-milovidov
32f42c4e92
Merge pull request #8194 from excitoon-favorites/fixed-move-pool
...
Fixed metrics in `BackgroundProcessingPool`
2019-12-13 02:26:52 +03:00
Artem Zuikov
5783142f39
Merge pull request #8178 from 4ertus2/some
...
Refactoring: extract getTableExpressions() variants into own file
2019-12-13 01:09:47 +03:00
Vladimir Chebotarev
e413cd6e6c
Fixed metrics in BackgroundProcessingPool
.
2019-12-13 01:08:54 +03:00
Vladimir Chebotarev
9882c7c5ad
Minor fix in logging.
2019-12-13 00:38:05 +03:00
Vladimir Chebotarev
9393bb0f12
Better logging in background move task.
2019-12-13 00:34:57 +03:00
Vitaly Baranov
4c157007f5
Refactoring of using ExternalLoader in dictionary DDL:
...
Instead of using ExternalLoader::reload() now it's used reloadConfig() which reloads only what necessary.
Functions attachDictionary() and detachDictionary() are simplified and have lesser number of parameters.
Instead of injecting into LoadablesConfigReader's internals for creating dictionary a temp repository is used.
2019-12-12 21:45:58 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration
...
AWS SDK S3 integration
2019-12-12 20:43:16 +03:00
alesapin
b7622c8fd9
Add parts_to_do_names column to system.mutations
2019-12-12 19:24:03 +03:00
chertus
68a33863ab
extract getTableExpressions variants into own file
2019-12-12 19:06:18 +03:00
Alexander Burmak
1f69a7a015
Fixed merge issues
2019-12-12 14:10:18 +03:00
Alexander Burmak
2ce6136de5
Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs
2019-12-12 12:10:50 +03:00
CurtizJ
890bfeb4eb
fix order description analyzing
2019-12-11 21:52:59 +03:00
Pavel Kovalenko
c7f016fc4e
AWS SDK integration - code cleanup.
2019-12-11 17:21:48 +03:00
CurtizJ
6834fbf03d
implement ORDER BY optimization for some other meta-storages
2019-12-11 16:09:46 +03:00
alesapin
2940aeff23
Fix style
2019-12-11 13:24:20 +03:00
alesapin
fd9483efbe
Just trigger CI
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0ff0a52249
Missed review fixes.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f2aee64072
Minor style fix.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e41deb5848
Added comment to MergeTreePartsMover::selectPartsForMove()
.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7fd1668fde
Review fixes.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e3ed311273
Fixed Clang build.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
67aa268bbb
Finally fixed tests and logic for extended TTL syntax.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f83b28a1c1
Fixed a typo in MergeTreeData::selectMoveDestination()
.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
618a39cc8c
Don't move anything if part already belongs their destination.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f72da4ab0c
Removing expired rows shall not be triggered on move TTL expiration.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
8ed37801ca
Finally fixed selection of destination of move TTL.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
15fb64f54b
Fixed move TTL expiration logic.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
df002f20b1
Fixed move TTL metadata.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
14cf530542
Added move TTL rules to metadata of ReplicatedMergeTree
.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7407f7c39d
Placed move TTL rules to a vector.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
108e2b33eb
Fixed a bug with erasing columns with same name.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0da7234d99
Added few FIXMEs to not forget.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce851fc782
Fixed MergeTreeData::hasTableTTL()
method according to extended TTLs.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cb777f6c50
Removed redundant template from updateTTL()
method.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
62016feab0
Renamed TTLDestinationType to PartDestinationType.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc0c21604f
Fixed Clang build one more time.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce066d3bb0
Style fixes.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
88c7220256
Fixed Clang build.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e3e9ac56f
Moved settings for BackgroundProcessingPool
to configuration.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e519c04bbe
Minor fix of JSON handling in MergeTreeDataPartTTLInfo
.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
342ea5c30a
Removed TODO comments.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1
Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree
.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
dfe0edc03f
Style fix.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
76c4ac9f60
Fixed ttl move logic in background move task and added ttl enforcement on inserts.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
575de5ada6
Attempt to add background moves by TTL expressions.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
893e0de37a
Minor fix.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
33ded274a3
First attempt to store min/max for move ttl expressions.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e984609fb
Fixed ClickHouse after changing syntax.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7a37c4f6a9
Parser for extended TTL expressions.
2019-12-11 13:24:20 +03:00
Alexey Milovidov
4f9cd8a3c8
Update contributors
2019-12-11 06:13:33 +03:00
CurtizJ
fd5b23730e
implement order by optimization for storage Merge
2019-12-11 04:35:47 +03:00
CurtizJ
45a9751c31
refactoring of order by optimization
2019-12-11 04:34:39 +03:00
Zhichang Yu
ff1b8d46e2
fixed part mutation, added test_backup_restore integration test case
2019-12-11 09:31:37 +08:00
CurtizJ
9e75892516
refactoring of order by optimization
2019-12-11 02:18:24 +03:00
Vladimir Chebotarev
269a0246aa
Added explicit check for existence of part and pair of log messages.
2019-12-10 12:47:23 +03:00
Vladimir Chebotarev
6afd8d7805
Added test_multiple_disk::test_kill_while_insert
, reworked log message and fixed logic of treating stale copies.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
a2f238d8da
Added more logging and switched to detaching stale part instead of removing.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
9cf7ef03af
Fixed handling of MergeTreeData::DataPartPtr
's in MergeTreeData::swapActivePart()
.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
374e0f7bb5
Finally fixed tests.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
c283776e84
Really fixed tests.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
89659a9129
Fixed a typo.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
fe3e89fb38
Fixed tests.
2019-12-09 23:29:44 +03:00
filimonov
f545da40e6
style
2019-12-09 23:29:44 +03:00
filimonov
0ab67c7b1f
Log when part is removed after move
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
efa73608b8
Separated constant path to DeleteOnDestroy marker.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
13c5c621c1
Attempt to ignore redundant copies of parts after move and restart.
2019-12-09 23:29:44 +03:00
Alexander Burmak
5a93441445
Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs
2019-12-09 17:18:47 +03:00
Pavel Kovalenko
ba59991912
AWS SDK integration - added new lines at the end of files.
2019-12-09 15:36:06 +03:00
Pavel Kovalenko
94e9638006
AWS SDK integration added url checking.
2019-12-09 13:58:57 +03:00
alexey-milovidov
cf194edfaf
Merge pull request #8016 from filimonov/kafka_fixes
...
Kafka fixes
2019-12-09 00:03:36 +03:00
alexey-milovidov
ee7d675f86
Update KafkaBlockInputStream.cpp
2019-12-09 00:03:09 +03:00
alexey-milovidov
16754bfff5
Merge pull request #8043 from excitoon-favorites/systemmergespaths
...
Added information about paths to `system.merges`.
2019-12-08 23:30:39 +03:00
Alexander Burmak
edd11abad1
Addressed code review comments
2019-12-08 19:47:51 +03:00
Alexander Burmak
8104395dd2
Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs
2019-12-08 11:45:18 +03:00
alesapin
af7b8f9274
Merge pull request #8051 from ClickHouse/fix_collations_behaviour
...
Fix several bugs with collations.
2019-12-08 11:10:23 +03:00
Vladimir Chebotarev
984e81876a
Fixed Clang build.
2019-12-07 22:30:37 +03:00
Vladimir Chebotarev
1fbfb50fba
Fixed updating result_part_path
while merging and mutating.
2019-12-07 12:54:05 +03:00
Vladimir Chebotarev
05a05b5fb6
Fixed result_part_part
of a mutation.
2019-12-07 11:10:08 +03:00
alesapin
3881a85c39
Review fixes
2019-12-07 01:22:12 +03:00
Pavel Kovalenko
c840fdefc0
Merge branch 'master' into aws-s3-sdk-integration
...
# Conflicts:
# dbms/src/Common/ErrorCodes.cpp
# dbms/src/IO/ReadBufferFromS3.cpp
# dbms/src/IO/ReadBufferFromS3.h
# dbms/src/IO/WriteBufferFromS3.cpp
# dbms/src/IO/WriteBufferFromS3.h
# dbms/src/Storages/StorageS3.cpp
2019-12-06 17:52:29 +03:00
alexey-milovidov
3d279499d0
Merge pull request #7632 from hczhcz/patch-2
...
Allow relative user_files_path
2019-12-06 17:44:18 +03:00
Pavel Kovalenko
a9dfefd37f
AWS SDK integration rework.
2019-12-06 17:37:21 +03:00
robot-clickhouse
6d56509109
Auto version update to [19.19.1.1] [54430]
2019-12-06 17:22:00 +03:00
Vitaly Baranov
8bd9709d1d
Merge pull request #8044 from vitlibar/simplify-format-of-header-of-distributed-send
...
Simplify format of the header of data sent to a shard in a distributed query.
2019-12-06 15:46:00 +03:00
Vitaliy Zakaznikov
435ce84939
Setting table alias when replacing subquery with a table.
...
Adding extra tests that use table aliases.
2019-12-06 13:31:08 +01:00
Mikhail Filimonov
4e4957e052
returning allowNext() to the proper position
2019-12-06 12:22:36 +01:00
Vitaly Baranov
2133492598
Merge pull request #7257 from vitlibar/RBAC-2
...
RBAC-2
2019-12-06 03:19:39 +03:00
Vitaliy Zakaznikov
ae3749d764
Fixing clang error in dbms/src/Storages/LiveView/StorageBlocks.h
2019-12-05 19:08:40 -05:00
Vitaliy Zakaznikov
2d6645cc1b
Fixing clang error.
2019-12-05 17:04:55 -05:00
Vitaliy Zakaznikov
613c343c09
Fixing styling issues.
2019-12-05 16:48:25 -05:00
Vitaliy Zakaznikov
32fe9ea9d5
Fixing issue with support for nested subqueries.
...
Adding additional live view with subquery tests.
2019-12-05 22:42:00 +01:00
Mikhail Filimonov
7d760a964d
Fix for timestamp & style
2019-12-05 22:21:15 +01:00
alesapin
6afafef86c
Merge pull request #8047 from ClickHouse/fix_check_query_again
...
Fix bug in checkDataPart
2019-12-05 21:31:36 +03:00
Vitaly Baranov
d9b1a733fc
Add table system.quotas.
2019-12-05 21:03:57 +03:00