alesapin
2695aa13c4
Add ability to execute mutations asynchronously
2019-12-16 18:51:15 +03:00
alexey-milovidov
d0ef4b6b96
Merge branch 'master' into more-accurate-using-load-reload
2019-12-16 02:42:45 +03:00
Mikhail Filimonov
f3fa71c707
Init query context for Kafka to make subqueries work
2019-12-13 02:21:40 +01:00
alexey-milovidov
399995d60b
Merge pull request #7812 from infinivision/fix_part_mutation
...
fix part mutation
2019-12-13 03:45:59 +03:00
alexey-milovidov
d0cf282204
Merge pull request #8179 from ClickHouse/parts_to_do_names
...
Add parts_to_do_names column to system.mutations.
2019-12-13 02:30:03 +03:00
alexey-milovidov
69535078fd
Merge pull request #8192 from excitoon-favorites/better-logging-disks
...
Better logging in background move task.
2019-12-13 02:27:38 +03:00
alexey-milovidov
32f42c4e92
Merge pull request #8194 from excitoon-favorites/fixed-move-pool
...
Fixed metrics in `BackgroundProcessingPool`
2019-12-13 02:26:52 +03:00
Artem Zuikov
5783142f39
Merge pull request #8178 from 4ertus2/some
...
Refactoring: extract getTableExpressions() variants into own file
2019-12-13 01:09:47 +03:00
Vladimir Chebotarev
e413cd6e6c
Fixed metrics in BackgroundProcessingPool
.
2019-12-13 01:08:54 +03:00
Vladimir Chebotarev
9882c7c5ad
Minor fix in logging.
2019-12-13 00:38:05 +03:00
Vladimir Chebotarev
9393bb0f12
Better logging in background move task.
2019-12-13 00:34:57 +03:00
Vitaly Baranov
4c157007f5
Refactoring of using ExternalLoader in dictionary DDL:
...
Instead of using ExternalLoader::reload() now it's used reloadConfig() which reloads only what necessary.
Functions attachDictionary() and detachDictionary() are simplified and have lesser number of parameters.
Instead of injecting into LoadablesConfigReader's internals for creating dictionary a temp repository is used.
2019-12-12 21:45:58 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration
...
AWS SDK S3 integration
2019-12-12 20:43:16 +03:00
alesapin
b7622c8fd9
Add parts_to_do_names column to system.mutations
2019-12-12 19:24:03 +03:00
chertus
68a33863ab
extract getTableExpressions variants into own file
2019-12-12 19:06:18 +03:00
Alexander Burmak
1f69a7a015
Fixed merge issues
2019-12-12 14:10:18 +03:00
Alexander Burmak
2ce6136de5
Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs
2019-12-12 12:10:50 +03:00
CurtizJ
890bfeb4eb
fix order description analyzing
2019-12-11 21:52:59 +03:00
Pavel Kovalenko
c7f016fc4e
AWS SDK integration - code cleanup.
2019-12-11 17:21:48 +03:00
CurtizJ
6834fbf03d
implement ORDER BY optimization for some other meta-storages
2019-12-11 16:09:46 +03:00
alesapin
2940aeff23
Fix style
2019-12-11 13:24:20 +03:00
alesapin
fd9483efbe
Just trigger CI
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0ff0a52249
Missed review fixes.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f2aee64072
Minor style fix.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e41deb5848
Added comment to MergeTreePartsMover::selectPartsForMove()
.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7fd1668fde
Review fixes.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e3ed311273
Fixed Clang build.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
67aa268bbb
Finally fixed tests and logic for extended TTL syntax.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f83b28a1c1
Fixed a typo in MergeTreeData::selectMoveDestination()
.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
618a39cc8c
Don't move anything if part already belongs their destination.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f72da4ab0c
Removing expired rows shall not be triggered on move TTL expiration.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
8ed37801ca
Finally fixed selection of destination of move TTL.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
15fb64f54b
Fixed move TTL expiration logic.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
df002f20b1
Fixed move TTL metadata.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
14cf530542
Added move TTL rules to metadata of ReplicatedMergeTree
.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7407f7c39d
Placed move TTL rules to a vector.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
108e2b33eb
Fixed a bug with erasing columns with same name.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0da7234d99
Added few FIXMEs to not forget.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce851fc782
Fixed MergeTreeData::hasTableTTL()
method according to extended TTLs.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cb777f6c50
Removed redundant template from updateTTL()
method.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
62016feab0
Renamed TTLDestinationType to PartDestinationType.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc0c21604f
Fixed Clang build one more time.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce066d3bb0
Style fixes.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
88c7220256
Fixed Clang build.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e3e9ac56f
Moved settings for BackgroundProcessingPool
to configuration.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e519c04bbe
Minor fix of JSON handling in MergeTreeDataPartTTLInfo
.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
342ea5c30a
Removed TODO comments.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1
Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree
.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
dfe0edc03f
Style fix.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
76c4ac9f60
Fixed ttl move logic in background move task and added ttl enforcement on inserts.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
575de5ada6
Attempt to add background moves by TTL expressions.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
893e0de37a
Minor fix.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
33ded274a3
First attempt to store min/max for move ttl expressions.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e984609fb
Fixed ClickHouse after changing syntax.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7a37c4f6a9
Parser for extended TTL expressions.
2019-12-11 13:24:20 +03:00
Alexey Milovidov
4f9cd8a3c8
Update contributors
2019-12-11 06:13:33 +03:00
CurtizJ
fd5b23730e
implement order by optimization for storage Merge
2019-12-11 04:35:47 +03:00
CurtizJ
45a9751c31
refactoring of order by optimization
2019-12-11 04:34:39 +03:00
Zhichang Yu
ff1b8d46e2
fixed part mutation, added test_backup_restore integration test case
2019-12-11 09:31:37 +08:00
CurtizJ
9e75892516
refactoring of order by optimization
2019-12-11 02:18:24 +03:00
Vladimir Chebotarev
269a0246aa
Added explicit check for existence of part and pair of log messages.
2019-12-10 12:47:23 +03:00
Vladimir Chebotarev
6afd8d7805
Added test_multiple_disk::test_kill_while_insert
, reworked log message and fixed logic of treating stale copies.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
a2f238d8da
Added more logging and switched to detaching stale part instead of removing.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
9cf7ef03af
Fixed handling of MergeTreeData::DataPartPtr
's in MergeTreeData::swapActivePart()
.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
374e0f7bb5
Finally fixed tests.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
c283776e84
Really fixed tests.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
89659a9129
Fixed a typo.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
fe3e89fb38
Fixed tests.
2019-12-09 23:29:44 +03:00
filimonov
f545da40e6
style
2019-12-09 23:29:44 +03:00
filimonov
0ab67c7b1f
Log when part is removed after move
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
efa73608b8
Separated constant path to DeleteOnDestroy marker.
2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
13c5c621c1
Attempt to ignore redundant copies of parts after move and restart.
2019-12-09 23:29:44 +03:00
Alexander Burmak
5a93441445
Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs
2019-12-09 17:18:47 +03:00
Pavel Kovalenko
ba59991912
AWS SDK integration - added new lines at the end of files.
2019-12-09 15:36:06 +03:00
Pavel Kovalenko
94e9638006
AWS SDK integration added url checking.
2019-12-09 13:58:57 +03:00
alexey-milovidov
cf194edfaf
Merge pull request #8016 from filimonov/kafka_fixes
...
Kafka fixes
2019-12-09 00:03:36 +03:00
alexey-milovidov
ee7d675f86
Update KafkaBlockInputStream.cpp
2019-12-09 00:03:09 +03:00
alexey-milovidov
16754bfff5
Merge pull request #8043 from excitoon-favorites/systemmergespaths
...
Added information about paths to `system.merges`.
2019-12-08 23:30:39 +03:00
Alexander Burmak
edd11abad1
Addressed code review comments
2019-12-08 19:47:51 +03:00
Alexander Burmak
8104395dd2
Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs
2019-12-08 11:45:18 +03:00
alesapin
af7b8f9274
Merge pull request #8051 from ClickHouse/fix_collations_behaviour
...
Fix several bugs with collations.
2019-12-08 11:10:23 +03:00
Vladimir Chebotarev
984e81876a
Fixed Clang build.
2019-12-07 22:30:37 +03:00
Vladimir Chebotarev
1fbfb50fba
Fixed updating result_part_path
while merging and mutating.
2019-12-07 12:54:05 +03:00
Vladimir Chebotarev
05a05b5fb6
Fixed result_part_part
of a mutation.
2019-12-07 11:10:08 +03:00
alesapin
3881a85c39
Review fixes
2019-12-07 01:22:12 +03:00
Pavel Kovalenko
c840fdefc0
Merge branch 'master' into aws-s3-sdk-integration
...
# Conflicts:
# dbms/src/Common/ErrorCodes.cpp
# dbms/src/IO/ReadBufferFromS3.cpp
# dbms/src/IO/ReadBufferFromS3.h
# dbms/src/IO/WriteBufferFromS3.cpp
# dbms/src/IO/WriteBufferFromS3.h
# dbms/src/Storages/StorageS3.cpp
2019-12-06 17:52:29 +03:00
alexey-milovidov
3d279499d0
Merge pull request #7632 from hczhcz/patch-2
...
Allow relative user_files_path
2019-12-06 17:44:18 +03:00
Pavel Kovalenko
a9dfefd37f
AWS SDK integration rework.
2019-12-06 17:37:21 +03:00
robot-clickhouse
6d56509109
Auto version update to [19.19.1.1] [54430]
2019-12-06 17:22:00 +03:00
Vitaly Baranov
8bd9709d1d
Merge pull request #8044 from vitlibar/simplify-format-of-header-of-distributed-send
...
Simplify format of the header of data sent to a shard in a distributed query.
2019-12-06 15:46:00 +03:00
Mikhail Filimonov
4e4957e052
returning allowNext() to the proper position
2019-12-06 12:22:36 +01:00
Vitaly Baranov
2133492598
Merge pull request #7257 from vitlibar/RBAC-2
...
RBAC-2
2019-12-06 03:19:39 +03:00
Mikhail Filimonov
7d760a964d
Fix for timestamp & style
2019-12-05 22:21:15 +01:00
alesapin
6afafef86c
Merge pull request #8047 from ClickHouse/fix_check_query_again
...
Fix bug in checkDataPart
2019-12-05 21:31:36 +03:00
Vitaly Baranov
d9b1a733fc
Add table system.quotas.
2019-12-05 21:03:57 +03:00
alesapin
772bb0b70b
Fix collation locales
2019-12-05 18:35:09 +03:00
alesapin
ee46a73d25
Fix bug in checkDataPart when last granule has same number of rows as in .mrk file
2019-12-05 15:01:36 +03:00
Nikolai Kochetov
26e415736a
Merge pull request #7665 from 4ertus2/joins
...
New ANY, SEMI, ANTI JOIN (HashJoin only)
2019-12-05 14:38:20 +03:00
Vitaly Baranov
133675a86a
Simplify format of the header of data sending to a shard in a distributed query.
2019-12-05 13:34:25 +03:00
Vladimir Chebotarev
7c7562987d
Removed is_move
from system.merges
.
2019-12-05 12:31:45 +03:00