thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 11:22:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
34,394 Commits 9,338 Branches 1,783 Tags 2.1 GiB
d4707ca911
Commit Graph

5826 Commits

Author SHA1 Message Date
Artem Zuikov
b282cbcc91
Merge pull request #8400 from 4ertus2/joins 
New ANY JOIN + SEMI, ANTI JOIN for StorageJoin
 2019-12-26 18:35:50 +03:00
Vladimir Chebotarev
64b2b18d5b Added a check for bad disk/volume as a destination of move TTL expression. 2019-12-26 18:04:55 +03:00
Alexander Burmak
3f1832355f Added WriteMode enumeration 2019-12-26 17:28:22 +03:00
Alexander Burmak
764b506fd5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2019-12-26 17:03:32 +03:00
Alexander Tokmakov
50200e245b Merge branch 'master' into refactor_databases 2019-12-26 15:00:07 +03:00
alesapin
6f28e69e97
Merge pull request #8345 from azat/fix-flaky-test--Buffer_and_max_memory_usage 
Fix buffer overcommit and 01019_Buffer_and_max_memory_usage flakiness
 2019-12-26 13:21:47 +03:00
alesapin
093d56f474
Merge pull request #8382 from ClickHouse/relative_paths_in_storages 
Use relative paths in Storages
 2019-12-26 13:05:37 +03:00
Vladimir Chebotarev
c4e9784464 Fixed skipping parts algorithm while checking parts on other disks. 2019-12-26 01:12:17 +03:00
Vladimir Chebotarev
ab5171f403 Fixed tests. 2019-12-25 23:32:15 +03:00
Vladimir Chebotarev
29068663ea Fixed build. 2019-12-25 23:32:15 +03:00
Vladimir Chebotarev
80056551ce Check extra parts of MergeTree at different disks, in order to not allow to miss data parts at undefined disks. 2019-12-25 23:32:15 +03:00
chertus
4fd7340416 New ANY JOIN for StorageJoin + SEMI, ANTI 2019-12-25 20:32:55 +03:00
Alexander Tokmakov
7c48396689 refactor databases: inherit from DatabaseOnDisk 2019-12-25 16:23:38 +03:00
alesapin
3b6e3db0c2 Remove redundant alter_lock, because parts cannot be altered concurrently. 2019-12-25 15:34:04 +03:00
alesapin
d4987f86d3 Merge branch 'master' into immutable_parts 2019-12-25 11:44:47 +03:00
Alexander Burmak
544bfd105b Corrected naming based on review feedback 2019-12-25 11:24:13 +03:00
alesapin
34d2afa354 Fix obvious bug 2019-12-24 23:03:33 +03:00
Nikolai Kochetov
6a1dccd27c Change initialization order for StorageDistributedDirectoryMonitor members. 2019-12-24 21:25:00 +03:00
alesapin
05b933b1d3 Better 2019-12-24 21:07:51 +03:00
Alexander Tokmakov
6325f8507c fixes 2019-12-24 20:41:24 +03:00
Alexander Tokmakov
60a47c3453 Merge branch 'master' into relative_paths_in_storages 2019-12-24 19:58:34 +03:00
tavplubix
7c1a6c726d
Merge pull request #8359 from ClickHouse/more_readable_interpreter_create 
Refactor table creation
 2019-12-24 18:07:43 +03:00
Alexander Tokmakov
514868cebc use relative paths in IStorage::rename(...) 2019-12-24 16:35:50 +03:00
Alexander Burmak
97f03ab064 Fixed CI errors 2019-12-24 13:25:14 +03:00
alexey-milovidov
28c7e78d36
Merge pull request #8344 from ClickHouse/system-stack-trace 
Added system.stack_trace table.
 2019-12-24 12:15:48 +03:00
Alexander Tokmakov
ac3f53f300 refactor StorageFile construction 2019-12-23 23:07:31 +03:00
Alexey Milovidov
3b7f3b07cd Better handling of signals 2019-12-23 22:23:54 +03:00
Alexey Milovidov
e907ce103e Fixed warning 2019-12-23 21:58:42 +03:00
Alexey Milovidov
9da4b63fe9 Fixed Darwin build 2019-12-23 21:56:57 +03:00
Alexey Milovidov
56870c6b3b Fixed -Wshadow 2019-12-23 19:49:06 +03:00
alesapin
25ecc38615 More correct separation between metadata and data alters for non replicated MergeTree. 2019-12-23 19:44:50 +03:00
Alexander Tokmakov
5fab732408 use arbitrary relative path in *MergeTree 2019-12-23 18:37:55 +03:00
Alexander Tokmakov
4f58d662f7 make data path relative 2019-12-23 18:20:08 +03:00
alesapin
73c9f0e71c Remove redundant code 2019-12-23 17:46:00 +03:00
alesapin
f168977b9a Merge branch 'master' into synchronous_mutations 2019-12-23 16:24:50 +03:00
Alexander Burmak
0894ed9f33 Integration of log storages with IDisk interface 2019-12-23 16:11:56 +03:00
Azat Khuzhin
58055e6a94 Do not overcommit Buffer memory usage 
During INSERT the check against existing rows and rows from the INSERT
block is performed and if they exceeded threshold the Buffer should be
flushed to avoid overcommit, while before this patch the second check
(in flushBuffer()) will ignore rows from INSERT block.
 2019-12-23 01:39:37 +03:00
Alexey Milovidov
4d349e9ed0 Added TODO 2019-12-23 00:01:12 +03:00
Alexey Milovidov
ca25e2f30f Added query_id to "system.stack_trace" 2019-12-22 23:37:29 +03:00
Alexey Milovidov
9c868c910a Simplification 2019-12-22 23:17:16 +03:00
Alexey Milovidov
e0000bef98 Added "system.stack_trace" table (development) 2019-12-22 20:20:33 +03:00
alexey-milovidov
fee9fda34c
Merge pull request #8130 from CurtizJ/optimize-storage-merge 
Implement ORDER BY optimization for Storage Merge.
 2019-12-22 12:43:18 +03:00
alexey-milovidov
980cf16873
Merge pull request #8323 from ClickHouse/minor-improvements-backquote 
Added quoting of db and table names where appropriate
 2019-12-20 22:14:35 +03:00
alexey-milovidov
0d119a40eb
Merge pull request #8240 from vitlibar/sync-system-reload-dictionary 
Synchronous system reload dictionary
 2019-12-20 20:00:03 +03:00
Alexey Milovidov
41ed1ed471 Added quoting of db and table names where appropriate 2019-12-20 19:53:37 +03:00
proller
521e2e709e Build fixes. Arm, minimal build 2019-12-20 17:46:00 +03:00
CurtizJ
75c5e02ec2 improve input order analyzing and turn on order by optimization with left/inner joins 2019-12-20 16:15:17 +03:00
Alexander Tokmakov
10ad22faea refactor InterpreterCreateQuery::createTable(...) 2019-12-20 15:51:51 +03:00
alexey-milovidov
7f10630873
Merge pull request #8308 from ClickHouse/deprecate-merge_tree_uniform_read_distribution 
Deprecate "merge_tree_uniform_read_distribution" setting
 2019-12-20 15:28:34 +03:00
Javi santana bot
dd5435501a check for active replicas when waiting for commands 2019-12-20 11:04:16 +01:00
alexey-milovidov
de01dd12b5
Merge pull request #8306 from ClickHouse/fix_rename_distributed 
Fix rename distributed
 2019-12-20 04:38:21 +03:00
Alexey Milovidov
0ac868ed48 Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 04:11:37 +03:00
Alexey Milovidov
371aef532c Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 02:49:41 +03:00
Alexey Milovidov
9ce8d5fe54 Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 01:38:05 +03:00
chertus
b5658ef1a3 remove qualification in StorageJoin JOIN case 2019-12-19 23:37:10 +03:00
Alexander Tokmakov
d1568c1614 fix rename distributed 2019-12-19 22:51:12 +03:00
chertus
c72b0d4e2a fix engine join crash [wip] 2019-12-19 18:50:28 +03:00
Vitaly Baranov
6baccb963d Add functions currentRowPolicies() and system table 'system.row_policies'. 2019-12-19 18:40:15 +03:00
alesapin
0cc7ccfc2e Remove unintended diff 2019-12-19 18:30:52 +03:00
alesapin
9fea941009 Make wait endless 2019-12-19 18:27:56 +03:00
alesapin
88033a4333 Merge branch 'master' into synchronous_mutations 2019-12-19 15:44:02 +03:00
alexey-milovidov
f5a16b1229
Update KeyCondition.cpp 2019-12-18 22:04:33 +03:00
alexey-milovidov
b5cab7c721
Update KeyCondition.cpp 2019-12-18 22:03:57 +03:00
Alexey Milovidov
90795b7d4b Added asserts to KeyCondition while evaluating RPN 2019-12-18 22:00:09 +03:00
alesapin
f110b70ad8 Merge branch 'master' into synchronous_mutations 2019-12-18 12:00:14 +03:00
alexey-milovidov
a7384b4d07
Merge branch 'master' into MoreGCCWarnings 2019-12-18 02:01:39 +03:00
alesapin
9a005d27ea Merge branch 'master' into synchronous_mutations 2019-12-17 15:27:36 +03:00
alesapin
b2979546c3 Fix mutation number by default 2019-12-17 15:23:17 +03:00
Vitaly Baranov
d0d5c72e4d Reloading of a dictionary now waits for results and shows errors. 
Clearer names for load and reload functions in ExternalLoader.
 2019-12-17 13:45:47 +03:00
Guillaume Tassery
bdcee8b382 Merge branch 'master' of github.com:ClickHouse/ClickHouse into move_partition 2019-12-17 11:18:11 +01:00
Olga Khvostikova
b47863a0c6
Fix segfault in table function file while inserting into it (#8177) 
* Fix segfault in table function file while inserting into it
 2019-12-17 11:06:39 +03:00
Guillaume Tassery
de9ab66935 fix merge conflict 2019-12-17 08:20:54 +01:00
Guillaume Tassery
595815bdf5 Add table as part destination type 2019-12-17 07:51:40 +01:00
Guillaume Tassery
dca0c83809
Merge branch 'master' into move_partition 2019-12-17 13:49:18 +07:00
Vxider
f564d524e5 parallel insert support for ReplicatedMergeTree 2019-12-17 12:22:58 +08:00
Vxider
2a94832ef6 parallel INSERT in INSERT SELECT query 2019-12-17 12:22:58 +08:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
alesapin
2695aa13c4 Add ability to execute mutations asynchronously 2019-12-16 18:51:15 +03:00
alexey-milovidov
d0ef4b6b96
Merge branch 'master' into more-accurate-using-load-reload 2019-12-16 02:42:45 +03:00
Vitaliy Zakaznikov
cf22cde702 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into live_view_support_for_subquery 2019-12-14 19:21:44 +01:00
Vitaliy Zakaznikov
0f9450433f * Reverting back to the old logic. 
* Removing redundant catch clauses.
* Updating createStorage function signature in StorageBlocks.h.
 2019-12-14 18:29:34 +01:00
Nikolai Kochetov
28fcc6902f Try to simplify code in StorageLiveView 2019-12-13 20:08:21 +03:00
Mikhail Filimonov
f3fa71c707 Init query context for Kafka to make subqueries work 2019-12-13 02:21:40 +01:00
alexey-milovidov
399995d60b
Merge pull request #7812 from infinivision/fix_part_mutation 
fix part mutation
 2019-12-13 03:45:59 +03:00
alexey-milovidov
d0cf282204
Merge pull request #8179 from ClickHouse/parts_to_do_names 
Add parts_to_do_names column to system.mutations.
 2019-12-13 02:30:03 +03:00
alexey-milovidov
69535078fd
Merge pull request #8192 from excitoon-favorites/better-logging-disks 
Better logging in background move task.
 2019-12-13 02:27:38 +03:00
alexey-milovidov
32f42c4e92
Merge pull request #8194 from excitoon-favorites/fixed-move-pool 
Fixed metrics in `BackgroundProcessingPool`
 2019-12-13 02:26:52 +03:00
Artem Zuikov
5783142f39
Merge pull request #8178 from 4ertus2/some 
Refactoring: extract getTableExpressions() variants into own file
 2019-12-13 01:09:47 +03:00
Vladimir Chebotarev
e413cd6e6c Fixed metrics in BackgroundProcessingPool. 2019-12-13 01:08:54 +03:00
Vladimir Chebotarev
9882c7c5ad Minor fix in logging. 2019-12-13 00:38:05 +03:00
Vladimir Chebotarev
9393bb0f12 Better logging in background move task. 2019-12-13 00:34:57 +03:00
Vitaly Baranov
4c157007f5 Refactoring of using ExternalLoader in dictionary DDL: 
Instead of using ExternalLoader::reload() now it's used reloadConfig() which reloads only what necessary.
Functions attachDictionary() and detachDictionary() are simplified and have lesser number of parameters.
Instead of injecting into LoadablesConfigReader's internals for creating dictionary a temp repository is used.
 2019-12-12 21:45:58 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration 
AWS SDK S3 integration
 2019-12-12 20:43:16 +03:00
alesapin
b7622c8fd9 Add parts_to_do_names column to system.mutations 2019-12-12 19:24:03 +03:00
chertus
68a33863ab extract getTableExpressions variants into own file 2019-12-12 19:06:18 +03:00
Alexander Burmak
1f69a7a015 Fixed merge issues 2019-12-12 14:10:18 +03:00
Alexander Burmak
2ce6136de5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-12 12:10:50 +03:00
CurtizJ
890bfeb4eb fix order description analyzing 2019-12-11 21:52:59 +03:00
Pavel Kovalenko
c7f016fc4e AWS SDK integration - code cleanup. 2019-12-11 17:21:48 +03:00
CurtizJ
6834fbf03d implement ORDER BY optimization for some other meta-storages 2019-12-11 16:09:46 +03:00
alesapin
2940aeff23 Fix style 2019-12-11 13:24:20 +03:00
alesapin
fd9483efbe Just trigger CI 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0ff0a52249 Missed review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f2aee64072 Minor style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e41deb5848 Added comment to MergeTreePartsMover::selectPartsForMove(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7fd1668fde Review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e3ed311273 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
67aa268bbb Finally fixed tests and logic for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f83b28a1c1 Fixed a typo in MergeTreeData::selectMoveDestination(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
618a39cc8c Don't move anything if part already belongs their destination. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f72da4ab0c Removing expired rows shall not be triggered on move TTL expiration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
8ed37801ca Finally fixed selection of destination of move TTL. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
15fb64f54b Fixed move TTL expiration logic. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
df002f20b1 Fixed move TTL metadata. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
14cf530542 Added move TTL rules to metadata of ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7407f7c39d Placed move TTL rules to a vector. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
108e2b33eb Fixed a bug with erasing columns with same name. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0da7234d99 Added few FIXMEs to not forget. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce851fc782 Fixed MergeTreeData::hasTableTTL() method according to extended TTLs. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cb777f6c50 Removed redundant template from updateTTL() method. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
62016feab0 Renamed TTLDestinationType to PartDestinationType. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc0c21604f Fixed Clang build one more time. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce066d3bb0 Style fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
88c7220256 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e3e9ac56f Moved settings for BackgroundProcessingPool to configuration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e519c04bbe Minor fix of JSON handling in MergeTreeDataPartTTLInfo. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
342ea5c30a Removed TODO comments. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1 Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
dfe0edc03f Style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
76c4ac9f60 Fixed ttl move logic in background move task and added ttl enforcement on inserts. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
575de5ada6 Attempt to add background moves by TTL expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
893e0de37a Minor fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
33ded274a3 First attempt to store min/max for move ttl expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e984609fb Fixed ClickHouse after changing syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7a37c4f6a9 Parser for extended TTL expressions. 2019-12-11 13:24:20 +03:00
Alexey Milovidov
4f9cd8a3c8 Update contributors 2019-12-11 06:13:33 +03:00
CurtizJ
fd5b23730e implement order by optimization for storage Merge 2019-12-11 04:35:47 +03:00
CurtizJ
45a9751c31 refactoring of order by optimization 2019-12-11 04:34:39 +03:00
Zhichang Yu
ff1b8d46e2 fixed part mutation, added test_backup_restore integration test case 2019-12-11 09:31:37 +08:00
CurtizJ
9e75892516 refactoring of order by optimization 2019-12-11 02:18:24 +03:00
Vladimir Chebotarev
269a0246aa Added explicit check for existence of part and pair of log messages. 2019-12-10 12:47:23 +03:00
Vladimir Chebotarev
6afd8d7805 Added test_multiple_disk::test_kill_while_insert, reworked log message and fixed logic of treating stale copies. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
a2f238d8da Added more logging and switched to detaching stale part instead of removing. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
9cf7ef03af Fixed handling of MergeTreeData::DataPartPtr's in MergeTreeData::swapActivePart(). 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
374e0f7bb5 Finally fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
c283776e84 Really fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
89659a9129 Fixed a typo. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
fe3e89fb38 Fixed tests. 2019-12-09 23:29:44 +03:00
filimonov
f545da40e6 style 2019-12-09 23:29:44 +03:00
filimonov
0ab67c7b1f Log when part is removed after move 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
efa73608b8 Separated constant path to DeleteOnDestroy marker. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
13c5c621c1 Attempt to ignore redundant copies of parts after move and restart. 2019-12-09 23:29:44 +03:00
Alexander Burmak
5a93441445 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-09 17:18:47 +03:00
Pavel Kovalenko
ba59991912 AWS SDK integration - added new lines at the end of files. 2019-12-09 15:36:06 +03:00
Pavel Kovalenko
94e9638006 AWS SDK integration added url checking. 2019-12-09 13:58:57 +03:00
alexey-milovidov
cf194edfaf
Merge pull request #8016 from filimonov/kafka_fixes 
Kafka fixes
 2019-12-09 00:03:36 +03:00
alexey-milovidov
ee7d675f86
Update KafkaBlockInputStream.cpp 2019-12-09 00:03:09 +03:00
alexey-milovidov
16754bfff5
Merge pull request #8043 from excitoon-favorites/systemmergespaths 
Added information about paths to `system.merges`.
 2019-12-08 23:30:39 +03:00
Alexander Burmak
edd11abad1 Addressed code review comments 2019-12-08 19:47:51 +03:00
Alexander Burmak
8104395dd2 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-08 11:45:18 +03:00
alesapin
af7b8f9274
Merge pull request #8051 from ClickHouse/fix_collations_behaviour 
Fix several bugs with collations.
 2019-12-08 11:10:23 +03:00
Vladimir Chebotarev
984e81876a Fixed Clang build. 2019-12-07 22:30:37 +03:00
Vladimir Chebotarev
1fbfb50fba Fixed updating result_part_path while merging and mutating. 2019-12-07 12:54:05 +03:00
Vladimir Chebotarev
05a05b5fb6 Fixed result_part_part of a mutation. 2019-12-07 11:10:08 +03:00
alesapin
3881a85c39 Review fixes 2019-12-07 01:22:12 +03:00
Pavel Kovalenko
c840fdefc0 Merge branch 'master' into aws-s3-sdk-integration 
# Conflicts:
#	dbms/src/Common/ErrorCodes.cpp
#	dbms/src/IO/ReadBufferFromS3.cpp
#	dbms/src/IO/ReadBufferFromS3.h
#	dbms/src/IO/WriteBufferFromS3.cpp
#	dbms/src/IO/WriteBufferFromS3.h
#	dbms/src/Storages/StorageS3.cpp
 2019-12-06 17:52:29 +03:00
alexey-milovidov
3d279499d0
Merge pull request #7632 from hczhcz/patch-2 
Allow relative user_files_path
 2019-12-06 17:44:18 +03:00
Pavel Kovalenko
a9dfefd37f AWS SDK integration rework. 2019-12-06 17:37:21 +03:00
robot-clickhouse
6d56509109 Auto version update to [19.19.1.1] [54430] 2019-12-06 17:22:00 +03:00
Vitaly Baranov
8bd9709d1d
Merge pull request #8044 from vitlibar/simplify-format-of-header-of-distributed-send 
Simplify format of the header of data sent to a shard in a distributed query.
 2019-12-06 15:46:00 +03:00
Vitaliy Zakaznikov
435ce84939 Setting table alias when replacing subquery with a table. 
Adding extra tests that use table aliases.
 2019-12-06 13:31:08 +01:00
Mikhail Filimonov
4e4957e052 returning allowNext() to the proper position 2019-12-06 12:22:36 +01:00
Vitaly Baranov
2133492598
Merge pull request #7257 from vitlibar/RBAC-2 
RBAC-2
 2019-12-06 03:19:39 +03:00
Vitaliy Zakaznikov
ae3749d764 Fixing clang error in dbms/src/Storages/LiveView/StorageBlocks.h 2019-12-05 19:08:40 -05:00
Vitaliy Zakaznikov
2d6645cc1b Fixing clang error. 2019-12-05 17:04:55 -05:00
Vitaliy Zakaznikov
613c343c09 Fixing styling issues. 2019-12-05 16:48:25 -05:00
Vitaliy Zakaznikov
32fe9ea9d5 Fixing issue with support for nested subqueries. 
Adding additional live view with subquery tests.
 2019-12-05 22:42:00 +01:00
Mikhail Filimonov
7d760a964d Fix for timestamp & style 2019-12-05 22:21:15 +01:00
alesapin
6afafef86c
Merge pull request #8047 from ClickHouse/fix_check_query_again 
Fix bug in checkDataPart
 2019-12-05 21:31:36 +03:00
Vitaly Baranov
d9b1a733fc Add table system.quotas. 2019-12-05 21:03:57 +03:00
alesapin
772bb0b70b Fix collation locales 2019-12-05 18:35:09 +03:00
Vitaliy Zakaznikov
28db10fd7d Fixing styling errors. 2019-12-05 14:26:47 +01:00
alesapin
ee46a73d25 Fix bug in checkDataPart when last granule has same number of rows as in .mrk file 2019-12-05 15:01:36 +03:00
Vitaliy Zakaznikov
e20793b2dc Merge remote-tracking branch 'origin/master' into live_view_support_for_subquery 2019-12-05 06:54:04 -05:00
Vitaliy Zakaznikov
1e0e00b7e4 Small fixes to empty lines and style. 2019-12-05 06:53:36 -05:00
Nikolai Kochetov
26e415736a
Merge pull request #7665 from 4ertus2/joins 
New ANY, SEMI, ANTI JOIN (HashJoin only)
 2019-12-05 14:38:20 +03:00
Vitaly Baranov
133675a86a Simplify format of the header of data sending to a shard in a distributed query. 2019-12-05 13:34:25 +03:00
Vladimir Chebotarev
7c7562987d Removed is_move from system.merges. 2019-12-05 12:31:45 +03:00
Vitaliy Zakaznikov
7f92e6a21f Draft of proper support for subquries in live view tables. 2019-12-05 00:29:37 +01:00
Azat Khuzhin
3a72e1c12a Add checksum for extra info/query in distributed sends 
This extras includes:
- server revision
- query settings
- query

Otherwise the code can try to interpret data, and got for instance
std::length_error exception, which is not catched (to mark the part as
broken). Also this will protect from the corruptions on disk.

And add a simple test, since dbms/tests/integration/test_insert_into_distributed too complex.

Also simplify the code by using readStringBinary() over
readVarUInt()+b.readStrict() (this also gains additional checks that
string is not bigger then 1GB).

Refs: #4852 (8ef7f3589a)
v2: avoid ABI breakage (suggested by @vitlibar)
v3: minor code fixes (suggested by @vitlibar) and as a consequence clang-8 build fix
v4: drop DBMS_MIN_REVISION_WITH_EXTRAS_CHECKSUM_IN_DIST_BATCH and also
    revert some renames to make the patch cleaner
 2019-12-04 22:54:38 +03:00
Mikhail Filimonov
34275626de Fix for https://github.com/ClickHouse/ClickHouse/issues/8003 : old producers do not write timestamp, but column still should have enough rows 2019-12-03 23:03:43 +01:00
Mikhail Filimonov
3de3ba336a Fix Native format in Kafka 2019-12-03 22:12:47 +01:00
Mikhail Filimonov
6e426592a7 Make the formats like RowBinaryWithNamesAndTypes work in Kafka & do not try to parse buffer when it at eof 2019-12-03 22:03:22 +01:00
alesapin
fa4728d44f Fix style 2019-12-03 20:57:00 +03:00
alesapin
2a43daec5c Buildable code 2019-12-03 20:15:16 +03:00
alesapin
20e4e92c49 Fix some conflicts 2019-12-03 19:32:41 +03:00
Pavel Kovalenko
a9e2327ec0 AWS S3 SDK integration. 2019-12-03 19:23:24 +03:00
Alexander Burmak
21623c3308 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-03 18:16:19 +03:00
alexey-milovidov
f09c29a2b6
Merge pull request #7992 from ClickHouse/excitoon-favorites-s3auth 
Merging #7623
 2019-12-03 15:21:12 +03:00
Alexey Milovidov
0da80b3c7b Merge branch 'master' of github.com:yandex/ClickHouse into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 04:35:42 +03:00
Alexey Milovidov
eef44d3fc5 Merge branch 'master' into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 04:31:08 +03:00
alexey-milovidov
87adf355e8
Merge pull request #7935 from filimonov/kafka_perf 
[wip] attempt to improve kafka parsing performance
 2019-12-03 03:52:40 +03:00
alexey-milovidov
b6edda194f
Update KafkaBlockInputStream.cpp 2019-12-03 03:52:02 +03:00
Alexey Milovidov
d70b73f033 Merge branch 's3auth' of https://github.com/excitoon-favorites/ClickHouse into excitoon-favorites-s3auth 2019-12-03 03:06:01 +03:00
alexey-milovidov
fe05565cec
Update StorageS3.cpp 2019-12-03 03:03:44 +03:00
Alexey Milovidov
fc174dce6e More simple 2019-12-03 02:50:53 +03:00
Alexey Milovidov
9d099bde8e Merge branch 'master' into fix_check_table_with_empty_pk 2019-12-03 02:36:21 +03:00
alexey-milovidov
e44dc0a6c8
Merge pull request #7981 from ClickHouse/fix_number_of_streams_for_storages_with_globs 
Limit number of streams for read from StorageFile and StorageHDFS
 2019-12-03 02:23:10 +03:00
Alexey Milovidov
060e4db596 Fixed build 2019-12-03 01:37:24 +03:00
Alexey Milovidov
034ef665f1 Merge branch 'master' of github.com:yandex/ClickHouse into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 00:36:31 +03:00
chertus
a179c5025f Merge branch 'master' into joins 2019-12-02 21:08:39 +03:00
chertus
5ce65546e9 semi & anti join 2019-12-02 21:08:04 +03:00
Vitaly Baranov
b2685a3710
Merge pull request #7727 from kekekekule/master 
Added lifetime to system.dictionaries #6820
 2019-12-02 15:15:44 +03:00
alesapin
08dfd1d1c4 Limit number of streams for read from StorageFile and StorageHDFS 2019-12-02 14:25:41 +03:00
alesapin
a4ca30b5fd Fix bug in check table for tables without primary key 2019-12-02 13:30:04 +03:00
Vladimir Chebotarev
8dbfcdb3c3 Fixed failing tests. 2019-12-01 20:41:35 +03:00
Vladimir Chebotarev
ef5c4fb5a4 Remake of result_part_path. 2019-12-01 20:41:35 +03:00
Vladimir Chebotarev
b23d411f84 Filling result_part_path column of system.merges during the merge. 2019-12-01 20:41:35 +03:00
Vladimir Chebotarev
41c965e4ba Attempt to add is_move, source_part_paths, result_part_path columns to system.merges. 2019-12-01 20:41:35 +03:00
Vladimir Chebotarev
94684c07bf Added syntax for access_key_id and secret_access_key in S3 table function and storage. 2019-12-01 10:56:11 +03:00
Артем Стрельцов
25aa2114b2 Deleted redundant empty lines 2019-12-01 03:49:11 +03:00
Alexey Milovidov
8916b8f2e6 Make data skipping indices non-experimental. Make settings about data skipping indices, multiple JOINs and CROSS to INNER JOIN conversion obsolete, 2019-11-30 23:41:02 +03:00
Alexander Burmak
e5ffdc0224 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-11-29 18:27:56 +03:00
Nikolay Degterinsky
6b39253b71 Fixed naming 2019-11-29 17:15:12 +03:00
Nikolay Degterinsky
59002ddb91 Merge branch 'master' of https://github.com/kekekekule/ClickHouse into dict_lifetime 2019-11-29 17:06:38 +03:00
Mikhail Filimonov
ad136ec62d get rid of cloneWithColumns in internal loop and some other trash 2019-11-29 11:46:25 +01:00
Nikolai Kochetov
7a32ca057d
Merge pull request #7670 from excitoon-favorites/move_pool 
Separated pool for background moves
 2019-11-29 11:08:51 +03:00
hcz
dd7051bd98 Merge remote-tracking branch 'origin/master' into patch-2 2019-11-29 15:07:53 +08:00
Mikhail Filimonov
4cc0d0ca5d make virtual_columns local 2019-11-29 07:21:31 +01:00
Mikhail Filimonov
07722dfa93 more progress - cleanup internal cycles 2019-11-29 00:06:03 +01:00
alexey-milovidov
2e34f02a36
Merge pull request #7936 from ClickHouse/branch-for-slightly-improvement-of-usability-of-exception-messages 
The rest of PR #7897 about improvement of exception message
 2019-11-28 22:07:29 +03:00
Mikhail Filimonov
6217cb51f6 Get rid of InputStream layer for Kafka, use InputStream directly. Reopening port during reset. 2019-11-28 17:43:06 +01:00
stavrolia
295633b7ef Another try 2019-11-28 17:31:35 +03:00
Anton Popov
9fe987c8e1
Merge pull request #7920 from excitoon-favorites/datetimettl 
Removed check for using `Date` or `DateTime` column from TTL expressions
 2019-11-27 19:55:57 +03:00
stavrolia
f23273fa80 Fix 2019-11-27 17:29:00 +03:00
Nikolai Kochetov
bd40c9cd13
Merge pull request #7933 from azat/dist-mon-codec-errors-mark-broken 
DirectoryMonitor: mark batch as broken on UNKNOWN_CODEC/CANNOT_DECOMPRESS errors
 2019-11-27 16:03:44 +03:00
Alexander Burmak
3e5ef56644 Filesystem abstraction layer 2019-11-27 14:33:27 +03:00
Vladimir Chebotarev
ecaa98e4e4 Allowed to use constant TTL expressions, updated tests. 2019-11-27 13:11:17 +03:00
Vladimir Chebotarev
c396af7c40 Removed check for using Date or DateTime column from TTL expressions. 2019-11-27 13:11:17 +03:00
stavrolia
f1e5e58480 Some rest of PR about improvement of exception message 2019-11-27 04:18:26 +03:00
Mikhail Filimonov
deec48a3e0 attempt to fix kafka parsing performance regression https://github.com/ClickHouse/ClickHouse/issues/7261 2019-11-27 00:46:19 +01:00
Azat Khuzhin
362505b129 DirectoryMonitor: mark batch as broken on UNKNOWN_CODEC/CANNOT_DECOMPRESS errors 
There is no point in retrying batch after those errors (for the same
reasons as CHECKSUM_DOESNT_MATCH is there).
 2019-11-26 20:21:05 +03:00
Vladimir Chebotarev
37bc15779d Better logging of BackgroundMovePool. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
37bebd1370 Improved BackgroundProcessingPool to use with background moves task. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
e96c24786b Separated pool for background moves. 2019-11-26 16:08:59 +03:00
Olga Khvostikova
47e499d71b
Merge pull request #7833 from excitoon-favorites/detachedparts 
Added disk info to `system.detached_parts`
 2019-11-26 11:56:50 +03:00
Nikolai Kochetov
c97212d132 Remove unused variable. 2019-11-25 16:35:28 +03:00
Nikolai Kochetov
d3118f0a76 Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:57:14 +03:00
Nikolai Kochetov
9b42e9341d Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:49:05 +03:00
Nikolai Kochetov
f770934e60 Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:05:29 +03:00