Commit Graph

397 Commits

Author SHA1 Message Date
alesapin
1bc84ec8b4 Fix comments 2020-04-20 13:56:23 +03:00
alesapin
8767ea7efa Add setting which restrict replica to merge parts by itself and always prefer dowloading from other replicas. 2020-04-20 13:53:29 +03:00
Nikolai Kochetov
052598534a Try fix unit tests. 2020-04-20 12:42:56 +03:00
Alexey Milovidov
d7264b292d Merge branch 'master' into sorting-processors 2020-04-20 09:29:41 +03:00
Alexey Milovidov
47e4d14ece Whitespace 2020-04-20 09:13:04 +03:00
alexey-milovidov
1577d771df
Merge pull request #10341 from azat/auto_distributed_group_by_no_merge
Auto distributed_group_by_no_merge on GROUP BY sharding key
2020-04-20 08:30:27 +03:00
Alexey Milovidov
a3195d56ae Fix translation 2020-04-20 07:19:50 +03:00
Alexey Milovidov
7023e096ec Check for error code in part check #6269 2020-04-20 04:44:24 +03:00
Azat Khuzhin
e44d5c5749 Fix clang readability-container-size-empty warning in StorageDistributed::canForceGroupByNoMerge() 2020-04-20 01:12:22 +03:00
Alexey Milovidov
25f3184dbe Merge branch 'master' into async-metric-memory-usage 2020-04-19 23:18:12 +03:00
Azat Khuzhin
be1dec9239 Fix distributed_group_by_no_merge optimization for Distributed-over-Distributed 2020-04-19 21:11:14 +03:00
Azat Khuzhin
93d049fe64 Allow auto distributed_group_by_no_merge for DISTINCT of sharding key 2020-04-19 18:53:37 +03:00
Azat Khuzhin
de4a723264 Auto distributed_group_by_no_merge on GROUP BY injective function of sharding key 2020-04-19 18:33:49 +03:00
Azat Khuzhin
5d11118cc9 Use thread pool (background_distributed_schedule_pool_size) for distributed sends
After #8756 the problem with 1 thread for each (distributed table, disk)
for distributed sends became even worse (since there can be multiple
disks), so use predefined thread pool for this tasks, that can be
controlled with background_distributed_schedule_pool_size knob.
2020-04-19 12:01:56 +03:00
Azat Khuzhin
673ddc9d77 Drop superfluous locking for atomic in DirectoryMonitor 2020-04-19 00:22:48 +03:00
alexey-milovidov
aac7cc7330
Merge pull request #10126 from Jokser/replicated-merge-tree-s3
Support ReplicatedMergeTree over S3
2020-04-18 16:13:04 +03:00
alexey-milovidov
46a5c75beb
Update MergeTreeData.h 2020-04-18 16:11:57 +03:00
alexey-milovidov
8cea45315f
Merge pull request #10133 from 4ertus2/joins
JOIN with Dictionary
2020-04-18 16:08:15 +03:00
alexey-milovidov
959e6cd032
Merge pull request #10221 from ClickHouse/remove-part-special-case
Support for one special case of removing incompletely written parts
2020-04-18 15:58:58 +03:00
alexey-milovidov
72dd453c3f
Merge pull request #10234 from vitlibar/show-columns-of-not-loaded-dictionary
Show information about not loaded dictionaries in system tables.
2020-04-18 15:06:08 +03:00
alexey-milovidov
17b6e0b3e5
Merge pull request #10315 from azat/buffer-flush-bg-pool
Use background thread pool for background buffer flushes
2020-04-18 15:04:35 +03:00
Vitaly Baranov
d62345bbaa Show information about not loaded dictionaries in system.columns, system.tables
and in "SHOW TABLES" executed in any database with the "Dictionary" engine.
2020-04-18 12:50:54 +03:00
Nikolai Kochetov
84faa9af26 Merge branch 'master' into shared-context-lifetime 2020-04-17 19:13:13 +03:00
Anton Popov
f7b7b5eb74 remove unused flags 2020-04-17 14:59:10 +03:00
Nikolai Kochetov
d51a9c551b Remove shared_ptr to SharedContext from Context. 2020-04-17 12:47:40 +03:00
Alexey Milovidov
fdc5688d2d Added memory usage to AsynchronousMetrics 2020-04-17 07:09:41 +03:00
Alexey Milovidov
fb095ad787 Merge branch 'master' into remove-part-special-case 2020-04-17 06:14:15 +03:00
Alexey Milovidov
b16ee538ab Merge branch 'master' into sorting-processors 2020-04-17 05:31:55 +03:00
alexey-milovidov
17e7d4d88a
Merge pull request #10307 from abyss7/arcadia-4
Changes for auto-sync with Arcadia
2020-04-17 05:08:34 +03:00
Nikita Mikhaylov
6b58998a36 better 2020-04-16 22:57:39 +03:00
Nikita Mikhaylov
c153cc8fe5 fixed :) 2020-04-16 22:54:11 +03:00
Nikita Mikhaylov
9a80eb6e47 Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-16 21:47:34 +03:00
Nikita Mikhaylov
85fbf413c1 server crashes, just to save 2020-04-16 21:47:20 +03:00
Azat Khuzhin
a9b1b36907 Use separate pool for buffer flushes (background_buffer_flush_schedule_pool_size) 2020-04-16 20:14:28 +03:00
Artem Zuikov
47cb670213 Merge branch 'master' into joins 2020-04-16 19:06:13 +03:00
Alexander Tokmakov
605f3b2119 fix DROP vs OPTIMIZE race in ReplicatedMergeTree 2020-04-16 18:30:18 +03:00
Ivan Lezhankin
e230632645 Changes required for auto-sync with Arcadia 2020-04-16 15:31:57 +03:00
Alexey Milovidov
cdeda4ab91 Fix usage of max_parser_depth setting; remove harmful default function arguments 2020-04-16 04:06:10 +03:00
Alexey Milovidov
f704c465a7 Make aware of one special case of imcompletely written parts #9940 2020-04-16 00:52:21 +03:00
Nikolai Kochetov
153f795ebe Merge branch 'master' into sorting-processors 2020-04-15 12:07:05 +03:00
Alexey Milovidov
8ad04d4fec Remove useless code 2020-04-15 00:05:45 +03:00
Nikolai Kochetov
12f4cfb2c7 Use processors for final. 2020-04-14 13:04:49 +03:00
Nikolai Kochetov
434a13a8bd Move algorithm to separate files. 2020-04-14 12:21:24 +03:00
alexey-milovidov
9de981d8d3
Merge pull request #10052 from Vxider/mv_parallel_insert
Enable parallel INSERT for materialized view
2020-04-14 01:30:44 +03:00
alexey-milovidov
2219f05139
Merge pull request #10235 from ClickHouse/fix_range_hashed_ddl_dictionaries
Fix 'Cannot add column' in DDL dictionary
2020-04-14 01:28:24 +03:00
Nikita Mikhaylov
89f80a6353
Merge branch 'master' into quorum_bug 2020-04-13 23:25:55 +04:00
Alexander Tokmakov
b7d4bccc77 fix build 2020-04-13 22:02:13 +03:00
Artem Zuikov
6106b2bfc7 Merge branch 'master' into joins 2020-04-13 20:37:27 +03:00
Nikita Mikhaylov
68e82c11e0 fix build 2020-04-13 18:58:29 +03:00
Alexander Tokmakov
6c0d9723e0 Merge branch 'master' into database_atomic 2020-04-13 18:47:47 +03:00
Nikita Mikhaylov
441bb13d4a better 2020-04-13 18:21:05 +03:00
alesapin
9cc7d0f06a Fix 'Cannot add column' error while creating range_hashed dictionary using DDL queries 2020-04-13 17:34:01 +03:00
alexey-milovidov
396360cd90
Merge pull request #10209 from ClickHouse/akz/fix_segfault_in_system_tables
Fix N.P. segfault in StorageSystemTables for database engine "Lazy"
2020-04-13 16:33:27 +03:00
alexey-milovidov
eedb5a3e3d
Merge pull request #10218 from ClickHouse/fix-generate-random-date
Fixed "generateRandom" function for Date type
2020-04-13 16:26:08 +03:00
Nikita Mikhaylov
d5c055ab03 remove logs 2020-04-13 15:13:13 +03:00
Alexey Milovidov
8ad89a82d4 Support Nested types in "generateRandom" 2020-04-13 02:08:32 +03:00
Alexey Milovidov
860e9092f1 Fixed another inconsistency in partition names 2020-04-13 01:25:41 +03:00
Alexey Milovidov
4788eb3423 Make the assertion in code consistent with the real partition expression 2020-04-13 01:00:03 +03:00
Alexey Milovidov
3215257a90 Fixed "generateRandom" function for Date type #9973 2020-04-13 00:27:11 +03:00
Alexey Milovidov
983950d4ec Convert types in Views 2020-04-13 00:07:11 +03:00
Alexander Tokmakov
20e6593f96 disable by default 2020-04-12 21:52:59 +03:00
Alexander Kazakov
2eb2e4cf41 Added proper nullptr check 2020-04-12 20:17:41 +03:00
Alexander Tokmakov
5e6d4b9449 Merge branch 'master' into database_atomic 2020-04-12 16:35:44 +03:00
alexey-milovidov
b888c867b3
Merge pull request #10026 from CurtizJ/speedup-index
Improve performance of index analysis with monotonic functions [2].
2020-04-12 06:37:26 +03:00
alexey-milovidov
78316f027a
Merge pull request #10195 from ClickHouse/fix-array-join-prewhere
Fix move-to-prewhere optimization in presense of arrayJoin functions.
2020-04-12 03:53:55 +03:00
alexey-milovidov
f5fc3b1e71
Merge pull request #10085 from achimbab/transform_null_in
transform_null_in option to test NULL values at the IN-Operator.
2020-04-12 02:01:54 +03:00
Alexey Milovidov
cf9f00644e Fix the issue with arrayJoin and PREWHERE optimization #10092 2020-04-12 01:13:06 +03:00
Alexey Milovidov
121bf7b8c2 Whitespace #9968 2020-04-12 00:37:19 +03:00
alexey-milovidov
f472535f54
Merge pull request #9968 from Enmk/SIMD_tokenization
Splitting string into Alpha-Num tokens with SIMD intrinsics.
2020-04-12 00:33:29 +03:00
alexey-milovidov
00d8e7eefb
Merge branch 'master' into transform_null_in 2020-04-11 23:15:54 +03:00
alexey-milovidov
cd979d7997
Merge pull request #10130 from CurtizJ/polymorphic-parts
Fix some kinds of alters with compact parts
2020-04-11 23:02:48 +03:00
Vitaly Baranov
18fbd968ba
Merge pull request #10165 from azat/drop-dictionary-as-table
Do not break DROP DICTIONARY with DROP TABLE
2020-04-11 14:49:41 +03:00
Nikita Mikhaylov
a8d72d01c3 mvp fix 2020-04-11 00:29:54 +03:00
Azat Khuzhin
5b3c635200 Do not break DROP DICTIONARY after DROP TABLE executed on dictionary 2020-04-10 21:10:32 +03:00
Alexey Milovidov
39bbc1071b Fix typo 2020-04-10 20:23:51 +03:00
Alexander Tokmakov
033d7f9b32 Merge branch 'master' into database_atomic 2020-04-10 17:12:09 +03:00
Anton Popov
d018977f4b fix 'ALTER CLEAR INDEX/COLUMN' queries with compact parts 2020-04-10 16:36:51 +03:00
Nikolai Kochetov
978576d0c5 Move Graphite params to separate file. 2020-04-10 12:25:52 +03:00
Nikolai Kochetov
71c72a75d7 Move Graphite params to separate file. 2020-04-10 12:24:16 +03:00
Nikolai Kochetov
868f7e9aea Move Graphite params to separate file. 2020-04-10 12:16:23 +03:00
Nikolai Kochetov
1b6d80bfae Merge branch 'master' into sorting-processors 2020-04-10 12:07:21 +03:00
Nikolai Kochetov
d3acce8afa Fix build. 2020-04-10 12:04:28 +03:00
Alexander Kazakov
497df3086f Merge branch 'master' into timed_rwlock
Change-Id: I620bfde2121ff013773b001d514b40b1e796a58b
2020-04-10 11:38:20 +03:00
philip.han
7fa5afecb4 Support transform_null_in option for StorageSet 2020-04-10 14:42:36 +09:00
Alexander Tokmakov
50decc755d fix rename materialized view 2020-04-10 04:35:37 +03:00
Alexander Kazakov
0accd2908c Fix up styler's grudge 2020-04-09 23:11:20 +03:00
Alexander Kazakov
26dd6140b2 Added new config settings to control timeouts
* "lock_acquire_timeout" controls for how long a query will continue to
acquire each lock on its argument tables
 * "lock_acquire_timeout_for_background_operations" is a per-table
setting for storages of *MergeTree family
2020-04-09 21:10:27 +03:00
Anton Popov
76cf9b7f03 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-04-09 20:16:45 +03:00
Artem Zuikov
9f0db4dfef Merge branch 'master' into joins 2020-04-09 11:53:18 +03:00
philip.han
3149f75430 Replace a reference for Context with a copied bool value. 2020-04-09 17:27:55 +09:00
alexey-milovidov
6ff4c3aa16
Merge pull request #10135 from azat/distributed-insert-converting
Convert blocks if structure does not match on INSERT into Distributed()
2020-04-09 05:51:36 +03:00
Alexander Tokmakov
140cd88c20 fixes 2020-04-09 02:59:39 +03:00
Alexey Milovidov
540e9f7d0d Fix logged number of inserted rows into ReplicatedMergeTree 2020-04-09 01:58:15 +03:00
Azat Khuzhin
6d85207bfb Convert blocks if structure does not match on INSERT into Distributed()
Follow-up for: #10105
2020-04-08 23:46:01 +03:00
alexey-milovidov
c389fee7e7
Update StorageReplicatedMergeTree.cpp 2020-04-08 22:48:01 +03:00
Alexander Tokmakov
dd1590830b Merge branch 'master' into database_atomic 2020-04-08 22:00:46 +03:00
Artem Zuikov
8d6f641796 join over dictionary concept 2020-04-08 21:59:52 +03:00
Anton Popov
c8c4dc8104 fix 'ALTER MODIFY COLUMN' with compact parts 2020-04-08 19:20:52 +03:00
Pavel Kovalenko
89fe81ed62 Integration test for ReplicatedMergeTree over S3 fixes. 2020-04-08 14:56:31 +03:00
Pavel Kovalenko
bc349a563a Merge branch 'master' into replicated-merge-tree-s3 2020-04-08 13:53:30 +03:00
alesapin
ded306f016 Fix adaptive granularity compatibility 2020-04-08 12:51:04 +03:00
Pavel Kovalenko
5b2b8d38fa Download part trough disk interface. 2020-04-08 11:41:13 +03:00
alexey-milovidov
a46a61c970
Update KeyCondition.h 2020-04-08 05:56:25 +03:00
alexey-milovidov
a42d875a68
Update KeyCondition.h 2020-04-08 05:55:39 +03:00
alexey-milovidov
723a1f41e2
Update KeyCondition.h 2020-04-08 05:55:22 +03:00
alexey-milovidov
94a621060d
Update KeyCondition.h 2020-04-08 05:55:03 +03:00
alexey-milovidov
a6194364ea
Update MergeTreeDataSelectExecutor.cpp 2020-04-08 05:54:08 +03:00
alexey-milovidov
6d80ab1eed
Merge pull request #9811 from vitlibar/RBAC-8
RBAC-8
2020-04-08 05:47:55 +03:00
alexey-milovidov
dd333460d6
Merge pull request #10068 from ClickHouse/fix_check_table_with_index
Fix bug with uncompressed checksums in CHECK TABLE query
2020-04-08 05:37:18 +03:00
alexey-milovidov
dad892e9d4
Merge pull request #10105 from azat/distributed-insert-types-differs
Fix SIGSEGV on INSERT into Distributed on different struct with underlying
2020-04-08 05:36:02 +03:00
Anton Popov
cbdc3ef214 Merge remote-tracking branch 'upstream/master' into speedup-index 2020-04-08 04:15:48 +03:00
Alexander Tokmakov
135197aa75 fixes 2020-04-08 04:02:00 +03:00
alexey-milovidov
09a397a68f
Merge pull request #9997 from azat/dist-on-dist-fixes
Fix Distributed-over-Distributed with one only shard in nested table
2020-04-08 03:45:29 +03:00
alexey-milovidov
ebe9ae4fab
Update StorageMerge.cpp 2020-04-08 03:45:11 +03:00
alexey-milovidov
1b704425b6
Update StorageBuffer.cpp 2020-04-08 03:42:47 +03:00
Azat Khuzhin
b2fa9d8750 Fix SIGSEGV on INSERT into Distributed on different struct with underlying 2020-04-08 02:35:31 +03:00
alexey-milovidov
7bef5a6edb
Update checkDataPart.cpp 2020-04-08 02:13:53 +03:00
Vitaly Baranov
e573549945 Rework access rights for table functions. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
423fa5087a Add SHOW_USERS(SHOW ROLES, etc.) privileges. 2020-04-07 23:20:38 +03:00
alexey-milovidov
ead277b717
Update StorageReplicatedMergeTree.cpp 2020-04-07 20:23:26 +03:00
alexey-milovidov
2654f131cc
Update checkDataPart.cpp 2020-04-07 20:08:46 +03:00
alesapin
27777c1d2b Better comment 2020-04-07 18:55:23 +03:00
Alexander Tokmakov
4c48b7dd80 better rename 2020-04-07 18:31:33 +03:00
alesapin
82a87bc0d2 Fix replicated tables startup when updating from old version 2020-04-07 18:28:29 +03:00
alesapin
0d7cff2b25 Merge branch 'master' into fix_check_table_with_index 2020-04-07 16:36:09 +03:00
alesapin
f1e0f15556
Merge pull request #9948 from ClickHouse/alter_rename_column
Alter rename column
2020-04-07 15:28:00 +03:00
Alexander Kazakov
621d26bcf7 Better timeout diagnostics message 2020-04-07 14:34:35 +03:00
philip.han
53b5dade5e Implement transform_null_in 2020-04-07 20:08:13 +09:00
Artem Zuikov
8297683972
renames: AnalyzedJoin -> TableJoin, Join -> HashJoin (#10065) 2020-04-07 12:48:47 +03:00
Vasily Nemkov
ef07c6d06f Merge remote-tracking branch 'upstream/master' into SIMD_tokenization 2020-04-07 11:25:52 +03:00
Alexander Kazakov
2e76e4d1ed Made clang happy - fixed build 2020-04-07 10:15:59 +03:00
Alexander Kazakov
09ce548376 All locks in IStorage have timeouts now 2020-04-07 02:45:51 +03:00
Alexander Tokmakov
a2101c9b1c better code 2020-04-07 02:22:44 +03:00
Vasily Nemkov
738e8a7ef8 Minor test refactoring
* using string literal for binary strings
* sorted includes
2020-04-06 21:41:11 +03:00
Vasily Nemkov
3d471556fb Merge commit '73b0f8db8c327a1d63cc7ebcc56087a3f9866dae' into SIMD_tokenization 2020-04-06 20:05:02 +03:00
alesapin
c17fa34fa5 Fix bug with uncompressed checksums in CHECK TABLE query 2020-04-06 20:00:29 +03:00
Anton Popov
2dc1eddfab fix FieldRef 2020-04-06 16:35:11 +03:00
Alexander Tokmakov
08bae4668d Merge branch 'master' into database_atomic 2020-04-06 16:18:07 +03:00
Anton Popov
5ada959853 improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
Anton Popov
79024d73a2 improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
alesapin
1cb072d58a Merge branch 'master' into alter_rename_column 2020-04-06 11:40:27 +03:00
Alexey Milovidov
110eb599c1 Fix "check style" tool 2020-04-06 02:57:24 +03:00
Vxider
21532f6a6d parallel insert for materialized view 2020-04-05 01:33:51 +08:00
Nikolai Kochetov
e23fda80aa Merge with master 2020-04-04 19:02:17 +03:00
Azat Khuzhin
1232760f78 Fix Distributed-over-Distributed when nested table has only one shard 2020-04-04 13:47:35 +03:00
Azat Khuzhin
8d372b0be7 Call getQueryProcessingStage() once, since it is heavy for StorageDistributed
Refs: #9808
2020-04-04 13:47:34 +03:00
Ivan Lezhankin
06446b4f08 dbms/ → src/ 2020-04-03 18:14:31 +03:00