Commit Graph

1687 Commits

Author SHA1 Message Date
Azat Khuzhin
673ddc9d77 Drop superfluous locking for atomic in DirectoryMonitor 2020-04-19 00:22:48 +03:00
alexey-milovidov
aac7cc7330
Merge pull request #10126 from Jokser/replicated-merge-tree-s3
Support ReplicatedMergeTree over S3
2020-04-18 16:13:04 +03:00
alexey-milovidov
46a5c75beb
Update MergeTreeData.h 2020-04-18 16:11:57 +03:00
alexey-milovidov
8cea45315f
Merge pull request #10133 from 4ertus2/joins
JOIN with Dictionary
2020-04-18 16:08:15 +03:00
alexey-milovidov
959e6cd032
Merge pull request #10221 from ClickHouse/remove-part-special-case
Support for one special case of removing incompletely written parts
2020-04-18 15:58:58 +03:00
alexey-milovidov
72dd453c3f
Merge pull request #10234 from vitlibar/show-columns-of-not-loaded-dictionary
Show information about not loaded dictionaries in system tables.
2020-04-18 15:06:08 +03:00
alexey-milovidov
17b6e0b3e5
Merge pull request #10315 from azat/buffer-flush-bg-pool
Use background thread pool for background buffer flushes
2020-04-18 15:04:35 +03:00
Dmitry
25cd4ce132 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-04-18 12:56:34 +03:00
Vitaly Baranov
d62345bbaa Show information about not loaded dictionaries in system.columns, system.tables
and in "SHOW TABLES" executed in any database with the "Dictionary" engine.
2020-04-18 12:50:54 +03:00
Anton Popov
391f7c34be in memory parts: basic read/write 2020-04-17 20:30:46 +03:00
Nikolai Kochetov
84faa9af26 Merge branch 'master' into shared-context-lifetime 2020-04-17 19:13:13 +03:00
Anton Popov
ee4eb97c3f in-memory parts: preparation 2020-04-17 15:15:20 +03:00
Anton Popov
9a2855fae7 in-memory parts: preparation 2020-04-17 15:15:20 +03:00
Anton Popov
f7b7b5eb74 remove unused flags 2020-04-17 14:59:10 +03:00
Nikolai Kochetov
d51a9c551b Remove shared_ptr to SharedContext from Context. 2020-04-17 12:47:40 +03:00
Alexey Milovidov
fdc5688d2d Added memory usage to AsynchronousMetrics 2020-04-17 07:09:41 +03:00
Alexey Milovidov
fb095ad787 Merge branch 'master' into remove-part-special-case 2020-04-17 06:14:15 +03:00
Alexey Milovidov
b16ee538ab Merge branch 'master' into sorting-processors 2020-04-17 05:31:55 +03:00
alexey-milovidov
17e7d4d88a
Merge pull request #10307 from abyss7/arcadia-4
Changes for auto-sync with Arcadia
2020-04-17 05:08:34 +03:00
Nikita Mikhaylov
6b58998a36 better 2020-04-16 22:57:39 +03:00
Nikita Mikhaylov
c153cc8fe5 fixed :) 2020-04-16 22:54:11 +03:00
Nikita Mikhaylov
9a80eb6e47 Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-16 21:47:34 +03:00
Nikita Mikhaylov
85fbf413c1 server crashes, just to save 2020-04-16 21:47:20 +03:00
Azat Khuzhin
a9b1b36907 Use separate pool for buffer flushes (background_buffer_flush_schedule_pool_size) 2020-04-16 20:14:28 +03:00
Artem Zuikov
47cb670213 Merge branch 'master' into joins 2020-04-16 19:06:13 +03:00
Alexander Tokmakov
605f3b2119 fix DROP vs OPTIMIZE race in ReplicatedMergeTree 2020-04-16 18:30:18 +03:00
Ivan Lezhankin
e230632645 Changes required for auto-sync with Arcadia 2020-04-16 15:31:57 +03:00
Alexey Milovidov
cdeda4ab91 Fix usage of max_parser_depth setting; remove harmful default function arguments 2020-04-16 04:06:10 +03:00
Alexey Milovidov
f704c465a7 Make aware of one special case of imcompletely written parts #9940 2020-04-16 00:52:21 +03:00
Nikolai Kochetov
153f795ebe Merge branch 'master' into sorting-processors 2020-04-15 12:07:05 +03:00
Alexey Milovidov
8ad04d4fec Remove useless code 2020-04-15 00:05:45 +03:00
Nikolai Kochetov
12f4cfb2c7 Use processors for final. 2020-04-14 13:04:49 +03:00
Nikolai Kochetov
434a13a8bd Move algorithm to separate files. 2020-04-14 12:21:24 +03:00
alexey-milovidov
9de981d8d3
Merge pull request #10052 from Vxider/mv_parallel_insert
Enable parallel INSERT for materialized view
2020-04-14 01:30:44 +03:00
alexey-milovidov
2219f05139
Merge pull request #10235 from ClickHouse/fix_range_hashed_ddl_dictionaries
Fix 'Cannot add column' in DDL dictionary
2020-04-14 01:28:24 +03:00
Nikita Mikhaylov
89f80a6353
Merge branch 'master' into quorum_bug 2020-04-13 23:25:55 +04:00
Alexander Tokmakov
b7d4bccc77 fix build 2020-04-13 22:02:13 +03:00
Artem Zuikov
6106b2bfc7 Merge branch 'master' into joins 2020-04-13 20:37:27 +03:00
Nikita Mikhaylov
68e82c11e0 fix build 2020-04-13 18:58:29 +03:00
Alexander Tokmakov
6c0d9723e0 Merge branch 'master' into database_atomic 2020-04-13 18:47:47 +03:00
Nikita Mikhaylov
441bb13d4a better 2020-04-13 18:21:05 +03:00
alesapin
9cc7d0f06a Fix 'Cannot add column' error while creating range_hashed dictionary using DDL queries 2020-04-13 17:34:01 +03:00
alexey-milovidov
396360cd90
Merge pull request #10209 from ClickHouse/akz/fix_segfault_in_system_tables
Fix N.P. segfault in StorageSystemTables for database engine "Lazy"
2020-04-13 16:33:27 +03:00
alexey-milovidov
eedb5a3e3d
Merge pull request #10218 from ClickHouse/fix-generate-random-date
Fixed "generateRandom" function for Date type
2020-04-13 16:26:08 +03:00
Nikita Mikhaylov
d5c055ab03 remove logs 2020-04-13 15:13:13 +03:00
Alexey Milovidov
8ad89a82d4 Support Nested types in "generateRandom" 2020-04-13 02:08:32 +03:00
Alexey Milovidov
860e9092f1 Fixed another inconsistency in partition names 2020-04-13 01:25:41 +03:00
Alexey Milovidov
4788eb3423 Make the assertion in code consistent with the real partition expression 2020-04-13 01:00:03 +03:00
Alexey Milovidov
3215257a90 Fixed "generateRandom" function for Date type #9973 2020-04-13 00:27:11 +03:00
Alexey Milovidov
983950d4ec Convert types in Views 2020-04-13 00:07:11 +03:00
Alexander Tokmakov
20e6593f96 disable by default 2020-04-12 21:52:59 +03:00
Alexander Kazakov
2eb2e4cf41 Added proper nullptr check 2020-04-12 20:17:41 +03:00
Alexander Tokmakov
5e6d4b9449 Merge branch 'master' into database_atomic 2020-04-12 16:35:44 +03:00
alexey-milovidov
b888c867b3
Merge pull request #10026 from CurtizJ/speedup-index
Improve performance of index analysis with monotonic functions [2].
2020-04-12 06:37:26 +03:00
alexey-milovidov
78316f027a
Merge pull request #10195 from ClickHouse/fix-array-join-prewhere
Fix move-to-prewhere optimization in presense of arrayJoin functions.
2020-04-12 03:53:55 +03:00
alexey-milovidov
f5fc3b1e71
Merge pull request #10085 from achimbab/transform_null_in
transform_null_in option to test NULL values at the IN-Operator.
2020-04-12 02:01:54 +03:00
Alexey Milovidov
cf9f00644e Fix the issue with arrayJoin and PREWHERE optimization #10092 2020-04-12 01:13:06 +03:00
Alexey Milovidov
121bf7b8c2 Whitespace #9968 2020-04-12 00:37:19 +03:00
alexey-milovidov
f472535f54
Merge pull request #9968 from Enmk/SIMD_tokenization
Splitting string into Alpha-Num tokens with SIMD intrinsics.
2020-04-12 00:33:29 +03:00
alexey-milovidov
00d8e7eefb
Merge branch 'master' into transform_null_in 2020-04-11 23:15:54 +03:00
alexey-milovidov
cd979d7997
Merge pull request #10130 from CurtizJ/polymorphic-parts
Fix some kinds of alters with compact parts
2020-04-11 23:02:48 +03:00
Vitaly Baranov
18fbd968ba
Merge pull request #10165 from azat/drop-dictionary-as-table
Do not break DROP DICTIONARY with DROP TABLE
2020-04-11 14:49:41 +03:00
Nikita Mikhaylov
a8d72d01c3 mvp fix 2020-04-11 00:29:54 +03:00
Azat Khuzhin
5b3c635200 Do not break DROP DICTIONARY after DROP TABLE executed on dictionary 2020-04-10 21:10:32 +03:00
Alexey Milovidov
39bbc1071b Fix typo 2020-04-10 20:23:51 +03:00
Alexander Tokmakov
033d7f9b32 Merge branch 'master' into database_atomic 2020-04-10 17:12:09 +03:00
Anton Popov
d018977f4b fix 'ALTER CLEAR INDEX/COLUMN' queries with compact parts 2020-04-10 16:36:51 +03:00
Nikolai Kochetov
978576d0c5 Move Graphite params to separate file. 2020-04-10 12:25:52 +03:00
Nikolai Kochetov
71c72a75d7 Move Graphite params to separate file. 2020-04-10 12:24:16 +03:00
Nikolai Kochetov
868f7e9aea Move Graphite params to separate file. 2020-04-10 12:16:23 +03:00
Nikolai Kochetov
1b6d80bfae Merge branch 'master' into sorting-processors 2020-04-10 12:07:21 +03:00
Nikolai Kochetov
d3acce8afa Fix build. 2020-04-10 12:04:28 +03:00
Alexander Kazakov
497df3086f Merge branch 'master' into timed_rwlock
Change-Id: I620bfde2121ff013773b001d514b40b1e796a58b
2020-04-10 11:38:20 +03:00
philip.han
7fa5afecb4 Support transform_null_in option for StorageSet 2020-04-10 14:42:36 +09:00
Alexander Tokmakov
50decc755d fix rename materialized view 2020-04-10 04:35:37 +03:00
Alexander Kazakov
0accd2908c Fix up styler's grudge 2020-04-09 23:11:20 +03:00
Alexander Kazakov
26dd6140b2 Added new config settings to control timeouts
* "lock_acquire_timeout" controls for how long a query will continue to
acquire each lock on its argument tables
 * "lock_acquire_timeout_for_background_operations" is a per-table
setting for storages of *MergeTree family
2020-04-09 21:10:27 +03:00
Anton Popov
76cf9b7f03 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-04-09 20:16:45 +03:00
Artem Zuikov
9f0db4dfef Merge branch 'master' into joins 2020-04-09 11:53:18 +03:00
philip.han
3149f75430 Replace a reference for Context with a copied bool value. 2020-04-09 17:27:55 +09:00
alexey-milovidov
6ff4c3aa16
Merge pull request #10135 from azat/distributed-insert-converting
Convert blocks if structure does not match on INSERT into Distributed()
2020-04-09 05:51:36 +03:00
Alexander Tokmakov
140cd88c20 fixes 2020-04-09 02:59:39 +03:00
Alexey Milovidov
540e9f7d0d Fix logged number of inserted rows into ReplicatedMergeTree 2020-04-09 01:58:15 +03:00
Azat Khuzhin
6d85207bfb Convert blocks if structure does not match on INSERT into Distributed()
Follow-up for: #10105
2020-04-08 23:46:01 +03:00
alexey-milovidov
c389fee7e7
Update StorageReplicatedMergeTree.cpp 2020-04-08 22:48:01 +03:00
Alexander Tokmakov
dd1590830b Merge branch 'master' into database_atomic 2020-04-08 22:00:46 +03:00
Artem Zuikov
8d6f641796 join over dictionary concept 2020-04-08 21:59:52 +03:00
Anton Popov
c8c4dc8104 fix 'ALTER MODIFY COLUMN' with compact parts 2020-04-08 19:20:52 +03:00
Pavel Kovalenko
89fe81ed62 Integration test for ReplicatedMergeTree over S3 fixes. 2020-04-08 14:56:31 +03:00
Pavel Kovalenko
bc349a563a Merge branch 'master' into replicated-merge-tree-s3 2020-04-08 13:53:30 +03:00
alesapin
ded306f016 Fix adaptive granularity compatibility 2020-04-08 12:51:04 +03:00
Pavel Kovalenko
5b2b8d38fa Download part trough disk interface. 2020-04-08 11:41:13 +03:00
alexey-milovidov
a46a61c970
Update KeyCondition.h 2020-04-08 05:56:25 +03:00
alexey-milovidov
a42d875a68
Update KeyCondition.h 2020-04-08 05:55:39 +03:00
alexey-milovidov
723a1f41e2
Update KeyCondition.h 2020-04-08 05:55:22 +03:00
alexey-milovidov
94a621060d
Update KeyCondition.h 2020-04-08 05:55:03 +03:00
alexey-milovidov
a6194364ea
Update MergeTreeDataSelectExecutor.cpp 2020-04-08 05:54:08 +03:00
alexey-milovidov
6d80ab1eed
Merge pull request #9811 from vitlibar/RBAC-8
RBAC-8
2020-04-08 05:47:55 +03:00
alexey-milovidov
dd333460d6
Merge pull request #10068 from ClickHouse/fix_check_table_with_index
Fix bug with uncompressed checksums in CHECK TABLE query
2020-04-08 05:37:18 +03:00
alexey-milovidov
dad892e9d4
Merge pull request #10105 from azat/distributed-insert-types-differs
Fix SIGSEGV on INSERT into Distributed on different struct with underlying
2020-04-08 05:36:02 +03:00
Anton Popov
cbdc3ef214 Merge remote-tracking branch 'upstream/master' into speedup-index 2020-04-08 04:15:48 +03:00
Alexander Tokmakov
135197aa75 fixes 2020-04-08 04:02:00 +03:00
alexey-milovidov
09a397a68f
Merge pull request #9997 from azat/dist-on-dist-fixes
Fix Distributed-over-Distributed with one only shard in nested table
2020-04-08 03:45:29 +03:00
alexey-milovidov
ebe9ae4fab
Update StorageMerge.cpp 2020-04-08 03:45:11 +03:00
alexey-milovidov
1b704425b6
Update StorageBuffer.cpp 2020-04-08 03:42:47 +03:00
Azat Khuzhin
b2fa9d8750 Fix SIGSEGV on INSERT into Distributed on different struct with underlying 2020-04-08 02:35:31 +03:00
alexey-milovidov
7bef5a6edb
Update checkDataPart.cpp 2020-04-08 02:13:53 +03:00
Vitaly Baranov
e573549945 Rework access rights for table functions. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
423fa5087a Add SHOW_USERS(SHOW ROLES, etc.) privileges. 2020-04-07 23:20:38 +03:00
alexey-milovidov
ead277b717
Update StorageReplicatedMergeTree.cpp 2020-04-07 20:23:26 +03:00
alexey-milovidov
2654f131cc
Update checkDataPart.cpp 2020-04-07 20:08:46 +03:00
alesapin
27777c1d2b Better comment 2020-04-07 18:55:23 +03:00
Alexander Tokmakov
4c48b7dd80 better rename 2020-04-07 18:31:33 +03:00
alesapin
82a87bc0d2 Fix replicated tables startup when updating from old version 2020-04-07 18:28:29 +03:00
alesapin
0d7cff2b25 Merge branch 'master' into fix_check_table_with_index 2020-04-07 16:36:09 +03:00
alesapin
f1e0f15556
Merge pull request #9948 from ClickHouse/alter_rename_column
Alter rename column
2020-04-07 15:28:00 +03:00
Alexander Kazakov
621d26bcf7 Better timeout diagnostics message 2020-04-07 14:34:35 +03:00
philip.han
53b5dade5e Implement transform_null_in 2020-04-07 20:08:13 +09:00
Artem Zuikov
8297683972
renames: AnalyzedJoin -> TableJoin, Join -> HashJoin (#10065) 2020-04-07 12:48:47 +03:00
Vasily Nemkov
ef07c6d06f Merge remote-tracking branch 'upstream/master' into SIMD_tokenization 2020-04-07 11:25:52 +03:00
Alexander Kazakov
2e76e4d1ed Made clang happy - fixed build 2020-04-07 10:15:59 +03:00
Alexander Kazakov
09ce548376 All locks in IStorage have timeouts now 2020-04-07 02:45:51 +03:00
Alexander Tokmakov
a2101c9b1c better code 2020-04-07 02:22:44 +03:00
Vasily Nemkov
738e8a7ef8 Minor test refactoring
* using string literal for binary strings
* sorted includes
2020-04-06 21:41:11 +03:00
Vasily Nemkov
3d471556fb Merge commit '73b0f8db8c327a1d63cc7ebcc56087a3f9866dae' into SIMD_tokenization 2020-04-06 20:05:02 +03:00
alesapin
c17fa34fa5 Fix bug with uncompressed checksums in CHECK TABLE query 2020-04-06 20:00:29 +03:00
Anton Popov
2dc1eddfab fix FieldRef 2020-04-06 16:35:11 +03:00
Alexander Tokmakov
08bae4668d Merge branch 'master' into database_atomic 2020-04-06 16:18:07 +03:00
Anton Popov
5ada959853 improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
Anton Popov
79024d73a2 improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
alesapin
1cb072d58a Merge branch 'master' into alter_rename_column 2020-04-06 11:40:27 +03:00
Alexey Milovidov
110eb599c1 Fix "check style" tool 2020-04-06 02:57:24 +03:00
Vxider
21532f6a6d parallel insert for materialized view 2020-04-05 01:33:51 +08:00
Nikolai Kochetov
e23fda80aa Merge with master 2020-04-04 19:02:17 +03:00
Azat Khuzhin
1232760f78 Fix Distributed-over-Distributed when nested table has only one shard 2020-04-04 13:47:35 +03:00
Azat Khuzhin
8d372b0be7 Call getQueryProcessingStage() once, since it is heavy for StorageDistributed
Refs: #9808
2020-04-04 13:47:34 +03:00
Ivan Lezhankin
06446b4f08 dbms/ → src/ 2020-04-03 18:14:31 +03:00