Commit Graph

529 Commits

Author SHA1 Message Date
Alexey Milovidov
39c6c9a5d7 Merge remote-tracking branch 'origin/master' into system-tables-lazy-load 2020-04-20 02:00:46 +03:00
Alexey Milovidov
3755a5ba54 Added suggestion from Azat 2020-04-20 01:59:21 +03:00
Alexey Milovidov
2987e70aab Introduce "max_server_memory_usage" setting 2020-04-20 01:59:21 +03:00
Alexey Milovidov
ec6b176f3b Rework total memory tracker #10293 2020-04-20 01:59:21 +03:00
Azat Khuzhin
e44d5c5749 Fix clang readability-container-size-empty warning in StorageDistributed::canForceGroupByNoMerge() 2020-04-20 01:12:22 +03:00
Alexey Milovidov
1c00953b3e Added test tool 2020-04-19 23:57:34 +03:00
Alexey Milovidov
71c4418876 More memory statistics 2020-04-19 23:49:13 +03:00
Alexey Milovidov
25f3184dbe Merge branch 'master' into async-metric-memory-usage 2020-04-19 23:18:12 +03:00
Alexey Milovidov
8d3e6ed5e3 Added missing code 2020-04-19 23:04:59 +03:00
Alexey Milovidov
ca6bea3731 Added a patch from Alexander Burmak 2020-04-19 22:53:12 +03:00
Azat Khuzhin
be1dec9239 Fix distributed_group_by_no_merge optimization for Distributed-over-Distributed 2020-04-19 21:11:14 +03:00
Azat Khuzhin
93d049fe64 Allow auto distributed_group_by_no_merge for DISTINCT of sharding key 2020-04-19 18:53:37 +03:00
Nikolai Kochetov
67b3487207 Try fix build. 2020-04-19 18:46:12 +03:00
Nikolai Kochetov
e969f66aca Try fix test. 2020-04-19 18:41:35 +03:00
Azat Khuzhin
de4a723264 Auto distributed_group_by_no_merge on GROUP BY injective function of sharding key 2020-04-19 18:33:49 +03:00
Azat Khuzhin
5d11118cc9 Use thread pool (background_distributed_schedule_pool_size) for distributed sends
After #8756 the problem with 1 thread for each (distributed table, disk)
for distributed sends became even worse (since there can be multiple
disks), so use predefined thread pool for this tasks, that can be
controlled with background_distributed_schedule_pool_size knob.
2020-04-19 12:01:56 +03:00
Azat Khuzhin
201d5d5b25 Update comment for background_schedule_pool_size
Include info about:
- kafka streaming
- dns cache updates
2020-04-19 11:20:57 +03:00
Andrew Onyshchuk
68f2e93443 Fix style 2020-04-18 22:54:22 -05:00
Azat Khuzhin
673ddc9d77 Drop superfluous locking for atomic in DirectoryMonitor 2020-04-19 00:22:48 +03:00
Andrew Onyshchuk
14647ed03b Add Avro nested fields insert support 2020-04-18 15:46:24 -05:00
alexey-milovidov
aac7cc7330
Merge pull request #10126 from Jokser/replicated-merge-tree-s3
Support ReplicatedMergeTree over S3
2020-04-18 16:13:04 +03:00
alexey-milovidov
46a5c75beb
Update MergeTreeData.h 2020-04-18 16:11:57 +03:00
alexey-milovidov
8cea45315f
Merge pull request #10133 from 4ertus2/joins
JOIN with Dictionary
2020-04-18 16:08:15 +03:00
alexey-milovidov
959e6cd032
Merge pull request #10221 from ClickHouse/remove-part-special-case
Support for one special case of removing incompletely written parts
2020-04-18 15:58:58 +03:00
alexey-milovidov
43d48a21c6
Merge pull request #10318 from ClickHouse/least-greatest-generic
Added generic variants for functions 'least' and 'greatest'.
2020-04-18 15:35:19 +03:00
alexey-milovidov
72dd453c3f
Merge pull request #10234 from vitlibar/show-columns-of-not-loaded-dictionary
Show information about not loaded dictionaries in system tables.
2020-04-18 15:06:08 +03:00
alexey-milovidov
17b6e0b3e5
Merge pull request #10315 from azat/buffer-flush-bg-pool
Use background thread pool for background buffer flushes
2020-04-18 15:04:35 +03:00
alexey-milovidov
391165d725
Merge pull request #10337 from nikitamikhaylov/proper_dictionary_timeouts
Proper dictionary timeouts.
2020-04-18 14:42:36 +03:00
alexey-milovidov
b5f8efefa2
Merge pull request #10342 from azat/optimizeGroupBy-isInjective
[RFC] Use isInjective() over manual list of such functions for GROUP BY optimization
2020-04-18 14:28:59 +03:00
alexey-milovidov
d1b72f10d5
Merge pull request #10325 from Avogar/msgpack_format
Improve MsgPackRowInputFormat
2020-04-18 14:27:11 +03:00
alexey-milovidov
ef5f83eef8
Update MsgPackRowInputFormat.cpp 2020-04-18 14:26:57 +03:00
Vitaly Baranov
d62345bbaa Show information about not loaded dictionaries in system.columns, system.tables
and in "SHOW TABLES" executed in any database with the "Dictionary" engine.
2020-04-18 12:50:54 +03:00
Azat Khuzhin
548399725f Use IFunction::isInjective() over manual list of such functions for GROUP BY optimization 2020-04-18 10:23:19 +03:00
Azat Khuzhin
322681eb37 Passthrough isInjective via IFunctionOverloadResolver 2020-04-18 01:50:15 +03:00
Azat Khuzhin
f29e5c60a5 Add const qualifier for IFunction::isInjective() 2020-04-18 01:50:15 +03:00
Alexander Kuzmenkov
6793cd7cca
More granular assertion in Arena.h 2020-04-18 00:36:07 +03:00
Kruglov Pavel
96f4d5b7c6
Fix build error 2020-04-17 23:51:53 +03:00
Артем Стрельцов
948efff076 Merge branch 'master' of github.com:yandex/ClickHouse into direct_queries 2020-04-17 23:11:10 +03:00
Alexander Kuzmenkov
ef80a3bac6 do less things in SquashingTransform 2020-04-17 23:05:35 +03:00
Артем Стрельцов
741775a12f fixed some remarks from review 2020-04-17 22:54:53 +03:00
Kruglov Pavel
0f11526f24
Fix style error 2020-04-17 22:19:03 +03:00
Nikita Mikhaylov
c603acd515 mvp 2020-04-17 20:01:18 +03:00
Nikolai Kochetov
4a3d80fd71 Fix build. 2020-04-17 19:34:45 +03:00
Nikolai Kochetov
84faa9af26 Merge branch 'master' into shared-context-lifetime 2020-04-17 19:13:13 +03:00
Nikolai Kochetov
ce11662ab1 Fix build. 2020-04-17 15:58:52 +03:00
Anton Popov
f7b7b5eb74 remove unused flags 2020-04-17 14:59:10 +03:00
Nikolai Kochetov
42a0ad771f Remove not relevant code. 2020-04-17 13:07:44 +03:00
Nikolai Kochetov
d51a9c551b Remove shared_ptr to SharedContext from Context. 2020-04-17 12:47:40 +03:00
Avogar
b056dbce1c Improve MsgPackRowInputFormat 2020-04-17 12:35:38 +03:00
Alexey Milovidov
fdc5688d2d Added memory usage to AsynchronousMetrics 2020-04-17 07:09:41 +03:00
Alexey Milovidov
fb095ad787 Merge branch 'master' into remove-part-special-case 2020-04-17 06:14:15 +03:00
Alexey Milovidov
67790a74e5 Fix test 2020-04-17 06:13:21 +03:00
Alexey Milovidov
b16ee538ab Merge branch 'master' into sorting-processors 2020-04-17 05:31:55 +03:00
alexey-milovidov
17e7d4d88a
Merge pull request #10307 from abyss7/arcadia-4
Changes for auto-sync with Arcadia
2020-04-17 05:08:34 +03:00
alexey-milovidov
4bdaccbaee
Merge pull request #10312 from ClickHouse/fix_drop_optimize_race
Fix DROP vs OPTIMIZE race in ReplicatedMergeTree
2020-04-17 05:07:55 +03:00
alexey-milovidov
390bfe9a4c
Merge pull request #10317 from Avogar/markdown_format
Markdown format
2020-04-17 05:05:13 +03:00
Alexey Milovidov
1df5c7cedf Added generic variants of least and greatest functions #4767 2020-04-17 01:28:08 +03:00
Kruglov Pavel
2672b71b2d
Delete extra spaces 2020-04-16 23:47:01 +03:00
Artem Zuikov
c62c288e4c
fix COMMA and other JOIN mix (#10311) 2020-04-16 23:28:23 +03:00
Avogar
89d787dae3 Add new line at the end of file 2020-04-16 23:14:19 +03:00
Avogar
831c48c514 Add MarkdownRowOutput format 2020-04-16 23:10:42 +03:00
Nikita Mikhaylov
6b58998a36 better 2020-04-16 22:57:39 +03:00
Nikita Mikhaylov
c153cc8fe5 fixed :) 2020-04-16 22:54:11 +03:00
Alexander Kazakov
d5b3b2c7b6
Updated RWLockImpl: Fixed suboptimacy (readers queuing up) + minor tweaks to names and comments (#10303)
* Readers queue correction
* Comments, renamings and cosmetics
2020-04-16 21:56:21 +03:00
Nikita Mikhaylov
9a80eb6e47 Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-16 21:47:34 +03:00
Nikita Mikhaylov
85fbf413c1 server crashes, just to save 2020-04-16 21:47:20 +03:00
Artem Zuikov
ce372f464b
Fix finalize chain logic in ExpressionAnalysisResult (#10302) 2020-04-16 21:03:27 +03:00
Azat Khuzhin
a9b1b36907 Use separate pool for buffer flushes (background_buffer_flush_schedule_pool_size) 2020-04-16 20:14:28 +03:00
Artem Zuikov
47cb670213 Merge branch 'master' into joins 2020-04-16 19:06:13 +03:00
alexey-milovidov
3de1a36b33
Update ya.make 2020-04-16 18:55:39 +03:00
Alexander Tokmakov
605f3b2119 fix DROP vs OPTIMIZE race in ReplicatedMergeTree 2020-04-16 18:30:18 +03:00
Nikolai Kochetov
025093d354 Fix build. 2020-04-16 17:51:33 +03:00
Nikolai Kochetov
d6db27e372 Modify context. 2020-04-16 17:37:38 +03:00
Ivan Lezhankin
e230632645 Changes required for auto-sync with Arcadia 2020-04-16 15:31:57 +03:00
Alexey Milovidov
cdeda4ab91 Fix usage of max_parser_depth setting; remove harmful default function arguments 2020-04-16 04:06:10 +03:00
Alexey Milovidov
f704c465a7 Make aware of one special case of imcompletely written parts #9940 2020-04-16 00:52:21 +03:00
alexey-milovidov
056c822e65
Merge pull request #10257 from 4ertus2/strange
Some tech debt
2020-04-16 00:45:55 +03:00
alexey-milovidov
2b64a97e9b
Merge pull request #10291 from 4ertus2/bugs
Fix count(*) with multiple joins
2020-04-16 00:45:09 +03:00
alexey-milovidov
d296e1b6d7
Merge pull request #10216 from Avogar/msgpack_format
Update MsgPack format
2020-04-16 00:44:08 +03:00
Artem Zuikov
739daf3bbe Merge branch 'master' into strange 2020-04-15 20:55:21 +03:00
Artem Zuikov
f08cdfcc4c fix count(*) with multiple_joins_rewriter_version = 1 2020-04-15 20:47:08 +03:00
Alexander Kuzmenkov
08d9734fc0 Merge remote-tracking branch 'origin/master' into HEAD 2020-04-15 20:16:56 +03:00
Nikolai Kochetov
234c4dbe84 Fix build. 2020-04-15 17:51:03 +03:00
Alexey Milovidov
fbe41a8ee6 Fix clang-tidy 2020-04-15 17:37:43 +03:00
Alexander Kuzmenkov
d15d6e1661 review fixes 2020-04-15 17:10:33 +03:00
alexey-milovidov
7b2c871c57
Merge pull request #10272 from ClickHouse/plus-infinity
Allow to parse +inf
2020-04-15 16:41:47 +03:00
alexey-milovidov
8c8a315bd8
Merge pull request #10271 from ClickHouse/remove-strange-code
Remove strange code in arrayIndex function
2020-04-15 16:41:18 +03:00
Alexander Kuzmenkov
2ee49c9d68 Merge remote-tracking branch 'origin/master' into HEAD 2020-04-15 15:57:29 +03:00
Nikolai Kochetov
43e178abfb Revert "dded more comments to AggregatingTransform."
This reverts commit 01e495d783.
2020-04-15 14:04:38 +03:00
Nikolai Kochetov
95916e39cf Added more comments to AggregatingTransform. 2020-04-15 13:57:42 +03:00
Nikolai Kochetov
01e495d783 dded more comments to AggregatingTransform. 2020-04-15 13:55:34 +03:00
Nikolai Kochetov
0c2d3417e2 Fix pipeline stuck with max_rows_to_group_by. 2020-04-15 13:18:52 +03:00
alesapin
e8cd92bba3 Fix debug build 2020-04-15 13:13:36 +03:00
Artem Zuikov
3d8562452d remove more code 2020-04-15 13:07:16 +03:00
Nikolai Kochetov
153f795ebe Merge branch 'master' into sorting-processors 2020-04-15 12:07:05 +03:00
alexey-milovidov
2a48b0ecd7
Merge pull request #10184 from xzkostyan/feature-zookeeper-ssl
Optional secured communication between ClickHouse and Zookeeper
2020-04-15 07:09:14 +03:00
alexey-milovidov
19c4968ca6
Update arrayIndex.h 2020-04-15 07:02:41 +03:00
Alexey Milovidov
738fef71f4 Allow to parse +inf #1839 2020-04-15 06:32:33 +03:00
Alexey Milovidov
eed2ea3b36 Remove strange code 2020-04-15 06:02:51 +03:00
alexey-milovidov
747bb16677
Merge pull request #10269 from ClickHouse/path-optional-scheme
Continuation of #6256
2020-04-15 05:47:51 +03:00
Alexey Milovidov
9667e1fb85 Fix clang-tidy 2020-04-15 05:46:36 +03:00
Alexey Milovidov
a4c2e9a599 Whitespace 2020-04-15 05:12:50 +03:00
Alexey Milovidov
db9760af41 Continuation of #6256 2020-04-15 03:12:47 +03:00
Avogar
93c322bc30 Fix style error 2020-04-15 02:58:36 +03:00
alexey-milovidov
eef35bddc1
Merge pull request #10265 from ClickHouse/remove-useless-code-cast
Remove useless code
2020-04-15 02:33:34 +03:00
Avogar
b8061356b0 Update parsing method in MsgPackRowInputFormat 2020-04-15 02:08:55 +03:00
Alexey Milovidov
0c0218168a Whitespaces 2020-04-15 01:25:31 +03:00
Alexey Milovidov
8ad04d4fec Remove useless code 2020-04-15 00:05:45 +03:00
Alexander Kuzmenkov
03e00ac215 Merge remote-tracking branch 'origin/master' into HEAD 2020-04-14 23:03:23 +03:00
Nikolai Kochetov
15a8ac3245 Fix tests. 2020-04-14 22:31:49 +03:00
Nikolai Kochetov
7def7b021e Fix test with vesrioned collapsing. 2020-04-14 21:58:22 +03:00
Artem Zuikov
ee1b4a1a30
Fix and improve OneTypeMatcher (#10253) 2020-04-14 21:50:00 +03:00
Nikolai Kochetov
80c27689ff Add debug output. 2020-04-14 21:22:14 +03:00
Nikolai Kochetov
92692aff5e Fix build. 2020-04-14 21:03:29 +03:00
Alexander Kuzmenkov
1d3fe23b3b review fixes 2020-04-14 20:41:06 +03:00
Artem Zuikov
24f715ad87 tech debt 2020-04-14 17:43:09 +03:00
Nikolai Kochetov
01945bf5d9 Fix style 2020-04-14 16:27:33 +03:00
Nikolai Kochetov
40a0f53a42 Remove SharedBlockPtr from MergingSortedBlockInputStream. 2020-04-14 14:32:38 +03:00
Nikolai Kochetov
ada3d4e67c Remove StopCondition from MergingSortedBlockInputStream. 2020-04-14 14:26:03 +03:00
Nikolai Kochetov
e92827b954 Remove StopCondition from MergingSortedBlockInputStream. 2020-04-14 14:25:01 +03:00
Nikolai Kochetov
2da9f889cd Fix unit test. 2020-04-14 14:09:23 +03:00
Nikolai Kochetov
1de7191aa3 U[date test 2020-04-14 13:49:46 +03:00
Nikolai Kochetov
c0a8def386 Fix build. 2020-04-14 13:35:17 +03:00
Nikolai Kochetov
edb3f2f3fc Remove old code. 2020-04-14 13:23:16 +03:00
Nikolai Kochetov
12f4cfb2c7 Use processors for final. 2020-04-14 13:04:49 +03:00
Nikolai Kochetov
1ce2e1b93b Move comments. 2020-04-14 12:43:53 +03:00
Nikolai Kochetov
fc42851186 Move comments. 2020-04-14 12:43:17 +03:00
Nikolai Kochetov
434a13a8bd Move algorithm to separate files. 2020-04-14 12:21:24 +03:00
Nikolai Kochetov
71feedea6f Remove some code. 2020-04-14 12:05:29 +03:00
Nikolai Kochetov
848026ac4c Fix style. 2020-04-14 11:48:38 +03:00
alexey-milovidov
7587bd8cfc
Merge pull request #10239 from ClickHouse/fix-cancel-race-in-remote
Fix race after cancel of RemoteBlockInputStream.
2020-04-14 05:04:38 +03:00
Alexander Kuzmenkov
59e8230271 Merge remote-tracking branch 'origin/master' into HEAD 2020-04-14 02:27:46 +03:00
alexey-milovidov
b8be585595
Merge pull request #10237 from ClickHouse/akz/mutations-to-correctly-handle-lambdas
ALTER UPDATE/DELETE on Replicated* storages: Fixed "Unknown function lambda." error
2020-04-14 01:32:38 +03:00
alexey-milovidov
9de981d8d3
Merge pull request #10052 from Vxider/mv_parallel_insert
Enable parallel INSERT for materialized view
2020-04-14 01:30:44 +03:00
alexey-milovidov
2219f05139
Merge pull request #10235 from ClickHouse/fix_range_hashed_ddl_dictionaries
Fix 'Cannot add column' in DDL dictionary
2020-04-14 01:28:24 +03:00
Konstantin Lebedev
a7c5f622ea Add string_utils for tests/zookeeper_impl.cpp 2020-04-14 00:27:54 +03:00
Nikolai Kochetov
2543741a9a Fix build. 2020-04-14 00:03:11 +03:00
Nikolai Kochetov
1ef6e8f7c7 Fix build. 2020-04-13 23:58:29 +03:00
Nikolai Kochetov
801320983b Refactor SummingSortedAlgorithm. 2020-04-13 23:50:13 +03:00
Alexander Kazakov
d480707c12 Fixed clang build + tweaked comment 2020-04-13 23:02:44 +03:00
Avogar
e46322fcef Update MsgPack input format. 2020-04-13 22:33:02 +03:00
Nikita Mikhaylov
89f80a6353
Merge branch 'master' into quorum_bug 2020-04-13 23:25:55 +04:00
Nikolai Kochetov
84b1dd4c1e Fix tests. 2020-04-13 22:20:26 +03:00
Nikolai Kochetov
d7d29d8250 Fix build. 2020-04-13 22:02:57 +03:00
Nikolai Kochetov
586c295b94 Added SummingSortedAlgorithm 2020-04-13 21:51:17 +03:00
alexey-milovidov
45e85724a6
Update MutationsInterpreter.cpp 2020-04-13 21:33:25 +03:00
Artem Zuikov
6106b2bfc7 Merge branch 'master' into joins 2020-04-13 20:37:27 +03:00
Artem Zuikov
df01227bd2 move DictionaryReader code out of header 2020-04-13 20:36:07 +03:00
Alexander Kazakov
0aa4c85602 Fixed style checker complaint 2020-04-13 20:04:17 +03:00
Artem Zuikov
0b7ae2c2bf working version 2020-04-13 20:03:11 +03:00