thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-18 14:30:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
41,415 Commits 9,020 Branches 1,770 Tags 1.8 GiB
4bd678a3fd
Commit Graph

1690 Commits

Author SHA1 Message Date
FawnD2
02e12215e7 Apply reducing memory usage optimization for seekable files to ORC format 2020-05-04 03:52:28 +03:00
alexey-milovidov
6b0bffcdab
Update CompressionFactory.cpp 2020-05-04 03:47:41 +03:00
Alexey Milovidov
99c18c5a09 Check for suspicious codecs #4966 2020-05-04 03:11:49 +03:00
FawnD2
a554177724 Simplify ORC format 2020-05-04 02:23:20 +03:00
alexey-milovidov
884c2aa631
Merge pull request #10641 from ClickHouse/storage-buffer-nullptr-dereference 
Fix nullptr dereference in StorageBuffer
 2020-05-04 02:01:57 +03:00
alexey-milovidov
788b436275
Merge pull request #10640 from ClickHouse/fix-http-code-parse-error 
Fix http code in case of some parse errors.
 2020-05-04 02:00:47 +03:00
FawnD2
112758b99d Merge branch 'master' into arrow-io-format 2020-05-04 00:53:17 +03:00
Alexey Milovidov
a5bdc375ca Fix Arcadia #10569 2020-05-04 00:36:11 +03:00
Alexey Milovidov
f8866af0c1 Fix nullptr dereference in StorageBuffer 2020-05-03 23:53:54 +03:00
FawnD2
2359ba3497 Correct stop condition 2020-05-03 22:59:19 +03:00
FawnD2
6b2e97fd56 Increate total read length while reading 2020-05-03 22:54:28 +03:00
FawnD2
b4898bdd19 Read single batch 2020-05-03 22:49:06 +03:00
Alexey Milovidov
bb6eabd82d Fix HTTP response code for some parse errors #10636 2020-05-03 22:47:07 +03:00
FawnD2
a8d914a811 Read full table 2020-05-03 22:22:41 +03:00
Артем Стрельцов
5bce553d91 performance optimization 2020-05-03 22:08:45 +03:00
Alexey Milovidov
8f7374c6de Fix another UBSan warning 2020-05-03 21:39:52 +03:00
FawnD2
b86562b8bc Style fixes 2020-05-03 21:29:04 +03:00
Alexey Milovidov
9a344e681f Fix UBSan report in FixedHashTable 2020-05-03 21:24:11 +03:00
Alexey Milovidov
626b9a3ae9 Fix UBSan report in HashTable 2020-05-03 21:21:18 +03:00
FawnD2
7cc7a87f9f Simplify interfaces 2020-05-03 21:12:14 +03:00
Артем Стрельцов
ff7b5db800 fixed bug with dictGetString 2020-05-03 21:03:41 +03:00
Артем Стрельцов
31fb42cf01 removed unused arena 2020-05-03 19:12:17 +03:00
Артем Стрельцов
f8d3999fa2 Merge branch 'master' of github.com:yandex/ClickHouse into layout_direct 2020-05-03 16:23:10 +03:00
FawnD2
a590826fbb Format settings for Arrow 2020-05-03 15:26:39 +03:00
FawnD2
e5b59616cd Style fix 2020-05-03 15:25:53 +03:00
alexey-milovidov
0cdd48e468
Merge pull request #10598 from ClickHouse/sampling-memory-profiler 
Add sampling memory profiler
 2020-05-03 15:17:03 +03:00
Azat Khuzhin
6ffdd53b6a Share auto-increment for first batch and tmp file in DistributedBlockOutputStream 2020-05-03 14:47:59 +03:00
Azat Khuzhin
53c470cab4 Fix directory monitor initialization from INSERT into Distributed 
This also fixes hardlink code (when one file should be sent to multiple
servers, i.e. internal_replication == false) of writeToShard() with
distributed_storage_policy (i.e. when StorageDistributed::getPath() will
path to different filesystems).

Plus also cleanup DistributedBlockOutputStream::writeToShard() a little.
 2020-05-03 14:47:51 +03:00
Azat Khuzhin
e97e1f06db Do not schedule distributed send if there were no error 
Since in this case it will be scheduled from the
DistributedBlockOutputStream with the
distributed_directory_monitor_max_sleep_time_ms, and this will overwrite
timer that was set by the DistributedBlockOutputStream, not good.
 2020-05-03 14:46:44 +03:00
Azat Khuzhin
947b3942dd Schedule distributed sends after the file has been written 2020-05-03 14:46:43 +03:00
Azat Khuzhin
0157fd5d93 Fix distributed send that are scheduled by INSERT query 
Before this patch each INSERT query re-schedule distributed send, thus
each time it resets the timer, while this is not the expected behaviour,
since in on frequent INSERT distributed sends will not be triggered at
all.

Fix this by not resetting the timer.
 2020-05-03 14:46:42 +03:00
Azat Khuzhin
6bb39dafc3 Drop decreated code (cond var and note for thread) in DirectoryMonitor 2020-05-03 14:46:41 +03:00
Alexey Milovidov
469cdc315b Added suggestion from @azat #10607 2020-05-03 14:40:37 +03:00
FawnD2
f62f1a5924 Add missed include 2020-05-03 06:08:37 +03:00
FawnD2
6e0b31fb2a Arrow output format 2020-05-03 05:46:36 +03:00
FawnD2
aeed62d5e7 Remove unused error codes 2020-05-03 04:20:03 +03:00
FawnD2
4d0225f5a9 std::string -> String 2020-05-03 04:15:09 +03:00
FawnD2
f4fe23e3fe Add ptr wrapper. Fix style 2020-05-03 04:01:05 +03:00
FawnD2
fa1c35753b Move CH -> Arrow routine converter into separated class 2020-05-03 03:54:39 +03:00
Alexey Milovidov
abe40e2127 Added required comment #10576 2020-05-03 01:34:50 +03:00
alexey-milovidov
a235533d5f
Merge pull request #10576 from Jokser/s3-with-dynamic-proxies 
S3 with dynamic proxy configuration
 2020-05-03 01:25:13 +03:00
alexey-milovidov
9011d18b80
Update S3Common.h 2020-05-03 01:25:02 +03:00
alexey-milovidov
d9400473f9
Update ThreadStatusExt.cpp 2020-05-03 01:20:14 +03:00
alexey-milovidov
67efc7f066
Merge pull request #10560 from Enmk/DateTime64_fixes 
Fixed comparing DateTime64 in WHERE against String value
 2020-05-03 00:54:11 +03:00
Артем Стрельцов
359de11fee removed redundant lines and comments 2020-05-03 00:49:19 +03:00
alexey-milovidov
342ed093de
Update S3Common.cpp 2020-05-02 23:46:39 +03:00
Артем Стрельцов
c82b1fc0fe fixed (hope) test flapping 2020-05-02 23:26:22 +03:00
Alexey Milovidov
554e7a0dd2 Preparations 2020-05-02 22:59:07 +03:00
Alexey Milovidov
e6ab4d655b Fix bad code 2020-05-02 22:54:29 +03:00
Alexey Milovidov
f0e80fec68 Whitespaces 2020-05-02 22:41:01 +03:00
alexey-milovidov
330627f597
Update ArrowBlockInputFormat.h 2020-05-02 22:35:58 +03:00
alexey-milovidov
47e3f83bc8
Update ArrowBlockInputFormat.h 2020-05-02 22:34:34 +03:00
alexey-milovidov
07f824c746
Update ArrowBlockInputFormat.cpp 2020-05-02 22:33:47 +03:00
alexey-milovidov
dfeb76038d
Update ArrowBlockInputFormat.h 2020-05-02 22:32:33 +03:00
alexey-milovidov
fbb280b5ac
Update ArrowBlockInputFormat.cpp 2020-05-02 22:32:21 +03:00
alexey-milovidov
db4c2352e1
Merge pull request #10569 from zhang2014/fix/ISSUES-10551 
ISSUES-10551 add backward compatibility for create bloom filter index
 2020-05-02 22:25:29 +03:00
alexey-milovidov
250a44a47f
Merge pull request #10607 from Avogar/json_as_string_format 
Add JSONAsStringRowInputFormat
 2020-05-02 22:17:22 +03:00
alexey-milovidov
229f666dea
Merge pull request #10611 from azat/optimize_skip_unused_shards-LowCardinality 
Fix optimize_skip_unused_shards with LowCardinality
 2020-05-02 22:14:33 +03:00
alexey-milovidov
4f1b115e76
Merge pull request #10610 from azat/optimize_skip_unused_shards-fixes 
Fix logging for optimize_skip_unused_shards
 2020-05-02 22:13:01 +03:00
alexey-milovidov
d38ea6fc1c
Merge pull request #10608 from ClickHouse/fix_drop_dns_cache 
Improve DROP DNS CACHE
 2020-05-02 22:10:58 +03:00
Артем Стрельцов
5ba6572210 fixed problem with dictGetString and Float32 2020-05-02 20:58:24 +03:00
tavplubix
a073cd6c79
Fix segfault in StorageBuffer when exception on server startup (#10609) 
* fix segfault in StorageBuffer when exception on server startup

* Trigger CI

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
 2020-05-02 19:54:20 +03:00
Alexey Ilyukhov
a03da4eb34 Fix style and array index 2020-05-02 19:48:36 +03:00
Alexey Milovidov
81adcc9058 Remove obsolete records from system.build_options 2020-05-02 17:00:03 +03:00
alexey-milovidov
d763d0019b
Merge pull request #10625 from amosbird/unwind 
Partial fix of clang build stack unwinding (omit-frame-pointer)
 2020-05-02 16:43:04 +03:00
Артем Стрельцов
2a4ce4f41c style fix 2020-05-02 15:02:57 +03:00
Amos Bird
014a1233ff
Partial fix of clang build stack unwinding 2020-05-02 18:52:29 +08:00
Alexey Ilyukhov
c12cd35099 Add point in polygon for non-const polygons 2020-05-02 11:46:18 +03:00
Артем Стрельцов
25d7f76e4f fixed bug & created functional test for new layout 2020-05-02 04:03:29 +03:00
Артем Стрельцов
97496048d6 created direct dictionary (has bugs, doesn't work properly) 2020-05-02 02:35:54 +03:00
Matwey V. Kornilov
d7627fa4fb Fix capnproto version check for capnp::UnalignedFlatArrayMessageReader 
capnp::UnalignedFlatArrayMessageReader was introduced in
3aa2b2aa02
(which is a part of 0.7.0 release). Unfortunately,
capnp::UnalignedFlatArrayMessageReader was removed in
3f0fee61c6
(which is a part of 0.8.0 release)

So change CAPNP_VERSION check accordingly.
 2020-05-01 22:32:06 +03:00
Alexey Milovidov
439777ef23 Allow to set memory_profiler_sample_probability per query 2020-05-01 22:17:56 +03:00
Alexey Milovidov
93c3a83af2 Remove useless code 2020-05-01 22:01:02 +03:00
Alexey Milovidov
600b396f1b Merge remote-tracking branch 'origin/master' into sampling-memory-profiler 2020-05-01 21:48:20 +03:00
Alexander Kazakov
e9baaa439b
Implementation of new system metrics provider (Procfs) (#10544) 
* New metrics provider (Procfs) + Refactored TasksStatsCounters

* Trivial statless test that ProcFS is provided

* Trivial perf test for ProcfsMetricsProvider

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
 2020-05-01 21:47:41 +03:00
alexey-milovidov
404452bad3
Update MergeTreeIndices.cpp 2020-05-01 21:40:56 +03:00
Avogar
3de0bca856 Remove double space 2020-05-01 19:50:18 +03:00
Avogar
9670e74885 Update makeContinuousMemoryFromCheckpointToPos in PeekableReadBuffer. 2020-05-01 19:42:15 +03:00
Avogar
697d5b07ce Fix build and style errors. Update test. 2020-05-01 19:41:14 +03:00
Alexey Milovidov
c4b64edc14 Merge branch 'master' into sampling-memory-profiler 2020-05-01 16:47:10 +03:00
Alexey Milovidov
6ba6d5fc69 Revert unrelated modification 2020-05-01 16:46:42 +03:00
Vasily Nemkov
86edceeb81 Comparison between DateTime64 and String values (just like for DateTime) 2020-05-01 15:52:18 +03:00
Vitaly Baranov
2528e72199
Merge pull request #10587 from vitlibar/database-with-dictionary-init-in-constructor 
Move initialization of DatabaseWithDictionaries to constructor.
 2020-05-01 14:08:53 +03:00
alesapin
4d8660f270 Remove obsolete comment 2020-05-01 13:05:37 +03:00
Azat Khuzhin
63d8ab8f03 Make createSelector() static (in storage) and const (in stream) 2020-05-01 11:31:05 +03:00
Alexander Kuzmenkov
2ac26bd3a5 Disable mremap under MemorySanitizer. 2020-05-01 10:38:05 +03:00
Azat Khuzhin
f22ba15b4a Reduce copy-paste of DistributedBlockOutputStream::createSelector 
This will make it less error prone.
 2020-05-01 02:59:40 +03:00
Azat Khuzhin
cdd7013438 Drop superfluous "Skipping irrelevant shards" messages 
Before this patch it printed 3 times:
- from StorageDistributed::getProcessingStageImpl()
- from StorageDistributed::read()
- from StorageDistributed::getProcessingStageImpl() (from StorageDistributed::read() -> getSampleBlock())
(But this should be optimized)
 2020-05-01 02:56:13 +03:00
Azat Khuzhin
c648c300bf Fix optimize_skip_unused_shards with LowCardinality 2020-05-01 02:39:58 +03:00
Azat Khuzhin
4cbe625567 Fix shard numbers output in logs (full cluster had been printed over optimized) 2020-05-01 02:13:07 +03:00
Alexander Tokmakov
9ca144cab9 drop access cache on DROP DNS CACHE 2020-05-01 01:29:47 +03:00
Avogar
6464a1a902 Add JSONAsStringRowInputFormat 2020-04-30 23:16:09 +03:00
Vitaly Baranov
dd34cd73e2 Move initialization of DatabaseWithDictionaries to constructor. 2020-04-30 20:22:20 +03:00
Nikolai Kochetov
10afbc22b5 Fix build. 2020-04-30 16:36:20 +03:00
Alexey Milovidov
db3241ccc7 Add sampling memory profiler 2020-04-30 16:30:10 +03:00
Alexey Milovidov
293ae88e7f Add sampling memory profiler 2020-04-30 16:25:17 +03:00
Nikolai Kochetov
62e9be7ba8 Fix build. 2020-04-30 14:33:27 +03:00
Nikolai Kochetov
19dadb8c2d Add parallel final. 2020-04-30 12:59:08 +03:00
alesapin
15e8f37839
Merge pull request #10531 from CurtizJ/polymorphic-parts-2 
Fix index corruption in merges with compact parts.
 2020-04-30 12:15:25 +03:00
Alexander Kuzmenkov
7f5b57c6c5
Merge pull request #10559 from ClickHouse/aku/summap-experiment 
Merge pull request #10000 (sumMap for Tuple argument)
 2020-04-30 11:56:04 +03:00
alesapin
5e2afad549
Merge pull request #10477 from ClickHouse/refactor_istorage 
Remove getColumn and hasColumn from IStorage, better virtuals.
 2020-04-30 10:42:52 +03:00
Anton Popov
6ed3092c8a make fillIndexGranularity less complicated 2020-04-30 00:57:58 +03:00
Pavel Kovalenko
0b70c2ca08 Fixed ya.make for S3. 2020-04-29 21:38:35 +03:00
alesapin
47e32aaaa1
bump CI 2020-04-29 21:17:15 +03:00
alesapin
7a8380a682 Fix build 2020-04-29 19:26:01 +03:00
Potya
351d62aa83 Nothing interesting 2020-04-29 15:17:40 +03:00
alesapin
69fdf2a6a3 Review fixes and better test 2020-04-29 15:15:23 +03:00
Pavel Kovalenko
f17e022fa4 Code style fixes. 2020-04-29 15:05:46 +03:00
Nikolai Kochetov
a9d63d4520
Merge pull request #10498 from vzakaznikov/insert_into_watch_from_live_view 
Adding support for INSERT INTO table WATCH query to build streaming systems using LIVE VIEW tables
 2020-04-29 12:15:54 +03:00
Pavel Kovalenko
a1acbcb019 Code style fixes. 2020-04-29 11:45:13 +03:00
Pavel Kovalenko
e5e84960ea S3 with proxy integration test and fixes. 2020-04-29 11:40:29 +03:00
Pavel Kovalenko
2ecf4b5a23 Dynamic proxy configuration for DiskS3. 2020-04-29 11:40:29 +03:00
Alexander Kuzmenkov
c5a7796d16 fixup 2020-04-29 09:35:02 +03:00
Alexander Kuzmenkov
31bf2b3be4 fixup 2020-04-29 09:05:52 +03:00
zhang2014
8ac709b5d3 ISSUES-10551 add backward compatibility for create bloom filter index 2020-04-29 11:57:28 +08:00
Azat Khuzhin
038235684d Add optimize_distributed_group_by_sharding_key and disable it by default 
I know at least one way to fool that optimization, by using as sharding
key something like `if(col1>0, col1, col2)` (although this is not common
sharding key I would say, but can be useful if this will work
correctly), so let's disable it by default.
 2020-04-29 00:09:25 +03:00
FawnD2
538e6c39da Arrow input format 2020-04-28 22:52:22 +03:00
Azat Khuzhin
53aea23de0 Fix SELECT of column ALIAS which default expression type different from column type 2020-04-28 22:43:10 +03:00
robot-clickhouse
de4e88ff97 Auto version update to [20.5.1.1] [54435] 2020-04-28 20:12:16 +03:00
Vitaliy Zakaznikov
664a09e55d Simplifying code related to auto set output_format_enable_streaming option. 2020-04-28 18:37:15 +02:00
Vitaliy Zakaznikov
4749122734 Adding support to auto set output_format_enable_streaming option 
based on the query type.
 2020-04-28 17:50:50 +02:00
Artem Zuikov
0b18b6104f add file to ya.make 2020-04-28 18:38:07 +03:00
Alexander Kuzmenkov
73398a3e17 fixup 2020-04-28 17:30:45 +03:00
Artem Zuikov
e34a9457e6
Improve right table insert for Partial MergeJoin on disk (#10467) 2020-04-28 16:55:50 +03:00
alesapin
30052ea46c Better 2020-04-28 16:00:41 +03:00
alesapin
80443af5dc Fix 2020-04-28 15:57:44 +03:00
alesapin
7c25a9bcbd Fix schema of storage 2020-04-28 15:33:17 +03:00
bobrovskij artemij
0cc3d780b3 Support write for XDBCStorage 2020-04-28 14:03:24 +03:00
alesapin
f981649213 Fix pushing to views stream and refactor virtuals 2020-04-28 13:38:57 +03:00
Eldar Zaitov
043be916cb Add miniman fuzzing documentation, fix code style. 2020-04-28 13:35:44 +03:00
Eldar Zaitov
f40603441b Add miniman fuzzing documentation, fix code style. 2020-04-28 13:34:57 +03:00
tavplubix
11c3493676
Merge pull request #10547 from ClickHouse/zhang2014/feature/ISSUES-5436 
Merging #7572
 2020-04-28 12:40:48 +03:00
bobrovskij artemij
1bcd077fbf Support write for XDBCStorage 2020-04-28 03:56:44 +03:00
Eldar Zaitov
670ed4bf1b lexer, ast, checksum and column specs fuzzers added 2020-04-28 02:12:18 +03:00
Alexander Tokmakov
e72a484beb minor fixes 2020-04-28 02:05:15 +03:00
Nikolai Kochetov
de6d2d01b9 Try to fix tests. 2020-04-27 21:15:55 +03:00
Anton Popov
032a0aa282 fix clang-tidy 2020-04-27 21:12:17 +03:00
alesapin
7c2f4d121a Fix func 2020-04-27 20:48:53 +03:00
alesapin
4badd0fd28 Better code 2020-04-27 20:46:51 +03:00
alesapin
228dbf475e
Finalize mutations in background (#10526) 2020-04-27 19:19:04 +03:00
alesapin
01db4877f6 Fix style check 2020-04-27 18:44:33 +03:00
alesapin
c24ab563d7 Fix several wrong usages 2020-04-27 18:38:35 +03:00
Nikolai Kochetov
2f06180c5e Revert changes for CSVRowOutputFormat. 2020-04-27 18:21:53 +03:00
alesapin
b0c5c1d685 Fix style 2020-04-27 18:21:37 +03:00
alesapin
6cfe0f7046 Fix after refactoring 2020-04-27 18:20:03 +03:00
alesapin
cefc58e77c Fix style 2020-04-27 18:17:08 +03:00
alesapin
5c6316afbc Fix bug 2020-04-27 18:10:50 +03:00
Nikolai Kochetov
201a184d31 Enable auto flust for output formats if enable_streaming was set. 2020-04-27 18:00:10 +03:00
Nikolai Kochetov
32baa073b5 Merge remote-tracking branch 'upstream/master' into insert_into_watch_from_live_view 2020-04-27 17:49:50 +03:00
alesapin
4c1ac83112 Fix in IStorage 2020-04-27 17:44:32 +03:00
alesapin
e85b50c911 Revert "Strange fix, how it was possible earlier?" 
This reverts commit 8d20644c99.
 2020-04-27 17:17:12 +03:00
alesapin
8d20644c99 Strange fix, how it was possible earlier? 2020-04-27 17:12:54 +03:00
alesapin
18c550df15 Better virtuals logic 2020-04-27 16:55:30 +03:00
Anton Popov
bee343dae1 fix writing of index in compact parts 2020-04-27 16:36:50 +03:00
alesapin
2829774105 Merge branch 'master' into refactor_istorage 2020-04-27 15:34:21 +03:00
alexey-milovidov
436e4e3f5e
Merge pull request #10502 from oandrew/avro-nested2 
Avro nested fields - support complex types
 2020-04-27 13:44:58 +03:00
Andrew Onyshchuk
570be94a48 Use correct type for DateTime64 (ubsan) 2020-04-26 21:10:30 -05:00
Azat Khuzhin
20b4eed9a1 Disable GROUP BY sharding_key optimization for WITH ROLLUP/CUBE/TOTALS 2020-04-27 01:30:54 +03:00
Alexey Milovidov
cac130ad3b Use time zone when comparing DateTime with string literal 2020-04-27 01:13:51 +03:00
Alexey Milovidov
a7d7dc5034 Fix some bad code 2020-04-26 20:34:36 +03:00
alexey-milovidov
c6ae6a7ba8
Merge pull request #10418 from ClickHouse/fix_logical_error_in_diagnostic_info 
Better diagnostic info in input formats
 2020-04-26 20:26:59 +03:00
alexey-milovidov
4c17542096
Merge pull request #10465 from kekekekule/ddl_settings 
Add custom settings support in DDL-queries for CREATE DICTIONARY
 2020-04-26 20:25:29 +03:00
alexey-milovidov
7d58dc154c
Update ASTDictionary.h 2020-04-26 20:24:18 +03:00
alexey-milovidov
0a9bcae0ed
Merge pull request #10511 from ClickHouse/fix-ubsan-datetime64 
Fixed UBSan for DateTime64; added a test
 2020-04-26 20:17:01 +03:00
alexey-milovidov
378d73d477
Merge pull request #10449 from azat/metrics-for-new-bg-schedule-pools 
Add tasks/memory metrics for distributed/buffer schedule pools
 2020-04-26 20:16:02 +03:00
Alexey Milovidov
79af5cd0ae Fix UBSan report in Decimal parse 2020-04-26 18:48:30 +03:00
Alexey Milovidov
a70637ab4b Fixed UBSan; added a test 2020-04-26 17:57:45 +03:00
alexey-milovidov
d1464a441f
Merge pull request #10503 from oandrew/read-columns-perf-fix 
IRowInputFormat performance fix
 2020-04-26 17:36:54 +03:00
alexey-milovidov
62e2f10959
Merge pull request #10474 from hczhcz/patch-0422 
Fix overflow in simpleLinearRegression
 2020-04-26 17:34:57 +03:00
Vitaliy Zakaznikov
626468d255 Adding support for streaming mode to JSONEachRowRowOutputFormat 2020-04-26 15:56:45 +02:00
Vitaliy Zakaznikov
369b4d53ef Adding support for output_format_enable_streaming format setting. 2020-04-26 15:44:11 +02:00
Andrew Onyshchuk
4a5497498e IRowInputFormat performance fix 2020-04-25 19:33:36 -05:00
Alexey Milovidov
d01bd44f14 Merge branch 'master' into execute-query-flush-format-2 2020-04-26 03:31:46 +03:00
alexey-milovidov
8820b43606
Merge pull request #10479 from Avogar/markdown_format 
Markdown format
 2020-04-26 03:25:48 +03:00
Andrew Onyshchuk
e7ba75ce98 Avro nested fields - support complex types 2020-04-25 17:42:49 -05:00
alexey-milovidov
8b1e504b19
Merge pull request #10497 from azat/kafka 
Tiny kafka fixes
 2020-04-25 23:50:22 +03:00
alexey-milovidov
092efc53ba
Merge pull request #10496 from ClickHouse/fix-visible-drift-memory-tracking 
Fix visible drift of MemoryTracking metric
 2020-04-25 23:50:08 +03:00
alexey-milovidov
1e25991c62
Merge pull request #10494 from kyprizel/master 
Split fuzzers and sanitizers
 2020-04-25 23:49:45 +03:00
alexey-milovidov
c9334d3fde
Merge pull request #10491 from azat/dist-shutdown 
Proper Distributed shutdown (fixes UAF, avoid waiting for sending all batches)
 2020-04-25 23:47:59 +03:00
Vitaliy Zakaznikov
71a40d6ec9 Revert "Working on adding AUTO REFRESH to LIVE VIEW tables." 
This reverts commit 855e06b031.
 2020-04-25 09:56:57 -04:00
Vitaliy Zakaznikov
1fc345f5a0 Revert "Reverting all the changes in LIVE VIEW table." 
This reverts commit 684c7f943a.
 2020-04-25 09:56:41 -04:00
Vitaliy Zakaznikov
e73166c78d Removing SquashingBlockOutputStream from the stream to 
allow blocks from WATCH query to propagate to target table
as is.
 2020-04-25 09:46:46 -04:00
Alexey Milovidov
c75c2fac29 Fix visible drift of MemoryTracking metric 2020-04-25 15:36:01 +03:00
Azat Khuzhin
40c65f7bee IRowInputFormat: omit "Skipped 0 rows with errors while reading the input stream" 
This will just pollute the output log.

And this is significant for kafka streaming, since it will print this
message for each message (due to how
ReadBufferFromKafkaConsumer/KafkaBlockInputStream works).

You can see this in the server log of the test_storage_kafka
(integration test), for the table with kafka_skip_broken_messages > 0,
it will have 52 lines of such message, 2 with "Skipped 1 rows" and 50
with "Skipped 0 rows" (since there are 52 messages in summary, 2
malformed and 50 correct).
 2020-04-25 15:16:29 +03:00
Vitaliy Zakaznikov
684c7f943a Reverting all the changes in LIVE VIEW table. 2020-04-25 07:39:15 -04:00
Vitaliy Zakaznikov
8621e93460 Starting to remove changes to LIVE VIEW table. 2020-04-25 07:37:33 -04:00
Vitaliy Zakaznikov
34a03939ea First changes to try to support INSERT INTO table WATCH query. 2020-04-25 07:33:47 -04:00
Eldar Zaitov
d7a037c26b split fuzzers and sanitizers 2020-04-25 10:12:38 +03:00
Azat Khuzhin
747a74215f Avoid processing all batches before Distributed shutdown 2020-04-25 02:03:27 +03:00
Azat Khuzhin
8ad6b37913 Proper StorageDistributed shutdown to avoid UAF in DistributedMonitor 
StorageDistributed::shutdown() does not acquire the lock, that controls
access to the cluster_nodes_data, thus it does not synced with the
requireDirectoryMonitor(), hence some monitors can be untracked that
will trigger UAF (use-after-free) after DROP TABLE dist:

This is for the SIGSEGV from the DirectoryMonitor (with already destroyed storage):
    0  0x0000000008e9f760 in std::__1::__cxx_atomic_load<int> (__order=std::__1::memory_order::seq_cst, __a=0x0)
    1  std::__1::__atomic_base<int, false>::load (__m=std::__1::memory_order::seq_cst, this=0x0) <-- this is nullptr
    2  std::__1::__atomic_base<int, false>::operator int (this=0x0)
    3  DB::ActionBlocker::isCancelled (this=0x7f85e31c9bb8) at ../src/Common/ActionBlocker.h:18
    4  DB::StorageDistributedDirectoryMonitor::run (this=0x7f85f93b2a00) at ../src/Storages/Distributed/DirectoryMonitor.cpp:140
 2020-04-25 02:03:26 +03:00
Vitaliy Zakaznikov
855e06b031 Working on adding AUTO REFRESH to LIVE VIEW tables. 2020-04-24 17:15:17 -04:00
tavplubix
7928f2eaa1
Merge pull request #7512 from ClickHouse/database_atomic 
DatabaseAtomic
 2020-04-24 22:28:18 +03:00
Alexander Tokmakov
04d4130b0d update yamake 2020-04-24 20:14:10 +03:00
Артем Стрельцов
5423506393 sure this will exactly fix the fail with build check 2020-04-24 19:04:54 +03:00
Alexander Tokmakov
53dcce55e9 better diagnostic info in input formats 2020-04-24 15:03:48 +03:00
Avogar
778f1aa1e7 Merge branch 'markdown_format' of github.com:avogar/ClickHouse into markdown_format 2020-04-24 14:07:04 +03:00
Avogar
2458da802c Update MarkdownRowOutputFormat 2020-04-24 14:06:41 +03:00
alesapin
793f4b734a Remove obsolete comment 2020-04-24 13:31:03 +03:00
alesapin
b4425c2dc4 Remove getColumn and hasColumn methods from IStorage 2020-04-24 13:20:03 +03:00
Артем Стрельцов
26a6353284 tried to fix build fail & fixed codestyle 2020-04-24 12:59:49 +03:00
alesapin
0c622370c5 Better 2020-04-24 12:21:38 +03:00
alesapin
dc2dd77d2e Remove redundant overrides from IStorage 2020-04-24 12:20:09 +03:00
alesapin
a2cb67c542
Merge pull request #10459 from ClickHouse/refactor_istorage 
Remove virtuals from IStorage as separate column
 2020-04-24 11:42:04 +03:00
hcz
541cd638ba Fix overflow in simpleLinearRegression 2020-04-24 16:33:09 +08:00
alexey-milovidov
79d531af87
Merge pull request #10466 from ClickHouse/aku/arena-infinite-loop 
Work around a bug leading to an infinite loop in addressToLine
 2020-04-24 10:38:07 +03:00
Alexander Kuzmenkov
2bedc82c18 Work around a bug leading to an infinite loop in addressToLine. 
Fixing this is hopeless and would entail rewriting the entire
WriteBuffer thing, and also this hack is something we can backport.
 2020-04-24 02:42:04 +03:00
Артем Стрельцов
aab2e8f9c1 unsignificant change 2020-04-24 02:21:51 +03:00
tavplubix
7d6ab32eb6
Update DatabaseCatalog.cpp 2020-04-24 01:08:26 +03:00
Артем Стрельцов
d7e27d4326 added SETTINGS section to DDL-query for CREATE DICTIONARY 2020-04-24 00:57:40 +03:00
Артем Стрельцов
f39fdf7182 some progress in parsing settings (i did this commit for having something to backup to) 2020-04-23 23:50:01 +03:00
Alexander Tokmakov
8be4d51111 fix build 2020-04-23 22:50:05 +03:00
Alexey Milovidov
2b569cf260 Added clarification in exception message #10405 2020-04-23 21:31:37 +03:00
Alexander Tokmakov
15e7ce0053 fixes 2020-04-23 21:00:43 +03:00
Alexander Tokmakov
f413061e0d remove Context from some IDatabase methods 2020-04-23 19:51:48 +03:00
alesapin
5ae25b68e4 Remove redundant virtual from function 2020-04-23 18:18:33 +03:00
alesapin
b0a73589b0 Remove virtual columns as separate field from IStorage 2020-04-23 18:09:00 +03:00
Alexander Tokmakov
04d6b59ac0 Merge branch 'master' into database_atomic 2020-04-23 17:31:37 +03:00
Артем Стрельцов
5da371b9c0 added settings parsing from DDL-query (they aren't applied now) 2020-04-23 15:39:27 +03:00
alexey-milovidov
1ecfa27cd3
Merge pull request #10441 from ClickHouse/remove_casts_from_defaults 
Remove CAST from DEFAULT expressions during table creation.
 2020-04-23 12:36:12 +03:00
Nikita Mikhaylov
3520755ab5 fix c++20 usage 2020-04-23 12:00:43 +03:00
Azat Khuzhin
4f5ec14f27 Configure thread names for buffer/distributed schedule pools 2020-04-23 03:16:14 +03:00
Azat Khuzhin
d854049d21 Add tasks/memory metrics for distributed/buffer schedule pools 
Follow-up-for: #10315
Follow-up-for: #10263
 2020-04-23 02:18:37 +03:00
Azat Khuzhin
c04c73b4c4 Drop unused MemoryTrackingForMerges from Context 
It set in src/Storages/MergeTree/MergeList.cpp anyway.
 2020-04-23 01:57:33 +03:00
alexey-milovidov
77969d11a5
Merge pull request #10442 from zhang2014/fix/create_database_failure 
Not remove metadata directory when attach database fails
 2020-04-23 01:07:13 +03:00
alexey-milovidov
b8e3655f0d
Merge pull request #10445 from azat/logger-source-coloring-client 
Make logger name colored in client too
 2020-04-23 00:35:40 +03:00
alexey-milovidov
fd27ce619b
Merge pull request #10444 from ClickHouse/server-memory-profiler 
Simple server wide memory profiler
 2020-04-23 00:34:23 +03:00
alexey-milovidov
4f6bb00424
Merge pull request #10420 from ClickHouse/clang-tidy-8 
Fixes for clang-tidy on clang-10
 2020-04-23 00:33:41 +03:00
Alexander Tokmakov
e02b5790af fix 2020-04-22 23:49:13 +03:00
Alexander Tokmakov
1833ac7f16 fixes 2020-04-22 23:43:10 +03:00
Nikita Mikhaylov
3cf2016867
Merge pull request #10188 from nikitamikhaylov/quorum_bug 
insert_quorum vs drop partition or ttl
 2020-04-23 00:11:57 +04:00
alexey-milovidov
9e14603ae5
Update DatabaseFactory.cpp 2020-04-22 22:37:30 +03:00
Azat Khuzhin
8715cef94c Make logger name colored in client too 
Follow-up-for: #10343
 2020-04-22 22:34:35 +03:00
Alexey Milovidov
282b5785c1 Fixed error 2020-04-22 21:41:19 +03:00
Alexander Kuzmenkov
3d5809a4ac
Merge pull request #10340 from ClickHouse/aku/unstable-codec-test 
Copy less memory in squashing transform.
 2020-04-22 21:18:42 +03:00
Alexey Milovidov
73dd78bac1 Merge branch 'master' into clang-tidy-8 2020-04-22 21:04:47 +03:00
Alexey Milovidov
07dcf40a6a Simple server wide memory profiler 2020-04-22 20:52:21 +03:00
zhang2014
a622208284 Not remove metadata directory when attach database fails 2020-04-23 00:03:58 +08:00
Alexey Milovidov
d189375051 Fix Mac OS build 2020-04-22 17:56:31 +03:00
alesapin
45b8cb5b37 Remove casts from table creation by default 2020-04-22 17:29:38 +03:00
Alexander Tokmakov
fefbbd37df Merge branch 'master' into database_atomic 2020-04-22 17:02:30 +03:00
zhang2014
0a0555d4d7 ISSUES-9623 fix failure test case 2020-04-22 18:34:42 +08:00
Alexey Milovidov
d3418bbb02 Fix clang-tidy 2020-04-22 11:45:14 +03:00
Alexey Milovidov
8c9408f927 Checkpoint 2020-04-22 11:31:10 +03:00
zhang2014
bfb87f0eab ISSUES-9623 check the number and type of arguments when creating BloomFilter index 2020-04-22 16:17:09 +08:00
Alexey Milovidov
03e17405cd Checkpoint 2020-04-22 10:03:43 +03:00
Alexey Milovidov
603d132d45 Checkpoint 2020-04-22 09:34:20 +03:00
Alexey Milovidov
1e325a9fd9 Checkpoint 2020-04-22 09:22:14 +03:00
alexey-milovidov
7065a8ba9c
Merge pull request #10422 from azat/fallback_to_stale_replicas-over-skip_unavailable_shards 
Prefer fallback_to_stale_replicas over skip_unavailable_shards
 2020-04-22 09:20:25 +03:00
Alexey Milovidov
0a7edce036 Checkpoint 2020-04-22 09:01:33 +03:00
Alexey Milovidov
be22a4b94e Checkpoint 2020-04-22 08:39:31 +03:00
Alexey Milovidov
b9b5036749 Merge branch 'master' into clang-tidy-8 2020-04-22 07:54:27 +03:00
Alexey Milovidov
e6acb35d95 Added a fix from Vadim Plakhtinskiy @VadimPlh 2020-04-22 07:32:05 +03:00
alexey-milovidov
eb0a1ec755
Merge pull request #10415 from azat/dict-load-after-detach-attach 
Fix dictionary name (RELOAD and system.dictionaries) after DETACH/ATTACH
 2020-04-22 06:57:08 +03:00
alexey-milovidov
7690c34e5b
Merge pull request #10424 from ClickHouse/tsv-bom-extra-case 
Allow to parse BOM in TSV if the first column cannot contain BOM in its value
 2020-04-22 06:56:43 +03:00
Alexander Kuzmenkov
d1c5e38a21
Merge pull request #10385 from CurtizJ/tuple-literal 
Parse tuples of tuples as literals
 2020-04-22 05:49:14 +03:00
alexey-milovidov
98294dc9fa
Merge pull request #10421 from ClickHouse/max_server_memory_usage_as_server_level_setting 
Make max_server_memory_usage server level setting.
 2020-04-22 03:34:17 +03:00
Alexey Milovidov
c805ed4dea Fixes for clang-tidy on clang-10 2020-04-22 03:29:38 +03:00
Alexey Milovidov
e8a9c7d518 Allow to parse BOM in TSV if the first column cannot contain BOM in its value 2020-04-22 02:46:42 +03:00
Alexander Kuzmenkov
c232f641b4
Merge branch 'master' into aku/unstable-codec-test 2020-04-22 02:40:53 +03:00
alexey-milovidov
0754eb7e78
Merge pull request #10416 from 4ertus2/perf 
Improve HashJoin memory usage
 2020-04-22 01:44:46 +03:00
Azat Khuzhin
0cc9dbd35b Prefer fallback_to_stale_replicas over skip_unavailable_shards 
Patch from: @alex-zaitsev
 2020-04-22 01:42:23 +03:00
Alexey Milovidov
0482e2e3ea Implement suggestion from Sergey Veletsky 2020-04-22 01:40:18 +03:00
alexey-milovidov
fcf5c3c6e1
Merge pull request #10399 from ClickHouse/fix-distributed_group_by_no_merge-segfault 
Fix segfault with distributed_group_by_no_merge
 2020-04-22 01:28:02 +03:00
Ivan
555488a458
Fix build in Arcadia (#10413) 2020-04-21 23:23:44 +03:00
Artem Zuikov
96b9edae29 fix comment 2020-04-21 22:09:18 +03:00
Artem Zuikov
17b0641b02 improve HashJoin memory usage 2020-04-21 22:01:34 +03:00
Alexey Milovidov
33338b722a Fix Mac OS #10246 2020-04-21 21:49:28 +03:00
Azat Khuzhin
9173895f85 Fix dictionary name (RELOAD and system.dictionaries) after DETACH/ATTACH 
After DETACH/ATTACH (or at server startup) the following will be broken:
- SYSTEM RELOAD DICTIONARY db_name.dict_name
- system.dictionaries will not have database for those dictionaries

The problem is that after DETACH/ATTACH the dictionary information is
obtained from metadata/$db/$dict.sql, but it does not have database
name.

Fix this by passing database name to the getDictionaryConfigurationFromAST().

Introduced-in: #10234
 2020-04-21 21:03:12 +03:00
Alexander Kuzmenkov
fcfbe4bfea
Update SquashingTransform.h 2020-04-21 19:27:56 +03:00
Alexander Kuzmenkov
a32ef00bf1 less copying 2020-04-21 17:59:57 +03:00
Anton Popov
3ccff833c1 fix ConstantExpressionTemplate with arrays 2020-04-21 15:54:36 +03:00
Nikita Mikhaylov
2173bcf28e Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-21 14:35:06 +03:00
Nikolai Kochetov
87a0b40ace Do not create extra totals and extremes ports. 2020-04-21 12:31:40 +03:00
Nikolai Kochetov
1d2388de39 Drop currently calculated totals and extremes before aggregation. 2020-04-21 11:45:28 +03:00
Alexey Milovidov
4cc0269de0 Fix flattening of Array(Tuple(...)) #10259 2020-04-21 02:44:51 +03:00
alexey-milovidov
4ecc86beca
Merge pull request #9950 from ClickHouse/aku/literal-columns 
Create unique columns for literals
 2020-04-21 02:30:17 +03:00
alexey-milovidov
2645dede2c
Merge pull request #10386 from palasonic1/palasonic-fix-read-hash-table 
Fix reading HashTable from buffer
 2020-04-21 02:26:47 +03:00
tavplubix
1a067484c8
Merge pull request #10137 from kekekekule/direct_queries 
Add custom settings support for certain dictionary sources
 2020-04-21 01:21:32 +03:00
Alexander Tokmakov
17c0317b80 minor fixes 2020-04-21 01:17:53 +03:00
alexey-milovidov
8c2839d3c9
Merge pull request #10308 from ClickHouse/shared-context-lifetime 
Shared context lifetime
 2020-04-21 00:12:45 +03:00
alexey-milovidov
fe1309e575
Merge pull request #10381 from ClickHouse/fix-concat-prepare 
Fix concat prepare
 2020-04-21 00:07:32 +03:00
alexey-milovidov
ab922d44d5
Merge pull request #10379 from ClickHouse/only_fetch_repliac 
Add setting always_fetch_merged_part
 2020-04-21 00:07:00 +03:00
alexey-milovidov
2c8576798b
Merge pull request #10354 from oandrew/avro-nested 
Avro nested fields insert support
 2020-04-20 23:36:02 +03:00
alexey-milovidov
3d4696d4ef
Update AvroRowInputFormat.cpp 2020-04-20 23:34:48 +03:00
alexey-milovidov
c4758b69a2
Merge pull request #10378 from hczhcz/patch-0420 
Add JSONExtractKeysAndValuesRaw
 2020-04-20 23:30:40 +03:00
alexey-milovidov
4912940009
Update FunctionsJSON.h 2020-04-20 23:28:54 +03:00
alexey-milovidov
2d799cf096
Merge pull request #10375 from azat/aggregator-drop-disk-reservation 
Drop disks reservation in Aggregator
 2020-04-20 23:22:14 +03:00
Maxim Serebryakov
a99a340b0b fix reading HashTable and HashSet 2020-04-20 23:19:03 +03:00
Anton Popov
e1b7e2de2f parse tuples of tuples as literals 2020-04-20 23:14:56 +03:00
alexey-milovidov
69b6f135e7
Merge pull request #10382 from excitoon-favorites/altercodec 
Allowed to alter column in non-modifying data mode when the same type is specified
 2020-04-20 22:54:53 +03:00
alexey-milovidov
f6de9c6ffd
Update AlterCommands.cpp 2020-04-20 22:54:08 +03:00
alexey-milovidov
1eca5088ec
Update AlterCommands.cpp 2020-04-20 22:53:19 +03:00
alexey-milovidov
faeab5f649
Merge pull request #10370 from amosbird/clang-10 
clang-10 fix
 2020-04-20 22:47:12 +03:00
Alexander Kuzmenkov
3ee89344af Statically dispatch on whether the argument is a Tuple 2020-04-20 18:37:28 +03:00
Ivan
d5b0a7e691
Fix Arcadia build (#10380) 2020-04-20 15:21:25 +03:00
Vladimir Chebotarev
82985ff594 Allowed to alter column in non-modifying data mode when the same type is specified. 2020-04-20 14:15:06 +03:00
Alexander Tokmakov
b29bddac12 Merge branch 'master' into database_atomic 2020-04-20 14:09:09 +03:00
Nikolai Kochetov
3dbc9b5562 Fix prepare for ConcatProcessor. 2020-04-20 14:03:29 +03:00
Nikita Mikhaylov
05206df88c better 2020-04-20 13:56:59 +03:00
alesapin
1bc84ec8b4 Fix comments 2020-04-20 13:56:23 +03:00
alesapin
8767ea7efa Add setting which restrict replica to merge parts by itself and always prefer dowloading from other replicas. 2020-04-20 13:53:29 +03:00
Nikolai Kochetov
c2c99b02bc Fix prepare for ConcatProcessor. 2020-04-20 13:36:38 +03:00
hcz
32573c0590 Add JSONExtractKeysAndValuesRaw 2020-04-20 18:08:22 +08:00
Nikolai Kochetov
052598534a Try fix unit tests. 2020-04-20 12:42:56 +03:00
Azat Khuzhin
9ca86dbf34 Drop disks reservation in Aggregator 
True reservation (IVolume::reserve()) will not takes compression into
account, and you aggregate a lot of data then it will likely fail even
though it can be completed, but just because you have big
max_bytes_before_external_group_by and huge max_threads it will fail.
 2020-04-20 11:33:46 +03:00
alexey-milovidov
9d0004cba0
Merge pull request #10365 from ClickHouse/avoid-infinite-loop-in-hierarchical-dictionaries 
Avoid infinite loop in hierarchical dictionaries
 2020-04-20 10:54:16 +03:00
Amos Bird
2d08c8e4ab
clang-10 fix 2020-04-20 15:45:37 +08:00
alexey-milovidov
83e17ae327
Merge pull request #9885 from ClickHouse/sorting-processors 
Sorting processors
 2020-04-20 09:30:03 +03:00
Alexey Milovidov
d7264b292d Merge branch 'master' into sorting-processors 2020-04-20 09:29:41 +03:00
Alexey Milovidov
70054e90d6 Merge branch 'master' into execute-query-flush-format-2 2020-04-20 09:19:34 +03:00
alexey-milovidov
587e16e23b
Merge pull request #10363 from ClickHouse/fixed-string-compare-as-zero-padded 
Compare with fixed string of different size as if strings are zero padded
 2020-04-20 09:14:27 +03:00
Alexey Milovidov
47e4d14ece Whitespace 2020-04-20 09:13:04 +03:00
alexey-milovidov
1577d771df
Merge pull request #10341 from azat/auto_distributed_group_by_no_merge 
Auto distributed_group_by_no_merge on GROUP BY sharding key
 2020-04-20 08:30:27 +03:00
Alexey Milovidov
a3195d56ae Fix translation 2020-04-20 07:19:50 +03:00
Alexey Milovidov
be4d20e690 Fixed an error and added a test 2020-04-20 07:02:52 +03:00
Alexey Milovidov
acde587c75 Merge branch 'master' into fixed-string-compare-as-zero-padded 2020-04-20 06:49:21 +03:00
Alexey Milovidov
c893edf46f Fix style 2020-04-20 06:48:35 +03:00
alexey-milovidov
fd738f9a61
Merge pull request #10364 from ClickHouse/check-error-code-in-part-check 
Check for error code in part check
 2020-04-20 06:46:36 +03:00
alexey-milovidov
7e5b044e67
Merge pull request #10362 from ClickHouse/rework-total-memory-tracker 
Rework total memory tracker
 2020-04-20 06:16:49 +03:00
Alexey Milovidov
3862085af7 Fix for embedded dictionaries 2020-04-20 05:39:43 +03:00
Alexey Milovidov
d99c26a40c Fix infinite loop in dictIsIn function #515 2020-04-20 05:31:21 +03:00
Alexey Milovidov
7023e096ec Check for error code in part check #6269 2020-04-20 04:44:24 +03:00
Alexey Milovidov
59a9edd018 Added forgotten modification 2020-04-20 04:43:25 +03:00
Alexey Milovidov
d783162548 Compare with fixed string as smaller string is zero padded #9272 2020-04-20 04:01:31 +03:00
Alexey Milovidov
1d885b3ff9 Merge branch 'master' into quota-key-in-client 2020-04-20 02:15:37 +03:00
Alexey Milovidov
237db26688 Less wrong 2020-04-20 02:11:41 +03:00
Alexey Milovidov
39c6c9a5d7 Merge remote-tracking branch 'origin/master' into system-tables-lazy-load 2020-04-20 02:00:46 +03:00
Alexey Milovidov
3755a5ba54 Added suggestion from Azat 2020-04-20 01:59:21 +03:00
Alexey Milovidov
2987e70aab Introduce "max_server_memory_usage" setting 2020-04-20 01:59:21 +03:00
Alexey Milovidov
ec6b176f3b Rework total memory tracker #10293 2020-04-20 01:59:21 +03:00
Azat Khuzhin
e44d5c5749 Fix clang readability-container-size-empty warning in StorageDistributed::canForceGroupByNoMerge() 2020-04-20 01:12:22 +03:00
Alexey Milovidov
1c00953b3e Added test tool 2020-04-19 23:57:34 +03:00
Alexey Milovidov
71c4418876 More memory statistics 2020-04-19 23:49:13 +03:00
Alexey Milovidov
25f3184dbe Merge branch 'master' into async-metric-memory-usage 2020-04-19 23:18:12 +03:00
Alexey Milovidov
8d3e6ed5e3 Added missing code 2020-04-19 23:04:59 +03:00
Alexey Milovidov
ca6bea3731 Added a patch from Alexander Burmak 2020-04-19 22:53:12 +03:00
zhang2014
57cbecf935 ISSUES-5436 reworking predefine http 2020-04-20 03:18:36 +08:00
Alexey Milovidov
5262512f0c Flush output for interactive applications 2020-04-19 22:02:36 +03:00
zhang2014
835dc4c445 After merge upsream master fix 2020-04-20 02:26:42 +08:00
zhang2014
8105a9bbe0 ISSUES-5436 fix review suggestions 2020-04-20 02:26:06 +08:00
zhang2014
847f7ab439 ISSUES-5436 fix build failure & fix test failure 2020-04-20 02:25:43 +08:00
zhang2014
6b716e511b ISSUES-5436 support custom http [part 6] 2020-04-20 02:25:12 +08:00
zhang2014
7aef95b082 ISSUES-5436 support custom http [part 5] 2020-04-20 02:23:18 +08:00
zhang2014
fd00757178 ISSUES-5436 support custom http [part 4] 2020-04-20 02:23:18 +08:00
zhang2014
60abff3341 ISSUES-5436 support custom http [part 3] 2020-04-20 02:23:18 +08:00
zhang2014
183eb82b7c ISSUES-5436 support custom http [part 2] 2020-04-20 02:23:18 +08:00
zhang2014
159ba24fca ISSUES-5436 support custom http 2020-04-20 02:23:18 +08:00
Alexey Milovidov
cf6bbaeb97 Flush output format on each block in executeQuery 2020-04-19 21:12:40 +03:00
Azat Khuzhin
be1dec9239 Fix distributed_group_by_no_merge optimization for Distributed-over-Distributed 2020-04-19 21:11:14 +03:00
Azat Khuzhin
93d049fe64 Allow auto distributed_group_by_no_merge for DISTINCT of sharding key 2020-04-19 18:53:37 +03:00
Nikolai Kochetov
67b3487207 Try fix build. 2020-04-19 18:46:12 +03:00
Nikolai Kochetov
e969f66aca Try fix test. 2020-04-19 18:41:35 +03:00
Azat Khuzhin
de4a723264 Auto distributed_group_by_no_merge on GROUP BY injective function of sharding key 2020-04-19 18:33:49 +03:00
Azat Khuzhin
5d11118cc9 Use thread pool (background_distributed_schedule_pool_size) for distributed sends 
After #8756 the problem with 1 thread for each (distributed table, disk)
for distributed sends became even worse (since there can be multiple
disks), so use predefined thread pool for this tasks, that can be
controlled with background_distributed_schedule_pool_size knob.
 2020-04-19 12:01:56 +03:00
Azat Khuzhin
201d5d5b25 Update comment for background_schedule_pool_size 
Include info about:
- kafka streaming
- dns cache updates
 2020-04-19 11:20:57 +03:00
Andrew Onyshchuk
68f2e93443 Fix style 2020-04-18 22:54:22 -05:00
Azat Khuzhin
673ddc9d77 Drop superfluous locking for atomic in DirectoryMonitor 2020-04-19 00:22:48 +03:00
Andrew Onyshchuk
14647ed03b Add Avro nested fields insert support 2020-04-18 15:46:24 -05:00
alexey-milovidov
aac7cc7330
Merge pull request #10126 from Jokser/replicated-merge-tree-s3 
Support ReplicatedMergeTree over S3
 2020-04-18 16:13:04 +03:00
alexey-milovidov
46a5c75beb
Update MergeTreeData.h 2020-04-18 16:11:57 +03:00
alexey-milovidov
8cea45315f
Merge pull request #10133 from 4ertus2/joins 
JOIN with Dictionary
 2020-04-18 16:08:15 +03:00
alexey-milovidov
959e6cd032
Merge pull request #10221 from ClickHouse/remove-part-special-case 
Support for one special case of removing incompletely written parts
 2020-04-18 15:58:58 +03:00
alexey-milovidov
43d48a21c6
Merge pull request #10318 from ClickHouse/least-greatest-generic 
Added generic variants for functions 'least' and 'greatest'.
 2020-04-18 15:35:19 +03:00
alexey-milovidov
72dd453c3f
Merge pull request #10234 from vitlibar/show-columns-of-not-loaded-dictionary 
Show information about not loaded dictionaries in system tables.
 2020-04-18 15:06:08 +03:00
alexey-milovidov
17b6e0b3e5
Merge pull request #10315 from azat/buffer-flush-bg-pool 
Use background thread pool for background buffer flushes
 2020-04-18 15:04:35 +03:00
alexey-milovidov
391165d725
Merge pull request #10337 from nikitamikhaylov/proper_dictionary_timeouts 
Proper dictionary timeouts.
 2020-04-18 14:42:36 +03:00
alexey-milovidov
b5f8efefa2
Merge pull request #10342 from azat/optimizeGroupBy-isInjective 
[RFC] Use isInjective() over manual list of such functions for GROUP BY optimization
 2020-04-18 14:28:59 +03:00
alexey-milovidov
d1b72f10d5
Merge pull request #10325 from Avogar/msgpack_format 
Improve MsgPackRowInputFormat
 2020-04-18 14:27:11 +03:00
alexey-milovidov
ef5f83eef8
Update MsgPackRowInputFormat.cpp 2020-04-18 14:26:57 +03:00
Vitaly Baranov
d62345bbaa Show information about not loaded dictionaries in system.columns, system.tables 
and in "SHOW TABLES" executed in any database with the "Dictionary" engine.
 2020-04-18 12:50:54 +03:00
Azat Khuzhin
548399725f Use IFunction::isInjective() over manual list of such functions for GROUP BY optimization 2020-04-18 10:23:19 +03:00
Azat Khuzhin
322681eb37 Passthrough isInjective via IFunctionOverloadResolver 2020-04-18 01:50:15 +03:00
Azat Khuzhin
f29e5c60a5 Add const qualifier for IFunction::isInjective() 2020-04-18 01:50:15 +03:00
Alexander Kuzmenkov
6793cd7cca
More granular assertion in Arena.h 2020-04-18 00:36:07 +03:00
Kruglov Pavel
96f4d5b7c6
Fix build error 2020-04-17 23:51:53 +03:00
Артем Стрельцов
948efff076 Merge branch 'master' of github.com:yandex/ClickHouse into direct_queries 2020-04-17 23:11:10 +03:00
Alexander Kuzmenkov
ef80a3bac6 do less things in SquashingTransform 2020-04-17 23:05:35 +03:00
Артем Стрельцов
741775a12f fixed some remarks from review 2020-04-17 22:54:53 +03:00
Kruglov Pavel
0f11526f24
Fix style error 2020-04-17 22:19:03 +03:00
Nikita Mikhaylov
c603acd515 mvp 2020-04-17 20:01:18 +03:00
Nikolai Kochetov
4a3d80fd71 Fix build. 2020-04-17 19:34:45 +03:00
Nikolai Kochetov
84faa9af26 Merge branch 'master' into shared-context-lifetime 2020-04-17 19:13:13 +03:00
Nikolai Kochetov
ce11662ab1 Fix build. 2020-04-17 15:58:52 +03:00
Anton Popov
f7b7b5eb74 remove unused flags 2020-04-17 14:59:10 +03:00
Nikolai Kochetov
42a0ad771f Remove not relevant code. 2020-04-17 13:07:44 +03:00
Nikolai Kochetov
d51a9c551b Remove shared_ptr to SharedContext from Context. 2020-04-17 12:47:40 +03:00
Avogar
b056dbce1c Improve MsgPackRowInputFormat 2020-04-17 12:35:38 +03:00
Alexey Milovidov
fdc5688d2d Added memory usage to AsynchronousMetrics 2020-04-17 07:09:41 +03:00
Alexey Milovidov
fb095ad787 Merge branch 'master' into remove-part-special-case 2020-04-17 06:14:15 +03:00
Alexey Milovidov
67790a74e5 Fix test 2020-04-17 06:13:21 +03:00
Alexey Milovidov
b16ee538ab Merge branch 'master' into sorting-processors 2020-04-17 05:31:55 +03:00
alexey-milovidov
17e7d4d88a
Merge pull request #10307 from abyss7/arcadia-4 
Changes for auto-sync with Arcadia
 2020-04-17 05:08:34 +03:00
alexey-milovidov
4bdaccbaee
Merge pull request #10312 from ClickHouse/fix_drop_optimize_race 
Fix DROP vs OPTIMIZE race in ReplicatedMergeTree
 2020-04-17 05:07:55 +03:00
alexey-milovidov
390bfe9a4c
Merge pull request #10317 from Avogar/markdown_format 
Markdown format
 2020-04-17 05:05:13 +03:00
Alexey Milovidov
1df5c7cedf Added generic variants of least and greatest functions #4767 2020-04-17 01:28:08 +03:00
Kruglov Pavel
2672b71b2d
Delete extra spaces 2020-04-16 23:47:01 +03:00
Artem Zuikov
c62c288e4c
fix COMMA and other JOIN mix (#10311) 2020-04-16 23:28:23 +03:00
Avogar
89d787dae3 Add new line at the end of file 2020-04-16 23:14:19 +03:00
Avogar
831c48c514 Add MarkdownRowOutput format 2020-04-16 23:10:42 +03:00
Nikita Mikhaylov
6b58998a36 better 2020-04-16 22:57:39 +03:00
Nikita Mikhaylov
c153cc8fe5 fixed :) 2020-04-16 22:54:11 +03:00
Alexander Kazakov
d5b3b2c7b6
Updated RWLockImpl: Fixed suboptimacy (readers queuing up) + minor tweaks to names and comments (#10303) 
* Readers queue correction
* Comments, renamings and cosmetics
 2020-04-16 21:56:21 +03:00
Nikita Mikhaylov
9a80eb6e47 Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-16 21:47:34 +03:00
Nikita Mikhaylov
85fbf413c1 server crashes, just to save 2020-04-16 21:47:20 +03:00
Artem Zuikov
ce372f464b
Fix finalize chain logic in ExpressionAnalysisResult (#10302) 2020-04-16 21:03:27 +03:00
Ildus Kurbangaliev
602baf62f0 Improve implementation of sumMap for tuples 2020-04-16 17:26:17 +00:00
Azat Khuzhin
a9b1b36907 Use separate pool for buffer flushes (background_buffer_flush_schedule_pool_size) 2020-04-16 20:14:28 +03:00
Ildus Kurbangaliev
fcacca68d7 Update src/AggregateFunctions/AggregateFunctionSumMap.cpp 
Co-Authored-By: Alexander Kuzmenkov <36882414+akuzm@users.noreply.github.com>
 2020-04-16 16:43:16 +00:00
Ildus Kurbangaliev
6244270809 Add SimpleAggregateFunction support for sumMap 2020-04-16 16:43:16 +00:00
Artem Zuikov
47cb670213 Merge branch 'master' into joins 2020-04-16 19:06:13 +03:00
alexey-milovidov
3de1a36b33
Update ya.make 2020-04-16 18:55:39 +03:00
Alexander Tokmakov
605f3b2119 fix DROP vs OPTIMIZE race in ReplicatedMergeTree 2020-04-16 18:30:18 +03:00
Nikolai Kochetov
025093d354 Fix build. 2020-04-16 17:51:33 +03:00
Nikolai Kochetov
d6db27e372 Modify context. 2020-04-16 17:37:38 +03:00
Ivan Lezhankin
e230632645 Changes required for auto-sync with Arcadia 2020-04-16 15:31:57 +03:00
Alexey Milovidov
cdeda4ab91 Fix usage of max_parser_depth setting; remove harmful default function arguments 2020-04-16 04:06:10 +03:00
Alexey Milovidov
f704c465a7 Make aware of one special case of imcompletely written parts #9940 2020-04-16 00:52:21 +03:00
alexey-milovidov
056c822e65
Merge pull request #10257 from 4ertus2/strange 
Some tech debt
 2020-04-16 00:45:55 +03:00
alexey-milovidov
2b64a97e9b
Merge pull request #10291 from 4ertus2/bugs 
Fix count(*) with multiple joins
 2020-04-16 00:45:09 +03:00
alexey-milovidov
d296e1b6d7
Merge pull request #10216 from Avogar/msgpack_format 
Update MsgPack format
 2020-04-16 00:44:08 +03:00
Artem Zuikov
739daf3bbe Merge branch 'master' into strange 2020-04-15 20:55:21 +03:00
Artem Zuikov
f08cdfcc4c fix count(*) with multiple_joins_rewriter_version = 1 2020-04-15 20:47:08 +03:00
Alexander Kuzmenkov
08d9734fc0 Merge remote-tracking branch 'origin/master' into HEAD 2020-04-15 20:16:56 +03:00
Nikolai Kochetov
234c4dbe84 Fix build. 2020-04-15 17:51:03 +03:00
Alexey Milovidov
fbe41a8ee6 Fix clang-tidy 2020-04-15 17:37:43 +03:00
Alexander Kuzmenkov
d15d6e1661 review fixes 2020-04-15 17:10:33 +03:00
alexey-milovidov
7b2c871c57
Merge pull request #10272 from ClickHouse/plus-infinity 
Allow to parse +inf
 2020-04-15 16:41:47 +03:00
alexey-milovidov
8c8a315bd8
Merge pull request #10271 from ClickHouse/remove-strange-code 
Remove strange code in arrayIndex function
 2020-04-15 16:41:18 +03:00
Alexander Kuzmenkov
2ee49c9d68 Merge remote-tracking branch 'origin/master' into HEAD 2020-04-15 15:57:29 +03:00
Nikolai Kochetov
43e178abfb Revert "dded more comments to AggregatingTransform." 
This reverts commit 01e495d783.
 2020-04-15 14:04:38 +03:00
Nikolai Kochetov
95916e39cf Added more comments to AggregatingTransform. 2020-04-15 13:57:42 +03:00
Nikolai Kochetov
01e495d783 dded more comments to AggregatingTransform. 2020-04-15 13:55:34 +03:00
Nikolai Kochetov
0c2d3417e2 Fix pipeline stuck with max_rows_to_group_by. 2020-04-15 13:18:52 +03:00
alesapin
e8cd92bba3 Fix debug build 2020-04-15 13:13:36 +03:00
Artem Zuikov
3d8562452d remove more code 2020-04-15 13:07:16 +03:00
Nikolai Kochetov
153f795ebe Merge branch 'master' into sorting-processors 2020-04-15 12:07:05 +03:00
alexey-milovidov
2a48b0ecd7
Merge pull request #10184 from xzkostyan/feature-zookeeper-ssl 
Optional secured communication between ClickHouse and Zookeeper
 2020-04-15 07:09:14 +03:00
alexey-milovidov
19c4968ca6
Update arrayIndex.h 2020-04-15 07:02:41 +03:00
Alexey Milovidov
738fef71f4 Allow to parse +inf #1839 2020-04-15 06:32:33 +03:00
Alexey Milovidov
eed2ea3b36 Remove strange code 2020-04-15 06:02:51 +03:00
alexey-milovidov
747bb16677
Merge pull request #10269 from ClickHouse/path-optional-scheme 
Continuation of #6256
 2020-04-15 05:47:51 +03:00
Alexey Milovidov
9667e1fb85 Fix clang-tidy 2020-04-15 05:46:36 +03:00
Alexey Milovidov
a4c2e9a599 Whitespace 2020-04-15 05:12:50 +03:00
Alexey Milovidov
ff817ae735 Remove debug output 2020-04-15 05:04:26 +03:00
Alexey Milovidov
fe59524481 Implemented in a different way 2020-04-15 04:59:14 +03:00
Alexey Milovidov
c22f91db01 Allow to pass quota_key in clickhouse-client 2020-04-15 04:15:05 +03:00
Alexey Milovidov
db9760af41 Continuation of #6256 2020-04-15 03:12:47 +03:00
Avogar
93c322bc30 Fix style error 2020-04-15 02:58:36 +03:00
alexey-milovidov
eef35bddc1
Merge pull request #10265 from ClickHouse/remove-useless-code-cast 
Remove useless code
 2020-04-15 02:33:34 +03:00
Avogar
b8061356b0 Update parsing method in MsgPackRowInputFormat 2020-04-15 02:08:55 +03:00
Alexey Milovidov
0c0218168a Whitespaces 2020-04-15 01:25:31 +03:00
Alexey Milovidov
8ad04d4fec Remove useless code 2020-04-15 00:05:45 +03:00
Alexander Kuzmenkov
03e00ac215 Merge remote-tracking branch 'origin/master' into HEAD 2020-04-14 23:03:23 +03:00
Nikolai Kochetov
15a8ac3245 Fix tests. 2020-04-14 22:31:49 +03:00
Nikolai Kochetov
7def7b021e Fix test with vesrioned collapsing. 2020-04-14 21:58:22 +03:00
Artem Zuikov
ee1b4a1a30
Fix and improve OneTypeMatcher (#10253) 2020-04-14 21:50:00 +03:00
Nikolai Kochetov
80c27689ff Add debug output. 2020-04-14 21:22:14 +03:00
Nikolai Kochetov
92692aff5e Fix build. 2020-04-14 21:03:29 +03:00
Alexander Kuzmenkov
1d3fe23b3b review fixes 2020-04-14 20:41:06 +03:00
Artem Zuikov
24f715ad87 tech debt 2020-04-14 17:43:09 +03:00
Nikolai Kochetov
01945bf5d9 Fix style 2020-04-14 16:27:33 +03:00
Nikolai Kochetov
40a0f53a42 Remove SharedBlockPtr from MergingSortedBlockInputStream. 2020-04-14 14:32:38 +03:00
Nikolai Kochetov
ada3d4e67c Remove StopCondition from MergingSortedBlockInputStream. 2020-04-14 14:26:03 +03:00
Nikolai Kochetov
e92827b954 Remove StopCondition from MergingSortedBlockInputStream. 2020-04-14 14:25:01 +03:00
Nikolai Kochetov
2da9f889cd Fix unit test. 2020-04-14 14:09:23 +03:00
Nikolai Kochetov
1de7191aa3 U[date test 2020-04-14 13:49:46 +03:00
Nikolai Kochetov
c0a8def386 Fix build. 2020-04-14 13:35:17 +03:00
Nikolai Kochetov
edb3f2f3fc Remove old code. 2020-04-14 13:23:16 +03:00
Nikolai Kochetov
12f4cfb2c7 Use processors for final. 2020-04-14 13:04:49 +03:00
Nikolai Kochetov
1ce2e1b93b Move comments. 2020-04-14 12:43:53 +03:00
Nikolai Kochetov
fc42851186 Move comments. 2020-04-14 12:43:17 +03:00
Nikolai Kochetov
434a13a8bd Move algorithm to separate files. 2020-04-14 12:21:24 +03:00
Nikolai Kochetov
71feedea6f Remove some code. 2020-04-14 12:05:29 +03:00
Nikolai Kochetov
848026ac4c Fix style. 2020-04-14 11:48:38 +03:00
alexey-milovidov
7587bd8cfc
Merge pull request #10239 from ClickHouse/fix-cancel-race-in-remote 
Fix race after cancel of RemoteBlockInputStream.
 2020-04-14 05:04:38 +03:00
Alexander Kuzmenkov
59e8230271 Merge remote-tracking branch 'origin/master' into HEAD 2020-04-14 02:27:46 +03:00
alexey-milovidov
b8be585595
Merge pull request #10237 from ClickHouse/akz/mutations-to-correctly-handle-lambdas 
ALTER UPDATE/DELETE on Replicated* storages: Fixed "Unknown function lambda." error
 2020-04-14 01:32:38 +03:00
alexey-milovidov
9de981d8d3
Merge pull request #10052 from Vxider/mv_parallel_insert 
Enable parallel INSERT for materialized view
 2020-04-14 01:30:44 +03:00
alexey-milovidov
2219f05139
Merge pull request #10235 from ClickHouse/fix_range_hashed_ddl_dictionaries 
Fix 'Cannot add column' in DDL dictionary
 2020-04-14 01:28:24 +03:00
Konstantin Lebedev
a7c5f622ea Add string_utils for tests/zookeeper_impl.cpp 2020-04-14 00:27:54 +03:00
Nikolai Kochetov
2543741a9a Fix build. 2020-04-14 00:03:11 +03:00
Nikolai Kochetov
1ef6e8f7c7 Fix build. 2020-04-13 23:58:29 +03:00
Nikolai Kochetov
801320983b Refactor SummingSortedAlgorithm. 2020-04-13 23:50:13 +03:00
Alexander Kazakov
d480707c12 Fixed clang build + tweaked comment 2020-04-13 23:02:44 +03:00
Avogar
e46322fcef Update MsgPack input format. 2020-04-13 22:33:02 +03:00
Nikita Mikhaylov
89f80a6353
Merge branch 'master' into quorum_bug 2020-04-13 23:25:55 +04:00
Nikolai Kochetov
84b1dd4c1e Fix tests. 2020-04-13 22:20:26 +03:00
Nikolai Kochetov
d7d29d8250 Fix build. 2020-04-13 22:02:57 +03:00
Alexander Tokmakov
b7d4bccc77 fix build 2020-04-13 22:02:13 +03:00
Nikolai Kochetov
586c295b94 Added SummingSortedAlgorithm 2020-04-13 21:51:17 +03:00
alexey-milovidov
45e85724a6
Update MutationsInterpreter.cpp 2020-04-13 21:33:25 +03:00
Artem Zuikov
6106b2bfc7 Merge branch 'master' into joins 2020-04-13 20:37:27 +03:00
Artem Zuikov
df01227bd2 move DictionaryReader code out of header 2020-04-13 20:36:07 +03:00
Alexander Kazakov
0aa4c85602 Fixed style checker complaint 2020-04-13 20:04:17 +03:00
Artem Zuikov
0b7ae2c2bf working version 2020-04-13 20:03:11 +03:00
Nikolai Kochetov
eacc04fc5c Fix race after cancel of RemoteBlockInputStream. 2020-04-13 19:33:15 +03:00
Nikita Mikhaylov
68e82c11e0 fix build 2020-04-13 18:58:29 +03:00
Alexander Tokmakov
6c0d9723e0 Merge branch 'master' into database_atomic 2020-04-13 18:47:47 +03:00
Alexander Tokmakov
d1024e76bd fix 2020-04-13 18:46:36 +03:00
Ivan Lezhankin
910ab8a265 Move contrib/libpcg-random → base/pcg-random 2020-04-13 18:42:58 +03:00
Nikita Mikhaylov
441bb13d4a better 2020-04-13 18:21:05 +03:00
Nikolai Kochetov
89aef7aaf9 Add comments. 2020-04-13 18:04:54 +03:00
Nikolai Kochetov
2b81d68b56 Fix build. 2020-04-13 17:58:23 +03:00
Nikolai Kochetov
9acea16b7f Fix build. 2020-04-13 17:57:21 +03:00
Nikolai Kochetov
d3adcc1cb0 Fix build. 2020-04-13 17:53:04 +03:00
Nikolai Kochetov
377e16c00c Refactor AggregatingSortedAlgorithm. 2020-04-13 17:42:58 +03:00
Alexander Kazakov
e05e2c7628 Fixed check for nondeterministic functions to handle lambdas correctly 2020-04-13 17:34:11 +03:00
alesapin
9cc7d0f06a Fix 'Cannot add column' error while creating range_hashed dictionary using DDL queries 2020-04-13 17:34:01 +03:00
Nikolai Kochetov
9ce0607de7 Remove header from AggregatingSortedAlgorithm. 2020-04-13 16:40:53 +03:00
alexey-milovidov
396360cd90
Merge pull request #10209 from ClickHouse/akz/fix_segfault_in_system_tables 
Fix N.P. segfault in StorageSystemTables for database engine "Lazy"
 2020-04-13 16:33:27 +03:00
alexey-milovidov
d1c436788b
Merge pull request #10206 from ClickHouse/fix-limit-with-infinite-sources 
Fix limit with infinite sources
 2020-04-13 16:32:02 +03:00
alexey-milovidov
6de28bd5d6
Merge pull request #10222 from ClickHouse/system-log-refactoring 
Small refactoring of SystemLogs
 2020-04-13 16:27:54 +03:00
Nikolai Kochetov
0544c1f25b Fix build. 2020-04-13 16:26:50 +03:00
alexey-milovidov
eedb5a3e3d
Merge pull request #10218 from ClickHouse/fix-generate-random-date 
Fixed "generateRandom" function for Date type
 2020-04-13 16:26:08 +03:00
Nikolai Kochetov
5efdf1203e Fix build. 2020-04-13 16:22:32 +03:00
Nikolai Kochetov
a2b5fd4b3d Fix build. 2020-04-13 16:18:46 +03:00
Artem Zuikov
12ca9f5912 disable alwaysReturnsEmptySet() for HashJoin over dictionary 2020-04-13 15:32:45 +03:00
Nikita Mikhaylov
d5c055ab03 remove logs 2020-04-13 15:13:13 +03:00
Nikolai Kochetov
a6bf7a14c8 Fix build. 2020-04-13 15:02:59 +03:00
Nikolai Kochetov
03dad5ccf5 Added AggregatingSortedAlgorithm. 2020-04-13 14:45:59 +03:00
Nikolai Kochetov
9a9bedc8cc Fix test for streams. 2020-04-13 12:02:50 +03:00
Nikolai Kochetov
29fc8f145b Fix tests in debug. 2020-04-13 11:50:14 +03:00
Alexey Milovidov
c7eaaaf7fe Small refactoring of SystemLogs 2020-04-13 04:33:05 +03:00
alexey-milovidov
6eed76d5fb
Merge pull request #10217 from ClickHouse/convert-types-in-views 
Convert types in Views
 2020-04-13 02:24:02 +03:00
alexey-milovidov
8f040683e4
Merge pull request #10214 from ClickHouse/fix-parse-date-time-best-effort-rfc-2822-tue-thu 
Fix "parseDateTimeBestEffort" for strings in RFC-2822 when day of week is Tuesday or Thursday
 2020-04-13 02:23:21 +03:00
Alexey Milovidov
8ad89a82d4 Support Nested types in "generateRandom" 2020-04-13 02:08:32 +03:00
Alexey Milovidov
860e9092f1 Fixed another inconsistency in partition names 2020-04-13 01:25:41 +03:00
Alexey Milovidov
4788eb3423 Make the assertion in code consistent with the real partition expression 2020-04-13 01:00:03 +03:00
Alexey Milovidov
3215257a90 Fixed "generateRandom" function for Date type #9973 2020-04-13 00:27:11 +03:00
Alexey Milovidov
983950d4ec Convert types in Views 2020-04-13 00:07:11 +03:00
Avogar
b9931863ef Fix FixedString packing 2020-04-13 00:01:17 +03:00
alexey-milovidov
bc00e6463a
Merge pull request #10053 from azat/log_queries_type 
Add log_queries_min_type to filter which entries will be written to query_log
 2020-04-12 23:37:42 +03:00
Alexey Milovidov
20dcc4decd Fixed build on FreeBSD according to the advice from Vitaly @hellvesper 2020-04-12 23:05:58 +03:00
alexey-milovidov
3f1658c0e9
Update parseDateTimeBestEffort.cpp 2020-04-12 22:35:23 +03:00
Alexey Milovidov
142087c4f7 Fix "parseDateTimeBestEffort" for strings in RFC-2822 when day of week is Thuesday or Thursday #10082 2020-04-12 22:34:04 +03:00
Alexey Milovidov
8cb4dd275a Remove default argument (harmful) #10082 2020-04-12 22:23:59 +03:00
alexey-milovidov
718e4bcdf8
Update IProcessor.h 2020-04-12 22:01:02 +03:00
Alexander Tokmakov
20e6593f96 disable by default 2020-04-12 21:52:59 +03:00
Alexander Kazakov
2eb2e4cf41 Added proper nullptr check 2020-04-12 20:17:41 +03:00
Alexey Milovidov
ec4889e43e Remove debug output 2020-04-12 19:21:07 +03:00
Alexey Milovidov
6de712f0f4 Fix joined constants, development 2020-04-12 19:21:07 +03:00
Alexey Milovidov
d4a3ef2fdc Fixed wrong code (no changes in behaviour) 2020-04-12 19:16:02 +03:00
Nikolai Kochetov
bff1f24cf7 Added IProcessor::onUpdatePorts 2020-04-12 18:21:21 +03:00
Nikolai Kochetov
4da19d122d Added IProcessor::onUpdatePorts 2020-04-12 18:02:17 +03:00
Nikolai Kochetov
82ef20d6dc Fix build. 2020-04-12 17:17:34 +03:00
Alexander Tokmakov
5e6d4b9449 Merge branch 'master' into database_atomic 2020-04-12 16:35:44 +03:00
Azat Khuzhin
365b5207b7 Add log_queries_min_type to filter which entries will be written to query_log 
Can be used to write into query_log only failed queries (i.e. on memory
exceeded error), by using:

  set log_queries_min_type='EXCEPTION_WHILE_PROCESSING'
 2020-04-12 10:46:36 +03:00
alexey-milovidov
b888c867b3
Merge pull request #10026 from CurtizJ/speedup-index 
Improve performance of index analysis with monotonic functions [2].
 2020-04-12 06:37:26 +03:00
Alexey Milovidov
ca5172cc63 Merging #10094 2020-04-12 06:25:47 +03:00
Alexey Milovidov
c64aa011ba Merge branch 'jgon' of https://github.com/amosbird/ClickHouse into amosbird-jgon 2020-04-12 06:21:00 +03:00
alexey-milovidov
a2418f94df
Update HashJoin.cpp 2020-04-12 06:19:13 +03:00
alexey-milovidov
d6544159ba
Update HashJoin.cpp 2020-04-12 06:18:21 +03:00
Alexey Milovidov
d43903211a Better exception message #9810 2020-04-12 05:51:56 +03:00
alexey-milovidov
791d2bc91e
Merge pull request #10198 from ClickHouse/add-function-is-constant 
Add function "isConstant"
 2020-04-12 05:44:22 +03:00
Alexey Milovidov
f8e1f1b69b Fix wrong whitespaces in debug output 2020-04-12 05:06:58 +03:00
Alexey Milovidov
813a09f75a Merge branch 'master' of github.com:yandex/ClickHouse 2020-04-12 05:05:45 +03:00
Alexey Milovidov
01bc88a851 Fix wrong whitespaces in debug output 2020-04-12 05:05:30 +03:00
alexey-milovidov
0cc91b9cab
Merge pull request #10196 from azat/Distributed-GLOBAL-IN 
Allow literals for GLOBAL IN
 2020-04-12 04:39:32 +03:00
alexey-milovidov
716ddc4580
Update isConstant.cpp 2020-04-12 04:26:11 +03:00
Alexey Milovidov
754967bde6 Add function "isConstant" 2020-04-12 04:24:00 +03:00
alexey-milovidov
78316f027a
Merge pull request #10195 from ClickHouse/fix-array-join-prewhere 
Fix move-to-prewhere optimization in presense of arrayJoin functions.
 2020-04-12 03:53:55 +03:00
alexey-milovidov
9203db0ad5
Merge pull request #10140 from BohuTANG/20200409_bug_fix_mysql_handshake_scramble 
Fix scramble issue for native mysql-connector-java(JDBC)
 2020-04-12 03:53:19 +03:00
Alexey Milovidov
dec3e0f986 Make least and greatest functions case insensitive for compatibility with MySQL 2020-04-12 03:38:25 +03:00
Azat Khuzhin
194dcc01fb Allow literals for GLOBAL IN 2020-04-12 02:48:55 +03:00
alexey-milovidov
0782052768
Merge pull request #10131 from ClickHouse/fix-extremes-for-processors 
Fix extremes for processors
 2020-04-12 02:31:39 +03:00
alexey-milovidov
f5fc3b1e71
Merge pull request #10085 from achimbab/transform_null_in 
transform_null_in option to test NULL values at the IN-Operator.
 2020-04-12 02:01:54 +03:00
alexey-milovidov
2adeabd3c7
Update Settings.h 2020-04-12 01:58:45 +03:00
Alexey Milovidov
cf9f00644e Fix the issue with arrayJoin and PREWHERE optimization #10092 2020-04-12 01:13:06 +03:00
Alexey Milovidov
121bf7b8c2 Whitespace #9968 2020-04-12 00:37:19 +03:00
alexey-milovidov
f472535f54
Merge pull request #9968 from Enmk/SIMD_tokenization 
Splitting string into Alpha-Num tokens with SIMD intrinsics.
 2020-04-12 00:33:29 +03:00
alexey-milovidov
00d8e7eefb
Merge branch 'master' into transform_null_in 2020-04-11 23:15:54 +03:00
alexey-milovidov
3e110d8237
Merge pull request #10192 from vitlibar/always-replace-empty-database-with-current 
Fix using the current database for access checking
 2020-04-11 23:10:16 +03:00
alexey-milovidov
a4969d89f9
Merge pull request #10164 from azat/system.tables-superfluous-dict-reload 
Avoid superfluous dictionaries load
 2020-04-11 23:05:56 +03:00
alexey-milovidov
cd979d7997
Merge pull request #10130 from CurtizJ/polymorphic-parts 
Fix some kinds of alters with compact parts
 2020-04-11 23:02:48 +03:00
alexey-milovidov
a7ecacc8b0
Merge pull request #10186 from filimonov/setting_allow_nondeterministic_mutations 
allow_nondeterministic_mutations
 2020-04-11 22:56:06 +03:00
Vitaly Baranov
2e55d44e57 Fix using the current database for access checking when the database isn't specified. 2020-04-11 20:13:56 +03:00
Alexander Tokmakov
8b6c836720 fix 2020-04-11 18:38:41 +03:00
Vitaly Baranov
18fbd968ba
Merge pull request #10165 from azat/drop-dictionary-as-table 
Do not break DROP DICTIONARY with DROP TABLE
 2020-04-11 14:49:41 +03:00
Ivan
67235834b3
Update libdivide to v3.0 (#10169) 2020-04-11 14:14:01 +03:00
Azat Khuzhin
55a143d1a5 Avoid superfluous dictionaries load (system.tables, SHOW CREATE TABLE) 
This patch avoids loading dictionaries for:
- SELECT * FROM system.tables (used by clickhouse-client for completion)
- SHOW CREATE TABLE some_dict

But the dictionary will still be loaded on:
- SHOW CREATE TABLE some_dict (from the database with Dictionary engine)
 2020-04-11 13:26:41 +03:00
Vitaly Baranov
e86f549103
Merge pull request #10181 from vitlibar/revert-resetting-settings-in-tcp-handler 
Revert resetting settings in TCPHandler
 2020-04-11 07:46:23 +03:00
Alexander Tokmakov
f0edb65e33 add test 2020-04-11 02:02:15 +03:00
Konstantin Lebedev
c9542b6601 Style fixes for communication between ClickHouse and Zookeeper over SSL 2020-04-11 01:09:14 +03:00
Nikita Mikhaylov
a8d72d01c3 mvp fix 2020-04-11 00:29:54 +03:00
alexey-milovidov
25236d3544
Merge branch 'master' into setting_allow_nondeterministic_mutations 2020-04-10 23:58:46 +03:00
alexey-milovidov
330d138106
Update Settings.h 2020-04-10 23:58:13 +03:00
Mikhail Filimonov
2f5b4b0f9b Added ability to relax the restriction on non-deterministic functions usage in mutations with allow_nondeterministic_mutations setting. 2020-04-10 22:01:10 +02:00
Azat Khuzhin
5b3c635200 Do not break DROP DICTIONARY after DROP TABLE executed on dictionary 2020-04-10 21:10:32 +03:00
Vitaly Baranov
ca634f603a Revert resetting the settings to their defaults after each query in TCPHandler. 2020-04-10 21:09:59 +03:00
Alexey Milovidov
39bbc1071b Fix typo 2020-04-10 20:23:51 +03:00
Nikolai Kochetov
198f02d4cf Try simplify Replacing. 2020-04-10 20:22:15 +03:00
Nikolai Kochetov
ca8c78bfa2 Try simplify Replacing. 2020-04-10 20:19:44 +03:00
Nikolai Kochetov
44a3e216d1 Try simplify Replacing. 2020-04-10 20:16:38 +03:00
Nikolai Kochetov
ba840b5a59 Added VersionedCollapsingAlgorithm. 2020-04-10 19:44:47 +03:00
Nikolai Kochetov
2fa40ad554 Fix build. 2020-04-10 19:18:53 +03:00
Nikolai Kochetov
864e0a407f Added GraphiteRollupSortedAlgorithm. 2020-04-10 19:15:51 +03:00
Nikolai Kochetov
f35a8bf351 Fix style. 2020-04-10 18:41:22 +03:00
Alexander Tokmakov
033d7f9b32 Merge branch 'master' into database_atomic 2020-04-10 17:12:09 +03:00
Nikolai Kochetov
994f95ddb0 Added ReplacingSortedAlgorithm. 2020-04-10 17:03:36 +03:00
Nikolai Kochetov
123c654db3 Fix build. 2020-04-10 16:41:00 +03:00
Anton Popov
d018977f4b fix 'ALTER CLEAR INDEX/COLUMN' queries with compact parts 2020-04-10 16:36:51 +03:00
Nikolai Kochetov
51e5603044 Fix build. 2020-04-10 16:03:37 +03:00
Nikolai Kochetov
e9587b8f4c Fix build. 2020-04-10 15:53:51 +03:00
Nikolai Kochetov
d46c228b9c Fix build. 2020-04-10 15:47:30 +03:00
Nikolai Kochetov
7b85a36975 Added CollapsingSortedAlgorithm. 2020-04-10 15:40:16 +03:00
Artem Zuikov
9901bf0f6e fix column size in KeyGetterForDict 2020-04-10 14:03:08 +03:00
Artem Zuikov
ba50519af8 workaround for function resolver 2020-04-10 13:28:44 +03:00
Nikolai Kochetov
2aba662d2c Fix build. 2020-04-10 12:32:34 +03:00
Nikolai Kochetov
97158f7656 Fix build. 2020-04-10 12:30:53 +03:00
Nikolai Kochetov
978576d0c5 Move Graphite params to separate file. 2020-04-10 12:25:52 +03:00
Nikolai Kochetov
71c72a75d7 Move Graphite params to separate file. 2020-04-10 12:24:16 +03:00
Nikolai Kochetov
16137068b2 Move Graphite params to separate file. 2020-04-10 12:22:51 +03:00
Nikolai Kochetov
27f3d2711a Move Graphite params to separate file. 2020-04-10 12:20:43 +03:00
Nikolai Kochetov
868f7e9aea Move Graphite params to separate file. 2020-04-10 12:16:23 +03:00
Nikolai Kochetov
1b6d80bfae Merge branch 'master' into sorting-processors 2020-04-10 12:07:21 +03:00
Nikolai Kochetov
f7fdfe4ed2 Fix build. 2020-04-10 12:04:56 +03:00
Nikolai Kochetov
fc605d411d Added IMergingAlgorithm. 2020-04-10 12:04:28 +03:00
Nikolai Kochetov
2ce753a316 Fix tests. 2020-04-10 12:04:28 +03:00
Nikolai Kochetov
cbd1f6a524 Added comments. 2020-04-10 12:04:28 +03:00
Nikolai Kochetov
f96a5fe923 Fix build, 2020-04-10 12:04:50 +03:00
Nikolai Kochetov
71fab516f2 Fix AggregatingSorted for simple aggregate functions. 2020-04-10 12:04:34 +03:00
Nikolai Kochetov
fe442d8c9a Remove special case for simple input in IMergingTransform. 2020-04-10 12:04:28 +03:00
Nikolai Kochetov
8726ad9e3b Try fix collapsing. 2020-04-10 12:04:28 +03:00
Nikolai Kochetov
d3acce8afa Fix build. 2020-04-10 12:04:28 +03:00
Alexander Kazakov
497df3086f Merge branch 'master' into timed_rwlock 
Change-Id: I620bfde2121ff013773b001d514b40b1e796a58b
 2020-04-10 11:38:20 +03:00
philip.han
7fa5afecb4 Support transform_null_in option for StorageSet 2020-04-10 14:42:36 +09:00
philip.han
c39e3a51ad Fix Set::insertFromBlockImplCase() 2020-04-10 12:30:54 +09:00
BohuTANG
87cc8de8e2 Merge remote-tracking branch 'ck/master' into 20200409_bug_fix_mysql_handshake_scramble 2020-04-10 11:10:41 +08:00
Alexander Tokmakov
50decc755d fix rename materialized view 2020-04-10 04:35:37 +03:00
Alexander Tokmakov
03ed9d59b0 add symlinks 2020-04-10 03:08:43 +03:00
Alexander Tokmakov
58067438cd add fallback for renameat2 2020-04-10 01:23:03 +03:00
alexey-milovidov
4a73fe7477
Merge pull request #9889 from Avogar/msgpack_format 
Msgpack format
 2020-04-10 00:07:10 +03:00
Артем Стрельцов
cd2eac9f93 codestyle fixed 2020-04-09 23:52:53 +03:00
alexey-milovidov
a85d35f31c
Merge pull request #10049 from azat/show-create-table-multiline 
Make SHOW CREATE TABLE multiline
 2020-04-09 23:30:56 +03:00
Alexander Kazakov
0accd2908c Fix up styler's grudge 2020-04-09 23:11:20 +03:00
Artem Zuikov
0cd49d746f several fixes 2020-04-09 23:00:57 +03:00
Alexander Kazakov
26dd6140b2 Added new config settings to control timeouts 
* "lock_acquire_timeout" controls for how long a query will continue to
acquire each lock on its argument tables
 * "lock_acquire_timeout_for_background_operations" is a per-table
setting for storages of *MergeTree family
 2020-04-09 21:10:27 +03:00
Anton Popov
76cf9b7f03 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-04-09 20:16:45 +03:00
Artem Zuikov
10aad52278 fix crash 2020-04-09 17:38:32 +03:00
Артем Стрельцов
3c4ac2f04c minor changes 2020-04-09 17:38:01 +03:00
Артем Стрельцов
a5ac19bf1a deleted debug output 2020-04-09 17:33:59 +03:00
Артем Стрельцов
5a70a77c4a Merge branch 'master' into direct_queries 2020-04-09 17:29:37 +03:00
Nikolai Kochetov
9f5a40e700 Added comment. 2020-04-09 13:35:51 +03:00
Artem Zuikov
9f0db4dfef Merge branch 'master' into joins 2020-04-09 11:53:18 +03:00
philip.han
3149f75430 Replace a reference for Context with a copied bool value. 2020-04-09 17:27:55 +09:00
Vitaly Baranov
12336a9ece Use "CREATE USER HOST REGEXP" instead of "CREATE USER HOST NAME REGEXP". 2020-04-09 10:22:51 +03:00
Vitaly Baranov
f0d3547b8f Parser can parse "ON CLUSTER" in other places of SQL commands too. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
4d93577791 PREWHERE can be used now by user without row filtering. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
d992e408d8 Disable creating row policies for insert, update, delete because those filters are not supported. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
d548c7e381 Simplify DCL for creating quotas. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
23ac1ee87c readonly user now can execute SHOW CREATE for access entities. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
36a5b57ac4 Use "CREATE SETTINGS PROFILE name SETTINGS INHERIT parent" instead of "CREATE SETTINGS PROFILE name SETTINGS PROFILE parent". 2020-04-09 10:22:51 +03:00
Nikolai Kochetov
ae6267070e Fix style. 2020-04-09 09:28:13 +03:00
alexey-milovidov
cb6c860d89
Update MySQLProtocol.h 2020-04-09 06:25:20 +03:00
alexey-milovidov
ccf5cb2a66
Update MySQLProtocol.h 2020-04-09 06:24:09 +03:00
BohuTANG
691fe42586 Merge remote-tracking branch 'ck/master' into 20200409_bug_fix_mysql_handshake_scramble 2020-04-09 10:59:04 +08:00
alexey-milovidov
6ff4c3aa16
Merge pull request #10135 from azat/distributed-insert-converting 
Convert blocks if structure does not match on INSERT into Distributed()
 2020-04-09 05:51:36 +03:00
BohuTANG
e544edd726 Fix random scramble using seperator character issue during MySQL handshakes 2020-04-09 09:43:02 +08:00
Alexander Tokmakov
140cd88c20 fixes 2020-04-09 02:59:39 +03:00
Alexey Milovidov
540e9f7d0d Fix logged number of inserted rows into ReplicatedMergeTree 2020-04-09 01:58:15 +03:00
Konstantin Lebedev
b666f60af8 Optional secured communication between ClickHouse and Zookeeper 2020-04-09 01:40:54 +03:00
Azat Khuzhin
6d85207bfb Convert blocks if structure does not match on INSERT into Distributed() 
Follow-up for: #10105
 2020-04-08 23:46:01 +03:00
alexey-milovidov
db4270b60c
Merge pull request #10077 from zhang2014/fix/ISSUES-10056 
ISSUES-10056 support identifier argument for MySQL Database engine
 2020-04-08 22:59:09 +03:00
Artem Zuikov
ab12ebb5cf add allowDictJoin() 2020-04-08 22:58:27 +03:00
alexey-milovidov
0372a6119a
Merge pull request #10110 from amosbird/tsm 
more monotonicity for toString()
 2020-04-08 22:55:04 +03:00
alexey-milovidov
9a00eca1c5
Merge pull request #10121 from ClickHouse/fix_adaptive_granularity_compatibility 
Fix adaptive granularity compatibility
 2020-04-08 22:50:09 +03:00
alexey-milovidov
c389fee7e7
Update StorageReplicatedMergeTree.cpp 2020-04-08 22:48:01 +03:00
alexey-milovidov
80b73a209b
Merge pull request #10107 from ClickHouse/fix-globs-test 
Fix unit test in debug build.
 2020-04-08 22:46:44 +03:00
alexey-milovidov
de2fb3ea17
Merge pull request #10108 from ClickHouse/thread-fuzzer-disable-under-thread-memory-sanitizer 
ThreadFuzzer: do not wrap pthread functions under thread and memory sanitizers
 2020-04-08 22:46:07 +03:00
Alexander Tokmakov
dd1590830b Merge branch 'master' into database_atomic 2020-04-08 22:00:46 +03:00
Artem Zuikov
8d6f641796 join over dictionary concept 2020-04-08 21:59:52 +03:00
Nikolai Kochetov
458c7f516d Fix extremes for Processors. 2020-04-08 21:50:14 +03:00
Pavel Kovalenko
0ea0daa194 Merge remote-tracking branch 'origin/master' into replicated-merge-tree-s3 2020-04-08 21:47:17 +03:00
zhang2014
9eb96b87db ISSUES-10056 reused evaluateConstantExpressionOrIdentifierAsLiteral 2020-04-09 01:31:28 +08:00
zhang2014
9ed708b902 ISSUES-10056 add some check and support identifier argument for MySQL Database Engine 2020-04-09 01:31:27 +08:00
Anton Popov
c8c4dc8104 fix 'ALTER MODIFY COLUMN' with compact parts 2020-04-08 19:20:52 +03:00
Amos Bird
f1cb928737
more monotonicity for toString() 2020-04-08 20:13:44 +08:00
Pavel Kovalenko
3603c98c81 Move gtest for S3 URI to proper folder. 2020-04-08 14:59:24 +03:00
Pavel Kovalenko
89fe81ed62 Integration test for ReplicatedMergeTree over S3 fixes. 2020-04-08 14:56:31 +03:00
Pavel Kovalenko
bc349a563a Merge branch 'master' into replicated-merge-tree-s3 2020-04-08 13:53:30 +03:00
alesapin
ded306f016 Fix adaptive granularity compatibility 2020-04-08 12:51:04 +03:00
Pavel Kovalenko
9b1c5c8b51 Fix regex for S3 URI to pass clang-tidy check. 2020-04-08 11:44:26 +03:00
Pavel Kovalenko
5b2b8d38fa Download part trough disk interface. 2020-04-08 11:41:13 +03:00
Azat Khuzhin
3116b2d29b Make SHOW CREATE TABLE multiline (because it more readable and also mysql like) 2020-04-08 10:26:40 +03:00
Amos Bird
0b5cc80580
joinGetOrNull 2020-04-08 11:01:08 +08:00
alexey-milovidov
a46a61c970
Update KeyCondition.h 2020-04-08 05:56:25 +03:00
alexey-milovidov
a42d875a68
Update KeyCondition.h 2020-04-08 05:55:39 +03:00
alexey-milovidov
723a1f41e2
Update KeyCondition.h 2020-04-08 05:55:22 +03:00
alexey-milovidov
94a621060d
Update KeyCondition.h 2020-04-08 05:55:03 +03:00
alexey-milovidov
a6194364ea
Update MergeTreeDataSelectExecutor.cpp 2020-04-08 05:54:08 +03:00
alexey-milovidov
6d80ab1eed
Merge pull request #9811 from vitlibar/RBAC-8 
RBAC-8
 2020-04-08 05:47:55 +03:00
alexey-milovidov
dd333460d6
Merge pull request #10068 from ClickHouse/fix_check_table_with_index 
Fix bug with uncompressed checksums in CHECK TABLE query
 2020-04-08 05:37:18 +03:00
alexey-milovidov
dad892e9d4
Merge pull request #10105 from azat/distributed-insert-types-differs 
Fix SIGSEGV on INSERT into Distributed on different struct with underlying
 2020-04-08 05:36:02 +03:00
Alexey Milovidov
97c2d17e99 ThreadFuzzer: do not wrap pthread functions under thread and memory sanitizers 2020-04-08 05:32:33 +03:00
Anton Popov
cbdc3ef214 Merge remote-tracking branch 'upstream/master' into speedup-index 2020-04-08 04:15:48 +03:00
alexey-milovidov
bcb2899b0d
Merge pull request #10104 from ClickHouse/adjust-collisions-weak-hash 
Remove unwanted output from unit tests
 2020-04-08 04:10:08 +03:00
Alexey Milovidov
f8500cf5d5 Fix unit test 2020-04-08 04:09:01 +03:00
Alexander Tokmakov
135197aa75 fixes 2020-04-08 04:02:00 +03:00
alexey-milovidov
401c52524b
Merge pull request #9998 from Jokser/s3-uri-virtual-hosted-style-support 
Virtual hosted-style support for S3 URI
 2020-04-08 03:51:28 +03:00
alexey-milovidov
37fe63f8d8
Update S3Common.cpp 2020-04-08 03:49:09 +03:00
alexey-milovidov
09a397a68f
Merge pull request #9997 from azat/dist-on-dist-fixes 
Fix Distributed-over-Distributed with one only shard in nested table
 2020-04-08 03:45:29 +03:00
alexey-milovidov
ebe9ae4fab
Update StorageMerge.cpp 2020-04-08 03:45:11 +03:00
alexey-milovidov
1b704425b6
Update StorageBuffer.cpp 2020-04-08 03:42:47 +03:00
alexey-milovidov
a29393821d
Merge pull request #10099 from ClickHouse/fix-9826 
Fix 9826
 2020-04-08 02:41:11 +03:00
Azat Khuzhin
b2fa9d8750 Fix SIGSEGV on INSERT into Distributed on different struct with underlying 2020-04-08 02:35:31 +03:00
alexey-milovidov
c079fd7f1b
Merge pull request #10064 from ClickHouse/small_fixes_in_dict_parser 
Small fixes in dictionaries DDL parser
 2020-04-08 02:22:20 +03:00
alexey-milovidov
7212efbfbf
Merge pull request #10103 from ClickHouse/fix-zk-multi-async-flacky 
Make the test "zk_multi_async" less flacky
 2020-04-08 02:15:43 +03:00
alexey-milovidov
7bef5a6edb
Update checkDataPart.cpp 2020-04-08 02:13:53 +03:00
alexey-milovidov
491f4b2c60
Merge pull request #10071 from ClickHouse/add_conversion_stream 
Add converting stream to localhost clickhouse dict
 2020-04-08 02:13:17 +03:00
Vitaly Baranov
d6fa8d1aad
Merge pull request #10101 from vitlibar/external-loader-remove-useless-logging 
Remove useless logging from ExternalLoader.
 2020-04-08 02:12:50 +03:00
alexey-milovidov
d20dfea6ed
Merge pull request #10095 from ClickHouse/fix_replica_start_from_old_version 
Fix replicated tables startup when updating from old version
 2020-04-08 02:11:12 +03:00
alexey-milovidov
115dd1b5fe
Merge pull request #9989 from ClickHouse/globs-in-paths-leading-zeros 
Fix behaviour of globs in filepath with leading zeros
 2020-04-08 00:49:27 +03:00
Alexey Milovidov
78b0bb6a3f Remove unwanted output from unit tests 2020-04-08 00:38:31 +03:00
Vitaly Baranov
e573549945 Rework access rights for table functions. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
42b8ed3ec6 Implement "ON CLUSTER" clause for access control SQL. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
b77e0a5b4e Avoid writing "HOST ANY" if the host is any by default. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
d0af31bbcf Use ALTER USER DROP HOST instead of ALTER USER REMOVE HOST for consistency. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
d064ddfe13 Disable MemoryAccessStorage. 2020-04-07 23:31:59 +03:00
Alexey Milovidov
ccec944ff4 Fix flacky test, take 3 2020-04-07 23:21:43 +03:00
Vitaly Baranov
423fa5087a Add SHOW_USERS(SHOW ROLES, etc.) privileges. 2020-04-07 23:20:38 +03:00
Vitaly Baranov
b4d7ef390c Rename some access types: add ALTER and SYSTEM prefixes. 2020-04-07 23:20:38 +03:00
Vitaly Baranov
f53b4ad3a8 Replace access types "TRUNCATE_VIEW" and "TRUNCATE_TABLE" with "TRUNCATE". 2020-04-07 23:20:38 +03:00
Vitaly Baranov
e5d8f05251 Rename sql command "CREATE POLICY" -> "CREATE ROW POLICY", "CREATE POLICY" is now an alias. 2020-04-07 23:20:38 +03:00
Vitaly Baranov
c2f5e3c4ad Improve declaration of access rights: single place in code instead of three. 2020-04-07 23:20:38 +03:00
Vitaly Baranov
d8b76232fe Remove useless logging from ExternalLoader. 2020-04-07 21:39:34 +03:00
Nikolai Kochetov
6b5b22cc5c Fix build. 2020-04-07 20:53:14 +03:00
Nikolai Kochetov
2704d81aae Fix pipeline expansion in PipelineExecutor. 2020-04-07 20:38:48 +03:00
alexey-milovidov
ead277b717
Update StorageReplicatedMergeTree.cpp 2020-04-07 20:23:26 +03:00
alexey-milovidov
2654f131cc
Update checkDataPart.cpp 2020-04-07 20:08:46 +03:00
alesapin
27777c1d2b Better comment 2020-04-07 18:55:23 +03:00
Alexander Tokmakov
4c48b7dd80 better rename 2020-04-07 18:31:33 +03:00
alesapin
82a87bc0d2 Fix replicated tables startup when updating from old version 2020-04-07 18:28:29 +03:00
Alexander Kuzmenkov
385e8839dc
Quote expected strings in parse error messages 2020-04-07 17:15:14 +03:00
Olga Khvostikova
834e458f26 Fix behaviour of globs in filepath with leading zeros 2020-04-07 16:46:12 +03:00
alesapin
0d7cff2b25 Merge branch 'master' into fix_check_table_with_index 2020-04-07 16:36:09 +03:00
alesapin
33c2587213 Merge branch 'master' into add_conversion_stream 2020-04-07 16:35:40 +03:00
alesapin
06f135ee8d Merge branch 'master' into small_fixes_in_dict_parser 2020-04-07 16:35:16 +03:00
Nikita Mikhaylov
626856deff Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-07 15:40:55 +03:00
alesapin
f1e0f15556
Merge pull request #9948 from ClickHouse/alter_rename_column 
Alter rename column
 2020-04-07 15:28:00 +03:00
Nikita Mikhaylov
3bf67b1380 typo 2020-04-07 15:02:07 +03:00
alesapin
9bc0ab2eed Merge branch 'master' into small_fixes_in_dict_parser 2020-04-07 14:59:08 +03:00
alesapin
d0bed6b204 Merge branch 'master' into fix_check_table_with_index 2020-04-07 14:58:45 +03:00
alesapin
5f3bcf198b Merge branch 'master' into add_conversion_stream 2020-04-07 14:57:58 +03:00
Alexander Kazakov
621d26bcf7 Better timeout diagnostics message 2020-04-07 14:34:35 +03:00
philip.han
53b5dade5e Implement transform_null_in 2020-04-07 20:08:13 +09:00
Nikita Mikhaylov
70c0646942 Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-07 13:42:48 +03:00
Artem Zuikov
8297683972
renames: AnalyzedJoin -> TableJoin, Join -> HashJoin (#10065) 2020-04-07 12:48:47 +03:00
Alexander Kazakov
78f97a7a59 Build fixes 2020-04-07 12:23:08 +03:00
Ivan
f6b31f344d
Add cross-compile build for FreeBSD (#9643) 
* Add toolchain to Docker image
 2020-04-07 11:33:49 +03:00
Vasily Nemkov
ef07c6d06f Merge remote-tracking branch 'upstream/master' into SIMD_tokenization 2020-04-07 11:25:52 +03:00
Alexander Kazakov
2e76e4d1ed Made clang happy - fixed build 2020-04-07 10:15:59 +03:00
Alexander Kuzmenkov
35783af25d Merge remote-tracking branch 'origin/master' into HEAD 2020-04-07 03:34:39 +03:00
Alexander Kazakov
081187dd1f Unit test for RWLock is set to use timeout for avoiding deadlocks 2020-04-07 03:06:48 +03:00
Alexander Kazakov
09ce548376 All locks in IStorage have timeouts now 2020-04-07 02:45:51 +03:00
Alexander Kazakov
b98bc9afef Reworked RWLockImpl::getLock() + phase-fairness 
Timeout param added to getLock() method
 2020-04-07 02:44:45 +03:00
Alexander Tokmakov
a2101c9b1c better code 2020-04-07 02:22:44 +03:00
Alexander Kazakov
2951ed4f1d Corrected Common.RWLockDeadlock test 2020-04-07 00:35:20 +03:00
Nikita Mikhaylov
2cec261f3a Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-06 23:15:11 +03:00
alesapin
107c5b7860
Merge pull request #10063 from ClickHouse/fix-GroupingAggregatedTransform-single-level 
Fix GroupingAggregatedTransform for single-level aggregation. Add test.
 2020-04-06 22:13:15 +03:00
alesapin
04e3e3179c Add converting stream to localhost clickhouse dict 2020-04-06 22:09:39 +03:00
Vasily Nemkov
738e8a7ef8 Minor test refactoring 
* using string literal for binary strings
* sorted includes
 2020-04-06 21:41:11 +03:00
Nikolai Kochetov
4fd5ef8bad Review fixes. 2020-04-06 21:05:45 +03:00
tavplubix
ea376b9739
Merge pull request #10054 from azat/detachDatabase-on-fail-at-start-deadlock 
Fix deadlock on failed database attach at start with materialized view
 2020-04-06 20:37:39 +03:00
Vasily Nemkov
3d471556fb Merge commit '73b0f8db8c327a1d63cc7ebcc56087a3f9866dae' into SIMD_tokenization 2020-04-06 20:05:02 +03:00
alesapin
c17fa34fa5 Fix bug with uncompressed checksums in CHECK TABLE query 2020-04-06 20:00:29 +03:00
alesapin
4be263c72f Clang-tidy fix 2020-04-06 17:43:36 +03:00
Artem Zuikov
174136a1e0
inflating cross join (#10029) 2020-04-06 16:39:57 +03:00
Anton Popov
2dc1eddfab fix FieldRef 2020-04-06 16:35:11 +03:00
Nikolai Kochetov
8986cf688b Added comment. 2020-04-06 16:28:46 +03:00
Alexander Tokmakov
08bae4668d Merge branch 'master' into database_atomic 2020-04-06 16:18:07 +03:00
alesapin
848678d656 Now layout type for dictionaries DDL with no arguments can be written without brackets 2020-04-06 14:02:17 +03:00
Anton Popov
5ada959853 improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
Anton Popov
79024d73a2 improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
Nikolai Kochetov
0117c194c5 Fix GroupingAggregatedTransform for single-level aggregation. Add test. 2020-04-06 13:33:59 +03:00
Pavel Kovalenko
8c1dda0105 Merge remote-tracking branch 'jokser/s3-uri-virtual-hosted-style-support' into s3-uri-virtual-hosted-style-support 2020-04-06 12:59:59 +03:00
Pavel Kovalenko
f9c98dd689 Merge remote-tracking branch 'origin/master' into s3-uri-virtual-hosted-style-support 2020-04-06 12:57:53 +03:00
alesapin
dd5ddf19d9 Rename missed files 2020-04-06 11:55:59 +03:00
alesapin
1cb072d58a Merge branch 'master' into alter_rename_column 2020-04-06 11:40:27 +03:00
Alexey Milovidov
110eb599c1 Fix "check style" tool 2020-04-06 02:57:24 +03:00
Azat Khuzhin
e7bbd400c7 Fix deadlock on failed database attach at start with materialized view 
This is not the problem for plain DROP DATABASE query since it first
remove tables.

  (gdb) bt
  0  __lll_lock_wait () at ../sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:103
  1  0x00007f353c262774 in __GI___pthread_mutex_lock (mutex=mutex@entry=0x11049288 <DB::DatabaseCatalog::init(DB::Context const*)::database_catalog+8>) at ../nptl/pthread_mutex_lock.c:80
  2  0x0000000004fd5d1e in DB::pthread_mutex_lock (arg=arg@entry=0x11049288 <DB::DatabaseCatalog::init(DB::Context const*)::database_catalog+8>) at ../src/Common/ThreadFuzzer.cpp:253
  3  0x000000000c70b3a9 in std::__1::__libcpp_mutex_lock (__m=__m@entry=0x11049288 <DB::DatabaseCatalog::init(DB::Context const*)::database_catalog+8>) at ../contrib/libcxx/include/__threading_support:322
  4  std::__1::mutex::lock (this=this@entry=0x11049288 <DB::DatabaseCatalog::init(DB::Context const*)::database_catalog+8>) at ../contrib/libcxx/src/mutex.cpp:33
  5  0x0000000008acd4e2 in std::__1::lock_guard<std::__1::mutex>::lock_guard (__m=..., this=<synthetic pointer>) at ../contrib/libcxx/include/__mutex_base:90
  6  DB::DatabaseCatalog::removeDependency (this=this@entry=0x11049280 <DB::DatabaseCatalog::init(DB::Context const*)::database_catalog>, from=..., where=...) at ../src/Interpreters/DatabaseCatalog.cpp:388
  7  0x000000000975044b in DB::StorageMaterializedView::shutdown (this=0x7f338d178a00) at ../src/Storages/StorageMaterializedView.cpp:362
  8  0x0000000008a79602 in DB::DatabaseWithOwnTablesBase::shutdown (this=0x7f353be3cc60) at ../contrib/libcxx/include/__tree:184
  9  0x0000000009546196 in DB::DatabaseWithDictionaries::shutdown (this=0x7f353be3cc60) at ../src/Databases/DatabaseWithDictionaries.cpp:265
  10 0x0000000008acecdb in DB::DatabaseCatalog::detachDatabase (this=0x11049280 <DB::DatabaseCatalog::init(DB::Context const*)::database_catalog>, database_name=..., drop=drop@entry=false, check_empty=check_empty@entry=false) at ../contrib/libcxx/include/memory:3826
  11 0x0000000004bf0aa5 in DB::InterpreterCreateQuery::createDatabase (this=0x7ffd6e1bab80, create=...) at ../src/Interpreters/InterpreterCreateQuery.cpp:162
  12 0x0000000008b04327 in DB::InterpreterCreateQuery::execute (this=this@entry=0x7ffd6e1bab80) at ../src/Interpreters/InterpreterCreateQuery.cpp:722
  13 0x0000000008d0fdaa in DB::executeCreateQuery (has_force_restore_data_flag=false, file_name=..., database=..., context=..., query=...) at ../src/Interpreters/loadMetadata.cpp:48
  14 DB::loadDatabase (context=..., database=..., database_path=..., force_restore_data=<optimized out>) at ../src/Interpreters/loadMetadata.cpp:72
  15 0x0000000008d103c3 in DB::loadMetadata (context=...) at ../src/Interpreters/loadMetadata.cpp:111
  16 0x0000000004f4d25e in DB::Server::main (this=<optimized out>) at ../contrib/libcxx/include/memory:2582
  17 0x000000000bbc8963 in Poco::Util::Application::run (this=this@entry=0x7ffd6e1bcc60) at ../contrib/poco/Util/src/Application.cpp:334
  18 0x0000000004ffe1de in DB::Server::run (this=0x7ffd6e1bcc60) at ../programs/server/Server.cpp:178
  19 0x0000000004ff36cc in mainEntryClickHouseServer (argc=3, argv=0x7f353be58bc0) at ../programs/server/Server.cpp:1060
  20 0x0000000004f49b99 in main (argc_=<optimized out>, argv_=<optimized out>) at ../contrib/libcxx/include/vector:655
 2020-04-05 14:16:16 +03:00
Vxider
21532f6a6d parallel insert for materialized view 2020-04-05 01:33:51 +08:00
Avogar
e635b0e9eb Fix build error 2020-04-04 20:04:41 +03:00
Nikolai Kochetov
e23fda80aa Merge with master 2020-04-04 19:02:17 +03:00
Avogar
092479397a Remove extra line. 2020-04-04 17:07:11 +03:00
Avogar
fbc11d3bf9 Move files 2020-04-04 17:04:20 +03:00
Avogar
7a96984dd8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into msgpack_format 2020-04-04 16:44:44 +03:00
Azat Khuzhin
1232760f78 Fix Distributed-over-Distributed when nested table has only one shard 2020-04-04 13:47:35 +03:00
Azat Khuzhin
8d372b0be7 Call getQueryProcessingStage() once, since it is heavy for StorageDistributed 
Refs: #9808
 2020-04-04 13:47:34 +03:00
Ivan Lezhankin
8a5a73e76d Merge branch 'master' into dbms2src 2020-04-03 18:20:05 +03:00
Ivan Lezhankin
06446b4f08 dbms/ → src/ 2020-04-03 18:14:31 +03:00