thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 21:51:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
48,654 Commits 9,131 Branches 1,778 Tags 2 GiB
e45edd57f2
Commit Graph

5625 Commits

Author SHA1 Message Date
Nikolai Kochetov
1b618fd130 Fix build 2020-09-14 23:56:56 +03:00
Nikolai Kochetov
9fcfa560ae Try simplify Visitor. 2020-09-14 23:35:45 +03:00
Nikolai Kochetov
45098f7112 Fix build. 2020-09-14 23:32:38 +03:00
Alexander Tokmakov
da6beb1a91 Merge branch 'master' into enable_some_tests_with_database_atomic 2020-09-14 23:00:14 +03:00
Nikolai Kochetov
d09422e60f Fix build. 2020-09-14 22:49:46 +03:00
alesapin
e96256d367 Trying to improve performance 2020-09-14 22:15:25 +03:00
Nikolai Kochetov
d418ee48a4
Merge pull request #14783 from amosbird/fix3 
Fix signedness conversion monotonicity
 2020-09-14 21:40:51 +03:00
Nikita Mikhaylov
ddea62211d
Merge pull request #11948 from CurtizJ/fsync-parts 
Experiment. Allow to turn on fsync on inserts, merges and fetches.
 2020-09-14 22:37:14 +04:00
Alexey Milovidov
3530f83c01 Remove debug output 2020-09-14 21:12:09 +03:00
Alexey Milovidov
f9361acb88 Disable in shared libraries mode 2020-09-14 21:00:45 +03:00
Alexey Milovidov
0e73b8acf3 Merge branch 'master' into remap-executable 2020-09-14 20:26:16 +03:00
Alexey Milovidov
038ae02126 Fix for #14761, part 2 2020-09-14 20:24:55 +03:00
Nikolai Kochetov
d4542a352c GatherUtils visibility. 2020-09-14 19:40:04 +03:00
Nikolai Kochetov
08d4e96529 GatherUtils visibility. 2020-09-14 19:37:35 +03:00
Ildus Kurbangaliev
67b49862d9
Add mapPopulateSeries function (#13166) 2020-09-14 19:11:50 +03:00
Nikolai Kochetov
c05021abc7 Inline GatherUtils algorithms. 2020-09-14 18:11:15 +03:00
Nikolai Kochetov
d2cd2775eb Inline GatherUtils algorithms. 2020-09-14 17:44:08 +03:00
Nikolai Kochetov
765c8604c9 Inline GatherUtils algorithms. 2020-09-14 17:35:57 +03:00
Nikolai Kochetov
bcfc83022a Return query plan from storage. 2020-09-14 17:13:58 +03:00
Alexey Milovidov
b5620018ca Fix for #14761 2020-09-14 17:02:24 +03:00
alexey-milovidov
752e3f8197
Merge pull request #14453 from amosbird/apply2 
column transformers in insert select
 2020-09-14 16:46:01 +03:00
alexey-milovidov
882206c0b6
Update InterpreterInsertQuery.cpp 2020-09-14 16:45:32 +03:00
Alexey Milovidov
3795dfed14 Remove one header 2020-09-14 16:34:44 +03:00
Alexey Milovidov
b966697939 Style 2020-09-14 16:31:30 +03:00
nikitamikhaylov
2bffefae1a typo 2020-09-14 16:30:44 +03:00
nikitamikhaylov
5697f6d926 style fix 2020-09-14 16:14:18 +03:00
Artem Zuikov
d274125c74
Fix wide integer left shift + refactoring (#14697) 2020-09-14 14:56:43 +03:00
Vxider
a913be9201 add table function null 2020-09-14 19:36:14 +08:00
Amos Bird
004b91511d
Fix wrong code 2020-09-14 18:16:22 +08:00
Amos Bird
5998570762
Fix signedness conversion monotonicity 2020-09-14 18:12:41 +08:00
Amos Bird
654245af3c
Fix signedness conversion monotonicity 2020-09-14 18:11:40 +08:00
alesapin
06575970aa
Merge pull request #14705 from amosbird/misc1 
Add merge_algorithm to system.merges
 2020-09-14 09:58:30 +03:00
alesapin
336430d3c2
Merge pull request #14646 from ClickHouse/if_bug 
Fix bug in if function when then clause contain const nullable column
 2020-09-14 09:51:40 +03:00
Nikolai Kochetov
109fd9d6d7
Merge pull request #13015 from amosbird/jgmko 
Refactor joinGet and implement multi-key lookup.
 2020-09-13 22:39:48 +03:00
Amos Bird
5cc8fd395c
Fix empty key segfault 2020-09-13 21:55:16 +08:00
Amos Bird
72786c8130
Take arithmetic overflow into consideration 2020-09-13 21:55:16 +08:00
Amos Bird
34b9547ce1
Binary operator monotonicity 2020-09-13 21:55:12 +08:00
Amos Bird
016f707ea1
column transformers in insert select 2020-09-13 10:21:13 +08:00
Amos Bird
c2d79bc5cc
Add merge_algorithm to system.merges 2020-09-13 10:00:03 +08:00
Amos Bird
882b2a3348
CTE 2020-09-13 09:39:17 +08:00
alexey-milovidov
c2f762e20a
Merge pull request #14748 from vitlibar/skip-access-storages-with-same-path 
Skip access storages with same path while reading the main config.
 2020-09-12 14:20:02 +03:00
alexey-milovidov
c87f50bc4b
Merge pull request #14761 from zhang2014/fix/osx_build 
Fix build failure in OSX
 2020-09-12 14:15:17 +03:00
alexey-milovidov
1c2ca4e773
Merge pull request #14734 from amosbird/bugfix1 
Fix missing clone in replace column transformer
 2020-09-12 09:54:00 +03:00
zhang2014
5b952a369b Fix build failure in OSX 2020-09-12 12:07:02 +08:00
alexey-milovidov
cc3d1a3922
Merge pull request #14471 from ClickHouse/git-to-clickhouse 
Added a script to import git repository to ClickHouse
 2020-09-12 03:56:31 +03:00
Azat Khuzhin
dd867b787f Allow parallel execution of distributed DDL 
Add distributed_ddl.pool_size to control maximum parallel to handle
distributed DDL.

Also:
- convert Exception constructors to fmt-like
- use sleepFor* over std::this_thread::sleep_for()
 2020-09-12 02:32:08 +03:00
Vitaly Baranov
70b0fe88b1
Merge pull request #14604 from vitlibar/no-detach-threads-2 
Use join() instead of detach() for threads #2
 2020-09-12 02:07:46 +03:00
Vitaly Baranov
5e3260678c
Merge pull request #14561 from vitlibar/no-detach-threads 
Use join() instead of detach() for threads
 2020-09-12 02:04:08 +03:00
Vitaly Baranov
e2c2a679ef Skip access storages with same path while reading the main config. 2020-09-12 01:34:46 +03:00
alesapin
2c4047b280 Revert accident changes 2020-09-11 20:07:00 +03:00
alesapin
6dd75182f0 Better 2020-09-11 20:04:55 +03:00
alesapin
a4c43e51b9 Add a test 2020-09-11 20:04:55 +03:00
alesapin
a5f8899874 First implementation 2020-09-11 20:04:55 +03:00
alesapin
489b9c80ac Starting steps 2020-09-11 20:04:55 +03:00
alesapin
d9394fbf66 Fix code 2020-09-11 18:51:08 +03:00
Artem Zuikov
6dd764bcfe
FunctionBinaryArithmetic refactoring (#14712) 2020-09-11 18:12:08 +03:00
Anton Popov
a64331d79f fix syncing of WAL 2020-09-11 16:09:26 +03:00
Nikita Mikhaylov
26742a3c81
Merge pull request #14703 from nikitamikhaylov/format-line-as-string 
Merging #13846 (Format LineAsString)
 2020-09-11 16:45:57 +04:00
Nikita Mikhaylov
468089a4cd
Merge pull request #14514 from bharatnc/ncb/event_time_microseconds_metric_logs 
add event_time_microseconds field to asynchronous_metric_log & metric_log system tables
 2020-09-11 16:14:00 +04:00
tavplubix
92eb58b555
Merge pull request #14696 from BohuTANG/mysql_replication_tablemapevent 
Fix mysql replication optional metadata ignore
 2020-09-11 15:09:55 +03:00
alesapin
5ce0c21bbe Remove redundant change 2020-09-11 14:24:42 +03:00
alesapin
ebb9de1376 Supress strange warning 2020-09-11 14:13:41 +03:00
alesapin
c36192db23 Remove diff 2020-09-11 13:54:03 +03:00
alesapin
e25b1da29f Disable -Wstringop-overflow for gcc-10 2020-09-11 13:53:26 +03:00
alesapin
c202ce8e63 Merge branch 'master' into update_to_gcc_10 2020-09-11 12:50:10 +03:00
tavplubix
1f47b1ff6b
Merge pull request #14704 from ClickHouse/fix_misleading_message_uuid_macro 
Fix misleading exception message about uuid macro
 2020-09-11 12:45:32 +03:00
alesapin
3b9ab3f1be Fix if 2020-09-11 12:23:31 +03:00
alexey-milovidov
e73ca17ad3
Merge pull request #14725 from BooBSD/formatReadableQuantity 
formatReadableQuantity() function
 2020-09-11 12:09:18 +03:00
alesapin
902624cb7b Merge branch 'master' into if_bug 2020-09-11 10:54:32 +03:00
Amos Bird
da2bb4e0d3
Fix missing clone in replace column transformer 2020-09-11 15:50:25 +08:00
BohuTANG
2873777857 Ignore unprocessed replication payload 2020-09-11 12:54:53 +08:00
BohuTANG
faa394b27c Merge remote-tracking branch 'origin/master' into mysql_replication_tablemapevent 2020-09-11 08:49:17 +08:00
Anton Popov
f2a5216e97 add waiting for fsync in WAL 2020-09-11 02:28:50 +03:00
Anton Popov
af4089c606 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-11 00:39:21 +03:00
alexey-milovidov
f21cf98960
Merge pull request #14657 from myrrc/feature/disable-debug-symbols-cmake-option 
Extracted the debug info generation for functions into a cmake option
 2020-09-10 21:04:15 +03:00
Alexey Milovidov
5675efbd47 Fix build 2020-09-10 20:16:12 +03:00
nikitamikhaylov
d0c259974d style check 2020-09-10 19:35:18 +03:00
Artem Hnilov
15bdb6048e Function formatReadableQuantity() added. 2020-09-10 16:25:07 +00:00
tavplubix
4581e3a18a
Merge pull request #14563 from bharatnc/ncb/zk-conn-fail-do-cleanup 
ReplicatedMergeTree - cleanup data directory after Zookeeper exceptions
 2020-09-10 19:19:57 +03:00
bharatnc
3b3b7bd5e7 minor changes to comment 2020-09-10 09:09:48 -07:00
tavplubix
a6c9dd0465
Merge pull request #14664 from ClickHouse/fix_missed_database_when_altering_mv 
Fix missed database name when altering MaterializedView
 2020-09-10 17:55:31 +03:00
Alexander Tokmakov
f19f02028b fix misleading exception message about uuid macro 2020-09-10 17:50:10 +03:00
Alexey Milovidov
65e9c678f8 Disable under certain conditions 2020-09-10 17:47:02 +03:00
Nikita Mikhaylov
a39ba57e8c
Merge branch 'master' into dev-nf 2020-09-10 18:10:47 +04:00
Nikita Mikhaylov
f0a65522cc
Merge pull request #14333 from hczhcz/patch-0901 
Add JSONStrings formats
 2020-09-10 17:54:42 +04:00
myrrc
e008198023 fix: default value 2020-09-10 15:44:49 +03:00
BohuTANG
00b8d91eb8 Fix mysql replication TableMapEvent optional metadata ignore 2020-09-10 19:46:59 +08:00
Nikolai Kochetov
7b50341dcc
Merge pull request #14683 from ClickHouse/fix-totals-for-accumulating 
Try fix totals port for IAccumulatingTransform.
 2020-09-10 14:46:49 +03:00
myrrc
598c81ed0a fix: default value 2020-09-10 14:07:08 +03:00
myrrc
c309f55c20 updated setting and added default value 2020-09-10 14:02:52 +03:00
Alexander Tokmakov
20b3823770 do not remove directory on attach 2020-09-10 13:21:13 +03:00
Alexander Kuzmenkov
223fc4d1e7 Avoid error while building the report on broken perf tests 2020-09-10 12:59:10 +03:00
zhang2014
5b3e9eaaf0 Merge branch 'master' into fix/datetime 2020-09-10 17:26:26 +08:00
Alexey Milovidov
532d121100 Fix typo 2020-09-10 12:14:31 +03:00
Alexey Milovidov
a644733139 Attempt to make performance test more reliable 2020-09-10 12:05:57 +03:00
Nikolai Kochetov
7fb45461d1 Try fix totals port for IAccumulatingTransform. 2020-09-10 10:36:29 +03:00
zhang2014
fea763bb75 ISSUES-4006 support decimal 256 for mysql block input stream 2020-09-10 11:37:00 +08:00
alexey-milovidov
e65e29d537
Merge pull request #14647 from fastio/master 
Add QueryMemoryLimitExceeded event
 2020-09-10 06:12:39 +03:00
alexey-milovidov
92b746116a
Merge pull request #14655 from ClickHouse/nested-multiline-comments 
Support for nested multiline comments
 2020-09-10 06:10:31 +03:00
hexiaoting
a173a863a8 fix style error 2020-09-10 11:03:35 +08:00
Anton Popov
b9bf67b6ac allow to randomize part type in MergeTree 2020-09-10 04:27:36 +03:00
bharatnc
05a80518a1 Merge remote-tracking branch 'upstream/master' into ncb/event_time_microseconds_metric_logs 2020-09-09 17:58:29 -07:00
Anton Popov
d1c35dc794 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-10 03:13:08 +03:00
Alexander Tokmakov
7080d56470 fix missed database name when altering mv 2020-09-09 22:59:34 +03:00
alesapin
b8a2c1d2a2 Push pragma only for new gcc 2020-09-09 22:45:37 +03:00
Vitaly Baranov
2a9ab48279 Use join() instead of detach() for the no_users_thread in StorageLiveView. 2020-09-09 22:39:27 +03:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup 2020-09-09 23:01:41 +04:00
alexey-milovidov
f60267a383
Merge pull request #14611 from amosbird/bf2 
Treat query as function argument.
 2020-09-09 21:20:33 +03:00
myrrc
11ffbda7cc added the debugger info option 2020-09-09 21:17:01 +03:00
alexey-milovidov
453914b6b8
Update ProfileEvents.cpp 2020-09-09 21:02:53 +03:00
Alexey Milovidov
7304bad56f Support for nested multiline comments 2020-09-09 20:51:05 +03:00
Ilya Yatsishin
594ce8ea66
Merge pull request #14636 from mcheshkov/use-global-addincl-for-icu 
Use global ICU ADDINCL for Arcadia build
 2020-09-09 20:50:52 +03:00
Alexander Tokmakov
dee1fefeb4 add more tests 2020-09-09 20:39:49 +03:00
Peng Jian
9fa04cf48b Add QueryMemoryLimitExceeded event 2020-09-10 00:59:38 +08:00
alesapin
62428845a0 Bug in mutation 2020-09-09 19:47:06 +03:00
bharatnc
fe6d6f16ea Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-09 09:25:34 -07:00
alexey-milovidov
38131917ef
Merge pull request #14530 from amosbird/ma 
Fix Nullable String to Enum conversion.
 2020-09-09 19:24:04 +03:00
alexey-milovidov
c6d0944994
Merge pull request #14591 from myrrc/bugfix/lc-nullability-checker 
Correct nullability checker for LowCardinality nested columns
 2020-09-09 19:23:19 +03:00
alexey-milovidov
a6a0d4966c
Merge pull request #14595 from azat/query-format-trailing-whitespace 
Fix some trailing whitespaces in query format (ExpressionList users)
 2020-09-09 19:22:55 +03:00
zhang2014
094897fe69 Merge branch 'master' into fix/datetime 2020-09-09 23:37:54 +08:00
Mikhail Cheshkov
673244876e Use global ICU ADDINCL for Arcadia build 2020-09-09 18:01:52 +03:00
alesapin
bd14c79b0b
Merge pull request #14494 from ClickHouse/recompression_in_background 
Recompression TTL
 2020-09-09 17:46:01 +03:00
alesapin
50dee3f449 Remove false-positive warning 2020-09-09 17:43:17 +03:00
nikitamikhaylov
751e410915 better[3] 2020-09-09 17:11:08 +03:00
Alexander Tokmakov
b68782d285 enable more tests with Atomic database 2020-09-09 16:32:50 +03:00
Artem Zuikov
48f29ae11f
Fix bug in Decimal scale (#14603) 2020-09-09 16:18:58 +03:00
myrrc
a8f5d9e70f added the test and comment 2020-09-09 15:52:44 +03:00
Nikita Mikhaylov
ead6bfe05c better[2] 2020-09-09 15:42:56 +03:00
Nikita Mikhaylov
f04d67b688 better 2020-09-09 15:41:51 +03:00
Nikita Mikhaylov
530057e79f update all columns 2020-09-09 15:27:05 +03:00
Vasily Nemkov
3973a17530
MySql datatypes dateTime64 and decimal (#11512) 2020-09-09 15:18:02 +03:00
Nikita Mikhaylov
c03a9487ca another test + fix 2020-09-09 14:55:20 +03:00
Artem Zuikov
36972d34a7
Fix logical error in GLOBAL JOIN with table function (#14545) 2020-09-09 13:03:13 +03:00
Winter Zhang
3d1d64ec60
Fix currentDatabase function cannot be used in ON CLUSTER ddl query. (#14211) 2020-09-09 12:58:59 +03:00
Anton Popov
32135d96f9
Merge pull request #12183 from CurtizJ/polymorphic-parts-2 
Support codecs in compact parts
 2020-09-09 12:34:13 +03:00
alesapin
485b104898 Use max ttl and add introspection to system parts about recompression 2020-09-09 12:15:42 +03:00
hcz
d8fce448a2 Implement null_as_default for JSONStrings formats 2020-09-09 15:47:32 +08:00
Amos Bird
b40998ca00
Treat query as function argument. 2020-09-09 15:41:38 +08:00
alesapin
a696cf12f6 Merge branch 'master' into recompression_in_background 2020-09-09 10:12:03 +03:00
alexey-milovidov
91edd2bba1
Merge branch 'master' into bugfix/lc-nullability-checker 2020-09-09 09:50:39 +03:00
bharatnc
f37814b367 Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-08 23:45:20 -07:00
alexey-milovidov
cf22527de0
Merge pull request #14590 from ClickHouse/remove-useless-lc-code 
Remove useless line.
 2020-09-09 09:39:07 +03:00
alexey-milovidov
0c2ecb53d1
Update arrayIndex.h 2020-09-09 09:35:05 +03:00
hexiaoting
406f384a45 support ILIKE, and separate like,limit function. 2020-09-09 11:24:47 +08:00
Vitaly Baranov
cce970e40c Use join() instead of detach() for loading threads in ExternalLoader. 2020-09-09 03:19:13 +03:00
Vitaly Baranov
bee629c971 Use join() instead of detach() for the lists_writing_thread in DiskAccessStorage. 2020-09-09 03:19:13 +03:00
Pavel Kovalenko
3632b0bdb3
Add option to DiskS3 that allows it's usage if S3 unavailable (#14497) 2020-09-09 02:35:57 +03:00
Azat Khuzhin
014c7c02bd Fix some trailing whitespaces in query format 
The following statements still has the trailing whitespace:
- WITH
- SELECT
- SELECT DISTINCT
- ARRAY JOIN
- GROUP BY
- ORDER BY
- LIMIT BY
 2020-09-09 01:36:21 +03:00
alexey-milovidov
f2e9a09b11
Merge pull request #14585 from ClickHouse/join-processor 
Remove Join from ExpressionActions
 2020-09-08 23:56:09 +03:00
alexey-milovidov
1e300d9119
Merge pull request #14562 from CurtizJ/fix-fuzz 
Fix segfault in combinator -Resample
 2020-09-08 23:53:14 +03:00
alexey-milovidov
292b0a02f2
Merge pull request #14586 from Avogar/Custom-null-representation-in-TCV 
Custom null representation in tsv
 2020-09-08 23:42:44 +03:00
Nikita Mikhaylov
614e01b0e4 better 2020-09-08 23:12:55 +03:00
myrrc
78eac658b0 adding correct LC nested nullability checker 2020-09-08 22:51:44 +03:00
Nikolai Kochetov
fe0507663b Remove useless line. 2020-09-08 22:40:22 +03:00
alexey-milovidov
a5499ab9d6
Merge pull request #14555 from 4ertus2/some 
Hide symbols in nameless namespace
 2020-09-08 19:55:56 +03:00
Anton Popov
a419267dc6 minor fixes 2020-09-08 19:28:49 +03:00
nikitamikhaylov
c4f0465a7c limit 2020-09-08 18:54:30 +03:00
robot-clickhouse
8def718661 Auto version update to [20.10.1.1] [54440] 2020-09-08 17:04:41 +03:00
Alexey Milovidov
a687bdb370 Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 15:51:00 +03:00
Kruglov Pavel
902ac5c33f
Change setting description 2020-09-08 15:49:57 +03:00
Alexey Milovidov
b460c67a4f Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 15:47:10 +03:00
Kruglov Pavel
401b0e5ebb
Fix mistake 2 2020-09-08 15:47:02 +03:00
Alexey Milovidov
843b51bbb5 Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 15:45:38 +03:00
alesapin
f0f7f2b5d2 Merge branch 'master' into recompression_in_background 2020-09-08 15:43:37 +03:00
alesapin
6ad91d1018
Merge pull request #14490 from ClickHouse/control_ttl_merges_in_pool 
Control ttl merges in pool
 2020-09-08 15:42:20 +03:00
Kruglov Pavel
70be9b152c
Add custom null representation in tsv 2020-09-08 15:39:24 +03:00
Kruglov Pavel
0e8946eb9f
Fix mistake 2020-09-08 15:38:11 +03:00
Kruglov Pavel
cce3f3fe4e
Change setting name 2020-09-08 15:37:18 +03:00
Kruglov Pavel
563f1486e6
Add output_tsv_null_representation 2020-09-08 15:36:11 +03:00
Kruglov Pavel
ac5d6caef5
Add tsv_null_representation 2020-09-08 15:32:31 +03:00
Nikolai Kochetov
dbd7ef9ee6 Fix build. 2020-09-08 15:31:36 +03:00
Kruglov Pavel
0e9612d9ff
Add null_representation setting in TSV 2020-09-08 15:29:22 +03:00
alesapin
bea15175d6
Merge pull request #14496 from Jokser/disk-s3-shutdown 
Disable S3 requests processing during context shutdown to speed up termination process
 2020-09-08 15:21:54 +03:00
Pavel Kovalenko
5e39f8b32b Add comment explaining DiskS3::shutdown 2020-09-08 15:20:35 +03:00
Ilya Yatsishin
a3d6732662
Merge pull request #14558 from bharatnc/ncb/improve-config-path-processing 
use std::filesystem::path in ConfigProcessor for filepath concatenation
 2020-09-08 14:39:23 +03:00
Nikolai Kochetov
b0cb5511a9 Fix build. 2020-09-08 14:17:39 +03:00
Nikita Mikhaylov
80f193f615
Merge pull request #14252 from bharatnc/ncb/time-query-log-in-ms 
add query_start_time_microseconds field to system.query_log & system.query_thread_log tables
 2020-09-08 15:11:50 +04:00
Nikolai Kochetov
4aeed33d4c Fix build. 2020-09-08 14:07:26 +03:00
Nikolai Kochetov
07e835381c Fix build. 2020-09-08 14:06:36 +03:00
Artem Zuikov
69e82e647e another fix for clang tidy 2020-09-08 14:01:17 +03:00
Nikolai Kochetov
39aad9979a Remove Join from ExpressionActions. 2020-09-08 13:40:53 +03:00
Artem Zuikov
d95614ad60 fix for clang tidy 2020-09-08 12:16:50 +03:00
Ilya Yatsishin
11a247d2f4
Merge pull request #14556 from ClickHouse/fix-arcadia-2 
Lower binary size in "Arcadia" build
 2020-09-08 12:08:35 +03:00
Nikolai Kochetov
c3eeb8f71e
Merge pull request #14412 from ClickHouse/pipes-and-creating-sets 
Pipes and creating sets
 2020-09-08 10:47:56 +03:00
Nikolai Kochetov
d771ce5609
Merge pull request #14500 from ClickHouse/many-rows-in-totals 
Many rows in totals
 2020-09-08 10:40:14 +03:00
alesapin
4364bff3bc
Merge pull request #12761 from kssenii/rabbitmq-improvements 
RabbitMQ improvements
 2020-09-08 09:38:25 +03:00
alesapin
8ff0aedebe Merge branch 'control_ttl_merges_in_pool' into recompression_in_background 2020-09-08 09:34:03 +03:00
alesapin
405a204514 Lower timeout for TTL merges 2020-09-08 09:33:00 +03:00
alesapin
f4846e2ef1
Update src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp 
Co-authored-by: Anton Popov <pad11rus@gmail.com>
 2020-09-08 09:30:54 +03:00
Winter Zhang
18b4c5997d
Merge branch 'master' into fix/datetime 2020-09-08 11:32:48 +08:00
bharatnc
0c00b992d5 StorageReplicatedMergeTree - cleanup data dir after Zk exceptions 
It's possible for `getZooKeeper()` to timeout if  zookeeper host(s) can't
be reached. In such cases `Poco::Exception` is thrown after a connection
timeout - refer to `src/Common/ZooKeeper/ZooKeeperImpl.cpp:866` for more info.

Side effect of this is that the CreateQuery gets interrupted and it exits.
But the data Directories for the tables being created aren't cleaned up.
This unclean state will hinder table creation on any retries and will
complain that the Directory for table already exists.

To achieve a clean state on failed table creations, catch this error if
the exception is of type Poco::Exception and call `dropIfEmpty()` method,
then proceed throwing the exception. Without this, the Directory for the
tables need to be manually deleted before retrying the CreateQuery.
 2020-09-07 18:09:09 -07:00
Artem Zuikov
7373aaf465 add IsOperation helper 2020-09-08 03:59:13 +03:00
Anton Popov
ee218c354e fix segfault in combinator -Resample 2020-09-08 02:21:12 +03:00
alexey-milovidov
1076a42cf5
Merge pull request #14549 from ClickHouse/lower-binary-size-in-debug 
Lower binary size in debug build
 2020-09-08 01:20:44 +03:00
Alexey Milovidov
e3924b8057 Fix "Arcadia" 2020-09-08 01:14:13 +03:00
bharatnc
7b89adb10d use std::filesystem::path in ConfigProcessor 
This PR improves the way the ClickHouse config path,
preprocessed_configs path etc are being joined inside
`ConfigProcessor.cpp`.

Uses `std::filesystem::path` to join the paths instead of
standard string concatenation. This would improve path concatenation.
Current method of concatenation results in:

```bash
➜  clickhouse-server ls -latr
total 68
-rw-r--r--   1 root root  5587 Aug 31 05:00 users.xml
drwxr-xr-x 143 root root 12288 Sep  7 11:23 ..
lrwxrwxrwx   1 root root    41 Sep  7 11:23 preprocessed -> /var/lib/clickhouse//preprocessed_configs
drwxr-xr-x   2 root root  4096 Sep  7 11:23 users.d
-rw-r--r--   1 root root 34252 Sep  7 11:28 config.xml
drwxr-xr-x   4 root root  4096 Sep  7 11:28 .
drwxr-xr-x   2 root root  4096 Sep  7 11:28 config.d
```

The symlink `/var/lib/clickhouse//preprocessed_configs` will still work.
amd this PR is an improvement to the current method of path
concatenation.
 2020-09-07 12:45:52 -07:00
alexey-milovidov
4bd5524da9
Merge pull request #14522 from ClickHouse/formats-dont-skip-bom-in-constructor 
More consistent invocation of skipBOMIfExists
 2020-09-07 21:38:03 +03:00
zhang2014
564dfac737 ISSUES-4006 fix decimal type decimal number part 2020-09-08 02:36:07 +08:00
Artem Zuikov
b3eafc1106 hide symbols in nameless namespace 2020-09-07 21:00:37 +03:00
Nikita Mikhaylov
a56d42de67 fix arcadia 2020-09-07 20:55:06 +03:00
Nikolai Kochetov
73de00f4df Review fix. 2020-09-07 20:49:23 +03:00
zhang2014
46c84b054e ISSUES-4006 fix negative decimal number 2020-09-08 01:28:20 +08:00
Nikita Mikhaylov
5d9367aea4
Merge pull request #14411 from nikitamikhaylov/rank-corr 
Merging #11769 (Rank Correlation Spearman)
 2020-09-07 21:18:19 +04:00
alexey-milovidov
e1104135c8
Merge pull request #13939 from fastio/master 
Multithreading implementation of Kafka engine
 2020-09-07 20:12:06 +03:00
Nikita Mikhaylov
2c04b0a8e6 comment added 2020-09-07 19:07:34 +03:00
Alexey Milovidov
53e39b05b2 Lower binary size in debug build 2020-09-07 18:35:18 +03:00
kssenii
40c8290dde Tiny fixes, better tests 2020-09-07 14:48:50 +00:00
Nikita Mikhaylov
8793281e3e remove cout 2020-09-07 17:02:59 +03:00
Nikita Mikhaylov
c09d86e5e4 another fixes 2020-09-07 16:15:04 +03:00
tavplubix
1f1b570832
Merge pull request #14523 from BohuTANG/mysql_replication_1 
Remove dryrun event to update position
 2020-09-07 15:49:33 +03:00
alesapin
17650e803f Tiny improvements 2020-09-07 14:08:53 +03:00
Nikolai Kochetov
382ebc700e Added comment. 2020-09-07 12:47:59 +03:00
zhang2014
b7e9d5e72d ISSUES-4006 support decimal for MaterializedMySQL engine 2020-09-07 17:43:25 +08:00
alesapin
f6237dc334 Better name 2020-09-07 12:32:45 +03:00
alesapin
4ce975c512 Merge branch 'master' into kssenii-rabbitmq-improvements 2020-09-07 11:36:08 +03:00
alesapin
f274ffc9d1 Add comments 2020-09-07 10:59:14 +03:00
Amos Bird
4c3c1cdaf3
Fix Nullable String to Enum conversion. 2020-09-07 15:32:44 +08:00
alesapin
ba70de63f8 Fix diff 2020-09-07 10:28:04 +03:00
alexey-milovidov
3903794386
Update ExecutableDictionarySource.cpp 2020-09-07 09:45:01 +03:00
alexey-milovidov
1f0d2be17a
Update ExecutableDictionarySource.h 2020-09-07 09:44:32 +03:00
Alexey Milovidov
8dd98f74a5 Remove debug output 2020-09-07 09:43:28 +03:00
Alexey Milovidov
04a6965006 Fix error with executable dictionary source 2020-09-07 09:40:01 +03:00
alesapin
7f301eab63 Merge branch 'master' into recompression_in_background 2020-09-07 09:31:16 +03:00
BohuTANG
576c6e9757 Remove dryrun event to update position 2020-09-07 13:18:28 +08:00
Alexey Milovidov
4a336e3814 More consistent invocation of skipBOMIfExists 2020-09-07 07:21:55 +03:00
alexey-milovidov
8b0a6d5609
Merge pull request #14404 from dimarub2000/system_events_show_zero_values 
system_events_show_zero_values setting added
 2020-09-07 06:40:36 +03:00
Alexey Milovidov
1400bdbf83 Fix unit tests 2020-09-07 06:11:35 +03:00
hexiaoting
dc0e276bba Add new feature: SHOW DATABASES LIKE 2020-09-07 11:06:21 +08:00
hexiaoting
a3671a15f6 Add new feature: SHOW DATABASES LIKE 2020-09-07 10:54:59 +08:00
Alexey Milovidov
83d2eafd12 Merge branch 'master' of github.com:yandex/ClickHouse into git-to-clickhouse 2020-09-07 03:19:44 +03:00
bharatnc
fd22450a2a Merge remote-tracking branch 'upstream/master' into ncb/time-query-log-in-ms 2020-09-06 13:19:27 -07:00
bharatnc
1c1f50c6b6 MetricLog - add event_time_microseconds column 2020-09-06 08:31:27 -07:00
bharatnc
25ca5e91bd AsynchronousMetricLog - add event_time_microseconds column 2020-09-06 08:31:27 -07:00
Dmitry
9639846ca9 Merge branch 'master' into system_events_show_zero_values 2020-09-06 14:55:14 +03:00
alexey-milovidov
a78b04b56a
Merge pull request #14455 from ClickHouse/prepare-clang-11 
Prepare for clang 11
 2020-09-06 11:02:58 +03:00
Peng Jian
ac25c41f22 Update docs for Kafka engine 2020-09-06 11:17:19 +08:00
Peng Jian
fd82272cfe Fix code style, and update docs for Kafka engine 2020-09-06 11:17:19 +08:00
Peng Jian
e6bfd9d586 1. Add new setting for Kafka engine, named kafka_thread_per_consumer which default value is false. 2. Create separate thread pool for Kafka engine. 2020-09-06 11:17:19 +08:00
Peng Jian
de0a40aedc fix code style 2020-09-06 11:17:19 +08:00
Peng Jian
61ac52cf29 Multithreading implementation of Kafka engine 2020-09-06 11:17:18 +08:00
alexey-milovidov
d61dda36ef
Update Sources.h 2020-09-06 01:09:59 +03:00
Anton Popov
3b9be70c8c Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-05 18:53:55 +03:00
Anton Popov
30a867e387 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-05 17:00:14 +03:00
bharatnc
425c4d0634 fix style check - declare error code ILLEGAL_TYPE_OF_ARGUMENT 2020-09-04 21:26:51 -07:00
bharatnc
25080f3a88 additional checks for empty tz for toStartOfMonth|Quarter|Year 2020-09-04 20:15:37 -07:00
bharatnc
8fd00ff77b rename test files and fix tests - add ; at the end 2020-09-04 18:42:43 -07:00
bharatnc
cf110f4eb0 toStartOfInterval* functions - disallow empty timezone 2020-09-04 17:32:38 -07:00
Nikolai Kochetov
29918c9411 Update IAccumulatingTransform. 2020-09-04 23:44:15 +03:00
Nikolai Kochetov
499405504f Merge branch 'master' into pipes-and-creating-sets 2020-09-04 23:41:20 +03:00
Nikolai Kochetov
01d0f6e5c5
Merge pull request #14402 from ClickHouse/stop-threads-if-exception-in-pipeline-executor 
Stop query execution if exception happened in PipelineExecutor itself.
 2020-09-04 23:40:22 +03:00
Pavel Kovalenko
9d11d4dd44 Variable inline. 2020-09-04 21:45:22 +03:00
Nikita Mikhaylov
4fadb6c3ec fast test 2020-09-04 21:05:06 +03:00
Nikolai Kochetov
d7be761484 Try fix test. 2020-09-04 20:14:36 +03:00
bharatnc
05fcc68862 update QueryThreadLog.cpp 2020-09-04 10:12:17 -07:00
Nikita Mikhaylov
f67a7b3a3d better 2020-09-04 19:53:50 +03:00
Anton Popov
c73bb98002 fix clang-tidy 2020-09-04 19:50:40 +03:00
bharatnc
1c1826361f more formatting changes in QueryLog.cpp 2020-09-04 09:47:02 -07:00
bharatnc
f2848d5820 fix formatting in files 2020-09-04 09:42:18 -07:00
bharatnc
44e168bea7 query_start_time_microseconds field in system.query_log 
Add a new field called `query_start_time_microseconds`  that will add
`microseconds`. This new field will be of type `DateTime64`.
 2020-09-04 09:42:18 -07:00
Anton Popov
f1cf03f1bb Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-04 17:40:22 +03:00
Nikita Mikhaylov
d718c5af99 fixed 2020-09-04 17:36:08 +03:00
alesapin
37a2bd0bfd less debug 2020-09-04 17:23:32 +03:00
alesapin
de911aaabe Merge branch 'master' into recompression_in_background 2020-09-04 17:21:27 +03:00
alesapin
2d1042614e Less comments 2020-09-04 17:19:41 +03:00
alesapin
79ef72178e Less garbage 2020-09-04 17:18:49 +03:00
Pavel Kovalenko
c933f72adb Disable S3 requests processing during context shutdown to speed up termination process. 2020-09-04 17:17:27 +03:00
alesapin
f48d654d35 Less garbage 2020-09-04 17:15:34 +03:00
alesapin
fecb2f1311 Less copypaste 2020-09-04 17:08:43 +03:00
alesapin
ea7168580b Fixes 2020-09-04 16:55:07 +03:00
Artem Zuikov
7c20aa2c62
Another 256-bit integers (strict 32 bytes) (#14229) 2020-09-04 16:33:02 +03:00
Nikolai Kochetov
7f88e3de1f Review fix. 2020-09-04 15:54:31 +03:00
Anton Popov
68913eab62 better reading from compact parts with differents codecs 2020-09-04 15:48:55 +03:00
Nikolai Kochetov
41a3fad1ea Allow many rows in totals. 2020-09-04 15:34:36 +03:00
alesapin
f8aa6cfe8a
Merge pull request #14438 from ClickHouse/apply_ttl_if_not_calculated 
Apply TTL if it's not calculated for part
 2020-09-04 15:32:50 +03:00
alesapin
f9dd4cc98d Merge branch 'control_ttl_merges_in_pool' into recompression_in_background 2020-09-04 14:32:25 +03:00
alesapin
e42d0f60da Fix several bugs 2020-09-04 14:27:27 +03:00
Nikolai Kochetov
40768593c3
Merge pull request #14469 from BohuTANG/mysql_set_@@var 
Support MySQL handler 'set @@xx' settting
 2020-09-04 14:18:57 +03:00
alesapin
4079636f81 Merge 2020-09-04 13:52:51 +03:00
alesapin
6f5ba4d8e5 Fix ya.make 2020-09-04 13:31:29 +03:00
alesapin
69b31ab90d More comments 2020-09-04 13:29:55 +03:00
Nikolai Kochetov
0bf0fb0e55
Merge pull request #14468 from BohuTANG/mysql_replication_gtid_format 
Fix mysql replication GTID event dump format
 2020-09-04 13:19:05 +03:00
alesapin
82c56349a5 Some comments 2020-09-04 13:08:09 +03:00
Nikolai Kochetov
c761970bc5 Merge branch 'master' into pipes-and-creating-sets 2020-09-04 11:38:35 +03:00
Nikolai Kochetov
b7e53208d1 Fix tests. 2020-09-04 11:36:47 +03:00
alesapin
c96a2b4f22
Merge pull request #14444 from ClickHouse/fix_select_parts_for_merge 
Fix select parts for merge
 2020-09-04 09:55:48 +03:00
alesapin
61ecaebcb1 Simplify settings for TTL merges 2020-09-04 09:55:19 +03:00
alexey-milovidov
54ede2e1bb
Merge pull request #14467 from ClickHouse/topk-check-overflow 
Check for array size overflow in topK
 2020-09-04 09:15:33 +03:00
alexey-milovidov
d623048dd1
Merge pull request #14454 from amosbird/im1 
Remove redundant conditions
 2020-09-04 09:14:35 +03:00
Alexey Milovidov
d3fa22280a Merge branch 'prepare-clang-11' into git-to-clickhouse 2020-09-04 09:12:27 +03:00
Alexey Milovidov
23b9677879 Added a script to import git repository to ClickHouse 2020-09-04 08:46:58 +03:00
BohuTANG
c094ff7eca ISSUES-9336 support MySQL handler 'set @@xx' settting 2020-09-04 12:51:15 +08:00
BohuTANG
4b0264c2a8 Fix mysql replication GTID event dump format 2020-09-04 12:00:37 +08:00
Alexey Milovidov
1cee6d5a31 Check for array size overflow in topK #14452 2020-09-04 04:05:57 +03:00
alexey-milovidov
12a21cb1a4
Merge pull request #14440 from matwey/fix/missed-atomic 
Add missed #include <atomic>
 2020-09-04 03:47:15 +03:00
Alexey Milovidov
4b3220f79a Prepare for clang 11 2020-09-04 03:39:56 +03:00
alexey-milovidov
4f9df21d3e
Merge pull request #10373 from azat/dist-SELECT-optimization 
Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key
 2020-09-04 01:38:56 +03:00
Anton Popov
6883ee7eea create less compressed streams while writing compact parts 2020-09-04 01:38:17 +03:00
Anton Popov
d5da58918e create less compressed streams while writing compact parts 2020-09-04 01:04:46 +03:00
Alexey Milovidov
796e3ae87d Prepare for clang 11 2020-09-03 22:40:21 +03:00
Amos Bird
3817c0efa7
Remove redundant conditions 2020-09-04 02:13:57 +08:00
Anton Popov
98011f6fc3 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-03 17:53:05 +03:00
alesapin
0dab4d9485 Merge branch 'fix_select_parts_for_merge' into control_ttl_merges_in_pool 2020-09-03 17:41:23 +03:00
alesapin
bd24c3a059 Fix build useless binary 2020-09-03 17:38:56 +03:00
Kseniia Sumarokova
4b7c303eaf
Merge branch 'master' into rabbitmq-improvements 2020-09-03 17:26:04 +03:00
Vitaly Baranov
dda884d6d0
Update AccessControlManager.h 
Add "override" for the destructor of AccessControlManager
 2020-09-03 17:20:14 +03:00
alesapin
15a02321bf Merge branch 'fix_select_parts_for_merge' into control_ttl_merges_in_pool 2020-09-03 17:16:29 +03:00
alesapin
55adb6f9f2
Update src/Storages/MergeTree/MergeSelector.h 
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2020-09-03 16:55:34 +03:00
alexey-milovidov
6a32d30578
Merge pull request #14431 from ClickHouse/fix-lazy-database 
Fix for Lazy database
 2020-09-03 16:38:59 +03:00
alesapin
e48e4309b2 Better names 2020-09-03 16:29:18 +03:00
alesapin
565555e55c Fix bug in parts selection 2020-09-03 16:04:28 +03:00
alesapin
13248a744b Fix bug in parts selection 2020-09-03 16:02:24 +03:00
alesapin
f4c7ff0376 Add fixed size of Merge TTLS 2020-09-03 16:00:13 +03:00
alesapin
aa47d0aabc Merge branch 'apply_ttl_if_not_calculated' into recompression_in_background 2020-09-03 12:07:03 +03:00
alesapin
acc0ee0657 Apply TTL if it's not calculated for part 2020-09-03 11:59:41 +03:00
Ilya Yatsishin
2b8ad576cc
Merge pull request #14323 from qoega/try-dns-fix 
Add tag pass for integration base image. Add explicit dns options for docker-compose.
 2020-09-03 11:27:24 +03:00
kssenii
e1ef558a2d Fixes 2020-09-03 06:50:20 +00:00
zhang2014
802a5a31a0 ISSUES-4006 fix code style 2020-09-03 11:11:18 +08:00
zhang2014
9c091fb2c1 ISSUES-4006 remove unsupport data type 2020-09-03 11:08:38 +08:00
zhang2014
dd0feeeaa1 ISSUES-4006 support datetime with precision 2020-09-03 11:03:28 +08:00
alexey-milovidov
edea940e17
Update StorageDistributed.cpp 2020-09-03 04:39:36 +03:00
Alexey Milovidov
96038e9d54 Fix for Lazy database 2020-09-03 04:06:12 +03:00
alexey-milovidov
1c2435d4f7
Merge pull request #14233 from amosbird/apply 
Introduce columns transformers.
 2020-09-03 01:37:40 +03:00
alexey-milovidov
72417d2716
Merge pull request #14368 from BohuTANG/materialize_mysql_query_filter_1 
change string.rfind to string starts_with and add some tests
 2020-09-03 01:09:53 +03:00
alexey-milovidov
4b1b744644
Revert "Less number of threads in builder" 2020-09-03 01:00:41 +03:00
Azat Khuzhin
fffeeeba06 Force WithMergeableStateAfterAggregation via distributed_group_by_no_merge (convert to UInt64) 
Possible values:
- 1 - Do not merge aggregation states from different servers for distributed query processing - in case it is for certain that there are different keys on different shards.
- 2 - same as 1 but also apply ORDER BY and LIMIT stages
 2020-09-03 00:52:51 +03:00
Azat Khuzhin
10b4f3b41f Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key 
Previous set of QueryProcessingStage does not allow to do this.
But after WithMergeableStateAfterAggregation had been introduced the
following queries can be optimized too under
optimize_distributed_group_by_sharding_key:
- GROUP BY sharding_key LIMIT
- GROUP BY sharding_key LIMIT BY
- GROUP BY sharding_key ORDER BY

And right now it is still not supports:
- WITH TOTALS (looks like it can be supported)
- WITH ROLLUP (looks like it can be supported)
- WITH CUBE
- SETTINGS extremes=1 (looks like it can be supported)
But will be implemented separatelly.

vX: fixes
v2: fix WITH *
v3: fix extremes
v4: fix LIMIT OFFSET (and make a little bit cleaner)
v5: fix HAVING
v6: fix ORDER BY
v7: rebase against 20.7
v8: move out WithMergeableStateAfterAggregation
v9: add optimize_distributed_group_by_sharding_key into test names
 2020-09-03 00:52:51 +03:00
Azat Khuzhin
4043be3121 Add new query processing stage WithMergeableStateAfterAggregation 
Process query until the stage where the aggregate functions were
calculated and finalized.

It will be used for optimize_distributed_group_by_sharding_key.

v2: fix aliases
v3: Fix protocol ABI breakage due to WithMergeableStateAfterAggregation
    Conditions >= for QueryProcessingStage::Enum has been verified, and they
    are ok (in InterpreterSelectQuery).
 2020-09-03 00:51:08 +03:00
alexey-milovidov
7bd31fb3d3
Merge pull request #14313 from ClickHouse/fix-fuzz-test6 
Better check for tuple size in SSD cache complex key external dictionaries
 2020-09-03 00:50:24 +03:00
Matwey V. Kornilov
9b4da1e82f Add missed #include <atomic> 
std::atomic<Data*> at line 199 requires including <atomic>
 2020-09-02 23:40:27 +03:00
Alexander Kuzmenkov
3a7181cfcb
Merge pull request #14397 from zhang2014/fix/ISSUES-14114 
ISSUES-14114 Implicitly convert primary key to not null in MaterializeMySQL
 2020-09-02 23:12:33 +03:00
alesapin
dcbddbb8d0 Add recompression ttls tests and fix bugs 2020-09-02 19:15:41 +03:00
Ilya Yatsishin
a5e9449bc3
Merge branch 'master' into try-dns-fix 2020-09-02 19:01:30 +03:00
alexey-milovidov
8e2fba5be1
Merge pull request #12567 from amosbird/fmi 
table function view
 2020-09-02 17:07:57 +03:00
Alexey Milovidov
95493352fe Remove wrong checks 2020-09-02 17:07:25 +03:00
Nikita Mikhaylov
cdb1f30630 style + fast test 2020-09-02 16:49:47 +03:00
Nikolai Kochetov
92c937db8b Remove CreatingSetsBlockInputStream 2020-09-02 16:13:13 +03:00
Nikolai Kochetov
acfd35a908 Update QueryPipeline::addCreatingSetsTransform 2020-09-02 16:04:54 +03:00
Ilya Yatsishin
136e7aa33d
Merge pull request #14362 from ClickHouse/less-number-of-threads-in-builder 
Less number of threads in builder
 2020-09-02 16:01:00 +03:00
Nikita Mikhaylov
7021f6edc1 better 
(cherry picked from commit 81481f26b5)
 2020-09-02 15:47:23 +03:00
Nikita Mikhaylov
e9a1f4a383 update ya.make 
(cherry picked from commit e62043e83b)
(cherry picked from commit a850388e62)
 2020-09-02 15:47:17 +03:00
Nikita Mikhaylov
eee19dada4 fixes + test 
(cherry picked from commit 5daee1cae1)
(cherry picked from commit c3dfb8e838)
 2020-09-02 15:47:09 +03:00
antikvist
a695344434 rank corr 
(cherry picked from commit 649e4dd913)
(cherry picked from commit ae17810201)
 2020-09-02 15:46:42 +03:00
antikvist
efc59d6686 rank corr 
(cherry picked from commit 11c94bee69)
(cherry picked from commit 483409f2e1)
 2020-09-02 15:46:29 +03:00
antikvist
e32887d300 rank corr 
(cherry picked from commit 2815397a19)
(cherry picked from commit d244797def)
 2020-09-02 15:45:59 +03:00
antikvist
950094c233 rank correlation 
(cherry picked from commit f9dda1e13e)
(cherry picked from commit 2a7026cb0c)
 2020-09-02 15:45:51 +03:00
antikvist
098561def3 welch t-test 
(cherry picked from commit 5cd118dcee)
(cherry picked from commit 8f19270f8d)
 2020-09-02 15:45:37 +03:00
antikvist
df668d6297 Rank Correlation 
(cherry picked from commit 3009c3885b)
(cherry picked from commit 024ff439e7)
 2020-09-02 15:45:31 +03:00
alexey-milovidov
09850dbdbc
Update ASTColumnsTransformers.cpp 2020-09-02 15:39:34 +03:00
alexey-milovidov
c009ace7a2
Update StorageSystemEvents.cpp 2020-09-02 15:28:29 +03:00
alesapin
128cb7ce22 Don't select already selected parts 2020-09-02 15:16:12 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output 
Suppress superfluous wget (-nv) output
 2020-09-02 14:59:28 +03:00
Dmitry
13ba8cd5a7 fixed spaces 2020-09-02 14:25:11 +03:00
alesapin
06b38a4d44 Remove cerr 2020-09-02 13:31:31 +03:00
alesapin
aac466ab1c Merge branch 'better_ttl_merges_selection' into recompression_in_background 2020-09-02 13:30:04 +03:00
Dmitry
6f18cd772c fixes 2020-09-02 13:07:23 +03:00
Dmitry
2180cdc400 system_events_show_zero_values setting added 2020-09-02 13:00:49 +03:00
Nikolai Kochetov
811e44a937
Merge pull request #14315 from azat/EXPLAIN-SIGSEGV-fix 
[RFC] Fix QueryPlan lifetime (for EXPLAIN PIPELINE graph=1) for queries with nested interpreter
 2020-09-02 12:46:59 +03:00
Nikolai Kochetov
13e0464138 Stop query execution if exception happened in PipelineExecutor itself. 2020-09-02 12:39:49 +03:00
alesapin
fbb37c37df Simplier interface 2020-09-02 11:28:46 +03:00
alesapin
b08056fa8c Better selection of Merges with TTL 2020-09-02 11:18:50 +03:00
Yatsishin Ilya
45e54f81c7 better resolv.conf, add DNSCacheUpdater logs 2020-09-02 11:07:46 +03:00
Amos Bird
6bd753d85d
TableFunction view. 2020-09-02 16:02:10 +08:00
Amos Bird
be925f8d9c
Introduce columns transformers. 2020-09-02 15:36:34 +08:00
zhang2014
1f908af189 ISSUES-14114 fix create parse failure when mysql nullable primary key 2020-09-02 13:05:09 +08:00
hcz
a80c1adee8 Add JSONCompactStrings formats 2020-09-02 12:15:58 +08:00
alexey-milovidov
adf50fd774
Merge pull request #13761 from zhang2014/improvement/date_time 
ISSUES-4006 add precision argument for DateTime type
 2020-09-02 05:12:35 +03:00
alexey-milovidov
2d85213629
Merge pull request #13792 from azat/lambda-arrayJoin-fix 
[RFC] Fix arrayJoin() capturing in lambda
 2020-09-02 05:10:58 +03:00
alexey-milovidov
bfa5a9ef03
Merge pull request #13987 from vitlibar/fix-grant-all-on-table 
Fix GRANT ALL statement when executed on a non-global level
 2020-09-02 05:06:32 +03:00
alexey-milovidov
04c88ca9e4
Update AccessFlags.h 2020-09-02 05:06:21 +03:00
alexey-milovidov
5a529f171c
Merge pull request #13988 from vitlibar/user-directories-mixed-style 
Add storages from <user_directories> after ones from <users_config> and <access_control_path>.
 2020-09-02 05:03:34 +03:00
alexey-milovidov
08ed74732e
Merge pull request #14320 from bharatnc/ncb/fix-alter-live-lock 
fix ALTER LIVE VIEW  [REFRESH] lock issue
 2020-09-02 04:52:35 +03:00
Alexey Milovidov
deb483eee5 Merge branch 'master' into fix-fuzz-test6 2020-09-02 04:40:42 +03:00
Alexey Milovidov
56bbac1569 Trigger CI 2020-09-02 04:28:52 +03:00
BohuTANG
6dfab88156 ISSUES-14235 change string.rfind to string starts_with and add some tests 2020-09-02 08:31:51 +08:00
alexey-milovidov
d58f6bd7c0
Merge pull request #14334 from ClickHouse/stop-threads-if-exception-in-pipeline-executor 
Stop query execution if exception happened in PipelineExecutor itself.
 2020-09-02 03:17:50 +03:00
Alexander Kuzmenkov
fa04b39d32
Revert "Change query event filter and add integration test for empty GTID transaction" 2020-09-02 02:06:53 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master 
Redis dictionary support for simple Redis requirepass authorization
 2020-09-02 01:43:02 +03:00
Anton Popov
4fe57fc169 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-02 01:29:44 +03:00
Anton Popov
26d75f7602 do fsync for WAL 2020-09-02 01:25:10 +03:00
kssenii
6682c62a90 Fixes 2020-09-01 20:07:34 +00:00
bharatnc
f0d1c6c794 Merge remote-tracking branch 'upstream/master' into ncb/fix-alter-live-lock 2020-09-01 09:06:10 -07:00
Anton Popov
3cadc9033a fsyncs for metadata files of part 2020-09-01 18:53:22 +03:00
Alexander Kuzmenkov
949a41f8b5
Merge pull request #14321 from BohuTANG/materialize_mysql_query_filter 
Change query event filter and add integration test for empty GTID transaction
 2020-09-01 17:44:58 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output 2020-09-01 16:59:04 +03:00
Nikolai Kochetov
f82b799f12 Update CreatingSetsTransform. 2020-09-01 16:53:11 +03:00
tavplubix
cb4644ea6d
Merge pull request #14326 from ClickHouse/fix_crash_alter_table_function 
Throw exception on alter for storages created from table functions
 2020-09-01 15:03:09 +03:00
alesapin
c37a19f7b0 Better 2020-09-01 14:23:38 +03:00
kssenii
15f735bb24 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-improvements 2020-09-01 10:51:34 +00:00
alesapin
f0dc5a3085 First working test 2020-09-01 13:49:53 +03:00
Nikolai Kochetov
8fac595428 Stop query execution if exception happened in PipelineExecutor itself. 2020-09-01 13:29:10 +03:00
Artem Zuikov
d304d522cc
Refactoring: rename types to allow change bigint library (#14219) 2020-09-01 12:54:50 +03:00
hcz
babd3beec0 Fix nullable data parsing 2020-09-01 17:48:19 +08:00
hcz
86fa185bb6 Add JSONStrings formats 2020-09-01 17:06:36 +08:00
hcz
602535396d Refactor, move function declarations 2020-09-01 16:36:27 +08:00
BohuTANG
453fb837d8 ISSUES-14235 change string.rfind to stringstarts_with 2020-09-01 16:25:15 +08:00
kssenii
c2fb72abf8 Better mv, more comments 2020-09-01 07:58:41 +00:00
alesapin
b751319f9e Merge branch 'master' into recompression_in_background 2020-09-01 10:31:10 +03:00
alesapin
a0b4cc78d6 Throw exception on alter for storages created from table functions 2020-09-01 10:26:31 +03:00
Azat Khuzhin
2d7cb03120 Suppress superfluous wget (-nv) output 
Since for dowloading some of files wget logging may take 50% of overall
log [1].

  [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
 2020-09-01 10:25:13 +03:00
Azat Khuzhin
d04cda0367 Fix QueryPlan lifetime (for EXPLAIN PIPELINE graph=1) for queries with nested interpreter 
Example of such queries are distributed queries, which creates local
InterpreterSelectQuery, which will have it's own QueryPlan but returns
Pipes that has that IQueryPlanStep attached.

After EXPLAIN PIPELINE graph=1 tries to use them, and will get SIGSEGV.

- TSAN:

<details>

```
==2782113==ERROR: AddressSanitizer: heap-use-after-free on address 0x6120000223c0 at pc 0x00002b8f3f3e bp 0x7fff18cfbff0 sp 0x7fff18cfbfe8
READ of size 8 at 0x6120000223c0 thread T22 (TCPHandler)
    #0 0x2b8f3f3d in DB::printPipelineCompact(std::__1::vector<std::__1::shared_ptr<DB::IProcessor>, std::__1::allocator<std::__1::shared_ptr<DB::IProcessor> > > const&, DB::WriteBuffer&, bool) /build/obj-x86_64-linux-gnu/../src/Processors/printPipeline.cpp:116:53
    #1 0x29ee698c in DB::InterpreterExplainQuery::executeImpl() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:275:17
    #2 0x29ee2e40 in DB::InterpreterExplainQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:73:14
    #3 0x2a7b44a2 in DB::executeQueryImpl(char const*, char const*, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool, DB::ReadBuffer*) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:389:28
    #4 0x2a7b1cb3 in DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:675:30
    #5 0x2b7993b2 in DB::TCPHandler::runImpl() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:253:24
    #6 0x2b7b649a in DB::TCPHandler::run() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1217:9
    #7 0x31d9c57e in Poco::Net::TCPServerConnection::start() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:43:3
    #8 0x31d9d281 in Poco::Net::TCPServerDispatcher::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:114:20
    #9 0x3206b5d5 in Poco::PooledThread::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:199:14
    #10 0x320657ad in Poco::ThreadImpl::runnableEntry(void*) /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:345:27
    #11 0x7ffff7f853e8 in start_thread (/usr/lib/libpthread.so.0+0x93e8)
    #12 0x7ffff7ea2292 in clone (/usr/lib/libc.so.6+0x100292)

0x6120000223c0 is located 0 bytes inside of 272-byte region [0x6120000223c0,0x6120000224d0)
freed by thread T22 (TCPHandler) here:
    #0 0x122f3b62 in operator delete(void*, unsigned long) (/src/ch/tmp/master-20200831/clickhouse+0x122f3b62)
    #1 0x2bd9e9fa in std::__1::default_delete<DB::IQueryPlanStep>::operator()(DB::IQueryPlanStep*) const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2363:5
    #2 0x2bd9e9fa in std::__1::unique_ptr<DB::IQueryPlanStep, std::__1::default_delete<DB::IQueryPlanStep> >::reset(DB::IQueryPlanStep*) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2618:7
    #3 0x2bd9e9fa in std::__1::unique_ptr<DB::IQueryPlanStep, std::__1::default_delete<DB::IQueryPlanStep> >::~unique_ptr() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2572:19
    #4 0x2bd9e9fa in DB::QueryPlan::Node::~Node() /build/obj-x86_64-linux-gnu/../src/Processors/QueryPlan/QueryPlan.h:66:12
    #5 0x2bd9e9fa in void std::__1::allocator_traits<std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> > >::__destroy<DB::QueryPlan::Node>(std::__1::integral_constant<bool, false>, std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> >&,
 DB::QueryPlan::Node*) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1798:23
    #6 0x2bd9e9fa in void std::__1::allocator_traits<std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> > >::destroy<DB::QueryPlan::Node>(std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> >&, DB::QueryPlan::Node*) /build/obj-x86_64-lin
ux-gnu/../contrib/libcxx/include/memory:1630:14
    #7 0x2bd9e9fa in std::__1::__list_imp<DB::QueryPlan::Node, std::__1::allocator<DB::QueryPlan::Node> >::clear() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/list:762:13
    #8 0x29fece08 in DB::InterpreterSelectQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:492:1
    #9 0x2abf7484 in DB::ClusterProxy::(anonymous namespace)::createLocalStream(std::__1::shared_ptr<DB::IAST> const&, DB::Block const&, DB::Context const&, DB::QueryProcessingStage::Enum) /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp:
78:33
    #10 0x2abea85d in DB::ClusterProxy::SelectStreamFactory::createForShard(DB::Cluster::ShardInfo const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, std::__1::shar
ed_ptr<DB::Throttler> const&, DB::SelectQueryInfo const&, std::__1::vector<DB::Pipe, std::__1::allocator<DB::Pipe> >&)::$_0::operator()() const /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp:133:51
    #11 0x2abea85d in DB::ClusterProxy::SelectStreamFactory::createForShard(DB::Cluster::ShardInfo const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, std::__1::shar
ed_ptr<DB::Throttler> const&, DB::SelectQueryInfo const&, std::__1::vector<DB::Pipe, std::__1::allocator<DB::Pipe> >&) /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp:189:13
    #12 0x2abe6d99 in DB::ClusterProxy::executeQuery(DB::ClusterProxy::IStreamFactory&, std::__1::shared_ptr<DB::Cluster> const&, Poco::Logger*, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, DB::Settings const&, DB::SelectQueryInfo const&) /build/obj-x86_64-lin
ux-gnu/../src/Interpreters/ClusterProxy/executeQuery.cpp:107:24
    #13 0x2abc4b74 in DB::StorageDistributed::read(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&, s
td::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, DB::Context const&, DB::QueryProcessingStage::Enum, unsigned long, unsigned int) /build/obj-x86_64-linux-gnu/../src/Storages/StorageDistributed.cpp:514:12
    #14 0x2bda1c5a in DB::ReadFromStorageStep::ReadFromStorageStep(std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions, std::__1::shared_ptr<DB::IStorage>, std::__1::vector<std::__1::basic_st
ring<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&, DB::SelectQueryInfo const&, std::__1::shared_ptr<DB::Context>, DB::QueryProcessingStage
::Enum, unsigned long, unsigned long) /build/obj-x86_64-linux-gnu/../src/Processors/QueryPlan/ReadFromStorageStep.cpp:39:26
    #15 0x2a01ca70 in std::__1::__unique_if<DB::ReadFromStorageStep>::__unique_single std::__1::make_unique<DB::ReadFromStorageStep, std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions&, std
::__1::shared_ptr<DB::IStorage>&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > >&, DB::SelectQueryInfo&, st
d::__1::shared_ptr<DB::Context>&, DB::QueryProcessingStage::Enum&, unsigned long&, unsigned long&>(std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions&, std::__1::shared_ptr<DB::IStorage>&,
std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > >&, DB::SelectQueryInfo&, std::__1::shared_ptr<DB::Context>&,
DB::QueryProcessingStage::Enum&, unsigned long&, unsigned long&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:3028:32
    #16 0x29ff556a in DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&, std::__1::shared_ptr<DB::PrewhereInfo> const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::
__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:1383:26
    #17 0x29fe6b83 in DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::__1::shared_ptr<DB::IBlockInputStream> const&, std::__1::optional<DB::Pipe>) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:795:9
    #18 0x29fe5771 in DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:473:5
    #19 0x2a47d370 in DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectWithUnionQuery.cpp:182:38
    #20 0x29ee5bff in DB::InterpreterExplainQuery::executeImpl() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:265:21
    #21 0x29ee2e40 in DB::InterpreterExplainQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:73:14
    #22 0x2a7b44a2 in DB::executeQueryImpl(char const*, char const*, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool, DB::ReadBuffer*) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:389:28
    #23 0x2a7b1cb3 in DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:675:30
    #24 0x2b7993b2 in DB::TCPHandler::runImpl() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:253:24
    #25 0x2b7b649a in DB::TCPHandler::run() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1217:9
    #26 0x31d9c57e in Poco::Net::TCPServerConnection::start() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:43:3
    #27 0x31d9d281 in Poco::Net::TCPServerDispatcher::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:114:20
    #28 0x3206b5d5 in Poco::PooledThread::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:199:14
    #29 0x320657ad in Poco::ThreadImpl::runnableEntry(void*) /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:345:27
    #30 0x7ffff7f853e8 in start_thread (/usr/lib/libpthread.so.0+0x93e8)
```

</details>
 2020-09-01 10:04:08 +03:00