thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-29 19:12:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
54,992 Commits 9,187 Branches 1,782 Tags 2.2 GiB
f21e22ae2c
Commit Graph

3566 Commits

Author SHA1 Message Date
alexey-milovidov
0d9519a0a2
Merge pull request #17567 from ClickHouse/insert_quorum_parallel-default 
Insert quorum parallel by default
 2020-12-18 08:08:26 +03:00
Alexey Milovidov
6c62301894 Merge branch 'master' of github.com:yandex/ClickHouse into boringssl2 2020-12-18 07:59:18 +03:00
Alexey Milovidov
1be41beca0 Merge branch 'master' into boringssl2 2020-12-18 05:59:30 +03:00
Alexander Kuzmenkov
4bfcb2fc16 a setting 2020-12-18 04:25:21 +03:00
Alexander Kuzmenkov
5e19eaf2f0 Merge remote-tracking branch 'origin/master' into tmp 2020-12-18 03:49:59 +03:00
Alexander Kuzmenkov
157fe3e8b4 some tests + ability to echo the queries 2020-12-18 03:49:18 +03:00
Nikita Mikhailov
6a55e018e4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel-parsing-input-format 2020-12-18 02:25:32 +03:00
Nikita Mikhaylov
aa7793e38f
Merge pull request #18084 from nikitamikhaylov/fix-arcadia-third 
Try to fix Arcadia
 2020-12-18 01:54:42 +03:00
alexey-milovidov
6fc3ca8b7b
Merge pull request #16724 from kitaisreal/added-function-accurate-cast-or-null 
Added function accurateCastOrNull, allow different types inside IN subquery
 2020-12-18 00:45:27 +03:00
Vitaly Baranov
d9125a4822
Merge pull request #18014 from vitlibar/fix-showing-temporary-tables-in-system-tables 
Fix showing temporary tables in system tables
 2020-12-17 22:59:09 +03:00
Alexey Milovidov
e4433157e7 Merge branch 'master' into insert_quorum_parallel-default 2020-12-17 22:42:32 +03:00
Alexey Milovidov
3060743b9f Merge branch 'master' into boringssl2 2020-12-17 22:09:30 +03:00
alexey-milovidov
dd78c9dc75
Merge pull request #17566 from ClickHouse/relax-too-many-parts-1 
Relax "Too many parts" threshold, part 1
 2020-12-17 20:44:44 +03:00
Nikolai Kochetov
171a992192 Merge branch 'master' into ucasFL-master 2020-12-17 18:52:13 +03:00
Anton Popov
a77acd5aa7
Fix flaky test 2020-12-17 18:12:24 +03:00
hexiaoting
cb91d64fe7
Add new feature: limit length and offset setting (#17633) 
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
 2020-12-17 17:16:14 +03:00
Nikita Mikhaylov
0f3582883c
Merge pull request #18147 from kitaisreal/array-aggregation-big-integer-types-support 
Added array aggregation big integer types support
 2020-12-17 15:44:55 +03:00
Nikita Mikhaylov
d302685e72
Merge pull request #18172 from nikitamikhaylov/julian-day-msan 
toModifiedJulianDayOrNull msan fix
 2020-12-17 15:12:05 +03:00
tavplubix
7e73b6acd8
Merge pull request #17642 from filimonov/detach-permanently 
DETACH TABLE PERMANENTLY
 2020-12-17 14:26:51 +03:00
Kruglov Pavel
d82c23d5cf
Merge pull request #16853 from amosbird/ss 
Add -SimpleState combinator
 2020-12-17 14:00:05 +03:00
Vitaly Baranov
72df75fc50 Add tests. 2020-12-17 11:42:25 +03:00
Vitaly Baranov
af3ccb49f1 Show create query for temporary tables in system.tables 2020-12-17 11:42:25 +03:00
Vitaly Baranov
d7a3cc8c90 Don't show the "_temporary_and_external_tables" database in system tables 
system.databases, system.tables, system.columns.
 2020-12-17 11:42:25 +03:00
root
019566643a add reference 2020-12-17 14:28:26 +08:00
jianmei zhang
1df76ad0c3 Try to fix issue #17712 for wrong importing of rows with last bad column 2020-12-17 14:23:25 +08:00
roverxu
632f4defaa add test from count of parts 2020-12-17 14:04:52 +08:00
roverxu
00a5956b5a add test from count of parts 2020-12-17 13:55:34 +08:00
Alexey Milovidov
ce9767fc42 Remove obsolete and inefficient ciphers 2020-12-17 07:43:54 +03:00
alexey-milovidov
81c00a4e94
Merge pull request #18167 from ClickHouse/fix_checking_profile_settings_constraints 
Fix `Unknown setting profile` error on attempt to set settings profile
 2020-12-17 07:18:53 +03:00
spongedc
bcaccab0ff 1. Fix test error 2. Add more test cases 2020-12-17 11:28:18 +08:00
nikitamikhaylov
db362e4585 done 2020-12-17 05:27:32 +03:00
Alexey Milovidov
7abc58526a Update test 2020-12-17 04:55:07 +03:00
Alexey Milovidov
6a7c73a7bd Merge branch 'master' into insert_quorum_parallel-default 2020-12-17 04:54:17 +03:00
Alexey Milovidov
b25f126569 Added a test 2020-12-17 04:52:27 +03:00
alexey-milovidov
37da513c36
Merge pull request #18136 from taiyang-li/explain_ast_nonselect_query 
Explain ast support nonselect querys
 2020-12-17 03:35:19 +03:00
alexey-milovidov
484f20f77d
Merge pull request #18140 from ClickHouse/fix_flaky_test 
Trying to fix 00620_optimize_on_nonleader_test
 2020-12-17 03:34:39 +03:00
alexey-milovidov
908784a0d9
Merge pull request #18148 from ClickHouse/suppress_error_in_test 
Suppress error in 00993_system_parts_race_condition_drop_zookeeper
 2020-12-17 03:32:10 +03:00
Alexander Tokmakov
76e73e4e8b fix 'Unknown setting profile' error 2020-12-16 23:49:56 +03:00
Maksim Kita
5a096a75b8 Fixed issues with average 2020-12-16 23:10:40 +03:00
alesapin
a999850378
Merge pull request #18130 from ClickHouse/fix_remove_column_ttl 
Fix remove TTL for column
 2020-12-16 22:05:16 +03:00
nikitamikhaylov
23270915d3 better 2020-12-16 21:03:39 +03:00
alexey-milovidov
b8250882ac
Merge pull request #18056 from zhangjmruc/master 
Fix issue #17160 by adding show settings like '...'
 2020-12-16 20:35:18 +03:00
Mikhail Filimonov
294e8bbb4e
Fix2 2020-12-16 18:16:47 +01:00
Nikolai Kochetov
d96ca3fb8d Fixing build. 2020-12-16 20:11:32 +03:00
alesapin
d873439846
Merge pull request #15236 from ClickHouse/run_func_tests_in_parallel 
Collect list of non-parallel test
 2020-12-16 19:29:32 +03:00
alesapin
8139bab240 More relaxed check 2020-12-16 19:12:57 +03:00
alesapin
9cc6fec36c Supress error in 00993_system_parts_race_condition_drop_zookeeper 2020-12-16 19:10:46 +03:00
Maksim Kita
b82770c2ad Added array aggregation big integer types support 2020-12-16 18:47:30 +03:00
nikitamikhaylov
50c29d9ed0 better 2020-12-16 18:34:29 +03:00
Mikhail Filimonov
f14cafee51
Fix tests 2020-12-16 16:06:43 +01:00
roverxu
1065ddef65 fix bug when drop data 2020-12-16 22:02:34 +08:00
alesapin
c15f5fba3b Fix 00620_optimize_on_nonleader_test 2020-12-16 16:16:24 +03:00
nikitamikhaylov
0a2bda002d remove last commit 2020-12-16 14:55:33 +03:00
nikitamikhaylov
61c1db3823 skip test 2020-12-16 14:55:33 +03:00
alesapin
dbbe761fa1 Fix test 2020-12-16 13:23:11 +03:00
taiyang-li
cd7827f70c explain ast support nonselect queries 2020-12-16 18:11:38 +08:00
alesapin
2a4a6b22b1 Fix remove TTL for column 2020-12-16 10:26:18 +03:00
spongedc
38c0827881 Merge remote-tracking branch 'origin/master' into support_show_create_view 2020-12-16 12:26:56 +08:00
spongedc
81b0fa2989 1. rename is_view to is_ordinary_view 2. add more tests 2020-12-16 11:19:38 +08:00
jianmei zhang
a7933ddf31 Merge and rebase with master 2020-12-16 09:38:38 +08:00
Anton Popov
45361f752c fix test 2020-12-16 02:36:03 +03:00
Alexey Milovidov
13ac1bee7a Merge branch 'master' into amosbird-stacktracefix 2020-12-15 22:12:49 +03:00
Anton Popov
e51cf03f21 Merge remote-tracking branch 'upstream/master' into HEAD 2020-12-15 21:08:01 +03:00
Anton Popov
ba63635251 add tests for formats with type map 2020-12-15 21:07:13 +03:00
Mikhail Filimonov
9df7ecb8e6
fixes 2020-12-15 18:06:23 +01:00
Nikita Mikhaylov
31bef163ba
Merge pull request #17848 from azat/max_distributed_connections-fix 
Fix max_distributed_connections
 2020-12-15 17:34:38 +03:00
Anton Popov
dd09e1d783 fix type map ser/de to json 2020-12-15 17:34:37 +03:00
Nikolai Kochetov
6defcbb662
Merge branch 'master' into optimize-data-on-insert 2020-12-15 16:50:42 +03:00
spongedc
dc27e0a4fd Fix error code 2020-12-15 20:29:26 +08:00
Vasily Nemkov
bf8c7cd685 Checking that columns from PARTITION BY are present in DEDUPLICATE BY 2020-12-15 13:41:00 +03:00
jianmei zhang
b56523fd94 Update test case to avoid the latest added parameter 2020-12-15 17:56:54 +08:00
jianmei zhang
508b50d121 support SHOW CHANGED SETTINGS query and add test cases, also do code changes to compile SHOW SETTINGS PROFILES. 2020-12-15 14:46:56 +08:00
Anton Popov
c78861e86e Merge remote-tracking branch 'upstream/master' into HEAD 2020-12-15 01:45:01 +03:00
Anton Popov
afc2d7099b add conversion from array to map 2020-12-15 01:16:04 +03:00
nikitamikhaylov
f7ac8bf542 rebase and fix tests 2020-12-15 00:56:48 +03:00
nikitamikhaylov
746b7d0e13 better test + fix writePrefix in JSONCompact 2020-12-15 00:56:47 +03:00
nikitamikhaylov
4ff1be6e25 better 2020-12-15 00:56:47 +03:00
alexey-milovidov
491e086435
Merge pull request #18057 from azat/fix-01600_remerge_sort_lowered_memory_bytes_ratio-flap 
Fix 01600_remerge_sort_lowered_memory_bytes_ratio flap
 2020-12-14 22:57:27 +03:00
alexey-milovidov
906415540a
Merge pull request #18060 from kitaisreal/create-query-create-as-select-with-columns-specification 
CreateQuery create as select with columns specification
 2020-12-14 22:57:02 +03:00
Maksim Kita
17b43ca721 Fixed tests 2020-12-14 22:12:15 +03:00
Maksim Kita
0464859cfe Updated usage of different types during IN query 
1. Added accurateCast function.
2. Use accurateCast in Set during execute.
3. Added accurateCast tests.
4. Updated select_in_different_types tests.
 2020-12-14 22:12:15 +03:00
Maksim Kita
f4b8e8ef99 Allow different types inside IN subquery 2020-12-14 22:12:15 +03:00
Maksim Kita
dd072a20c9 Fixed compile issues 2020-12-14 22:12:15 +03:00
Maksim Kita
db5d0944ed Added Decimal support 2020-12-14 22:12:15 +03:00
Maksim Kita
baad78d2f2 Fixed setting null value in vector. Updated tests. 2020-12-14 22:12:15 +03:00
Maksim Kita
4cd5025e83 Added numeric limits for UInt128 2020-12-14 22:12:15 +03:00
Maksim Kita
d636e1618b Added function accurate cast or null 2020-12-14 22:12:15 +03:00
spongedc
8b2feaeca2 Support SHOW CREATE VIEW Syntax 2020-12-14 22:37:25 +08:00
Mikhail Filimonov
24abcc970b
Tests and fixes 2020-12-14 15:31:13 +01:00
Mikhail Filimonov
3f5e5eb15a
Handle not implemented cases properly 2020-12-14 15:31:05 +01:00
Mikhail Filimonov
f6097cf818
Adding DETACH TABLE PERMANENTLY 2020-12-14 15:28:59 +01:00
Maksim Kita
14dedae9f1 Updated sql test file 2020-12-14 15:50:11 +03:00
Maksim Kita
55f991adde Updated test 2020-12-14 15:23:53 +03:00
alexey-milovidov
0bc2603b1d
Update 01081_PartialSortingTransform_full_column.sql 2020-12-14 14:14:59 +03:00
alexey-milovidov
ab17927c85
Merge pull request #18032 from kitaisreal/array-aggregation-functions 
Array aggregation functions
 2020-12-14 14:11:09 +03:00
Maksim Kita
d8534ae1af CreateQuery create as select with columns specification 2020-12-14 12:30:08 +03:00
Azat Khuzhin
bf23bc6f0c Fix 01600_remerge_sort_lowered_memory_bytes_ratio flap 2020-12-14 10:52:04 +03:00
jianmei zhang
f829fbb928 Merge remote-tracking branch 'upstream/master' 2020-12-14 11:21:42 +08:00
jianmei zhang
2169e8f7f4 Fix issue #17160 by adding show settings like '...' 2020-12-14 10:33:51 +08:00
Maksim Kita
0be51cbabd Updated tests 2020-12-13 21:27:48 +03:00
Maksim Kita
5d6036e9c8 Fixed style issues 2020-12-13 14:38:56 +03:00
alexey-milovidov
bce02de691
Merge pull request #17539 from azat/remerge_sort_lowered_memory_bytes_ratio 
Add remerge_sort_lowered_memory_bytes_ratio setting
 2020-12-13 04:38:50 +03:00
alexey-milovidov
8df4789113
Merge pull request #17845 from kitaisreal/space-saving-remove-last-element-from-map-fix 
SpaceSaving remove last element from map fix
 2020-12-13 04:09:51 +03:00
alexey-milovidov
04e222f6f3
Merge pull request #17986 from azat/fwd-decl 
More forward declaration for generic headers
 2020-12-13 01:12:05 +03:00
Maksim Kita
0dcbcec19a Added tests 2020-12-13 00:29:09 +03:00
alexey-milovidov
2eabd41749
Merge pull request #17659 from nautaa/master 
add function to escape charaters for XML
 2020-12-12 23:43:41 +03:00
Azat Khuzhin
41bc43325b Make 01290_max_execution_speed_distributed less flaky 2020-12-12 17:43:10 +03:00
Maksim Kita
07c8293043 Added tests 2020-12-12 15:08:46 +03:00
Amos Bird
a0f4dfd948
get back tests 2020-12-12 13:59:33 +08:00
alexey-milovidov
0d6fe7121d
Merge pull request #17887 from sundy-li/trivial_count-fix 
disable optimize_trivial_count in query with array join
 2020-12-12 02:44:07 +03:00
alexey-milovidov
adbe8e1ebb
Merge pull request #17903 from ClickHouse/attach_table_from_path 
Implement ATTACH TABLE name FROM 'path/to/data/'
 2020-12-12 02:42:53 +03:00
Kruglov Pavel
a8c1d17f83
Merge pull request #16935 from ucasFL/agg-func-setting-null-for-empty 
`aggregate_functions_null_for_empty` move OrNull ahead
 2020-12-11 17:11:39 +03:00
Maksim Kita
4ae5619714 Optimized erase in HashTable 2020-12-11 16:54:08 +03:00
Maksim Kita
bf5d75853c Added erase into HashTable 2020-12-11 16:54:08 +03:00
Maksim Kita
bfceb06659 Fixed test 2020-12-11 16:54:08 +03:00
Maksim Kita
d8b78682e1 SpaceSaving remove last element from map fix 2020-12-11 16:54:08 +03:00
Alexander Kuzmenkov
fb1221148d
Merge pull request #17748 from azat/custom-TLD 
Add ability to use custom TLD list
 2020-12-11 12:42:19 +03:00
nauta
00dc104025 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse 2020-12-11 16:15:40 +08:00
Amos Bird
5b1e5679b4
Add -SimpleState combinator 2020-12-11 11:43:56 +08:00
alexey-milovidov
2fb7ce8340
Revert "Date vs DateTime64 comparison" 2020-12-11 01:09:01 +03:00
alexey-milovidov
c35c52be87
Merge pull request #17867 from ucasFL/mergetree-setting 
Add settings `min_compress_block_size` and `max_compress_block_size` to MergeTreeSettings
 2020-12-10 22:54:05 +03:00
Nikita Mikhaylov
80d4af9a73
Merge pull request #17874 from nikitamikhaylov/calendar-date 
Merging #17750
 2020-12-10 00:19:04 +03:00
Azat Khuzhin
8875767b87 Add a test for custom TLD 2020-12-09 21:08:30 +03:00
Vasily Nemkov
a2f85a03f3 Enforcing all sorting keys to be present in DEDUPLICATE BY columns 
Updated test and minor cleanup
 2020-12-09 18:08:37 +03:00
alesapin
4d1f528806
Merge pull request #17918 from ClickHouse/revert-17120-fix_granularity_on_block_borders 
Revert "Fix index granularity calculation on block borders"
 2020-12-09 14:46:56 +03:00
Nikolai Kochetov
6a9e1ce436
Merge pull request #17895 from Enmk/DateTime64_DateTime_comparison 
Date vs DateTime64 comparison
 2020-12-09 14:22:26 +03:00
alesapin
7783ddb3af
Revert "Fix index granularity calculation on block borders" 2020-12-09 14:05:48 +03:00
feng lv
91c3de9664 fix 
fix

fix
 2020-12-09 09:13:51 +00:00
feng lv
7546c611fb add test 2020-12-09 08:11:14 +00:00
feng lv
e95e443246 fix 
fix
 2020-12-09 04:32:28 +00:00
feng lv
9b2bb1820a Merge branch 'master' of github.com:ClickHouse/ClickHouse into agg-func-setting-null-for-empty 2020-12-09 02:28:49 +00:00
alexey-milovidov
8ff30b87a6
Merge pull request #15930 from kitaisreal/clickhouse-client-and-local-added-queries-file-parameter 
Clickhouse client and clickhouse local added queries-file parameter
 2020-12-08 21:44:19 +03:00
Vasily Nemkov
59fc301344 Fixed test to be less flaky 
Also logging expanded list of columns passed from `DEDUPLICATE BY` to actual deduplication routines.
 2020-12-08 19:44:34 +03:00
Vasily Nemkov
0c2d73adcb Fixed comparing Date and DateTime64 2020-12-08 17:17:02 +03:00
Alexander Tokmakov
04ceaa66f2 implement ATTACH TABLE name FROM 'path/to/data/ 2020-12-08 17:15:23 +03:00
nauta
ab5f397022 add encodeXMLComponent function 2020-12-08 21:02:09 +08:00
Kruglov Pavel
e19eb6f17a
Merge branch 'master' into optimize-data-on-insert 2020-12-08 15:57:46 +03:00
alexey-milovidov
d9b52f94f7
Merge pull request #17637 from amosbird/buildid 
reload symbols and fix build-id
 2020-12-08 14:55:35 +03:00
alexey-milovidov
ab10cb4bf9
Merge pull request #17707 from ClickHouse/quota-by-x-forwarded-for 
Allow quotas to be keyed by proxy-forwarded IP address; add support for PROXY protocol
 2020-12-08 14:48:05 +03:00
sundy-li
d4d913edb0 update tests 2020-12-08 19:18:43 +08:00
Vasily Nemkov
5556c48298 Added test for DateTime vs DateTime64 comparison 2020-12-08 13:51:50 +03:00
Nikolai Kochetov
7d77a7ba24
Merge pull request #16952 from Enmk/DateTime64_fixes_comparison 
Fixed comparison of DateTime64 with different scales
 2020-12-08 12:40:41 +03:00
sundy-li
d9176263aa disable optimize_trivial_count in query with array join 2020-12-08 16:00:12 +08:00
Alexey Milovidov
fa08c59d14 Fix bad test 2020-12-08 02:09:47 +03:00
Alexey Milovidov
af55793e69 Better test 2020-12-07 19:57:08 +03:00
Alexey Milovidov
b762398616 Better test 2020-12-07 19:43:32 +03:00
Maksim Kita
ae56223611 Added queries-file parameter. Updated tests. 2020-12-07 19:29:17 +03:00
Maksim Kita
963ee5211b Added queries-file parameter. Fixed code review issues 2020-12-07 19:29:17 +03:00
Maksim Kita
f5d1a9e59a Clickhouse client and local added queries-file parameter 2020-12-07 19:29:17 +03:00
alexey-milovidov
584fb97ed2
Merge pull request #17832 from kitaisreal/clickhouse-benchmark-added-query-parameter 
Clickhouse-benchmark added query parameter
 2020-12-07 19:26:16 +03:00
nikitamikhaylov
a8616ea262 better 2020-12-07 18:47:57 +03:00
Alexey Milovidov
1ed329017b Merge branch 'master' into quota-by-x-forwarded-for 2020-12-07 18:22:19 +03:00
Vasily Nemkov
168155eeec Minor: cleanup 2020-12-07 18:07:40 +03:00
Vasily Nemkov
f01a566646 Updated tests 2020-12-07 17:42:49 +03:00
PHO
3c90065158 Add functions toMJD and fromMJD 
These functions convert between Proleptic Gregorian calendar date and Modified Julian Day number.
 2020-12-07 16:00:32 +03:00
alesapin
371cb23946 Merge branch 'master' into run_func_tests_in_parallel 2020-12-07 13:30:41 +03:00
alesapin
57f40e4260
Merge pull request #17458 from ClickHouse/merge-expressions 
Merge expressions
 2020-12-07 12:34:19 +03:00
Maksim Kita
ee33323d1e Added tests 2020-12-07 11:35:44 +03:00
Vasily Nemkov
70ea507dae OPTIMIZE DEDUPLICATE BY columns 
Extended OPTIMIZE ... DEDUPLICATE syntax to allow explicit (or implicit with asterisk/column transformers) list of columns to check for duplicates on.

Following syntax variants are now supported:

OPTIMIZE TABLE table DEDUPLICATE; -- the old one
OPTIMIZE TABLE table DEDUPLICATE BY *;
OPTIMIZE TABLE table DEDUPLICATE BY * EXCEPT colX;
OPTIMIZE TABLE table DEDUPLICATE BY * EXCEPT (colX, colY);
OPTIMIZE TABLE table DEDUPLICATE BY col1,col2,col3;
OPTIMIZE TABLE table DEDUPLICATE BY COLUMNS('column-matched-by-regex');
OPTIMIZE TABLE table DEDUPLICATE BY COLUMNS('column-matched-by-regex') EXCEPT colX;
OPTIMIZE TABLE table DEDUPLICATE BY COLUMNS('column-matched-by-regex') EXCEPT (colX, colY);

Note that * behaves just like in SELECT: MATERIALIZED, and ALIAS columns are not used for expansion.
Also, it is an error to specify empty list of columns, or write an expression that results in an empty list of columns, or deduplicate by an ALIAS column.
Column transformers other than EXCEPT are not supported.
 2020-12-07 09:44:07 +03:00
alexey-milovidov
dd8362a5eb
Merge pull request #17570 from vdimir/typo_01018_ip_dictionary 
Fix mixed statements in 01018_ip_dictionary.sql
 2020-12-07 02:22:55 +03:00
alexey-milovidov
4df1983d64
Merge pull request #17571 from vdimir/ip-dict-accept-alias 
IP dictionary works with aliased types `IPv4` and `IPv6` (close #6804)
 2020-12-07 02:19:32 +03:00
Alexey Milovidov
a63d4f0db3 Merge branch 'master' into amosbird-buildid 2020-12-07 02:17:29 +03:00
Azat Khuzhin
c3a4e5e7b7 Fix max_distributed_connections (one more time) 
With prefer_localhost_replica=1 max_distributed_connections uses
max_threads before this patch.

Fixes: #14936
Previous fix: #9673
 2020-12-07 01:19:53 +03:00
Anton Popov
7aaa2c052f
Merge branch 'master' into merging-map 2020-12-05 22:41:46 +03:00
Anton Popov
60b0cbb1c1
Merge pull request #15939 from Avogar/optimize_final_optimization 
Optimize final optimization
 2020-12-05 02:26:27 +03:00
Alexander Kuzmenkov
b54d50fa7f
Merge pull request #17459 from azat/countMatches-pull 
Add countMatches function
 2020-12-05 00:01:47 +03:00
Pavel Kruglov
905ba78adc Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize-data-on-insert 2020-12-04 18:56:46 +03:00
Ivan
315ff4f0d9
ANTLR4 Grammar for ClickHouse and new parser (#11298) 2020-12-04 05:15:44 +03:00
Alexey Milovidov
d92606d362 Better test 2020-12-03 23:23:09 +03:00
alesapin
b68aa1c76d Merge branch 'master' into run_func_tests_in_parallel 2020-12-03 17:22:09 +03:00
Anton Popov
cd1917c7a6
Merge branch 'master' into optimize_final_optimization 2020-12-03 16:52:51 +03:00
Alexey Milovidov
00dc21b0b9 Better tests 2020-12-03 13:02:20 +03:00
Alexey Milovidov
3e2447391b Support for PROXY protocol 2020-12-03 00:05:51 +03:00
Ivan
278cde366c
Update arcadia_skip_list.txt 2020-12-02 22:55:48 +03:00
alexey-milovidov
85f4045160
Merge pull request #17144 from fibersel/issue-16791 
introduce zstd compression (for data import/export)
 2020-12-02 22:41:07 +03:00
Alexey Milovidov
a25baebc5a Added a test 2020-12-02 22:20:11 +03:00
Azat Khuzhin
5365718f01
Fix optimize_distributed_group_by_sharding_key for query with OFFSET only (#16996) 
* Fix optimize_distributed_group_by_sharding_key for query with OFFSET only

* Fix 01244_optimize_distributed_group_by_sharding_key flakiness
 2020-12-02 20:11:39 +03:00
Azat Khuzhin
cbd4434a33 Add a test for countMatches()/countMatchesCaseInsensitive() 2020-12-01 22:25:28 +03:00
Nikita Mikhaylov
519b886641
Merge pull request #17634 from nikitamikhaylov/scipy-arcadia 
Try to fix Yandex Synchronization check
 2020-12-01 17:59:49 +03:00
Anton Popov
12604ce0e6 Merge branch 'dev_map2' of git://github.com/hexiaoting/ClickHouse into merging-map 2020-12-01 14:52:30 +03:00
alexey-milovidov
2644f446ab
Merge pull request #17453 from azat/memory-tracking-exception-locking 
Do not allow to throw MEMORY_LIMIT_EXCEEDED if there is uncaught exception
 2020-12-01 10:25:17 +03:00
Amos Bird
7e1d71305a
fix test 2020-12-01 10:15:38 +08:00
Vasily Nemkov
87945fb68b Merge branch 'master' into HEAD 2020-11-30 23:25:57 +03:00
nikitamikhaylov
1037a994a8 done 2020-11-30 15:53:37 +03:00
Alexander Kuzmenkov
d9dd9341ce Fix the OpenTelemetry test 2020-11-30 12:11:17 +03:00
alesapin
25f40db2fb
Merge pull request #17499 from ClickHouse/concurrent_mutation_and_random_kill 
Fix kill mutation on concurrent alter queries
 2020-11-30 10:51:50 +03:00
alexey-milovidov
46e685e1b8
Merge pull request #17565 from ClickHouse/fix-multiline-queries-with-comments 
Fix multiline queries with comments in interactive mode
 2020-11-30 09:38:41 +03:00
alexey-milovidov
df90cbd7d3
Merge pull request #17563 from ClickHouse/parser-alter-missing-code 
Allow query parameters in UPDATE statement.
 2020-11-30 09:38:14 +03:00
Alexey Milovidov
7f1a8b15fd Fix bad test 2020-11-29 21:21:59 +03:00
alexey-milovidov
484f7601d3
Merge pull request #17562 from ClickHouse/test-memory-accounting-zeros 
Add a test for #11803
 2020-11-29 21:17:25 +03:00
Azat Khuzhin
ccd794a676 Add remerge_sort_lowered_memory_bytes_ratio setting 
Sometimes default ratio is not good enough (2), since it depends on lots
of factors:
- size of LIMIT
- max_memory_usage
- ...

So add a separate setting for it.

But note that it make sense to set
remerge_sort_lowered_memory_bytes_ratio only in range (1, 2]

Since <= 1 will just use more CPU, and > 2 will use more RAM and will
unlikely be faster.
 2020-11-29 21:16:42 +03:00
alexey-milovidov
b682539d4a
Merge pull request #17561 from ClickHouse/test-9490 
Add a test for #9490
 2020-11-29 21:16:39 +03:00
alexey-milovidov
b03aaf2b8a
Merge pull request #17557 from ClickHouse/test-chertus 
Add a test for #12297
 2020-11-29 21:16:03 +03:00
alexey-milovidov
5a1ebb5722
Merge pull request #17541 from ClickHouse/add-test-engine-join-uuid 
Add a test for StorageJoin and UUID
 2020-11-29 21:15:40 +03:00
alexey-milovidov
038a56d243
Merge pull request #16951 from CurtizJ/fix-groupby-optimization 
Fix optimization with 'optimize_aggregators_of_group_by_keys' and joins
 2020-11-29 20:47:16 +03:00
alexey-milovidov
1c7844b91e
Merge pull request #16956 from CurtizJ/fix-order-by 
Fix order by optimization with monotonous functions
 2020-11-29 20:45:47 +03:00
vdimir
cb2259cfb3
Fix mixed statements and typos in 0_stateless/01018_ip_dictionary.sql 2020-11-29 19:49:04 +03:00
Alexey Milovidov
f46eb6f2be Update tests 2020-11-29 18:16:47 +03:00
alexey-milovidov
ced739f231
Merge branch 'master' into test-distributed_buffer_cannot_find_column 2020-11-29 17:54:16 +03:00
Alexey Milovidov
98f9670f69 Add a test 2020-11-29 17:50:50 +03:00
alexey-milovidov
a965dba0b9
Update 01599_mutation_query_params.sh 2020-11-29 16:45:08 +03:00
Alexey Milovidov
4f47545bc8 Add a test for #10976 2020-11-29 16:42:56 +03:00
Alexey Milovidov
5edda3c6bd Add a test for #11803 2020-11-29 16:04:57 +03:00
Alexey Milovidov
3ccc4d66a1 Add a test for #9490 2020-11-29 16:02:35 +03:00
FawnD2
26488467f8 Merge branch 'master' into switch-upstream-for-arrow-submodule 2020-11-29 15:53:28 +03:00
Alexey Milovidov
3bd9a7d3bd Add a test for #12297 2020-11-29 15:23:16 +03:00
a.palagashvili
502355922d added errors checking, removed redundant variables 2020-11-29 15:14:42 +03:00
alexey-milovidov
00da5148a1
Merge pull request #17347 from azat/substringCount 
Implement countSubstrings()
 2020-11-29 14:32:33 +03:00
alexey-milovidov
fabceebbce
Merge pull request #17145 from amosbird/cddt 
Fix unmatched type comparison in KeyCondition
 2020-11-29 14:29:35 +03:00
alexey-milovidov
43aa7740fb
Merge pull request #17526 from ClickHouse/obfuscator-remove-some-words 
Query obfuscator: remove some words
 2020-11-29 14:25:09 +03:00
Alexey Milovidov
4c3466dcf4 Merge branch 'master' into zhang2014-ISSUES-17244 2020-11-29 14:20:36 +03:00
Alexey Milovidov
d4721fea69 Added a test just in case 2020-11-29 13:56:14 +03:00
Alexey Milovidov
33b38a9f7b Update tests 2020-11-29 13:52:32 +03:00
Alexey Milovidov
e635b47299 Add a test for StorageJoin and UUID 2020-11-29 10:43:34 +03:00
vdimir
5f330a9366
IP dictionary works with aliased types IPv4 and IPv6 (close #6804) 2020-11-28 23:12:19 +03:00
alexey-milovidov
19bb345440
Merge pull request #17506 from ClickHouse/fix-bad-test 
Fix bad test 01317_no_password_in_command_line.sh
 2020-11-28 15:38:22 +03:00
Azat Khuzhin
6803e563a5 Add a test for INSERT SELECT with very small memory limits 
I found one query, using which, pretty easy to abnormal terminate the
server, for example executing the following query:

    insert into placeholder_table_name select * from numbers_mt(65535) settings max_memory_usage=1, max_untracked_memory=1 ; -- { serverError 60 }

Will lead to abnormal server termination:

    22:51:36.377873 [ 1853495 ] {edae87ee-05b3-4bfa-be51-3f81d25bca2e} <Debug> executeQuery: (from [::1]:48852) insert into placeholder_table_name select * from numbers_mt(65535) format Null settings max_memory_usage=1, max_untracked_memory=1
    22:51:36.390607 [ 1853446 ] {} <Trace> BaseDaemon: Received signal -1
    22:51:36.390644 [ 1853446 ] {} <Fatal> BaseDaemon: (version 20.12.1.5205 (official build), build id: B23CB64BD60D7F4C) (from thread 1853495) Terminate called for uncaught exception:
    e.displayText() = DB::Exception: Memory limit (for query) exceeded: would use 2.01 MiB (attempt to allocate chunk of 48 bytes), maximum: 1.00 B, Stack trace (when copying this message, always include the lines below):

    uild_docker/../contrib/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0x107323d0 in /src/ch/tmp/upstream/clickhouse
    uild_docker/../src/Common/Exception.cpp:39: DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0x74f5085 in /src/ch/tmp/upstream/clickhouse
    uild_docker/../contrib/libcxx/include/string:2134: DB::Exception::Exception<char const*, char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, long&, std::__1::basic_string<char, std::__1::char_traits<char>,
    22:51:36.390667 [ 1853446 ] {} <Trace> BaseDaemon: Received signal 6
    22:51:36.390801 [ 1854585 ] {} <Fatal> BaseDaemon: ########################################
    22:51:36.390827 [ 1854585 ] {} <Fatal> BaseDaemon: (version 20.12.1.5205 (official build), build id: B23CB64BD60D7F4C) (from thread 1853495) (query_id: edae87ee-05b3-4bfa-be51-3f81d25bca2e) Received signal Aborted (6)
    22:51:36.390842 [ 1854585 ] {} <Fatal> BaseDaemon:
    22:51:36.390859 [ 1854585 ] {} <Fatal> BaseDaemon: Stack trace: 0x7ffff7dde615 0x7ffff7dc7862 0x768a37d 0x11aea23c 0x11ad6df1 0x11ad72bc 0x11ad7806 0x11af6657 0x11ae99ea 0x74df512 0x74de86c 0x74dd02c 0x11acf19c 0xd692953 0xd7bf172 0xd7bc031 0xd7b8c11 0xdf37cf9 0xdf38e9e 0x1067a1cb 0x1067a660 0x107bec66 0x107ba3d0 0x7ffff7f843e9 0x7ffff7ea1293
    22:51:36.390888 [ 1854585 ] {} <Fatal> BaseDaemon: 3. raise @ 0x3d615 in /usr/lib/libc-2.32.so
    22:51:36.390900 [ 1854585 ] {} <Fatal> BaseDaemon: 4. __GI_abort @ 0x26862 in /usr/lib/libc-2.32.so
    22:51:36.391618 [ 1854585 ] {} <Fatal> BaseDaemon: 5. /build/build_docker/../src/IO/WriteBuffer.h:46: terminate_handler() (.cold) @ 0x768a37d in /src/ch/tmp/upstream/clickhouse
    22:51:36.392363 [ 1854585 ] {} <Fatal> BaseDaemon: 6. /build/build_docker/../contrib/libcxxabi/src/cxa_handlers.cpp:61: std::__terminate(void (*)()) @ 0x11aea23c in /src/ch/tmp/upstream/clickhouse
    22:51:36.393103 [ 1854585 ] {} <Fatal> BaseDaemon: 7. /build/build_docker/../contrib/libcxxabi/src/cxa_personality.cpp:325: call_terminate @ 0x11ad6df1 in /src/ch/tmp/upstream/clickhouse
    22:51:36.393812 [ 1854585 ] {} <Fatal> BaseDaemon: 8. /build/build_docker/../contrib/libcxxabi/src/cxa_personality.cpp:887: scan_eh_tab @ 0x11ad72bc in /src/ch/tmp/upstream/clickhouse
    22:51:36.394541 [ 1854585 ] {} <Fatal> BaseDaemon: 9. /build/build_docker/../contrib/libcxxabi/src/cxa_personality.cpp:970: __gxx_personality_v0 @ 0x11ad7806 in /src/ch/tmp/upstream/clickhouse
    22:51:36.395265 [ 1854585 ] {} <Fatal> BaseDaemon: 10. /build/obj-x86_64-linux-gnu/../contrib/libunwind/src/UnwindLevel1.c:101: _Unwind_RaiseException @ 0x11af6657 in /src/ch/tmp/upstream/clickhouse
    22:51:36.395979 [ 1854585 ] {} <Fatal> BaseDaemon: 11. /build/build_docker/../contrib/libcxxabi/src/cxa_exception.cpp:151: __cxa_throw @ 0x11ae99ea in /src/ch/tmp/upstream/clickhouse
    22:51:36.396038 [ 1854585 ] {} <Fatal> BaseDaemon: 12. /build/build_docker/../src/Common/MemoryTracker.cpp:171: MemoryTracker::alloc(long) (.cold) @ 0x74df512 in /src/ch/tmp/upstream/clickhouse
    22:51:36.396212 [ 1854585 ] {} <Fatal> BaseDaemon: 13. /build/build_docker/../src/Common/MemoryTracker.cpp:177: MemoryTracker::alloc(long) @ 0x74de86c in /src/ch/tmp/upstream/clickhouse
    22:51:36.396225 [ 1854585 ] {} <Fatal> BaseDaemon: 14. /build/build_docker/../base/common/../common/memory.h:20: operator new(unsigned long) @ 0x74dd02c in /src/ch/tmp/upstream/clickhouse
    22:51:36.396948 [ 1854585 ] {} <Fatal> BaseDaemon: 15. /build/build_docker/../contrib/libcxx/include/string:1495: std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >::basic_string(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) @ 0x11acf19c in /src/ch/tmp/upstream/clickhouse
    22:51:36.397683 [ 1854585 ] {} <Fatal> BaseDaemon: 16. /build/build_docker/../contrib/libcxx/include/list:361: DB::ProcessListEntry::~ProcessListEntry() @ 0xd692953 in /src/ch/tmp/upstream/clickhouse
    22:51:36.399234 [ 1854585 ] {} <Fatal> BaseDaemon: 17. /build/build_docker/../contrib/libcxx/include/memory:3483: std::__1::shared_ptr<DB::ProcessListEntry>::~shared_ptr() @ 0xd7bf172 in /src/ch/tmp/upstream/clickhouse
    22:51:36.400472 [ 1854585 ] {} <Fatal> BaseDaemon: 18. /build/build_docker/../src/Interpreters/executeQuery.cpp:428: DB::executeQueryImpl(char const*, char const*, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool, DB::ReadBuffer*) (.cold) @ 0xd7bc031 in /src/ch/tmp/upstream/clickhouse
    22:51:36.401525 [ 1854585 ] {} <Fatal> BaseDaemon: 19. /build/build_docker/../src/Interpreters/executeQuery.cpp:814: DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) @ 0xd7b8c11 in /src/ch/tmp/upstream/clickhouse
    22:51:36.402887 [ 1854585 ] {} <Fatal> BaseDaemon: 20. /build/build_docker/../src/Server/TCPHandler.cpp:254: DB::TCPHandler::runImpl() @ 0xdf37cf9 in /src/ch/tmp/upstream/clickhouse
    22:51:36.404453 [ 1854585 ] {} <Fatal> BaseDaemon: 21. /build/build_docker/../src/Server/TCPHandler.cpp:1336: DB::TCPHandler::run() @ 0xdf38e9e in /src/ch/tmp/upstream/clickhouse
    22:51:36.405158 [ 1854585 ] {} <Fatal> BaseDaemon: 22. /build/build_docker/../contrib/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x1067a1cb in /src/ch/tmp/upstream/clickhouse
    22:51:36.405918 [ 1854585 ] {} <Fatal> BaseDaemon: 23. /build/build_docker/../contrib/libcxx/include/atomic:856: Poco::Net::TCPServerDispatcher::run() @ 0x1067a660 in /src/ch/tmp/upstream/clickhouse
    22:51:36.406690 [ 1854585 ] {} <Fatal> BaseDaemon: 24. /build/build_docker/../contrib/poco/Foundation/include/Poco/Mutex_POSIX.h:59: Poco::PooledThread::run() @ 0x107bec66 in /src/ch/tmp/upstream/clickhouse
    22:51:36.407413 [ 1854585 ] {} <Fatal> BaseDaemon: 25. /build/build_docker/../contrib/poco/Foundation/include/Poco/AutoPtr.h:215: Poco::ThreadImpl::runnableEntry(void*) @ 0x107ba3d0 in /src/ch/tmp/upstream/clickhouse
    22:51:36.407428 [ 1854585 ] {} <Fatal> BaseDaemon: 26. start_thread @ 0x93e9 in /usr/lib/libpthread-2.32.so
    22:51:36.407436 [ 1854585 ] {} <Fatal> BaseDaemon: 27. clone @ 0x100293 in /usr/lib/libc-2.32.so

But after other patches in this series it wont.
 2020-11-28 11:15:26 +03:00
Alexey Milovidov
7c0138542b Query obfuscator: remove some words 2020-11-28 10:55:15 +03:00
alexey-milovidov
c189f6405f
Merge pull request #16767 from azat/optimize_trivial_count_query-fix 
Fix optimize_trivial_count_query with partition predicate
 2020-11-28 08:43:12 +03:00
alexey-milovidov
62a45e8ff7
Merge pull request #17414 from azat/fix-INSERT-SETTINGS-parsing 
Fix parsing of SETTINGS clause of the INSERT ... SELECT ... SETTINGS query
 2020-11-28 08:38:42 +03:00
alexey-milovidov
7a6c72ce88
Merge pull request #17471 from CurtizJ/fix-order-by-functions 
Fix 'optimize_redundant_functions_in_order_by'
 2020-11-28 08:34:26 +03:00
Alexey Milovidov
44b059c681 Fix bad test 01317_no_password_in_command_line.sh 2020-11-28 08:27:59 +03:00
Nikita Mikhaylov
6f3db7ff50
Merge pull request #17330 from CurtizJ/move-to-prewhere 
Allow to move conditions to prewhere with compact parts
 2020-11-28 02:02:42 +03:00
alesapin
6567796014 Fix kill mutation on concurrent alter queries 2020-11-27 18:46:52 +03:00
Anton Popov
458395dcaf fix test 2020-11-27 17:31:30 +03:00
Anton Popov
601d633690 fix optimize_redundant_functions_in_order_by 2020-11-27 14:29:39 +03:00
Alexander Kuzmenkov
19bdb34b19
Merge pull request #16183 from hexiaoting/dev_replace 
Fix: throw error when column transformer use non-exist column
 2020-11-27 14:09:58 +03:00
Nikolai Kochetov
f3bea2210c Update tests. 2020-11-27 13:55:45 +03:00
Nikolai Kochetov
85283b3944
Merge pull request #17397 from ClickHouse/fix-types-for-read-from-join 
Fix crash while reading from JOIN table with LowCardinality types
 2020-11-27 13:37:05 +03:00
Nikolai Kochetov
60af8219ee
Merge pull request #17439 from ClickHouse/chengxianglibra-dist-agg-issue 
Fix incorrect optimization of distinct
 2020-11-27 13:26:19 +03:00
Nikolai Kochetov
c206b2506b Update tests. 2020-11-27 13:10:09 +03:00
hexiaoting
2523f8f0c6 Merge remote-tracking branch 'origin/master' into dev_replace 2020-11-27 10:51:04 +08:00
alexey-milovidov
572bdb4090
Merge pull request #17423 from ClickHouse/remove-time-series-group-sum 
Remove timeSeriesGroupSum
 2020-11-26 23:07:46 +03:00
Azat Khuzhin
838596c7a4 Implement countSubstrings() 
Function to count number of substring occurrences in the string:
- in case of needle is multi char - counts non-intersecting substrings
- the code is based on position helpers.

The following new functions is available:
- countSubstrings()
- countSubstringsCaseInsensitive()
- countSubstringsCaseInsensitiveUTF8()

v0: substringCount()

v2:
- add substringCountCaseInsensitiveUTF8
- improve tests
- fix coding style issues
- fix multichar needle

v3: rename to countSubstrings (by analogy with countEqual())
 2020-11-26 22:58:16 +03:00
alexey-milovidov
1cd09fa367
Merge pull request #15127 from ucasFL/add-mutation-for-storagememory 
Add mutation support for StorageMemory
 2020-11-26 22:22:59 +03:00
Nikolai Kochetov
9291bbb04b
Merge pull request #16804 from vdimir/ip-dict-no-trie 
sorted-array based ip_dict
 2020-11-26 19:26:06 +03:00
Alexander Kuzmenkov
15a0f14445
Merge pull request #15419 from myrrc/improvement/diff-types-in-avg-weighted 
Allow different types in avgWeighted. Allow avg and avgWeighed to operate on extended integral types.
 2020-11-26 17:16:48 +03:00
alesapin
90bddce5ed
Merge pull request #17410 from ClickHouse/test_mutation_for_empty_partitions 
Add test for mutation with empty partition
 2020-11-26 16:42:43 +03:00
Nikita Mikhaylov
084c75fa6e
Merge pull request #17309 from nikitamikhaylov/merging-sequential-consistency 
Merging #16309
 2020-11-26 15:26:05 +03:00
Nikita Mikhaylov
adb82649c4
Merge pull request #16883 from nikitamikhaylov/refactor-rank-corr 
mannWhitneyUTest + studentTTest + welchTTest + small rankCorr refactor
 2020-11-26 15:17:18 +03:00
Nikolai Kochetov
83f2fc3d9c Update test. 2020-11-26 12:51:55 +03:00
hexiaoting
5b3a7f5c98 Merge remote-tracking branch 'origin/master' into dev_map2 2020-11-26 16:43:27 +08:00
Nikolai Kochetov
42399e8866 Merge branch 'dist-agg-issue' of https://github.com/chengxianglibra/ClickHouse into chengxianglibra-dist-agg-issue 2020-11-26 11:35:47 +03:00
Amos Bird
022ba2b0a9
Fix unmatched type comparison in KeyCondition 2020-11-26 16:15:50 +08:00
alexey-milovidov
ee3a0b790b
Merge pull request #17376 from azat/toUnixTimestamp-Date-fix 
Prohibit toUnixTimestamp(Date())
 2020-11-26 10:50:00 +03:00
hexiaoting
74d875c837 Merge remote-tracking branch 'origin/master' into dev_map2 2020-11-26 15:13:52 +08:00
alexey-milovidov
747453b008
Merge pull request #17051 from hexiaoting/bugfix_fuzzbits 
Bug fix for funciton fuzzBits
 2020-11-26 06:41:20 +03:00
Alexey Milovidov
85d3e62275 Remove timeSeriesGroupSum 2020-11-26 05:46:28 +03:00
alexey-milovidov
fb3a69b298
Merge pull request #17254 from azat/fix-dist-query-cancelation 
Fix "Unexpected packet Data received from client"  for Distributed queries
 2020-11-26 03:46:27 +03:00
alexey-milovidov
c438b43892
Merge pull request #17375 from ClickHouse/always-working-test 
Added a test for what was always working
 2020-11-26 03:29:14 +03:00
Nikita Mikhaylov
ede023a237
rerun tests to be sure 2020-11-26 01:24:42 +03:00
Alexander Kuzmenkov
394b81ac46 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-25 23:38:55 +03:00
Azat Khuzhin
0b47f4a9e9 Fix optimize_trivial_count_query with partition predicate 
Consider the following example:

    CREATE TABLE test(p DateTime, k int) ENGINE MergeTree PARTITION BY toDate(p) ORDER BY k;
    INSERT INTO test VALUES ('2020-09-01 00:01:02', 1), ('2020-09-01 20:01:03', 2), ('2020-09-02 00:01:03', 3);

- SELECT count() FROM test WHERE toDate(p) >= '2020-09-01' AND p <= '2020-09-01 00:00:00'
  In this case rpn will be (FUNCTION_IN_RANGE, FUNCTION_UNKNOWN (due to strict), FUNCTION_AND)
  and for optimize_trivial_count_query we cannot use index if there is at least one FUNCTION_UNKNOWN.
  since there is no post processing and return count() based on only the first predicate is wrong.

  Before this patch FUNCTION_UNKNOWN was allowed for optimize_trivial_count_query, and the result was wrong.

And two examples above just to show the difference, the behaviour hadn't been changed with this patch:

- SELECT * FROM test WHERE toDate(p) >= '2020-09-01' AND p <= '2020-09-01 00:00:00'
  In this case will be (FUNCTION_IN_RANGE, FUNCTION_IN_RANGE (due to non-strict), FUNCTION_AND)
  so it will prune everything out and nothing will be read.

- SELECT * FROM test WHERE toDate(p) >= '2020-09-01' AND toUnixTimestamp(p)%5==0
  In this case will be (FUNCTION_IN_RANGE, FUNCTION_UNKNOWN, FUNCTION_AND)
  and all, two, partitions will be scanned, but due to filtering later none of rows will be matched.
 2020-11-25 23:09:17 +03:00
Azat Khuzhin
32f69dc76f Cleanup 01505_trivial_count_with_partition_predicate 2020-11-25 23:09:17 +03:00
Nikolai Kochetov
729272391f
Merge branch 'master' into ip-dict-no-trie 2020-11-25 23:07:19 +03:00
Nikolai Kochetov
99f1151236
Update arcadia_skip_list.txt 2020-11-25 23:06:37 +03:00
Azat Khuzhin
3f67e320dd Fix parsing of SETTINGS clause of the INSERT ... SELECT ... SETTINGS query 
Before this patch the following query ignores the settings for INSERT:

   insert into test_parallel_insert select * from numbers_mt(65535*2) settings max_insert_threads=10

And the reason is that SETTINGS was parsed by the SELECT parser.
Fix this by push down the SETTINGS from the SELECT to INSERT.

Also note that since INSERT parser does not use ParserQueryWithOutput the
following works:

   insert into test_parallel_insert select * from numbers_mt(65535*2) format Null settings max_insert_threads=10
 2020-11-25 22:53:58 +03:00
nikitamikhaylov
44f4064e9b update test 2020-11-25 20:51:07 +03:00
nikitamikhaylov
02a80230f8 remove comments 2020-11-25 20:51:07 +03:00
nikitamikhaylov
71d6126c6b better 2020-11-25 20:51:07 +03:00
nikitamikhaylov
4246971961 fix tests 2020-11-25 20:51:07 +03:00
nikitamikhaylov
de9dc3a43f update copy pasted test 2020-11-25 20:51:06 +03:00
nikitamikhaylov
f764332070 better merge 2020-11-25 20:51:06 +03:00
nikitamikhaylov
3f874af323 new interface for the function 
(cherry picked from commit 89547e77cf)
 2020-11-25 20:51:06 +03:00
nikitamikhaylov
9177ba3c02 test added 2020-11-25 20:51:06 +03:00
nikitamikhaylov
13081370ba mann-whitney 2020-11-25 20:51:06 +03:00
nikitamikhaylov
9afe579225 small refactor 2020-11-25 20:51:06 +03:00
alesapin
68c8219edf Add test for mutation with empty partition 2020-11-25 18:13:27 +03:00
alesapin
dd4c5bdeb9
Merge pull request #17249 from amosbird/insub 
Fix const column in set index.
 2020-11-25 17:05:23 +03:00
Nikolai Kochetov
8e5f7acd07 Added test. 2020-11-25 16:34:07 +03:00
Alexander Kuzmenkov
edce1e636e
Merge pull request #16535 from ClickHouse/aku/opentelemetry 
OpenTelemetry improvements
 2020-11-25 14:10:17 +03:00
myrrc
1a9c313529 fix test reference 2020-11-25 12:19:19 +03:00
alesapin
3e1b2f515b
Merge pull request #17311 from ClickHouse/fix_integration_tests 
Fix some flaky tests
 2020-11-25 10:09:27 +03:00
Azat Khuzhin
9649b96bbb Update expectations for toUnixTimestamp(Date()) in 00921_datetime64_compatibility 2020-11-25 07:42:36 +03:00
Azat Khuzhin
17f6c82ffa Prohibit toUnixTimestamp(Date()) 
Making it implicitly cast to Date() does not looks correct, since before
it returns somewhat unexpected result:

    SELECT toUnixTimestamp(today())

    ┌─toUnixTimestamp(today())─┐
    │                    18591 │
    └──────────────────────────┘
 2020-11-25 00:26:14 +03:00
Alexey Milovidov
99073c26ee Added a test for what was always working 2020-11-25 00:00:55 +03:00
Alexander Kuzmenkov
1d7dcef4a0 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-24 21:45:10 +03:00
Alexander Kuzmenkov
1d6558f694 not sure what's going on 2020-11-24 21:45:01 +03:00
Anton Popov
f2106f9683 add test 2020-11-24 20:41:11 +03:00
Amos Bird
6b4512809c
Fix const column in set index. 2020-11-24 22:31:59 +08:00
Alexander Kuzmenkov
9b0368ffa5
Merge pull request #16338 from ucasFL/union-distinct 
Add UNION DISTINCT and setting `union_default_mode`
 2020-11-24 17:30:24 +03:00
myrrc
420f2489a7 fixed decimal scales calc, updated the tests 2020-11-24 17:07:59 +03:00
Anton Popov
4e07681444 remove outdated test 2020-11-24 16:30:52 +03:00
myrrc
fbb0e6e6aa Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted 2020-11-24 16:04:17 +03:00
Anton Popov
6e1a9240e1
Merge branch 'master' into fix-groupby-optimization 2020-11-24 15:24:07 +03:00
Anton Popov
ff36dee2ec move test to bugs 2020-11-24 15:22:13 +03:00
Nikita Mikhaylov
6787f98476
Merge pull request #14958 from nikitamikhaylov/refactor_cache_dictionary 
Refactor cache dictionary
 2020-11-24 14:55:02 +03:00
nikitamikhaylov
5be300ff22 Merge branch 'master' of github.com:ClickHouse/ClickHouse into merging-sequential-consistency 2020-11-24 14:46:57 +03:00
Anton Popov
2fb8717dfd
Merge pull request #17253 from amosbird/globalinfix 
global in set index.
 2020-11-24 03:06:00 +03:00
alesapin
3d177d414a Merge branch 'master' into fix_integration_tests 2020-11-23 23:27:46 +03:00
Anton Popov
852a08eacb allow to move conditions to prewhere with compact parts 2020-11-23 21:27:59 +03:00
Alexander Kuzmenkov
234bd09044 debug an unreproducible test failure 2020-11-23 20:48:00 +03:00
Alexander Kuzmenkov
412c2fe079 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-23 19:51:18 +03:00
alesapin
eb9b3e6737 Less global queries in functional tests 2020-11-23 17:57:46 +03:00
nikitamikhaylov
065cd00257 better 2020-11-23 17:24:32 +03:00
Amos Bird
172b7e9ed1
global in set index. 2020-11-23 22:05:08 +08:00
feng lv
005f345139 Merge branch 'master' of github.com:ClickHouse/ClickHouse into add-mutation-for-storagememory 2020-11-23 13:56:19 +00:00
nikitamikhaylov
68bef22fda Merge branch 'master' of github.com:ClickHouse/ClickHouse into merging-sequential-consistency 2020-11-23 16:28:35 +03:00
alexey-milovidov
f38db2d421
Update 01560_merge_distributed_join.sql 2020-11-23 12:51:59 +03:00
Alexey Milovidov
9969a73d50 Merge branch 'master' into azat-merge-distributed-join-fix 2020-11-23 12:43:15 +03:00
Alexey Milovidov
ed679d8edb Better test 2020-11-23 12:38:03 +03:00
Alexey Milovidov
24710046c3 Arcadia does not support distributed tests 2020-11-23 12:34:23 +03:00
Alexey Milovidov
b10283f8d5 Add a test for #13990 2020-11-23 12:32:57 +03:00
lichengxiang
fdde2d1e8a fix #17294: Distinct on subquery with group by may return duplicate result 2020-11-23 17:06:59 +08:00
feng lv
18491d8920 fix 2020-11-23 05:30:36 +00:00
Alexey Milovidov
fbbf439338 Merge branch 'master' into Enmk-DateTime64_fixes_comparison 2020-11-23 05:46:17 +03:00
zhang2014
213c7639b7 ISSUES-17244 try fix deterministic functions with predicate optimizer 2020-11-22 22:17:09 +08:00
alexey-milovidov
1663b13215
Merge pull request #17257 from ucasFL/fix 
fix toUInt256 stack overflow
 2020-11-21 22:54:06 +03:00
fenglv
268b15f221 fix toUInt256 stack overflow 2020-11-21 12:59:40 +00:00
Azat Khuzhin
ee4267c1ba Rename 01247_optimize_distributed_group_by_sharding_key to distingiush it 
Otherwise flaky tests will run then both, not a problem, but this is
just to trigger flaky check, since there is some tricky issue [1]:

    2020-11-20 00:35:51 01247_optimize_distributed_group_by_sharding_key:                       [ FAIL ] 0.67 sec. - return code 101
    2020-11-20 00:35:51 Received exception from server (version 20.12.1):
    2020-11-20 00:35:51 Code: 101. DB::Exception: Received from localhost:9000. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Unexpected packet Data received from client.

  [1]: https://clickhouse-test-reports.s3.yandex.net/16996/8d71564056925df1415880f382aaa169cbdf37b0/functional_stateless_tests_flaky_check_(address)/test_run.txt.out.log
 2020-11-21 13:32:17 +03:00
Nikolai Kochetov
bac1def5f9
Merge pull request #17134 from abyss7/tcp-port 
Implement tcpPort() function for tests
 2020-11-20 20:32:55 +03:00
Pavel Kruglov
ca3fe49a2a Make setting global 2020-11-20 17:29:13 +03:00
Alexander Kuzmenkov
b05ac888bd Merge remote-tracking branch 'origin/master' into HEAD 2020-11-20 12:50:08 +03:00
Alexander Kuzmenkov
bde805cb3e
Merge pull request #17175 from ClickHouse/aku/named-tuple 
Allow formatting named tuples as JSON objects
 2020-11-20 12:48:24 +03:00
Nikolai Kochetov
31886fdca6
Merge pull request #16811 from amosbird/pf2 
Fix verbatim partition pruner.
 2020-11-20 12:07:33 +03:00
Kruglov Pavel
51bcd286f2
Merge pull request #16845 from azat/cutToFirstSignificantSubdomainWithWWW 
Add cutToFirstSignificantSubdomainWithWWW()
 2020-11-20 01:44:57 +03:00
Pavel Kruglov
3ee4972586 Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize-data-on-insert 2020-11-20 01:23:51 +03:00
vdimir
36544a45b7
Merge remote-tracking branch 'upstream/master' into ip-dict-no-trie 2020-11-19 18:56:24 +03:00
alesapin
2623d35f68
Merge pull request #17120 from ClickHouse/fix_granularity_on_block_borders 
Fix index granularity calculation on block borders
 2020-11-19 18:36:07 +03:00
Alexander Kuzmenkov
f326536ef0 fixup 2020-11-19 15:30:44 +03:00
Alexander Kuzmenkov
bcf15170ed Merge remote-tracking branch 'origin/master' into HEAD 2020-11-19 15:29:51 +03:00
Alexander Kuzmenkov
24293ccb30 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-19 15:28:37 +03:00
Alexander Kuzmenkov
f2b4c15ab0
Merge pull request #17152 from ClickHouse/aku/json-array 
Write rows as JSON array in JSONEachRow output format
 2020-11-19 15:27:31 +03:00
Nikolai Kochetov
8a9792cd30
Merge branch 'master' into pf2 2020-11-19 12:01:15 +03:00
alesapin
978e577b0f
Merge pull request #16424 from filimonov/execute_merges_on_single_replica_v2 
execute_merges_on_single_replica
 2020-11-19 10:15:52 +03:00
alexey-milovidov
c7e88087cd
Merge pull request #16636 from hombit/cmath 
Add some of missed cmath functions
 2020-11-19 07:37:27 +03:00
alexey-milovidov
29bfb5a518
Merge pull request #16997 from vdimir/source-clickhouse-usability 
source(clickhouse(...)) usability
 2020-11-19 07:37:00 +03:00
alexey-milovidov
5aff81b8b8
Merge pull request #17135 from amosbird/ccc 
Fix ColumnConst comparison.
 2020-11-19 07:36:41 +03:00
Azat Khuzhin
4a77a42f34 Test for Merge(Distributed()) with JOIN 2020-11-18 23:53:31 +03:00
alesapin
d11c547ec2 Merge branch 'master' into fix_granularity_on_block_borders 2020-11-18 23:36:45 +03:00
Azat Khuzhin
48645eae33 Add cutToFirstSignificantSubdomainWithWWW() 
Sometimes it is odd to get TLD itself from the
cutToFirstSignificantSubdomain() (since you will not get TLD itself if
you pass it directly):
- cutToFirstSignificantSubdomain('org')            -> ""
- cutToFirstSignificantSubdomain('www.org')        -> org
- cutToFirstSignificantSubdomain('kernel.org')     -> kernel.org
- cutToFirstSignificantSubdomain('www.kernel.org') -> kernel.org

So add one more function to get www.org in this case:
- cutToFirstSignificantSubdomainWithWWW('org')            -> ""
- cutToFirstSignificantSubdomainWithWWW('www.org')        -> www.org
- cutToFirstSignificantSubdomainWithWWW('kernel.org')     -> kernel.org
- cutToFirstSignificantSubdomainWithWWW('www.kernel.org') -> kernel.org

P.S. not sure about the naming though, so it will great if someone has
suggestion for the name.
 2020-11-18 21:09:27 +03:00
Alexander Kuzmenkov
1570320e20 fixes for context hierarchy 2020-11-18 20:43:18 +03:00
Ivan Lezhankin
fdd1c182ab Merge remote-tracking branch 'upstream/master' into tcp-port 2020-11-18 16:22:00 +03:00
alesapin
7080f424e2 Fix bug for skip indices and make code more complex 2020-11-18 15:04:13 +03:00
Pavel Kruglov
cc1b16ea81 Fix test 2020-11-18 13:40:58 +03:00
Alexander Kuzmenkov
f2b3f5f8b6 Allow formatting named tuples as JSON objects 2020-11-18 13:38:30 +03:00
Pavel Kruglov
547ec19fb3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize-data-on-insert 2020-11-18 12:01:59 +03:00
Mikhail Filimonov
97fef77ed1
execute_merges_on_single_replica 2020-11-18 08:45:33 +01:00
Alexey Milovidov
26d7795221 Merge branch 'master' into amosbird-ccc 2020-11-18 07:42:45 +03:00
Alexander Kuzmenkov
b16c5a1748 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-17 22:54:54 +03:00
Alexander Kuzmenkov
51f9d54d10 test 2020-11-17 22:51:45 +03:00
Alexander Kuzmenkov
a8f29f7da6 make it a setting and not a format 2020-11-17 22:45:17 +03:00
Pavel Kruglov
4ed7657008 fix typo 2020-11-17 22:07:19 +03:00
Alexander Kuzmenkov
2bd6584636 JSONArray fixes 2020-11-17 21:33:54 +03:00
Pavel Kruglov
53b8ff42c2 Add test and set setting to 0 in some other tests 2020-11-17 19:56:36 +03:00
Konstantin Malanchev
07f65b852c Fix tests 2020-11-17 17:48:16 +01:00
a.palagashvili
6f5390cc70 introduce zstd compression 2020-11-17 19:02:10 +03:00
Nikita Mikhaylov
68b6f08e36
Merge pull request #16721 from nikitamikhaylov/parsing-constraints 
Turn off parallel parsing when memory limit is small.
 2020-11-17 17:37:14 +03:00
Amos Bird
f24cf46db5
Fix ColumnConst comparison. 2020-11-17 22:14:31 +08:00
nikitamikhaylov
c7ebcf9c7c arcadia skip 2020-11-17 16:59:12 +03:00