thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-30 19:42:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
88,495 Commits 9,190 Branches 1,782 Tags 2.2 GiB
f4bae3969d
Commit Graph

17543 Commits

Author SHA1 Message Date
Alexey Milovidov
9fb1d92ff5
Merge pull request #36707 from CurtizJ/fix-vertical-merges 
Fix vertical merges in wide parts
 2022-04-29 10:09:50 +03:00
Alexey Milovidov
73b451160d
Merge pull request #36769 from ClickHouse/fix-performance-test 
Fix performance test
 2022-04-29 08:19:27 +03:00
Azat Khuzhin
bf312c2a5b Fix ALTER DROP COLUMN of nested column with compact parts 
ALTER DROP COLUMN of nested column did not requires mutation before, and
so it leaves nested column as-is, and in case of compact parts
subsequent alter, that requires mutation, will trigger READ_COLUMN of
that nested column (because it exists in part), but it will fail because
there is no such column in the table already.

Here is example of such a failure on CI - [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/35459/52099b23a1cb9a7ff036c5c60aa037c999b333ef/stateless_tests__thread__actions__[1/3].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-29 07:12:34 +03:00
Azat Khuzhin
3931dbd848 Implement partial GROUP BY key for optimize_aggregation_in_order 
Suppose you have a table with lots of rows, like:

    create table data_02233 (parent_key Int, child_key Int, value Int) engine=MergeTree() order by parent_key

And you want to do GROUP BY (parent_key, child_key) with optimize_aggregation_in_order:

    select parent_key, child_key, count() from data_02233 group by parent_key, child_key with totals order by parent_key, child_key

Right now, it is not possible, because optimize_aggregation_in_order
supports only w/o key aggregation, i.e. GROUP BY cannot be done inside
unique parent_key region.

v2: rebase on top SortDescriptionWithPositions
v3: disable two-level aggregation
v4: fix merging of aggregates
v5: improve tests coverage (add a test with multiple parts, to add merge processor)
v6: add a test for compiled aggregate functions (sum()) explicitly
v7: add missing sortBlock()
v8: remove group_by_description_optimized
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-29 06:58:07 +03:00
zhangyifan27
318212a929 reformat py 2022-04-29 11:00:54 +08:00
Alexey Milovidov
b1fa88c821
Merge pull request #36767 from azat/clickhouse-test-compat 
Fix clickhouse-test for server without `is_all_data_sent` in system.processes
 2022-04-29 05:42:05 +03:00
Alexey Milovidov
df45c9503d Trim down some tests 2022-04-29 04:33:12 +02:00
Alexey Milovidov
31215f874c Fix slow performance test 2022-04-29 04:29:06 +02:00
Amos Bird
e81929a8b5
Saturate date/datetime to zero (part 2) 
For partial hours/minutes timezones.
 2022-04-29 10:24:18 +08:00
Alexey Milovidov
bf100e0a4c Remove "partial merge join" performance test, because we are not interested in the results 2022-04-29 04:13:30 +02:00
zhangyifan27
2257e57aa5 fix groupBitmapAndState on distributed table 2022-04-29 08:09:00 +08:00
kssenii
c31aae0ef4 Update test 2022-04-29 01:17:11 +02:00
Kseniia Sumarokova
2f64255415
Merge pull request #36743 from ClickHouse/kssenii-patch-3 
Update 00170_s3_cache.sql
 2022-04-29 00:03:39 +02:00
Azat Khuzhin
287c098c7e Fix clickhouse-test for server w/o is_all_data_sent in system.processes 2022-04-28 23:19:21 +03:00
Maksim Kita
55994afe0c Fix evaluateConstantExpression for subqueries 2022-04-28 22:09:29 +02:00
Alexander Tokmakov
6797e7dc76 fix flaky test 2022-04-28 21:39:45 +02:00
Anton Popov
1fc51e09ff fix insertion to column of type Object from multiple files via table function 2022-04-28 18:51:13 +00:00
mergify[bot]
99279b2d7b
Merge branch 'master' into clickhouse-dictionary-context-copy 2022-04-28 18:05:08 +00:00
mergify[bot]
20e2fa9b3f
Merge branch 'master' into dynamic-columns-9 2022-04-28 17:53:03 +00:00
Anton Popov
5ff11a431d
Update 01825_type_json_bools.sql 2022-04-28 19:28:00 +02:00
Alexey Milovidov
d8fa806fca
Merge pull request #36360 from ClickHouse/optimize-asynchronous-metric-log 
Optimize `system.asynchronous_metric_log`
 2022-04-28 20:16:17 +03:00
Alexander Tokmakov
4f54fadd2c
Update clickhouse-test 2022-04-28 20:16:01 +03:00
Yakov Olkhovskiy
7001489095
Merge pull request #36633 from ucasfl/fix-crash 
Fix format crash when default expression follow EPHEMERAL not literal
 2022-04-28 12:38:43 -04:00
alesapin
db9cb4cf09
Merge pull request #36736 from ClickHouse/keeper-id-guards 
Add an extra check for RAFT config change
 2022-04-28 18:22:39 +02:00
Vadim Volodin
233f0b4b52 Handle cluster macro in s3Cluster table function 2022-04-28 18:38:17 +03:00
Anton Popov
54f074e104 deduce UInt8 type for bools from json instead of UInt64 2022-04-28 15:30:43 +00:00
mergify[bot]
d96c9c5cff
Merge branch 'master' into fix-timeouts 2022-04-28 15:03:19 +00:00
avogar
d295de1689 Fix comments and test 2022-04-28 14:59:35 +00:00
Mikhail f. Shiryaev
0a131b41ea
Improve release.py 
- Improve check-dirty
- Prefetch target branches
- Prefetch release commit
- Simplify check_branch
 2022-04-28 16:55:02 +02:00
Kseniia Sumarokova
5c69e0e1c2
Update 00170_s3_cache.reference 2022-04-28 16:41:23 +02:00
Kseniia Sumarokova
f0ce3337d4
Fix reference 2022-04-28 16:40:23 +02:00
mergify[bot]
1d73e6c824
Merge branch 'master' into kssenii-patch-3 2022-04-28 14:37:05 +00:00
Meena Renganathan
ccd6f5a572 Merge branch 'master' of https://github.com/DevTeamBK/ClickHouse into FIPS_compliance 2022-04-28 07:33:12 -07:00
Alexander Tokmakov
07925ae309
Update clickhouse-test 2022-04-28 17:29:53 +03:00
wuxiaobai24
82a053dbb5 Merge remote-tracking branch 'upstream/master' into file_descriptor 2022-04-28 22:23:25 +08:00
Kruglov Pavel
4d08587559
Merge branch 'master' into mysqldump-format 2022-04-28 15:58:18 +02:00
Meena Renganathan
bdaf5391cf Merge branch 'master' of https://github.com/DevTeamBK/ClickHouse into FIPS_compliance 2022-04-28 06:15:46 -07:00
avogar
81f85892eb Fix bug in receive timeouts in Hedged requests 2022-04-28 13:10:27 +00:00
zhanglistar
7d798b3655
Count distinct optimization by using subquery of group by (#35993) 2022-04-28 14:55:37 +02:00
Maksim Kita
c4d98aaa4c ClickHouseDictionarySource context copy 2022-04-28 14:16:49 +02:00
Maksim Kita
fa1579cdd5
Merge pull request #36390 from lthaooo/fix_dictionary_reload_bug 
fix dictionary reload bug
 2022-04-28 13:37:34 +02:00
Kseniia Sumarokova
558aecc48b
Update 00170_s3_cache.sql 2022-04-28 13:34:05 +02:00
Kseniia Sumarokova
b100ca4b17
Merge pull request #36710 from azat/client-wait-insert 
Properly cancel INSERT queries in clickhouse-client
 2022-04-28 13:19:26 +02:00
Kseniia Sumarokova
d5a7177bb1
Merge pull request #36658 from kssenii/follow-up 
Fix formatting in drop cache system query
 2022-04-28 13:12:16 +02:00
Vladimir C
1cbdc1ef3a
Merge pull request #36206 from vdimir/output-format-prometheus 2022-04-28 12:09:53 +02:00
alesapin
8f1a0f6625
Merge pull request #36258 from ClickHouse/keeper-recovery-mode 
clickhouse-keeper support for force recovery
 2022-04-28 11:20:59 +02:00
alesapin
af980ef4ef
Merge pull request #36371 from Joeywzr/add_query_level_settingss 
Add query level settings: parts_to_delay_insert and parts_to_throw_insert
 2022-04-28 11:08:14 +02:00
Antonio Andelic
44ff5f1697 Add some checks for endpoint change 2022-04-28 08:54:05 +00:00
Vitaly Baranov
641a5f5e35
Merge pull request #36198 from vitlibar/backup-improvements-3 
Backup for replicated tables and other improvements
 2022-04-28 09:23:53 +02:00
Alexey Milovidov
fa77778c3a Fix "black" 2022-04-28 05:30:14 +02:00
Azat Khuzhin
66ac7f2552 tests: fix 02015_async_inserts_stress_long flakiness 2022-04-28 06:17:51 +03:00
Alexey Milovidov
de3a47c67a Merge branch 'master' into optimize-asynchronous-metric-log 2022-04-28 05:03:57 +02:00
wuxiaobai24
7955eb2100 Merge remote-tracking branch 'upstream/master' into file_descriptor 2022-04-28 10:47:59 +08:00
Alexey Milovidov
b60c19e05c
Merge pull request #36613 from rschu1ze/clang-tidy-cleanup 
Cleanup clang-tidy integration.
 2022-04-28 05:04:50 +03:00
mergify[bot]
b7e63154df
Merge branch 'master' into optimize-asynchronous-metric-log 2022-04-27 18:27:27 +00:00
Azat Khuzhin
22189b0a5a Properly cancel INSERT queries in clickhouse-client 
This will also fix issues like queries left after the test, like in [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/36686/042cf0c76444e8738eb2481ae21a135f05b4c990/stateless_tests__debug__actions__[2/3]/runlog.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-27 20:00:27 +03:00
Meena Renganathan
98543a9a3f Removed the tests aes-192-cfb128 and aes-256-cfb128 since the latest boringssl modules doesn't support 2022-04-27 07:48:43 -07:00
Anton Popov
eb810116a4 fix vertical merges in wide parts 2022-04-27 13:42:47 +00:00
terrylin
2697417a2b add test case 2022-04-27 20:35:20 +08:00
Antonio Andelic
3210d76300 Use correct nodes in test_keeper_znode_time 2022-04-27 11:29:27 +00:00
mergify[bot]
afd82a68f9
Merge branch 'master' into clang-tidy-cleanup 2022-04-27 02:30:02 +00:00
Alexey Milovidov
b8a9f1411a
Merge pull request #36649 from azat/system.processes-is_all_data_sent 
clickhouse-test: improve left queries after the test hardening
 2022-04-27 05:21:22 +03:00
lgbo-ustc
520b05b9f1 update test case tests/queries/0_stateless/02236_explain_pipeline_join.sql 2022-04-27 10:08:22 +08:00
lgbo-ustc
0c0d4f14da update test case 02236_explain_pipeline_join 2022-04-27 09:27:49 +08:00
Alexey Milovidov
acea30ffbf
Merge pull request #36669 from ClickHouse/kssenii-patch-3 
Update 00170_s3_cache.sql
 2022-04-27 03:48:00 +03:00
Alexey Milovidov
5355ba78b3
Merge pull request #36585 from azat/22.4-tests-fixes 
Simplify 01834_alias_columns_laziness_filimonov test
 2022-04-27 03:47:34 +03:00
Vitaly Baranov
a8e924caf6 Make BACKUP & RESTORE synchronous by default. 2022-04-26 18:45:39 +02:00
vdimir
d5d98ed951
PrometheusTextOutputFormat: support lables, histograms and summaries 2022-04-26 14:57:36 +00:00
vdimir
be0aa06958
Add output format Prometheus 2022-04-26 14:57:35 +00:00
Alexander Gololobov
3c000b098a
Merge pull request #36638 from nickitat/fix_sorting_step 
Fix SortingStep::updateOutputStream()
 2022-04-26 15:49:49 +02:00
Kruglov Pavel
89892cb652
Update 00061_merge_tree_alter.sql 2022-04-26 15:46:25 +02:00
Vladimir C
ca7ba0a198
Merge pull request #36537 from Joeywzr/add_bin_tests 
Add function bin tests for Int/UInt128/UInt256
 2022-04-26 14:49:19 +02:00
Alexander Tokmakov
32f4565def
Merge pull request #36642 from ClickHouse/fix_settings_in_create_query 
Fix parsing of settings in create query
 2022-04-26 15:22:12 +03:00
Kseniia Sumarokova
5198eec6f7
Update 00170_s3_cache.sql 2022-04-26 13:58:35 +02:00
alesapin
57dd5d03d9
Merge pull request #36652 from amosbird/fixunstabletest1 
Fix flaky test
 2022-04-26 13:33:14 +02:00
Vitaly Baranov
a89ef54c69 Fix tests and compilation. 2022-04-26 13:32:23 +02:00
lgbo-ustc
6cb7b7888f update test case 02236_explain_pipeline_join 2022-04-26 19:07:07 +08:00
avogar
33d845dade Add MySQLDump input format 2022-04-26 10:42:56 +00:00
Alexander Tokmakov
190becdcc3
Merge pull request #36644 from ClickHouse/fix_some_flaky_tests 
Fix some flaky tests
 2022-04-26 13:40:14 +03:00
Anton Popov
17bb7f175b
Merge pull request #36544 from CurtizJ/tuple-numeric-identifiers 
Allow names of tuple elements that start from digits
 2022-04-26 12:22:03 +02:00
Alexander Tokmakov
bd1f12e5d5
Update 02180_group_by_lowcardinality.sql 2022-04-26 13:04:19 +03:00
Nikita Mikhaylov
7d95051d32
Fixed integer overflow in toStartOfInterval (#36546) 2022-04-26 11:44:57 +02:00
kssenii
c502a14404 Fix 2022-04-26 11:26:20 +02:00
Kseniia Sumarokova
81db081b88
Merge pull request #36639 from kssenii/better-drop-cache 
Improve drop cache query
 2022-04-26 11:25:46 +02:00
Azat Khuzhin
87421d81ce tests: use TSVRaw format in 02117_show_create_table_system 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-26 12:15:00 +03:00
Azat Khuzhin
b6f127c977 tests: fix system.processes definition in 02117_show_create_table_system 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-26 12:15:00 +03:00
Azat Khuzhin
c2c8b5cd7e clickhouse-test: improve left queries after the test hardening 
Right now it is possible to have "false-positive" for this hardening,
because there is a tiny delay (that can be quite significant on CI, when
it is under pressure) between when the server sends EndOfStream and the
server removes an entry from system.processes.

But now system.processes has is_all_data_sent column, that means that
the EndOfStream was sent, and we can use it to avoid false positive.

Here is an example of such report [1]:

    2022-04-25 03:47:18 00806_alter_update:                                                     [ FAIL ] 0.95 sec. - Queries left in background after the test finished:
    2022-04-25 03:47:18         "elapsed": 0.100084746,
    2022-04-25 03:47:18         "is_cancelled": 0,
    2022-04-25 03:47:18         "query": "DROP TABLE alter_update_00806;",
    2022-04-25 03:47:18         "thread_ids": [
    2022-04-25 03:47:18             "8950"
    2022-04-25 03:47:18         ],

    2022.04.25 03:47:17.887095 [ 8950 ] {7c062004-4c22-486c-934a-f405846e2c81} <Debug> executeQuery: (from [::1]:52012) (comment: 00806_alter_update.sql) DROP TABLE alter_update_00806;
    2022.04.25 03:47:17.887493 [ 8950 ] {7c062004-4c22-486c-934a-f405846e2c81} <Trace> ContextAccess (default): Access granted: DROP TABLE ON test_7ntsjn.alter_update_00806
    2022.04.25 03:47:17.887765 [ 8950 ] {7c062004-4c22-486c-934a-f405846e2c81} <Trace> test_7ntsjn.alter_update_00806 (1bc92bca-10a7-444e-be5e-7f61f4650169): Found 2 old parts to remove.
    2022.04.25 03:47:17.887947 [ 8950 ] {7c062004-4c22-486c-934a-f405846e2c81} <Debug> test_7ntsjn.alter_update_00806 (1bc92bca-10a7-444e-be5e-7f61f4650169): Removing part from filesystem 20180101_20180101_1_1_0
    2022.04.25 03:47:17.888960 [ 8950 ] {7c062004-4c22-486c-934a-f405846e2c81} <Debug> test_7ntsjn.alter_update_00806 (1bc92bca-10a7-444e-be5e-7f61f4650169): Removing part from filesystem 20180102_20180102_2_2_0
    2022.04.25 03:47:17.890620 [ 8950 ] {7c062004-4c22-486c-934a-f405846e2c81} <Debug> DatabaseCatalog: Waiting for table 1bc92bca-10a7-444e-be5e-7f61f4650169 to be finally dropped
    2022.04.25 03:47:17.895046 [ 8950 ] {7c062004-4c22-486c-934a-f405846e2c81} <Debug> MemoryTracker: Peak memory usage (for query): 0.00 B.
    ...
    2022.04.25 03:47:17.938328 [ 4422 ] {aa01985a-78f5-4c0e-b646-8d04a4a1dc77} <Debug> executeQuery: (from [::1]:59416) (comment: 00806_alter_update.sql) DROP DATABASE test_7ntsjn
    2022.04.25 03:47:17.938667 [ 4422 ] {aa01985a-78f5-4c0e-b646-8d04a4a1dc77} <Trace> ContextAccess (default): Access granted: DROP DATABASE ON test_7ntsjn.*
    ...
    2022.04.25 03:47:18.154847 [ 8950 ] {} <Debug> TCPHandler: Processed in 0.269358257 sec.
    2022.04.25 03:47:18.154991 [ 8950 ] {} <Debug> TCPHandler: Done processing connection.
    2022.04.25 03:47:18.155181 [ 8950 ] {} <Debug> TCP-Session: e1d8176a-ee62-4e0a-9855-fe9eb52e06dc Destroying unnamed session of user 94309d50-4f52-5250-31bd-74fecac179db

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/36319/a646cf76b6d4699f06aea1e8d777edb1ad6fd2c5/stateless_tests__debug__actions__[1/3]/runlog.log

So as you can see here DROP TABLE was captured when elapsed was 0.1,
while TCPHandler processes it for 0.26 seconds.
Also from the same report you are seeing that DROP DATABASE was executed
before TCPHandler stopoped processing DROP TABLE.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-26 12:15:00 +03:00
Anton Popov
e051751012
Merge pull request #36637 from CurtizJ/dynamic-columns-11 
Fix merges of wide parts with type `Object`
 2022-04-26 10:34:04 +02:00
Memo
22ecd92ed3 fix reference 2022-04-26 16:24:21 +08:00
Vitaly Baranov
78bcb96098 Rename backup & restore setting 'async' -> 'sync', and make backup & restore async by default. 2022-04-26 09:51:19 +02:00
Robert Schulze
718a173ce9
Merge remote-tracking branch 'origin/master' into clang-tidy-cleanup 
Conflicts:
- cmake/clang_tidy.cmake
 2022-04-26 09:42:47 +02:00
Robert Schulze
15e75e79e4
analysis.cmake --> clang_tidy.cmake 2022-04-26 09:41:56 +02:00
Amos Bird
298c0dd673
Fix flaky test 2022-04-26 15:06:50 +08:00
Antonio Andelic
cf022542bd Merge branch 'master' into keeper-recovery-mode 2022-04-26 06:50:02 +00:00
Alexey Milovidov
0cb227501f
Merge pull request #36587 from azat/client-reconnect 
client: add a message on reconnect (under warning log level)
 2022-04-26 08:44:27 +03:00
mergify[bot]
4e82b56a8d
Merge branch 'master' into optimize-asynchronous-metric-log 2022-04-26 05:40:49 +00:00
mergify[bot]
56f92f5f31
Merge branch 'master' into 22.4-tests-fixes 2022-04-26 02:55:31 +00:00
Alexey Milovidov
86bf67c93c
Merge pull request #36526 from Joeywzr/to_start_of_five_minutes 
Replace toStartOfFiveMinute to toStartOfFiveMinutes
 2022-04-26 05:52:02 +03:00
lgbo-ustc
74ccc233d2 Merge remote-tracking branch 'ck/master' into concurrent_join 2022-04-26 09:21:02 +08:00
alesapin
d265ad619b
Merge pull request #35971 from azat/column-ttl-test 
Regression test for CHECKSUM_DOESNT_MATCH error because of per-column TTL bug
 2022-04-25 23:53:58 +02:00
mergify[bot]
a5aab53b70
Merge branch 'master' into add_query_level_settingss 2022-04-25 21:41:36 +00:00
mergify[bot]
178f244c8b
Merge branch 'master' into dynamic-columns-11 2022-04-25 21:36:56 +00:00
mergify[bot]
f7d2a7dec9
Merge branch 'master' into tuple-numeric-identifiers 2022-04-25 21:32:25 +00:00
alesapin
012f85a569
Merge pull request #36539 from ClickHouse/fix-01161-all-system-tables 
Fix 01161_all_system_tables
 2022-04-25 23:30:36 +02:00
alesapin
7a901c0826
Merge pull request #36602 from azat/netlink-strict-resubmit 
Strict taskstats parser (resubmit)
 2022-04-25 23:28:08 +02:00
alesapin
b74cd2ba08
Merge pull request #36622 from ClickHouse/lambda-cancel-sync 
Lambda cancel sync
 2022-04-25 23:20:27 +02:00
alesapin
c04c62795e
Merge pull request #36634 from azat/01502_long_log_tinylog_deadlock_race-test 
Properly wait for queries in 01502_long_log_tinylog_deadlock_race test
 2022-04-25 23:11:37 +02:00
Alexander Tokmakov
049d2a0897 fix tests 2022-04-25 22:18:45 +02:00
Kseniia Sumarokova
3215faca72
Update storage_conf.xml 2022-04-25 21:15:38 +02:00
Alexander Tokmakov
cfcf8dbfbe fix backward incompatibility 2022-04-25 21:00:39 +02:00
Nikita Taranov
d7ff09b8e0 update tests 2022-04-25 18:23:24 +00:00
alesapin
88f05ac14a Fix black 2022-04-25 20:08:05 +02:00
mergify[bot]
d2ac9b2223
Merge branch 'master' into to_start_of_five_minutes 2022-04-25 17:36:38 +00:00
mergify[bot]
f2233e6844
Merge branch 'master' into client-reconnect 2022-04-25 17:31:14 +00:00
mergify[bot]
21238b44a2
Merge branch 'master' into 22.4-tests-fixes 2022-04-25 17:30:19 +00:00
Nikita Taranov
5dc9478bac fix SortingStep::updateOutputStream() 2022-04-25 17:29:14 +00:00
mergify[bot]
e79de5a577
Merge branch 'master' into optimize-asynchronous-metric-log 2022-04-25 17:29:11 +00:00
mergify[bot]
fdc895462e
Merge branch 'master' into fix-trash-s3-metrics 2022-04-25 17:28:06 +00:00
kssenii
a76a35d3ce Better drop cache 2022-04-25 19:20:25 +02:00
Anton Popov
d28b1559e6 fix merges of wide parts with type Object 2022-04-25 16:44:24 +00:00
mergify[bot]
265398d1b6
Merge branch 'master' into feat/add_part_offset 2022-04-25 15:58:16 +00:00
Azat Khuzhin
01438e1060 tests: properly wait for queries in 01502_long_log_tinylog_deadlock_race 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-25 18:26:47 +03:00
fenglv
85f35a6857 Fix format crash when default expression follow EPHEMERAL not literal 2022-04-25 14:57:14 +00:00
alesapin
268cb29230 Disble test postgresql replica with asan 2022-04-25 16:37:50 +02:00
Vitaly Baranov
4de4fff590 Fix tests. 2022-04-25 16:34:34 +02:00
Vitaly Baranov
68a020ecea Implement BACKUP/RESTORE ON CLUSTER. 2022-04-25 16:34:33 +02:00
Vitaly Baranov
ec5b89a6ac Revert backup version 2. Add parameter data_file_path to handle duplicate files more easily without introducing a new backup format. 2022-04-25 16:34:33 +02:00
Vitaly Baranov
f14613f433 Implemented backup version 2: now files in backups are named by their checksums. 
It will allow to store duplicate files only one time.
 2022-04-25 16:34:33 +02:00
Vitaly Baranov
acd28d8a1d Implement RESTORE for replicated tables. 2022-04-25 16:34:33 +02:00
Vitaly Baranov
d20b3d78c5 Rename some restore settings. 2022-04-25 16:34:17 +02:00
Meena Renganathan
2da4f168d6 Removed the tests aes-192-cfb128 and aes-256-cfb128 since the latest boringssl module does n't support. 2022-04-25 06:55:34 -07:00
Azat Khuzhin
3c43914f9a tests: simplify 01834_alias_columns_laziness_filimonov 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-25 16:51:39 +03:00
Mikhail f. Shiryaev
824335ca33
Filter out sychronized events globbaly 2022-04-25 14:45:11 +02:00
Mikhail f. Shiryaev
f53040b95e
Merge pull request #36559 from ClickHouse/performance-rebalance 
Use just index to split performance tests by group
 2022-04-25 14:15:23 +02:00
alesapin
46ac2f3e36
Merge pull request #36607 from ClickHouse/exclude_bc_test 
Exclude test `02271_fix_column_matcher_and_column_transformer` from bc check
 2022-04-25 14:00:13 +02:00
Azat Khuzhin
23347a878d tests: update 01173_transaction_control_queries 
Since now on INSERT failures reconnect does not happens.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-25 14:42:30 +03:00
Kseniia Sumarokova
2106a7b895
Merge pull request #36489 from awakeljw/fork_chmaster 
fix ConvertDecimalType unexpected behavior
 2022-04-25 13:23:54 +02:00
Nikolai Kochetov
0fa63a8d65
Merge pull request #36549 from ClickHouse/interpolate-alias-fix 
Avoid projections if INTERPOLATE with expressions is present
 2022-04-25 13:18:00 +02:00
Kruglov Pavel
34c342fdd3
Merge pull request #36205 from Avogar/improve-globs 
Some refactoring around schema inference with globs
 2022-04-25 13:14:46 +02:00
Robert Schulze
63221c8779
Update outdated clang-tidy instructions 2022-04-25 12:56:45 +02:00
tavplubix
7246101f61
better fix for tests 2022-04-25 13:51:33 +03:00
Alexander Gololobov
5e85b1a7b4 More test cases 2022-04-25 12:11:07 +02:00
lgbo-ustc
432ba871f8 update test case tests/queries/0_stateless/01925_join_materialized_columns 2022-04-25 18:02:10 +08:00
Mikhail f. Shiryaev
f3aaff773a
Disable broken performance test 2022-04-25 11:26:05 +02:00
alesapin
a8f3f9704e Exclude test from bc check 2022-04-25 11:20:22 +02:00
Azat Khuzhin
35613e3010 tests: adopt 01268_procfs_metrics for difference between proc and taskstruct 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-25 08:49:17 +03:00
Azat Khuzhin
aaa222821c tests: simplify 01268_procfs_metrics 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-25 08:49:08 +03:00
lgbo-ustc
981d560553 Merge remote-tracking branch 'ck/master' into concurrent_join 2022-04-25 13:00:04 +08:00
Yakov Olkhovskiy
a15c864ec7
Update 02233_interpolate_1.sql 
new line
 2022-04-24 23:50:19 -04:00
ndchikin
7bc0626e55 nth_value bug fix 2022-04-25 02:47:30 +00:00
Alexey Milovidov
f27c4d5fd4
Update 01958_partial_hour_timezone.reference 2022-04-25 03:25:00 +03:00
mergify[bot]
705d5af3a0
Merge branch 'master' into to_start_of_five_minutes 2022-04-24 22:24:24 +00:00
Alexey Milovidov
52dc76eb28
Merge pull request #36433 from PolyProgrammist/integration-tests-notion 
Notion for integration tests to build with ENABLE_CLICKHOUSE_ALL=ON
 2022-04-25 01:23:14 +03:00
Alexey Milovidov
5ce6f0aae0 Fix test 2022-04-25 00:08:26 +02:00
Alexey Milovidov
f51e137a2d
Update test.py 2022-04-24 22:39:06 +03:00
awakeljw
d58a21678a fix ConvertDecimalType unexpected behavior 2022-04-24 23:35:58 +08:00
alesapin
edc78247f0
Merge pull request #36299 from ClickHouse/fix_trash 
Trying to fix some trash in zero copy replication
 2022-04-24 13:19:43 +02:00
Alexey Milovidov
7a34dfef6e Update test 2022-04-24 08:43:49 +02:00
Alexey Milovidov
90297e225c
Merge pull request #36430 from amosbird/fixcolumnmatcher 
Fix column matcher and column transformer
 2022-04-24 09:11:21 +03:00
Alexey Milovidov
28ab036e08
Merge pull request #35976 from kitaisreal/performance-tests-fix 
Fix performance tests
 2022-04-24 06:17:40 +03:00
Alexey Milovidov
fe004c3486
Merge pull request #36486 from kitaisreal/executable-user-defined-functions-fix-group-by 
ExecutableUserDefinedFunction fix usage in GROUP BY
 2022-04-24 06:11:57 +03:00
Alexey Milovidov
da1b0b491f
Merge pull request #36487 from FArthur-cmd/fix_certificates 
Add passphrase for certificates
 2022-04-24 04:58:21 +03:00
Kruglov Pavel
3936b3e800
Merge pull request #36207 from Avogar/improve-json-schema-inference 
Improve schema inference for json objects
 2022-04-23 16:42:27 +02:00
Mikhail f. Shiryaev
2aaaf41ee4
Speed-up file_table_function 20 times 2022-04-23 14:33:03 +02:00
alesapin
f0f92341e0
Merge pull request #36492 from ClickHouse/fix-keeper-hostname-check 
Fix hostname checks in clickhouse-keeper
 2022-04-23 13:54:57 +02:00
tavplubix
e49323ca9c
Update 01161_all_system_tables.sh 2022-04-23 14:23:33 +03:00
alesapin
46792379e7 Merge branch 'master' into fix_trash 2022-04-23 12:05:35 +02:00
wuxiaobai24
751185a366 allow file descriptor in table function file() 2022-04-23 11:01:27 +08:00
alesapin
7380a71333
Merge pull request #31833 from ClickHouse/musl-check 
Build clickhouse-keeper with Musl
 2022-04-22 22:41:16 +02:00
alesapin
0e8949200e
Merge pull request #36552 from ClickHouse/fix-docker-server-check 
Fix version autodetection for docker_server.py
 2022-04-22 22:15:55 +02:00
avogar
700621e4e0 Fix tests 2022-04-22 17:38:39 +00:00
avogar
80eacc8533 Merge branch 'master' of github.com:ClickHouse/ClickHouse into improve-json-schema-inference 2022-04-22 17:18:44 +00:00
Anton Popov
50879555ef
Update 02286_tuple_numeric_identifier.sql 2022-04-22 18:29:57 +02:00
Yakov Olkhovskiy
5d59001d44 test is added 2022-04-22 11:07:32 -04:00
Mikhail f. Shiryaev
83c02e8014
Fix version autodetection for docker_server.py 2022-04-22 16:51:29 +02:00
tavplubix
48dddc53b9
Update 01161_all_system_tables.sh 2022-04-22 17:32:53 +03:00
mergify[bot]
eefc302779
Merge branch 'master' into fix-keeper-hostname-check 2022-04-22 14:07:53 +00:00
alesapin
18d094d79d
Merge pull request #35865 from azat/clickhouse-test-left-queries 
clickhouse-test: fix left-queries-check, to fix test log parser
 2022-04-22 15:59:38 +02:00
Nikita Mikhaylov
224f4dc620
Made parallel_reading_from_replicas work with localhost replica (#36281) 2022-04-22 15:52:38 +02:00
Anton Popov
5b5dd4fa46
Merge pull request #36423 from CurtizJ/return-back-36126 
Return back #36126
 2022-04-22 14:27:57 +02:00
Anton Popov
39fa397e9f allow names of tuple elements starting from digits 2022-04-22 12:07:23 +00:00
Antonio Andelic
2e187e4b97
Merge pull request #36439 from xiedeyantu/temp-table-improve 
temporary table can show total rows and total bytes
 2022-04-22 13:41:25 +02:00
Antonio Andelic
357dd7354c Fix no-parallel tag 2022-04-22 11:39:36 +00:00
Kseniia Sumarokova
33bb48106f
Merge pull request #36314 from CurtizJ/print-bad-filenames 
Show names of erroneous files in case of parsing errors while executing table functions
 2022-04-22 13:24:55 +02:00
Memo
523f33d57d add bin tests 2022-04-22 18:59:55 +08:00
lgbo-ustc
b6ed16e360 update test case tests/queries/0_stateless/01049_join_low_card_bug_long.reference 2022-04-22 18:27:54 +08:00
alesapin
32f5bc8d52
Merge pull request #36091 from ClickHouse/thin-ckeckout 
Thin checkout
 2022-04-22 11:22:46 +02:00
Antonio Andelic
4e389d8df1 Rename to hostname, add tests 2022-04-22 08:16:14 +00:00
lgbo-ustc
9fe049de51 update test case 01383_remote_ambiguous_column_shard 2022-04-22 14:22:57 +08:00
Alexey Milovidov
e8575f5f35
Merge pull request #36327 from ucasfl/alias 
Add aliases JSONLines and NDJSON for JSONEachRow
 2022-04-22 07:08:02 +03:00
Memo
956d525840 fix conflict 2022-04-22 11:22:50 +08:00
Memo
39aadf0975 replaced toStartOfFiveMinute to toStartOfFiveMinutes 2022-04-22 10:49:59 +08:00
lgbo-ustc
32c8a0cef8 update test case 01049_join_low_card_bug_long 2022-04-22 09:52:02 +08:00
Dmitry Novik
6ee62007d3 Handle GROUPING SETS with size < 2 2022-04-21 23:52:43 +00:00
mergify[bot]
cd8fa75546
Merge branch 'master' into fix_trash 2022-04-21 21:45:31 +00:00
Maksim Kita
bac1f12a2b
Merge pull request #36167 from kitaisreal/special-operators-broken-aliases-fix 
Fix broken aliases during parsing of special operators
 2022-04-21 22:31:45 +02:00
Mikhail f. Shiryaev
2dfdbe0afa
Update contributors each release 2022-04-21 20:10:12 +02:00
Mikhail f. Shiryaev
c65c832edb
Adjust git_helper and version_helper for shallow clone 2022-04-21 20:08:55 +02:00
Mikhail f. Shiryaev
9abd28ebc9
Prepare update_contributors for release.py step 2022-04-21 20:08:54 +02:00
Mikhail f. Shiryaev
fc5107623f
Checkout shallow repository for builds 2022-04-21 20:08:52 +02:00
Dmitry Novik
94a381e522 Add test for parallel GROUPING SETS processing 2022-04-21 17:17:55 +00:00
mergify[bot]
e38a3c3595
Merge branch 'master' into alias 2022-04-21 15:02:30 +00:00
Anton Popov
a87f19b493 fix more cases with nested arrays 2022-04-21 14:57:12 +00:00
Mikhail f. Shiryaev
139811b6f1
Consistent "force tests" label 2022-04-21 16:37:51 +02:00
Dmitry Novik
b5e2b38529 Optimize pipeline in case of single input 2022-04-21 14:11:58 +00:00
Dmitry Novik
df63a9b205 Depricate TOTALS with GROUPING SETS 2022-04-21 13:41:59 +00:00
Dmitry Novik
77a82cc090
Merge pull request #35631 from amosbird/projection-fix1 
Fix broken SET reuse during projection analysis.
 2022-04-21 15:32:52 +02:00
FArthur-cmd
72efd079c6 fix check_black 2022-04-21 12:57:05 +00:00
FArthur-cmd
7d1b3f84d0 fix check_black 2022-04-21 12:48:00 +00:00
mergify[bot]
04e3356d50
Merge branch 'master' into temp-table-improve 2022-04-21 12:43:55 +00:00
Antonio Andelic
03779fd463 Merge branch 'master' into keeper-recovery-mode 2022-04-21 12:34:18 +00:00
FArthur-cmd
f0a4009f60 Add passphrase for certificates 2022-04-21 12:26:30 +00:00
mergify[bot]
1ba1cad5cf
Merge branch 'master' into improve-globs 2022-04-21 11:52:13 +00:00
Kruglov Pavel
ae1f38ebe7
Fix test 2022-04-21 13:49:56 +02:00
Maksim Kita
01e09ba44e Fixed tests 2022-04-21 13:47:43 +02:00
Maksim Kita
fb28791d83 Fixed tests 2022-04-21 13:47:43 +02:00
Maksim Kita
90e3a75874 Fixed tests 2022-04-21 13:47:43 +02:00
Maksim Kita
00ac3231b2 Fix broken aliases during parsing of special operators 2022-04-21 13:47:43 +02:00
Maksim Kita
397603e9be ExecutableUserDefinedFunction fix usage in GROUP BY 2022-04-21 13:44:56 +02:00
Kruglov Pavel
7fb0f2284d
Merge branch 'master' into fix-s3-cluster 2022-04-21 13:39:52 +02:00
Kruglov Pavel
a6186f7ba4
Merge pull request #36333 from ClickHouse/bool-sync-after-error 
Fix tech debt for Bool and Map data types
 2022-04-21 13:32:14 +02:00
Kruglov Pavel
016da97d4f
Merge pull request #36454 from azat/fix-limit-by 
Fix "Cannot find column" error for distributed queries with LIMIT BY
 2022-04-21 12:50:27 +02:00
lgbo-ustc
fbd549c6ac update test scripts 2022-04-21 18:07:44 +08:00
Dmitry Novik
61deae7105
Merge branch 'master' into grouping-sets-fix 2022-04-21 03:34:42 +02:00
xiedeyantu
53337cf021 fix style check fail 2022-04-21 09:18:34 +08:00
Alexey Milovidov
dd93d5d872
Merge pull request #36422 from ClickHouse/check-revert-prs 
Check revert prs
 2022-04-21 02:25:34 +03:00
Alexey Milovidov
ec9b86fd03
Merge branch 'master' into fixcolumnmatcher 2022-04-21 02:15:25 +03:00
alesapin
cbfe00bb47 Fix tidy 2022-04-21 00:30:13 +02:00
Sergei Trifonov
2f38e7bc5c
Merge pull request #36400 from azat/dyn-linker-vars 
Add more harmful variables for OSX
 2022-04-21 00:02:51 +02:00
Azat Khuzhin
9a882cc8a6 Regression test for CHECKSUM_DOESNT_MATCH error because of per-column TTL bug 
This is a regression test for possible CHECKSUM_DOESNT_MATCH due to
per-column TTL bug, that had been fixed in [1].

  [1]: https://github.com/ClickHouse/ClickHouse/pull/35820

v2: mark 02265_column_ttl as long
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-20 21:49:48 +03:00
Azat Khuzhin
836c43092b tests: increase timeout in 02151_http_s_structure_set_eof 
Otherwise sometimes 0.15s seems not enough to start the query

CI: https://s3.amazonaws.com/clickhouse-test-reports/35865/e330d691a3a1981582ebbe20e3ecc15247644f19/stateless_tests_flaky_check__address__actions_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-20 21:34:31 +03:00
Azat Khuzhin
efcff2a725 tests: mark 02151_http_s_structure_set_eof as long 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
CI: https://s3.amazonaws.com/clickhouse-test-reports/35865/e330d691a3a1981582ebbe20e3ecc15247644f19/stateless_tests_flaky_check__address__actions_/runlog.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-20 21:34:31 +03:00
Azat Khuzhin
06532cb2f8 tests: use proper wait in 01502_log_tinylog_deadlock_race 
CI: https://s3.amazonaws.com/clickhouse-test-reports/35865/e330d691a3a1981582ebbe20e3ecc15247644f19/stateless_tests__address__actions__[2/2].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-20 21:34:31 +03:00
Azat Khuzhin
4d2aa3308b tests: use more unique user name in 02104_overcommit_memory 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-20 21:34:31 +03:00
Azat Khuzhin
dc177a72df tests: use proper query termination in 02104_overcommit_memory via SIGINT 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-20 21:34:31 +03:00
Azat Khuzhin
7b5ed949a1 tests: wait queries that may left 
v2: wait for queries in 01085_max_distributed_connections_http
    CI: https://s3.amazonaws.com/clickhouse-test-reports/35865/e330d691a3a1981582ebbe20e3ecc15247644f19/stateless_tests__debug__actions__[2/3].html

v3: wait left queries in 01675_data_type_coroutine*
    CI: https://s3.amazonaws.com/clickhouse-test-reports/36400/828d23c933681ecfc19a09a78947918c545e5558/stateless_tests__debug__actions__[2/3].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-20 21:34:08 +03:00
Azat Khuzhin
5d49bf1b81 clickhouse-test: fix left-queries-check, to fix test log parser 
Before:

    00170_s3_cache:
    Found queries left in processlist after running 00170_s3_cache.sql (database=test_8zpbah):
    [
        ...
    ]
    2022-03-27 00:11:27 [ FAIL ] 600.06 sec. - Timeout!

After:

    02263_test:                                                             [ FAIL ] - Queries left in background after the test finished:
    [
        ...
    ]
    Settings used in the test: --max_insert_threads=11 --group_by_two_level_threshold=100000 --group_by_two_level_threshold_bytes=50000000 --distributed_aggregation_memory_efficient=0 --fsync_metadata=0 --priority=2 --output_format_parallel_formatting=1 --input_format_parallel_parsing=0 --min_chunk_bytes_for_parallel_parsing=12372842 --max_read_buffer_size=855730 --prefer_localhost_replica=1 --max_block_size=74323 --max_threads=56

    Database: default

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-20 21:31:39 +03:00
Kseniia Sumarokova
842879beea
Merge pull request #36272 from kssenii/mongo-fix 
Allow missing columns for mongo storage
 2022-04-20 17:54:35 +02:00
xiedeyantu
8334648767 fix test 2022-04-20 23:34:05 +08:00
Yakov Olkhovskiy
95fc6243b1
Merge pull request #36386 from Joeywzr/hex_support_uint128 
hex support Int128/Int256/UInt128/UInt256
 2022-04-20 11:11:51 -04:00
Kruglov Pavel
3916436a10
Fix style 2022-04-20 16:35:24 +02:00
Kruglov Pavel
6ddebf7d38
Fix style 2022-04-20 16:34:05 +02:00
Kruglov Pavel
813e228fcc
Merge branch 'master' into improve-globs 2022-04-20 16:31:47 +02:00
xiedeyantu
2ecbf3e1be add test for temporary table can show total rows and total bytes 2022-04-20 22:02:47 +08:00
mergify[bot]
ded06ff100
Merge branch 'master' into return-back-36126 2022-04-20 13:01:32 +00:00
Azat Khuzhin
c6ffec1fec Fix "Cannot find column" error for distributed queries with LIMIT BY 
Consider the following example:

    SELECT k FROM (SELECT materialize('foo') AS k, -1 AS v) ORDER BY abs(v) AS _v ASC LIMIT 1 BY k

The problem here is that in case of query has LIMIT BY for
WithMergeableState* (which is the final state on the remote shard for
distributd queries) it returns the following columns:
- k
- v

While it should return:
- k
- abs(v)

So as query w/o LIMIT BY, so that initiator will be able to do the sorting

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-20 15:23:24 +03:00
Kruglov Pavel
5801de7f72
Merge pull request #36254 from Avogar/improve-client 
Send both stdin data and data from query/data from infile in client
 2022-04-20 13:55:04 +02:00
lgbo-ustc
c844415578 add new join_algorithm parallel_hash 2022-04-20 19:47:16 +08:00
李扬
a1e54c3918
Fix wrong result of datetime64 when negative (#35440) 2022-04-20 13:11:31 +02:00
alesapin
40c15222f8 Merge branch 'master' into fix_trash 2022-04-20 12:45:49 +02:00