Commit Graph

10907 Commits

Author SHA1 Message Date
vdimir
4534f43b68
set prefer_localhost_replica for 02291_join_const_literal_36279 2022-05-04 11:29:36 +00:00
kssenii
2c421b0f2b Fix 2022-05-04 13:08:10 +02:00
Antonio Andelic
808ea6dc65
Merge pull request #36888 from amosbird/projection-fix-one
Fix incorrect query result when doing constant aggregation
2022-05-04 10:34:40 +02:00
Vitaly Baranov
160bc288d3 Fix implementation of totalBytes() & totalRows() for Log family. 2022-05-04 00:15:21 +02:00
Amos Bird
7febf57439
Fix minmax_count_projection constant aggregation 2022-05-04 03:07:59 +08:00
mergify[bot]
57fcca6dda
Merge branch 'master' into nth_value 2022-05-03 16:37:09 +00:00
Anton Popov
d0a1eab52e fix insertion of complex jsons with nested arrays 2022-05-03 13:34:45 +00:00
Alexander Gololobov
367898da5e
Merge pull request #35318 from weeds085490/feat/add_part_offset
feat(...): [LWD] support getting _part_offset of a row
2022-05-03 13:27:02 +02:00
vdimir
ffb0570cae
Add testcase to 02291_join_const_literal_36279.sql 2022-05-03 11:06:59 +00:00
vdimir
9e2cafa5e5
Add test join_const_literal_36279 2022-05-03 10:18:19 +00:00
Dmitry Novik
639bb1b2d3 Fix reference file 2022-05-02 20:41:37 +00:00
Dmitry Novik
a499a1e024 Fix test 2022-05-02 20:00:21 +00:00
Dmitry Novik
9be17ef50c
Merge pull request #35111 from azat/optimize_aggregation_in_order-prefix
Implement partial GROUP BY key for optimize_aggregation_in_order
2022-05-02 17:49:48 +02:00
Vladimir C
7293a69e5e
Merge pull request #36656 from amosbird/timefunctionunderflow
Saturate date/datetime to zero (part 2)
2022-05-02 17:10:48 +02:00
Anton Popov
507948ee1d fix test 2022-05-02 12:18:35 +00:00
Kruglov Pavel
c3570b9f7e
Merge branch 'master' into fix-s3-cluster 2022-05-02 14:15:21 +02:00
Kruglov Pavel
b98ac57090
Merge pull request #36803 from CurtizJ/fix-unflatten-nested
Fix creation of tables with `flatten_nested = 0`
2022-05-02 13:58:16 +02:00
Kruglov Pavel
d613f7eab0
Merge branch 'master' into mysqldump-format 2022-05-02 13:31:57 +02:00
Kruglov Pavel
fd980e6840
Merge pull request #36562 from wuxiaobai24/file_descriptor
allow file descriptor in table function file()
2022-05-02 13:25:13 +02:00
Azat Khuzhin
6d5772094f tests: disable 02260_alter_compact_part_drop_nested_column for <=22.4
This should fix stress tests, like here [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/36836/9dde147529979ed9cc4d68036de5fd93e0fc2c42/stress_test__address__actions_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-02 13:57:36 +03:00
Alexey Milovidov
c95591f294
Merge pull request #36841 from ClickHouse/fix-performance-test-5
Remove "preconditions" from performance tests (overengineering, unneeded feature)
2022-05-02 12:22:56 +03:00
Antonio Andelic
a1a22b0007
Merge pull request #35149 from ContentSquare/nullables_with_proto3
Nullables with proto3 using Google wrappers
2022-05-02 09:49:37 +02:00
awakeljw
0a32fe4da3 Fix CAST Object to Object with Nullable subcolumns 2022-05-02 11:31:13 +08:00
Alexey Milovidov
7cc64d40a6 Remove tags as well 2022-05-02 02:35:44 +02:00
Alexey Milovidov
88826e2da5 Remove "preconditions" from performance tests (overengineering, unneeded feature) 2022-05-02 02:33:22 +02:00
Alexey Milovidov
9621d44345
Merge pull request #36834 from azat/client-complete-func
Add functions from CREATE FUNCTION to completion
2022-05-02 02:46:37 +03:00
Kseniia Sumarokova
e3d2d72b39
Merge pull request #36802 from KinderRiven/local_cache_trace
system table used for statistical query of remote file access
2022-05-02 00:16:04 +02:00
Azat Khuzhin
3982638e9a Validate that function had been passed in CREATE FUNCTION
Otherwise right now it leads to LOGICAL_ERROR, due to bad cast.
2022-05-01 19:01:03 +03:00
Azat Khuzhin
3b69e635dc Add functions from CREATE FUNCTION to completion 2022-05-01 18:35:22 +03:00
Nikita Mikhaylov
93a65463d0
Added SYSTEM SYNC DATABASE query (#35944) 2022-05-01 15:40:18 +02:00
KinderRiven
c01f28b47a fix and add test for system.filesystem_cache_log 2022-05-01 19:45:16 +08:00
KinderRiven
1145570c08 fix and add test for system.filesystem_cache_log 2022-05-01 19:45:16 +08:00
Alexey Milovidov
b79c6cef84
Merge pull request #36756 from CurtizJ/type-json-bool
Deduce `UInt8` type for bools from json instead of `UInt64`
2022-05-01 13:51:28 +03:00
mergify[bot]
7f7d78b001
Merge branch 'master' into revert-group-array-sorted 2022-05-01 10:46:44 +00:00
Nikita Mikhaylov
117ffa90cf
Fix ungrammatical error message (#36760) 2022-04-30 13:57:13 +02:00
Alexey Milovidov
d6c0de0d40 Revert "Merge pull request #34055 from palegre-tiny/groupSortedArray"
This reverts commit f055d7b692, reversing
changes made to 4ec3c35e14.
2022-04-30 12:29:23 +02:00
Alexey Milovidov
d1d2f2c1a4
Merge pull request #36731 from azat/fix-async_inserts_stress_long-test
tests: fix 02015_async_inserts_stress_long flakiness
2022-04-30 09:41:20 +03:00
Anton Popov
db9f570594 fix tests 2022-04-29 21:33:59 +00:00
Anton Popov
9878cae3e8 allow to execute hash function with arguments of type Array(Tuple(..)) 2022-04-29 18:50:42 +00:00
Alexey Milovidov
6c75b63953
Merge pull request #35914 from DevTeamBK/FIPS_compliance
ClickHouse's boringssl module updated to the official version of the FIPS compliant.
2022-04-29 21:08:51 +03:00
Anton Popov
243315b826 fix insert to Object columns 2022-04-29 17:26:05 +00:00
Anton Popov
76dd240980 fix tests 2022-04-29 16:33:05 +00:00
Anton Popov
cef462f83d fix creation of tables with flatten_nested = 0 2022-04-29 14:53:08 +00:00
Jakub Kuklis
ae2b103dbc Reference output formatting corrections 2022-04-29 15:14:39 +02:00
Anton Popov
19428353e7
Merge pull request #35797 from azat/nested-columns-fixes
RFC: Fix ALTER DROP COLUMN of nested column with compact parts
2022-04-29 15:09:05 +02:00
Anton Popov
57c9f8f9c0
Merge pull request #36077 from CurtizJ/dynamic-columns-9
Fix insertion of complex JSONs with nested arrays to columns of type `Object`.
2022-04-29 13:12:46 +02:00
Vladimir C
e1e7a67670
Merge pull request #36201 from vdimir/join_dup_columns_issue36199 2022-04-29 12:57:10 +02:00
Jakub Kuklis
52f6d313ee Fix typo 2022-04-29 12:20:56 +02:00
alesapin
c72596bae6
Merge pull request #36763 from kssenii/fix-async-reads
Fix some issues with low cardinality and async reads from remote fs
2022-04-29 12:18:19 +02:00
Jakub Kuklis
5f2b7edeec Update the test to have the correct order of FORMAT and SETTINGS 2022-04-29 12:09:04 +02:00
vdimir
81c24fc521
Fix assertion in join 2022-04-29 09:15:00 +00:00
Maksim Kita
0b3f27b991
Merge pull request #36744 from kitaisreal/clickhouse-dictionary-context-copy
ClickHouseDictionarySource context copy
2022-04-29 11:07:45 +02:00
Jakub Kuklis
c5ec2d211e Removing unused variable from test 2022-04-29 10:01:51 +02:00
Jakub Kuklis
45727d4deb Revert local change 2022-04-29 10:01:51 +02:00
Jakub Kuklis
a1f2dd6d34 Adding two settings in place of one, improvements to the test clarity 2022-04-29 10:01:51 +02:00
Jakub Kuklis
e705425374 Minor improvements 2022-04-29 10:01:51 +02:00
Jakub Kuklis
67c368ddfb Add a test with multiple wrappers used in a single message 2022-04-29 10:01:51 +02:00
Jakub Kuklis
5c34585a00 Improve the test clarity 2022-04-29 10:01:51 +02:00
Jakub Kuklis
507ba1042c Adding a setting to enable Google wrappers special treatment 2022-04-29 10:01:51 +02:00
Jakub Kuklis
b7a8acc302 Alternative design for output, mory messy, but the default value inside Google wrapper is not serialized 2022-04-29 10:01:50 +02:00
Jakub Kuklis
36229f631e Remove done TODO 2022-04-29 10:01:50 +02:00
Jakub Kuklis
53e2454800 Corrected the behaviour for Proto Nullable output 2022-04-29 10:01:50 +02:00
Jakub Kuklis
014b71e4b2 Test for input and output of Nullable Google wrappers, still one thing to investigate about output 2022-04-29 10:01:50 +02:00
lgbo-ustc
fd750ceab8 update tests/queries/0_stateless/02236_explain_pipeline_join.reference 2022-04-29 15:50:32 +08:00
Alexey Milovidov
9fb1d92ff5
Merge pull request #36707 from CurtizJ/fix-vertical-merges
Fix vertical merges in wide parts
2022-04-29 10:09:50 +03:00
Azat Khuzhin
bf312c2a5b Fix ALTER DROP COLUMN of nested column with compact parts
ALTER DROP COLUMN of nested column did not requires mutation before, and
so it leaves nested column as-is, and in case of compact parts
subsequent alter, that requires mutation, will trigger READ_COLUMN of
that nested column (because it exists in part), but it will fail because
there is no such column in the table already.

Here is example of such a failure on CI - [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/35459/52099b23a1cb9a7ff036c5c60aa037c999b333ef/stateless_tests__thread__actions__[1/3].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-29 07:12:34 +03:00
Azat Khuzhin
3931dbd848 Implement partial GROUP BY key for optimize_aggregation_in_order
Suppose you have a table with lots of rows, like:

    create table data_02233 (parent_key Int, child_key Int, value Int) engine=MergeTree() order by parent_key

And you want to do GROUP BY (parent_key, child_key) with optimize_aggregation_in_order:

    select parent_key, child_key, count() from data_02233 group by parent_key, child_key with totals order by parent_key, child_key

Right now, it is not possible, because optimize_aggregation_in_order
supports only w/o key aggregation, i.e. GROUP BY cannot be done inside
unique parent_key region.

v2: rebase on top SortDescriptionWithPositions
v3: disable two-level aggregation
v4: fix merging of aggregates
v5: improve tests coverage (add a test with multiple parts, to add merge processor)
v6: add a test for compiled aggregate functions (sum()) explicitly
v7: add missing sortBlock()
v8: remove group_by_description_optimized
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-29 06:58:07 +03:00
Amos Bird
e81929a8b5
Saturate date/datetime to zero (part 2)
For partial hours/minutes timezones.
2022-04-29 10:24:18 +08:00
kssenii
c31aae0ef4 Update test 2022-04-29 01:17:11 +02:00
Kseniia Sumarokova
2f64255415
Merge pull request #36743 from ClickHouse/kssenii-patch-3
Update 00170_s3_cache.sql
2022-04-29 00:03:39 +02:00
Anton Popov
1fc51e09ff fix insertion to column of type Object from multiple files via table function 2022-04-28 18:51:13 +00:00
mergify[bot]
99279b2d7b
Merge branch 'master' into clickhouse-dictionary-context-copy 2022-04-28 18:05:08 +00:00
mergify[bot]
20e2fa9b3f
Merge branch 'master' into dynamic-columns-9 2022-04-28 17:53:03 +00:00
Anton Popov
5ff11a431d
Update 01825_type_json_bools.sql 2022-04-28 19:28:00 +02:00
Yakov Olkhovskiy
7001489095
Merge pull request #36633 from ucasfl/fix-crash
Fix format crash when default expression follow EPHEMERAL not literal
2022-04-28 12:38:43 -04:00
Anton Popov
54f074e104 deduce UInt8 type for bools from json instead of UInt64 2022-04-28 15:30:43 +00:00
avogar
d295de1689 Fix comments and test 2022-04-28 14:59:35 +00:00
Kseniia Sumarokova
5c69e0e1c2
Update 00170_s3_cache.reference 2022-04-28 16:41:23 +02:00
Kseniia Sumarokova
f0ce3337d4
Fix reference 2022-04-28 16:40:23 +02:00
mergify[bot]
1d73e6c824
Merge branch 'master' into kssenii-patch-3 2022-04-28 14:37:05 +00:00
Meena Renganathan
ccd6f5a572 Merge branch 'master' of https://github.com/DevTeamBK/ClickHouse into FIPS_compliance 2022-04-28 07:33:12 -07:00
wuxiaobai24
82a053dbb5 Merge remote-tracking branch 'upstream/master' into file_descriptor 2022-04-28 22:23:25 +08:00
Kruglov Pavel
4d08587559
Merge branch 'master' into mysqldump-format 2022-04-28 15:58:18 +02:00
Meena Renganathan
bdaf5391cf Merge branch 'master' of https://github.com/DevTeamBK/ClickHouse into FIPS_compliance 2022-04-28 06:15:46 -07:00
zhanglistar
7d798b3655
Count distinct optimization by using subquery of group by (#35993) 2022-04-28 14:55:37 +02:00
Maksim Kita
c4d98aaa4c ClickHouseDictionarySource context copy 2022-04-28 14:16:49 +02:00
Maksim Kita
fa1579cdd5
Merge pull request #36390 from lthaooo/fix_dictionary_reload_bug
fix dictionary reload bug
2022-04-28 13:37:34 +02:00
Kseniia Sumarokova
558aecc48b
Update 00170_s3_cache.sql 2022-04-28 13:34:05 +02:00
Kseniia Sumarokova
b100ca4b17
Merge pull request #36710 from azat/client-wait-insert
Properly cancel INSERT queries in clickhouse-client
2022-04-28 13:19:26 +02:00
Kseniia Sumarokova
d5a7177bb1
Merge pull request #36658 from kssenii/follow-up
Fix formatting in drop cache system query
2022-04-28 13:12:16 +02:00
Vladimir C
1cbdc1ef3a
Merge pull request #36206 from vdimir/output-format-prometheus 2022-04-28 12:09:53 +02:00
alesapin
af980ef4ef
Merge pull request #36371 from Joeywzr/add_query_level_settingss
Add query level settings: parts_to_delay_insert and parts_to_throw_insert
2022-04-28 11:08:14 +02:00
Azat Khuzhin
66ac7f2552 tests: fix 02015_async_inserts_stress_long flakiness 2022-04-28 06:17:51 +03:00
wuxiaobai24
7955eb2100 Merge remote-tracking branch 'upstream/master' into file_descriptor 2022-04-28 10:47:59 +08:00
Azat Khuzhin
22189b0a5a Properly cancel INSERT queries in clickhouse-client
This will also fix issues like queries left after the test, like in [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/36686/042cf0c76444e8738eb2481ae21a135f05b4c990/stateless_tests__debug__actions__[2/3]/runlog.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-27 20:00:27 +03:00
Anton Popov
eb810116a4 fix vertical merges in wide parts 2022-04-27 13:42:47 +00:00
terrylin
2697417a2b add test case 2022-04-27 20:35:20 +08:00
Alexey Milovidov
b8a9f1411a
Merge pull request #36649 from azat/system.processes-is_all_data_sent
clickhouse-test: improve left queries after the test hardening
2022-04-27 05:21:22 +03:00
lgbo-ustc
520b05b9f1 update test case tests/queries/0_stateless/02236_explain_pipeline_join.sql 2022-04-27 10:08:22 +08:00
lgbo-ustc
0c0d4f14da update test case 02236_explain_pipeline_join 2022-04-27 09:27:49 +08:00