Commit Graph

6903 Commits

Author SHA1 Message Date
alexey-milovidov
36ab47769b
Merge pull request #27609 from Algunenano/refactor_mysql_format
Refactor mysql format check
2021-08-13 03:02:49 +03:00
Maksim Kita
a020fe3b1b
Merge pull request #27531 from abel-cheng/with-constants
Enable using constants from with and select in aggregate function parameters.
2021-08-12 21:27:21 +03:00
Nikita Mikhaylov
8c06abee73
Merge pull request #25902 from Avogar/arrow-nested
Refactor ArrowColumnToCHColumn, support inserting Nested as Array(Struct) in Arrow/ORC/Parquet
2021-08-12 20:02:01 +03:00
Alexander Tokmakov
95eeeb53d6 fix 2021-08-12 18:58:49 +03:00
Raúl Marín
27cb83f5a7 Get today datetime in UTC 2021-08-12 17:08:39 +02:00
Nikita Mikhaylov
287262d500
Merge pull request #25714 from Algunenano/materialization_log
Better views logging
2021-08-12 17:13:33 +03:00
kssenii
a549e29bd4 Better 2021-08-12 16:35:46 +03:00
Maksim Kita
36498f67cf
Merge pull request #27505 from BraulioVM/add-function/tupleItems
Add function to turn named tuples into array of pairs
2021-08-12 16:32:11 +03:00
Raúl Marín
9b81c075c6 Use today() to ensure the rollup is tested properly 2021-08-12 12:53:57 +02:00
Alexander Tokmakov
9dd742cc29 more debug info 2021-08-12 13:39:06 +03:00
Maksim Kita
34682c98c7
Merge pull request #27605 from Enmk/fix_27193_toDateTime64_conversion
Fixed parsing DateTime64 value from string.
2021-08-12 13:32:59 +03:00
Maksim Kita
ab3fdfa00e
Update 02006_todatetime64_from_string.sql 2021-08-12 13:27:36 +03:00
Raúl Marín
f6788fc660 Mysql handler: Move format check to the handler 2021-08-12 11:29:50 +02:00
Pavel Kruglov
dc8e1be96b Fix time zone in test 2021-08-12 11:58:47 +03:00
mergify[bot]
21cbd50ae1
Merge branch 'master' into materialization_log 2021-08-12 08:53:34 +00:00
mergify[bot]
af845690dd
Merge branch 'master' into fix_01236 2021-08-12 08:52:50 +00:00
mergify[bot]
80eaea1c51
Merge branch 'master' into short-circuit 2021-08-12 08:38:45 +00:00
Vasily Nemkov
bdc4d9fe75 Fixed parsing DateTime64 value from string.
The time offset undeflowed on positive values.
2021-08-12 10:37:46 +03:00
alexey-milovidov
8fe123e9c4
Merge pull request #27561 from Algunenano/odd_tests
Improve the experience of running stateless tests locally
2021-08-12 00:54:08 +03:00
Alexander Tokmakov
0256e313b3 fix 2021-08-12 00:29:37 +03:00
alexey-milovidov
1239a91aca
Merge pull request #27080 from Algunenano/timezone_00719
Improve compatibility with non-whole-minute timezone offsets
2021-08-11 22:34:55 +03:00
alexey-milovidov
494ef840be
Merge pull request #27326 from Algunenano/fix_01176
Fix Mysql protocol when using parallel formats (CSV / TSV)
2021-08-11 22:28:48 +03:00
Alexander Tokmakov
a2b2e8cb3f fix 2021-08-11 21:02:35 +03:00
Braulio Valdivielso
94babf1c8b rename tests 2021-08-11 18:38:27 +01:00
Braulio Valdivielso
4e103b94f0 Merge branch 'master' into add-function/tupleToNameValuePairs 2021-08-11 18:35:44 +01:00
mergify[bot]
68a52fc065
Merge branch 'master' into projection-fix12 2021-08-11 17:08:04 +00:00
Alexander Tokmakov
35f1caddcb kill mutations before syncing 2021-08-11 18:24:47 +03:00
mergify[bot]
f590cc9ef4
Merge branch 'master' into materialization_log 2021-08-11 13:34:00 +00:00
Raúl Marín
4ebdb5917a clickhouse-test: Implement @@SKIP@@ directive in tests 2021-08-11 15:22:31 +02:00
achimbab
9a7cce83b3 Bugfix for windowFunnel's "strict" mode. 2021-08-11 21:08:09 +09:00
Alexander Kuzmenkov
8f9845722a
Merge pull request #27250 from azat/minmax-nullable-new-format
Add new index data skipping minmax index format for proper Nullable support
2021-08-11 13:56:16 +03:00
kssenii
fb21fec177 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into col-identifier-as-col-number 2021-08-11 07:38:06 +00:00
kssenii
7d8b694a9f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into cast-internal 2021-08-11 07:37:21 +00:00
kssenii
c1251c89d6 Fix test 2021-08-11 06:17:54 +00:00
abel-wang
92ef0a9ed7 format test results. 2021-08-11 12:34:41 +08:00
mergify[bot]
b1839e781c
Merge branch 'master' into fix_01176 2021-08-11 03:53:07 +00:00
mergify[bot]
127e050580
Merge branch 'master' into timezone_00719 2021-08-11 03:52:50 +00:00
abel-wang
b5c1ee9a8a add tests 2021-08-11 11:32:44 +08:00
abel-wang
6ac4ad2920 add tests 2021-08-11 11:19:46 +08:00
alexey-milovidov
54d8282209
Merge pull request #27248 from azat/mt-mutation-stuck-fix
Fix mutation stuck on invalid partitions in non-replicated MergeTree
2021-08-11 06:10:15 +03:00
mergify[bot]
0de123e0e2
Merge branch 'master' into fix_01176 2021-08-11 03:07:40 +00:00
mergify[bot]
ad65e5ac1a
Merge branch 'master' into timezone_00719 2021-08-11 03:07:34 +00:00
Alexey Milovidov
ca38b6b7f2 Update test 2021-08-11 06:06:20 +03:00
Alexey Milovidov
c590a239d5 Merge branch 'master' into fix-bad-cast 2021-08-11 05:48:37 +03:00
Braulio Valdivielso
65920b26bd remove unnecessary comment
The `tupleToNameValuePairs` function is not expected to cast types of
values in a tuple to the least common super type. Users will have to
be explicit about casting in their queries
2021-08-10 23:20:15 +01:00
Braulio Valdivielso
a880b8a7a1 fixup! clean up and add more tests 2021-08-10 21:47:56 +01:00
Braulio Valdivielso
68c8a168b1 change name to function to "tupleToNameValuePairs" 2021-08-10 21:33:24 +01:00
mergify[bot]
1e5f8ed9cf
Merge branch 'master' into break_some_tests 2021-08-10 17:56:26 +00:00
Nikolai Kochetov
f0a7c6ec94
Merge pull request #27516 from vdimir/fix-join-const-nullable
Fix Nullable const columns in JOIN
2021-08-10 19:56:58 +03:00
Raúl Marín
ee416e79bd 01236_graphite_mt: Use static date and print dates in results 2021-08-10 17:55:02 +02:00
Raúl Marín
3dfa54bfd8 Revert "Fix 01236_graphite_mt for random timezones"
This reverts commit 669a80000d.
2021-08-10 17:08:43 +02:00
kssenii
503a5edc59 Fix 2021-08-10 14:01:59 +00:00
Amos Bird
e63c26edb7
Fix projection materialization with missing columns 2021-08-10 21:47:27 +08:00
kssenii
554231c6fc Support positional arguments for GROUP BY, ORDER BY, LIMIT BY 2021-08-10 13:38:42 +00:00
Alexander Tokmakov
12b422f82c check replication consistency after 993-like tests 2021-08-10 16:37:26 +03:00
Raúl Marín
669a80000d Fix 01236_graphite_mt for random timezones 2021-08-10 13:20:15 +02:00
Alexander Kuzmenkov
3f7b96e15b
Merge pull request #27487 from ClickHouse/aku/kill-window
make it possible to cancel window functions on ctrl+c
2021-08-10 14:17:34 +03:00
Maksim Kita
87fb75b272
Merge pull request #27191 from FArthur-cmd/memory-tracker-26043
Client with flag for memory tracker
2021-08-10 14:01:02 +03:00
vdimir
ae3726643d
Support ColumnConst(ColumnLowCardinality) in JoinCommon::convertColumnToNullable 2021-08-10 12:59:13 +03:00
Raúl Marín
770aa427f1 MV: Test profile events and view type 2021-08-10 11:51:32 +02:00
kssenii
eb4746ac69 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into cast-internal 2021-08-10 09:38:41 +00:00
Maksim Kita
12149d1ebb
Merge pull request #27234 from DHBin/add_bitmapSubsetOffsetLimit
add bitmapSubsetOffsetLimit function
2021-08-10 12:09:56 +03:00
Raúl Marín
d1d47658f5 Merge remote-tracking branch 'blessed/master' into materialization_log 2021-08-10 10:49:05 +02:00
vdimir
77adb509cb
Fix Nullable const columns in JOIN 2021-08-10 10:42:56 +03:00
kssenii
4eb4dd97d4 Support not only 2 inputs, support any size sequence of intersect / except together 2021-08-10 09:24:12 +03:00
Braulio Valdivielso
dbed356edf clean up and add more tests 2021-08-09 22:58:02 +01:00
Alexander Kuzmenkov
dff51cb105 fixup 2021-08-09 23:56:44 +03:00
Nikolai Kochetov
bb4c11cd27
Merge pull request #27298 from ClickHouse/fix-23515
Fix bug from #23515.
2021-08-09 23:25:30 +03:00
Alexander Kuzmenkov
0cdb6f8c78 fixup 2021-08-09 22:19:54 +03:00
Braulio Valdivielso
6f8c4b8fde add some basic tests for namedTupleItems 2021-08-09 20:07:43 +01:00
Alexander Kuzmenkov
852ee7e26a a more stable test 2021-08-09 21:35:34 +03:00
Alexander Kuzmenkov
2259387f0c make it possible to cancel window functions on ctrl+c 2021-08-09 20:04:42 +03:00
Pavel Kruglov
70b51133c1 Try to simplify code 2021-08-09 18:01:08 +03:00
Pavel Kruglov
a9cf67ecf2 Fix bugs, add tests 2021-08-09 17:57:49 +03:00
Pavel Kruglov
3ec2ab6156 Avoid using expand, fix bugs, add tests and comments 2021-08-09 17:54:49 +03:00
Pavel Kruglov
20041d91df Fix test 2021-08-09 17:54:14 +03:00
Pavel Kruglov
67ad60d69d Add tests 2021-08-09 17:54:14 +03:00
Pavel Kruglov
50d4192126 Implement short circuit function evaluation, first attempt 2021-08-09 17:43:10 +03:00
Nikita Mikhaylov
7803a27e99
Merge pull request #27384 from azat/tests-system.mutations
Add and check system.mutations for database filter
2021-08-09 17:01:31 +03:00
Raúl Marín
abeaf60e4a Improve compatibility with non-whole-minute timezone offsets 2021-08-09 15:45:51 +02:00
Anton Popov
b90dc1017b fix tests 2021-08-09 16:43:10 +03:00
Nikolai Kochetov
57e5407fd8 Fix test from fuzzer. 2021-08-09 15:19:28 +03:00
Raúl Marín
bba600903b Merge remote-tracking branch 'blessed/master' into fix_01176 2021-08-09 13:38:13 +02:00
Nikita Mikhaylov
0b7385848d
Merge pull request #27303 from azat/tests-system.projection_parts
Add and check system.projection_parts for database filter
2021-08-09 13:33:16 +03:00
Nikolai Kochetov
372293b85d
Merge branch 'master' into fix-27179 2021-08-09 11:59:22 +03:00
Artur
904f53ba8b correct reference 2021-08-09 08:58:49 +00:00
Vladimir C
9cbc4b4f7f
Merge pull request #27217 from vdimir/issue-27091 2021-08-09 09:53:59 +03:00
Azat Khuzhin
f46b5dbf1a Increase insert_quorum_timeout in 01090_zookeeper_mutations_and_insert_quorum_long 2021-08-09 09:51:47 +03:00
Azat Khuzhin
8d97585da8 tests: add filter by database for queries to system.mutations 2021-08-09 09:50:50 +03:00
Azat Khuzhin
bf344ecf20 Mark 01710_projection_fetch as long 2021-08-09 09:47:50 +03:00
kssenii
a5a60a0451 Fix tests 2021-08-09 05:20:41 +00:00
alexey-milovidov
5f84564207
Merge pull request #27378 from amosbird/hyperscansanitizer
Add settings to check hyperscan regexp length.
2021-08-09 02:48:14 +03:00
mergify[bot]
316c254536
Merge branch 'master' into fix-bad-cast 2021-08-08 23:45:19 +00:00
alexey-milovidov
4fd752c74f
Merge pull request #27427 from azat/fix-dist-zero-nodes
Fix distributed queries with zero shards and aggregation
2021-08-09 02:45:02 +03:00
kssenii
7991bb6e83 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into cast-internal 2021-08-08 21:30:17 +00:00
Kseniia Sumarokova
ba220c8e3a
Merge branch 'master' into subquery-operators 2021-08-08 20:18:41 +03:00
kssenii
0f67acf648 Add test 2021-08-08 20:16:22 +03:00
mergify[bot]
bd313279e8
Merge branch 'master' into hyperscansanitizer 2021-08-08 17:03:05 +00:00
Azat Khuzhin
940a537c66 Fix 01710_projection_fetch flakiness 2021-08-08 19:31:57 +03:00
Azat Khuzhin
038241b6ed Add new index data skipping minmax index format for proper Nullable support
Note, that it cannot be done w/o new extension, since index does not
have any header.

v2: use IDisk interface for existence check
v3: remove extra file existence check
v4: fix MATERIALIZE INDEX
2021-08-08 19:30:12 +03:00
Azat Khuzhin
7964355ecf Fix mutation stuck on invalid partitions in non-replicated MergeTree
v2: Do not try to process empty mutations
    Found with flaky check [1].

      [1]: https://clickhouse-test-reports.s3.yandex.net/27248/66e8c0833392c20ba8dba3780f2b0d5c18f8194e/functional_stateless_tests_flaky_check_(address).html#fail1
2021-08-08 19:28:15 +03:00
Azat Khuzhin
702d9955c0 Fix distributed queries with zero shards and aggregation 2021-08-08 19:22:49 +03:00
Nikolai Kochetov
57a7a20759
Update 02002_row_level_filter_bug.sh 2021-08-08 18:25:53 +03:00
mergify[bot]
ec331132c1
Merge branch 'master' into fix-bad-cast 2021-08-08 15:20:27 +00:00
mergify[bot]
8d05b7c5e5
Merge branch 'master' into roaring-memory-tracker 2021-08-08 15:19:57 +00:00
Artur
7a36b7a212 correct tests 2021-08-08 12:22:33 +00:00
Azat Khuzhin
f19ff3d61c Fix 02003_WithMergeableStateAfterAggregationAndLimit_LIMIT_BY_LIMIT_OFFSET 2021-08-08 10:27:26 +03:00
Azat Khuzhin
b8a679158c Fix 01951_distributed_push_down_limit reference 2021-08-08 09:36:36 +03:00
alexey-milovidov
a7e26506cf
Merge pull request #26951 from ianton-ru/zero_copy_by_default
Set allow_remote_fs_zero_copy_replication to true by default
2021-08-08 04:46:49 +03:00
alexey-milovidov
e6e9a27d8f
Merge pull request #27377 from evillique/bz2
Add support for bzip2 compression method
2021-08-08 04:40:13 +03:00
Alexey Milovidov
3f8c1a1433 Add a test 2021-08-08 04:36:34 +03:00
alexey-milovidov
da803b56c1
Merge pull request #27380 from amosbird/logformattedquery
Add setting to log formatted query into system.query_log
2021-08-08 04:09:19 +03:00
alexey-milovidov
6811eb5e39
Merge pull request #27214 from azat/tests-replicated-database-macro
Allow parallel execution of *.sql tests with ReplicatedMergeTree (by using {database} macro)
2021-08-08 04:05:59 +03:00
Alexey Milovidov
24cef99065 Merge branch 'master' into fix-bad-cast 2021-08-08 04:00:29 +03:00
alexey-milovidov
c5207fc237
Merge pull request #26466 from azat/optimize-dist-select
Rework SELECT from Distributed optimizations
2021-08-08 03:59:32 +03:00
Azat Khuzhin
c62de36e4c Mark more tests as long 2021-08-08 00:55:40 +03:00
mergify[bot]
9869c8bb10
Merge branch 'master' into zero_copy_by_default 2021-08-07 16:53:44 +00:00
mergify[bot]
589505e76b
Merge branch 'master' into legacy-tuple-name 2021-08-07 16:42:20 +00:00
alexey-milovidov
4b52c37681
Merge pull request #27249 from azat/fix-WithMergeableStateAfterAggregationAndLimit
Fix WithMergeableStateAfterAggregationAndLimit with LIMIT BY and LIMIT OFFSET
2021-08-07 19:28:59 +03:00
alexey-milovidov
d9eab713aa
Merge pull request #27324 from Algunenano/fix_01300
Fix 01300_client_save_history_when_terminated_long
2021-08-07 19:27:29 +03:00
alexey-milovidov
7512b61dd9
Merge pull request #27300 from Algunenano/flaky_00738
Improve 00738_lock_for_inner_table stability
2021-08-07 19:25:02 +03:00
alexey-milovidov
24cc073a22
Merge pull request #27328 from ClickHouse/fix_partition_id_validation
Fix partition id validation
2021-08-07 18:45:19 +03:00
alexey-milovidov
fa5bcb2e30
Merge pull request #27301 from ClickHouse/fix-unknown-column-with-sampling
Fix unknown column with sampling
2021-08-07 18:39:19 +03:00
Nikolay Degterinsky
b5a6e18511 Small fixes 2021-08-07 15:15:49 +00:00
Azat Khuzhin
86ceaaadb9 Mark more tests as long 2021-08-07 17:40:09 +03:00
kssenii
01b4bd3f91 Fix some more tests 2021-08-07 14:28:12 +00:00
Azat Khuzhin
07e1047b4f Mark more tests as long 2021-08-07 16:30:12 +03:00
Azat Khuzhin
08beb313e8 Mark more tests as long 2021-08-07 15:06:01 +03:00
董海镔
3dcff2124c rename bitmapSubsetOffsetLimit to subBitmap and modify the rb_offset_limit function logic 2021-08-07 18:47:33 +08:00
kssenii
ec9e82fb0c Fix some tests 2021-08-07 10:12:59 +00:00
Nikolay Degterinsky
bf0297ccab Fix stateless test 2021-08-07 09:51:35 +00:00
Azat Khuzhin
8f5ecb5ed6 Mark more tests as long 2021-08-07 12:50:42 +03:00
Amos Bird
5ef59d4828
Add setting to log formatted query into system.query_log 2021-08-07 14:26:38 +08:00
Amos Bird
aa33a7add1
Add settings to check hyperscan regexp length. 2021-08-07 13:07:41 +08:00
Nikolay Degterinsky
9a45458faf Add bzip2 file compression 2021-08-07 00:25:52 +00:00
Alexander Tokmakov
5e2bfd5ba1 fix partition id validation 2021-08-06 23:56:51 +03:00
Azat Khuzhin
1fcbd1e196 Mark more tests as long 2021-08-06 23:46:29 +03:00
Nikolai Kochetov
28c33ce7c4 Add test. 2021-08-06 21:53:22 +03:00
Nikolai Kochetov
e068ea3913 Add test. 2021-08-06 21:51:43 +03:00
alexey-milovidov
e1927118cd
Merge pull request #27181 from vdimir/issue-27169
Fix uninitialized memory in functions multiSearch* with empty array
2021-08-06 21:10:22 +03:00
alexey-milovidov
ef7b695057
Merge pull request #27275 from Algunenano/fix_01099
01099_operators_date_and_timestamp: Use dates that work with all available timezones
2021-08-06 21:06:36 +03:00
Nikolai Kochetov
157ecef3c2
Merge pull request #27227 from ClickHouse/do-not-update-settings-for-view
Revert #24095. User-level settings will affect queries from view.
2021-08-06 20:57:36 +03:00
Raúl Marín
8439135960 Try to make the test faster 2021-08-06 18:28:44 +02:00
Raúl Marín
b1ff4ca81a Fix 01176_mysql_client_interactive and work with mariadb client 2021-08-06 18:03:27 +02:00
Alexander Kuzmenkov
658ce5258f
Merge pull request #26663 from ildus/mappopulateseries_for_maps
Add Map type support in mapPopulateSeries function
2021-08-06 18:53:37 +03:00
Raúl Marín
28901ef55f Fix 01300_client_save_history_when_terminated_long
It was broken because of colored output
2021-08-06 17:25:24 +02:00
Azat Khuzhin
1f60cd735d Revert changes in 01710_projection_fetch 2021-08-06 17:52:23 +03:00
Artur
e00536dede correcting test 2021-08-06 14:47:20 +00:00
Nikolai Kochetov
48eb995461 Fix unknown column bug in sampling. 2021-08-06 17:23:50 +03:00
Raúl Marín
d33a634014 Improve 00738_lock_for_inner_table stability
A sufficiently fast machine would finish processing the MV before the drop
2021-08-06 16:12:59 +02:00
Nikolai Kochetov
7320411a7f Fix bug from #23515. 2021-08-06 16:39:11 +03:00
vdimir
3ca05653bb
Use template for 01049_join_low_card_bug_long.sql 2021-08-06 15:07:50 +03:00
vdimir
d53ade572e
Fix non joined stream structure 2021-08-06 14:54:04 +03:00
Artur
985a906c57 correcting tests 2021-08-06 09:46:39 +00:00
Raúl Marín
084e3da13f 01099_operators_date_and_timestamp: Use dates that work with all available timezones 2021-08-06 11:36:52 +02:00
tavplubix
14ef66e49b
Merge pull request #25895 from ClickHouse/improve_create_or_replace
Improve CREATE OR REPLACE query
2021-08-06 11:58:46 +03:00
Vladimir C
7f7bf9654b
Merge pull request #27235 from Algunenano/fix_lambda_aliases 2021-08-06 11:27:45 +03:00
Azat Khuzhin
6747b8a03b Mark more tests as long 2021-08-06 07:07:50 +03:00
Azat Khuzhin
c523904b74 Mark more tests as long 2021-08-06 14:00:07 +03:00
Azat Khuzhin
6567aeda6c Mark more tests as long 2021-08-06 07:56:23 +03:00
Azat Khuzhin
735b730a52 Mark more tests as long 2021-08-06 00:20:48 +03:00
Azat Khuzhin
1358a2db92 Fix WithMergeableStateAfterAggregationAndLimit with LIMIT BY and LIMIT OFFSET
In case of LIMIT BY, pre LIMIT cannot be applied (that is done on the
shard before), and hence shard applies regular LIMIT, but it goes with
applying OFFSET, and also the initiator will do apply OFFSET too.
2021-08-06 00:16:26 +03:00
Azat Khuzhin
c4e2342a06 Add verbose description for pre-LIMIT into EXPLAIN query 2021-08-06 00:16:26 +03:00
alexey-milovidov
1a3d8cebd2
Merge pull request #27197 from azat/nullable-index-fix
Fix on-disk format breakage for secondary indices over Nullable column
2021-08-05 21:52:18 +03:00
Azat Khuzhin
d5987b7a06 Fix 00754_alter_modify_order_by_replicated_zookeeper 2021-08-05 21:01:36 +03:00
Azat Khuzhin
fbcf0962ee Mark some tests as long 2021-08-05 21:01:35 +03:00
Raúl Marín
fd76966715 Test shadow lambda recovery
Be a good citizen and leave a test checking for the recovery
after the lambda function has been processed
2021-08-05 19:03:42 +02:00
Raúl Marín
8b9778ebb6 Shadow lambda arguments
In case of ambiguity, lambda functions should prefer its arguments to
other aliases or identifiers
2021-08-05 18:52:00 +02:00
董海镔
e8b6c0a227 add bitmapSubsetOffsetLimit function 2021-08-06 00:44:07 +08:00
Artur
d2869d2e2b add test for memory tracker in client 2021-08-05 16:20:24 +00:00
vdimir
a427b19d3a
Check join_use_nulls changed in StorageView::read 2021-08-05 18:38:52 +03:00
Raúl Marín
479f053f2e Merge remote-tracking branch 'blessed/master' into materialization_log 2021-08-05 17:24:10 +02:00
Pavel Kruglov
607d4dcc0b Resolve conflicts, fix build and tests 2021-08-05 18:09:48 +03:00
Nikolai Kochetov
fc12310ee8 Revert #24095. User-level settings will affect queries from view. 2021-08-05 17:17:22 +03:00
Alexander Kuzmenkov
d852207b0e
Merge pull request #25721 from CurtizJ/read-in-order-perf-2
Reduce memory usage in queries with `ORDER BY primary_key
2021-08-05 16:13:48 +03:00
Anton Popov
1a607af429 add test for parsing maps 2021-08-05 14:54:48 +03:00
Maksim Kita
71e5cfe3ca
Merge pull request #27134 from FArthur-cmd/compress_output_3473
add compression for INTO OUTFILE
2021-08-05 14:20:08 +03:00
Alexander Kuzmenkov
4bc652699f
Merge pull request #27184 from ClickHouse/aku/window-functions
mark window functions as ready for general use
2021-08-05 14:18:28 +03:00
Pavel Kruglov
ee167e9ee8 Remove extra file 2021-08-05 14:10:27 +03:00
Pavel Kruglov
e4c5d7e3b1 Support inserting nested as Array of structs, add some refactoring 2021-08-05 14:10:27 +03:00
alexey-milovidov
975e0a4d47
Merge pull request #27182 from amosbird/logquerykind
Try our best to log query_kind
2021-08-05 12:43:13 +03:00
terrylin
dd539f0a0d improvement of materilize ttl 2021-08-05 15:33:02 +08:00
Azat Khuzhin
bc0af176fe tests/stateless: add {database} macro for ReplicatedMergeTree in *.sql 2021-08-05 10:24:23 +03:00
terrylin
bd3d9a4518 materialize ttl recalculate only (optional) 2021-08-05 14:17:48 +08:00
Amos Bird
665f735044
Add some test 2021-08-05 10:50:11 +08:00
Azat Khuzhin
dee27fcbb9 Fix on-disk format breakage for secondary indices over Nullable column
[1] breaks on disk format (and the relevant change in the:

  [1]: https://github.com/ClickHouse/ClickHouse/pull/12455#discussion_r682830812

Too bad that I checked this patchset only for compatibility after
reverting this patch [2] (use case: I've applied it manually, then
revert it, and data skipping indexes over Nullable column had been
broken)

  [2]: https://github.com/ClickHouse/ClickHouse/pull/12455#issuecomment-823423772

But this patchset actually breaks compatibility with older versions of
clickhouse for Nullable data skipping indexes after simple upgrade:

Here is a simple reproducer:

    --
    -- run this with 21.6 or similar (i.e. w/o this patch)
    --

    CREATE TABLE data
    (
        `key` Int,
        `value` Nullable(Int),
        INDEX value_index value TYPE minmax GRANULARITY 1
    )
    ENGINE = MergeTree
    ORDER BY key;

    INSERT INTO data SELECT
        number,
        number
    FROM numbers(10000);

    SELECT * FROM data WHERE value = 20000 SETTINGS force_data_skipping_indices = 'value_index' SETTINGS force_data_skipping_indices = 'value_index', max_rows_to_read=1;

Now upgrade and run the query again:

    SELECT * FROM data WHERE value = 20000 SETTINGS force_data_skipping_indices = 'value_index' SETTINGS force_data_skipping_indices = 'value_index', max_rows_to_read=1;

And it will fail because of on disk format changes:

    $ ll --time-style=+ data/*/data/all_1_1_0/skp*.idx
    -rw-r----- 1 azat azat 36  data/with_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx
    -rw-r----- 1 azat azat 37  data/without_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx

    $ md5sum data/*/data/all_1_1_0/skp*.idx
    a19c95c4a14506c65665a1e30ab404bf  data/with_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx
    e50e2fcfa873b232196623d56ab26105  data/without_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx

Note, that there is no stable release with this patch included yet, so
no need to backport.

Also note that you may create data skipping indexes over Nullable
column even before [3].

  [3]: https://github.com/ClickHouse/ClickHouse/pull/12455

v2: break cases when granulas has Null in values due to backward
compatibility
2021-08-05 00:19:38 +03:00
Azat Khuzhin
643c31d6f3 Save information about used functions/tables/... into query_log on error 2021-08-04 21:44:18 +03:00
Anton Popov
9a9aebc644 fix tests 2021-08-04 20:38:10 +03:00
Alexander Kuzmenkov
b190e499ee fixup 2021-08-04 17:46:25 +03:00
Alexander Kuzmenkov
0730e685b0 Mark window functions ready for general use. 2021-08-04 17:45:32 +03:00
terrylin
88b9e7f24f materialize ttl recalculate only optional 2021-08-04 22:16:13 +08:00
terrylin
8a6455116a materialize ttl recalculate only optional 2021-08-04 22:15:11 +08:00
Anton Ivashkin
61016da2b1 Set allow_remote_fs_zero_copy_replication to true by default 2021-08-04 17:08:09 +03:00
vdimir
b8558a1716
Fix uninitialized memory in functions multiSearch* with empty array 2021-08-04 16:44:39 +03:00
tavplubix
0dbcbc28ba
Merge pull request #27164 from nicelulu/fix_0_stateless_01034
Fix CURR_DATABASE empty for 01034_move_partition_from_table_zookeeper.sh
2021-08-04 13:50:06 +03:00
Artur Filatenkov
9b9982ee3d correct test with deleting files after usage 2021-08-04 12:53:41 +03:00
Vladimir C
d9c9422a44
Merge pull request #27078 from vdimir/pmj-empty-set 2021-08-04 11:15:46 +03:00
zhangxiao871
6a5925b6ce Fix CURR_DATABASE empty for 01034_move_partition_from_table_zookeeper.sh 2021-08-04 11:07:39 +08:00
alexey-milovidov
63b90bec6c
Merge pull request #27131 from kitaisreal/global-subqueries-visitor-external-storage-check-fix
GlobalSubqueriesVisitor external storage check fix
2021-08-04 03:11:56 +03:00
Anton Popov
699a3d9031 implement legacy_column_name_of_tuple_literal in less intrusive way 2021-08-03 21:03:24 +03:00
Ilya Yatsishin
30851aee23
Merge pull request #27093 from amosbird/hostnametest
Normalize hostname in stateless tests
2021-08-03 17:58:28 +03:00
Vladimir C
1ebde0278e
Merge pull request #26957 from vdimir/fix-unknown-name-join-rewrite 2021-08-03 17:10:08 +03:00
Artur
f4a59a6abf correct tests 2021-08-03 13:41:58 +00:00
Artur
5c6974736d add newline 2021-08-03 12:52:46 +00:00
Artur
f4275b952e add simple test 2021-08-03 12:31:38 +00:00
mergify[bot]
dc57254982
Merge branch 'master' into improve_create_or_replace 2021-08-03 11:39:07 +00:00
Maksim Kita
0dc7da92b4 Added test 2021-08-03 14:24:21 +03:00
Maksim Kita
d9383270f6
Merge pull request #27054 from MaxWk/feature/add-default-database-to-system-users
add column default_database to system.users
2021-08-03 13:37:15 +03:00
terrylin
ffe9eab1d0 update test cases and fix bug 2021-08-03 15:37:25 +08:00
Azat Khuzhin
97851bde08 Fix Distributed over Distributed for WithMergeableStateAfterAggregation* stages
In case if one Distributed has multiple shards, and underlying
Distributed has only one, there can be the case when the query will be
tried to process from Complete to WithMergeableStateAfterAggregation,
which is obviously wrong.
2021-08-03 10:10:08 +03:00
Amos Bird
b541b5eca3
Normalize hostname in CI 2021-08-03 15:00:57 +08:00
tavplubix
58b50bad3a
Merge pull request #27033 from ClickHouse/database_replicated_fixes
Fix assertions in Replicated database
2021-08-02 23:33:18 +03:00
Nikita Mikhaylov
771bd6be11
Merge pull request #27092 from Algunenano/clear_dns_test
Stateless tests: Keep an DNS error free log
2021-08-02 21:44:15 +03:00
Azat Khuzhin
ff12f5102a Avoid running LIMIT BY/DISTINCT step on the initiator for optimize_distributed_group_by_sharding_key
Before the following queries was running LimitBy/Distinct step on the
initator:

  select distinct sharding_key from dist order by k

While this can be omitted.
2021-08-02 21:04:30 +03:00
Azat Khuzhin
c830964240 Cover distributed_push_down_limit for queries w/o sharding expr 2021-08-02 21:04:30 +03:00
Azat Khuzhin
2fb95d9ee0 Rework SELECT from Distributed query stages optimization
Before this patch it wasn't possible to optimize simple SELECT * FROM
dist ORDER BY (w/o GROUP BY and DISTINCT) to more optimal stage
(QueryProcessingStage::WithMergeableStateAfterAggregationAndLimit),
since that code was under
allow_nondeterministic_optimize_skip_unused_shards, rework it and make
it possible.

Also now distributed_push_down_limit is respected for
optimize_distributed_group_by_sharding_key.

Next step will be to enable distributed_push_down_limit by default.

v2: fix detection of aggregates
2021-08-02 21:04:29 +03:00
terrylin
d468bd7af3 modify test cases 2021-08-02 23:18:42 +08:00
Nikolai Kochetov
d63a5e1c96
Merge pull request #26675 from Algunenano/kill_better
Handle KILL requests while running pipeline executors
2021-08-02 17:37:54 +03:00
Raúl Marín
9f32ecca89 Merge remote-tracking branch 'blessed/master' into materialization_log 2021-08-02 16:21:10 +02:00
Raúl Marín
d5a5ba8f0d Stateless tests: Keep an DNS error free log 2021-08-02 15:19:40 +02:00
Alexander Tokmakov
42a8bb6872 fix assertions in Replicated database 2021-08-02 16:19:11 +03:00
vdimir
5d2aec78c3
Add testcase for multiple joins and unknwon identifier in where section 2021-08-02 15:08:14 +03:00
vdimir
7364f35da6
Add alwaysReturnsEmptySet for Merge Join 2021-08-02 13:49:56 +03:00
Nikolai Kochetov
6951e8147d
Merge pull request #27020 from amosbird/shardlevelconstness
Shard-level const column
2021-08-02 13:45:20 +03:00
Alexander Kuzmenkov
44e3b76c3a
Merge branch 'master' into mappopulateseries_for_maps 2021-08-02 13:02:22 +03:00
alesapin
181f93c60a
Merge pull request #24997 from evillique/nlp
NLP functions
2021-08-02 10:50:40 +03:00
Anton Popov
cc3ed12ed6 Merge remote-tracking branch 'upstream/master' into HEAD 2021-08-02 02:56:00 +03:00
terrylin
eb555fc719 modify test cases 2021-08-01 21:34:30 +08:00
万康
80f33244d4 add column default_database 2021-08-01 08:12:37 +08:00
万康
66631ca680 add column default_database 2021-08-01 08:11:01 +08:00
Alexey Milovidov
7fa24539b8 Make test 01852_cast_operator independent of timezone 2021-07-31 21:24:23 +03:00
Nickita Taranov
36aaabfd3a impl 2021-07-31 19:31:17 +03:00
terrylin
fa1f069793 modify test cases 2021-08-01 00:16:00 +08:00
terrylin
c9166f1a3f modify test cases 2021-07-31 23:24:30 +08:00
terrylin
d0b44a3d5d modify test cases 2021-07-31 22:34:51 +08:00
terrylin
79c55866b5 modify test cases 2021-07-31 21:10:06 +08:00
terrylin
09a4f82d0f code style check 2021-07-31 20:36:40 +08:00
terrylin
b0df75626b modify test cases about ttl 2021-07-31 19:37:13 +08:00
Amos Bird
c03b20d1a1
Fix 2021-07-31 17:02:33 +08:00
Amos Bird
479d4fa991
Add shardNum() and shardCount() functions 2021-07-31 15:45:39 +08:00
Vitaly Baranov
99929981ab
Merge pull request #25687 from MaxWk/profile-default-database
add setting profile_default_database
2021-07-31 08:37:02 +03:00
alexey-milovidov
d2b7e23899
Merge pull request #26961 from Enmk/fix/extractAllGroupsHorizontal_max_matches_per_row
Updated extractAllGroupsHorizontal - flexible limit on number of matches
2021-07-31 04:54:24 +03:00
alexey-milovidov
c74f5feaaf
Merge pull request #27028 from Algunenano/flaky_01006
Improve 01006_simpod_empty_part_single_column_write
2021-07-31 04:53:39 +03:00
Ildus Kurbangaliev
a4e9a56e8e Make changes by review on #26663 PR 2021-07-30 20:57:32 +02:00
alesapin
02176fb4c7 Add experimental flag 2021-07-30 18:25:51 +03:00
Raúl Marín
1f3c8387a3 01006_simpod_empty_part_single_column_write: Use sync mutation instead of waiting 2021-07-30 15:53:33 +02:00
Raúl Marín
be126cbbc5 Improve wait_for_mutation check
Fast return if there isn't any mutation (it's likely it has finished already)
2021-07-30 15:36:51 +02:00
Raúl Marín
f0ff9af332 Attempt to fix flaky 00705_drop_create_merge_tree 2021-07-30 13:40:49 +02:00
Alexander Kuzmenkov
4b9cf024f5
Merge pull request #26960 from ClickHouse/aku/window-partition-boundary
fix window function partition boundary search
2021-07-30 13:25:54 +03:00
alesapin
916594fe23 Merge branch 'master' into evillique-nlp 2021-07-30 13:03:10 +03:00