thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-18 04:12:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
70,780 Commits 9,324 Branches 1,783 Tags 2.2 GiB
e5b600eadc
Commit Graph

11206 Commits

Author SHA1 Message Date
Nikita Mikhaylov
7803a27e99
Merge pull request #27384 from azat/tests-system.mutations 
Add and check system.mutations for database filter
 2021-08-09 17:01:31 +03:00
Raúl Marín
abeaf60e4a Improve compatibility with non-whole-minute timezone offsets 2021-08-09 15:45:51 +02:00
Anton Popov
b90dc1017b fix tests 2021-08-09 16:43:10 +03:00
tavplubix
e7290fb134
Merge pull request #27385 from BraulioVM/fix/27171 
Do not fail if HTTP port is not set and user tries to send request to TCP port
 2021-08-09 15:30:58 +03:00
Nikolai Kochetov
57e5407fd8 Fix test from fuzzer. 2021-08-09 15:19:28 +03:00
kssenii
484c3a5d2e Update kafka test 2021-08-09 11:55:38 +00:00
Raúl Marín
bba600903b Merge remote-tracking branch 'blessed/master' into fix_01176 2021-08-09 13:38:13 +02:00
Nikita Mikhaylov
0b7385848d
Merge pull request #27303 from azat/tests-system.projection_parts 
Add and check system.projection_parts for database filter
 2021-08-09 13:33:16 +03:00
Nikolai Kochetov
fb32b1a9c0
Update skip_list.json 2021-08-09 12:00:12 +03:00
Nikolai Kochetov
372293b85d
Merge branch 'master' into fix-27179 2021-08-09 11:59:22 +03:00
Artur
904f53ba8b correct reference 2021-08-09 08:58:49 +00:00
Nikolai Kochetov
e2b59f7cae Add test to parallel skip list. 2021-08-09 11:57:53 +03:00
Maksim Kita
e6b339fbb3
Merge pull request #26845 from kitaisreal/compile-aggregate-functions-without-key 
Compile aggregate functions without key
 2021-08-09 11:52:52 +03:00
Vladimir C
9cbc4b4f7f
Merge pull request #27217 from vdimir/issue-27091 2021-08-09 09:53:59 +03:00
Azat Khuzhin
f46b5dbf1a Increase insert_quorum_timeout in 01090_zookeeper_mutations_and_insert_quorum_long 2021-08-09 09:51:47 +03:00
Vitaly Baranov
5a7fe51532
Merge pull request #27431 from vitlibar/grpc-protocol-bytes-instead-of-strings 
Use bytes instead of strings in the GRPC protocol.
 2021-08-09 09:51:24 +03:00
Azat Khuzhin
8d97585da8 tests: add filter by database for queries to system.mutations 2021-08-09 09:50:50 +03:00
Azat Khuzhin
bf344ecf20 Mark 01710_projection_fetch as long 2021-08-09 09:47:50 +03:00
kssenii
a5a60a0451 Fix tests 2021-08-09 05:20:41 +00:00
alexey-milovidov
5f84564207
Merge pull request #27378 from amosbird/hyperscansanitizer 
Add settings to check hyperscan regexp length.
 2021-08-09 02:48:14 +03:00
mergify[bot]
316c254536
Merge branch 'master' into fix-bad-cast 2021-08-08 23:45:19 +00:00
alexey-milovidov
4fd752c74f
Merge pull request #27427 from azat/fix-dist-zero-nodes 
Fix distributed queries with zero shards and aggregation
 2021-08-09 02:45:02 +03:00
kssenii
7991bb6e83 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into cast-internal 2021-08-08 21:30:17 +00:00
Kseniia Sumarokova
ba220c8e3a
Merge branch 'master' into subquery-operators 2021-08-08 20:18:41 +03:00
kssenii
0f67acf648 Add test 2021-08-08 20:16:22 +03:00
mergify[bot]
bd313279e8
Merge branch 'master' into hyperscansanitizer 2021-08-08 17:03:05 +00:00
Azat Khuzhin
940a537c66 Fix 01710_projection_fetch flakiness 2021-08-08 19:31:57 +03:00
Azat Khuzhin
038241b6ed Add new index data skipping minmax index format for proper Nullable support 
Note, that it cannot be done w/o new extension, since index does not
have any header.

v2: use IDisk interface for existence check
v3: remove extra file existence check
v4: fix MATERIALIZE INDEX
 2021-08-08 19:30:12 +03:00
Azat Khuzhin
7964355ecf Fix mutation stuck on invalid partitions in non-replicated MergeTree 
v2: Do not try to process empty mutations
    Found with flaky check [1].

      [1]: https://clickhouse-test-reports.s3.yandex.net/27248/66e8c0833392c20ba8dba3780f2b0d5c18f8194e/functional_stateless_tests_flaky_check_(address).html#fail1
 2021-08-08 19:28:15 +03:00
Azat Khuzhin
702d9955c0 Fix distributed queries with zero shards and aggregation 2021-08-08 19:22:49 +03:00
Nikolai Kochetov
57a7a20759
Update 02002_row_level_filter_bug.sh 2021-08-08 18:25:53 +03:00
mergify[bot]
ec331132c1
Merge branch 'master' into fix-bad-cast 2021-08-08 15:20:27 +00:00
mergify[bot]
8d05b7c5e5
Merge branch 'master' into roaring-memory-tracker 2021-08-08 15:19:57 +00:00
Artur
7a36b7a212 correct tests 2021-08-08 12:22:33 +00:00
Azat Khuzhin
f19ff3d61c Fix 02003_WithMergeableStateAfterAggregationAndLimit_LIMIT_BY_LIMIT_OFFSET 2021-08-08 10:27:26 +03:00
Azat Khuzhin
b8a679158c Fix 01951_distributed_push_down_limit reference 2021-08-08 09:36:36 +03:00
alexey-milovidov
a7e26506cf
Merge pull request #26951 from ianton-ru/zero_copy_by_default 
Set allow_remote_fs_zero_copy_replication to true by default
 2021-08-08 04:46:49 +03:00
alexey-milovidov
e6e9a27d8f
Merge pull request #27377 from evillique/bz2 
Add support for bzip2 compression method
 2021-08-08 04:40:13 +03:00
Alexey Milovidov
3f8c1a1433 Add a test 2021-08-08 04:36:34 +03:00
alexey-milovidov
da803b56c1
Merge pull request #27380 from amosbird/logformattedquery 
Add setting to log formatted query into system.query_log
 2021-08-08 04:09:19 +03:00
alexey-milovidov
6811eb5e39
Merge pull request #27214 from azat/tests-replicated-database-macro 
Allow parallel execution of *.sql tests with ReplicatedMergeTree (by using {database} macro)
 2021-08-08 04:05:59 +03:00
Alexey Milovidov
24cef99065 Merge branch 'master' into fix-bad-cast 2021-08-08 04:00:29 +03:00
alexey-milovidov
c5207fc237
Merge pull request #26466 from azat/optimize-dist-select 
Rework SELECT from Distributed optimizations
 2021-08-08 03:59:32 +03:00
alexey-milovidov
a60d60dec1
Merge pull request #27153 from CurtizJ/legacy-tuple-name 
Implement `legacy_column_name_of_tuple_literal` in a less intrusive way
 2021-08-08 01:16:31 +03:00
Azat Khuzhin
c62de36e4c Mark more tests as long 2021-08-08 00:55:40 +03:00
mergify[bot]
9869c8bb10
Merge branch 'master' into zero_copy_by_default 2021-08-07 16:53:44 +00:00
alexey-milovidov
6b6b4f114b
Merge pull request #27089 from ianton-ru/fix_test_merge_tree_s3_failover 
Fix test_merge_tree_s3_failover with debug build
 2021-08-07 19:46:37 +03:00
alexey-milovidov
ac3abb8fd2
Update test.py 2021-08-07 19:46:19 +03:00
mergify[bot]
589505e76b
Merge branch 'master' into legacy-tuple-name 2021-08-07 16:42:20 +00:00
alexey-milovidov
af1d41a3de
Merge pull request #27228 from myrrc/improvement/tester-changes 
Using formatted string literals in clickhouse-test, extracted sort key functions and stacktraces printer
 2021-08-07 19:35:46 +03:00
alexey-milovidov
4b52c37681
Merge pull request #27249 from azat/fix-WithMergeableStateAfterAggregationAndLimit 
Fix WithMergeableStateAfterAggregationAndLimit with LIMIT BY and LIMIT OFFSET
 2021-08-07 19:28:59 +03:00
alexey-milovidov
d9eab713aa
Merge pull request #27324 from Algunenano/fix_01300 
Fix 01300_client_save_history_when_terminated_long
 2021-08-07 19:27:29 +03:00
alexey-milovidov
22bc7eb170
Merge pull request #27294 from Algunenano/better_kafka_errors 
Improve kafka integration test error messages
 2021-08-07 19:26:31 +03:00
alexey-milovidov
7512b61dd9
Merge pull request #27300 from Algunenano/flaky_00738 
Improve 00738_lock_for_inner_table stability
 2021-08-07 19:25:02 +03:00
alexey-milovidov
24cc073a22
Merge pull request #27328 from ClickHouse/fix_partition_id_validation 
Fix partition id validation
 2021-08-07 18:45:19 +03:00
alexey-milovidov
833b232bae
Merge pull request #27383 from kssenii/fix-test 
Fix flacky test
 2021-08-07 18:40:57 +03:00
alexey-milovidov
fa5bcb2e30
Merge pull request #27301 from ClickHouse/fix-unknown-column-with-sampling 
Fix unknown column with sampling
 2021-08-07 18:39:19 +03:00
Nikolay Degterinsky
b5a6e18511 Small fixes 2021-08-07 15:15:49 +00:00
Azat Khuzhin
86ceaaadb9 Mark more tests as long 2021-08-07 17:40:09 +03:00
kssenii
01b4bd3f91 Fix some more tests 2021-08-07 14:28:12 +00:00
Azat Khuzhin
07e1047b4f Mark more tests as long 2021-08-07 16:30:12 +03:00
Azat Khuzhin
08beb313e8 Mark more tests as long 2021-08-07 15:06:01 +03:00
Braulio Valdivielso
3fdc2aae19 test that the tcp handler returns correct http responses 
I have added two tests. One checks the usual scenario where the
instance's config specifies a `http_port`. In that case, we expect the
`http_port` to be part of the response. The other scenario checks what
happens when the config doesn't specify a `http_port`. It's hard to
nail down the expectation there without hardcoding the error
response (which is not what we generally want) but I'm mainly checking
that no HTTP port is mentioned. This particular test would have failed
before my previous fix, because the TCP handler wouldn't have managed
to send back an HTTP response and `requests.post` would have thrown an
exception.
 2021-08-07 11:56:05 +01:00
董海镔
3dcff2124c rename bitmapSubsetOffsetLimit to subBitmap and modify the rb_offset_limit function logic 2021-08-07 18:47:33 +08:00
kssenii
ec9e82fb0c Fix some tests 2021-08-07 10:12:59 +00:00
Nikolay Degterinsky
bf0297ccab Fix stateless test 2021-08-07 09:51:35 +00:00
Azat Khuzhin
8f5ecb5ed6 Mark more tests as long 2021-08-07 12:50:42 +03:00
kssenii
bc7eaad5ca Fix 2021-08-07 12:35:59 +03:00
kssenii
9ca422f0c5 Introduce CAST for internal usage 2021-08-07 09:03:10 +00:00
Amos Bird
5ef59d4828
Add setting to log formatted query into system.query_log 2021-08-07 14:26:38 +08:00
Amos Bird
aa33a7add1
Add settings to check hyperscan regexp length. 2021-08-07 13:07:41 +08:00
Nikolay Degterinsky
9a45458faf Add bzip2 file compression 2021-08-07 00:25:52 +00:00
Alexander Tokmakov
5e2bfd5ba1 fix partition id validation 2021-08-06 23:56:51 +03:00
Azat Khuzhin
1fcbd1e196 Mark more tests as long 2021-08-06 23:46:29 +03:00
Nikolai Kochetov
28c33ce7c4 Add test. 2021-08-06 21:53:22 +03:00
Nikolai Kochetov
e068ea3913 Add test. 2021-08-06 21:51:43 +03:00
alexey-milovidov
e1927118cd
Merge pull request #27181 from vdimir/issue-27169 
Fix uninitialized memory in functions multiSearch* with empty array
 2021-08-06 21:10:22 +03:00
alexey-milovidov
ef7b695057
Merge pull request #27275 from Algunenano/fix_01099 
01099_operators_date_and_timestamp: Use dates that work with all available timezones
 2021-08-06 21:06:36 +03:00
Nikolai Kochetov
157ecef3c2
Merge pull request #27227 from ClickHouse/do-not-update-settings-for-view 
Revert #24095. User-level settings will affect queries from view.
 2021-08-06 20:57:36 +03:00
Raúl Marín
8439135960 Try to make the test faster 2021-08-06 18:28:44 +02:00
Raúl Marín
b1ff4ca81a Fix 01176_mysql_client_interactive and work with mariadb client 2021-08-06 18:03:27 +02:00
Alexander Kuzmenkov
658ce5258f
Merge pull request #26663 from ildus/mappopulateseries_for_maps 
Add Map type support in mapPopulateSeries function
 2021-08-06 18:53:37 +03:00
Raúl Marín
28901ef55f Fix 01300_client_save_history_when_terminated_long 
It was broken because of colored output
 2021-08-06 17:25:24 +02:00
Vladimir C
9de16c5017
Merge pull request #27216 from ianton-ru/MDB-13990 2021-08-06 18:12:00 +03:00
Azat Khuzhin
1f60cd735d Revert changes in 01710_projection_fetch 2021-08-06 17:52:23 +03:00
Artur
e00536dede correcting test 2021-08-06 14:47:20 +00:00
Mike Kot
a308c8f842 Extracted test skipping functions 2021-08-06 17:39:44 +03:00
Mike Kot
af536b1b5e Using formatted string literals, extracted sort funcs in tester 2021-08-06 17:39:44 +03:00
Nikolai Kochetov
48eb995461 Fix unknown column bug in sampling. 2021-08-06 17:23:50 +03:00
Raúl Marín
d33a634014 Improve 00738_lock_for_inner_table stability 
A sufficiently fast machine would finish processing the MV before the drop
 2021-08-06 16:12:59 +02:00
Nikolai Kochetov
7320411a7f Fix bug from #23515. 2021-08-06 16:39:11 +03:00
vdimir
3ca05653bb
Use template for 01049_join_low_card_bug_long.sql 2021-08-06 15:07:50 +03:00
vdimir
d53ade572e
Fix non joined stream structure 2021-08-06 14:54:04 +03:00
Raúl Marín
b4e417e507 test_kafka_virtual_columns_with_materialized_view: Limit iterations and show better error 2021-08-06 13:39:33 +02:00
Raúl Marín
4f1b02426a test_storage_kafka: Remove duplicated code 2021-08-06 13:38:56 +02:00
Raúl Marín
226db3f6be Integration runner: Output longer errors 2021-08-06 13:38:30 +02:00
Vitaly Baranov
9a40ce87e9 Use bytes instead of strings in the GRPC protocol. 2021-08-06 13:55:49 +03:00
Artur
985a906c57 correcting tests 2021-08-06 09:46:39 +00:00
Raúl Marín
084e3da13f 01099_operators_date_and_timestamp: Use dates that work with all available timezones 2021-08-06 11:36:52 +02:00
tavplubix
14ef66e49b
Merge pull request #25895 from ClickHouse/improve_create_or_replace 
Improve CREATE OR REPLACE query
 2021-08-06 11:58:46 +03:00
Vladimir C
7f7bf9654b
Merge pull request #27235 from Algunenano/fix_lambda_aliases 2021-08-06 11:27:45 +03:00
Azat Khuzhin
6747b8a03b Mark more tests as long 2021-08-06 07:07:50 +03:00
Azat Khuzhin
c523904b74 Mark more tests as long 2021-08-06 14:00:07 +03:00
Azat Khuzhin
6567aeda6c Mark more tests as long 2021-08-06 07:56:23 +03:00
Azat Khuzhin
735b730a52 Mark more tests as long 2021-08-06 00:20:48 +03:00
Azat Khuzhin
d0b6b167f5 Exclude 01493_alter_remove_properties_zookeeper from parallel run too 2021-08-06 00:19:04 +03:00
Azat Khuzhin
1358a2db92 Fix WithMergeableStateAfterAggregationAndLimit with LIMIT BY and LIMIT OFFSET 
In case of LIMIT BY, pre LIMIT cannot be applied (that is done on the
shard before), and hence shard applies regular LIMIT, but it goes with
applying OFFSET, and also the initiator will do apply OFFSET too.
 2021-08-06 00:16:26 +03:00
Azat Khuzhin
c4e2342a06 Add verbose description for pre-LIMIT into EXPLAIN query 2021-08-06 00:16:26 +03:00
alexey-milovidov
1a0570cdef
Merge pull request #27219 from evillique/perf 
Fix NLP performance test
 2021-08-05 22:05:59 +03:00
alexey-milovidov
1a3d8cebd2
Merge pull request #27197 from azat/nullable-index-fix 
Fix on-disk format breakage for secondary indices over Nullable column
 2021-08-05 21:52:18 +03:00
Alexander Kuzmenkov
75ce065626
fix the testflows tests for window function 2021-08-05 21:35:36 +03:00
Azat Khuzhin
685c7b8df2 Add some tests to parallel list excludes 2021-08-05 21:01:36 +03:00
Azat Khuzhin
d5987b7a06 Fix 00754_alter_modify_order_by_replicated_zookeeper 2021-08-05 21:01:36 +03:00
Azat Khuzhin
fbcf0962ee Mark some tests as long 2021-08-05 21:01:35 +03:00
Raúl Marín
fd76966715 Test shadow lambda recovery 
Be a good citizen and leave a test checking for the recovery
after the lambda function has been processed
 2021-08-05 19:03:42 +02:00
Raúl Marín
8b9778ebb6 Shadow lambda arguments 
In case of ambiguity, lambda functions should prefer its arguments to
other aliases or identifiers
 2021-08-05 18:52:00 +02:00
董海镔
e8b6c0a227 add bitmapSubsetOffsetLimit function 2021-08-06 00:44:07 +08:00
Artur
d2869d2e2b add test for memory tracker in client 2021-08-05 16:20:24 +00:00
Anton Ivashkin
0e040ca40c Add 10 seconds cache for S3 proxy resolver 2021-08-05 18:52:04 +03:00
vdimir
a427b19d3a
Check join_use_nulls changed in StorageView::read 2021-08-05 18:38:52 +03:00
Kseniia Sumarokova
5edd9e0513
Merge pull request #27198 from kssenii/postgres-db-schema 
Support schema for postgres database engine
 2021-08-05 18:30:47 +03:00
Raúl Marín
479f053f2e Merge remote-tracking branch 'blessed/master' into materialization_log 2021-08-05 17:24:10 +02:00
Kruglov Pavel
59a94bd322
Merge pull request #27183 from ClickHouse/fix_detached_parts_name_partsing 
Fix part name parsing in system.detached_parts
 2021-08-05 18:21:03 +03:00
Pavel Kruglov
607d4dcc0b Resolve conflicts, fix build and tests 2021-08-05 18:09:48 +03:00
Nikolai Kochetov
fc12310ee8 Revert #24095. User-level settings will affect queries from view. 2021-08-05 17:17:22 +03:00
Alexander Kuzmenkov
d852207b0e
Merge pull request #25721 from CurtizJ/read-in-order-perf-2 
Reduce memory usage in queries with `ORDER BY primary_key
 2021-08-05 16:13:48 +03:00
Anton Popov
1a607af429 add test for parsing maps 2021-08-05 14:54:48 +03:00
Maksim Kita
71e5cfe3ca
Merge pull request #27134 from FArthur-cmd/compress_output_3473 
add compression for INTO OUTFILE
 2021-08-05 14:20:08 +03:00
Alexander Kuzmenkov
4bc652699f
Merge pull request #27184 from ClickHouse/aku/window-functions 
mark window functions as ready for general use
 2021-08-05 14:18:28 +03:00
Pavel Kruglov
ee167e9ee8 Remove extra file 2021-08-05 14:10:27 +03:00
Pavel Kruglov
e4c5d7e3b1 Support inserting nested as Array of structs, add some refactoring 2021-08-05 14:10:27 +03:00
Nikolay Degterinsky
1e8badcf05 Improve NLP performance test 2021-08-05 11:07:31 +00:00
Maksim Kita
7fdf3cc263
Merge pull request #27180 from kitaisreal/storage-system-replicas-added-column-replica-is-active 
Storage system replicas added column replica is active
 2021-08-05 12:46:53 +03:00
alexey-milovidov
975e0a4d47
Merge pull request #27182 from amosbird/logquerykind 
Try our best to log query_kind
 2021-08-05 12:43:13 +03:00
Maksim Kita
7264c7bf4b Fixed performance tests 2021-08-05 12:37:15 +03:00
Azat Khuzhin
c806534eee Update parallel skip_list 2021-08-05 10:29:23 +03:00
kssenii
1e38d48364 Fixes 2021-08-05 07:25:47 +00:00
Azat Khuzhin
bc0af176fe tests/stateless: add {database} macro for ReplicatedMergeTree in *.sql 2021-08-05 10:24:23 +03:00
Kseniia Sumarokova
3d347065a8
Merge pull request #27194 from azat/query_log_used-on-error 
Save information about used functions/tables/... into query_log on error
 2021-08-05 09:15:09 +03:00
Ildus Kurbangaliev
2ed7e02079 Fix snapshots for mapPopulateSeries function 2021-08-05 11:11:41 +05:00
Amos Bird
665f735044
Add some test 2021-08-05 10:50:11 +08:00
zhangxiao871
9fc4e42766 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix_create_znode 2021-08-05 10:21:16 +08:00
Azat Khuzhin
dee27fcbb9 Fix on-disk format breakage for secondary indices over Nullable column 
[1] breaks on disk format (and the relevant change in the:

  [1]: https://github.com/ClickHouse/ClickHouse/pull/12455#discussion_r682830812

Too bad that I checked this patchset only for compatibility after
reverting this patch [2] (use case: I've applied it manually, then
revert it, and data skipping indexes over Nullable column had been
broken)

  [2]: https://github.com/ClickHouse/ClickHouse/pull/12455#issuecomment-823423772

But this patchset actually breaks compatibility with older versions of
clickhouse for Nullable data skipping indexes after simple upgrade:

Here is a simple reproducer:

    --
    -- run this with 21.6 or similar (i.e. w/o this patch)
    --

    CREATE TABLE data
    (
        `key` Int,
        `value` Nullable(Int),
        INDEX value_index value TYPE minmax GRANULARITY 1
    )
    ENGINE = MergeTree
    ORDER BY key;

    INSERT INTO data SELECT
        number,
        number
    FROM numbers(10000);

    SELECT * FROM data WHERE value = 20000 SETTINGS force_data_skipping_indices = 'value_index' SETTINGS force_data_skipping_indices = 'value_index', max_rows_to_read=1;

Now upgrade and run the query again:

    SELECT * FROM data WHERE value = 20000 SETTINGS force_data_skipping_indices = 'value_index' SETTINGS force_data_skipping_indices = 'value_index', max_rows_to_read=1;

And it will fail because of on disk format changes:

    $ ll --time-style=+ data/*/data/all_1_1_0/skp*.idx
    -rw-r----- 1 azat azat 36  data/with_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx
    -rw-r----- 1 azat azat 37  data/without_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx

    $ md5sum data/*/data/all_1_1_0/skp*.idx
    a19c95c4a14506c65665a1e30ab404bf  data/with_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx
    e50e2fcfa873b232196623d56ab26105  data/without_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx

Note, that there is no stable release with this patch included yet, so
no need to backport.

Also note that you may create data skipping indexes over Nullable
column even before [3].

  [3]: https://github.com/ClickHouse/ClickHouse/pull/12455

v2: break cases when granulas has Null in values due to backward
compatibility
 2021-08-05 00:19:38 +03:00
Azat Khuzhin
f710f1e954 Cover data skipping indices on disk format (compare with 21.6) 2021-08-05 00:19:32 +03:00
kssenii
f06703a7c9 Support schema for postgres database engine 2021-08-04 20:52:45 +00:00
Anton Popov
2b6dc35d9f
Merge pull request #27122 from amosbird/datedatetimecomp 
Specialize date time comparision.
 2021-08-04 21:44:48 +03:00
Azat Khuzhin
643c31d6f3 Save information about used functions/tables/... into query_log on error 2021-08-04 21:44:18 +03:00
Anton Popov
9a9aebc644 fix tests 2021-08-04 20:38:10 +03:00
tavplubix
538958aee6
Delete 01160_detached_parts.sql 2021-08-04 20:05:57 +03:00
Ildus Kurbangaliev
8e347bab99 Fix error in testflows related with mapPopulateSeries 2021-08-04 20:21:37 +05:00
Alexander Kuzmenkov
b190e499ee fixup 2021-08-04 17:46:25 +03:00
Alexander Kuzmenkov
0730e685b0 Mark window functions ready for general use. 2021-08-04 17:45:32 +03:00
Alexander Tokmakov
23f8b3d07d fix part name parsing in system.detached_parts 2021-08-04 17:42:48 +03:00
Kseniia Sumarokova
f58727b50f
Merge pull request #27060 from kssenii/library-bridge-fixes 
library bridge fixes
 2021-08-04 17:12:09 +03:00
Anton Ivashkin
61016da2b1 Set allow_remote_fs_zero_copy_replication to true by default 2021-08-04 17:08:09 +03:00
vdimir
b8558a1716
Fix uninitialized memory in functions multiSearch* with empty array 2021-08-04 16:44:39 +03:00
Maksim Kita
3f48c85722 StorageSystemReplicas added column replica_is_active 2021-08-04 16:19:42 +03:00
Ildus Kurbangaliev
d8ce46ea74 Show more details in testflows checks 2021-08-04 17:20:35 +05:00
tavplubix
0dbcbc28ba
Merge pull request #27164 from nicelulu/fix_0_stateless_01034 
Fix CURR_DATABASE empty for 01034_move_partition_from_table_zookeeper.sh
 2021-08-04 13:50:06 +03:00
Artur Filatenkov
9b9982ee3d correct test with deleting files after usage 2021-08-04 12:53:41 +03:00
Vladimir C
d9c9422a44
Merge pull request #27078 from vdimir/pmj-empty-set 2021-08-04 11:15:46 +03:00
zhangxiao871
6a5925b6ce Fix CURR_DATABASE empty for 01034_move_partition_from_table_zookeeper.sh 2021-08-04 11:07:39 +08:00
alexey-milovidov
63b90bec6c
Merge pull request #27131 from kitaisreal/global-subqueries-visitor-external-storage-check-fix 
GlobalSubqueriesVisitor external storage check fix
 2021-08-04 03:11:56 +03:00
kssenii
cc2c1b80df Fix tests 2021-08-03 19:47:59 +00:00
Anton Popov
699a3d9031 implement legacy_column_name_of_tuple_literal in less intrusive way 2021-08-03 21:03:24 +03:00
Ilya Yatsishin
30851aee23
Merge pull request #27093 from amosbird/hostnametest 
Normalize hostname in stateless tests
 2021-08-03 17:58:28 +03:00
Vladimir C
1ebde0278e
Merge pull request #26957 from vdimir/fix-unknown-name-join-rewrite 2021-08-03 17:10:08 +03:00
Artur
f4a59a6abf correct tests 2021-08-03 13:41:58 +00:00
Maksim Kita
8d061390f3 Updated performance tests 2021-08-03 16:19:56 +03:00
Artur
5c6974736d add newline 2021-08-03 12:52:46 +00:00
Raúl Marín
aad913291d test_distributed_directory_monitor_split_batch_on_failure: Track everything 
Reverting the memory reduction and forcing max_untracked_memory to 0
which should be more reliable and closer to the original test
 2021-08-03 14:38:59 +02:00
Artur
f4275b952e add simple test 2021-08-03 12:31:38 +00:00
mergify[bot]
dc57254982
Merge branch 'master' into improve_create_or_replace 2021-08-03 11:39:07 +00:00
Maksim Kita
0dc7da92b4 Added test 2021-08-03 14:24:21 +03:00
Maksim Kita
d9383270f6
Merge pull request #27054 from MaxWk/feature/add-default-database-to-system-users 
add column default_database to system.users
 2021-08-03 13:37:15 +03:00
zhangxiao871
3d3b1658c5 Fix clickhouse-keeper create znode exists and empty condition. 2021-08-03 17:59:08 +08:00
Amos Bird
4f7e007d35
Specialize date time comparision. 2021-08-03 16:49:39 +08:00
Azat Khuzhin
97851bde08 Fix Distributed over Distributed for WithMergeableStateAfterAggregation* stages 
In case if one Distributed has multiple shards, and underlying
Distributed has only one, there can be the case when the query will be
tried to process from Complete to WithMergeableStateAfterAggregation,
which is obviously wrong.
 2021-08-03 10:10:08 +03:00
Amos Bird
b541b5eca3
Normalize hostname in CI 2021-08-03 15:00:57 +08:00
Kseniia Sumarokova
98326ec028
Merge pull request #19526 from taiyang-li/disk_reload 
Enable local disk config reload
 2021-08-03 08:37:39 +03:00
Kseniia Sumarokova
5d3abc14c7
Merge pull request #22045 from OmarBazaraa/mongo-ssl 
Support SSL connection in MongoDB engine
 2021-08-03 08:29:34 +03:00
tavplubix
58b50bad3a
Merge pull request #27033 from ClickHouse/database_replicated_fixes 
Fix assertions in Replicated database
 2021-08-02 23:33:18 +03:00
Nikita Mikhaylov
771bd6be11
Merge pull request #27092 from Algunenano/clear_dns_test 
Stateless tests: Keep an DNS error free log
 2021-08-02 21:44:15 +03:00
Azat Khuzhin
ff12f5102a Avoid running LIMIT BY/DISTINCT step on the initiator for optimize_distributed_group_by_sharding_key 
Before the following queries was running LimitBy/Distinct step on the
initator:

  select distinct sharding_key from dist order by k

While this can be omitted.
 2021-08-02 21:04:30 +03:00
Azat Khuzhin
c830964240 Cover distributed_push_down_limit for queries w/o sharding expr 2021-08-02 21:04:30 +03:00
Azat Khuzhin
2fb95d9ee0 Rework SELECT from Distributed query stages optimization 
Before this patch it wasn't possible to optimize simple SELECT * FROM
dist ORDER BY (w/o GROUP BY and DISTINCT) to more optimal stage
(QueryProcessingStage::WithMergeableStateAfterAggregationAndLimit),
since that code was under
allow_nondeterministic_optimize_skip_unused_shards, rework it and make
it possible.

Also now distributed_push_down_limit is respected for
optimize_distributed_group_by_sharding_key.

Next step will be to enable distributed_push_down_limit by default.

v2: fix detection of aggregates
 2021-08-02 21:04:29 +03:00
kssenii
087ddeb0dc Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into taiyang-li-disk-reload 2021-08-02 15:16:09 +00:00
Nikolai Kochetov
d63a5e1c96
Merge pull request #26675 from Algunenano/kill_better 
Handle KILL requests while running pipeline executors
 2021-08-02 17:37:54 +03:00
Raúl Marín
9f32ecca89 Merge remote-tracking branch 'blessed/master' into materialization_log 2021-08-02 16:21:10 +02:00
kssenii
294695bb7d Review fixes 2021-08-02 13:40:58 +00:00
Raúl Marín
d5a5ba8f0d Stateless tests: Keep an DNS error free log 2021-08-02 15:19:40 +02:00
Alexander Tokmakov
42a8bb6872 fix assertions in Replicated database 2021-08-02 16:19:11 +03:00
Anton Ivashkin
740c169396 Fix test_merge_tree_s3_failover with debug build 2021-08-02 16:08:27 +03:00
vdimir
5d2aec78c3
Add testcase for multiple joins and unknwon identifier in where section 2021-08-02 15:08:14 +03:00
vdimir
7364f35da6
Add alwaysReturnsEmptySet for Merge Join 2021-08-02 13:49:56 +03:00
Nikolai Kochetov
6951e8147d
Merge pull request #27020 from amosbird/shardlevelconstness 
Shard-level const column
 2021-08-02 13:45:20 +03:00
Alexander Kuzmenkov
44e3b76c3a
Merge branch 'master' into mappopulateseries_for_maps 2021-08-02 13:02:22 +03:00
Maksim Kita
1f1795a305
Merge pull request #26978 from Algunenano/improve_executable_dictionary 
01674_executable_dictionary_implicit_key: executable_dictionary: Use printf
 2021-08-02 12:54:08 +03:00
alesapin
181f93c60a
Merge pull request #24997 from evillique/nlp 
NLP functions
 2021-08-02 10:50:40 +03:00
kssenii
5f5bbc1fca Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into taiyang-li-disk-reload 2021-08-02 07:20:14 +00:00
万康
15f4ff9d6e skip parallel test 2021-08-02 08:29:28 +08:00
Anton Popov
cc3ed12ed6 Merge remote-tracking branch 'upstream/master' into HEAD 2021-08-02 02:56:00 +03:00
kssenii
2bdb97d5e0 Some small changes 2021-08-01 10:06:48 +00:00
kssenii
9c6a8b0059 Restore previous ids passing 2021-08-01 08:59:19 +00:00
kssenii
130253e3b9 Fix bridge-server interaction in case of metadata inconsistency 2021-08-01 08:59:16 +00:00
alexey-milovidov
d9f55a3f31
Merge pull request #27040 from vzakaznikov/reenable_testflows_rbac 
Moving to TestFlows 1.7.20 that has native support for parallel tests.
 2021-08-01 10:57:09 +03:00
万康
80f33244d4 add column default_database 2021-08-01 08:12:37 +08:00
万康
66631ca680 add column default_database 2021-08-01 08:11:01 +08:00
Vitaliy Zakaznikov
bd1e2eda47 Moving to TestFlows 1.7.20 that has native support for parallel tests. 2021-07-31 15:50:27 -04:00
Alexey Milovidov
7fa24539b8 Make test 01852_cast_operator independent of timezone 2021-07-31 21:24:23 +03:00
Amos Bird
c38403998e
Fix flaky 2021-07-31 23:00:10 +08:00
Amos Bird
c03b20d1a1
Fix 2021-07-31 17:02:33 +08:00
Amos Bird
479d4fa991
Add shardNum() and shardCount() functions 2021-07-31 15:45:39 +08:00
Vitaly Baranov
99929981ab
Merge pull request #25687 from MaxWk/profile-default-database 
add setting profile_default_database
 2021-07-31 08:37:02 +03:00
alexey-milovidov
71d20659c9
Merge pull request #27007 from ClickHouse/tavplubix-patch-2-1 
Set insert_quorum_timeout to 1 minute for tests.
 2021-07-31 04:55:00 +03:00
alexey-milovidov
d2b7e23899
Merge pull request #26961 from Enmk/fix/extractAllGroupsHorizontal_max_matches_per_row 
Updated extractAllGroupsHorizontal - flexible limit on number of matches
 2021-07-31 04:54:24 +03:00
alexey-milovidov
c74f5feaaf
Merge pull request #27028 from Algunenano/flaky_01006 
Improve 01006_simpod_empty_part_single_column_write
 2021-07-31 04:53:39 +03:00
alexey-milovidov
7e5f25ea92
Merge pull request #27026 from excitoon-favorites/runner 
Improved `runner` to use `pytest` keyword expressions
 2021-07-31 00:09:07 +03:00
Ildus Kurbangaliev
a4e9a56e8e Make changes by review on #26663 PR 2021-07-30 20:57:32 +02:00
mergify[bot]
1d4e2564bc
Merge branch 'master' into improve_executable_dictionary 2021-07-30 16:45:39 +00:00
alexey-milovidov
f17b5debfb
Merge pull request #27023 from Algunenano/flaky_drop_create_merge 
Attempt to fix flaky 00705_drop_create_merge_tree
 2021-07-30 19:45:22 +03:00
alesapin
02176fb4c7 Add experimental flag 2021-07-30 18:25:51 +03:00
Raúl Marín
1f3c8387a3 01006_simpod_empty_part_single_column_write: Use sync mutation instead of waiting 2021-07-30 15:53:33 +02:00
alesapin
acc4e9e79d Merge remote-tracking branch 'evillique/nlp' into evillique-nlp 2021-07-30 16:46:58 +03:00
Raúl Marín
be126cbbc5 Improve wait_for_mutation check 
Fast return if there isn't any mutation (it's likely it has finished already)
 2021-07-30 15:36:51 +02:00
Vladimir Chebotarev
1cf4da2df7 Improved runner to use pytest keyword expressions. 2021-07-30 15:59:27 +03:00
Raúl Marín
f0ff9af332 Attempt to fix flaky 00705_drop_create_merge_tree 2021-07-30 13:40:49 +02:00
alesapin
66e675e54e
Merge pull request #26897 from qoega/test_distributed_respect_user_timeouts-tune 
Try increase diff upper bound
 2021-07-30 14:28:54 +03:00
Amos Bird
7b9e81742f
Shard level constness 2021-07-30 18:53:34 +08:00
Alexander Kuzmenkov
4b9cf024f5
Merge pull request #26960 from ClickHouse/aku/window-partition-boundary 
fix window function partition boundary search
 2021-07-30 13:25:54 +03:00
alesapin
916594fe23 Merge branch 'master' into evillique-nlp 2021-07-30 13:03:10 +03:00
Maksim Kita
5666cf5fee
Merge pull request #27008 from Algunenano/adjust_00537_quarters 
Adjust 00537_quarters to be timezone independent
 2021-07-30 12:54:51 +03:00
Vasily Nemkov
a1fb16df52 setting regexp_max_matches_per_row instead of 3rd argument 2021-07-30 12:28:21 +03:00
Raúl Marín
4106d4bc21 Adjust 00537_quarters to be timezone independent 2021-07-30 11:14:07 +02:00
PHO
6425dd001a
Add a codec AES_128_GCM_SIV for encrypting columns on disk (#19896) 
* Add a codec Encrypted() for encrypting columns on disk

While this is implemented as a compression codec, it does not actually compress data. It instead encrypts data on disk. The key is obtained by executing a user-specified command at the server startup, or if it's not specified the codec refuses to process any data. For now the only supported cipher is 'AES-128-GCM-SIV'.
 2021-07-30 12:12:33 +03:00
tavplubix
5a526ed078
Update timeouts.xml 2021-07-30 12:02:13 +03:00
alesapin
cae5502d51
Merge pull request #26963 from ClickHouse/fix_bad_partition_id 
Add simple validation for partition id before drop partition
 2021-07-30 11:21:28 +03:00
alexey-milovidov
99849f94c0
Merge pull request #26959 from ClickHouse/fix_stress_client_options 
Fix client options in stress test
 2021-07-30 08:49:34 +03:00
alexey-milovidov
4545fa15f7
Merge pull request #26975 from Algunenano/fix_quota_test 
Fix 01600_quota_by_forwarded_ip
 2021-07-30 08:45:05 +03:00
Maksim Kita
c5349f6d8c
Merge pull request #26901 from Algunenano/fix_client_secure 
Tests: Fix CLICKHOUSE_CLIENT_SECURE with the default config
 2021-07-29 21:43:42 +03:00
Raúl Marín
b4cd34b5fb Make the test parallelizable 2021-07-29 20:01:57 +02:00
Raúl Marín
8f8df8bf7b Test with printf instead 2021-07-29 19:22:57 +02:00
Raúl Marín
89a26f6d84 executable_dictionary: Use echo -e 2021-07-29 18:29:21 +02:00
Raúl Marín
ee4759ce86 Fix 01600_quota_by_forwarded_ip 
The test was assuming clickhouse-local and curl would connect using the same address
 2021-07-29 17:47:16 +02:00
tavplubix
c18c16855a
Merge pull request #26913 from PolyProgrammist/table-function-cluster-macros 
Supported cluster macros inside table function 'cluster'
 2021-07-29 18:43:36 +03:00
tavplubix
8aa5df7ceb
Update 01154_move_partition_long.sh 2021-07-29 16:40:33 +03:00
alesapin
21599ffefc Simple validation for partition id before drop partition 2021-07-29 16:11:05 +03:00
Alexander Kuzmenkov
55e1d1b592 the reference was correct after all, I just confused the sides of the 
diff
 2021-07-29 15:49:37 +03:00
Vasily Nemkov
ec77ba8bfc Updated extractAllGroupsHorizontal - flexible limit on number of matches per row. 
If it is not set via third argument, it deafults to previously hardcoded
value 1000.
 2021-07-29 15:36:55 +03:00
alesapin
bb77342606 Add test 2021-07-29 15:33:28 +03:00
Alexander Kuzmenkov
7c9467d7a7 fix window function partition boundary search 
It was horribly broken and many test references were wrong. I'm
surprised I never noticed this.
 2021-07-29 15:18:10 +03:00
Alexander Tokmakov
381634960e fix client options in stress test 2021-07-29 15:16:34 +03:00
Raúl Marín
0505e2e589 Add tests 2021-07-29 13:03:14 +02:00
tavplubix
4a3ade1aa5
Merge pull request #26814 from ClickHouse/fix_lost_aggregate_function_parameters 
Fix lost parameters of aggregate functions
 2021-07-29 13:43:05 +03:00
tavplubix
f8b6815ade
Merge pull request #26847 from ClickHouse/check_aggregate_function_parameters 
Check aggregate function parameters in -Merge combinator
 2021-07-29 13:42:52 +03:00
Vadim Volodin
918a4e8ab3 Supported cluster macros inside table function 'cluster' 2021-07-29 12:12:29 +03:00
kssenii
f1e96dbc55 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into taiyang-li-disk-reload 2021-07-29 07:53:16 +00:00
Alexey Milovidov
b7a26772f3 Add comments 2021-07-29 09:15:44 +03:00
Alexey Milovidov
10166eb1a4 Revert Arcadia file 2021-07-29 09:13:13 +03:00
Alexey Milovidov
c4c3e34377 Remove unused files that confuse developers #26913 2021-07-29 09:10:29 +03:00
alexey-milovidov
905eed2429
Merge pull request #26915 from Algunenano/fix_01854 
Improve test compatibility (00646_url_engine and 01854_HTTP_dict_decompression)
 2021-07-29 01:20:17 +03:00
alexey-milovidov
5ed60ee6bf
Merge pull request #26918 from Algunenano/01921_timezone 
01921_datatype_date32: Adapt it to work under Pacific/Fiji
 2021-07-29 01:19:33 +03:00
alesapin
26b129bef2
Merge pull request #26900 from ClickHouse/fix_trash_bug 
Fix bug when default column reference non materialized column
 2021-07-28 22:40:48 +03:00
Alexander Tokmakov
764701c3f3 allow mismatching parameters for some functions 2021-07-28 20:55:13 +03:00
Raúl Marín
46b162c595 01921_datatype_date32: Adapt it to work under Pacific/Fiji 2021-07-28 18:16:32 +02:00
Raúl Marín
0bb2eb3f4f More PR comments 2021-07-28 18:05:37 +02:00
Raúl Marín
92ed6f5cc9 Improvements from PR review 2021-07-28 17:48:40 +02:00
Raúl Marín
3a1081ddee Same for 00646_url_engine 2021-07-28 17:21:18 +02:00
Raúl Marín
62a9a89ced Improve 01854_HTTP_dict_decompression compatibility 
127.0.0.1 192.168.1.193 might return multiple ip addresses, so take the first one
 2021-07-28 17:18:55 +02:00
alesapin
d91380cd71 Fix bug when default column reference non materialized column 2021-07-28 15:04:42 +03:00
Raúl Marín
d2a8ec9b93 Fix CLICKHOUSE_CLIENT_SECURE with the default config 2021-07-28 14:03:35 +02:00
Yatsishin Ilya
315c3f804c Try increase diff upper bound 2021-07-28 13:29:15 +03:00
Yatsishin Ilya
50ae1b3255 Better tests 2021-07-28 13:22:15 +03:00
OmarBazaraa
6b9e0f5a6f Fix 2021-07-28 09:38:34 +00:00
OmarBazaraa
8acc290bc5 Add integration tests 2021-07-28 09:38:34 +00:00
Alexander Tokmakov
fab4529c97 Merge branch 'master' into rename_materialize_mysql 2021-07-28 12:18:01 +03:00
Raúl Marín
4a09c54a04 Merge remote-tracking branch 'blessed/master' into materialization_log 2021-07-28 10:38:47 +02:00
alesapin
1277db4435
Merge pull request #26129 from ClickHouse/system_zookeeper_log 
Add system.zookeeper_log table
 2021-07-28 11:22:29 +03:00
Ilya Yatsishin
093384f90f
Merge pull request #26827 from qoega/jdbc-bridge-test 2021-07-28 09:34:13 +03:00
Alexander Tokmakov
fc9ab2cda7 Merge branch 'master' into rename_materialize_mysql 2021-07-27 22:38:40 +03:00
Alexander Tokmakov
ebcf0844f5 fix_tests 2021-07-27 20:30:25 +03:00
Alexander Tokmakov
378dcef813 fixes 2021-07-27 19:57:28 +03:00
Maksim Kita
3a6b37691a Compile aggregate functions without key 2021-07-27 19:50:57 +03:00
Kseniia Sumarokova
b5dce17707
Merge pull request #26821 from azat/rocksdb-improvements 
Add system.rocksdb and read rocksdb/rocksdb_TABLE options from config
 2021-07-27 17:31:12 +03:00
Raúl Marín
772cc1910a test_distributed_directory_monitor_split_batch_on_failure: Lower memory limit 
With the changes, when running under the sanitizers, some of the internala arenas do not reach
the threshold to move from the stack to the heap, so the allocations aren't accounted
and the limit won't be reached

Testing with a lower limit to confirm it's enough to throw in remote queries
but not locally
 2021-07-27 16:29:34 +02:00
Raúl Marín
145699d0c2 test_kafka_no_holes_when_write_suffix_failed: Fix expected error message 
The old error message was incorrect (it said a failure happened when
pushing the prefix when it was happening while pushing the suffix.
 2021-07-27 16:29:34 +02:00
Raúl Marín
ff249a14af Fix test_kafka_no_holes_when_write_suffix_failed 2021-07-27 16:29:34 +02:00
Raúl Marín
db0cdd696f Dependent views: Report progress 2021-07-27 16:29:34 +02:00
Raúl Marín
0d7d8320f9 Avoid using :: to cast 
There is an issue with the ANTRL parser, reported
https://github.com/ClickHouse/ClickHouse/issues/25855
 2021-07-27 16:29:34 +02:00
Raúl Marín
97823600e3 Rename tests after rebase 2021-07-27 16:29:34 +02:00
Raúl Marín
43a96c67a5 Add test to check behaviour on exceptions 2021-07-27 16:29:34 +02:00
Raúl Marín
eebb0c6c72 Stop testing static uuids 
Complicates things in CI and breaks parallel tests
 2021-07-27 16:29:34 +02:00
Raúl Marín
22d1ed472d Fix unrelated shellcheck warning 2021-07-27 16:29:34 +02:00
Raúl Marín
06b56b6dc7 MV min_insert_block_size_rows: Only test for exceptions 
With the changes in the previous commit, we try to finish any materialized
view that was started before an exception was thrown
 2021-07-27 16:29:33 +02:00
Raúl Marín
69577a782f Views: Once started, finish all concurrent views before throwing 
Since sequential processing executes things in phases too, try to finish
all (non errored out) views before throwing any exception
 2021-07-27 16:29:33 +02:00
Raúl Marín
70b7bb4eaa Refresh table acecss information before the final query_log 
Table access should show the tables used by joins in dependent views
 2021-07-27 16:29:33 +02:00
Raúl Marín
f0125262b7 Add views and it's tables to system.query_log 2021-07-27 16:29:33 +02:00
Raúl Marín
14e8029e01 Initial basic tests and change name to not include uuid 2021-07-27 16:29:33 +02:00
Raúl Marín
891e9ba3c8 rbac: Check access to query_views_log too 2021-07-27 16:29:33 +02:00
mergify[bot]
242efdd0f1
Merge branch 'master' into jdbc-bridge-test 2021-07-27 14:28:27 +00:00