Commit Graph

10792 Commits

Author SHA1 Message Date
Amos Bird
aa33a7add1
Add settings to check hyperscan regexp length. 2021-08-07 13:07:41 +08:00
tavplubix
14ef66e49b
Merge pull request #25895 from ClickHouse/improve_create_or_replace
Improve CREATE OR REPLACE query
2021-08-06 11:58:46 +03:00
Vladimir C
7f7bf9654b
Merge pull request #27235 from Algunenano/fix_lambda_aliases 2021-08-06 11:27:45 +03:00
alexey-milovidov
1a0570cdef
Merge pull request #27219 from evillique/perf
Fix NLP performance test
2021-08-05 22:05:59 +03:00
alexey-milovidov
1a3d8cebd2
Merge pull request #27197 from azat/nullable-index-fix
Fix on-disk format breakage for secondary indices over Nullable column
2021-08-05 21:52:18 +03:00
Alexander Kuzmenkov
75ce065626
fix the testflows tests for window function 2021-08-05 21:35:36 +03:00
Raúl Marín
fd76966715 Test shadow lambda recovery
Be a good citizen and leave a test checking for the recovery
after the lambda function has been processed
2021-08-05 19:03:42 +02:00
Raúl Marín
8b9778ebb6 Shadow lambda arguments
In case of ambiguity, lambda functions should prefer its arguments to
other aliases or identifiers
2021-08-05 18:52:00 +02:00
Kseniia Sumarokova
5edd9e0513
Merge pull request #27198 from kssenii/postgres-db-schema
Support schema for postgres database engine
2021-08-05 18:30:47 +03:00
Kruglov Pavel
59a94bd322
Merge pull request #27183 from ClickHouse/fix_detached_parts_name_partsing
Fix part name parsing in system.detached_parts
2021-08-05 18:21:03 +03:00
Alexander Kuzmenkov
d852207b0e
Merge pull request #25721 from CurtizJ/read-in-order-perf-2
Reduce memory usage in queries with `ORDER BY primary_key
2021-08-05 16:13:48 +03:00
Maksim Kita
71e5cfe3ca
Merge pull request #27134 from FArthur-cmd/compress_output_3473
add compression for INTO OUTFILE
2021-08-05 14:20:08 +03:00
Alexander Kuzmenkov
4bc652699f
Merge pull request #27184 from ClickHouse/aku/window-functions
mark window functions as ready for general use
2021-08-05 14:18:28 +03:00
Nikolay Degterinsky
1e8badcf05 Improve NLP performance test 2021-08-05 11:07:31 +00:00
Maksim Kita
7fdf3cc263
Merge pull request #27180 from kitaisreal/storage-system-replicas-added-column-replica-is-active
Storage system replicas added column replica is active
2021-08-05 12:46:53 +03:00
alexey-milovidov
975e0a4d47
Merge pull request #27182 from amosbird/logquerykind
Try our best to log query_kind
2021-08-05 12:43:13 +03:00
kssenii
1e38d48364 Fixes 2021-08-05 07:25:47 +00:00
Kseniia Sumarokova
3d347065a8
Merge pull request #27194 from azat/query_log_used-on-error
Save information about used functions/tables/... into query_log on error
2021-08-05 09:15:09 +03:00
Amos Bird
665f735044
Add some test 2021-08-05 10:50:11 +08:00
Azat Khuzhin
dee27fcbb9 Fix on-disk format breakage for secondary indices over Nullable column
[1] breaks on disk format (and the relevant change in the:

  [1]: https://github.com/ClickHouse/ClickHouse/pull/12455#discussion_r682830812

Too bad that I checked this patchset only for compatibility after
reverting this patch [2] (use case: I've applied it manually, then
revert it, and data skipping indexes over Nullable column had been
broken)

  [2]: https://github.com/ClickHouse/ClickHouse/pull/12455#issuecomment-823423772

But this patchset actually breaks compatibility with older versions of
clickhouse for Nullable data skipping indexes after simple upgrade:

Here is a simple reproducer:

    --
    -- run this with 21.6 or similar (i.e. w/o this patch)
    --

    CREATE TABLE data
    (
        `key` Int,
        `value` Nullable(Int),
        INDEX value_index value TYPE minmax GRANULARITY 1
    )
    ENGINE = MergeTree
    ORDER BY key;

    INSERT INTO data SELECT
        number,
        number
    FROM numbers(10000);

    SELECT * FROM data WHERE value = 20000 SETTINGS force_data_skipping_indices = 'value_index' SETTINGS force_data_skipping_indices = 'value_index', max_rows_to_read=1;

Now upgrade and run the query again:

    SELECT * FROM data WHERE value = 20000 SETTINGS force_data_skipping_indices = 'value_index' SETTINGS force_data_skipping_indices = 'value_index', max_rows_to_read=1;

And it will fail because of on disk format changes:

    $ ll --time-style=+ data/*/data/all_1_1_0/skp*.idx
    -rw-r----- 1 azat azat 36  data/with_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx
    -rw-r----- 1 azat azat 37  data/without_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx

    $ md5sum data/*/data/all_1_1_0/skp*.idx
    a19c95c4a14506c65665a1e30ab404bf  data/with_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx
    e50e2fcfa873b232196623d56ab26105  data/without_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx

Note, that there is no stable release with this patch included yet, so
no need to backport.

Also note that you may create data skipping indexes over Nullable
column even before [3].

  [3]: https://github.com/ClickHouse/ClickHouse/pull/12455

v2: break cases when granulas has Null in values due to backward
compatibility
2021-08-05 00:19:38 +03:00
Azat Khuzhin
f710f1e954 Cover data skipping indices on disk format (compare with 21.6) 2021-08-05 00:19:32 +03:00
kssenii
f06703a7c9 Support schema for postgres database engine 2021-08-04 20:52:45 +00:00
Anton Popov
2b6dc35d9f
Merge pull request #27122 from amosbird/datedatetimecomp
Specialize date time comparision.
2021-08-04 21:44:48 +03:00
Azat Khuzhin
643c31d6f3 Save information about used functions/tables/... into query_log on error 2021-08-04 21:44:18 +03:00
tavplubix
538958aee6
Delete 01160_detached_parts.sql 2021-08-04 20:05:57 +03:00
Alexander Kuzmenkov
b190e499ee fixup 2021-08-04 17:46:25 +03:00
Alexander Kuzmenkov
0730e685b0 Mark window functions ready for general use. 2021-08-04 17:45:32 +03:00
Alexander Tokmakov
23f8b3d07d fix part name parsing in system.detached_parts 2021-08-04 17:42:48 +03:00
Kseniia Sumarokova
f58727b50f
Merge pull request #27060 from kssenii/library-bridge-fixes
library bridge fixes
2021-08-04 17:12:09 +03:00
Maksim Kita
3f48c85722 StorageSystemReplicas added column replica_is_active 2021-08-04 16:19:42 +03:00
tavplubix
0dbcbc28ba
Merge pull request #27164 from nicelulu/fix_0_stateless_01034
Fix CURR_DATABASE empty for 01034_move_partition_from_table_zookeeper.sh
2021-08-04 13:50:06 +03:00
Artur Filatenkov
9b9982ee3d correct test with deleting files after usage 2021-08-04 12:53:41 +03:00
Vladimir C
d9c9422a44
Merge pull request #27078 from vdimir/pmj-empty-set 2021-08-04 11:15:46 +03:00
zhangxiao871
6a5925b6ce Fix CURR_DATABASE empty for 01034_move_partition_from_table_zookeeper.sh 2021-08-04 11:07:39 +08:00
alexey-milovidov
63b90bec6c
Merge pull request #27131 from kitaisreal/global-subqueries-visitor-external-storage-check-fix
GlobalSubqueriesVisitor external storage check fix
2021-08-04 03:11:56 +03:00
kssenii
cc2c1b80df Fix tests 2021-08-03 19:47:59 +00:00
Ilya Yatsishin
30851aee23
Merge pull request #27093 from amosbird/hostnametest
Normalize hostname in stateless tests
2021-08-03 17:58:28 +03:00
Vladimir C
1ebde0278e
Merge pull request #26957 from vdimir/fix-unknown-name-join-rewrite 2021-08-03 17:10:08 +03:00
Artur
f4a59a6abf correct tests 2021-08-03 13:41:58 +00:00
Artur
5c6974736d add newline 2021-08-03 12:52:46 +00:00
Artur
f4275b952e add simple test 2021-08-03 12:31:38 +00:00
mergify[bot]
dc57254982
Merge branch 'master' into improve_create_or_replace 2021-08-03 11:39:07 +00:00
Maksim Kita
0dc7da92b4 Added test 2021-08-03 14:24:21 +03:00
Maksim Kita
d9383270f6
Merge pull request #27054 from MaxWk/feature/add-default-database-to-system-users
add column default_database to system.users
2021-08-03 13:37:15 +03:00
Amos Bird
4f7e007d35
Specialize date time comparision. 2021-08-03 16:49:39 +08:00
Amos Bird
b541b5eca3
Normalize hostname in CI 2021-08-03 15:00:57 +08:00
Kseniia Sumarokova
98326ec028
Merge pull request #19526 from taiyang-li/disk_reload
Enable local disk config reload
2021-08-03 08:37:39 +03:00
Kseniia Sumarokova
5d3abc14c7
Merge pull request #22045 from OmarBazaraa/mongo-ssl
Support SSL connection in MongoDB engine
2021-08-03 08:29:34 +03:00
tavplubix
58b50bad3a
Merge pull request #27033 from ClickHouse/database_replicated_fixes
Fix assertions in Replicated database
2021-08-02 23:33:18 +03:00
Nikita Mikhaylov
771bd6be11
Merge pull request #27092 from Algunenano/clear_dns_test
Stateless tests: Keep an DNS error free log
2021-08-02 21:44:15 +03:00