Commit Graph

69404 Commits

Author SHA1 Message Date
Amos Bird
5ef59d4828
Add setting to log formatted query into system.query_log 2021-08-07 14:26:38 +08:00
tavplubix
14ef66e49b
Merge pull request #25895 from ClickHouse/improve_create_or_replace
Improve CREATE OR REPLACE query
2021-08-06 11:58:46 +03:00
Vladimir C
7f7bf9654b
Merge pull request #27235 from Algunenano/fix_lambda_aliases 2021-08-06 11:27:45 +03:00
alexey-milovidov
e36bc3bbaf
Merge pull request #27136 from nikitamikhaylov/lz4-checks
Better code around decompression
2021-08-05 22:09:29 +03:00
alexey-milovidov
1a0570cdef
Merge pull request #27219 from evillique/perf
Fix NLP performance test
2021-08-05 22:05:59 +03:00
alexey-milovidov
1a3d8cebd2
Merge pull request #27197 from azat/nullable-index-fix
Fix on-disk format breakage for secondary indices over Nullable column
2021-08-05 21:52:18 +03:00
Alexander Kuzmenkov
75ce065626
fix the testflows tests for window function 2021-08-05 21:35:36 +03:00
Raúl Marín
fd76966715 Test shadow lambda recovery
Be a good citizen and leave a test checking for the recovery
after the lambda function has been processed
2021-08-05 19:03:42 +02:00
Raúl Marín
8b9778ebb6 Shadow lambda arguments
In case of ambiguity, lambda functions should prefer its arguments to
other aliases or identifiers
2021-08-05 18:52:00 +02:00
Kseniia Sumarokova
5edd9e0513
Merge pull request #27198 from kssenii/postgres-db-schema
Support schema for postgres database engine
2021-08-05 18:30:47 +03:00
Kruglov Pavel
59a94bd322
Merge pull request #27183 from ClickHouse/fix_detached_parts_name_partsing
Fix part name parsing in system.detached_parts
2021-08-05 18:21:03 +03:00
Maksim Kita
4f0dbae0f9
Merge pull request #27211 from amosbird/betterregex
Split mutex into individual regexp construction.
2021-08-05 17:03:44 +03:00
Nikita Mikhaylov
a61c1bcb63
Merge pull request #27224 from georgthegreat/fix-include
ADDINCL proper fast_float directory
2021-08-05 16:58:46 +03:00
Yuriy Chernyshov
3432743b31 ADDINCL proper fast_float directory 2021-08-05 16:53:36 +03:00
Maksim Kita
fbeabb060e
Merge pull request #27221 from ClickHouse/filimonov-changelog-readme
Update changelog/README.md
2021-08-05 16:47:52 +03:00
Alexander Kuzmenkov
d852207b0e
Merge pull request #25721 from CurtizJ/read-in-order-perf-2
Reduce memory usage in queries with `ORDER BY primary_key
2021-08-05 16:13:48 +03:00
Maksim Kita
71e5cfe3ca
Merge pull request #27134 from FArthur-cmd/compress_output_3473
add compression for INTO OUTFILE
2021-08-05 14:20:08 +03:00
filimonov
7b6ae5ee17
Update README.md 2021-08-05 13:19:13 +02:00
Alexander Kuzmenkov
4bc652699f
Merge pull request #27184 from ClickHouse/aku/window-functions
mark window functions as ready for general use
2021-08-05 14:18:28 +03:00
Alexander Tokmakov
8e1e53fb68 fix 2021-08-05 14:14:50 +03:00
Nikolay Degterinsky
1e8badcf05 Improve NLP performance test 2021-08-05 11:07:31 +00:00
Maksim Kita
7fdf3cc263
Merge pull request #27180 from kitaisreal/storage-system-replicas-added-column-replica-is-active
Storage system replicas added column replica is active
2021-08-05 12:46:53 +03:00
alexey-milovidov
975e0a4d47
Merge pull request #27182 from amosbird/logquerykind
Try our best to log query_kind
2021-08-05 12:43:13 +03:00
Vladimir C
a774151dec
Merge pull request #27177 from kolsys/server-play-allow-params 2021-08-05 12:10:57 +03:00
Vladimir C
d9b8936256
Update programs/server/play.html 2021-08-05 12:04:13 +03:00
kssenii
e8dd257468 Update DatabaseFactory.cpp 2021-08-05 09:04:00 +00:00
Amos Bird
45a86b1aa4
Remove silly and wrong optimization 2021-08-05 17:01:15 +08:00
Maksim Kita
2ca6b2cfc0
Merge pull request #27155 from kitaisreal/parse-int-unsafe-updated
Updated readIntTextUnsafe
2021-08-05 11:37:22 +03:00
Maksim Kita
e64e89eeab Reverted libunwind 2021-08-05 11:32:53 +03:00
Maksim Kita
aabb1d04bd
Merge pull request #27190 from ClickHouse/aku/perf-settings
properly check the settings in perf test
2021-08-05 10:56:39 +03:00
Maksim Kita
6536d9041b
Merge pull request #27195 from azat/fix-sys-block-polling
Fix polling of /sys/block
2021-08-05 10:32:01 +03:00
kssenii
1e38d48364 Fixes 2021-08-05 07:25:47 +00:00
Kseniia Sumarokova
3d347065a8
Merge pull request #27194 from azat/query_log_used-on-error
Save information about used functions/tables/... into query_log on error
2021-08-05 09:15:09 +03:00
Amos Bird
a1dd7e5c97
Split mutex into individual regexp construction. 2021-08-05 13:59:47 +08:00
Amos Bird
665f735044
Add some test 2021-08-05 10:50:11 +08:00
Azat Khuzhin
dee27fcbb9 Fix on-disk format breakage for secondary indices over Nullable column
[1] breaks on disk format (and the relevant change in the:

  [1]: https://github.com/ClickHouse/ClickHouse/pull/12455#discussion_r682830812

Too bad that I checked this patchset only for compatibility after
reverting this patch [2] (use case: I've applied it manually, then
revert it, and data skipping indexes over Nullable column had been
broken)

  [2]: https://github.com/ClickHouse/ClickHouse/pull/12455#issuecomment-823423772

But this patchset actually breaks compatibility with older versions of
clickhouse for Nullable data skipping indexes after simple upgrade:

Here is a simple reproducer:

    --
    -- run this with 21.6 or similar (i.e. w/o this patch)
    --

    CREATE TABLE data
    (
        `key` Int,
        `value` Nullable(Int),
        INDEX value_index value TYPE minmax GRANULARITY 1
    )
    ENGINE = MergeTree
    ORDER BY key;

    INSERT INTO data SELECT
        number,
        number
    FROM numbers(10000);

    SELECT * FROM data WHERE value = 20000 SETTINGS force_data_skipping_indices = 'value_index' SETTINGS force_data_skipping_indices = 'value_index', max_rows_to_read=1;

Now upgrade and run the query again:

    SELECT * FROM data WHERE value = 20000 SETTINGS force_data_skipping_indices = 'value_index' SETTINGS force_data_skipping_indices = 'value_index', max_rows_to_read=1;

And it will fail because of on disk format changes:

    $ ll --time-style=+ data/*/data/all_1_1_0/skp*.idx
    -rw-r----- 1 azat azat 36  data/with_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx
    -rw-r----- 1 azat azat 37  data/without_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx

    $ md5sum data/*/data/all_1_1_0/skp*.idx
    a19c95c4a14506c65665a1e30ab404bf  data/with_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx
    e50e2fcfa873b232196623d56ab26105  data/without_nullable_patch/data/all_1_1_0/skp_idx_value_index.idx

Note, that there is no stable release with this patch included yet, so
no need to backport.

Also note that you may create data skipping indexes over Nullable
column even before [3].

  [3]: https://github.com/ClickHouse/ClickHouse/pull/12455

v2: break cases when granulas has Null in values due to backward
compatibility
2021-08-05 00:19:38 +03:00
Azat Khuzhin
f710f1e954 Cover data skipping indices on disk format (compare with 21.6) 2021-08-05 00:19:32 +03:00
kssenii
f06703a7c9 Support schema for postgres database engine 2021-08-04 20:52:45 +00:00
Azat Khuzhin
8a7c9e1124 Fix polling of /sys/block
- rescan /sys/block on errors (disk had been replaced and you will got
  ENOENT)
- rescan /sys/block periodically (each 5m), for newly added devices
  (i.e. new disk to RAID array can be added)
2021-08-04 22:41:53 +03:00
Anton Popov
2b6dc35d9f
Merge pull request #27122 from amosbird/datedatetimecomp
Specialize date time comparision.
2021-08-04 21:44:48 +03:00
Azat Khuzhin
7a47327980 Fix used_storages by using log_queries from local context
I don't have log_queries enabled by default.
2021-08-04 21:44:19 +03:00
Azat Khuzhin
643c31d6f3 Save information about used functions/tables/... into query_log on error 2021-08-04 21:44:18 +03:00
Alexander Tokmakov
d4fbd7107e try make flags more readable 2021-08-04 21:14:59 +03:00
Anton Popov
9586bb7e90 fix pvs 2021-08-04 20:42:22 +03:00
tavplubix
538958aee6
Delete 01160_detached_parts.sql 2021-08-04 20:05:57 +03:00
Ilya Yatsishin
553fed9ad5
Merge pull request #27095 from qoega/amqp-cpp-update 2021-08-04 19:48:52 +03:00
Alexander Kuzmenkov
cfcb0e4b22 properly check the settings in perf test 2021-08-04 19:41:21 +03:00
Anton Popov
915ef50c2d optimize reading in order of key more 2021-08-04 18:18:03 +03:00
Alexander Kuzmenkov
b190e499ee fixup 2021-08-04 17:46:25 +03:00
Alexander Kuzmenkov
0730e685b0 Mark window functions ready for general use. 2021-08-04 17:45:32 +03:00