Commit Graph

15566 Commits

Author SHA1 Message Date
Vitaly Baranov
2de6e8e575 Change type of RowPolicyKind: bool -> enum. 2022-02-17 14:18:10 +07:00
Mikhail f. Shiryaev
0c41564b27
Add the rollback command logging on success run 2022-02-16 20:51:28 +01:00
Mikhail f. Shiryaev
015c0ab611
Solve the issue with wrong initial version 2022-02-16 17:46:43 +01:00
Mikhail f. Shiryaev
b2f3a4ccab
Fix issues with labeling 2022-02-16 17:42:44 +01:00
Azat Khuzhin
774744a86d Fix allow_experimental_projection_optimization with enable_global_with_statement
allow_experimental_projection_optimization requires one more
InterpreterSelectQuery, which with enable_global_with_statement will
apply ApplyWithAliasVisitor if the query is not subquery.

But this should not be done for queries from
MergeTreeData::getQueryProcessingStage()/getQueryProcessingStageWithAggregateProjections()
since this will duplicate WITH statements over and over.

This will also fix scalar.xml perf tests, that leads to the following
error now:

    scalar.query0.prewarm0: DB::Exception: Stack size too large.

And since it has very long query in the log, this leads to the following
perf test error:

    _csv.Error: field larger than field limit (131072)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-16 19:14:47 +03:00
Vladimir C
67a8b55066
rollback 00809_add_days_segfault 2022-02-16 16:38:18 +01:00
Mikhail f. Shiryaev
00c8d74878
Reorder Release class 2022-02-16 15:59:51 +01:00
Mikhail f. Shiryaev
799d0bc580
Clean stale remainings, create necessary labels for prestable 2022-02-16 15:56:49 +01:00
vdimir
65452ac089
Fix checkOverflow in FunctionDateOrDateTimeAddInterval 2022-02-16 14:30:37 +00:00
Mikhail f. Shiryaev
3f295f9429
Merge pull request #34644 from ClickHouse/fix-release-ci
Fix release ci
2022-02-16 14:33:55 +01:00
Mikhail f. Shiryaev
4f84406136
Merge pull request #34641 from ClickHouse/version-and-release
refactor version_helper, create release script
2022-02-16 14:00:55 +01:00
Mikhail f. Shiryaev
14a1fa40e7
Fix the issue with ReleaseCI PRInfo 2022-02-16 13:33:10 +01:00
Mikhail f. Shiryaev
e9c95d05b1
Create a release script 2022-02-16 12:17:08 +01:00
Mikhail f. Shiryaev
e338396a76
Use regexps from git_helper 2022-02-16 12:16:44 +01:00
Mikhail f. Shiryaev
546cee5512
Huge refactoring of version_helper 2022-02-16 12:16:42 +01:00
Mikhail f. Shiryaev
cac6f1cd69
Apply black to version_helper 2022-02-16 12:16:40 +01:00
Nikolai Kochetov
f9d2dae88e
Merge pull request #34424 from yakov-olkhovskiy/ephemeral-column
Ephemeral column issue #9436
2022-02-16 12:04:57 +01:00
Kruglov Pavel
dd863ca2a0
Merge branch 'master' into fix-url-globs 2022-02-16 12:45:31 +03:00
Kruglov Pavel
adf58ea1ce
Merge pull request #34490 from Avogar/fix-client
Refactor client fault tolerant connection
2022-02-16 12:39:46 +03:00
Kruglov Pavel
8580d76bdd
Merge pull request #34503 from Avogar/s3-signatures
Add one more signature for s3 table function
2022-02-16 12:30:11 +03:00
zzsmdfj
4dcb411f4f to #31092_add_encodeURLComponent_function 2022-02-16 10:19:20 +08:00
Mikhail f. Shiryaev
0e04279e45
Revert "Timeout fast tests" 2022-02-15 23:50:21 +01:00
Maksim Kita
22821ccac9
Merge pull request #34613 from nikitamikhaylov/parallel-replicas-bugs-1
Fixed the assertion in case of using `allow_experimental_parallel_reading_from_replicas` with `max_parallel_replicas` equals to 1
2022-02-15 21:29:41 +01:00
Anton Popov
72e75fdaf5
Merge pull request #34601 from CurtizJ/filtering-by-sparse-columns
Support filtering by sparse columns without conversion to full
2022-02-15 23:26:13 +03:00
Maksim Kita
9b1afa6dda
Merge pull request #34614 from ClickHouse/timeout-fast-tests
Timeout fast tests
2022-02-15 20:47:19 +01:00
Maksim Kita
100389b92f
Merge pull request #34615 from Algunenano/test_19222
Add test for #19222
2022-02-15 20:42:51 +01:00
vdimir
a5c34fafd4
Check overflow in addSeconds/Minues/etc functions 2022-02-15 19:04:59 +00:00
Raúl Marín
3bac81e4f3 Add test for #19222 2022-02-15 17:35:01 +01:00
alesapin
bc2d0ee7c7
Merge pull request #34215 from ClickHouse/revert-34211-revert-34153-add_func_tests_over_s3
Add func tests run with s3 and fix several bugs
2022-02-15 19:07:11 +03:00
Mikhail f. Shiryaev
bf59d9c5cd
TOREMOVE: test working timeout 2022-02-15 16:52:06 +01:00
Mikhail f. Shiryaev
996f0893b8
Set timeout for fast tests to 40 minutes 2022-02-15 16:51:19 +01:00
Mikhail f. Shiryaev
a9aeca9a94
Apply black formatter, fix linter notes 2022-02-15 16:50:24 +01:00
Mikhail f. Shiryaev
c906375358
Pass timeout into Popen optionally 2022-02-15 16:48:16 +01:00
Nikita Mikhaylov
e1b0c715fa Done 2022-02-15 15:39:59 +00:00
Dmitry Novik
bb6dad7d0e Fix lock order 2022-02-15 15:04:13 +00:00
Yatsishin Ilya
bbe2c07a7b remove clickhouse-test deb completely 2022-02-15 12:03:51 +00:00
Maksim Kita
37f7e6a216
Merge pull request #34562 from bigo-sg/fix_round
Fix round bug
2022-02-15 13:01:57 +01:00
Anton Popov
5c316ffabe support filtering by sparse columns without convertion to full 2022-02-15 14:30:54 +03:00
Kruglov Pavel
cf454a6539
Merge pull request #34532 from CurtizJ/fix-aggregation-in-order-3
Fix aggregation in order with distributed_aggregation_memory_efficient=0
2022-02-15 14:26:15 +03:00
alesapin
e1fb220bb7 Fix test 2022-02-15 13:31:41 +03:00
Nikolai Kochetov
ab288642f6 Merge branch 'master' into ephemeral-column 2022-02-15 10:03:34 +00:00
alesapin
36b1944cb0 Merge branch 'master' into s3-fix-content-type 2022-02-15 12:39:49 +03:00
taiyang-li
28ff342c4b fix fasttest 2022-02-15 11:38:00 +08:00
Dmitry Novik
31a5e85aa4 Add test for GlobalOvercommitTracker 2022-02-15 00:29:55 +00:00
alexey-milovidov
bc206ec423
Merge pull request #31182 from ClickHouse/memory-overcommit
Memory overcommit
2022-02-14 23:55:02 +03:00
Maksim Kita
70ffcb8e33
Merge pull request #34393 from kitaisreal/sort-added-equal-items-randomization
Sort added equal items ranges randomization
2022-02-14 16:41:19 +01:00
Maksim Kita
b73d1f4b64
Merge pull request #34578 from azat/ARRAY-JOIN-fix-format
Fix indentation in ARRAY JOIN formatting
2022-02-14 16:40:55 +01:00
Dmitry Novik
02cb5a880f Remove integration test 2022-02-14 15:22:07 +00:00
Anton Popov
2399f3e3bb
Merge pull request #34495 from Avogar/improve-local
Improve schema inference in clickhouse-local
2022-02-14 17:27:24 +03:00
Anton Popov
79144f8b91
Update 02211_shcema_inference_from_stdin.sh 2022-02-14 17:26:48 +03:00
vdimir
99ca89c0ca
Fix StorageJoin and Asof or join_use_nulls in pipeline 2022-02-14 14:14:27 +00:00
Maksim Kita
c469fb36ae Fixed tests 2022-02-14 12:59:53 +00:00
Azat Khuzhin
edc35f1254 Fix indentation in ARRAY JOIN formatting
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-14 15:58:58 +03:00
alesapin
bb69455395
Merge pull request #34504 from CurtizJ/ttl-move-if-exists
Support `TTL TO [DISK|VOLUME] [IF EXISTS]`
2022-02-14 14:56:18 +03:00
alesapin
b75d551281 Fix clang tidy and add check for master 2022-02-14 14:37:41 +03:00
Kruglov Pavel
2bf15d6b5b
Merge pull request #34352 from bigo-sg/clickhouse_local_format
Default input and output formats that can be overriden by --input-format and --output-format.
2022-02-14 14:09:59 +03:00
alesapin
b2886a429b Fix lock during fetch 2022-02-14 12:20:27 +03:00
Mikhail f. Shiryaev
1e82b04de3
Apply black formatter to ci-runner to trigger license/cla 2022-02-14 01:32:22 +01:00
Mikhail f. Shiryaev
9340aab154
Clean kerberos keytab between running 2022-02-13 22:01:46 +01:00
Mikhail f. Shiryaev
23546ab825
Use the current kerberized-haddop image 2022-02-13 22:01:45 +01:00
alesapin
89373155fc Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-13 21:07:54 +03:00
Yakov Olkhovskiy
579fe6c97a major rework, transform added to the insert pipe 2022-02-13 17:42:59 +00:00
Maksim Kita
1d69737395 Fixed tests 2022-02-13 15:10:44 +00:00
Maksim Kita
7cbf18ef59 Fixed tests 2022-02-13 15:10:44 +00:00
Maksim Kita
3bc70250ae Fixed tests 2022-02-13 15:10:44 +00:00
Maksim Kita
05a6d8e118 Fixed tests 2022-02-13 15:10:44 +00:00
Maksim Kita
478ad91b7d Fixed tests 2022-02-13 15:10:44 +00:00
Maksim Kita
91bc9cd4cf
Merge pull request #34499 from vitlibar/grpc-send-output-format-back-to-client
gRPC: Send output format back to client
2022-02-13 15:34:32 +01:00
Maksim Kita
340614e5ec
Merge pull request #34489 from vitlibar/make-create-row-policy-privilege-table-level
Privileges CREATE/ALTER/DROP ROW POLICY are table-level now
2022-02-13 15:15:49 +01:00
Maksim Kita
9ae2271922
Merge pull request #34506 from freedomDR/fix_lowcardinality_group_by
fix lowcardinality on group by of any model
2022-02-13 15:07:49 +01:00
Maksim Kita
380d9afb2c
Merge pull request #34557 from bharatnc/ncb/geoToH3-update
check and get columns in geoToH3 func
2022-02-13 14:29:45 +01:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI (#34517)
* test/fuzzer: preserve core

This may help to capture things like in [1]:

    Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: do not run 'info locals' since 'backtrace full' includes it

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: try capture backtrace from all threads

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test/stress: fix path for core artifacts

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes: #33389

* test/fuzzer: store core file in artifacts

v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-13 15:02:15 +03:00
taiyang-li
de057fc619 add tests 2022-02-13 18:58:24 +08:00
freedomDR
8e5ba9e778 Avoid crash in case of GROUP BY LowCardinality(Nullable(String)) column and group_by_overflow_mode='any' 2022-02-13 10:19:58 +00:00
taiyang-li
aabf2aac69 finish all tests 2022-02-13 17:06:58 +08:00
bharatnc
5f661fde48 fix tests 2022-02-12 23:04:09 -08:00
alexey-milovidov
1774836d4f
Merge pull request #34555 from kitaisreal/table-functions-insert-partition-by-refactoring
TableFunctionFile added performance test
2022-02-13 09:08:51 +03:00
Saad Ur Rahman
03f81c8685
[CH-34239] HTTP User-Agent header (#34330)
* [IO] HTTP User-Agent header

Added HTTP User-Agent Header to HTTP requests.

User-Agent: ClickHouse/VERSION_STRING
Input header vectors could potentially contain User-Agent. If so, do not set another.

* [Tests] HTTP User Agent

Added stateless functional test 02205_HTTP_user_agent.

Co-authored-by: Filatenkov Artur <58165623+FArthur-cmd@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-02-13 00:40:11 +03:00
alexey-milovidov
4a2c69c073
Merge pull request #34067 from Algunenano/mv_fixes
Fix  `parallel_view_processing=0` and `view_duration_ms` in views log
2022-02-12 22:36:41 +03:00
Maksim Kita
e2c8ba9ab2 Added performance test 2022-02-12 16:05:35 +00:00
taiyang-li
8e20cf9fac chmod bash shell 2022-02-12 19:30:02 +08:00
alexey-milovidov
747b6b2058
Merge pull request #34528 from CurtizJ/key-condition-float
Fix comparison between integers and floats in index analysis
2022-02-12 10:19:09 +03:00
alexey-milovidov
9bb2eba281
Merge pull request #34429 from ClickHouse/filimonov-SystemAsynchronousInserts
asynchronous_inserts engine AsynchronousInserts -> SystemAsynchronousInserts
2022-02-12 10:08:04 +03:00
Mikhail f. Shiryaev
0f21981694
Add a flag for images architecture 2022-02-11 18:26:45 +01:00
Mikhail f. Shiryaev
bd3812a462
Add a comment 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
dcecbbaf81
Add argument --all for docker imabes builder 2022-02-11 18:26:42 +01:00
tavplubix
6d1fae834a
Merge pull request #34187 from qoega/default-table-engine
Default table engine
2022-02-11 18:14:29 +03:00
Anton Popov
357bdd69c4 fix aggregation in order with distributed_aggregation_memory_efficient=0 2022-02-11 18:09:13 +03:00
Vladimir C
a2b1900333
Merge pull request #34496 from Avogar/jsonl
Support .jsonl extension for JSONEachRow format
2022-02-11 15:44:31 +01:00
Anton Popov
2fcd69baf7 fix comparison with integers and floats in index analysis 2022-02-11 17:15:27 +03:00
taiyang-li
bcd077fdc3 add stateless test 2022-02-11 21:20:57 +08:00
avogar
f423c035d9 Fix test 2022-02-11 14:10:39 +03:00
Vitaly Baranov
e148b43a29 Privileges CREATE/ALTER/DROP ROW POLICY now can be granted on a table or on database.* as well as globally *.* 2022-02-11 12:35:52 +07:00
Maksim Kita
10439c9d3f
Merge pull request #34404 from kitaisreal/sql-user-defined-functions-access-type-fix
For SQLUserDefinedFunctions change privilege level from DATABASE to GLOBAL
2022-02-11 00:21:28 +01:00
Alexander Tokmakov
9e893dfda7 fixes 2022-02-10 23:35:03 +03:00
alesapin
088f8cacf3 Small improvements 2022-02-10 19:50:21 +03:00
Anton Popov
70986a70a1 support TTL TO [DISK|VOLUME] [IF EXISTS] 2022-02-10 19:26:23 +03:00
avogar
a8f83a387c Add one more signature for s3 table function 2022-02-10 18:57:02 +03:00
avogar
a1759d1aa0 Fix test 2022-02-10 18:38:28 +03:00
avogar
a69905d378 Fix 2022-02-10 18:23:52 +03:00
avogar
9bbbbdcdd6 Improve schema inference in clickhouse-local 2022-02-10 18:23:52 +03:00
Kruglov Pavel
13cf8f87e1
Fix test 2022-02-10 18:14:46 +03:00
Vitaly Baranov
cf2e205b08 Add field output_columns to first Result sent in gRPC protocol. 2022-02-10 21:05:56 +07:00
Vitaly Baranov
bd746fd82b Add fields query_id and time_zone to first Result sent in gRPC protocol. 2022-02-10 21:05:47 +07:00
Vitaly Baranov
f8c8eeceea Add field output_format to first Result sent in gRPC protocol. 2022-02-10 21:05:08 +07:00
avogar
9e58ae7577 Support jsonl extension for JSONEachRow format 2022-02-10 16:00:37 +03:00
Kruglov Pavel
738355b724
Merge pull request #34408 from vitlibar/split-and-rename-compression-fields-in-grpc
Split and rename compression fields in gRPC
2022-02-10 15:40:20 +03:00
Kruglov Pavel
bf8c028533
Merge pull request #34479 from Avogar/fix-filesystem-error
Fix possible error 'file_size: Operation not supported'
2022-02-10 14:17:05 +03:00
mergify[bot]
cb3e5f8538
Merge branch 'master' into memory-overcommit 2022-02-10 11:01:43 +00:00
Maksim Kita
f7b70877c8 Fixed tests 2022-02-10 10:27:11 +00:00
avogar
75c56163a0 Refactor client fault tolerant connection 2022-02-10 12:43:08 +03:00
Kruglov Pavel
8385dc27c2
Fix test 2022-02-10 12:19:01 +03:00
avogar
bfa96463ca Fix possible error 'file_size: Operation not supported' 2022-02-10 09:23:27 +03:00
Dmitry Novik
d2e1f66c57 Fix test 2022-02-10 01:01:14 +00:00
Vitaly Baranov
77d9cddfec Replace clickhouse_grpc.proto in a test with symlink. 2022-02-10 02:46:05 +07:00
Vitaly Baranov
1341b4b4de Rename QueryInfo's field result_compression -> transport_compression_type and change its type for better consistency.
Make the previous field obsolete.
2022-02-10 02:46:05 +07:00
Vitaly Baranov
1f6b65d39d gRPC: Split compression_type field into input_compression_type and output_compression_type.
Make the previous field obsolete.
2022-02-10 02:46:05 +07:00
Denny Crane
ca0d78295a test for #13907 toColumnTypeName_toLowCardinality_const 2022-02-09 14:19:50 -04:00
Kruglov Pavel
538830931b
Merge branch 'master' into fix-url-globs 2022-02-09 20:09:56 +03:00
mergify[bot]
d55eadc3c9
Merge branch 'master' into default-table-engine 2022-02-09 17:08:31 +00:00
Yakov Olkhovskiy
eaf660fd61 test is added 2022-02-09 17:04:06 +00:00
Maksim Kita
e0dfc9cd38
Merge pull request #34454 from kitaisreal/dictionary-get-http-json-test
Added test 33734
2022-02-09 17:21:03 +01:00
avogar
84087c1554 Improve schema inference with globs 2022-02-09 19:16:15 +03:00
Nikolai Kochetov
38fb50f736
Merge pull request #33958 from Algunenano/mv_cacheable_scalars
Scalar cache improvements
2022-02-09 16:46:53 +03:00
Maksim Kita
0658fb3256 Added test 33734 2022-02-09 12:06:17 +00:00
Anton Popov
822b58247a
Merge pull request #34132 from CurtizJ/fix-distributed-inserts
Fix inserts to distributed tables in case of change of native protocol
2022-02-09 14:58:44 +03:00
Kruglov Pavel
4ec0f6f091
Merge pull request #33824 from ManagedDatabases/client-fault-tolerant-connection
Client fault tolerant connection
2022-02-09 14:26:11 +03:00
alesapin
10c3e6e546 Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-09 14:14:58 +03:00
mergify[bot]
fd5caa3196
Merge branch 'master' into short-circuit-bug 2022-02-09 11:04:19 +00:00
filimonov
5bef470615
Fix test 2022-02-09 07:48:50 +01:00
Alexey Milovidov
b95f2b5c99 Multipart upload 2022-02-09 05:59:23 +03:00
Alexey Milovidov
cb2718c897 Add a test 2022-02-09 05:56:32 +03:00
mergify[bot]
43459ee7b3
Merge branch 'master' into fixing-test-storage-postgresql 2022-02-09 00:54:18 +00:00
alesapin
36909a986f Fix bug with files remove 2022-02-08 22:21:16 +03:00
DF5HSE
cfefa57485 Merge branch 'master' of github.com:ClickHouse/ClickHouse into client-fault-tolerant-connection 2022-02-08 19:53:55 +03:00
alesapin
02a93cb852 Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-08 19:42:27 +03:00
avogar
08c009ab50 Fix possible error 'Cannot convert column Function to mask' 2022-02-08 18:23:43 +03:00
Nikolai Kochetov
0f7c0c72bd
Merge pull request #34305 from amosbird/projection-fix27
Fix various issues when projection is enabled by default
2022-02-08 17:19:56 +03:00
Anton Popov
496d77c3c3
Merge pull request #33467 from cmsxbc/addressToLineWithInlines
add function addressToLineWithInlines
2022-02-08 17:03:46 +03:00
kssenii
71c57bed8e Fix 2022-02-08 14:52:07 +01:00
Kruglov Pavel
3e216adc17
Merge pull request #34405 from Avogar/fix-segfault-in-url
Fix segfault in schema inference from url
2022-02-08 16:48:37 +03:00
Nicolae Vartolomei
50ee264223 Disable projects when allow_experimental_query_deduplication is in use 2022-02-08 12:16:10 +00:00
Dmitry Novik
b680096f87 Add test for global overcommit tracker 2022-02-08 12:09:01 +00:00
alesapin
31fdd5c6dc
Merge pull request #34364 from vitlibar/fix-inserting-into-temp-tables-via-grpc
Fix inserting to temporary tables via gRPC.
2022-02-08 14:46:48 +03:00
alesapin
b47b0eb1dc Revert accident change 2022-02-08 14:05:01 +03:00
avogar
e118c89bb2 Fix segfault in schema inference from url 2022-02-08 13:40:03 +03:00
Yatsishin Ilya
bcf4303286 Merge remote-tracking branch 'origin' into default-table-engine 2022-02-08 10:35:29 +00:00
Kruglov Pavel
b4fec2af7c
Merge pull request #34065 from Avogar/msgpack
Support UUID in MsgPack format
2022-02-08 11:42:17 +03:00
DF5HSE
c08bc7ad65 Merge branch 'master' of github.com:ClickHouse/ClickHouse into client-fault-tolerant-connection 2022-02-08 11:37:31 +03:00
alesapin
3af6012cb4 Revert "Revert "Revert "Revert "Merge pull request #34219 from ClickHouse/revert-34212-revert-33291-add-pool-to-s3-write-buffer""""
This reverts commit 2bc2ea485e.
2022-02-08 11:01:26 +03:00