Commit Graph

9559 Commits

Author SHA1 Message Date
Azat Khuzhin
fef5f146e7 Fix ENOENT with fsync_part_directory and Vertical merge
fsync of the temporary part directory is superfluous anyway, and besides
that directory is not exists at that time, that will lead to ENOENT
error:

    2022.02.18 17:02:51.634565 [ 35639 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 107. DB::ErrnoException: Cannot open file /var/lib/clickhouse/data/system/text_log/tmp_merge_202202_1864_3192_14/, errno: 2, strerror: No such file or directory. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

    0. DB::Exception::Exception() @ 0xb26ecfa in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    1. DB::throwFromErrnoWithPath() @ 0xb2700ea in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    2. DB::LocalDirectorySyncGuard::LocalDirectorySyncGuard() @ 0x14905531 in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    3. DB::DiskLocal::getDirectorySyncGuard() const @ 0x148af3e3 in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    4. DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x157bef13 in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug

Note, that IMergeTreeDataPart::renameTo() anyway will have fsync for the
directory.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-19 07:50:59 +03:00
Vladimir C
fcec52f49c
Merge pull request #34612 from vdimir/fix_aarch64/01681_arg_min_max_if_fix
Adjust 01681_arg_min_max_if_fix
2022-02-18 18:35:52 +01:00
Vladimir C
9b7d011ee7
Merge pull request #34529 from vdimir/join-nullable-on-pipeline
Apply join_use_nulls on types before join
2022-02-18 18:34:44 +01:00
vdimir
963e859f92
Ignore result in 01681_arg_min_max_if_fix 2022-02-18 14:10:06 +00:00
Maksim Kita
652980eec3
Merge pull request #34714 from azat/fix-custom_partitioning_local
Fix flaky 00502_custom_partitioning_local
2022-02-18 11:27:08 +01:00
Nikolay Degterinsky
c09275f0da
Merge pull request #34368 from usurai/sw
Add startsWith & endsWith function for arrays
2022-02-18 08:34:48 +03:00
Azat Khuzhin
8576195d05 Fix flaky 00502_custom_partitioning_local
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 22:17:11 +03:00
Maksim Kita
562f1ec01a
Merge pull request #34607 from zzsmdfj/issue/#31092_add_encodeURLComponent_function
add encode url component function
2022-02-17 17:57:23 +01:00
Kruglov Pavel
5e8b2228e0
Merge pull request #34561 from bigo-sg/arrow_type_timestamp
Implement transformation between CH DateTime64 and arrow timestamp column
2022-02-17 16:55:17 +03:00
Kruglov Pavel
07098fc597
Merge pull request #34619 from vdimir/fix_aarch64/01662_date_ubsan
Check overflow in addSeconds/Minues/etc functions
2022-02-17 15:55:55 +03:00
alesapin
6df2c9c2d8
Merge pull request #34433 from ClickHouse/s3-fix-content-type
Workaround for bug when AWS mistakenly set Content-Type to XML
2022-02-17 13:11:14 +03:00
Azat Khuzhin
774744a86d Fix allow_experimental_projection_optimization with enable_global_with_statement
allow_experimental_projection_optimization requires one more
InterpreterSelectQuery, which with enable_global_with_statement will
apply ApplyWithAliasVisitor if the query is not subquery.

But this should not be done for queries from
MergeTreeData::getQueryProcessingStage()/getQueryProcessingStageWithAggregateProjections()
since this will duplicate WITH statements over and over.

This will also fix scalar.xml perf tests, that leads to the following
error now:

    scalar.query0.prewarm0: DB::Exception: Stack size too large.

And since it has very long query in the log, this leads to the following
perf test error:

    _csv.Error: field larger than field limit (131072)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-16 19:14:47 +03:00
Vladimir C
67a8b55066
rollback 00809_add_days_segfault 2022-02-16 16:38:18 +01:00
vdimir
65452ac089
Fix checkOverflow in FunctionDateOrDateTimeAddInterval 2022-02-16 14:30:37 +00:00
Nikolai Kochetov
f9d2dae88e
Merge pull request #34424 from yakov-olkhovskiy/ephemeral-column
Ephemeral column issue #9436
2022-02-16 12:04:57 +01:00
Kruglov Pavel
adf58ea1ce
Merge pull request #34490 from Avogar/fix-client
Refactor client fault tolerant connection
2022-02-16 12:39:46 +03:00
zzsmdfj
4dcb411f4f to #31092_add_encodeURLComponent_function 2022-02-16 10:19:20 +08:00
Maksim Kita
22821ccac9
Merge pull request #34613 from nikitamikhaylov/parallel-replicas-bugs-1
Fixed the assertion in case of using `allow_experimental_parallel_reading_from_replicas` with `max_parallel_replicas` equals to 1
2022-02-15 21:29:41 +01:00
Anton Popov
72e75fdaf5
Merge pull request #34601 from CurtizJ/filtering-by-sparse-columns
Support filtering by sparse columns without conversion to full
2022-02-15 23:26:13 +03:00
Maksim Kita
100389b92f
Merge pull request #34615 from Algunenano/test_19222
Add test for #19222
2022-02-15 20:42:51 +01:00
vdimir
a5c34fafd4
Check overflow in addSeconds/Minues/etc functions 2022-02-15 19:04:59 +00:00
Raúl Marín
3bac81e4f3 Add test for #19222 2022-02-15 17:35:01 +01:00
alesapin
bc2d0ee7c7
Merge pull request #34215 from ClickHouse/revert-34211-revert-34153-add_func_tests_over_s3
Add func tests run with s3 and fix several bugs
2022-02-15 19:07:11 +03:00
Nikita Mikhaylov
e1b0c715fa Done 2022-02-15 15:39:59 +00:00
Maksim Kita
37f7e6a216
Merge pull request #34562 from bigo-sg/fix_round
Fix round bug
2022-02-15 13:01:57 +01:00
Anton Popov
5c316ffabe support filtering by sparse columns without convertion to full 2022-02-15 14:30:54 +03:00
Kruglov Pavel
cf454a6539
Merge pull request #34532 from CurtizJ/fix-aggregation-in-order-3
Fix aggregation in order with distributed_aggregation_memory_efficient=0
2022-02-15 14:26:15 +03:00
alesapin
e1fb220bb7 Fix test 2022-02-15 13:31:41 +03:00
Nikolai Kochetov
ab288642f6 Merge branch 'master' into ephemeral-column 2022-02-15 10:03:34 +00:00
alesapin
36b1944cb0 Merge branch 'master' into s3-fix-content-type 2022-02-15 12:39:49 +03:00
taiyang-li
28ff342c4b fix fasttest 2022-02-15 11:38:00 +08:00
alexey-milovidov
bc206ec423
Merge pull request #31182 from ClickHouse/memory-overcommit
Memory overcommit
2022-02-14 23:55:02 +03:00
Maksim Kita
70ffcb8e33
Merge pull request #34393 from kitaisreal/sort-added-equal-items-randomization
Sort added equal items ranges randomization
2022-02-14 16:41:19 +01:00
Maksim Kita
b73d1f4b64
Merge pull request #34578 from azat/ARRAY-JOIN-fix-format
Fix indentation in ARRAY JOIN formatting
2022-02-14 16:40:55 +01:00
Anton Popov
2399f3e3bb
Merge pull request #34495 from Avogar/improve-local
Improve schema inference in clickhouse-local
2022-02-14 17:27:24 +03:00
Anton Popov
79144f8b91
Update 02211_shcema_inference_from_stdin.sh 2022-02-14 17:26:48 +03:00
vdimir
99ca89c0ca
Fix StorageJoin and Asof or join_use_nulls in pipeline 2022-02-14 14:14:27 +00:00
Maksim Kita
c469fb36ae Fixed tests 2022-02-14 12:59:53 +00:00
Azat Khuzhin
edc35f1254 Fix indentation in ARRAY JOIN formatting
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-14 15:58:58 +03:00
alesapin
bb69455395
Merge pull request #34504 from CurtizJ/ttl-move-if-exists
Support `TTL TO [DISK|VOLUME] [IF EXISTS]`
2022-02-14 14:56:18 +03:00
Kruglov Pavel
2bf15d6b5b
Merge pull request #34352 from bigo-sg/clickhouse_local_format
Default input and output formats that can be overriden by --input-format and --output-format.
2022-02-14 14:09:59 +03:00
alesapin
b2886a429b Fix lock during fetch 2022-02-14 12:20:27 +03:00
alesapin
89373155fc Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-13 21:07:54 +03:00
Yakov Olkhovskiy
579fe6c97a major rework, transform added to the insert pipe 2022-02-13 17:42:59 +00:00
Maksim Kita
1d69737395 Fixed tests 2022-02-13 15:10:44 +00:00
Maksim Kita
7cbf18ef59 Fixed tests 2022-02-13 15:10:44 +00:00
Maksim Kita
3bc70250ae Fixed tests 2022-02-13 15:10:44 +00:00
Maksim Kita
05a6d8e118 Fixed tests 2022-02-13 15:10:44 +00:00
Maksim Kita
478ad91b7d Fixed tests 2022-02-13 15:10:44 +00:00
Maksim Kita
340614e5ec
Merge pull request #34489 from vitlibar/make-create-row-policy-privilege-table-level
Privileges CREATE/ALTER/DROP ROW POLICY are table-level now
2022-02-13 15:15:49 +01:00