Commit Graph

15503 Commits

Author SHA1 Message Date
Alexandre Snarskii
7d87a446d1 make arrayCompact behave as other higher-order functions 2022-02-21 15:40:03 +03:00
alexey-milovidov
26d0e5438c
Merge pull request #33057 from azat/jemalloc-dev-branch
[RFC] Update jemalloc to 5.3RC
2022-02-20 14:19:41 +03:00
alexey-milovidov
a126ca7650
Merge pull request #34760 from Algunenano/any_performance
Improve the performance of the `ANY` aggregation function by acting over batches.
2022-02-20 13:58:41 +03:00
Vladimir C
5284083647
Merge pull request #34683 from vdimir/fix_aarch64/position_utf_8
Fix `positionUTF8` on aarch64
2022-02-20 11:35:40 +01:00
Raúl Marín
e0c6014ecd Mention scipy dep in performance bench README 2022-02-20 02:43:28 +01:00
Vitaly Baranov
874b2c8dcb
Merge pull request #34596 from vitlibar/allow-restrictive-without-permissive
Allow restrictive row policies without permissive
2022-02-19 21:45:28 +07:00
Maksim Kita
0bfac173f9
Merge pull request #34745 from bharatnc/ncb/fixes-to-s2
fix s2 functions having const columns
2022-02-19 12:20:25 +01:00
Anton Popov
5ccee4e778
Merge pull request #34739 from azat/fix-fsync_part_directory
Fix ENOENT with fsync_part_directory and Vertical merge
2022-02-19 12:21:07 +03:00
bharatnc
233b4486ed add tests 2022-02-18 22:42:39 -08:00
Azat Khuzhin
fef5f146e7 Fix ENOENT with fsync_part_directory and Vertical merge
fsync of the temporary part directory is superfluous anyway, and besides
that directory is not exists at that time, that will lead to ENOENT
error:

    2022.02.18 17:02:51.634565 [ 35639 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 107. DB::ErrnoException: Cannot open file /var/lib/clickhouse/data/system/text_log/tmp_merge_202202_1864_3192_14/, errno: 2, strerror: No such file or directory. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

    0. DB::Exception::Exception() @ 0xb26ecfa in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    1. DB::throwFromErrnoWithPath() @ 0xb2700ea in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    2. DB::LocalDirectorySyncGuard::LocalDirectorySyncGuard() @ 0x14905531 in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    3. DB::DiskLocal::getDirectorySyncGuard() const @ 0x148af3e3 in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    4. DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x157bef13 in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug

Note, that IMergeTreeDataPart::renameTo() anyway will have fsync for the
directory.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-19 07:50:59 +03:00
alexey-milovidov
9630087131
Update app.py 2022-02-19 00:26:43 +03:00
alexey-milovidov
37fbf7c329
Merge branch 'master' into add-trusted-taiyang-li 2022-02-19 00:25:52 +03:00
Maksim Kita
3dd6b91cbe
Merge pull request #34731 from kitaisreal/performance-tests-fix-h3
Performance tests fix H3
2022-02-18 19:21:38 +01:00
Vladimir C
fcec52f49c
Merge pull request #34612 from vdimir/fix_aarch64/01681_arg_min_max_if_fix
Adjust 01681_arg_min_max_if_fix
2022-02-18 18:35:52 +01:00
Vladimir C
9b7d011ee7
Merge pull request #34529 from vdimir/join-nullable-on-pipeline
Apply join_use_nulls on types before join
2022-02-18 18:34:44 +01:00
Maksim Kita
80b0efb367 Performance tests fix H3 2022-02-18 15:57:54 +00:00
Vladimir C
a249819c52
Merge pull request #34730 from ucasfl/name
rename name in ci check
2022-02-18 16:17:11 +01:00
vdimir
963e859f92
Ignore result in 01681_arg_min_max_if_fix 2022-02-18 14:10:06 +00:00
feng lv
3270e5f636 rename name in ci check 2022-02-18 14:06:16 +00:00
vdimir
4ce64891f9
Add taiyang-li to trusted contributors 2022-02-18 13:59:47 +01:00
Maksim Kita
652980eec3
Merge pull request #34714 from azat/fix-custom_partitioning_local
Fix flaky 00502_custom_partitioning_local
2022-02-18 11:27:08 +01:00
Nikolay Degterinsky
c09275f0da
Merge pull request #34368 from usurai/sw
Add startsWith & endsWith function for arrays
2022-02-18 08:34:48 +03:00
Azat Khuzhin
8576195d05 Fix flaky 00502_custom_partitioning_local
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 22:17:11 +03:00
Azat Khuzhin
de6547976b tests: update 01502_jemalloc_percpu_arena after jemalloc update
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
ed5a3772a2 tests: make 01505_pipeline_executor_UAF compatible with sanitizers builds
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Azat Khuzhin
77ce66a90c tests: update 01505_pipeline_executor_UAF after jemalloc update
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-17 21:25:58 +03:00
Maksim Kita
562f1ec01a
Merge pull request #34607 from zzsmdfj/issue/#31092_add_encodeURLComponent_function
add encode url component function
2022-02-17 17:57:23 +01:00
Mikhail f. Shiryaev
462b817759
Merge pull request #34624 from ClickHouse/timeout-fast-tests
Timeout fast tests
2022-02-17 17:25:12 +01:00
Mikhail f. Shiryaev
e8f927283c
Add timeouts to TeePopen, second attempt 2022-02-17 16:44:34 +01:00
alesapin
8a0153b6d3
Merge pull request #34606 from qoega/no-clickhouse-test-deb
Remove clickhouse-test deb completely
2022-02-17 18:13:44 +03:00
Mikhail f. Shiryaev
1aff775574
Apply black formatter, fix linter notes 2022-02-17 16:11:12 +01:00
Kruglov Pavel
5e8b2228e0
Merge pull request #34561 from bigo-sg/arrow_type_timestamp
Implement transformation between CH DateTime64 and arrow timestamp column
2022-02-17 16:55:17 +03:00
alesapin
d08e3d1d46
Merge pull request #34680 from ClickHouse/drop-pvs
Remove PVS test
2022-02-17 16:25:02 +03:00
Kruglov Pavel
07098fc597
Merge pull request #34619 from vdimir/fix_aarch64/01662_date_ubsan
Check overflow in addSeconds/Minues/etc functions
2022-02-17 15:55:55 +03:00
vdimir
7f20d29396
add order by to 01670_dictionary_create_key_expression 2022-02-17 12:39:59 +00:00
vdimir
1bdcf7a215
add use-hyperscan for multimatch tests 2022-02-17 12:39:33 +00:00
Mikhail f. Shiryaev
c3bf9eb2f9
Remove PVS test 2022-02-17 12:59:47 +01:00
Kruglov Pavel
6dcb766879
Merge pull request #34465 from Avogar/fix-url-globs
Improve schema inference with globs in FIle/S3/HDFS/URL engines
2022-02-17 13:33:27 +03:00
alesapin
6df2c9c2d8
Merge pull request #34433 from ClickHouse/s3-fix-content-type
Workaround for bug when AWS mistakenly set Content-Type to XML
2022-02-17 13:11:14 +03:00
Kruglov Pavel
7411178064
Merge pull request #34650 from azat/fix-projection-optimization
Fix allow_experimental_projection_optimization with enable_global_with_statement
2022-02-17 13:09:57 +03:00
Dmitry Novik
c32313b045
Merge branch 'master' into memory-overcommit-test 2022-02-17 00:50:15 -08:00
Vitaly Baranov
a4ef274aa1 Improve restrictive policies without permissive ones: in this case the result filter won't be calculated as False always anymore. 2022-02-17 14:18:15 +07:00
Vitaly Baranov
4b9db33ad7 The command "SHOW CREATE ROW POLICY" now shows "AS permissive" or "AS restrictive" before "TO" clause. 2022-02-17 14:18:15 +07:00
Vitaly Baranov
f4da321dbb SHOW CREATE ROW POLICY now always outputs "AS permissive" or "AS restrictive". 2022-02-17 14:18:15 +07:00
Vitaly Baranov
2de6e8e575 Change type of RowPolicyKind: bool -> enum. 2022-02-17 14:18:10 +07:00
Mikhail f. Shiryaev
0c41564b27
Add the rollback command logging on success run 2022-02-16 20:51:28 +01:00
Mikhail f. Shiryaev
015c0ab611
Solve the issue with wrong initial version 2022-02-16 17:46:43 +01:00
Mikhail f. Shiryaev
b2f3a4ccab
Fix issues with labeling 2022-02-16 17:42:44 +01:00
Azat Khuzhin
774744a86d Fix allow_experimental_projection_optimization with enable_global_with_statement
allow_experimental_projection_optimization requires one more
InterpreterSelectQuery, which with enable_global_with_statement will
apply ApplyWithAliasVisitor if the query is not subquery.

But this should not be done for queries from
MergeTreeData::getQueryProcessingStage()/getQueryProcessingStageWithAggregateProjections()
since this will duplicate WITH statements over and over.

This will also fix scalar.xml perf tests, that leads to the following
error now:

    scalar.query0.prewarm0: DB::Exception: Stack size too large.

And since it has very long query in the log, this leads to the following
perf test error:

    _csv.Error: field larger than field limit (131072)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-16 19:14:47 +03:00
Vladimir C
67a8b55066
rollback 00809_add_days_segfault 2022-02-16 16:38:18 +01:00