thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-23 02:00:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
83,717 Commits 8,939 Branches 1,766 Tags 2 GiB
6e568c1530
Commit Graph

15566 Commits

Author SHA1 Message Date
Chao Ma
895396e61a Fix distributed subquery max_query_size limitation inconsistency 2022-02-20 10:07:57 +08:00
Raúl Marín
e0c6014ecd Mention scipy dep in performance bench README 2022-02-20 02:43:28 +01:00
bharatnc
a4cf3303f9 fix fuzzer segfault 2022-02-19 08:41:21 -08:00
Vitaly Baranov
874b2c8dcb
Merge pull request #34596 from vitlibar/allow-restrictive-without-permissive 
Allow restrictive row policies without permissive
 2022-02-19 21:45:28 +07:00
Maksim Kita
0bfac173f9
Merge pull request #34745 from bharatnc/ncb/fixes-to-s2 
fix s2 functions having const columns
 2022-02-19 12:20:25 +01:00
Anton Popov
5ccee4e778
Merge pull request #34739 from azat/fix-fsync_part_directory 
Fix ENOENT with fsync_part_directory and Vertical merge
 2022-02-19 12:21:07 +03:00
bharatnc
233b4486ed add tests 2022-02-18 22:42:39 -08:00
Azat Khuzhin
fef5f146e7 Fix ENOENT with fsync_part_directory and Vertical merge 
fsync of the temporary part directory is superfluous anyway, and besides
that directory is not exists at that time, that will lead to ENOENT
error:

    2022.02.18 17:02:51.634565 [ 35639 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 107. DB::ErrnoException: Cannot open file /var/lib/clickhouse/data/system/text_log/tmp_merge_202202_1864_3192_14/, errno: 2, strerror: No such file or directory. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

    0. DB::Exception::Exception() @ 0xb26ecfa in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    1. DB::throwFromErrnoWithPath() @ 0xb2700ea in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    2. DB::LocalDirectorySyncGuard::LocalDirectorySyncGuard() @ 0x14905531 in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    3. DB::DiskLocal::getDirectorySyncGuard() const @ 0x148af3e3 in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug
    4. DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x157bef13 in /usr/lib/debug/.build-id/01/8c328bd4858d67.debug

Note, that IMergeTreeDataPart::renameTo() anyway will have fsync for the
directory.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-19 07:50:59 +03:00
bharatnc
d9acbf480c fix - skip fast tests 2022-02-18 18:45:15 -08:00
bharatnc
8076dd8cf5 add tests 2022-02-18 16:35:07 -08:00
Mikhail f. Shiryaev
d2cbc5af40
Add patch type for stable/lts releases 2022-02-19 00:13:07 +01:00
Mikhail f. Shiryaev
df9165bbff
Refactoring of Release, add Repo 
- Do not pass Namespace to Release.do
- Decouple repository to another class
 2022-02-19 00:13:00 +01:00
Mikhail f. Shiryaev
0960fbad52
Set selease_branch only once as Release property 2022-02-19 00:10:21 +01:00
Mikhail f. Shiryaev
d2a8cff508
Add release_branch checker 2022-02-19 00:01:42 +01:00
Mikhail f. Shiryaev
0f1565a3a2
Clean-up the code a little bit 2022-02-19 00:01:39 +01:00
alexey-milovidov
9630087131
Update app.py 2022-02-19 00:26:43 +03:00
alexey-milovidov
37fbf7c329
Merge branch 'master' into add-trusted-taiyang-li 2022-02-19 00:25:52 +03:00
Maksim Kita
3dd6b91cbe
Merge pull request #34731 from kitaisreal/performance-tests-fix-h3 
Performance tests fix H3
 2022-02-18 19:21:38 +01:00
Vladimir C
fcec52f49c
Merge pull request #34612 from vdimir/fix_aarch64/01681_arg_min_max_if_fix 
Adjust 01681_arg_min_max_if_fix
 2022-02-18 18:35:52 +01:00
Vladimir C
9b7d011ee7
Merge pull request #34529 from vdimir/join-nullable-on-pipeline 
Apply join_use_nulls on types before join
 2022-02-18 18:34:44 +01:00
Maksim Kita
80b0efb367 Performance tests fix H3 2022-02-18 15:57:54 +00:00
Maksim Kita
0f9f30cc9e Added tests 2022-02-18 15:21:11 +00:00
Vladimir C
a249819c52
Merge pull request #34730 from ucasfl/name 
rename name in ci check
 2022-02-18 16:17:11 +01:00
vdimir
963e859f92
Ignore result in 01681_arg_min_max_if_fix 2022-02-18 14:10:06 +00:00
feng lv
3270e5f636 rename name in ci check 2022-02-18 14:06:16 +00:00
vdimir
4ce64891f9
Add taiyang-li to trusted contributors 2022-02-18 13:59:47 +01:00
Maksim Kita
652980eec3
Merge pull request #34714 from azat/fix-custom_partitioning_local 
Fix flaky 00502_custom_partitioning_local
 2022-02-18 11:27:08 +01:00
Nikolay Degterinsky
c09275f0da
Merge pull request #34368 from usurai/sw 
Add startsWith & endsWith function for arrays
 2022-02-18 08:34:48 +03:00
Azat Khuzhin
8576195d05 Fix flaky 00502_custom_partitioning_local 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 22:17:11 +03:00
Azat Khuzhin
de6547976b tests: update 01502_jemalloc_percpu_arena after jemalloc update 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
ed5a3772a2 tests: make 01505_pipeline_executor_UAF compatible with sanitizers builds 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
77ce66a90c tests: update 01505_pipeline_executor_UAF after jemalloc update 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Maksim Kita
562f1ec01a
Merge pull request #34607 from zzsmdfj/issue/#31092_add_encodeURLComponent_function 
add encode url component function
 2022-02-17 17:57:23 +01:00
Mikhail f. Shiryaev
462b817759
Merge pull request #34624 from ClickHouse/timeout-fast-tests 
Timeout fast tests
 2022-02-17 17:25:12 +01:00
Mikhail f. Shiryaev
e8f927283c
Add timeouts to TeePopen, second attempt 2022-02-17 16:44:34 +01:00
alesapin
8a0153b6d3
Merge pull request #34606 from qoega/no-clickhouse-test-deb 
Remove clickhouse-test deb completely
 2022-02-17 18:13:44 +03:00
Mikhail f. Shiryaev
1aff775574
Apply black formatter, fix linter notes 2022-02-17 16:11:12 +01:00
Kruglov Pavel
5e8b2228e0
Merge pull request #34561 from bigo-sg/arrow_type_timestamp 
Implement transformation between CH DateTime64 and arrow timestamp column
 2022-02-17 16:55:17 +03:00
alesapin
d08e3d1d46
Merge pull request #34680 from ClickHouse/drop-pvs 
Remove PVS test
 2022-02-17 16:25:02 +03:00
Kruglov Pavel
07098fc597
Merge pull request #34619 from vdimir/fix_aarch64/01662_date_ubsan 
Check overflow in addSeconds/Minues/etc functions
 2022-02-17 15:55:55 +03:00
vdimir
7f20d29396
add order by to 01670_dictionary_create_key_expression 2022-02-17 12:39:59 +00:00
vdimir
1bdcf7a215
add use-hyperscan for multimatch tests 2022-02-17 12:39:33 +00:00
Mikhail f. Shiryaev
c3bf9eb2f9
Remove PVS test 2022-02-17 12:59:47 +01:00
Kruglov Pavel
6dcb766879
Merge pull request #34465 from Avogar/fix-url-globs 
Improve schema inference with globs in FIle/S3/HDFS/URL engines
 2022-02-17 13:33:27 +03:00
alesapin
6df2c9c2d8
Merge pull request #34433 from ClickHouse/s3-fix-content-type 
Workaround for bug when AWS mistakenly set Content-Type to XML
 2022-02-17 13:11:14 +03:00
Kruglov Pavel
7411178064
Merge pull request #34650 from azat/fix-projection-optimization 
Fix allow_experimental_projection_optimization with enable_global_with_statement
 2022-02-17 13:09:57 +03:00
Dmitry Novik
c32313b045
Merge branch 'master' into memory-overcommit-test 2022-02-17 00:50:15 -08:00
Vitaly Baranov
a4ef274aa1 Improve restrictive policies without permissive ones: in this case the result filter won't be calculated as False always anymore. 2022-02-17 14:18:15 +07:00
Vitaly Baranov
4b9db33ad7 The command "SHOW CREATE ROW POLICY" now shows "AS permissive" or "AS restrictive" before "TO" clause. 2022-02-17 14:18:15 +07:00
Vitaly Baranov
f4da321dbb SHOW CREATE ROW POLICY now always outputs "AS permissive" or "AS restrictive". 2022-02-17 14:18:15 +07:00
Vitaly Baranov
2de6e8e575 Change type of RowPolicyKind: bool -> enum. 2022-02-17 14:18:10 +07:00
Mikhail f. Shiryaev
0c41564b27
Add the rollback command logging on success run 2022-02-16 20:51:28 +01:00
Mikhail f. Shiryaev
015c0ab611
Solve the issue with wrong initial version 2022-02-16 17:46:43 +01:00
Mikhail f. Shiryaev
b2f3a4ccab
Fix issues with labeling 2022-02-16 17:42:44 +01:00
Azat Khuzhin
774744a86d Fix allow_experimental_projection_optimization with enable_global_with_statement 
allow_experimental_projection_optimization requires one more
InterpreterSelectQuery, which with enable_global_with_statement will
apply ApplyWithAliasVisitor if the query is not subquery.

But this should not be done for queries from
MergeTreeData::getQueryProcessingStage()/getQueryProcessingStageWithAggregateProjections()
since this will duplicate WITH statements over and over.

This will also fix scalar.xml perf tests, that leads to the following
error now:

    scalar.query0.prewarm0: DB::Exception: Stack size too large.

And since it has very long query in the log, this leads to the following
perf test error:

    _csv.Error: field larger than field limit (131072)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-16 19:14:47 +03:00
Vladimir C
67a8b55066
rollback 00809_add_days_segfault 2022-02-16 16:38:18 +01:00
Mikhail f. Shiryaev
00c8d74878
Reorder Release class 2022-02-16 15:59:51 +01:00
Mikhail f. Shiryaev
799d0bc580
Clean stale remainings, create necessary labels for prestable 2022-02-16 15:56:49 +01:00
vdimir
65452ac089
Fix checkOverflow in FunctionDateOrDateTimeAddInterval 2022-02-16 14:30:37 +00:00
Mikhail f. Shiryaev
3f295f9429
Merge pull request #34644 from ClickHouse/fix-release-ci 
Fix release ci
 2022-02-16 14:33:55 +01:00
Mikhail f. Shiryaev
4f84406136
Merge pull request #34641 from ClickHouse/version-and-release 
refactor version_helper, create release script
 2022-02-16 14:00:55 +01:00
Mikhail f. Shiryaev
14a1fa40e7
Fix the issue with ReleaseCI PRInfo 2022-02-16 13:33:10 +01:00
Mikhail f. Shiryaev
e9c95d05b1
Create a release script 2022-02-16 12:17:08 +01:00
Mikhail f. Shiryaev
e338396a76
Use regexps from git_helper 2022-02-16 12:16:44 +01:00
Mikhail f. Shiryaev
546cee5512
Huge refactoring of version_helper 2022-02-16 12:16:42 +01:00
Mikhail f. Shiryaev
cac6f1cd69
Apply black to version_helper 2022-02-16 12:16:40 +01:00
Nikolai Kochetov
f9d2dae88e
Merge pull request #34424 from yakov-olkhovskiy/ephemeral-column 
Ephemeral column issue #9436
 2022-02-16 12:04:57 +01:00
Kruglov Pavel
dd863ca2a0
Merge branch 'master' into fix-url-globs 2022-02-16 12:45:31 +03:00
Kruglov Pavel
adf58ea1ce
Merge pull request #34490 from Avogar/fix-client 
Refactor client fault tolerant connection
 2022-02-16 12:39:46 +03:00
Kruglov Pavel
8580d76bdd
Merge pull request #34503 from Avogar/s3-signatures 
Add one more signature for s3 table function
 2022-02-16 12:30:11 +03:00
zzsmdfj
4dcb411f4f to #31092_add_encodeURLComponent_function 2022-02-16 10:19:20 +08:00
Mikhail f. Shiryaev
0e04279e45
Revert "Timeout fast tests" 2022-02-15 23:50:21 +01:00
Maksim Kita
22821ccac9
Merge pull request #34613 from nikitamikhaylov/parallel-replicas-bugs-1 
Fixed the assertion in case of using `allow_experimental_parallel_reading_from_replicas` with `max_parallel_replicas` equals to 1
 2022-02-15 21:29:41 +01:00
Anton Popov
72e75fdaf5
Merge pull request #34601 from CurtizJ/filtering-by-sparse-columns 
Support filtering by sparse columns without conversion to full
 2022-02-15 23:26:13 +03:00
Maksim Kita
9b1afa6dda
Merge pull request #34614 from ClickHouse/timeout-fast-tests 
Timeout fast tests
 2022-02-15 20:47:19 +01:00
Maksim Kita
100389b92f
Merge pull request #34615 from Algunenano/test_19222 
Add test for #19222
 2022-02-15 20:42:51 +01:00
vdimir
a5c34fafd4
Check overflow in addSeconds/Minues/etc functions 2022-02-15 19:04:59 +00:00
Raúl Marín
3bac81e4f3 Add test for #19222 2022-02-15 17:35:01 +01:00
alesapin
bc2d0ee7c7
Merge pull request #34215 from ClickHouse/revert-34211-revert-34153-add_func_tests_over_s3 
Add func tests run with s3 and fix several bugs
 2022-02-15 19:07:11 +03:00
Mikhail f. Shiryaev
bf59d9c5cd
TOREMOVE: test working timeout 2022-02-15 16:52:06 +01:00
Mikhail f. Shiryaev
996f0893b8
Set timeout for fast tests to 40 minutes 2022-02-15 16:51:19 +01:00
Mikhail f. Shiryaev
a9aeca9a94
Apply black formatter, fix linter notes 2022-02-15 16:50:24 +01:00
Mikhail f. Shiryaev
c906375358
Pass timeout into Popen optionally 2022-02-15 16:48:16 +01:00
Nikita Mikhaylov
e1b0c715fa Done 2022-02-15 15:39:59 +00:00
Dmitry Novik
bb6dad7d0e Fix lock order 2022-02-15 15:04:13 +00:00
Yatsishin Ilya
bbe2c07a7b remove clickhouse-test deb completely 2022-02-15 12:03:51 +00:00
Maksim Kita
37f7e6a216
Merge pull request #34562 from bigo-sg/fix_round 
Fix round bug
 2022-02-15 13:01:57 +01:00
Anton Popov
5c316ffabe support filtering by sparse columns without convertion to full 2022-02-15 14:30:54 +03:00
Kruglov Pavel
cf454a6539
Merge pull request #34532 from CurtizJ/fix-aggregation-in-order-3 
Fix aggregation in order with distributed_aggregation_memory_efficient=0
 2022-02-15 14:26:15 +03:00
alesapin
e1fb220bb7 Fix test 2022-02-15 13:31:41 +03:00
Nikolai Kochetov
ab288642f6 Merge branch 'master' into ephemeral-column 2022-02-15 10:03:34 +00:00
alesapin
36b1944cb0 Merge branch 'master' into s3-fix-content-type 2022-02-15 12:39:49 +03:00
taiyang-li
28ff342c4b fix fasttest 2022-02-15 11:38:00 +08:00
Dmitry Novik
31a5e85aa4 Add test for GlobalOvercommitTracker 2022-02-15 00:29:55 +00:00
alexey-milovidov
bc206ec423
Merge pull request #31182 from ClickHouse/memory-overcommit 
Memory overcommit
 2022-02-14 23:55:02 +03:00
Maksim Kita
70ffcb8e33
Merge pull request #34393 from kitaisreal/sort-added-equal-items-randomization 
Sort added equal items ranges randomization
 2022-02-14 16:41:19 +01:00
Maksim Kita
b73d1f4b64
Merge pull request #34578 from azat/ARRAY-JOIN-fix-format 
Fix indentation in ARRAY JOIN formatting
 2022-02-14 16:40:55 +01:00
Dmitry Novik
02cb5a880f Remove integration test 2022-02-14 15:22:07 +00:00
Anton Popov
2399f3e3bb
Merge pull request #34495 from Avogar/improve-local 
Improve schema inference in clickhouse-local
 2022-02-14 17:27:24 +03:00
Anton Popov
79144f8b91
Update 02211_shcema_inference_from_stdin.sh 2022-02-14 17:26:48 +03:00