Commit Graph

103868 Commits

Author SHA1 Message Date
Alexander Gololobov
1eb24e13b3 Inrease step to speed up 02473_multistep_prewhere test 2022-12-28 18:07:35 +01:00
Alexander Gololobov
c4a01cbd5b Fix for propely cleaning rows_per_granule_original between prewhere steps 2022-12-28 18:07:35 +01:00
Alexander Gololobov
0379ab6a52 Cover more cases 02473_multistep_prewhere test 2022-12-28 18:07:35 +01:00
Alexander Gololobov
abbb58107c Fix for "out of bound" in ColumnVector::insertRangeFrom called from shrink() 2022-12-28 18:07:35 +01:00
Alexander Gololobov
79874e8733 Fix for "Invalid number of rows in Chunk" 2022-12-28 18:07:35 +01:00
Alexander Gololobov
b75ea86583 Test various combinations of deleted and policy-filtered rows 2022-12-28 18:07:35 +01:00
Alexander Gololobov
bdf51545f7 Added FilterWithCachedCount class instead of caching counts in filter_bytes_map 2022-12-28 18:07:35 +01:00
Alexander Gololobov
36135ab552 Test different block sizes to trigger different prewhere filtering code paths 2022-12-28 18:07:35 +01:00
Azat Khuzhin
31a88d4eae Fix PREWHERE with row-level filters (when row filter is always true/false)
In case of row-level filters optimized out, i.e. converted to
always true/false, it is possible for MergeTreeRangeReader to reuse
incorrect statistics for the filter (countBytesInResultFilter()), and
because of this it simply does not apply other filters, since it assume
that this filter does not need to filter anything.

Fixes: #40956
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-28 18:07:35 +01:00
Alexander Gololobov
bf64e3eaca Test with different index_granularity to hit different PREWHERE code paths 2022-12-28 18:07:35 +01:00
Alexander Gololobov
d44392b366 Checking the fix for "Invalid number of rows in Chunk" 2022-12-28 18:07:35 +01:00
Alexander Gololobov
6730ecc2a3 A test to repro "Invalid number of rows in Chunk" 2022-12-28 18:07:35 +01:00
Nikolay Degterinsky
a8c9851110
Merge pull request #44639 from evillique/fix_parser
Fix lambdas parsing
2022-12-28 17:39:22 +01:00
Anton Popov
80a18df09f
Merge pull request #44642 from CurtizJ/fix-async-insert-test
Fix test `02015_async_inserts_2`
2022-12-28 16:11:38 +01:00
Vitaly Baranov
8a2fbbe88c
Merge pull request #43947 from azat/backups/dedup
RFC: Add ability to disable deduplication for BACKUP
2022-12-28 15:24:53 +01:00
Alexey Milovidov
ab719f4432
Merge pull request #44358 from ClickHouse/fix-30975
Fix support for complex parameters of parametric aggregate functions, #30975
2022-12-28 16:38:41 +03:00
Alexey Milovidov
1b4121459d
Merge pull request #44645 from ClickHouse/keeper-test-fix
Fix flaky test `test_keeper_multinode_simple`
2022-12-28 16:38:17 +03:00
Alexey Milovidov
9f74843b17
Merge pull request #44660 from vitlibar/fix-flaky-test_backup_restore_on_cluster
Fix flaky test test_backup_restore_on_cluster
2022-12-28 16:33:36 +03:00
Kruglov Pavel
d42d9f70c8
Merge pull request #44225 from Avogar/fix-datetime-timezone
Forbid paths in timezone names
2022-12-28 13:57:39 +01:00
Vitaly Baranov
b211dff013 Increase the create table timeout in test "test_backup_restore_on_cluster". 2022-12-28 00:17:19 +01:00
Nikita Mikhaylov
9d10550b66
Merge branch 'master' into keeper-test-fix 2022-12-27 22:51:47 +01:00
Alexey Milovidov
5d6266c33e
Merge branch 'master' into fix_parser 2022-12-28 00:45:53 +03:00
Alexey Milovidov
14d7266e70
Merge branch 'master' into fix-30975 2022-12-27 23:21:10 +03:00
Alexey Milovidov
2892d447d4
Merge pull request #44626 from ClickHouse/alexey-milovidov-patch-5
Sometimes spot instances fail more than 20 times in a row
2022-12-27 23:20:05 +03:00
alesapin
a3bb3c0172
Merge pull request #44649 from ClickHouse/add_chmod_to_run_fuzzer
Add +x flag for run-fuzzer.sh
2022-12-27 19:50:27 +01:00
alesapin
f93c52ac69 Add +x flag for run-fuzzer.sh 2022-12-27 19:48:58 +01:00
avogar
5c42b78766 Forbid paths in timezones in cctz lib 2022-12-27 17:52:38 +00:00
Kruglov Pavel
05c37365df
Merge branch 'master' into fix-datetime-timezone 2022-12-27 18:46:57 +01:00
Nikolay Degterinsky
29371745bd Fix lambdas parsing 2022-12-27 17:42:38 +00:00
Kruglov Pavel
819e7a3008
Merge pull request #44550 from Avogar/better-json-tuples-to-arrays-inference
Improve inferring arrays with nulls in JSON formats
2022-12-27 18:22:13 +01:00
Nikita Mikhaylov
00ecf6dd05 Better 2022-12-27 17:04:47 +00:00
Nikita Mikhaylov
ce6264b684 Done 2022-12-27 17:03:57 +00:00
Anton Popov
1f7a4a94ff fix test 02015_async_inserts_2 2022-12-27 17:01:30 +00:00
Kruglov Pavel
ac162a2c49
Merge pull request #44522 from Avogar/zero-numbers
Infer numbers starting from zero as strings in TSV
2022-12-27 17:00:10 +01:00
Kruglov Pavel
f95eabc192
Merge pull request #44469 from Avogar/low-card-if
Don't execute and/or/if/multiIf on LowCardinality dictionary
2022-12-27 16:59:42 +01:00
Kruglov Pavel
6dea7336f7
Merge pull request #44405 from Avogar/fix-parquet-orc
Fix reading columns that are not presented in input data in Parquet/ORC formats
2022-12-27 16:58:35 +01:00
Kruglov Pavel
e981b2e78b
Merge pull request #43813 from Avogar/fix-sum-if
Better handling of NULL in aggregate combinators, fix possible segfault/logical error
2022-12-27 16:50:48 +01:00
Azat Khuzhin
c9c590071d Add ability to disable deduplication for BACKUP
Right now BACKUP omit similar files, and will not allow to use this
backup as a regular table, and usually those similar files are quite
small (i.e. columns.txt).

So by using `BACKUP TO S3() deduplicate_files=0` you will be possible to
use `ATTACH TABLE` directly from S3.

P.S. right now it is possible only for the table with one part, since,
usually, there is nothing to deduplicate (if the columns are different).

v2: Add deduplicate_files into metadata
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-27 15:56:06 +01:00
Azat Khuzhin
7d81c39207 backups: ignore file not found error for S3 (similar to Disk)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-27 15:56:05 +01:00
Azat Khuzhin
998bf444e6 backups: remove IBackupCoordination::getFileSizeAndChecksum() (in favor of getFileInfo())
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-27 15:56:05 +01:00
Alexey Milovidov
c27f90c8ed
Update src/Parsers/ParserDataType.cpp
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
2022-12-27 17:16:31 +03:00
Alexey Milovidov
4ce9732502
Update AggregateFunctionSumMap.h 2022-12-27 17:15:48 +03:00
Alexey Milovidov
611bb44288
Merge branch 'master' into fix-30975 2022-12-27 17:15:12 +03:00
Alexey Milovidov
c26ce8a629
Merge pull request #44338 from ClickHouse/mysql-compat-test
Add a test for PowerBI
2022-12-27 17:12:51 +03:00
Alexey Milovidov
ed3d70f7c0
Merge pull request #44623 from azat/build/rust-fix
Fix rust modules rebuild (previously ignores changes in cargo config.toml)
2022-12-27 17:10:33 +03:00
Sergei Trifonov
56b3c6c68f
Merge pull request #44308 from ZhiguoZh/20221216-threadpool-notify
Call std::condition_variable::notify_* without lock in ThreadPool
2022-12-27 15:02:49 +01:00
Mikhail f. Shiryaev
93af1f3f7c
Restart failing workflows up to 30 times 2022-12-27 14:50:37 +01:00
Mikhail f. Shiryaev
d6ebb5fca8
Merge pull request #44399 from ClickHouse/checkout-action
Implement a custom central checkout action
2022-12-27 14:15:22 +01:00
Alexey Milovidov
514ff2ba20
Merge pull request #44570 from ClickHouse/clickhouse-benchmark-better-arguments
Better command line argument name in `clickhouse-benchmark`
2022-12-27 16:10:21 +03:00
Alexey Milovidov
e1115828d0
Merge pull request #44593 from ClickHouse/better-diagnostic-in-stress-test
Better diagnostics on server stop for the stress test
2022-12-27 16:07:43 +03:00