Commit Graph

117222 Commits

Author SHA1 Message Date
Yakov Olkhovskiy
cf301324fb
Merge branch 'master' into fix-ip-aggregate-state 2023-06-16 12:49:17 -04:00
Alexey Milovidov
5752ad2d2f
Merge pull request #51086 from aiven-sal/aiven-sal/ctriv
Generate safe IVs
2023-06-16 18:49:00 +03:00
Salvatore Mesoraca
6b49968bc4
Generate safe IVs
IVs should never be re-used when using CTR.
The previous implementation had a 50% probability to generate
an IV that was already used after 65536 generations.
This happens because std::mt19937 is seeded using a 32bit integer
and returns a 32 bits integer.
Because of the birthday problem, collisions have a 50% chance after
only 2^16 IV's generations.
CH uses one IV per file and, for most use cases, 65k files are
not as many as they seem.
Also, the initial entropy is gathered using std::random_device
which is "best-effort" and it's allowed by the standard to
return a fixed sequence of numbers.
2023-06-16 17:09:08 +02:00
Nikolai Kochetov
df1ea0b572
Merge pull request #50489 from ClickHouse/vdimir/alter_moving_garbage
Cleanup moving parts
2023-06-16 15:39:32 +02:00
Vitaly Baranov
f7638de213
Fix crash in BackupCoordinationStageSync::setError(). (#51012) 2023-06-16 15:32:30 +02:00
Kruglov Pavel
dcc3efe4b7
Merge pull request #50364 from Avogar/allow-skip-empty-files
Allow to skip empty files in file/s3/url/hdfs table functions
2023-06-16 14:59:49 +02:00
Alexander Tokmakov
9260a1bf2e
Merge pull request #51006 from ClickHouse/followup_50448
Follow-up to #50448
2023-06-16 15:32:12 +03:00
Kruglov Pavel
1f47bb7716
Fix docs 2023-06-16 13:45:46 +02:00
Kruglov Pavel
f8ddfb1fd8
Merge branch 'master' into allow-skip-empty-files 2023-06-16 13:23:41 +02:00
Kruglov Pavel
11f176dd19
Merge pull request #50712 from KevinyhZou/bug_fix_csv_parse_by_tab_delimiter
Support CSVInputFormat to read csv file by whitespace & tab delimiter
2023-06-16 13:16:22 +02:00
Antonio Andelic
56a48037ba
Merge pull request #50964 from ClickHouse/pufit/embedded-keeper-client
Add embedded keeper-client to keeper standalone binary
2023-06-16 10:08:41 +02:00
Rich Raposa
d3be3bdc9b
Merge pull request #51058 from ClickHouse/rfraposa-patch-2
Fix redis table function page for nav
2023-06-15 21:55:18 -06:00
Mikhail f. Shiryaev
2e3cb102d9
Merge pull request #51061 from ClickHouse/fix-sqlancer
Do not spam sqlancer build log
2023-06-16 00:59:32 +02:00
Mikhail f. Shiryaev
5d4a3ac0c6
Do not spam sqlancer build log 2023-06-16 00:44:42 +02:00
Mikhail f. Shiryaev
ff093ecfa9
Merge pull request #51060 from ClickHouse/fix-sqlancer
Sqlancer has changed master to main
2023-06-16 00:38:53 +02:00
Han Fei
6bbd0d144d
Merge pull request #50951 from ZhiguoZh/20230607-toyear-fix
Optimization of predicates with toYear/toYYYYMM based on a general solution
2023-06-16 00:32:55 +02:00
Mikhail f. Shiryaev
60ab05e86f
Sqlancer has changed master to main 2023-06-16 00:28:09 +02:00
Rich Raposa
59201ee3be
Fix redis table function page for nav 2023-06-15 15:26:44 -06:00
Robert Schulze
74cb79769b
Merge pull request #50925 from arenadata/ADQM-812
Implement support of syslog format in the parseDateTimeBestEffort() function
2023-06-15 21:04:50 +02:00
robot-ch-test-poll2
eec7edda8f
Merge pull request #51039 from ClickHouse/evillique-patch-1
Update backup.md
2023-06-15 21:03:54 +02:00
Mikhail f. Shiryaev
3833cfc744
Merge pull request #51035 from ClickHouse/fix-tweak-for-tags
Fix a versions' tweak for tagged commits, improve version_helper
2023-06-15 20:22:35 +02:00
Alexander Tokmakov
6cc4f76707 fix 2023-06-15 18:37:45 +02:00
pufit
e01e0d53a9 Add embedded keeper-client to keeper standalone binary 2023-06-15 12:08:20 -04:00
Dmitry Novik
2180d97be7
Merge pull request #50995 from ClickHouse/fix-memory-test
Attempt to make 01281_group_by_limit_memory_tracking not flaky
2023-06-15 16:56:08 +02:00
Kruglov Pavel
953af94ee0
Merge pull request #50874 from valbok/materialized-mysql-named-collections-test
MaterializedMySQL: Add test_named_collections
2023-06-15 16:46:49 +02:00
Yakov Olkhovskiy
35b7474ccf
add MapState to aspell-dict.txt 2023-06-15 10:22:58 -04:00
Nikolay Degterinsky
b963369920
Merge pull request #50865 from jmaicher/fix/50864/verification-cooldown-cache-entry
Fix type of LDAP server params hash in cache entry
2023-06-15 16:21:44 +02:00
Nikolay Degterinsky
d136e64c98
Update backup.md 2023-06-15 16:16:39 +02:00
Zhiguo Zhou
ff6629d1d1 Enhance safety of function generateOptimizedDateFilterAST
This commit checks the corner case where the comparator is none
of equals, notEquals, less, lessOrEquals, greater, greaterOrEquals,
and throws LOGICAL_ERROR exception if so.
2023-06-15 22:04:13 +08:00
Alexander Tokmakov
b248ba730a
Merge pull request #50997 from vitlibar/use-hash_of_all_files-for-parts
Use hash_of_all_files to check identity of parts during on-cluster backups
2023-06-15 16:54:55 +03:00
Zhiguo Zhou
d780d0bab1 fix style
Move error throws in Transform to FunctionDateOrDateTimeToSomething.
2023-06-15 21:48:02 +08:00
Han Fei
9e81b2fd5d fix style 2023-06-15 21:48:02 +08:00
Zhiguo Zhou
d14299eb09 The general optimization of predicates with date/datetime converters
As is suggested in issue #15257, the function preimage is a general
solution to the optimization problem with predicates containing the
date and datetime converters. This commit implements the idea by
adding the new methods, hasInformationAboutPreimage and getPreimage,
to IFunction/IFunctionBase, and having the specific convert functions
define their own preimage. Moreover, we added a new pass in the
TreeOptimizer and a new AST visitor for in-place rewriting the AST
with the converters' preimage.

Specifically, the optimization is applied to toYear and toYYYYMM.
2023-06-15 21:48:02 +08:00
Zhiguo Zhou
1760247599 Add tests in date_predicate_optimizations
This commit adds tests of toYear/toYYYYMM for all of the date
types, including Date, Date32, DateTime and DateTime64, to ensure
the optimization for the date or datetime filter would not break
the queries. The test data are especially selected around the margins
of a year or a month.
2023-06-15 21:48:02 +08:00
Mikhail f. Shiryaev
eb2a5c31a3
Do not mock git_helper.Git, suppress git describe error for ignore_no_tags 2023-06-15 15:35:03 +02:00
Alexander Tokmakov
dc0a224f52 fix 2023-06-15 15:05:17 +02:00
avogar
870f3d1270 Fix comments 2023-06-15 12:59:46 +00:00
Mikhail f. Shiryaev
2ac95ccfce
Adjust version_helper test cases to proper tags 2023-06-15 14:48:10 +02:00
Mikhail f. Shiryaev
07203a4542
Fix a versions' tweak for tagged commits, improve version_helper 2023-06-15 14:48:09 +02:00
Kseniia Sumarokova
c15e7b93cb
Merge pull request #50976 from kssenii/fix-data-lakes-too-many-head-requests
Fix data lakes slowness because of synchronous head requests
2023-06-15 13:33:09 +02:00
Dan Roscigno
ee9faa9be1
Merge pull request #50968 from DerekChia/patch-3
Update delete.md
2023-06-15 07:06:49 -04:00
Alexander Tokmakov
6fc9479730
Update settings.md (#51007) 2023-06-15 13:51:42 +03:00
Igor Nikonov
1113a7c524
Merge pull request #50214 from azat/parallelize_output_from_storages-fix
Disable parallelize_output_from_storages for processing MATERIALIZED VIEWs and storages with one block only
2023-06-15 12:48:54 +02:00
Kseniia Sumarokova
b7fbc4dd8e
Merge pull request #50977 from valbok/empty-table-overrides
MaterializedMySQL: Keep parentheses for empty table overrides
2023-06-15 12:48:04 +02:00
Kseniia Sumarokova
58650b3280
Merge pull request #51002 from ClickHouse/Avogar-patch-1
Fix flaky test_seekable_formats
2023-06-15 12:46:04 +02:00
Kseniia Sumarokova
f1f8b302bf
Merge pull request #50934 from azat/tests/fix-query_log
Fix tests sanity checks and avoid dropping system.query_log table
2023-06-15 12:44:23 +02:00
Alexander Tokmakov
f73a3cf255
Merge pull request #50924 from valbok/missing-drops
MaterializedMySQL: Add missing DROP DATABASE for tests
2023-06-15 13:33:28 +03:00
Alexander Tokmakov
a018d9ca11 try to fix false-positive 'part is lost forever' 2023-06-15 12:25:16 +02:00
Kruglov Pavel
7aea4a1f10
Merge branch 'master' into allow-skip-empty-files 2023-06-15 12:07:24 +02:00
Robert Schulze
946e1a8c6f
Merge pull request #50966 from arenadata/ADQM-934
clickhouse-client: Force that `--password` is specified at most once
2023-06-15 11:14:26 +02:00