Commit Graph

117221 Commits

Author SHA1 Message Date
Alexey Milovidov
4e45e39e25
Merge pull request #51099 from ClickHouse/fix_use_local_vars_after_exception
Fix for part_names_mutex used after destruction
2023-06-16 23:52:50 +03:00
Alexey Milovidov
f6efca6e55
Merge pull request #51001 from ClickHouse/fix_02561_null_as_default_more_formats
Fix flaky 02561_null_as_default_more_formats
2023-06-16 23:51:08 +03:00
Alexey Milovidov
782889a051
Merge pull request #51042 from ClickHouse/sys_zookeep_parallel_list
Make multiple parallel list requests when reading from system.zookeeper
2023-06-16 23:46:53 +03:00
Michael Kolupaev
10d597676c Refactor IColumn::forEachSubcolumn to make it slightly harder to implement incorrectly 2023-06-16 11:08:12 -07:00
Michael Kolupaev
c2900177a2 Fix race condition in ColumnLowCardinality caused by subtly broken copy-on-write for the dictionary 2023-06-16 11:06:28 -07:00
robot-clickhouse-ci-2
677203ce71
Merge pull request #51082 from ClickHouse/Avogar-patch-1
Update Avro format docs
2023-06-16 19:22:40 +02:00
Alexander Gololobov
8289d8fefa Fix for part_names_mutex used after destruction 2023-06-16 18:46:07 +02:00
Alexey Milovidov
5752ad2d2f
Merge pull request #51086 from aiven-sal/aiven-sal/ctriv
Generate safe IVs
2023-06-16 18:49:00 +03:00
Salvatore Mesoraca
6b49968bc4
Generate safe IVs
IVs should never be re-used when using CTR.
The previous implementation had a 50% probability to generate
an IV that was already used after 65536 generations.
This happens because std::mt19937 is seeded using a 32bit integer
and returns a 32 bits integer.
Because of the birthday problem, collisions have a 50% chance after
only 2^16 IV's generations.
CH uses one IV per file and, for most use cases, 65k files are
not as many as they seem.
Also, the initial entropy is gathered using std::random_device
which is "best-effort" and it's allowed by the standard to
return a fixed sequence of numbers.
2023-06-16 17:09:08 +02:00
Kruglov Pavel
38ed92c8f4
Update Avro format docs 2023-06-16 15:53:29 +02:00
Nikolai Kochetov
df1ea0b572
Merge pull request #50489 from ClickHouse/vdimir/alter_moving_garbage
Cleanup moving parts
2023-06-16 15:39:32 +02:00
Vitaly Baranov
f7638de213
Fix crash in BackupCoordinationStageSync::setError(). (#51012) 2023-06-16 15:32:30 +02:00
Kruglov Pavel
dcc3efe4b7
Merge pull request #50364 from Avogar/allow-skip-empty-files
Allow to skip empty files in file/s3/url/hdfs table functions
2023-06-16 14:59:49 +02:00
Alexander Tokmakov
9260a1bf2e
Merge pull request #51006 from ClickHouse/followup_50448
Follow-up to #50448
2023-06-16 15:32:12 +03:00
Kruglov Pavel
1f47bb7716
Fix docs 2023-06-16 13:45:46 +02:00
Kruglov Pavel
f8ddfb1fd8
Merge branch 'master' into allow-skip-empty-files 2023-06-16 13:23:41 +02:00
Kruglov Pavel
11f176dd19
Merge pull request #50712 from KevinyhZou/bug_fix_csv_parse_by_tab_delimiter
Support CSVInputFormat to read csv file by whitespace & tab delimiter
2023-06-16 13:16:22 +02:00
Antonio Andelic
56a48037ba
Merge pull request #50964 from ClickHouse/pufit/embedded-keeper-client
Add embedded keeper-client to keeper standalone binary
2023-06-16 10:08:41 +02:00
Rich Raposa
d3be3bdc9b
Merge pull request #51058 from ClickHouse/rfraposa-patch-2
Fix redis table function page for nav
2023-06-15 21:55:18 -06:00
Mikhail f. Shiryaev
2e3cb102d9
Merge pull request #51061 from ClickHouse/fix-sqlancer
Do not spam sqlancer build log
2023-06-16 00:59:32 +02:00
Mikhail f. Shiryaev
5d4a3ac0c6
Do not spam sqlancer build log 2023-06-16 00:44:42 +02:00
Mikhail f. Shiryaev
ff093ecfa9
Merge pull request #51060 from ClickHouse/fix-sqlancer
Sqlancer has changed master to main
2023-06-16 00:38:53 +02:00
Han Fei
6bbd0d144d
Merge pull request #50951 from ZhiguoZh/20230607-toyear-fix
Optimization of predicates with toYear/toYYYYMM based on a general solution
2023-06-16 00:32:55 +02:00
Mikhail f. Shiryaev
60ab05e86f
Sqlancer has changed master to main 2023-06-16 00:28:09 +02:00
Rich Raposa
59201ee3be
Fix redis table function page for nav 2023-06-15 15:26:44 -06:00
Robert Schulze
74cb79769b
Merge pull request #50925 from arenadata/ADQM-812
Implement support of syslog format in the parseDateTimeBestEffort() function
2023-06-15 21:04:50 +02:00
robot-ch-test-poll2
eec7edda8f
Merge pull request #51039 from ClickHouse/evillique-patch-1
Update backup.md
2023-06-15 21:03:54 +02:00
Mikhail f. Shiryaev
3833cfc744
Merge pull request #51035 from ClickHouse/fix-tweak-for-tags
Fix a versions' tweak for tagged commits, improve version_helper
2023-06-15 20:22:35 +02:00
Alexander Gololobov
f08fd758fa Make multiple parallel list requests 2023-06-15 18:45:10 +02:00
Alexander Tokmakov
6cc4f76707 fix 2023-06-15 18:37:45 +02:00
pufit
e01e0d53a9 Add embedded keeper-client to keeper standalone binary 2023-06-15 12:08:20 -04:00
Dmitry Novik
2180d97be7
Merge pull request #50995 from ClickHouse/fix-memory-test
Attempt to make 01281_group_by_limit_memory_tracking not flaky
2023-06-15 16:56:08 +02:00
Kruglov Pavel
953af94ee0
Merge pull request #50874 from valbok/materialized-mysql-named-collections-test
MaterializedMySQL: Add test_named_collections
2023-06-15 16:46:49 +02:00
Nikolay Degterinsky
b963369920
Merge pull request #50865 from jmaicher/fix/50864/verification-cooldown-cache-entry
Fix type of LDAP server params hash in cache entry
2023-06-15 16:21:44 +02:00
Nikolay Degterinsky
d136e64c98
Update backup.md 2023-06-15 16:16:39 +02:00
Zhiguo Zhou
ff6629d1d1 Enhance safety of function generateOptimizedDateFilterAST
This commit checks the corner case where the comparator is none
of equals, notEquals, less, lessOrEquals, greater, greaterOrEquals,
and throws LOGICAL_ERROR exception if so.
2023-06-15 22:04:13 +08:00
Alexander Tokmakov
b248ba730a
Merge pull request #50997 from vitlibar/use-hash_of_all_files-for-parts
Use hash_of_all_files to check identity of parts during on-cluster backups
2023-06-15 16:54:55 +03:00
Zhiguo Zhou
d780d0bab1 fix style
Move error throws in Transform to FunctionDateOrDateTimeToSomething.
2023-06-15 21:48:02 +08:00
Han Fei
9e81b2fd5d fix style 2023-06-15 21:48:02 +08:00
Zhiguo Zhou
d14299eb09 The general optimization of predicates with date/datetime converters
As is suggested in issue #15257, the function preimage is a general
solution to the optimization problem with predicates containing the
date and datetime converters. This commit implements the idea by
adding the new methods, hasInformationAboutPreimage and getPreimage,
to IFunction/IFunctionBase, and having the specific convert functions
define their own preimage. Moreover, we added a new pass in the
TreeOptimizer and a new AST visitor for in-place rewriting the AST
with the converters' preimage.

Specifically, the optimization is applied to toYear and toYYYYMM.
2023-06-15 21:48:02 +08:00
Zhiguo Zhou
1760247599 Add tests in date_predicate_optimizations
This commit adds tests of toYear/toYYYYMM for all of the date
types, including Date, Date32, DateTime and DateTime64, to ensure
the optimization for the date or datetime filter would not break
the queries. The test data are especially selected around the margins
of a year or a month.
2023-06-15 21:48:02 +08:00
Mikhail f. Shiryaev
eb2a5c31a3
Do not mock git_helper.Git, suppress git describe error for ignore_no_tags 2023-06-15 15:35:03 +02:00
Alexander Tokmakov
dc0a224f52 fix 2023-06-15 15:05:17 +02:00
avogar
870f3d1270 Fix comments 2023-06-15 12:59:46 +00:00
Mikhail f. Shiryaev
2ac95ccfce
Adjust version_helper test cases to proper tags 2023-06-15 14:48:10 +02:00
Mikhail f. Shiryaev
07203a4542
Fix a versions' tweak for tagged commits, improve version_helper 2023-06-15 14:48:09 +02:00
Kseniia Sumarokova
c15e7b93cb
Merge pull request #50976 from kssenii/fix-data-lakes-too-many-head-requests
Fix data lakes slowness because of synchronous head requests
2023-06-15 13:33:09 +02:00
Dan Roscigno
ee9faa9be1
Merge pull request #50968 from DerekChia/patch-3
Update delete.md
2023-06-15 07:06:49 -04:00
Alexander Tokmakov
6fc9479730
Update settings.md (#51007) 2023-06-15 13:51:42 +03:00
Igor Nikonov
1113a7c524
Merge pull request #50214 from azat/parallelize_output_from_storages-fix
Disable parallelize_output_from_storages for processing MATERIALIZED VIEWs and storages with one block only
2023-06-15 12:48:54 +02:00