mirror of
https://github.com/ClickHouse/ClickHouse.git
synced 2024-12-15 10:52:30 +00:00
108 KiB
108 KiB
sidebar_position | sidebar_label |
---|---|
1 | 2023 |
2023 Changelog
ClickHouse release v23.1.1.3077-stable (dcaac47702
) FIXME as compared to v22.12.1.1752-stable (688e488e93
)
Backward Incompatible Change
- Remove query
SYSTEM RESTART DISK
. #44647 (alesapin). - Disallow Gorilla compression on columns of non-Float32 or non-Float64 type. #45252 (Robert Schulze).
- Remove PREALLOCATE for HASHED/SPARSE_HASHED dictionaries. #45388 (Azat Khuzhin).
- Parallel quorum inserts might work incorrectly with
*MergeTree
tables created with deprecated syntax. Therefore, parallel quorum inserts support is completely disabled for such tables. It does not affect tables created with a new syntax. #45430 (Alexander Tokmakov).
New Feature
- Add
quantileInterpolatedWeighted
/quantilesInterpolatedWeighted
functions. #38252 (Bharat Nallan). - Add an experimental inverted index as a new secondary index type for efficient text search. #38667 (larryluogit).
- Add column
ptr
tosystem.trace_log
fortrace_type = 'MemorySample'
. This column contains an address of allocation. Added functionflameGraph
which can build flamegraph containing allocated and not released memory. Reworking of #38391. #38953 (Nikolai Kochetov). - Dictionary source for extracting keys by traversing regular expressions tree. #40878 (Vage Ogannisian).
- Added parametrized view functionality, now it's possible to specify query parameters for View table engine. resolves #40907. #41687 (SmitaRKulkarni).
- added extendable and configurable scheduling subsystem for IO requests (not yet integrated with IO code itself). #41840 (Sergei Trifonov).
- Added
SYSTEM DROP DATABASE REPLICA
that removes metadata of dead replica ofReplicated
database. Resolves #41794. #42807 (Alexander Tokmakov). - Array join support map type, like function explode in spark. #43239 (李扬).
- Support SQL standard binary and hex string literals. #43785 (Mo Xuan).
- Add experimental query result cache. #43797 (Robert Schulze).
- format datetime in joda datetime style. Refer to https://joda-time.sourceforge.net/apidocs/org/joda/time/format/DateTimeFormat.html. #43818 (李扬).
- to merge #40878 , supporting regexp dictionary. #43858 (Han Fei).
- Implemented a fractional second formatter (
%f
) for formatDateTime. #44060 (ltrk2). - Added age function to calculate difference between two dates or dates with time values expressed as number of full units. Closes #41115. #44421 (Robert Schulze).
- Implemented a fractional second formatter (%f) for formatDateTime. This is slightly modified PR #44060 by @ltrk2. #44497 (Alexander Gololobov).
- Add null source for dictionaries. Closes #44240. #44502 (mayamika).
- We can use
s3_storage_class
to set different tier. Such as<disks> <s3> <type>s3</type> <endpoint>xxx</endpoint> <access_key_id>xxx</access_key_id> <secret_access_key>xxx</secret_access_key> <s3_storage_class>STANDARD/INTELLIGENT_TIERING</s3_storage_class> </s3> </disks>
Closes #44443. #44707 (chen). - Try to detect header with column names (and maybe types) for CSV/TSV/CustomSeparated input formats. Add settings
input_format_tsv/csv/custom_detect_header
that enables this behaviour (enabled by default). Closes #44640. #44953 (Kruglov Pavel). - Insert default values in case of missing elements in JSON object while parsing named tuple. Add setting
input_format_json_defaults_for_missing_elements_in_named_tuple
that controls this behaviour. Closes #45142#issuecomment-1380153217. #45231 (Kruglov Pavel). -
- Add total memory and used memory metrics with respect to cgroup in AsyncMetrics (https://github.com/ClickHouse/ClickHouse/issues/37983). #45301 (sichenzhao).
- Introduce non-throwing variants of hasToken and hasTokenCaseInsensitive. #45341 (ltrk2).
Performance Improvement
- Added sharding support in HashedDictionary to allow parallel load (almost linear scaling based on number of shards). #40003 (Azat Khuzhin).
- Do not load inactive parts at startup of
MergeTree
tables. #42181 (Anton Popov). -
- Speed up query parsing. #42284 (Raúl Marín).
- Always replace OR chain
expr = x1 OR ... OR expr = xN
toexpr IN (x1, ..., xN)
in case ifexpr
is aLowCardinality
column. Settingoptimize_min_equality_disjunction_chain_length
is ignored in this case. #42889 (Guo Wangyang). -
Original changelog In the original implementation, the memory of ThreadGroupStatus:: finished_threads_counters_memory is released by moving it to a temporary std::vector, which soon expired and gets destructed. This method is viable, however not straightforward enough. To enhance the code readability, this commit releases the memory in the vector by firstly resizing it to 0 and then shrinking the capacity accordingly. #43586 (Zhiguo Zhou).
- As a follow-up of #42214, this PR tries to optimize the column-wise ternary logic evaluation by achieving auto-vectorization. In the performance test of this microbenchmark, we've observed a peak performance gain of 21x on the ICX device (Intel Xeon Platinum 8380 CPU). #43669 (Zhiguo Zhou).
- Improved latency of reading from storage
S3
and table functions3
with large number of small files. Now settingsremote_filesystem_read_method
andremote_filesystem_read_prefetch
take effect while reading from storageS3
. #43726 (Anton Popov). -
- Avoid acquiring read locks in system.tables if possible. #43840 (Raúl Marín).
- The performance experiments of SSB (Star Schema Benchmark) on the ICX device (Intel Xeon Platinum 8380 CPU, 80 cores, 160 threads) shows that this change could effectively decrease the lock contention for ThreadPoolImpl::mutex by 75%, increasing the CPU utilization and improving the overall performance by 2.4%. #44308 (Zhiguo Zhou).
- Now optimisation is applied only if the cached HT size is sufficiently large (thresholds were determined empirically and hardcoded). #44455 (Nikita Taranov).
- ... The whole struct field will be loaded at current, even though we just want to read one field of the struct. #44484 (lgbo).
- Small performance improvement for asynchronous reading from remote fs. #44868 (Kseniia Sumarokova).
- Switched to faster shared (RW) mutex implementation. Performance may be improved in queries with a lot of thread synchronization or for data structures experiencing heavy contention. #45007 (Sergei Trifonov).
- Add fast path for: - col like '%%' - col like '%' - col not like '%' - col not like '%' - match(col, '.*'). #45244 (李扬).
- todo. #45289 (Nikita Taranov).
Improvement
- Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and add support for all formats, also refactor formats a bit: - Fix producing messages in row-based formats with suffixes/prefixes. Now every message is formatted complitely with all delimiters and can be parsed back using input format. - Support block-based formats like Native, Parquet, ORC, etc. Every block is formatted as a separated message. The number of rows in one message depends on block size, so you can control it via setting
max_block_size
. - Add new engine settingskafka_max_rows_per_message/rabbitmq_max_rows_per_message/nats_max_rows_per_message
. They control the number of rows formatted in one message in row-based formats. Default value: 1. - Fix high memory consumption in NATS table engine. - Support arbitrary binary data in NATS producer (previously it worked only with strings contained \0 at the end) - Add missing Kafka/RabbitMQ/NATS engine settings in documentation. - Refactor producing and consuming in Kafka/RabbitMQ/NATS, separate it from WriteBuffers/ReadBuffers semantic. - Refactor output formats: remove callbacks on each row used in Kafka/RabbitMQ/NATS (now we don't use callbacks there), allow to use IRowOutputFormat directly, clarify row end and row between delimiters, make it possible to reset output format to start formatting again - Add proper implementation in formatRow function (bonus after formats refactoring). #42777 (Kruglov Pavel). - Support
optimize_or_like_chain
in the new infrastructure. Part of #42648. #42797 (Dmitry Novik). - Improve the Asterisk and ColumnMatcher parsers. Part of #42648. #42884 (Nikolay Degterinsky).
- Implement
optimize_redundant_functions_in_order_by
on top of QueryTree. Part of #42648. #42970 (Dmitry Novik). - Support
optimize_group_by_function_keys
in the new analyzer architecture. Also, add support for optimizing GROUPING SETS keys. Part of #42648. #43261 (Dmitry Novik). - Improve reading CSV field in CustomSeparated/Template format. Closes #42352 Closes #39620. #43332 (Kruglov Pavel).
- Support reading/writing
Nested
tables asList
ofStruct
in CapnProto format. Read/writeDecimal32/64
asInt32/64
. Closes #43319. #43379 (Kruglov Pavel). -
- Unify query elapsed time measurements. #43455 (Raúl Marín).
- Support scalar subqueries cache Implementation: * Added a map with hash of the node (without alias) and the evaluated value to Context. Testing: * Added a test-case with new analyser in 02174_cte_scalar_cache.sql. #43640 (SmitaRKulkarni).
- Improve automatic usage of structure from insertion table in table functions file/hdfs/s3 when virtual columns present in select query, it fixes possible error
Block structure mismatch
ornumber of columns mismatch
. #43695 (Kruglov Pavel). - Add support for signed arguments in range(). Fixes #43333. #43733 (sanyu).
- Remove redundant sorting, for example, sorting related ORDER BY clauses in subqueries. Implemented on top of query plan. It does similar optimization as
optimize_duplicate_order_by_and_distinct
regardingORDER BY
clauses, but more generic, since it's applied to any redundant sorting steps (not only caused by ORDER BY clause) and applied to subqueries of any depth. Related to #42648. #43905 (Igor Nikonov). - Added mmap support for StorageFile, which should improve the performance of clickhouse-local. #43927 (pufit).
- Add ability to disable deduplication for BACKUP (for backups wiithout deduplication ATTACH can be used instead of full RESTORE), example
BACKUP foo TO S3(...) SETTINGS deduplicate_files=0
(defaultdeduplicate_files=1
). #43947 (Azat Khuzhin). - Make
system.replicas
table do parallel fetches of replicas statuses. Closes #43918. #43998 (Nikolay Degterinsky). - Refactor and improve schema inference for text formats. Add new setting
schema_inference_make_columns_nullable
that controls making result typesNullable
(enabled by default);. #44019 (Kruglov Pavel). - Better support for PROXYv1. #44135 (Yakov Olkhovskiy).
- Add information about the latest part check by cleanup thread into
system.parts
table. #44244 (Dmitry Novik). - Disable functions in readonly for inserts. #44290 (SmitaRKulkarni).
- Add a setting
simultaneous_parts_removal_limit
to allow to limit the number of parts being processed by one iteration of CleanupThread. #44461 (Dmitry Novik). - If user only need virtual columns, we don't need to initialize ReadBufferFromS3. May be helpful to #44246. #44493 (chen).
- Prevent duplicate column names hints. Closes #44130. #44519 (Joanna Hulboj).
- Allow macro substitution in endpoint of disks resolve #40951. #44533 (SmitaRKulkarni).
- Added a
message_format_string
column tosystem.text_log
. The column contains a pattern that was used to format the message. #44543 (Alexander Tokmakov). - Improve schema inference when
input_format_json_read_object_as_string
is enabled. #44546 (Kruglov Pavel). - Add user-level setting
database_replicated_allow_replicated_engine_arguments
which allow to ban creation ofReplicatedMergeTree
tables with arguments inDatabaseReplicated
. #44566 (alesapin). - Prevent users from mistakenly specifying zero (invalid) value for
index_granularity
. This closes #44536. #44578 (Alexey Milovidov). - Added possibility to set path to service keytab file in
keytab
parameter inkerberos
section of config.xml. #44594 (Roman Vasin). - Use already written part of the query for fuzzy search (pass to skim). #44600 (Azat Khuzhin).
- Enable input_format_json_read_objects_as_strings by default to be able to read nested JSON objects while JSON Object type is experimental. #44657 (Kruglov Pavel).
- When users do duplicate async inserts, we should dedup inside the memory before we query keeper. #44682 (Han Fei).
- Input/ouptut Avro bool type as ClickHouse bool type. #44684 (Kruglov Pavel).
-
- Don't parse beyond the quotes when reading UUIDs. #44686 (Raúl Marín).
- Infer UInt64 in case of Int64 overflow and fix some transforms in schema inference. #44696 (Kruglov Pavel).
- Previously dependency resolving inside DatabaseReplicated was done in a hacky way and now it done right using an explicit graph. #44697 (Nikita Mikhaylov).
- Support Bool type in Arrow/Parquet/ORC. Closes #43970. #44698 (Kruglov Pavel).
- Fix
output_format_pretty_row_numbers
does not preserve the counter across the blocks. Closes #44815. #44832 (flynn). - Extend function "toDayOfWeek" with a mode argument describing if a) the week starts on Monday or Sunday and b) if counting starts at 0 or 1. #44860 (李扬).
-
- Don't report errors in system.errors due to parts being merged concurrently with the background cleanup process. #44874 (Raúl Marín).
- Optimize and fix metrics for Distributed async INSERT. #44922 (Azat Khuzhin).
- Added settings to disallow concurrent backups and restores resolves #43891 Implementation: * Added server level settings to disallow concurrent backups and restores, which are read and set when BackupWorker is created in Context. * Settings are set to true by default. * Before starting backup or restores, added a check to see if any other backups/restores are running. For internal request it checks if its from the self node using backup_uuid. #45072 (SmitaRKulkarni).
- add a cache for async block ids. This will reduce the requests of zookeeper when we enable async inserts deduplication. #45106 (Han Fei).
- CRC32 changes to address the WeakHash collision issue in PowerPC. #45144 (MeenaRenganathan22).
- Optimize memory consumption during backup to S3: files to S3 now will be copied directly without using
WriteBufferFromS3
(which could use a lot of memory). #45188 (Vitaly Baranov). - Use structure from insertion table in generateRandom without arguments. #45239 (Kruglov Pavel).
- Use
GetObjectAttributes
request instead ofHeadObject
request to get the size of an object in AWS S3. This change fixes handling endpoints without explicit region, for example. #45288 (Vitaly Baranov). - Add
<storage_policy>
config parameter for system logs. #45320 (Stig Bakken). - Remove redundant sorting, for example, sorting related ORDER BY clauses in subqueries. Implemented on top of query plan. It does similar optimization as
optimize_duplicate_order_by_and_distinct
regardingORDER BY
clauses, but more generic, since it's applied to any redundant sorting steps (not only caused by ORDER BY clause) and applied to subqueries of any depth. Related to #42648. #45420 (Igor Nikonov). - Allow to implicitly convert floats stored in string fields of JSON to integers in
JSONExtract
functions. E.g.JSONExtract('{"a": "1000.111"}', 'a', 'UInt64')
->1000
, previously it returned 0. #45432 (Anton Popov). - Added fields
supports_parallel_parsing
andsupports_parallel_formatting
to tablesystem.formats
for better introspection. #45499 (Anton Popov). - Attempt to improve fsync latency (by syncing all files at once during fetches and small files after mutations) and one tiny fix for fsync_part_directory. #45537 (Azat Khuzhin).
Bug Fix
- Fix HTTP requests without path for AWS. After updating AWS SDK the sdk no longer adds a slash to requesting paths so we need to do it in our PocoHTTPClient to keep HTTP requests correct. #45238 (Vitaly Baranov).
- Fix backup if mutations get killed during the backup process. #45351 (Vitaly Baranov).
Build/Testing/Packaging Improvement
- Builtin skim for fuzzy search in clickhouse client/local history. #44239 (Azat Khuzhin).
- Memory limit for server is set now in AST fuzz tests to avoid OOMs. #44282 (Nikita Taranov).
- In rare cases, we don't rebuild binaries, because another task with a similar prefix succeeded. E.g.
binary_darwin
didn't restart becausebinary_darwin_aarch64
. #44311 (Mikhail f. Shiryaev). - The "universal.sh" now fetches a SSE2 build on systems which don't have SSE4.2. #44366 (Robert Schulze).
- Retry the integration tests on compressing errors. #44529 (Mikhail f. Shiryaev).
- ... 1. Added pytest-random by default in integration tests runner 2. Disable TSAN checks for tests with GPRC ( like https://s3.amazonaws.com/clickhouse-test-reports/42807/e9d7407a58f6e3f7d88c0c534685704f23560704/integration_tests__tsan__[4/6].html ) 3. Cleanup tables after tests in odbc. #44711 (Ilya Yatsishin).
- We removed support for shared linking because of Rust. Actually, Rust is only an excuse for this removal, and we wanted to remove it nevertheless. #44828 (Alexey Milovidov).
- Checks will try to download images before running integration tests. If image, proxy or whatever is broken in infrastructure it will not make tests flaky. Images will be cached locally and download time will not be added to random tests. Compose images are now changed to be used without correct environment from helpers/cluster.py. #44848 (Ilya Yatsishin).
- Fix zookeeper downloading, update the version, and optimize the image size. #44853 (Mikhail f. Shiryaev).
- The performance tests were silently broken because
Errors
wasn't detected in the status message. #44867 (Mikhail f. Shiryaev). - Remove the dependency on the
adduser
tool from the packages, because we don't use it. This fixes #44934. #45011 (Alexey Milovidov). - SQLite library is updated to the latest. It is used for the SQLite database and table integration engines. Also, fixed a false-positive TSan report. This closes #45027. #45031 (Alexey Milovidov).
- Fix report sending in the case when FastTest failed. #45588 (Dmitry Novik).
Bug Fix (user-visible misbehavior in official stable or prestable release)
- #40651 #41404. #42126 (Alexander Gololobov).
- Fix possible use-of-unitialized value after executing expressions after sorting. Closes #43386 CC: @nickitat. #43635 (Kruglov Pavel).
- Better handling of NULL in aggregate combinators, fix possible segfault/logical error while using optimization
optimize_rewrite_sum_if_to_count_if
. Closes #43758. #43813 (Kruglov Pavel). - Fix CREATE USER/ROLE query settings constraints. #43993 (Nikolay Degterinsky).
-
- Fix wrong behavior of
JOIN ON t1.x = t2.x AND 1 = 1
, forbid such queries. #44016 (Vladimir C).
- Fix wrong behavior of
- Fixed bug with non-parsable default value for EPHEMERAL column in table metadata. #44026 (Yakov Olkhovskiy).
- Fix parsing of bad version from compatibility setting. #44224 (Kruglov Pavel).
- Bring interval subtraction from datetime in line with addition. #44241 (ltrk2).
- Fix double-free in HashTable::clearAndShrink() with zero elements in it. #44256 (Azat Khuzhin).
- Remove limits on maximum size of the result for view. #44261 (lizhuoyu5).
- Fix possible logical error in cache if
do_not_evict_index_and_mrk_files=1
. Closes #42142. #44268 (Kseniia Sumarokova). - Fix possible too early cache write interruption in write-through cache (caching could be stopped due to false assumption when it shouldn't have). #44289 (Kseniia Sumarokova).
- Fix possible crash in case function
IN
with constant arguments was used as a constant argument together withLowCardinality
. Fixes #44221. #44346 (Nikolai Kochetov). - Fix support for complex parameters (like arrays) of parametric aggregate functions. This closes #30975. The aggregate function
sumMapFiltered
was unusable in distributed queries before this change. #44358 (Alexey Milovidov). -
- Fix possible nullptr deference in JoinSwitcher with
allow_experimental_analyzer
. #44371 (Vladimir C).
- Fix possible nullptr deference in JoinSwitcher with
- Fix reading ObjectId in BSON schema inference. #44382 (Kruglov Pavel).
- Fix race which can lead to premature temp parts removal before merge finished in ReplicatedMergeTree. This issue could lead to errors like
No such file or directory: xxx
. Fixes #43983. #44383 (alesapin). - Some invalid
SYSTEM ... ON CLUSTER
queries worked in an unexpected way if a cluster name was not specified. It's fixed, now invalid queries throwSYNTAX_ERROR
as they should. Fixes #44264. #44387 (Alexander Tokmakov). - Fix reading Map type in ORC format. #44400 (Kruglov Pavel).
- Fix reading columns that are not presented in input data in Parquet/ORC formats. Previously it could lead to error
INCORRECT_NUMBER_OF_COLUMNS
. Closes #44333. #44405 (Kruglov Pavel). - Previously bar() function used the same '▋' (U+258B "Left five eighths block") character to display both 5/8 and 6/8 bars. This change corrects this behavior by using '▊' (U+258A "Left three quarters block") for displaying 6/8 bar. #44410 (Alexander Gololobov).
- Placing profile settings after profile settings constraints in the configuration file made constraints ineffective. #44411 (Konstantin Bogdanov).
- Fix
SYNTAX_ERROR
while runningEXPLAIN AST INSERT
queries with data. Closes #44207. #44413 (save-my-heart). - Fix reading bool value with CRLF in CSV format. Closes #44401. #44442 (Kruglov Pavel).
- Don't execute and/or/if/multiIf on LowCardinality dictionary, so the result type cannot be LowCardinality. It could lead to error
Illegal column ColumnLowCardinality
in some cases. Fixes #43603. #44469 (Kruglov Pavel). - Fix mutations with setting
max_streams_for_merge_tree_reading
. #44472 (Anton Popov). - Fix potential null pointer dereference with GROUPING SETS in ASTSelectQuery::formatImpl (#43049). #44479 (Robert Schulze).
- Validate types in table function arguments, CAST function arguments, JSONAsObject schema inference according to settings. #44501 (Kruglov Pavel).
-
- Fix IN function with LC and const column, close #44503. #44506 (Duc Canh Le).
- Fixed a bug in normalization of a
DEFAULT
expression inCREATE TABLE
statement. The second argument of functionin
(or the right argument of operatorIN
) might be replaced with the result of its evaluation during CREATE query execution. Fixes #44496. #44547 (Alexander Tokmakov). - Projections do not work in presence of WITH ROLLUP, WITH CUBE and WITH TOTALS. In previous versions, a query produced an exception instead of skipping the usage of projections. This closes #44614. This closes #42772. #44615 (Alexey Milovidov).
-
- Fix bug in experimental analyzer and
aggregate_functions_null_for_empty = 1
. Close #44644. #44648 (Vladimir C).
- Fix bug in experimental analyzer and
- async blocks are not cleaned because the function
get all blocks sorted by time
didn't get async blocks. #44651 (Han Fei). - Fix
LOGICAL_ERROR
The top step of the right pipeline should be ExpressionStep
for JOIN with subquery, UNION, and TOTALS. Fixes #43687. #44673 (Nikolai Kochetov). - Avoid std::out_of_range exception in StorageExecutable. #44681 (Kruglov Pavel).
- Do not apply
optimize_syntax_fuse_functions
to quantiles on AST, close #44712. #44713 (Vladimir C). - Fix bug with wrong type in Merge table and PREWHERE, close #43324. #44716 (Vladimir C).
- Fix possible crash during shutdown (while destroying TraceCollector). Fixes #44757. #44758 (Nikolai Kochetov).
- Fix a possible crash in distributed query processing. The crash could happen if a query with totals or extremes returned an empty result and there are mismatched types in the Distrubuted and the local tables. Fixes #44738. #44760 (Nikolai Kochetov).
- Fix fsync for fetches (
min_compressed_bytes_to_fsync_after_fetch
)/small files (ttl.txt, columns.txt) in mutations (min_rows_to_fsync_after_merge
/min_compressed_bytes_to_fsync_after_merge
). #44781 (Azat Khuzhin). - A rare race condition was possible when querying the
system.parts
orsystem.parts_columns
tables in the presence of parts being moved between disks. Introduced in #41145. #44809 (Alexey Milovidov). - Fix the error
Context has expired
which could appear with enabled projections optimization. Can be reproduced for queries with specific functions, likedictHas/dictGet
which use context in runtime. Fixes #44844. #44850 (Nikolai Kochetov). - Another fix for
Cannot read all data
error which could happen while readingLowCardinality
dictionary from remote fs. Fixes #44709. #44875 (Nikolai Kochetov). -
- Ignore hwmon sensors on label read issues. #44895 (Raúl Marín).
- Use
max_delay_to_insert
value in case calculated time to delay INSERT exceeds the setting value. Related to #44902. #44916 (Igor Nikonov). - Fix error
Different order of columns in UNION subquery
for queries withUNION
. Fixes #44866. #44920 (Nikolai Kochetov). - Delay for INSERT can be calculated incorrectly, which can lead to always using
max_delay_to_insert
setting as delay instead of a correct value. Using simple formulamax_delay_to_insert * (parts_over_threshold/max_allowed_parts_over_threshold)
i.e. delay grows proportionally to parts over threshold. Closes #44902. #44954 (Igor Nikonov). - fix alter table ttl error when wide part has light weight delete mask. #44959 (Mingliang Pan).
- Follow-up fix for Replace domain IP types (IPv4, IPv6) with native #43221. #45024 (Yakov Olkhovskiy).
- Follow-up fix for Replace domain IP types (IPv4, IPv6) with native https://github.com/ClickHouse/ClickHouse/pull/43221. #45043 (Yakov Olkhovskiy).
- A buffer overflow was possible in the parser. Found by fuzzer. #45047 (Alexey Milovidov).
- Fix possible cannot-read-all-data error in storage FileLog. Closes #45051, #38257. #45057 (Kseniia Sumarokova).
- Memory efficient aggregation (setting
distributed_aggregation_memory_efficient
) is disabled when grouping sets are present in the query. #45058 (Nikita Taranov). - Fix
RANGE_HASHED
dictionary to count range columns as part of primary key during updates whenupdate_field
is specified. Closes #44588. #45061 (Maksim Kita). - Fix error
Cannot capture column
forLowCardinality
captured argument of nested labmda. Fixes #45028. #45065 (Nikolai Kochetov). - Fix the wrong query result of
additional_table_filters
(additional filter was not applied) in case if minmax/count projection is used. #45133 (Nikolai Kochetov). - Follow-up fix for Replace domain IP types (IPv4, IPv6) with native https://github.com/ClickHouse/ClickHouse/pull/43221. #45150 (Yakov Olkhovskiy).
- Fix wrong column nullability in StoreageJoin, close #44940. #45184 (Vladimir C).
- Fix
background_fetches_pool_size
settings reload (increase at runtime). #45189 (Raúl Marín). - Correctly process
SELECT
queries on KV engines (e.g. KeeperMap, EmbeddedRocksDB) usingIN
on the key with subquery producing different type. #45215 (Antonio Andelic). - Fix logical error in SEMI JOIN & join_use_nulls in some cases, close #45163, close #45209. #45230 (Vladimir C).
- Fix heap-use-after-free in reading from s3. #45253 (Kruglov Pavel).
- Fix bug when the Avro Union type is ['null', Nested type], closes #45275. Fix bug that incorrectly infer
bytes
type toFloat
. #45276 (flynn). - Throw a correct exception when explicit PREWHERE cannot be used with table using storage engine
Merge
. #45319 (Antonio Andelic). - Under WSL1 Ubuntu self-extracting clickhouse fails to decompress due to inconsistency - /proc/self/maps reporting 32bit file's inode, while stat reporting 64bit inode. #45339 (Yakov Olkhovskiy).
- Fix race in Distributed table startup (that could lead to processing file of async INSERT multiple times). #45360 (Azat Khuzhin).
- Fix possible crash while reading from storage
S3
and table functions3
in case whenListObject
request has failed. #45371 (Anton Popov). -
- Fixed some bugs in JOINS with WHERE by disabling "move to prewhere" optimization for it, close #44062. #45391 (Vladimir C).
- Fix
SELECT ... FROM system.dictionaries
exception when there is a dictionary with a bad structure (e.g. incorrect type in xml config). #45399 (Aleksei Filatov). - Fix s3Cluster schema inference when structure from insertion table is used in
INSERT INTO ... SELECT * FROM s3Cluster
queries. #45422 (Kruglov Pavel). - Fix bug in JSON/BSONEachRow parsing with HTTP that could lead to using default values for some columns instead of values from data. #45424 (Kruglov Pavel).
- Fixed bug (Code: 632. DB::Exception: Unexpected data ... after parsed IPv6 value ...) with typed parsing of IP types from text source. #45425 (Yakov Olkhovskiy).
- close #45297 Add check for empty regular expressions. #45428 (Han Fei).
- Fix possible (likely distributed) query hung. #45448 (Azat Khuzhin).
- Fix disabled two-level aggregation from HTTP. #45450 (Nikolai Kochetov).
- Fix possible deadlock with
allow_asynchronous_read_from_io_pool_for_merge_tree
enabled in case of exception fromThreadPool::schedule
. #45481 (Nikolai Kochetov). - Fix possible in-use table after DETACH. #45493 (Azat Khuzhin).
- Fix rare abort in case when query is canceled and parallel parsing was used during its execution. #45498 (Anton Popov).
- Fix a race between Distributed table creation and INSERT into it (could lead to CANNOT_LINK during INSERT into the table). #45502 (Azat Khuzhin).
- Add proper default (SLRU) to cache policy getter. Closes #45514. #45524 (Kseniia Sumarokova).
- Remove AST-based optimization
optimize_fuse_sum_count_avg
, close #45439. #45558 (Vladimir C).
Bug-fix
- Disallow arrayjoin in mutations closes #42637 Implementation: * Added a new parameter to ActionsVisitor::Data disallow_arrayjoin, which is set by MutationsIterator when it appends expression. * ActionsVisitor uses disallow_arrayjoin and throws error when its used with mutations. Testing: * Added test for the same 02504_disallow_arrayjoin_in_mutations.sql. #44447 (SmitaRKulkarni).
- Fix for qualified asterisks with alias table name and column transformer resolves #44736. #44755 (SmitaRKulkarni).
- Updated backup/restore status when concurrent backups & restores are not allowed resolves #45486 Implementation: * Moved concurrent backup/restore check inside try-catch block which sets the status so that other nodes in cluster are aware of failures. * Renamed backup_uuid to restore_uuid in RestoreSettings. #45497 (SmitaRKulkarni).
Build Improvement
- crc32 fix for s390x. #43706 (Suzy Wang).
- Fixed endian issues in transform function for s390x. #45522 (Harry Lee).
Feature
- Record server startup time in ProfileEvents resolves #43188 Implementation: * Added ProfileEvents::ServerStartupMilliseconds. * Recorded time from start of main till listening to sockets. Testing: * Added a test 02532_profileevents_server_startup_time.sql. #45250 (SmitaRKulkarni).
NO CL ENTRY
- NO CL ENTRY: 'Revert "If user only need virtual columns, we don't need to initialize ReadBufferFromS3"'. #44939 (Anton Popov).
- NO CL ENTRY: 'Revert "Custom reading for mutation"'. #45121 (Alexander Tokmakov).
- NO CL ENTRY: 'Revert "Revert "Custom reading for mutation""'. #45122 (Nikolai Kochetov).
- NO CL ENTRY: 'Revert "update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability"'. #45221 (Alexander Tokmakov).
- NO CL ENTRY: 'Revert "Validate function arguments in query tree"'. #45299 (Maksim Kita).
- NO CL ENTRY: 'Revert "Revert "Validate function arguments in query tree""'. #45300 (Maksim Kita).
- NO CL ENTRY: 'Revert "Support optimize_or_like_chain in QueryTreePassManager"'. #45406 (Anton Popov).
- NO CL ENTRY: 'Resubmit Support optimize_or_like_chain in QueryTreePassManager'. #45410 (Dmitry Novik).
- NO CL ENTRY: 'Revert "Remove redundant sorting"'. #45414 (Igor Nikonov).
NOT FOR CHANGELOG / INSIGNIFICANT
- Automatically merge green backport PRs and green approved PRs #41110 (Mikhail f. Shiryaev).
- Fix assertion in async read buffer from remote #41231 (Kseniia Sumarokova).
- add retries on ConnectionError #42991 (Yakov Olkhovskiy).
- Update aws-c* submodules #43020 (Vitaly Baranov).
- Replace domain IP types (IPv4, IPv6) with native #43221 (Yakov Olkhovskiy).
- Fix aggregate functions optimisation in AggregateFunctionsArithmericOperationsPass #43372 (Dmitry Novik).
- Improve pytest --pdb experience by preserving dockerd on SIGINT #43392 (Azat Khuzhin).
- RFC: tests: add stacktraces for hunged queries #43396 (Azat Khuzhin).
- Followup fixes for systemd notification (#43400) #43597 (Alexander Gololobov).
- Refactor FunctionNode #43761 (Dmitry Novik).
- Some cleanup: grace hash join #43851 (Igor Nikonov).
- Temporary files evict fs cache - 2nd approach #43972 (Vladimir C).
- Randomize setting
enable_memory_bound_merging_of_aggregation_results
in tests #43986 (Nikita Taranov). - Analyzer aggregate functions passes small fixes #44013 (Maksim Kita).
- Fix wrong char in command #44018 (alesapin).
- Analyzer support Set index #44097 (Maksim Kita).
- Provide monotonicity info for
toUnixTimestamp64*
#44116 (Nikita Taranov). - Avoid loading toolchain files multiple times #44122 (Azat Khuzhin).
- tests: exclude flaky columns from SHOW CLUSTERS test #44123 (Azat Khuzhin).
- Bump libdivide (to gain some new optimizations) #44132 (Azat Khuzhin).
- Make atomic counter relaxed in blockNumber() #44193 (Igor Nikonov).
- Try fix flaky 01072_window_view_multiple_columns_groupby #44195 (Kseniia Sumarokova).
- Apply new code of named collections (from #43147) to external table engines part 1 #44204 (Kseniia Sumarokova).
- Add some settings under
compatibility
#44209 (Alexey Milovidov). - Recommend Slack over Telegram in the "Question" issue template #44222 (Ivan Blinkov).
- Forbid paths in timezone names #44225 (Kruglov Pavel).
- Analyzer storage view crash fix #44230 (Maksim Kita).
- Add ThreadsInOvercommitTracker metric #44233 (Dmitry Novik).
- Analyzer expired Context crash fix #44234 (Maksim Kita).
- Fix grace join memory consumption, pt1 #44238 (Vladimir C).
- Fixed use-after-free of BLAKE3 error message #44242 (Joanna Hulboj).
- Fix deadlock in StorageSystemDatabases #44272 (Alexander Tokmakov).
- Get rid of global Git object #44273 (Mikhail f. Shiryaev).
- Update version after release #44275 (Mikhail f. Shiryaev).
- Update version_date.tsv and changelogs after v22.12.1.1752-stable #44281 (robot-clickhouse).
- Do not hold data parts during insert #44299 (Anton Popov).
- Another fix
test_server_reload
#44306 (Antonio Andelic). - Update version_date.tsv and changelogs after v22.9.7.34-stable #44309 (robot-clickhouse).
- tests/perf: fix dependency check during DROP #44312 (Azat Khuzhin).
- (unused openssl integration, not for production) a follow-up #44325 (Boris Kuschel).
- Replace old named collections code with new (from #43147) part 2 #44327 (Kseniia Sumarokova).
- Disable "git-import" test in debug mode #44328 (Alexey Milovidov).
- Check s3 part upload settings #44335 (Nikolai Kochetov).
- Fix typo #44337 (Alexey Milovidov).
- Add a test for PowerBI #44338 (Alexey Milovidov).
- Add a test for #36038 #44339 (Alexey Milovidov).
- Add a test for #29386 #44340 (Alexey Milovidov).
- Add a test for #22929 #44341 (Alexey Milovidov).
- Add a test for #29883 #44342 (Alexey Milovidov).
- Fix Docker #44343 (Alexey Milovidov).
- fix flack test "02481_async_insert_dedup.python" #44349 (Han Fei).
- Add a test for #22160 #44355 (Alexey Milovidov).
- Add a test for #34708 #44356 (Alexey Milovidov).
- Add a test for #30679 #44357 (Alexey Milovidov).
- Add a test for #34669 #44359 (Alexey Milovidov).
- Add a test for #34724 #44360 (Alexey Milovidov).
- Try restarting ZK cluster on failed connection in
test_keeper_zookeeper_converted
#44363 (Antonio Andelic). - Disable grase_hash in test 00172_parallel_join #44367 (Vladimir C).
- Add check for submodules sanity #44386 (Mikhail f. Shiryaev).
- Lock table for share during startup for database ordinary #44393 (alesapin).
- Implement a custom central checkout action #44399 (Mikhail f. Shiryaev).
- Try fix some tests #44406 (Kseniia Sumarokova).
- Better ParserAllCollectionsOfLiterals #44408 (Nikolay Degterinsky).
- Fix bug with merge/mutate pool size increase #44436 (alesapin).
- Update 01072_window_view_multiple_columns_groupby.sh #44438 (Kseniia Sumarokova).
- Disable buggy tsan assertion for integration test #44444 (alesapin).
- Respect setting settings.schema_inference_make_columns_nullable in Parquet/ORC/Arrow formats #44446 (Kruglov Pavel).
- Add tests as examples with errors of date(time) and string comparison that we should eliminate #44462 (Ilya Yatsishin).
- Parallel parts cleanup with zero copy replication #44466 (Alexander Tokmakov).
- Fix incorrect usages of
getPartName()
#44468 (Alexander Tokmakov). - Fix flaky test
roaring_memory_tracking
#44470 (Alexey Milovidov). - Clarify query_id in test 01092_memory_profiler #44483 (Vladimir C).
- Default value for optional in SortNode::updateTreeHashImpl #44491 (Vladimir C).
- Do not try to remove WAL/move broken parts for static storage #44495 (Azat Khuzhin).
- Removed parent pid check that breaks in containers #44499 (Alexander Gololobov).
- Analyzer duplicate alias crash fix #44508 (Maksim Kita).
- Minor code polishing #44513 (alesapin).
- Better error message if named collection does not exist #44517 (Kseniia Sumarokova).
- Add the lambda to collect data for workflow_jobs #44520 (Mikhail f. Shiryaev).
- Introduce groupArrayLast() (useful to store last X values) #44521 (Azat Khuzhin).
- Infer numbers starting from zero as strings in TSV #44522 (Kruglov Pavel).
- Fix wrong condition for enabling async reading from MergeTree. #44530 (Nikolai Kochetov).
- tests: capture dmesg in integration tests #44535 (Azat Khuzhin).
- Analyzer support distributed queries processing #44540 (Maksim Kita).
- Followup #43761 #44541 (Dmitry Novik).
- Drop unused columns after join on/using #44545 (Vladimir C).
- Improve inferring arrays with nulls in JSON formats #44550 (Kruglov Pavel).
- Make BC check optional (if env var set) #44564 (alesapin).
- Fix extremely slow stack traces in debug build #44569 (Alexey Milovidov).
- Better command line argument name in
clickhouse-benchmark
#44570 (Alexey Milovidov). - Fix HDFS test #44572 (Alexey Milovidov).
- Fix test_distributed_queries_stress #44573 (Alexey Milovidov).
- Switch "contrib/sysroot" back to master. #44574 (Vitaly Baranov).
- Non-significant changes #44575 (Alexey Milovidov).
- Fuzzer HTML: fix trash #44580 (Alexey Milovidov).
- Better diagnostics on server stop for the stress test #44593 (Alexey Milovidov).
- The position of the log message about the server environment was wrong #44595 (Alexey Milovidov).
- Fix bad punctuation in log #44596 (Alexey Milovidov).
- Fix misleading log message #44598 (Alexey Milovidov).
- Fix bad log message about MergeTree metadata cache. #44599 (Alexey Milovidov).
- Slightly cleanup interactive line reader code #44601 (Azat Khuzhin).
- Rename
runlog.log
torun.log
in tests #44603 (Alexey Milovidov). - Fix hung query in stress test #44604 (Alexey Milovidov).
- Improve variable name #44605 (Alexey Milovidov).
- Faster server startup after stress test #44606 (Alexey Milovidov).
- Fix log messages in Coordination #44607 (Alexey Milovidov).
- Disable Analyzer in fuzz and stress tests #44609 (Alexey Milovidov).
- Better log message #44610 (Alexey Milovidov).
- Maybe fix a bogus MSan error #44611 (Alexey Milovidov).
- Fix "too large allocation" message from MSan #44613 (Alexey Milovidov).
- Do not fail the AST fuzzer if sanitizer is out of memory #44616 (Alexey Milovidov).
- Fix test
01111_create_drop_replicated_db_stress
#44617 (Alexey Milovidov). - tests/integration: suppress exceptions during logging (due to pytest) #44618 (Azat Khuzhin).
- Fix rust modules rebuild (previously ignores changes in cargo config.toml) #44623 (Azat Khuzhin).
- Sometimes spot instances fail more than 20 times in a row #44626 (Alexey Milovidov).
- Fix restart after quorum insert #44628 (alesapin).
- Revert "Merge pull request #38953 from ClickHouse/add-allocation-ptr-to-trace-log #44629 (Raúl Marín).
- Fix lambdas parsing #44639 (Nikolay Degterinsky).
- Function viewExplain accept SELECT and settings #44641 (Vladimir C).
- Fix test
02015_async_inserts_2
#44642 (Anton Popov). - Fix flaky test
test_keeper_multinode_simple
#44645 (Nikita Mikhaylov). - Add +x flag for run-fuzzer.sh #44649 (alesapin).
- Custom reading for mutation #44653 (Nikolai Kochetov).
- Fix flaky test test_backup_restore_on_cluster #44660 (Vitaly Baranov).
- tests/integration: add missing kazoo client termination #44666 (Azat Khuzhin).
- Move dmesg dumping out from runner to ci-runner.py #44667 (Azat Khuzhin).
- Remove questdb (it makes a little sense but the test was flaky) #44669 (Alexey Milovidov).
- Fix minor typo: replace validate_bugix_check with validate_bugfix_check #44672 (Pradeep Chhetri).
- Fix parsing of ANY operator #44678 (Nikolay Degterinsky).
- Fix test
01130_in_memory_parts
#44683 (Anton Popov). - Remove old code #44685 (Alexey Milovidov).
- Fix flaky test git-import #44687 (Alexey Milovidov).
- Improve odbc test #44688 (Alexey Milovidov).
- Add retries to HTTP requests in ClickHouse test #44689 (alesapin).
- Fix flaky tests #44690 (Nikita Mikhaylov).
- Fix flaky test "01502_long_log_tinylog_deadlock_race" #44693 (Alexey Milovidov).
- Improve handling of old parts #44694 (Raúl Marín).
- Update entrypoint.sh #44699 (Denny Crane).
- tests: more fixes for test_keeper_auth #44702 (Azat Khuzhin).
- Fix crash on delete from materialized view #44705 (Alexander Gololobov).
- Fix flaky filelog tests with database ordinary #44706 (Kseniia Sumarokova).
- Make lightweight deletes always synchronous #44718 (Alexander Gololobov).
- Fix deadlock in attach thread #44719 (alesapin).
- A few improvements to AST Fuzzer #44720 (Alexey Milovidov).
- Fix flaky test #44721 (Alexey Milovidov).
- Rename log in stress test #44722 (alesapin).
- Debug deadlock in stress test #44723 (Alexey Milovidov).
- Fix flaky test "02102_row_binary_with_names_and_types.sh" #44724 (Alexey Milovidov).
- Slightly better some tests #44725 (alesapin).
- Fix cases when clickhouse-server takes long time to start in functional tests with MSan #44726 (Alexey Milovidov).
- Perf test: Log the time spent waiting for file sync #44737 (Raúl Marín).
- Fix flaky test 02448_clone_replica_lost_part #44759 (alesapin).
- Build rust modules from the binary directory #44762 (Azat Khuzhin).
- Remove database ordinary from stress test #44763 (alesapin).
- Fix flaky test 02479_mysql_connect_to_self #44768 (Alexey Milovidov).
- Print fatal messages in Fuzzer #44769 (Alexey Milovidov).
- Fix incorrect docs #44795 (Kruglov Pavel).
- Added table name to error message #44806 (Alexander Gololobov).
- Retry packages download if GitHub returned HTTP 500. #44807 (Alexey Milovidov).
- Slightly better docs #44808 (Kruglov Pavel).
- Fix total trash in stress test #44810 (Alexey Milovidov).
- Fix ASan builds for glibc 2.36+ #44811 (Azat Khuzhin).
- Remove the remainings of TestFlows #44812 (Alexey Milovidov).
- Fix
grep
#44813 (Alexey Milovidov). - Fix bad cast in monotonicity analysis #44818 (Alexey Milovidov).
- Modern tools, part 1 #44819 (Alexey Milovidov).
- Modern tools in CI, part 2. #44820 (Alexey Milovidov).
- Fix data race in DDLWorker #44821 (Alexey Milovidov).
- Fix tests for bridges #44822 (Alexey Milovidov).
- Fix flaky test_multiple_disks::test_jbod_overflow #44823 (Azat Khuzhin).
- Less OOM in stress test #44824 (Alexey Milovidov).
- Fix misleading integration tests reports for parametrized tests #44825 (Azat Khuzhin).
- Fix two typos #44826 (Alexey Milovidov).
- Adjust CSS #44829 (Alexey Milovidov).
- Fix fuzzer report #44830 (Alexey Milovidov).
- check-style: check base for std::cerr/cout too #44833 (Azat Khuzhin).
- Try fixing
test_keeper_snapshot_small_distance
with ZK restart #44834 (Antonio Andelic). - Exclude cargo shared libraries from the artifacts #44836 (Azat Khuzhin).
- Add a tiny but important logging #44837 (Mikhail f. Shiryaev).
- Escape submodules in style-check #44838 (Mikhail f. Shiryaev).
- Move
test_dies_with_parent
to another module #44839 (Nikita Mikhaylov). - Remove unneeded softlink to official dev docs #44841 (Robert Schulze).
- Fix data race in StorageS3 #44842 (Antonio Andelic).
- Fix rare race which can lead to queue hang #44847 (alesapin).
- No more retries in integration tests #44851 (Ilya Yatsishin).
- Document usage of check_cxx_source_compiles instead of check_cxx_source_runs #44854 (Robert Schulze).
- More cases of OOM in Fuzzer #44855 (Alexey Milovidov).
- Fix: sorted DISTINCT with empty string #44856 (Igor Nikonov).
- Try to fix MSan build #44857 (Nikolay Degterinsky).
- Cleanup setup_minio.sh #44858 (Pradeep Chhetri).
- Wait for ZK process to stop in tests using snapshot #44859 (Antonio Andelic).
- Fix flaky test and several typos #44870 (alesapin).
- Upload status files to S3 report for bugfix check #44871 (Mikhail f. Shiryaev).
- Fix flaky test
02503_insert_storage_snapshot
#44873 (alesapin). - Revert some changes from #42777 to fix performance tests #44876 (Kruglov Pavel).
- Rewrite test_postgres_protocol test #44880 (Ilya Yatsishin).
- Fix ConcurrentBoundedQueue::emplace() return value in case of finished queue #44881 (Azat Khuzhin).
- Validate function arguments in query tree #44882 (Dmitry Novik).
- Rework CI reports to have a class and clarify the logic #44883 (Mikhail f. Shiryaev).
- fix-typo #44886 (Enrique Herreros).
- Store ZK generated data in
test_keeper_snapshot_small_distance
#44888 (Antonio Andelic). - Fix "AttributeError: 'BuildResult' object has no attribute 'libraries'" in BuilderReport and BuilderSpecialReport #44890 (Robert Schulze).
- Convert integration test_dictionaries_update_field to a stateless #44891 (Azat Khuzhin).
- Upgrade googletest to latest HEAD #44894 (Robert Schulze).
- Try fix rabbitmq potential leak #44897 (Kseniia Sumarokova).
- Try to fix flaky
test_storage_kafka::test_kafka_produce_key_timestamp
#44898 (Antonio Andelic). - Fix flaky
test_concurrent_queries_restriction_by_query_kind
#44903 (Antonio Andelic). - Avoid Keeper crash on shutdown (fix
test_keeper_snapshot_on_exit
) #44908 (Antonio Andelic). - Do not merge over a gap with outdated undeleted parts #44909 (Sema Checherinda).
- Fix logging message in MergeTreeDataMergerMutator (about merged parts) #44917 (Azat Khuzhin).
- Fix flaky test
test_lost_part
#44921 (Nikita Mikhaylov). - Add fast and cancellable shared_mutex alternatives #44924 (Sergei Trifonov).
- Fix deadlock in Keeper's changelog #44937 (Antonio Andelic).
- Stop merges to avoid a race between merge and freeze. #44938 (Nikolai Kochetov).
- Fix memory leak in Aws::InitAPI #44942 (Vitaly Baranov).
- Change error code on invalid background_pool_size config #44947 (Raúl Marín).
- Fix exception fix in TraceCollector dtor #44948 (Robert Schulze).
- Parallel distributed insert select with s3Cluster [3] #44955 (Nikita Mikhaylov).
- Do not check read result consistency when unwinding #44956 (Alexander Gololobov).
- Up the log level of tables dependencies graphs #44957 (Vitaly Baranov).
- Hipster's HTML #44961 (Alexey Milovidov).
- Docs: Mention non-standard DOTALL behavior of ClickHouse's match() #44977 (Robert Schulze).
- tests: fix test_replicated_users flakiness #44978 (Azat Khuzhin).
- Check what if disable some checks in storage Merge. #44983 (Nikolai Kochetov).
- Fix check for not existing input in ActionsDAG #44987 (Nikolai Kochetov).
- Update version_date.tsv and changelogs after v22.12.2.25-stable #44988 (robot-clickhouse).
- Fix test test_grpc_protocol/test.py::test_progress #44996 (Vitaly Baranov).
- Improve S3 EC2 metadata tests #45001 (Vitaly Baranov).
- Fix minmax_count_projection with _partition_value #45003 (Amos Bird).
- Fix strange trash in Fuzzer #45006 (Alexey Milovidov).
- Add
dmesg.log
to Fuzzer #45008 (Alexey Milovidov). - Fix
01961_roaring_memory_tracking
test, again #45009 (Alexey Milovidov). - Recognize more ok cases for Fuzzer #45012 (Alexey Milovidov).
- Supposedly fix the "Download script failed" error #45013 (Alexey Milovidov).
- Add snapshot creation retry in Keeper tests using ZooKeeper #45016 (Antonio Andelic).
- test for #20098 #45017 (Denny Crane).
- test for #26473 #45018 (Denny Crane).
- Remove the remainings of Testflows (2). #45021 (Alexey Milovidov).
- Enable the check that was commented #45022 (Alexey Milovidov).
- Fix false positive in Fuzzer #45025 (Alexey Milovidov).
- Fix false positive in Fuzzer, alternative variant #45026 (Alexey Milovidov).
- Fix function
range
(the bug was unreleased) #45030 (Alexey Milovidov). - Fix OOM in Fuzzer #45032 (Alexey Milovidov).
- Less OOM in Stress test #45033 (Alexey Milovidov).
- Add a test for #31361 #45034 (Alexey Milovidov).
- Add a test for #38729 #45035 (Alexey Milovidov).
- Fix typos #45036 (Alexey Milovidov).
- I didn't understand the logic of this test, @azat #45037 (Alexey Milovidov).
- Small fixes for Coordination unit tests #45039 (Antonio Andelic).
- Fix flaky test (hilarious) #45042 (Alexey Milovidov).
- Non significant changes #45046 (Alexey Milovidov).
- Don't fix parallel formatting #45050 (Alexey Milovidov).
- Fix (benign) data race in clickhouse-client #45053 (Alexey Milovidov).
- Analyzer aggregation without column fix #45055 (Maksim Kita).
- Analyzer ARRAY JOIN crash fix #45059 (Maksim Kita).
- Fix data race in openSQLiteDB #45062 (Kseniia Sumarokova).
- Analyzer function IN crash fix #45064 (Maksim Kita).
- JIT compilation float to bool conversion fix #45067 (Maksim Kita).
- Update version_date.tsv and changelogs after v22.11.3.47-stable #45069 (robot-clickhouse).
- Update version_date.tsv and changelogs after v22.10.5.54-stable #45071 (robot-clickhouse).
- Update version_date.tsv and changelogs after v22.3.16.1190-lts #45073 (robot-clickhouse).
- Improve release scripts #45074 (Mikhail f. Shiryaev).
- Change the color of links in dark reports a little bit #45077 (Mikhail f. Shiryaev).
- Fix Fuzzer script #45082 (Alexey Milovidov).
- Try fixing KeeperMap tests #45094 (Antonio Andelic).
- Update version_date.tsv and changelogs after v22.8.12.45-lts #45098 (robot-clickhouse).
- Try to fix flaky test_create_user_and_login/test.py::test_login_as_dropped_user_xml #45099 (Ilya Yatsishin).
- Update version_date.tsv and changelogs after v22.10.6.3-stable #45107 (robot-clickhouse).
- Docs: Make heading consistent with other headings in System Table docs #45109 (Robert Schulze).
- Update version_date.tsv and changelogs after v22.11.4.3-stable #45110 (robot-clickhouse).
- Update version_date.tsv and changelogs after v22.12.3.5-stable #45113 (robot-clickhouse).
- Docs: Rewrite awkwardly phrased sentence about flush interval #45114 (Robert Schulze).
- Fix data race in s3Cluster. #45123 (Nikolai Kochetov).
- Pull SQLancer image before check run #45125 (Ilya Yatsishin).
- Fix flaky azure test #45134 (alesapin).
- Minor cleanup in stress/run.sh #45136 (Alexander Tokmakov).
- Performance report: "Partial queries" --> "Backward-incompatible queries #45152 (Robert Schulze).
- Fix flaky test_tcp_handler_interserver_listen_host #45156 (Ilya Yatsishin).
- Clean trash from changelog for v22.3.16.1190-lts #45159 (Mikhail f. Shiryaev).
- Disable
test_storage_rabbitmq
#45161 (Alexander Tokmakov). - Disable test_ttl_move_memory_usage as too flaky. #45162 (Nikolai Kochetov).
- More logging to facilitate debugging of flaky test_ttl_replicated #45165 (Alexander Gololobov).
- Try to fix flaky test_ttl_move_memory_usage #45168 (Alexander Tokmakov).
- Fix flaky test test_multiple_disks/test.py::test_rename #45180 (Kseniia Sumarokova).
- Calculate only required columns in system.detached_parts #45181 (Kseniia Sumarokova).
- Restart NightlyBuilds if the runner died #45187 (Mikhail f. Shiryaev).
- Fix part ID generation for IP types for backward compatibility #45191 (Yakov Olkhovskiy).
- Fix integration test test_replicated_users::test_rename_replicated #45192 (Nikita Mikhaylov).
- Add CACHE_INVALIDATOR for sqlancer builds #45201 (Ilya Yatsishin).
- Fix possible stack-use-after-return in LimitReadBuffer #45203 (Kruglov Pavel).
- Disable check to make test_overcommit_tracker not flaky #45206 (Dmitry Novik).
- Fix flaky test
01961_roaring_memory_tracking
(3) #45208 (Alexey Milovidov). - Remove trash from stress test #45211 (Alexey Milovidov).
- remove unused function #45212 (flynn).
- Fix flaky
test_keeper_three_nodes_two_alive
#45213 (Antonio Andelic). - Fuzz PREWHERE clause #45222 (Alexander Gololobov).
- Added a test for merge join key condition with big int & decimal #45228 (SmitaRKulkarni).
- Fix rare logical error:
Too large alignment
#45229 (Anton Popov). - Update version_date.tsv and changelogs after v22.3.17.13-lts #45234 (robot-clickhouse).
- More verbose logs about replication log entries #45235 (Alexander Tokmakov).
- One more attempt to fix race in TCPHandler #45240 (Nikita Mikhaylov).
- Update clickhouse-test #45251 (Alexander Tokmakov).
- Planner small fixes #45254 (Maksim Kita).
- Fix log level "Test" for send_logs_level in client #45273 (Azat Khuzhin).
- tests: fix clickhouse binaries detection #45283 (Azat Khuzhin).
- tests/ci: encode HTML entities in the reports #45284 (Azat Khuzhin).
- Disable
02151_hash_table_sizes_stats_distributed
under TSAN #45287 (Nikita Taranov). - Fix wrong approved_at, simplify conditions #45302 (Mikhail f. Shiryaev).
- Disable 02028_create_select_settings with Ordinary #45307 (Alexander Tokmakov).
- Save message format strings for DB::Exception #45342 (Alexander Tokmakov).
- Slightly better output for glibc check #45353 (Kseniia Sumarokova).
- Add checks for compilation of regexps #45356 (Anton Popov).
- Analyzer compound identifier typo correction fix #45357 (Maksim Kita).
- Bump to newer version of debug-action #45359 (Ilya Yatsishin).
- Improve failed kafka startup logging #45369 (Ilya Yatsishin).
- Fix flaky ttl test #45370 (alesapin).
- Add detailed profile events for throttling #45373 (Sergei Trifonov).
- Update .gitignore #45378 (Nikolay Degterinsky).
- Make test simpler to see errors #45402 (Ilya Yatsishin).
- Reduce an amount of trash in
tests_system_merges
#45403 (Alexander Tokmakov). - Fix reading from encrypted disk with passed file size #45418 (Anton Popov).
- Add delete by ttl for zookeeper_log #45419 (Nikita Taranov).
- Get rid of artifactory in favor of r2 + ch-repos-manager #45421 (Mikhail f. Shiryaev).
- Minor improvements around reading from remote #45442 (Kseniia Sumarokova).
- Docs: Beautify section on secondary index types #45444 (Robert Schulze).
- Fix Buffer's offsets mismatch logical error in stress test #45446 (Kseniia Sumarokova).
- Better formatting for exception messages #45449 (Alexander Tokmakov).
- Add default GRANULARITY argument for secondary indexes #45451 (Nikolay Degterinsky).
- Cleanup of inverted index #45460 (Robert Schulze).
- CherryPick: Fix a wrong staring search date #45466 (Mikhail f. Shiryaev).
- Fix typos #45470 (Robert Schulze).
- Fix possible aborts in arrow lib #45478 (Kruglov Pavel).
- Add more retries to AST Fuzzer #45479 (Nikolay Degterinsky).
- Fix schema inference from insertion table in hdfsCluster #45483 (Kruglov Pavel).
- Remove unnecessary getTotalRowCount function calls #45485 (Maksim Kita).
- Use new copy s3 functions in S3ObjectStorage #45487 (Vitaly Baranov).
- Forward declaration of ConcurrentBoundedQueue in ThreadStatus #45489 (Azat Khuzhin).
- Revert "Merge pull request #44922 from azat/dist/async-INSERT-metrics" #45492 (Azat Khuzhin).
- Docs: Fix weird formatting #45495 (Robert Schulze).
- Docs: Fix link to writing guide #45496 (Robert Schulze).
- Improve logging for TeePopen.timeout exceeded #45504 (Mikhail f. Shiryaev).
- Fix MSan build once again (too heavy translation units) #45512 (Nikolay Degterinsky).
- Additional check in MergeTreeReadPool #45515 (Kseniia Sumarokova).
- Update test_system_merges/test.py #45516 (Alexander Tokmakov).
- Revert "Merge pull request #45493 from azat/fix-detach" #45545 (Alexander Tokmakov).
- Update stress #45546 (Alexander Tokmakov).
- Ignore utf errors in clickhouse-test reportLogStats #45556 (Vladimir C).
- Resubmit "Fix possible in-use table after DETACH" #45566 (Alexander Tokmakov).
- Typo: "Granulesis" --> "Granules" #45598 (Robert Schulze).
- Fix version in autogenerated_versions.txt #45624 (Dmitry Novik).