mirror of
https://github.com/ClickHouse/ClickHouse.git
synced 2024-11-16 04:32:33 +00:00
108 KiB
108 KiB
sidebar_position | sidebar_label |
---|---|
1 | 2023 |
2023 Changelog
ClickHouse release v23.8.1.2992-lts (ebc7d9a9f3
) FIXME as compared to v23.7.1.2470-stable (a70127baec
)
Backward Incompatible Change
- Deprecate the metadata cache feature. It is experimental and we have never used it. The feature is dangerous: #51182. Remove the
system.merge_tree_metadata_cache
system table. The metadata cache is still available in this version but will be removed soon. This closes #39197. #51303 (Alexey Milovidov). - If a dynamic disk contains a name, it should be specified as
disk = disk(name = 'disk_name'
, ...) in disk function arguments. In previous version it could be specified asdisk = disk_<disk_name>(...)
, which is no longer supported. #52820 (Kseniia Sumarokova). clickhouse-benchmark
will establish connections in parallel when invoked with--concurrency
more than one. Previously it was unusable if you ran it with 1000 concurrent connections from Europe to the US. Correct calculation of QPS for connections with high latency. Backward incompatible change: the option for JSON output ofclickhouse-benchmark
is removed. If you've used this option, you can also extract data from thesystem.query_log
in JSON format as a workaround. #53293 (Alexey Milovidov).- The
microseconds
column is removed from thesystem.text_log
, and themilliseconds
column is removed from thesystem.metric_log
, because they are redundant in the presence of theevent_time_microseconds
column. #53601 (Alexey Milovidov). - Changed zookeeper paths for storage
S3Queue
metadata. #54137 (Kseniia Sumarokova).
New Feature
- Add column
ptr
tosystem.trace_log
fortrace_type = 'MemorySample'
. This column contains an address of allocation. Added functionflameGraph
which can build flamegraph containing allocated and not released memory. Reworking of #38391. #45322 (Nikolai Kochetov). - Add setting
rewrite_count_distinct_if_with_count_distinct_implementation
to rewritecountDistinctIf
withcount_distinct_implementation
. Closes #30642. #46051 (flynn). - Add new table engine
S3Queue
for streaming data import from s3. Closes #37012. #49086 (s-kat). - SevenZipArchiveReader - TarArchiveReader - Table Function file('path_to_archive :: filename') - Functional tests for "Table Function file('path_to_archive :: filename')" - Unit tests for TarArchiveReader/SevenZipArchiveReader. #50321 (nikitakeba).
- Added table function azureBlobStorageCluster table function. The supported set of features is very similar to table function S3Cluster. #50795 (SmitaRKulkarni).
- Allow using cluster, clusterAllReplicas, remote, remoteRaw and remoteSecure without table name in issue #50808. #50848 (Yangkuan Liu).
- System table to monitor kafka consumers. #50999 (Ilya Golshtein).
- Added max_sessions_for_user setting. #51724 (Alexey Gerasimchuck).
- Now that clickhouse do not have a function to convert UTC timezone timestamp to other timezone timestamp, which is not same as spark, and so we and the functions
toUTCTimestamp/fromUTCTimestamp
to act same as spark'sto_utc_timestamp/from_utc_timestamp
. #52117 (KevinyhZou). - Add new functions
structureToCapnProtoSchema
/structureToProtobufSchema
that convert ClickHouse table structure to CapnProto/Protobuf format schema. Allow to intput/output data in CapnProto/Protobuf format without external format schema using autogenerated schema from table structure (controled by settingsformat_capn_proto_use_autogenerated_schema
/format_protobuf_use_autogenerated_schema
). Allow to export autogenerated schema while input/outoput using settingoutput_format_schema
. #52278 (Kruglov Pavel). - A new field "query_cache_usage" in SYSTEM.QUERY_LOG now shows if and how the query cache was used. #52384 (Robert Schulze).
- Add new function startsWithUTF8 and endsWithUTF8. #52555 (李扬).
- Allow variable number of columns in TSV/CuatomSeprarated/JSONCompactEachRow, make schema inference work with variable number of columns. Add settings
input_format_tsv_allow_variable_number_of_columns
,input_format_custom_allow_variable_number_of_columns
,input_format_json_compact_allow_variable_number_of_columns
. #52692 (Kruglov Pavel). - Added
SYSTEM STOP/START PULLING REPLICATION LOG
queries (for testingReplicatedMergeTree
). #52881 (Alexander Tokmakov). - Allow to execute constant non-deterministic functions in mutations on initiator. #53129 (Anton Popov).
- Add input format One that doesn't read any data and always returns single row with column
dummy
with typeUInt8
and value0
likesystem.one
. It can be used together with_file/_path
virtual columns to list files in file/s3/url/hdfs/etc table functions without reading any data. #53209 (Kruglov Pavel). - Add tupleConcat function. Closes #52759. #53239 (Nikolay Degterinsky).
- Support
TRUNCATE DATABASE
operation. #53261 (Bharat Nallan). - Add max_threads_for_indexes setting to limit number of threads used for primary key processing. #53313 (Joris Giovannangeli).
- Add experimental support for HNSW as approximate neighbor search method. #53447 (Davit Vardanyan).
- Re-add SipHash keyed functions. #53525 (Salvatore Mesoraca).
- (#52755 , #52895) Added functions
arrayRotateLeft
,arrayRotateRight
,arrayShiftLeft
,arrayShiftRight
. #53557 (Mikhail Koviazin). - Add column
name
tosystem.clusters
as an alias to cluster. #53605 (irenjj). - The advanced dashboard now allows mass editing (save/load). #53608 (Alexey Milovidov).
- Add support for plural units. #53641 (irenjj).
- Support function
isNotDistinctFrom
in join on section for null-safe comparison, ref #53061. #53755 (vdimir). - Added the "hide_in_preprocessed" attribute to ClickHouse's server configuration XML dialect. This is a mechanism to hide certain settings from appearing in preprocessed server configuration files. Useful e.g. for passwords or private keys that should not appear verbatim in files. #53818 (Roman Vasin).
- Added server setting validate_tcp_client_information determines whether validation of client information enabled when query packet is received. #53907 (Alexey Gerasimchuck).
Performance Improvement
- Enable JIT compilation for AArch64, PowerPC, SystemZ, RISCV. #38217 (Maksim Kita).
- This patch will provide a method to deal with all the hashsets in parallel before merge. #50748 (Jiebin Sun).
- Optimize aggregation performance of nullable string key when using aggregationmethodserialized. #51399 (LiuNeng).
- The performance experiments of SSB on the ICX device (Intel Xeon Platinum 8380 CPU, 80 cores, 160 threads) show that this change could bring an improvement of 8.5% to the geomean QPS when the experimental analyzer is enabled. The details are shown below: . #52091 (Zhiguo Zhou).
- Parquet filter pushdown. I.e. when reading Parquet files, row groups (chunks of the file) are skipped based on the WHERE condition and the min/max values in each column. In particular, if the file is roughly sorted by some column, queries that filter by a short range of that column will be much faster. #52951 (Michael Kolupaev).
- Optimize the merge if all hashSets are singleLevel in UniqExactSet. #52973 (Jiebin Sun).
- StorageJoin: do not create clone hash join with all columns. #53046 (Duc Canh Le).
- Optimize reading small row groups by batching them together in Parquet. Closes #53069. #53281 (Kruglov Pavel).
- Implement native orc input format without arrow to improve performance. #53324 (李扬).
- The dashboard will tell the server to compress the data, which is useful for large time frames over slow internet connections. For example, one chart with 86400 points can be 1.5 MB uncompressed and 60 KB compressed with
br
. #53569 (Alexey Milovidov). - Optimize count from files in most input formats. Closes #44334. #53637 (Kruglov Pavel).
- Better utilization of thread pool for BACKUPs&RESTOREs. #53649 (Nikita Mikhaylov).
- Remove useless slow on client performance check. #53695 (Raúl Marín).
Improvement
- Bloom filter indices are pruned so that they correlate with cardinality of the data set they are tracking. #35102 (Anton Kozlov).
- Add
stderr_reaction
configuration/setting to control the reaction (none, log or throw) when external command stderr has data. This helps make debugging external command easier. #43210 (Amos Bird). - Https://github.com/clickhouse/clickhouse/issues/48720. @kgoralski helped with some thought about
system.merges
part. :d. #48990 (Jianfei Hu). - If a dictionary is created with a complex key, automatically choose the "complex key" layout variant. #49587 (xiebin).
- Add setting
use_concurrency_control
for better testing of the new concurrency control feature. #49618 (Alexey Milovidov). - Added suggestions for mistyped names for db and tables with different scenarios commented. #49801 (Yarik Briukhovetskyi).
- While read small files from hdfs by gluten, we found that it will cost more times when compare to directly query by spark. #50063 (KevinyhZou).
- Too many worthless error logs after session expiration. #50171 (helifu).
- Introduce fallback ZooKeeper sessions which are time-bound. Fixed
index
column in system.zookeeper_connection for DNS addresses. #50424 (Anton Kozlov). - Add ability to log when max_partitions_per_insert_block is reached ... #50948 (Sean Haynes).
- Added a bunch of custom commands (mostly to make ClickHouse debugging easier). #51117 (pufit).
- Updated check for connection_string as connection string with sas does not always begin with DefaultEndPoint and updated connection url to include sas token after adding container to url. #51141 (SmitaRKulkarni).
- Fix description for filtering sets in full_sorting_merge join. #51329 (ttanay).
- The sizes of the (index) uncompressed/mark, mmap and query caches can now be configured dynamically at runtime. #51446 (Robert Schulze).
- Fixed memory consumption in
Aggregator
whenmax_block_size
is huge. #51566 (Nikita Taranov). - Add
SYSTEM SYNC FILESYSTEM CACHE
command. It will compare in-memory state of filesystem cache with what it has on disk and fix in-memory state if needed. #51622 (Kseniia Sumarokova). - Attempt to create a generic proxy resolver for CH while keeping backwards compatibility with existing S3 storage conf proxy resolver. #51749 (Arthur Passos).
- Support reading tuple subcolumns from file/s3/hdfs/url/azureBlobStorage table functions. #51806 (Kruglov Pavel).
- Function
arrayIntersect
now returns the values sorted like the first argument. Closes #27622. #51850 (Yarik Briukhovetskyi). - Add new queries, which allow to create/drop of access entities in specified access storage or move access entities from one access storage to another. #51912 (pufit).
- ALTER TABLE FREEZE are not replicated in Replicated engine. #52064 (Mikhail Kot).
- Added possibility to flush logs to the disk on crash - Added logs buffer configuration. #52174 (Alexey Gerasimchuck).
- Fix S3 table function does not work for pre-signed URL. close #50846. #52310 (Jensen).
- System.events and system.metrics tables add column name as an alias to event and metric. close #51257. #52315 (Jensen).
- Added support of syntax
CREATE UNIQUE INDEX
in parser for better SQL compatibility.UNIQUE
index is not supported. Setcreate_index_ignore_unique=1
to ignore UNIQUE keyword in queries. #52320 (Ilya Yatsishin). - Add support of predefined macro (
{database}
and{table}
) in some kafka engine settings: topic, consumer, client_id, etc. #52386 (Yury Bogomolov). - Disable updating fs cache during backup/restore. Filesystem cache must not be updated during backup/restore, it seems it just slows down the process without any profit (because the BACKUP command can read a lot of data and it's no use to put all the data to the filesystem cache and immediately evict it). #52402 (Vitaly Baranov).
- Updated parameterized view implementation to create new StorageView with substituted parameters for every SELECT query of a parameterized view. #52569 (SmitaRKulkarni).
- The configuration of S3 endpoint allow using it from the root, and append '/' automatically if needed. #47809. #52600 (xiaolei565).
- Added support for adding and subtracting arrays:
[5,2] + [1,7]
. Division and multiplication were not implemented due to confusion between pointwise multiplication and the scalar product of arguments. Closes #49939. #52625 (Yarik Briukhovetskyi). - Add support for string literals as table name. Closes #52178. #52635 (hendrik-m).
- For clickhouse-local allow positional options and populate global UDF settings (user_scripts_path and user_defined_executable_functions_config). #52643 (Yakov Olkhovskiy).
- System.asynchronous_metrics now includes metrics "querycacheentries" and "querycachebytes" to inspect the query cache. #52650 (Robert Schulze).
- Added possibility use s3_storage_class parameter in SETTINGS of BACKUP statement for backups to S3. #52658 (Roman Vasin).
- Improve insert retries on keeper session expiration. #52688 (Raúl Marín).
- Add utility
print-backup-info.py
which parses a backup metadata file and prints information about the backup. #52690 (Vitaly Baranov). - Closes #49510. Currently we have database and table names case-sensitive, but the tools query
information_schema
sometimes in lowercase, sometimes in uppercase. For this reason we haveinformation_schema
database, containing lowercase tables, such asinformation_schema.tables
andINFORMATION_SCHEMA
database, containing uppercase tables, such asINFORMATION_SCHEMA.TABLES
. But some tools are queryingINFORMATION_SCHEMA.tables
andinformation_schema.TABLES
. The proposed solution is to duplicate both lowercase and uppercase tables in lowercase and uppercaseinformation_schema
database. #52695 (Yarik Briukhovetskyi). GET_PART
andATTACH_PART
are almost identical, so they should use same executor pool. #52716 (Duc Canh Le).- Query
CHECK TABLE
has better performance and usability (sends progress updates, cancellable). #52745 (vdimir). - Add modulo, intDiv, intDivOrZero for tuple. #52758 (Yakov Olkhovskiy).
- Search for default
yaml
andyml
configs in clickhouse-client afterxml
. #52767 (Alexey Milovidov). - When merging into non-'clickhouse' rooted configuration, configs with different root node name just bypassed without exception. #52770 (Yakov Olkhovskiy).
- Now it's possible to specify min (
memory_profiler_sample_min_allocation_size
) and max (memory_profiler_sample_max_allocation_size
) size for allocations to be tracked with sampling memory profiler. #52779 (alesapin). - Add
precise_float_parsing
setting to switch float parsing methods (fast/precise). #52791 (Andrey Zvonov). - Use the same default paths for
clickhouse_keeper
(symlink) as forclickhouse_keeper
(executable). #52861 (Vitaly Baranov). - CVE-2016-2183: disable 3DES. #52893 (Kenji Noguchi).
- Load filesystem cache metadata on startup in parallel. Configured by
load_metadata_threads
(default: 1) cache config setting. Related to #52037. #52943 (Kseniia Sumarokova). - Improve error message for table function remote. Closes #40220. #52959 (Jiyoung Yoo).
- Added the possibility to specify custom storage policy in the
SETTINGS
clause ofRESTORE
queries. #52970 (Victor Krasnov). - Add the ability to throttle the S3 requests on backup operations (
BACKUP
andRESTORE
commands now honors3_max_[get/put]_[rps/burst]
). #52974 (Daniel Pozo Escalona). - Add settings to ignore ON CLUSTER clause in queries for management of replicated user-defined functions or access control entities with replicated storage. #52975 (Aleksei Filatov).
- Enable parallel reading from replicas over distributed table. Related to #49708. #53005 (Igor Nikonov).
- EXPLAIN actions for JOIN step. #53006 (Maksim Kita).
- Make
hasTokenOrNull
andhasTokenCaseInsensitiveOrNull
return null for empty needles. #53059 (ltrk2). - Allow to restrict allowed paths for filesystem caches. Mainly useful for dynamic disks. If in server config
filesystem_caches_path
is specified, all filesystem caches' paths will be restricted to this directory. E.g. if thepath
in cache config is relative - it will be put infilesystem_caches_path
; ifpath
in cache config is absolute, it will be required to lie insidefilesystem_caches_path
. Iffilesystem_caches_path
is not specified in config, then behaviour will be the same as in earlier versions. #53124 (Kseniia Sumarokova). - Added a bunch of custom commands (mostly to make ClickHouse debugging easier). #53127 (pufit).
- Add diagnostic info about file name during schema inference - it helps when you process multiple files with globs. #53135 (Alexey Milovidov).
- Client will load suggestions using the main connection if the second connection is not allowed to create a session. #53177 (Alexey Gerasimchuck).
- Add EXCEPT clause to
SYSTEM STOP/START LISTEN QUERIES [ALL/DEFAULT/CUSTOM]
query, for exampleSYSTEM STOP LISTEN QUERIES ALL EXCEPT TCP, HTTP
. #53280 (Nikolay Degterinsky). - Change the default of
max_concurrent_queries
from 100 to 1000. It's ok to have many concurrent queries if they are not heavy, and mostly waiting for the network. Note: don't confuse concurrent queries and QPS: for example, ClickHouse server can do tens of thousands of QPS with less than 100 concurrent queries. #53285 (Alexey Milovidov). - Add ability to override credentials for accessing base backup in S3 (since tokens may be expired). #53326 (Azat Khuzhin).
- Improve
move_primary_key_columns_to_end_of_prewhere
. #53337 (Han Fei). - Limit number of concurrent background partition optimize merges. #53405 (Duc Canh Le).
- Added a setting
allow_moving_table_directory_to_trash
that allows to ignoreDirectory for table data already exists
error when replicating/recovering aReplicated
database. #53425 (Alexander Tokmakov). - Server settings asynchronous_metrics_update_period_s and asynchronous_heavy_metrics_update_period_s configured to 0 now fail gracefully instead of crash the server. #53428 (Robert Schulze).
- Previously the caller could register the same watch callback multiple times. In that case each entry was consuming memory and the same callback was called multiple times which didn't make much sense. In order to avoid this the caller could have some logic to not add the same watch multiple times. With this change this deduplication is done internally if the watch callback is passed via shared_ptr. #53452 (Alexander Gololobov).
- The ClickHouse server now respects memory limits changed via cgroups when reloading its configuration. #53455 (Robert Schulze).
- Add ability to turn off flush of Distributed tables on
DETACH
/DROP
/server shutdown (flush_on_detach
setting forDistributed
). #53501 (Azat Khuzhin). - Domainrfc support ipv6(ip literal within square brackets). #53506 (Chen768959).
- Use filter by file/path before reading in url/file/hdfs table functins. #53529 (Kruglov Pavel).
- Use longer timeout for S3 CopyObject requests. #53533 (Michael Kolupaev).
- Added server setting
aggregate_function_group_array_max_element_size
. This setting is used to limit array size forgroupArray
function at serialization. The default value is16777215
. #53550 (Nikolai Kochetov). SCHEMA()
was added as alias forDATABASE()
to improve MySQL compatibility. #53587 (Daniël van Eeden).- Add asynchronous metrics about tables in the system database. For example,
TotalBytesOfMergeTreeTablesSystem
. This closes #53603. #53604 (Alexey Milovidov). - SQL editor in the Play UI and Dashboard will not use Grammarly. #53614 (Alexey Milovidov).
- The advanced dashboard now has an option to maximize charts and move them around. #53622 (Alexey Milovidov).
- As expert-level settings, it is now possible to 1. configure the size_ratio (i.e. the relative size of the protected queue) of the [index] mark/uncompressed caches, 2. configure the cache policy of the index mark and index uncompressed caches. #53657 (Robert Schulze).
- More careful thread management will improve the speed of the S3 table function over a large number of files by more than ~25%. #53668 (pufit).
- Upgrade snappy to 1.1.10, clickhouse may benefit from it. #53672 (李扬).
- Added client info validation to the query packet in TCPHandler. #53673 (Alexey Gerasimchuck).
- Cache number of rows in files for count in file/s3/url/hdfs/azure functions. The cache can be enabled/disabled by setting
use_cache_for_count_from_files
(enabled by default). Continuation of https://github.com/ClickHouse/ClickHouse/pull/53637. #53692 (Kruglov Pavel). - Updated to retry loading part in case of Azure::Core::Http::TransportException (https://github.com/ClickHouse/ClickHouse/issues/39700#issuecomment-1686442785). #53750 (SmitaRKulkarni).
- Stacktrace for exceptions, Materailized view exceptions are propagated. #53766 (Ilya Golshtein).
- If no hostname or port were specified, keeper client will try to search for a connection string in the ClickHouse's config.xml. #53769 (pufit).
- Add profile event
PartsLockMicroseconds
which shows the amount of microseconds we hold the data parts lock in MergeTree table engine family. #53797 (alesapin). - Make reconnect limit in raft limits configurable for keeper. This configuration can help to make keeper to rebuild connection with peers quicker if the current connection is broken. #53817 (Pengyuan Bian).
- Supported globs in select from file in clickhouse-local. #53863 (Alexey Gerasimchuck).
- ...Ignore foreign keys in tables definition to improve compatibility with MySQL, so a user wouldn't need to rewrite his SQL of the foreign key part, ref #53380. #53864 (jsc0218).
- 'from' is supported as a Expression. #53914 (Chen768959).
- Changes of the server configuration are now detected with high precision (milliseconds and less). #54065 (Mikhail Koviazin).
Build/Testing/Packaging Improvement
- Don't expose symbols from ClickHouse binary to dynamic linker. It might fix #43933. #47475 (Alexey Milovidov).
- Fixed endian issues in native protocol. #50267 (Harry Lee).
- Build
clickhouse/nginx-dav
and use it in integration tests instead ofkssenii/nginx-test
. Addresses #43182. #51843 (Mikhail f. Shiryaev). - Add
clickhouse-keeper-client
symlink to the clickhouse-server package. #51882 (Mikhail f. Shiryaev). - Fixed ForEach aggregate function state for s390x. #52040 (Harry Lee).
- Add https://github.com/elliotchance/sqltest to CI to report the SQL 2016 conformance. #52293 (Alexey Milovidov).
- Fixed codec delta endian issue for s390x. #52592 (Harry Lee).
- Packing inline cache into docker images sometimes causes strange special effects. Since we don't use it at all, it's good to go. #53008 (Mikhail f. Shiryaev).
- Upgrade PRQL to 0.9.3. #53060 (Maximilian Roos).
- System tables from CI checks are exported to ClickHouse Cloud. #53086 (Alexey Milovidov).
- The compiler's profile data (
-ftime-trace
) is uploaded to ClickHouse Cloud. #53100 (Alexey Milovidov). - Speed up Debug and Tidy builds. #53178 (Alexey Milovidov).
- Speed up the build by removing tons and tonnes of garbage. One of the frequently included headers was poisoned by boost. #53180 (Alexey Milovidov).
- Add ClickHouse builds for Linux s390x to CI. #53181 (Yakov Olkhovskiy).
- Remove even more garbage. #53182 (Alexey Milovidov).
- The function
arrayAUC
was using heavy C++ templates. #53183 (Alexey Milovidov). - Some translation units were always rebuilt regardless of ccache. The culprit is found and fixed. #53184 (Alexey Milovidov).
- The compiler's profile data (
-ftime-trace
) is uploaded to ClickHouse Cloud., the second attempt after #53100. #53213 (Alexey Milovidov). - Three tests were failing / flaky: 1. test_host_regexp_multiple_ptr_records 2. test_host_regexp_multiple_ptr_records_concurrent 3. test_reverse_dns_query. #53286 (Arthur Passos).
- Export logs from CI in stateful tests to ClickHouse Cloud. #53351 (Alexey Milovidov).
- Export logs from CI in stress tests. #53353 (Alexey Milovidov).
- Export logs from CI in fuzzer. #53354 (Alexey Milovidov).
- Export logs from CI in performance test to ClickHouse Cloud. #53355 (Alexey Milovidov).
- Preserve environment parameters in
clickhouse start
command. Fixes #51962. #53418 (Mikhail f. Shiryaev). - Follow up for #53418. Small improvements for install_check.py, adding tests for proper ENV parameters passing to the main process on
init.d start
. #53457 (Mikhail f. Shiryaev). - Fixed base64 endian issue for s390x. #53570 (Harry Lee).
- Reorganize file management in CMake to prevent potential duplications. For instance,
indexHint.cpp
is duplicated in bothdbms_sources
andclickhouse_functions_sources
. #53621 (Amos Bird). - Fixed functional test in 02354_distributed_with_external_aggregation_memory_usage in s390x. #53648 (Harry Lee).
- Skipped QPL functional test for s390x. #53758 (Harry Lee).
- Slightly improve cmake build by sanitizing some dependencies and removing some duplicates. Each commit includes a short description of the changes made. #53759 (Amos Bird).
- Fixed StripeLog storage endian issue on the s390x platform. #53902 (Harry Lee).
Bug Fix (user-visible misbehavior in an official stable release)
- Fix results of queries utilizing the Annoy index when the part has more than one mark. #51325 (Tian Xinhui).
- Fix usage of temporary directories during RESTORE. #51493 (Azat Khuzhin).
- Fixed binary arithmetic for Nullable(IPv4). #51642 (Yakov Olkhovskiy).
- Support IPv4 and IPv6 as dictionary attributes. #51756 (Yakov Olkhovskiy).
- Updated checkDataPart to read compress marks as compressed file by checking its extension resolves #51337. #51777 (SmitaRKulkarni).
- Fix mistakenly comma parsing as part of datetime in CSV datetime best effort parsing. Closes #51059. #51950 (Kruglov Pavel).
- Fixed exception when executable udf was provided with a parameter. #51961 (Nikita Taranov).
- Fixed recalculation of skip indexes and projections in
ALTER DELETE
queries. #52530 (Anton Popov). - Fixed the infinite loop in ReadBuffer when the pos overflows the end of the buffer in MaterializedMySQL. #52621 (Val Doroshchuk).
- Do not try to load suggestions in
clickhouse-local
when a the dialect is notclickhouse
. #52628 (János Benjamin Antal). - Remove mutex from CaresPTRResolver and create
ares_channel
on demand. Trying to fix: https://github.com/ClickHouse/ClickHouse/pull/52327#issuecomment-1643021543. #52634 (Arthur Passos). - Fix filtering by virtual columns with OR expression (i.e. by
_table
forMerge
engine). #52653 (Azat Khuzhin). - Fix crash in function
tuple
with one sparse column argument. #52659 (Anton Popov). - Fix named collections related statements:
if [not] exists
,on cluster
. Closes #51609. #52687 (Al Korgun). - Fix reading of unnecessary column in case of multistage
PREWHERE
. #52689 (Anton Popov). - Fix unexpected sort result on multi columns with nulls first direction. #52761 (ZhiHong Zhang).
- Keeper fix: fix data race during reconfiguration. #52804 (Antonio Andelic).
- Fixed sorting of sparse columns in case of
ORDER BY ... LIMIT n
clause and large values ofn
. #52827 (Anton Popov). - Keeper fix: platforms that used poll() would delay responding to requests until the client sent a heartbeat. #52833 (Andy Fiddaman).
- Make regexp analyzer recognize named capturing groups. #52840 (Han Fei).
- Fix possible assert in ~PushingAsyncPipelineExecutor in clickhouse-local. #52862 (Kruglov Pavel).
- Fix reading of empty
Nested(Array(LowCardinality(...)))
columns (added byALTER TABLE ... ADD COLUMN ...
query and not materialized in parts) from compact parts ofMergeTree
tables. #52949 (Anton Popov). - Fixed the record inconsistency in session_log between login and logout. #52958 (Alexey Gerasimchuck).
- Fix password leak in show create mysql table. #52962 (Duc Canh Le).
- Fix possible crash in full sorting merge join on sparse columns, close #52978. #53000 (vdimir).
- Fix very rare race condition with empty key prefix directory deletion in fs cache. #53055 (Kseniia Sumarokova).
- Fixed
output_format_parquet_compression_method='zstd'
producing invalid Parquet files sometimes. In older versions, use settingoutput_format_parquet_use_custom_encoder = 0
as a workaround. #53064 (Michael Kolupaev). - Fix query_id in part_log with async flush queries. #53103 (Raúl Marín).
- Fix possible error from filesystem cache "Read unexpected size". #53121 (Kseniia Sumarokova).
- Disable the new parquet encoder: it has a bug. #53130 (Alexey Milovidov).
Not-ready Set is passed as the second argument for function 'in'
could happen with limitedmax_result_rows
andresult_overflow_mode = 'break'
. #53162 (Nikolai Kochetov).- Fix character escaping in the PostgreSQL engine (
\'
->''
,\\
->\
). Closes #49821. #53250 (Nikolay Degterinsky). - Fixed the record inconsistency in session_log between login and logout. #53255 (Alexey Gerasimchuck).
- Fixed the record inconsistency in session_log between login and logout. #53302 (Alexey Gerasimchuck).
- Fixed adding intervals of a fraction of a second to DateTime producing incorrect result. #53309 (Michael Kolupaev).
- Fix the "Context has expired" error in dictionaries when using subqueries. #53342 (Alexey Milovidov).
- Fix incorrect normal projection AST format when single function is used in ORDER BY. This fixes #52607. #53347 (Amos Bird).
- Forbid
use_structure_from_insertion_table_in_table_functions
when execute Scalar. Closes #52494. #53348 (flynn). - Avoid loading tables from lazy database when not needed Follow up to #43840. #53372 (SmitaRKulkarni).
- Fixed
system.data_skipping_indices
columnsdata_compressed_bytes
anddata_uncompressed_bytes
for MaterializedMySQL. #53381 (Filipp Ozinov). - Fix processing single carriage return in TSV file segmentation engine that could lead to parsing errors. Closes #53320. #53407 (Kruglov Pavel).
- Fix the "Context has expired" error when using subqueries with functions
file()
(regular function, not table function),joinGet()
,joinGetOrNull()
,connectionId()
. #53433 (Michael Kolupaev). - Fix timeout_overflow_mode when having subquery in the rhs of IN. #53439 (Duc Canh Le).
- This PR fixes #53152. #53440 (Zhiguo Zhou).
- Fix the JSON_QUERY function can not parse the json string while path is numberic. like in the query SELECT JSON_QUERY('{"123":"abcd"}', '
.123'), we would encounter the exceptions ``` DB::Exception: Unable to parse JSONPath: While processing JSON_QUERY('{"123":"acd"}', '
.123'). (BAD_ARGUMENTS) ```. #53470 (KevinyhZou). - Fix possible crash for queries with parallel
FINAL
whereORDER BY
andPRIMARY KEY
are different in table definition. #53489 (Nikolai Kochetov). - Fixed ReplacingMergeTree to properly process single-partition cases when
do_not_merge_across_partitions_select_final=1
. PreviouslySELECT
could return rows that were marked as deleted. #53511 (Vasily Nemkov). - Fix bug in flushing of async insert queue on graceful shutdown. #53547 (joelynch).
- Fix crash in join on sparse column. #53548 (vdimir).
- Fix possible UB in Set skipping index for functions with incorrect args. #53559 (Azat Khuzhin).
- Fix possible UB in inverted indexes (experimental feature). #53560 (Azat Khuzhin).
- Fixed bug for interpolate when interpolated column is aliased with the same name as a source column. #53572 (Yakov Olkhovskiy).
- Fixed a bug in EXPLAIN PLAN index=1 where the number of dropped granules was incorrect. #53616 (wangxiaobo).
- Correctly handle totals and extremes when
DelayedSource
is used. #53644 (Antonio Andelic). - Fix
Pipeline stuck
error in mutation withIN (subquery WITH TOTALS)
where ready set was taken from cache. #53645 (Nikolai Kochetov). - Allow to use JSON subcolumns in predicates of UPDATE and DELETE queries. #53677 (zps).
- Fix possible logical error exception during filter pushdown for full_sorting_merge join. #53699 (vdimir).
- Fix NULL::LowCardinality(Nullable(...)) with IN. #53706 (Andrey Zvonov).
- Fixes possible crashes in
DISTINCT
queries with enabledoptimize_distinct_in_order
and sparse columns. #53711 (Igor Nikonov). - Correctly handle default column with multiple rows in transform. #53742 (Salvatore Mesoraca).
- Fix crash in SQL function parseDateTime() with non-const timezone argument. #53764 (Robert Schulze).
- Fix uncaught exception in
getCreateTableQueryImpl
. #53832 (Kseniia Sumarokova). - Fix possible segfault while using PostgreSQL engine. Closes #36919. #53847 (Kseniia Sumarokova).
- Fix
named_collection_admin
alias tonamed_collection_control
not working from config. #54066 (Kseniia Sumarokova). - A distributed query could miss
rows_before_limit_at_least
in the query result in case it was executed on a replica with a delay more thanmax_replica_delay_for_distributed_queries
. #54122 (Nikolai Kochetov).
NO CL ENTRY
- NO CL ENTRY: 'Revert "Implementing new commands for keeper-client"'. #52985 (Alexey Milovidov).
- NO CL ENTRY: 'Revert "Remove try/catch from DatabaseFilesystem"'. #53044 (Alexander Tokmakov).
- NO CL ENTRY: 'Revert "Upload build time-trace data to CI database"'. #53210 (Alexander Gololobov).
- NO CL ENTRY: 'Revert "Added new tests for session_log and fixed the inconsistency between login and logout."'. #53247 (Alexey Milovidov).
- NO CL ENTRY: 'Revert "Improve CHECK TABLE system query"'. #53272 (Alexander Tokmakov).
- NO CL ENTRY: 'Revert "#2 Added new tests for session_log and fixed the inconsistency between login and logout."'. #53294 (Alexey Milovidov).
- NO CL ENTRY: 'Revert "Documentation: add Ibis project to the integrations section"'. #53374 (Alexey Milovidov).
- NO CL ENTRY: 'Revert "Planner prepare filters for analysis"'. #53782 (Alexander Tokmakov).
- NO CL ENTRY: 'Revert "dateDiff: add support for plural units."'. #53795 (Alexander Tokmakov).
- NO CL ENTRY: 'Revert "Fixed wrong python test name pattern"'. #53929 (Alexander Tokmakov).
- NO CL ENTRY: 'Revert "Fix bug on mutations with subcolumns of type JSON in predicates of UPDATE and DELETE queries."'. #54063 (Alexander Tokmakov).
NOT FOR CHANGELOG / INSIGNIFICANT
- clickhouse-copier add check drop partition #35263 (sunny).
- Add more checks into ThreadStatus ctor. #42019 (Nikolai Kochetov).
- Refactor Query Tree visitor #46740 (Dmitry Novik).
- Revert "Revert "Randomize JIT settings in tests"" #48282 (Alexey Milovidov).
- Fix outdated cache configuration in s3 tests: s3_storage_policy_by_defau… #48424 (Kseniia Sumarokova).
- Fix IN with decimal in analyzer #48754 (vdimir).
- Some unclear change in StorageBuffer::reschedule() for something #49723 (DimasKovas).
- MergeTree & SipHash checksum big-endian support #50276 (ltrk2).
- Maintain same aggregate function merge behavior for small and big endian machine #50609 (Suzy Wang).
- Add a test to limit client max opening fd #51213 (Duc Canh Le).
- Add info about acquired space in cache to not enough space error #51537 (vdimir).
- KeeperDispatcher: remove reductant lock as the ConcurrentBoundedQueue is thread-safe #51766 (frinkr).
- Fix build type in packager #51771 (Antonio Andelic).
- metrics_perf_events_enabled turn off in perf tests #52072 (Sema Checherinda).
- Remove try/catch from DatabaseFilesystem #52155 (Alexey Milovidov).
- Add a test that clickhouse-client or local do not throw/catch on startup #52159 (Alexey Milovidov).
- Retry blob listing in test_alter_moving_garbage #52193 (vdimir).
- Try to make
test_kafka_formats_with_broken_message
andtest_kafka_formats
integration tests stable #52273 (János Benjamin Antal). - Kill the runner process with all subprocesses #52277 (Mikhail f. Shiryaev).
- Implement endianness-indepedent support for MergeTree checksums #52329 (ltrk2).
- add tests with connection reset by peer error, and retry it inside client #52441 (Sema Checherinda).
- Fix logging for asynchronous non-batched distributed sends #52583 (Azat Khuzhin).
- Follow-up to "Implement support of encrypted elements in configuration file" #52609 (Robert Schulze).
- Return zxid from TestKeeper and in multi responses #52618 (Alexander Gololobov).
- Analyzer: Support ARRAY JOIN COLUMNS(...) syntax #52622 (Dmitry Novik).
- Fix stress test: check if storage shutdown before we operate MergeTreeDeduplicationLog #52623 (Han Fei).
- Suspicious DISTINCT crashes from sqlancer #52636 (Igor Nikonov).
- Partially fixed test 01747_system_session_log_long #52640 (Alexey Gerasimchuck).
- Check for unexpected Cyrillic #52641 (Alexey Milovidov).
- Fix
test_keeper_reconfig_replace_leader
#52651 (Antonio Andelic). - Rename setting disable_url_encoding to enable_url_encoding and add a test #52656 (Kruglov Pavel).
- Remove creation of a unnecessary temporary ContextAccess on login #52660 (Vitaly Baranov).
- Update version after release #52661 (Alexey Milovidov).
- Update version_date.tsv and changelogs after v23.7.1.2470-stable #52664 (robot-clickhouse).
- Fix bugs and better test for SYSTEM STOP LISTEN #52680 (Nikolay Degterinsky).
- Remove unneeded readBinary() specializations + update docs #52683 (Robert Schulze).
- Remove remainders of legacy setting 'allow_experimental_query_cache' #52685 (Robert Schulze).
- Fix 02417_opentelemetry_insert_on_distributed_table flakiness #52691 (Azat Khuzhin).
- Improvements to backup restore disallow_concurrency test #52709 (SmitaRKulkarni).
- Move UnlinkMetadataFileOperationOutcome to common header #52710 (Alexander Gololobov).
- Improve endianness-independent support for hash functions #52712 (ltrk2).
- Allow reading zero objects in CachedObjectStorage::readObjects() #52733 (Michael Kolupaev).
- Merging reading from archives #50321 #52734 (Antonio Andelic).
- Merging #52640 #52744 (Alexander Tokmakov).
- Analyzer: fix 00979_set_index_not.sql #52754 (Igor Nikonov).
- Planner prepare filters for analysis #52762 (Maksim Kita).
- Allow reading empty file with no blobs #52763 (Alexander Gololobov).
- Fix: check correctly window frame bounds for RANGE #52768 (Igor Nikonov).
- Numerical stability of the test for Polygons #52769 (Alexey Milovidov).
- Change the default timezones in Docker test images #52772 (Alexey Milovidov).
- Upload build statistics to the CI database #52773 (Alexey Milovidov).
- Add
instance_type
information to the CI database #52774 (Alexey Milovidov). - Remove Coverity (part 2) #52775 (Alexey Milovidov).
- Add a tool to upload
-ftime-trace
to ClickHouse #52776 (Alexey Milovidov). - Revert revert of system drop filesystem cache by key #52778 (Kseniia Sumarokova).
- Remove obsolete part of a check name #52793 (Alexey Milovidov).
- Maybe fix TLS tests #52796 (Alexey Milovidov).
- Allow OOM in Stress and Upgrade checks #52807 (Alexey Milovidov).
- Do not test upper bounds for throttlers #52821 (Sergei Trifonov).
- Add more logging and touch test for materialize mysql #52822 (alesapin).
- Try to remove more leftovers. #52823 (Nikolai Kochetov).
- Update test_crash_log/test.py #52825 (Alexander Tokmakov).
- Don't report LOGICAL_ERROR if a file got truncated during read #52828 (Michael Kolupaev).
- Throw S3Exception whenever possible. #52829 (Nikolai Kochetov).
- Increase min protocol version for sparse serialization #52835 (Anton Popov).
- Cleanup localBackup #52837 (Nikolai Kochetov).
- Try to fix 02352_rwlock #52852 (János Benjamin Antal).
- Disable a couple of long tests for debug build. #52854 (Nikolai Kochetov).
- Fix flaky tests in test_merge_tree_azure_blob_storage & test_storage_azure_blob_storage #52855 (SmitaRKulkarni).
- Cancel merges before renaming a system log table #52858 (Alexander Tokmakov).
- Try to fix a rare fail in 00612_http_max_query_size #52859 (Nikolai Kochetov).
- Remove duplicated dialect setting value #52864 (János Benjamin Antal).
- Significant improvement of rust caching #52865 (Mikhail f. Shiryaev).
- Docker improvements #52869 (Mikhail f. Shiryaev).
- Try to continue clickhouse process in stress test after terminating gdb. #52871 (Nikolai Kochetov).
- fix master ci for #52091 #52873 (Han Fei).
- Fix the PR body check for
Reverts #number
#52874 (Mikhail f. Shiryaev). - Analyzer WITH statement references test #52875 (Maksim Kita).
- Disable more tests for debug. #52878 (Nikolai Kochetov).
- Fix assertion in mutations with transactions #52894 (Alexander Tokmakov).
- Fixed test_profile_max_sessions_for_user test flakiness #52897 (Alexey Gerasimchuck).
- Use concepts to replace more std::enable_if_t #52898 (flynn).
- Disable
test_reconfig_replace_leader_in_one_command
#52901 (Antonio Andelic). - tests: fix possible EADDRINUSE v2 #52906 (Azat Khuzhin).
- Merging #52897 #52907 (Alexander Tokmakov).
- Remove obsolete
no-upgrade-check
tag #52915 (Alexander Tokmakov). - Fix flaky test_storage_s3_queue::test_multiple_tables_streaming_sync_distributed #52944 (Kseniia Sumarokova).
- Don't create empty parts on drop partittion if we have a transaction #52945 (Alexander Tokmakov).
- Analyzer: fix WITH clause resolving #52947 (Dmitry Novik).
- Refactor CI_CONFIG #52948 (Mikhail f. Shiryaev).
- Try to fix assert in remove redundant sorting #52950 (Igor Nikonov).
- Remove unused code in StorageSystemStackTrace #52952 (Azat Khuzhin).
- Fix wrong error code "BAD_GET" #52954 (Alexey Milovidov).
- Fix some issues with databases #52956 (Alexander Tokmakov).
- Fix config update in HTTP Header Filtering #52957 (Nikolay Degterinsky).
- Added peak_memory_usage to clickhouse-client final progress message #52961 (Alexey Gerasimchuck).
- tests: fix 01293_client_interactive_vertical_multiline flakiness (increase timeout) #52965 (Azat Khuzhin).
- Added TSAN option report_atomic_races=0 for test_max_sessions_for_user #52969 (Alexey Gerasimchuck).
- MaterializedMySQL: Add tests for unquoted utf8 column names in DML #52971 (Val Doroshchuk).
- Update version_date.tsv and changelogs after v23.7.2.25-stable #52976 (robot-clickhouse).
- Decrease a num of tries for a couple of too slow tests for debug. #52981 (Nikolai Kochetov).
- Fix test
00061_storage_buffer
#52983 (Alexey Milovidov). - Remove
test_host_regexp_multiple_ptr_records_concurrent
, CC @arthurpassos #52984 (Alexey Milovidov). - Fix
test_zookeeper_config
#52988 (Alexey Milovidov). - Remove assertion from test_no_ttl_merges_in_busy_pool #52989 (alesapin).
- Fix
test_dictionary_custom_settings
#52990 (Alexey Milovidov). - Fix flaky test #53007 (alesapin).
- Fix default port for Keeper Client #53010 (pufit).
- Add a test to broken tests (Analyzer) #53013 (Nikita Mikhaylov).
- Implement big-endian support for transform #53015 (ltrk2).
- Fix completion for clickhouse-keeper-client #53029 (Azat Khuzhin).
- clickhouse-keeper-client: fix version parsing for set command #53031 (Azat Khuzhin).
- MaterializedMySQL: Add tests to alter named collections #53032 (Val Doroshchuk).
- Fix description for 's3_upload_part_size_multiply_parts_count_threshold' setting #53042 (Elena Torró).
- Update 01114_database_atomic.sh #53043 (Alexander Tokmakov).
- Revert revert of "Remove try/catch from DatabaseFilesystem" #53045 (Kseniia Sumarokova).
- Fix cache related logical error in stress tests #53047 (Kseniia Sumarokova).
- Remove upgrade checks with sanitizers #53051 (János Benjamin Antal).
- Increase election timeout in integration tests #53052 (Alexander Tokmakov).
- Analyzer: do not enable it for old servers in tests #53053 (Dmitry Novik).
- Try to make
01414_mutations_and_errors_zookeeper
less flaky #53056 (János Benjamin Antal). - Fix test
02434_cancel_insert_when_client_dies
#53062 (Alexey Milovidov). - Add
abort_on_error=1
toTSAN_OPTIONS
#53065 (Nikita Taranov). - Fix Parquet stats for Float32 and Float64 #53067 (Michael Kolupaev).
- Fix a comment #53072 (Alexey Milovidov).
- Fix 02263_format_insert_settings flakiness #53080 (Azat Khuzhin).
- Something with tests #53081 (Alexey Milovidov).
- Update version_date.tsv and changelogs after v23.7.3.14-stable #53084 (robot-clickhouse).
- Simplify system logs creation #53085 (Alexey Milovidov).
- Fix hung check in stress test #53090 (Alexey Milovidov).
- Add clusters for running tests locally easily #53091 (Alexey Milovidov).
- Fix wording #53092 (Alexey Milovidov).
- Update README.md #53097 (Tyler Hannan).
- Remove old util #53099 (Alexey Milovidov).
- Add optional parameters to Buffer Engine definition #53102 (Elena Torró).
- Compatibility with clang-17 #53104 (Raúl Marín).
- Remove duplicate test:
test_concurrent_alter_with_ttl_move
#53107 (alesapin). - Relax flaky test
test_s3_engine_heavy_write_check_mem
#53108 (alesapin). - Update PocoHTTPClient.cpp #53109 (Alexander Tokmakov).
- Add hints for HTTP handlers #53110 (Ruslan Mardugalliamov).
- Revert changes in
ZstdDeflatingAppendableWriteBuffer
#53111 (Antonio Andelic). - Fix flaky test by using azure_query function #53113 (SmitaRKulkarni).
- Update
test_restore_replica
#53119 (Alexander Tokmakov). - do not fail if prctl is not allowed (#43589) #53122 (ekrasikov).
- Use more unique name for TemporaryFileOnDisk #53123 (Vitaly Baranov).
- Update
Mergeable Check
at the finishing CI #53126 (Mikhail f. Shiryaev). - Added retry for TransportException in azure blob storage #53128 (SmitaRKulkarni).
- Small fix for HTTPHeaderFilter #53146 (San).
- Added functions to disallow concurrency of backup restore test #53150 (SmitaRKulkarni).
- Attempt to fix test_insert_quorum by adding sync second replica #53155 (vdimir).
- fix mem leak in RegExpTreeDictionary #53160 (Han Fei).
- Fixes for detach/attach partition and broken detached parts cleanup #53164 (Alexander Tokmakov).
- Update conftest.py #53166 (Alexander Tokmakov).
- Allow experimantal features when recovering Replicated db replica #53167 (Alexander Tokmakov).
- Update version_date.tsv and changelogs after v23.7.4.5-stable #53169 (robot-clickhouse).
- Analyzer: fix test_system_flush_logs #53171 (Dmitry Novik).
- Fix warning in test_replicated_database #53173 (Michael Kolupaev).
- Fix: 00838_unique_index test with analyzer #53175 (Igor Nikonov).
- Improved efficiency for array operations #53193 (Yarik Briukhovetskyi).
- Disable test_reverse_dns_query/test.py #53195 (Alexander Tokmakov).
- Improve reading from archives #53198 (Antonio Andelic).
- Disable test_host_regexp_multiple_ptr_records/test.py #53211 (Alexander Tokmakov).
- Enable hedged requests under tsan #53219 (Kruglov Pavel).
- Remove garbage #53241 (Alexey Milovidov).
- Fix LOGICAL_ERROR exception in ALTER query #53242 (Nikolay Degterinsky).
- Fix bad test
00417_kill_query
#53244 (Alexey Milovidov). - Fix test
02428_delete_with_settings
#53246 (Alexey Milovidov). - Remove unrecognizable garbage from the performance test #53249 (Alexey Milovidov).
- Disable randomization in
02273_full_sort_join
#53251 (Alexey Milovidov). - Remove outdated Dockerfile #53252 (Alexey Milovidov).
- Improve fs cache cleanup #53273 (Kseniia Sumarokova).
- Add garbage #53279 (Alexander Tokmakov).
- Inhibit randomization in
00906_low_cardinality_cache
#53283 (Alexey Milovidov). - Fix test 01169_old_alter_partition_isolation_stress #53292 (Alexander Tokmakov).
- Remove no-parallel tag from some tests #53295 (Alexander Tokmakov).
- Fix test
00002_log_and_exception_messages_formatting
#53296 (Alexey Milovidov). - Fix
01485_256_bit_multiply
#53297 (Alexey Milovidov). - Remove flaky tests for the experimental
UNDROP
feature #53298 (Alexey Milovidov). - Added test for session_log using remote and mysql sessions #53304 (Alexey Gerasimchuck).
- Added integration test for session_log using concurrrent GRPC/PostgreSQL/MySQL sessions #53305 (Alexey Gerasimchuck).
- Added test for session_log using concurrrent TCP/HTTP/MySQL sessions #53306 (Alexey Gerasimchuck).
- Added test for session_log dropping user/role/profile currently used in active session #53307 (Alexey Gerasimchuck).
- Added an integration test for client peak_memory_usage value #53308 (Alexey Gerasimchuck).
- Fix log message #53339 (Kseniia Sumarokova).
- Analyzer: fix quotas for system tables #53343 (Dmitry Novik).
- Relax mergeable check #53344 (Alexey Milovidov).
- Add clickhouse-keeper-client and clickhouse-keeper-converter symlinks to clickhouse-keeper package #53357 (Pradeep Chhetri).
- Add linux s390x to universal installer #53358 (Pradeep Chhetri).
- Make one exception message longer #53375 (Alexey Milovidov).
- Fix wrong query in log messages check #53376 (Alexey Milovidov).
- Non-significant changes #53377 (Alexey Milovidov).
- Inhibit randomization in more tests #53378 (Alexey Milovidov).
- Make some Keeper exceptions more structured #53379 (Alexey Milovidov).
- Follow-up to #52695: Move tests to a more appropriate place #53400 (Robert Schulze).
- Minor fixes (hints for wrong DB or table name) #53402 (Yarik Briukhovetskyi).
- Quick fail undocumented features #53413 (Mikhail f. Shiryaev).
- boost getNestedColumnWithDefaultOnNull by insertManyDefaults #53414 (frinkr).
- Update test_distributed_inter_server_secret to pass with analyzer #53416 (vdimir).
- Parallel replicas: remove unnecessary code #53419 (Igor Nikonov).
- Refactorings for configuration of in-memory caches #53422 (Robert Schulze).
- Less exceptions with runtime format string #53424 (Alexander Tokmakov).
- Analyzer: fix virtual columns in StorageDistributed #53426 (Dmitry Novik).
- Fix creation of empty parts #53429 (Alexander Tokmakov).
- Merging #53177 #53430 (Alexander Tokmakov).
- Merging #53142 #53431 (Alexander Tokmakov).
- Do not send logs to CI if the credentials are not set #53441 (Alexey Milovidov).
- Minor: Factorize constants in Annoy index #53444 (Robert Schulze).
- Restart killed PublishedReleaseCI workflows #53445 (Mikhail f. Shiryaev).
- Follow-up: Do not send logs to CI if the credentials are not set #53456 (Alexey Milovidov).
- Merging #53307 #53472 (Alexander Tokmakov).
- Merging #53306 #53473 (Alexander Tokmakov).
- Merging #53304 #53474 (Alexander Tokmakov).
- Merging #53373 #53475 (Alexander Tokmakov).
- Fix flaky test
02443_detach_attach_partition
#53478 (Alexander Tokmakov). - Remove outdated code in ReplicatedMergeTreeQueue::initialize() #53484 (Azat Khuzhin).
- krb5: Fix CVE-2023-36054 #53485 (Robert Schulze).
- curl: update to latest master (fixes CVE-2023-32001) #53487 (Robert Schulze).
- Update boost to 1.79 #53490 (Robert Schulze).
- Get rid of secrets CLICKHOUSE_CI_LOGS #53491 (Mikhail f. Shiryaev).
- Update style checker #53493 (Mikhail f. Shiryaev).
- Update materialized_with_ddl.py #53494 (Alexander Tokmakov).
- Fix a race condition between RESTART REPLICAS and DROP DATABASE #53495 (Alexander Tokmakov).
- Fix tiny thing in Replicated database #53496 (Nikolay Degterinsky).
- Simplify performance test #53499 (Alexey Milovidov).
- Added waiting for PostgreSQL compatibility port open in integrational tests. #53505 (Alexey Gerasimchuck).
- Allow non standalone keeper run in integration tests #53512 (Duc Canh Le).
- Make sending logs to the cloud less fragile (and fix an unrelated flaky test) #53528 (Alexander Tokmakov).
- Update test.py #53534 (Alexander Tokmakov).
- Fix
AddressSanitizer failed to allocate 0x0 (0) bytes of SetAlternateSignalStack
in integration tests #53535 (Nikita Taranov). - Fix keeper default path check #53539 (pufit).
- Follow-up to #53528 #53544 (Alexander Tokmakov).
- Update 00002_log_and_exception_messages_formatting.sql #53545 (Alexander Tokmakov).
- Update krb5 to 1.21.2 #53552 (Robert Schulze).
- Enable ISA-L on x86-64 only by default #53553 (ltrk2).
- Change Big Endian-UUID to work the same as Little Endian-UUID #53556 (Austin Kothig).
- Bump openldap to LTS version (v2.5.16) #53558 (Robert Schulze).
- Update 02443_detach_attach_partition.sh #53564 (Alexander Tokmakov).
- Proper destruction of task in ShellCommandSource #53573 (Amos Bird).
- Fix for flaky test_ssl_cert_authentication #53586 (Pradeep Chhetri).
- AARCH64 Neon memequal wide #53588 (Maksim Kita).
- Experiment Aggregator merge and destroy states in batch #53589 (Maksim Kita).
- Fix test
02102_row_binary_with_names_and_types
#53592 (Alexey Milovidov). - Remove useless test #53599 (Alexey Milovidov).
- Simplify test
01600_parts_types_metrics_long
#53606 (Alexey Milovidov). - 💄 [S3::URI] Fix comment typos around versionId #53607 (Tomáš Hromada).
- Fix upgrade check #53611 (Kseniia Sumarokova).
- Cleanup cluster test: remove unnecessary zookeeper #53617 (Igor Nikonov).
- Bump boost to 1.80 #53625 (Robert Schulze).
- Update version_date.tsv and changelogs after v23.3.9.55-lts #53626 (robot-clickhouse).
- CMake small refactoring #53628 (Maksim Kita).
- Fix data race of shell command #53631 (Amos Bird).
- Fix 02443_detach_attach_partition #53633 (Alexander Tokmakov).
- Add default timeout value for ClickHouseHelper #53639 (Mikhail f. Shiryaev).
- Implement support for more aggregate functions on big-endian #53650 (ltrk2).
- fix Logical Error in AsynchronousBoundedReadBuffer #53651 (Sema Checherinda).
- State of State and avg aggregation function fix for big endian #53655 (Suzy Wang).
- Resubmit #50171 #53678 (alesapin).
- Bump boost to 1.81 #53679 (Robert Schulze).
- Whitespaces #53690 (Alexey Milovidov).
- Remove bad test #53691 (Alexey Milovidov).
- Fix bad path format in logs #53693 (alesapin).
- Correct a functional test to not use endianness-specific input #53697 (ltrk2).
- Fix running clickhouse-test with python 3.8 #53700 (Dmitry Novik).
- refactor some old code #53704 (flynn).
- Fixed wrong python test name pattern #53713 (Alexey Gerasimchuck).
- Fix flaky
shutdown_wait_unfinished_queries
integration test #53714 (Konstantin Bogdanov). - Update version_date.tsv and changelogs after v23.3.10.5-lts #53733 (robot-clickhouse).
- Fix flaky test_storage_s3_queue/test.py::test_delete_after_processing #53736 (Kseniia Sumarokova).
- Fix broken
02862_sorted_distinct_sparse_fix
#53738 (Antonio Andelic). - Do not warn about arch_sys_counter clock #53739 (Artur Malchanau).
- Add some profile events #53741 (Kseniia Sumarokova).
- Support clang-18 (Wmissing-field-initializers) #53751 (Raúl Marín).
- Upgrade openSSL to v3.0.10 #53756 (Bhavna Jindal).
- Improve JSON-handling on s390x #53760 (ltrk2).
- Reduce API calls to SSM client #53762 (Mikhail f. Shiryaev).
- Remove branch references from .gitmodules #53763 (Robert Schulze).
- Fix reading from
url
with all filtered paths #53796 (Antonio Andelic). - Follow-up to #53611 #53799 (Kseniia Sumarokova).
- Fix a bug in attach partition #53811 (Alexander Tokmakov).
- Bump boost to 1.82 #53812 (Robert Schulze).
- Enable producing endianness-independent output in lz4 #53816 (ltrk2).
- Fix typo in cluster name. #53829 (Nikolai Kochetov).
- Get rid of describe_parameters for the best robot token #53833 (Mikhail f. Shiryaev).
- Update 00002_log_and_exception_messages_formatting.sql #53839 (Alexander Tokmakov).
- Fix after #51622 #53840 (Kseniia Sumarokova).
- Fix segfault in
TableNameHints
(withLazy
database) #53849 (Alexander Tokmakov). - Follow-up to #53501 #53851 (Alexander Tokmakov).
- Follow-up to #53528 #53852 (Alexander Tokmakov).
- refactor some code #53856 (flynn).
- Bump boost to 1.83 #53859 (Robert Schulze).
- Remove unused parallel replicas coordinator in query info #53862 (Igor Nikonov).
- Update version_date.tsv and changelogs after v23.7.5.30-stable #53870 (robot-clickhouse).
- Update version_date.tsv and changelogs after v23.6.3.87-stable #53872 (robot-clickhouse).
- Update version_date.tsv and changelogs after v23.3.11.5-lts #53873 (robot-clickhouse).
- Update version_date.tsv and changelogs after v23.5.5.92-stable #53874 (robot-clickhouse).
- Update version_date.tsv and changelogs after v22.8.21.38-lts #53875 (robot-clickhouse).
- Fix: USearch deserialize #53876 (Davit Vardanyan).
- Improve schema inference for archives #53880 (Antonio Andelic).
- Make UInt128TrivialHash endianness-independent #53891 (ltrk2).
- Use iterators instead of std::ranges #53893 (ltrk2).
- Finalize file descriptor in ~WriteBufferToFileSegment #53895 (vdimir).
- Fix: respect skip_unavailable_shards with parallel replicas #53904 (Igor Nikonov).
- Fix flakiness of 00514_interval_operators #53906 (Michael Kolupaev).
- Change IStorage interface by random walk, no goal in particular #54009 (Nikita Mikhaylov).
- Refactor logic around async insert with deduplication #54012 (Antonio Andelic).
- More assertive #54044 (Alexey Milovidov).
- Correct doc for filesystem_prefetch_max_memory_usage #54058 (Raúl Marín).
- Fix after #52943 #54064 (Kseniia Sumarokova).
- Parse IS NOT DISTINCT and <=> operators #54067 (vdimir).
- Replace dlcdn.apache.org by archive domain #54081 (Mikhail f. Shiryaev).
- Increased log waiting timeout in test_profile_max_sessions_for_user #54092 (Alexey Gerasimchuck).
- Update Dockerfile #54118 (Kseniia Sumarokova).
- Small improvements in
getAlterMutationCommandsForPart
#54126 (Anton Popov). - Fix some more analyzer tests #54128 (Nikolai Kochetov).
- Disable
01600_parts_types_metrics_long
for asan #54132 (Antonio Andelic). - Fixing 01086_odbc_roundtrip with analyzer. #54133 (Nikolai Kochetov).
- Add warnings about ingestion script speed and memory usage in Laion dataset instructions #54153 (Michael Kolupaev).
- tests: mark 02152_http_external_tables_memory_tracking as no-parallel #54155 (Azat Khuzhin).
- The external logs have had colliding arguments #54165 (Mikhail f. Shiryaev).
- Rename macro #54169 (Kseniia Sumarokova).