ClickHouse/docs/changelogs/v23.7.1.2470-stable.md

sidebar_position	sidebar_label
1	2023

2023 Changelog

ClickHouse release v23.7.1.2470-stable (a70127baec) FIXME as compared to v23.6.1.1524-stable (d1c7e13d08)

Backward Incompatible Change

• Add NAMED COLLECTION access type (aliases USE NAMED COLLECTION, NAMED COLLECTION USAGE). This PR is backward incompatible because this access type is disabled by default (because a parent access type NAMED COLLECTION ADMIN is disabled by default as well). Proposed in #50277. To grant use GRANT NAMED COLLECTION ON collection_name TO user or GRANT NAMED COLLECTION ON * TO user, to be able to give these grants named_collection_admin is required in config (previously it was named named_collection_control, so will remain as an alias). #50625 (Kseniia Sumarokova).
• Fixing a typo in the system.parts column name last_removal_attemp_time. Now it is named last_removal_attempt_time. #52104 (filimonov).
• Bump version of the distributed_ddl_entry_format_version to 5 by default (enables opentelemetry and initial_query_idd pass through). This will not allow to process existing entries for distributed DDL after downgrade (but note, that usually there should be no such unprocessed entries). #52128 (Azat Khuzhin).
• Check projection metadata the same way we check ordinary metadata. This change may prevent the server from starting in case there was a table with an invalid projection. An example is a projection that created positional columns in PK (e.g. projection p (select * order by 1, 4) which is not allowed in table PK and can cause a crash during insert/merge). Drop such projections before the update. Fixes #52353. #52361 (Nikolai Kochetov).
• The experimental feature hashid is removed due to a bug. The quality of implementation was questionable at the start, and it didn't get through the experimental status. This closes #52406. #52449 (Alexey Milovidov).
• The function toDecimalString is removed due to subpar implementation quality. This closes #52407. #52450 (Alexey Milovidov).

New Feature

• Implement KQL-style formatting for Interval. #45671 (ltrk2).
• Support ZooKeeper reconfig command for CH Keeper with incremental reconfiguration which can be enabled via keeper_server.enable_reconfiguration setting. Support adding servers, removing servers, and changing server priorities. #49450 (Mike Kot).
• Kafka connector can fetch avro schema from schema registry with basic authentication using url-encoded credentials. #49664 (Ilya Golshtein).
• Add function arrayJaccardIndex which computes the Jaccard similarity between two arrays. #50076 (FFFFFFFHHHHHHH).
• Added support for prql as a query language. #50686 (János Benjamin Antal).
• Add a column is_obsolete to system.settings and similar tables. Closes #50819. #50826 (flynn).
• Implement support of encrypted elements in configuration file Added possibility to use encrypted text in leaf elements of configuration file. The text is encrypted using encryption codecs from <encryption_codecs> section. #50986 (Roman Vasin).
• Just a new request of #49483. #51013 (lgbo).
• Add SYSTEM STOP LISTEN query. Closes #47972. #51016 (Nikolay Degterinsky).
• Add input_format_csv_allow_variable_number_of_columns options. #51273 (Dmitry Kardymon).
• Another boring feature: add function substring_index, as in spark or mysql. #51472 (李扬).
• Show stats for jemalloc bins. Example ``` SELECT *, size * (nmalloc - ndalloc) AS allocated_bytes FROM system.jemalloc_bins WHERE allocated_bytes > 0 ORDER BY allocated_bytes DESC LIMIT 10. #51674 (Alexander Gololobov).
• Add RowBinaryWithDefaults format with extra byte before each column for using column default value. Closes #50854. #51695 (Kruglov Pavel).
• Added default_temporary_table_engine setting. Same as default_table_engine but for temporary tables. #51292. #51708 (velavokr).
• Added new initcap / initcapUTF8 functions which convert the first letter of each word to upper case and the rest to lower case. #51735 (Dmitry Kardymon).
• Create table now supports PRIMARY KEY syntax in column definition. Columns are added to primary index in the same order columns are defined. #51881 (Ilya Yatsishin).
• Added the possibility to use date and time format specifiers in log and error log file names, either in config files (log and errorlog tags) or command line arguments (--log-file and --errorlog-file). #51945 (Victor Krasnov).
• Added Peak Memory Usage (for query) to client final statistics, and to http header. #51946 (Dmitry Kardymon).
• Added new hasSubsequence() (+CaseInsensitive + UTF8 versions) functions. #52050 (Dmitry Kardymon).
• Add array_agg as alias of groupArray for PostgreSQL compatibility. Closes #52100. ### Documentation entry for user-facing changes. #52135 (flynn).
• Add any_value as a compatibility alias for any aggregate function. Closes #52140. #52147 (flynn).
• Add aggregate function array_concat_agg for compatibility with BigQuery, it's alias of groupArrayArray. Closes #52139. #52149 (flynn).
• Add OCTET_LENGTH as an alias to length. Closes #52153. #52176 (FFFFFFFHHHHHHH).
• Re-add SipHash keyed functions. #52206 (Salvatore Mesoraca).
• Added firstLine function to extract the first line from the multi-line string. This closes #51172. #52209 (Mikhail Koviazin).

Performance Improvement

• Enable move_all_conditions_to_prewhere and enable_multiple_prewhere_read_steps settings by default. #46365 (Alexander Gololobov).
• Improves performance of some queries by tuning allocator. #46416 (Azat Khuzhin).
• Writing parquet files is 10x faster, it's multi-threaded now. Almost the same speed as reading. #49367 (Michael Kolupaev).
• Enable automatic selection of the sparse serialization format by default. It improves performance. The format is supported since version 22.1. After this change, downgrading to versions older than 22.1 might not be possible. You can turn off the usage of the sparse serialization format by providing the ratio_of_defaults_for_sparse_serialization = 1 setting for your MergeTree tables. #49631 (Alexey Milovidov).
• Now we use fixed-size tasks in MergeTreePrefetchedReadPool as in MergeTreeReadPool. Also from now we use connection pool for S3 requests. #49732 (Nikita Taranov).
• More pushdown to the right side of join. #50532 (Nikita Taranov).
• Improve grace_hash join by reserving hash table's size (resubmit). #50875 (lgbo).
• Waiting on lock in OpenedFileCache could be noticeable sometimes. We sharded it into multiple sub-maps (each with its own lock) to avoid contention. #51341 (Nikita Taranov).
• Remove duplicate condition in functionunixtimestamp64.h. #51857 (lcjh).
• The idea is that conditions with PK columns are likely to be used in PK analysis and will not contribute much more to PREWHERE filtering. #51958 (Alexander Gololobov).
• 1. Add rewriter for both old and new analyzer. 2. Add settings optimize_uniq_to_count which default is 0. #52004 (JackyWoo).
• The performance experiments of OnTime on the ICX device (Intel Xeon Platinum 8380 CPU, 80 cores, 160 threads) show that this change could bring an improvement of 11.6% to the QPS of the query Q8 while having no impact on others. #52036 (Zhiguo Zhou).
• Enable allow_vertical_merges_from_compact_to_wide_parts by default. It will save memory usage during merges. #52295 (Alexey Milovidov).
• Fix incorrect projection analysis which invalidates primary keys. This issue only exists when query_plan_optimize_primary_key = 1, query_plan_optimize_projection = 1 . This fixes #48823 . This fixes #51173 . #52308 (Amos Bird).
• Reduce the number of syscalls in FileCache::loadMetadata. #52435 (Raúl Marín).

Improvement

• Added query SYSTEM FLUSH ASYNC INSERT QUEUE which flushes all pending asynchronous inserts to the destination tables. Added a server-side setting async_insert_queue_flush_on_shutdown (true by default) which determines whether to flush queue of asynchronous inserts on graceful shutdown. Setting async_insert_threads is now a server-side setting. #49160 (Anton Popov).
• Don't show messages about 16 EiB free space in logs, as they don't make sense. This closes #49320. #49342 (Alexey Milovidov).
• Properly check the limit for the sleepEachRow function. Add a setting function_sleep_max_microseconds_per_block. This is needed for generic query fuzzer. #49343 (Alexey Milovidov).
• Fix two issues: ``` select geohashEncode(120.2, number::Float64) from numbers(10);. #50066 (李扬).
• Add support for external disks in Keeper for storing snapshots and logs. #50098 (Antonio Andelic).
• Add support for multi-directory selection ({}) globs. #50559 (Andrey Zvonov).
• Allow to have strict lower boundary for file segment size by downloading remaining data in the background. Minimum size of file segment (if actual file size is bigger) is configured as cache configuration setting boundary_alignment, by default 4Mi. Number of background threads are configured as cache configuration setting background_download_threads, by default 2. Also max_file_segment_size was increased from 8Mi to 32Mi in this PR. #51000 (Kseniia Sumarokova).
• Allow filtering HTTP headers with http_forbid_headers section in config. Both exact matching and regexp filters are available. #51038 (Nikolay Degterinsky).
• #50727 new alias for function current_database and added new function current_schemas. #51076 (Pedro Riera).
• Log async insert flush queries into to system.query_log. #51160 (Raúl Marín).
• Decreased default timeouts for S3 from 30 seconds to 3 seconds, and for other HTTP from 180 seconds to 30 seconds. #51171 (Michael Kolupaev).
• Use read_bytes/total_bytes_to_read for progress bar in s3/file/url/... table functions for better progress indication. #51286 (Kruglov Pavel).
• Functions "date_diff() and age()" now support millisecond/microsecond unit and work with microsecond precision. #51291 (Dmitry Kardymon).
• Allow SQL standard FETCH without OFFSET. See https://antonz.org/sql-fetch/. #51293 (Alexey Milovidov).
• Improve parsing of path in clickhouse-keeper-client. #51359 (Azat Khuzhin).
• A third-party product depending on ClickHouse (Gluten: Plugin to Double SparkSQL's Performance) had a bug. This fix avoids heap overflow in that third-party product while reading from HDFS. #51386 (李扬).
• Fix checking error caused by uninitialized class members. #51418 (李扬).
• Add ability to disable native copy for S3 (setting for BACKUP/RESTORE allow_s3_native_copy, and s3_allow_native_copy for s3/s3_plain disks). #51448 (Azat Khuzhin).
• Add column primary_key_size to system.parts table to show compressed primary key size on disk. Closes #51400. #51496 (Yarik Briukhovetskyi).
• Allow running clickhouse-local without procfs, without home directory existing, and without name resolution plugins from glibc. #51518 (Alexey Milovidov).
• Correcting the message of modify storage policy https://github.com/clickhouse/clickhouse/issues/51516 ### documentation entry for user-facing changes. #51519 (xiaolei565).
• Support DROP FILESYSTEM CACHE <cache_name> KEY <key> [ OFFSET <offset>]. #51547 (Kseniia Sumarokova).
• Allow to add disk name for custom disks. Previously custom disks would use an internal generated disk name. Now it will be possible with disk = disk_<name>(...) (e.g. disk will have name name) . #51552 (Kseniia Sumarokova).
• Add placeholder %a for rull filename in rename_files_after_processing setting. #51603 (Kruglov Pavel).
• Add column modification time into system.parts_columns. #51685 (Azat Khuzhin).
• Add new setting input_format_csv_use_default_on_bad_values to CSV format that allows to insert default value when parsing of a single field failed. #51716 (KevinyhZou).
• Added a crash log flush to the disk after the unexpected crash. #51720 (Alexey Gerasimchuck).
• Fix behavior in dashboard page where errors unrelated to authentication are not shown. Also fix 'overlapping' chart behavior. #51744 (Zach Naimon).
• Allow UUID to UInt128 conversion. #51765 (Dmitry Kardymon).
• Added support for function range of Nullable arguments. #51767 (Dmitry Kardymon).
• Convert condition like toyear(x) = c to c1 <= x < c2. #51795 (Han Fei).
• Improve MySQL compatibility of statement SHOW INDEX. #51796 (Robert Schulze).
• Fix use_structure_from_insertion_table_in_table_functions does not work with MATERIALIZED and ALIAS columns. Closes #51817. Closes #51019. #51825 (flynn).
• Introduce a table setting wait_for_unique_parts_send_before_shutdown_ms which specify the amount of time replica will wait before closing interserver handler for replicated sends. Also fix inconsistency with shutdown of tables and interserver handlers: now server shutdown tables first and only after it shut down interserver handlers. #51851 (alesapin).
• CacheDictionary request only unique keys from source. Closes #51762. #51853 (Maksim Kita).
• Fixed settings not applied for explain query when format provided. #51859 (Nikita Taranov).
• Allow SETTINGS before FORMAT in DESCRIBE TABLE query for compatibility with SELECT query. Closes #51544. #51899 (Nikolay Degterinsky).
• Var-int encoded integers (e.g. used by the native protocol) can now use the full 64-bit range. 3rd party clients are advised to update their var-int code accordingly. #51905 (Robert Schulze).
• Update certificates when they change without the need to manually SYSTEM RELOAD CONFIG. #52030 (Mike Kot).
• Added allow_create_index_without_type setting that allow to ignore ADD INDEX queries without specified TYPE. Standard SQL queries will just succeed without changing table schema. #52056 (Ilya Yatsishin).
• Fixed crash when mysqlxx::Pool::Entry is used after it was disconnected. #52063 (Val Doroshchuk).
• CREATE TABLE ... AS SELECT .. is now supported in MaterializedMySQL. #52067 (Val Doroshchuk).
• Introduced automatic conversion of text types to utf8 for MaterializedMySQL. #52084 (Val Doroshchuk).
• Add alias for functions today (now available under the curdate/current_date names) and now (current_timestamp). #52106 (Lloyd-Pottiger).
• Log messages are written to text_log from the beginning. #52113 (Dmitry Kardymon).
• In cases where the HTTP endpoint has multiple IP addresses and the first of them is unreachable, a timeout exception will be thrown. Made session creation with handling all resolved endpoints. #52116 (Aleksei Filatov).
• Support async_deduplication_token for async insert. #52136 (Han Fei).
• Avro input format support Union with single type. Closes #52131. #52137 (flynn).
• Add setting optimize_use_implicit_projections to disable implicit projections (currently only min_max_count projection). This is defaulted to false until #52075 is fixed. #52152 (Amos Bird).
• It was possible to use the function hasToken for infinite loop. Now this possibility is removed. This closes #52156. #52160 (Alexey Milovidov).
• 1. Upgrade Intel QPL from v1.1.0 to v1.2.0 2. Upgrade Intel accel-config from v3.5 to v4.0 3. Fixed issue that Device IOTLB miss has big perf. impact for IAA accelerators. #52180 (jasperzhu).
• Functions "date_diff() and age()" now support millisecond/microsecond unit and work with microsecond precision. #52181 (Dmitry Kardymon).
• Create ZK ancestors optimistically. #52195 (Raúl Marín).
• Fix #50582. Avoid the Not found column ... in block error in some cases of reading in-order and constants. #52259 (Chen768959).
• Check whether S2 geo primitives are invalid as early as possible on ClickHouse side. This closes: #27090. #52260 (Nikita Mikhaylov).
• Now unquoted utf-8 strings are supported in DDL for MaterializedMySQL. #52318 (Val Doroshchuk).
• Add back missing projection QueryAccessInfo when query_plan_optimize_projection = 1. This fixes #50183 . This fixes #50093 . #52327 (Amos Bird).
• Add new setting disable_url_encoding that allows to disable decoding/encoding path in uri in URL engine. #52337 (Kruglov Pavel).
• When ZooKeeperRetriesControl rethrows an error, it's more useful to see its original stack trace, not the one from ZooKeeperRetriesControl itself. #52347 (Vitaly Baranov).
• Now double quoted comments are supported in MaterializedMySQL. #52355 (Val Doroshchuk).
• Wait for zero copy replication lock even if some disks don't support it. #52376 (Raúl Marín).
• Now it's possible to specify min (memory_profiler_sample_min_allocation_size) and max (memory_profiler_sample_max_allocation_size) size for allocations to be tracked with sampling memory profiler. #52419 (alesapin).
• The session_timezone setting is demoted to experimental. #52445 (Alexey Milovidov).
• Now interserver port will be closed only after tables are shut down. #52498 (alesapin).
• Added field refcount to system.remote_data_paths table. #52518 (Anton Popov).
• New setting merge_tree_determine_task_size_by_prewhere_columns added. If set to true only sizes of the columns from PREWHERE section will be considered to determine reading task size. Otherwise all the columns from query are considered. #52606 (Nikita Taranov).

Build/Testing/Packaging Improvement

• Add experimental ClickHouse builds for Linux RISC-V 64 to CI. #31398 (Alexey Milovidov).
• Fixed CRC32(WeakHash32) issue for s390x. #50365 (Harry Lee).
• Add integration test check with the enabled analyzer. #50926 (Dmitry Novik).
• Update cargo dependencies. #51721 (Raúl Marín).
• Fixed several issues found by OSS-Fuzz. #51736 (Nikita Mikhaylov).
• There were a couple of failures because of (?) S3 availability. The sccache has a feature of failing over to local compilation. #51893 (Mikhail f. Shiryaev).
• 02242_delete_user_race and 02243_drop_user_grant_race tests have been corrected. #51923 (Alexey Gerasimchuck).
• Make the function CHColumnToArrowColumn::fillArrowArrayWithArrayColumnData to work with nullable arrays, which are not possible in ClickHouse, but needed for Gluten. #52112 (李扬).
• We've updated the CCTZ library to master, but there are no user-visible changes. #52124 (Alexey Milovidov).
• The system.licenses table now includes the hard-forked library Poco. This closes #52066. #52127 (Alexey Milovidov).
• Follow up #50926. Add integration tests check with enabled analyzer to master. #52210 (Dmitry Novik).
• Reproducible builds for Rust. #52395 (Azat Khuzhin).
• Improve the startup time of clickhouse-client and clickhouse-local in debug and sanitizer builds. This closes #52228. #52489 (Alexey Milovidov).
• Check that there are no cases of bad punctuation: whitespace before a comma like Hello ,world instead of Hello, world. #52549 (Alexey Milovidov).

Bug Fix (user-visible misbehavior in an official stable release)

• Fix materialised pg syncTables #49698 (Kseniia Sumarokova).
• Fix projection with optimize_aggregators_of_group_by_keys #49709 (Amos Bird).
• Fix optimize_skip_unused_shards with JOINs #51037 (Azat Khuzhin).
• Fix formatDateTime() with fractional negative datetime64 #51290 (Dmitry Kardymon).
• Functions hasToken* were totally wrong. Add a test for #43358 #51378 (Alexey Milovidov).
• Fix optimization to move functions before sorting. #51481 (Nikolai Kochetov).
• Fix Block structure mismatch in Pipe::unitePipes for FINAL #51492 (Nikita Taranov).
• Fix SIGSEGV for clusters with zero weight across all shards (fixes INSERT INTO FUNCTION clusterAllReplicas()) #51545 (Azat Khuzhin).
• Fix timeout for hedged requests #51582 (Azat Khuzhin).
• Fix logical error in ANTI join with NULL #51601 (vdimir).
• Fix for moving 'IN' conditions to PREWHERE #51610 (Alexander Gololobov).
• Do not apply PredicateExpressionsOptimizer for ASOF/ANTI join #51633 (vdimir).
• Fix async insert with deduplication for ReplicatedMergeTree using merging algorithms #51676 (Antonio Andelic).
• Fix reading from empty column in parseSipHashKey #51804 (Nikita Taranov).
• Fix segfault when create invalid EmbeddedRocksdb table #51847 (Duc Canh Le).
• Fix inserts into MongoDB tables #51876 (Nikolay Degterinsky).
• Fix deadlock on DatabaseCatalog shutdown #51908 (Alexander Tokmakov).
• Fix error in subquery operators #51922 (Alexey Milovidov).
• Fix async connect to hosts with multiple ips #51934 (Kruglov Pavel).
• Do not remove inputs after ActionsDAG::merge #51947 (Nikolai Kochetov).
• Check refcount in RemoveManyObjectStorageOperation::finalize instead of execute #51954 (vdimir).
• Allow parametric UDFs #51964 (Alexey Milovidov).
• Small fix for toDateTime64() for dates after 2283-12-31 #52130 (Andrey Zvonov).
• Fix ORDER BY tuple of WINDOW functions #52145 (Alexey Milovidov).
• Fix incorrect projection analysis when aggregation expression contains monotonic functions #52151 (Amos Bird).
• Fix error in groupArrayMoving functions #52161 (Alexey Milovidov).
• Disable direct join for range dictionary #52187 (Duc Canh Le).
• Fix sticky mutations test (and extremely rare race condition) #52197 (alesapin).
• Fix race in Web disk #52211 (Kseniia Sumarokova).
• Fix data race in Connection::setAsyncCallback on unknown packet from server #52219 (Kruglov Pavel).
• Fix temp data deletion on startup, add test #52275 (vdimir).
• Don't use minmax_count projections when counting nullable columns #52297 (Amos Bird).
• MergeTree/ReplicatedMergeTree should use server timezone for log entries #52325 (Azat Khuzhin).
• Fix parameterized view with cte and multiple usage #52328 (SmitaRKulkarni).
• Disable expression templates for time intervals #52335 (Alexander Tokmakov).
• Fix apply_snapshot in Keeper #52358 (Antonio Andelic).
• Update build-osx.md #52377 (AlexBykovski).
• Fix countSubstrings() hang with empty needle and a column haystack #52409 (Sergei Trifonov).
• Fix normal projection with merge table #52432 (Amos Bird).
• Fix possible double-free in Aggregator #52439 (Nikita Taranov).
• Fixed inserting into Buffer engine #52440 (Vasily Nemkov).
• The implementation of AnyHash was non-conformant. #52448 (Alexey Milovidov).
• Check recursion depth in OptimizedRegularExpression #52451 (Alexey Milovidov).
• Fix data-race DatabaseReplicated::startupTables()/canExecuteReplicatedMetadataAlter() #52490 (Azat Khuzhin).
• Fix abort in function transform #52513 (Alexey Milovidov).
• Fix lightweight delete after drop of projection #52517 (Anton Popov).
• Fix possible error "Cannot drain connections: cancel first" #52585 (Kruglov Pavel).

NO CL ENTRY

• NO CL ENTRY: 'Revert "Add documentation for building in docker"'. #51773 (Alexey Milovidov).
• NO CL ENTRY: 'Revert "Fix build"'. #51911 (Alexey Milovidov).
• NO CL ENTRY: 'Revert "Millisecond and microsecond support in date_diff / age functions"'. #52129 (Alexey Milovidov).
• NO CL ENTRY: 'Revert "Re-add SipHash keyed functions"'. #52466 (Alexey Milovidov).
• NO CL ENTRY: 'Revert "Add an ability to specify allocations size for sampling memory profiler"'. #52496 (Alexey Milovidov).
• NO CL ENTRY: 'Revert "Rewrite uniq to count"'. #52576 (Yarik Briukhovetskyi).

NOT FOR CHANGELOG / INSIGNIFICANT

• Remove duplicate_order_by_and_distinct optimization #47135 (Igor Nikonov).
• Update sort desc in ReadFromMergeTree after applying PREWHERE info #48669 (Igor Nikonov).
• Fix BindException: Address already in use in HDFS integration tests #49428 (Nikita Taranov).
• Force libunwind usage (removes gcc_eh support) #49438 (Azat Khuzhin).
• Cleanup storage_conf.xml #49557 (Kseniia Sumarokova).
• Fix flaky tests caused by OPTIMIZE FINAL failing memory budget check #49764 (Michael Kolupaev).
• Remove unstable queries from performance/join_set_filter #50235 (vdimir).
• More accurate DNS resolve for the keeper connection #50738 (pufit).
• Try to fix some trash in Disks and part moves #51135 (Alexander Tokmakov).
• Add jemalloc support fro s390x #51186 (Boris Kuschel).
• Resubmit #48821 #51208 (Kseniia Sumarokova).
• test for #36894 #51274 (Denny Crane).
• external_aggregation_fix for big endian machines #51280 (Sanjam Panda).
• Fix: Invalid number of rows in Chunk column Object #51296 (Igor Nikonov).
• Add a test for #44816 #51305 (Alexey Milovidov).
• Add a test for calculate_text_stack_trace setting #51311 (Alexey Milovidov).
• decrease log level, make logs shorter #51320 (Sema Checherinda).
• Collect stack traces from job's scheduling and print along with exception's stack trace. #51349 (Yakov Olkhovskiy).
• Add a test for #42691 #51352 (Alexey Milovidov).
• Add a test for #32474 #51354 (Alexey Milovidov).
• Add a test for #41727 #51355 (Alexey Milovidov).
• Add a test for #35801 #51356 (Alexey Milovidov).
• Add a test for #34626 #51357 (Alexey Milovidov).
• Initialize text_log earlier to capture table startup messages #51360 (Azat Khuzhin).
• Use separate default settings for clickhouse-local #51363 (Azat Khuzhin).
• Attempt to remove wrong code (catch/throw in Functions) #51367 (Alexey Milovidov).
• Remove suspicious code #51383 (Alexey Milovidov).
• Disable hedged requests under TSan #51392 (Alexey Milovidov).
• no finalize in d-tor WriteBufferFromOStream #51404 (Sema Checherinda).
• Better diagnostics for 01193_metadata_loading #51414 (Alexander Tokmakov).
• Fix attaching gdb in stress tests #51445 (Kruglov Pavel).
• Merging #36384 #51458 (Alexey Milovidov).
• Fix possible race on shutdown wait #51497 (Sergei Trifonov).
• Fix test_alter_moving_garbage: lock between getActiveContainingPart and swapActivePart in parts mover #51498 (vdimir).
• Fix a logical error on mutation #51502 (Alexander Tokmakov).
• Fix running integration tests with spaces in it's names #51514 (Azat Khuzhin).
• Fix flaky test 00417_kill_query #51522 (Nikolay Degterinsky).
• fs cache: add some checks #51536 (Kseniia Sumarokova).
• Don't run 02782_uniq_exact_parallel_merging_bug in parallel with other tests #51549 (Nikita Taranov).
• 00900_orc_load: lift kill timeout #51559 (Robert Schulze).
• Add retries to 00416_pocopatch_progress_in_http_headers #51575 (Nikolay Degterinsky).
• Remove the usage of Analyzer setting in the client #51578 (Alexey Milovidov).
• Fix merge_selecting_task scheduling #51591 (Alexander Tokmakov).
• Add hex functions for cityhash #51595 (Vitaly Baranov).
• Remove unset CLICKHOUSE_LOG_COMMENT from tests #51623 (Nikita Taranov).
• Implement endianness-independent serialization #51637 (ltrk2).
• Ignore APPEND and TRUNCATE modifiers if file does not exist. #51640 (alekar).
• Try to fix flaky 02210_processors_profile_log #51641 (Igor Nikonov).
• Make common macros extendable #51646 (Amos Bird).
• Correct an exception message in src/Functions/nested.cpp #51651 (Alex Cheng).
• tests: fix 02050_client_profile_events flakiness #51653 (Azat Khuzhin).
• Minor follow-up to re2 update to 2023-06-02 (#50949) #51655 (Robert Schulze).
• Fix 02116_tuple_element with Analyzer #51669 (Robert Schulze).
• Update timeouts in tests for transactions #51683 (Alexander Tokmakov).
• Remove unused code #51684 (Sergei Trifonov).
• Remove mmap/mremap/munmap from Allocator.h #51686 (alesapin).
• SonarCloud: Add C++23 Experimental Flag #51687 (Julio Jimenez).
• Wait with retries when attaching GDB in tests #51688 (Antonio Andelic).
• Update version_date.tsv and changelogs after v23.6.1.1524-stable #51691 (robot-clickhouse).
• fix write to finalized buffer #51696 (Sema Checherinda).
• do not log exception aborted for pending mutate/merge entries when shutdown #51697 (Sema Checherinda).
• Fix race in ContextAccess #51704 (Vitaly Baranov).
• Make test scripts backwards compatible #51707 (Antonio Andelic).
• test for full join and null predicate #51709 (Denny Crane).
• A cmake warning on job limits underutilizing CPU #51710 (velavokr).
• Fix SQLLogic docker images #51719 (Antonio Andelic).
• Added ASK_PASSWORD client constant instead of hardcoded '\n' #51723 (Alexey Gerasimchuck).
• Update README.md #51726 (Tyler Hannan).
• Fix source image for sqllogic #51728 (Mikhail f. Shiryaev).
• Remove MemoryPool from Poco because it's useless #51732 (alesapin).
• Fix: logical error in grace hash join #51737 (Igor Nikonov).
• Update 01320_create_sync_race_condition_zookeeper.sh #51742 (Alexander Tokmakov).
• Pin for docker-ce #51743 (Mikhail f. Shiryaev).
• Revert "Fix: Invalid number of rows in Chunk column Object" #51750 (Alexander Tokmakov).
• Add SonarCloud to README #51751 (Robert Schulze).
• Fix test 02789_object_type_invalid_num_of_rows #51754 (Alexey Milovidov).
• Fix (benign) data race in transform #51755 (Alexey Milovidov).
• Fix flaky KeeperMap test #51764 (Antonio Andelic).
• Version mypy=1.4.1 falsly reports unused ignore comment #51769 (Mikhail f. Shiryaev).
• Avoid keeping lock Context::getLock() while calculating access rights #51772 (Vitaly Baranov).
• Making stateless tests with timeout less flaky #51774 (Antonio Andelic).
• Fix after #51000 #51790 (Kseniia Sumarokova).
• Add assert in ThreadStatus destructor for correct current_thread #51800 (Kruglov Pavel).
• Fix broken parts handling in ReplicatedMergeTree #51801 (Alexander Tokmakov).
• Fix tsan signal-unsafe call #51802 (Yakov Olkhovskiy).
• Fix for parallel replicas not completely disabled by granule count threshold #51805 (Alexander Gololobov).
• Make sure that we don't attempt to serialize/deserialize block with 0 columns and non-zero rows #51807 (Alexander Gololobov).
• Fix rare bug in DROP COLUMN and enabled sparse columns #51809 (Anton Popov).
• Fix flaky test_multiple_disks #51821 (Antonio Andelic).
• Follow up to #51547 #51822 (Kseniia Sumarokova).
• Correctly grep archives in stress tests #51824 (Antonio Andelic).
• Update analyzer_tech_debt.txt #51836 (Alexander Tokmakov).
• remove unused code #51837 (flynn).
• Fix disk config for upgrade tests #51839 (Antonio Andelic).
• Remove Coverity from workflows, but leave in the code #51842 (Alexey Milovidov).
• Many fixes [3] #51848 (Ilya Yatsishin).
• Change misleading name in joins: addJoinedBlock -> addBlockToJoin #51852 (Igor Nikonov).
• fix: correct exception messages on policies comparison #51854 (Feng Kaiyu).
• Update 02439_merge_selecting_partitions.sql #51862 (Alexander Tokmakov).
• Remove useless packages #51863 (Alexey Milovidov).
• Remove useless logs #51865 (Alexey Milovidov).
• Fix incorrect log level = warning #51867 (Alexey Milovidov).
• Fix test_replicated_table_attach #51868 (Alexey Milovidov).
• Better usability of a test #51869 (Alexey Milovidov).
• Remove useless code #51873 (Alexey Milovidov).
• Another fix upgrade check script #51878 (Antonio Andelic).
• Sqlloogic improvements #51883 (Ilya Yatsishin).
• Disable ThinLTO on non-Linux #51897 (Robert Schulze).
• Pin rust nightly (to make it stable) #51903 (Azat Khuzhin).
• Fix build #51909 (Alexey Milovidov).
• Fix build #51910 (Alexey Milovidov).
• Fix flaky test 00175_partition_by_ignore and move it to correct location #51913 (Alexey Milovidov).
• Fix flaky test 02360_send_logs_level_colors: avoid usage of file tool #51914 (Alexey Milovidov).
• Maybe better tests #51916 (Alexey Milovidov).
• Revert system drop filesystem cache by key #51917 (Alexey Milovidov).
• Fix flaky test detach_attach_partition_race #51920 (Alexey Milovidov).
• Another fix for 02481_async_insert_race_long #51925 (Antonio Andelic).
• Fix segfault caused by ThreadStatus #51931 (Antonio Andelic).
• Print short fault info only from safe fields #51932 (Alexander Gololobov).
• Fix typo in integration tests #51944 (Ilya Yatsishin).
• Better logs on shutdown #51951 (Alexander Tokmakov).
• Filter databases list before querying potentially slow fields #51955 (Alexander Gololobov).
• Fix some issues with transactions #51959 (Alexander Tokmakov).
• Fix unrelated messages from LSan in clickhouse-client #51966 (Alexey Milovidov).
• Allow OOM in AST Fuzzer with Sanitizers #51967 (Alexey Milovidov).
• Disable one test under Analyzer #51968 (Alexey Milovidov).
• Fix Docker #51969 (Alexey Milovidov).
• Fix test 01825_type_json_from_map #51970 (Alexey Milovidov).
• Fix test 02354_distributed_with_external_aggregation_memory_usage #51971 (Alexey Milovidov).
• Fix disaster in integration tests, part 2 #51973 (Alexey Milovidov).
• [RFC] Cleanup remote_servers in dist config.xml #51985 (Azat Khuzhin).
• Update version_date.tsv and changelogs after v23.6.2.18-stable #51986 (robot-clickhouse).
• Update version_date.tsv and changelogs after v22.8.20.11-lts #51987 (robot-clickhouse).
• Fix performance test for regexp cache #51988 (Alexey Milovidov).
• Move a test to the right place #51989 (Alexey Milovidov).
• Add a check to validate that the stateful tests are stateful #51990 (Alexey Milovidov).
• Check that functional tests cleanup their tables #51991 (Alexey Milovidov).
• Fix test_extreme_deduplication #51992 (Alexey Milovidov).
• Cleanup SymbolIndex after reload got removed #51993 (Azat Khuzhin).
• Update CompletedPipelineExecutor exception log name #52028 (xiao).
• Fix 00502_custom_partitioning_replicated_zookeeper_long #52032 (Antonio Andelic).
• Prohibit send_metadata for s3_plain disks #52038 (Azat Khuzhin).
• Update version_date.tsv and changelogs after v23.4.6.25-stable #52061 (robot-clickhouse).
• Preparations for Trivial Support For Resharding (part1) #52068 (Azat Khuzhin).
• Update version_date.tsv and changelogs after v23.3.8.21-lts #52077 (robot-clickhouse).
• Fix flakiness of test_keeper_s3_snapshot flakiness #52083 (Azat Khuzhin).
• Fix test_extreme_deduplication flakiness #52085 (Azat Khuzhin).
• Small docs update for toYearWeek() function #52090 (Andrey Zvonov).
• Small docs update for DateTime, DateTime64 #52094 (Andrey Zvonov).
• Add missing --force for docker network prune (otherwise it is noop on CI) #52095 (Azat Khuzhin).
• tests: drop existing view in test_materialized_mysql_database #52103 (Azat Khuzhin).
• Update README.md #52115 (Tyler Hannan).
• Print Zxid in keeper stat command in hex (so as ZooKeeper) #52122 (Azat Khuzhin).
• Skip protection from double decompression if inode from maps cannot be obtained #52138 (Azat Khuzhin).
• There is no point in detecting flaky tests #52142 (Alexey Milovidov).
• Remove default argument value #52143 (Alexey Milovidov).
• Fix the "kill_mutation" test #52144 (Alexey Milovidov).
• Fix ORDER BY tuple of WINDOW functions (and slightly more changes) #52146 (Alexey Milovidov).
• Fix possible EADDRINUSE ("Address already in use") in integration tests #52148 (Azat Khuzhin).
• Fix test 02497_storage_file_reader_selection #52154 (Alexey Milovidov).
• Fix unexpected AST Set #52158 (Alexey Milovidov).
• Fix crash in comparison functions due to incorrect query analysis #52172 (Alexey Milovidov).
• Fix slow test 02317_distinct_in_order_optimization #52173 (Alexey Milovidov).
• Add comments for https://github.com/ClickHouse/ClickHouse/pull/52112 #52175 (李扬).
• Randomize timezone in tests across non-deterministic around 1970 and default #52184 (Azat Khuzhin).
• Fix test_multiple_disks/test.py::test_start_stop_moves #52189 (Antonio Andelic).
• CMake: Simplify job limiting #52196 (Robert Schulze).
• Fix self extracting binaries under qemu linux-user (qemu-$ARCH-static) #52198 (Azat Khuzhin).
• Fix Integration tests flaky check (asan) #52201 (Antonio Andelic).
• Fix flaky test test_lost_part #52202 (alesapin).
• MaterializedMySQL: Replace to_string by magic_enum::enum_name #52204 (Val Doroshchuk).
• MaterializedMySQL: Add tests to parse db and table names from DDL #52208 (Val Doroshchuk).
• Revert "Fixed several issues found by OSS-Fuzz" #52216 (Nikita Mikhaylov).
• Use one copy replication more agressively #52218 (alesapin).
• Fix flaky test 01076_parallel_alter_replicated_zookeeper #52221 (alesapin).
• Fix 01889_key_condition_function_chains for analyzer. #52223 (Nikolai Kochetov).
• Inhibit settings randomization in the test json_ghdata #52226 (Alexey Milovidov).
• Slightly better diagnostics in a test #52227 (Alexey Milovidov).
• Enable no-upgrade-check for 02273_full_sort_join #52235 (vdimir).
• Fix network manager for integration tests #52237 (Azat Khuzhin).
• List replication queue only for current test database #52238 (Alexander Gololobov).
• Attempt to fix assert in tsan with fibers #52241 (Kruglov Pavel).
• Fix undefined behaviour in fuzzer #52256 (Antonio Andelic).
• Follow-up to #51959 #52261 (Alexander Tokmakov).
• More fair queue for drop table sync #52276 (Alexander Tokmakov).
• Fix 02497_trace_events_stress_long #52279 (Antonio Andelic).
• Fix test 01111_create_drop_replicated_db_stress #52283 (Alexey Milovidov).
• Fix ugly code #52284 (Alexey Milovidov).
• Add missing replica syncs in test_backup_restore_on_cluster #52306 (Michael Kolupaev).
• Fix test_replicated_database 'node doesn't exist' flakiness #52307 (Michael Kolupaev).
• Minor: Update description of events "QueryCacheHits/Misses" #52309 (Robert Schulze).
• Beautify pretty-printing of the query string in SYSTEM.QUERY_CACHE #52312 (Robert Schulze).
• Reduce dependencies for skim by avoid using default features #52316 (Azat Khuzhin).
• Fix 02725_memory-for-merges #52317 (alesapin).
• Skip unsupported disks in Keeper #52321 (Antonio Andelic).
• Revert "Improve CSVInputFormat to check and set default value to column if deserialize failed" #52322 (Kruglov Pavel).
• Resubmit #51716 #52323 (Kruglov Pavel).
• Add logging about all found workflows for merge_pr.py #52324 (Mikhail f. Shiryaev).
• Minor: Less awkward IAST::FormatSettings #52332 (Robert Schulze).
• Mark test 02125_many_mutations_2 as no-parallel to avoid flakiness #52338 (Kruglov Pavel).
• Fix capabilities installed via systemd service (fixes netlink/IO priorities) #52357 (Azat Khuzhin).
• Update 01606_git_import.sh #52360 (Alexander Tokmakov).
• Update ci-slack-bot.py #52372 (Alexander Tokmakov).
• Fix test_keeper_session #52373 (Antonio Andelic).
• Update ci-slack-bot.py #52374 (Alexander Tokmakov).
• Disable analyzer setting in backward_compatibility integration tests. #52375 (Nikolai Kochetov).
• New metric - Filesystem cache size limit #52378 (Krzysztof Góralski).
• Fix test_replicated_merge_tree_encrypted_disk #52379 (Nikita Mikhaylov).
• Fix 02122_parallel_formatting_XML #52380 (Nikita Mikhaylov).
• Follow up to #49698 #52381 (Kseniia Sumarokova).
• Less replication errors #52382 (Alexander Tokmakov).
• Rename TaskStatsInfoGetter into NetlinkMetricsProvider #52392 (Azat Khuzhin).
• Fix test_keeper_force_recovery #52408 (Antonio Andelic).
• Fix flaky gtest_lru_file_cache.cpp #52418 (Kseniia Sumarokova).
• Fix: remove redundant distinct with views #52438 (Igor Nikonov).
• Add 02815_range_dict_no_direct_join to analyzer_tech_debt.txt #52464 (vdimir).
• do not throw exception in OptimizedRegularExpressionImpl::analyze #52467 (Han Fei).
• Remove skip_startup_tables from IDatabase::loadStoredObjects() #52491 (Azat Khuzhin).
• Fix test_insert_same_partition_and_merge by increasing wait time #52497 (SmitaRKulkarni).
• Try to fix asan wanring in HashJoin #52499 (Igor Nikonov).
• Replace with three way comparison #52509 (flynn).
• Fix flakiness of test_version_update_after_mutation by enabling force_remove_data_recursively_on_drop #52514 (Azat Khuzhin).
• Fix test_throttling #52515 (Antonio Andelic).
• Improve logging macros #52519 (Alexander Tokmakov).
• Fix toDecimalString function #52520 (Andrey Zvonov).
• Remove unused code #52527 (Raúl Marín).
• Cancel execution in PipelineExecutor in case of exception in graph->updateNode #52533 (Kruglov Pavel).
• Make 01951_distributed_push_down_limit analyzer agnostic #52534 (Igor Nikonov).
• Fix disallow_concurrency test for backup and restore #52536 (SmitaRKulkarni).
• Update 02136_scalar_subquery_metrics.sql #52537 (Alexander Tokmakov).
• tests: fix 01035_avg_weighted_long flakiness #52556 (Azat Khuzhin).
• tests: increase throttling for 01923_network_receive_time_metric_insert #52557 (Azat Khuzhin).
• tests: fix 00719_parallel_ddl_table flakiness in debug builds #52558 (Azat Khuzhin).
• tests: fix 01821_join_table_race_long flakiness #52559 (Azat Khuzhin).
• Fix flaky 00995_exception_while_insert #52568 (Antonio Andelic).
• MaterializedMySQL: Fix typos in tests #52575 (Val Doroshchuk).
• Fix 02497_trace_events_stress_long again #52587 (Antonio Andelic).
• Revert "Remove mmap/mremap/munmap from Allocator.h" #52589 (Nikita Taranov).
• Remove peak memory usage from the final message in the client #52598 (Alexey Milovidov).
• GinIndexStore: fix a bug when files are finalizated after first write, #52602 (Sema Checherinda).
• Fix deadlocks in StorageTableFunctionProxy #52626 (Alexander Tokmakov).
• Fix build with clang-15 #52627 (Alexander Tokmakov).
• Fix style #52647 (Antonio Andelic).
• Fix logging level of a noisy message #52648 (Alexander Tokmakov).
• Revert "Added field refcount to system.remote_data_paths table" #52657 (Alexander Tokmakov).