ClickHouse/docs/changelogs/v21.10.2.15-stable.md

sidebar_position	sidebar_label
1	2022

2022 Changelog

ClickHouse release v21.10.2.15-stable FIXME as compared to v21.10.1.8013-prestable

Improvement

• Backported in #29944: Update zoneinfo files to 2021c. #29925 (Alexey Milovidov).

Bug Fix

• Backported in #29776: Allow using a materialized column as the sharding key in a distributed table even if insert_allow_materialized_columns=0:. #28637 (Vitaly Baranov).
• Backported in #28792: Fix transformation of disjunctions chain to IN (controlled by settings optimize_min_equality_disjunction_chain_length) in distributed queries with settings legacy_column_name_of_tuple_literal = 0. #28658 (Anton Popov).
• Backported in #29127: Fix bug in clickhouse-keeper-converter which can lead to incorrect ZooKeeper log deserialization. #29071 (小路).
• Backported in #29970: Fix shutdown of AccessControlManager. Now there can't be reloading of the configuration after AccessControlManager has been destroyed. This PR fixes the flaky test test_user_directories/test.py::test_relative_path. #29951 (Vitaly Baranov).
• Backported in #30051: Fix releasing query ID and session ID at the end of query processing while handing gRPC call. This PR fixes flaky test test_grpc_protocol/test.py::test_session. #29954 (Vitaly Baranov).

Bug Fix (user-visible misbehaviour in official stable release)

• Backported in #29054: Fix invalid constant type conversion when nullable or lowcardinality primary key is used. #28636 (Amos Bird).
• Backported in #28795: - Fix the number of arguments required by s2RectAdd and s2RectContains functions. #28663 (Bharat Nallan).
• Backported in #28794: Add Settings.Names, Settings.Values aliases for system.processes table. #28685 (Vitaly Orlov).
• Backported in #28793: Fix the coredump in the creation of distributed tables, when the parameters passed in are wrong. #28686 (Zhiyong Wang).
• Backported in #28812: Fix possible crash for SELECT with partially created aggregate projection in case of exception. #28700 (Amos Bird).
• Backported in #28790: Fix benign race condition in ReplicatedMergeTreeQueue. Shouldn't be visible for user, but can lead to subtle bugs. #28734 (alesapin).
• Backported in #29150: Fix extremely rare case when ReplicatedMergeTree replicas can diverge after hard reboot of all replicas. The error looks like Part ... intersects (previous|next) part .... #28817 (alesapin).
• Backported in #28843: Fix expressions compilation with short circuit evaluation. #28821 (Azat Khuzhin).
• Backported in #28992: Fixed a race condition between DROP PART and REPLACE/MOVE PARTITION that might cause replicas to diverge in rare cases. #28864 (Alexander Tokmakov).
• Backported in #28950: Fix reading of subcolumns from compact parts. #28873 (Anton Popov).
• Backported in #28926: Fix bug with LowCardinality in short-curcuit function evaluation. Closes #28884. #28887 (Kruglov Pavel).
• Backported in #29162: Fix queries to external databases (i.e. MySQL) with multiple columns in IN ( i.e. (k,v) IN ((1, 2)) ) (but note that this has some backward incompatibility for the clickhouse-copier since it uses alias for tuple element). #28888 (Azat Khuzhin).
• Backported in #29108: Fix waiting for mutation with mutations_sync=2. #28889 (Azat Khuzhin).
• Backported in #28928: Fix higher-order array functions (SIGSEGV for arrayCompact/ILLEGAL_COLUMN for arrayDifference/arrayCumSumNonNegative) with consts. #28904 (Azat Khuzhin).
• Backported in #28951: Fix bad optimizations of ORDER BY if it contains WITH FILL. This closes #28908. This closes #26049. #28910 (Alexey Milovidov).
• Backported in #29023: Fix the number of threads used in GLOBAL IN subquery (it was executed in single threads since #19414 bugfix). #28997 (Nikolai Kochetov).
• Backported in #29814: Do not allow to reuse previous credentials in case of inter-server secret (Before INSERT via Buffer/Kafka to Distributed table with interserver secret configured for that cluster, may re-use previously set user for that connection). #29060 (Azat Khuzhin).
• Backported in #29192: Fix segfault while inserting into column with type LowCardinality(Nullable) in Avro input format. #29132 (Kruglov Pavel).
• Backported in #29400: Send normal Database doesn't exist error (UNKNOWN_DATABASE) to the client (via TCP) instead of Attempt to read after eof (ATTEMPT_TO_READ_AFTER_EOF). #29229 (Azat Khuzhin).
• Backported in #29358: Fix possible Table columns structure in ZooKeeper is different from local table structure exception while recreating or creating new replicas of ReplicatedMergeTree, when one of table columns have default expressions with case-insensitive functions. #29266 (Anton Popov).
• Backported in #29450: Fix failed assertion in ReadBufferFromHDFS. Update libhdfs3 library to be able to run in tests in debug. Closes #29251. Closes #27814. #29276 (Kseniia Sumarokova).
• Backported in #29302: Fix connection timeouts (send_timeout/receive_timeout). #29282 (Azat Khuzhin).
• Backported in #29382: Remove window function nth_value as it is not memory-safe. This closes #29347. #29348 (Alexey Milovidov).
• Backported in #29439: Fix replicated access storage not shutting down cleanly when misconfigured. #29388 (Kevin Michel).
• Backported in #29488: Fix Logical error Cannot capture columns in functions greatest/least. Closes #29334. #29454 (Kruglov Pavel).
• Backported in #29537: Fix possible Block structure mismatch for subqueries with pushed-down HAVING predicate. Fixes #29010. #29475 (Nikolai Kochetov).
• Backported in #29590: In ODBC bridge add retries for error Invalid cursor state. It is a retriable error. Closes #29473. #29518 (Kseniia Sumarokova).
• Backported in #29571: Fix bug in check pathStartsWith becuase there was bug with the usage of std::mismatch: The behavior is undefined if the second range is shorter than the first range.. #29531 (Kseniia Sumarokova).
• Backported in #29725: Fix null deference for GROUP BY WITH TOTALS HAVING (when the column from HAVING wasn't selected). #29553 (Azat Khuzhin).
• Backported in #29629: Fix rare segfault in ALTER MODIFY query when using incorrect table identifier in DEFAULT expression like x.y.z... Fixes #29184. #29573 (alesapin).
• Backported in #29657: Fix JIT expression compilation with aliases and short-circuit expression evaluation. Closes #29403. #29574 (Maksim Kita).
• Backported in #29749: Condition in filter predicate could be lost after push-down optimisation. #29625 (Nikolai Kochetov).
• Backported in #29850: Fix concurrent access to LowCardinality during GROUP BY (leads to SIGSEGV). #29782 (Azat Khuzhin).
• Backported in #29910: Fix bad cast in ATTACH TABLE ... FROM 'path' query when non-string literal is used instead of path. It may lead to reading of uninitialized memory. #29790 (Alexey Milovidov).
• Backported in #29866: Avoid Timeout exceeded: elapsed 18446744073.709553 seconds error that might happen in extremely rare cases, presumably due to some bug in kernel. Fixes #29154. #29811 (Alexander Tokmakov).
• Backported in #30023: MaterializedMySQL: Fix an issue where if the connection to MySQL was lost, only parts of a transaction could be processed. #29837 (Håvard Kvålen).
• Backported in #29876: Fix system tables recreation check (fails to detect changes in enum values). #29857 (Azat Khuzhin).
• Backported in #30058: Fix potential resource leak of the concurrent query limit of merge tree tables introduced in https://github.com/ClickHouse/ClickHouse/pull/19544 . #29879 (Amos Bird).
• Backported in #30208: Fix data-race between LogSink::writeMarks() and LogSource in StorageLog. #29946 (Azat Khuzhin).
• Backported in #30213: Fix possible data-race between FileChecker and StorageLog/StorageStripeLog. #29959 (Azat Khuzhin).
• Backported in #30067: Fix crash of sample by tuple(), closes #30004. #30016 (flynn).
• Backported in #30127: Dropped Memory database might reappear after server restart, it's fixed (#29795). Also added force_remove_data_recursively_on_drop setting as a workaround for Directory not empty error when dropping Ordinary database (because it's not possible to remove data leftovers manually in cloud environment). #30054 (Alexander Tokmakov).
• Backported in #30232: Fix INSERT SELECT incorrectly fills MATERIALIZED column based of Nullable column. #30189 (Azat Khuzhin).
• Backported in #30264: FlatDictionary, HashedDictionary fix bytes_allocated calculation for nullable attributes. #30238 (Maksim Kita).
• Backported in #30307: Fix crash with shortcircuit and lowcardinality in multiIf. #30243 (Raúl Marín).
• Backported in #30291: Fix ComplexKeyHashedDictionary, ComplexKeySparseHashedDictionary parsing preallocate option from layout config. #30246 (Maksim Kita).

NO CL CATEGORY

• Avoid deadlocks when reading and writting on JOIN Engine tables at the same time. #30182 (Raúl Marín).

NOT FOR CHANGELOG / INSIGNIFICANT

• Fix usage of nested columns with non-array columns with the same prefix [2] #28762 (Anton Popov).
• Lower compiled_expression_cache_size to 128MB #28816 (Maksim Kita).
• Column default dictGet identifier fix #28863 (Maksim Kita).
• Don not add const group by key for query with only having. #28975 (Nikolai Kochetov).
• Merging #27963 #29063 (Maksim Kita).
• Fix terminate on uncaught exception #29216 (Alexander Tokmakov).
• Fix arcadia (pre)stable 21.10 build #29250 (DimasKovas).
• May be fix s3 tests #29762 (Kseniia Sumarokova).
• Remove unnecessary PEERDIR to libcxx-filesystem #29798 (Yuriy Chernyshov).
• Update BoringSSL #29998 (Filatenkov Artur).
• SQL user defined functions fix alias #30075 (Maksim Kita).