ClickHouse/docs/changelogs/v24.3.4.147-lts.md

sidebar_position	sidebar_label
1	2024

2024 Changelog

ClickHouse release v24.3.4.147-lts (31a7bdc346) FIXME as compared to v24.3.3.102-lts (7e7f3bdd9b)

Improvement

• Backported in #63465: Make rabbitmq nack broken messages. Closes #45350. #60312 (Kseniia Sumarokova).
• Backported in #64290: Fix logical-error when undoing quorum insert transaction. #61953 (Han Fei).

Build/Testing/Packaging Improvement

• Backported in #63610: The Dockerfile is reviewed by the docker official library in https://github.com/docker-library/official-images/pull/15846. #63400 (Mikhail f. Shiryaev).
• Backported in #65128: Decrease the unit-test image a few times. #65102 (Mikhail f. Shiryaev).

Bug Fix (user-visible misbehavior in an official stable release)

• Backported in #64277: Fix queries with FINAL give wrong result when table does not use adaptive granularity. #62432 (Duc Canh Le).
• Backported in #63716: Fix excessive memory usage for queries with nested lambdas. Fixes #62036. #62462 (Nikolai Kochetov).
• Backported in #63247: Fix size checks when updating materialized nested columns ( fixes #62731 ). #62773 (Eliot Hautefeuille).
• Backported in #62984: Fix the Unexpected return type error for queries that read from StorageBuffer with PREWHERE when the source table has different types. Fixes #62545. #62916 (Nikolai Kochetov).
• Backported in #63185: Sanity check: Clamp values instead of throwing. #63119 (Raúl Marín).
• Backported in #63293: Fix crash with untuple and unresolved lambda. #63131 (Raúl Marín).
• Backported in #63411: Fix a misbehavior when SQL security defaults don't load for old tables during server startup. #63209 (pufit).
• Backported in #63616: Fix bug which could potentially lead to rare LOGICAL_ERROR during SELECT query with message: Unexpected return type from materialize. Expected type_XXX. Got type_YYY. Introduced in #59379. #63353 (alesapin).
• Backported in #63455: Fix X-ClickHouse-Timezone header returning wrong timezone when using session_timezone as query level setting. #63377 (Andrey Zvonov).
• Backported in #63603: Fix backup of projection part in case projection was removed from table metadata, but part still has projection. #63426 (Kseniia Sumarokova).
• Backported in #63508: Fix 'Every derived table must have its own alias' error for MYSQL dictionary source, close #63341. #63481 (vdimir).
• Backported in #63595: Avoid segafult in MergeTreePrefetchedReadPool while fetching projection parts. #63513 (Antonio Andelic).
• Backported in #63748: Read only the necessary columns from VIEW (new analyzer). Closes #62594. #63688 (Maksim Kita).
• Backported in #63770: Fix #63539. Forbid WINDOW redefinition in new analyzer. #63694 (Dmitry Novik).
• Backported in #64189: Fix Not found column and CAST AS Map from array requires nested tuple of 2 elements exceptions for distributed queries which use Map(Nothing, Nothing) type. Fixes #63637. #63753 (Nikolai Kochetov).
• Backported in #63845: Fix possible ILLEGAL_COLUMN error in partial_merge join, close #37928. #63755 (vdimir).
• Backported in #63906: query_plan_remove_redundant_distinct can break queries with WINDOW FUNCTIONS (with allow_experimental_analyzer is on). Fixes #62820. #63776 (Igor Nikonov).
• Backported in #63989: Fix incorrect select query result when parallel replicas were used to read from a Materialized View. #63861 (Nikita Taranov).
• Backported in #64031: Fix a error Database name is empty for remote queries with lambdas over the cluster with modified default database. Fixes #63471. #63864 (Nikolai Kochetov).
• Backported in #64559: Fix SIGSEGV due to CPU/Real (query_profiler_real_time_period_ns/query_profiler_cpu_time_period_ns) profiler (has been an issue since 2022, that leads to periodic server crashes, especially if you were using distributed engine). #63865 (Azat Khuzhin).
• Backported in #64009: Fix analyzer - IN function with arbitrary deep sub-selects in materialized view to use insertion block. #63930 (Yakov Olkhovskiy).
• Backported in #64236: Fix resolve of unqualified COLUMNS matcher. Preserve the input columns order and forbid usage of unknown identifiers. #63962 (Dmitry Novik).
• Backported in #64106: Deserialize untrusted binary inputs in a safer way. #64024 (Robert Schulze).
• Backported in #64168: Add missing settings to recoverLostReplica. #64040 (Raúl Marín).
• Backported in #64320: This fix will use a proper redefined context with the correct definer for each individual view in the query pipeline Closes #63777. #64079 (pufit).
• Backported in #64380: Fix analyzer: "Not found column" error is fixed when using INTERPOLATE. #64096 (Yakov Olkhovskiy).
• Backported in #64567: Fix creating backups to S3 buckets with different credentials from the disk containing the file. #64153 (Antonio Andelic).
• Backported in #64270: Prevent LOGICAL_ERROR on CREATE TABLE as MaterializedView. #64174 (Raúl Marín).
• Backported in #64339: The query cache now considers two identical queries against different databases as different. The previous behavior could be used to bypass missing privileges to read from a table. #64199 (Robert Schulze).
• Backported in #64259: Ignore text_log config when using Keeper. #64218 (Antonio Andelic).
• Backported in #64688: Fix Query Tree size validation. Closes #63701. #64377 (Dmitry Novik).
• Backported in #64725: Fixed CREATE TABLE AS queries for tables with default expressions. #64455 (Anton Popov).
• Backported in #64621: Fix an error Cannot find column in distributed queries with constant CTE in the GROUP BY key. #64519 (Nikolai Kochetov).
• Backported in #64678: Fix #64612. Do not rewrite aggregation if -If combinator is already used. #64638 (Dmitry Novik).
• Backported in #64831: Fix bug which could lead to non-working TTLs with expressions. Fixes #63700. #64694 (alesapin).
• Backported in #64940: Fix OrderByLimitByDuplicateEliminationVisitor across subqueries. #64766 (Raúl Marín).
• Backported in #64869: Fixed memory possible incorrect memory tracking in several kinds of queries: queries that read any data from S3, queries via http protocol, asynchronous inserts. #64844 (Anton Popov).
• Backported in #64980: Fix the Block structure mismatch error for queries reading with PREWHERE from the materialized view when the materialized view has columns of different types than the source table. Fixes #64611. #64855 (Nikolai Kochetov).
• Backported in #64972: Fix rare crash when table has TTL with subquery + database replicated + parallel replicas + analyzer. It's really rare, but please don't use TTLs with subqueries. #64858 (alesapin).
• Backported in #65070: Fix ALTER MODIFY COMMENT query that was broken for parameterized VIEWs in https://github.com/ClickHouse/ClickHouse/pull/54211. #65031 (Nikolay Degterinsky).
• Backported in #65175: Fix the Unknown expression identifier error for remote queries with INTERPOLATE (alias) (new analyzer). Fixes #64636. #65090 (Nikolai Kochetov).

Critical Bug Fix (crash, LOGICAL_ERROR, data loss, RBAC)

• Backported in #64587: Disabled enable_vertical_final setting by default. This feature should not be used because it has a bug: #64543. #64544 (Alexander Tokmakov).
• Backported in #64878: This PR fixes an error when a user in a specific situation can escalate their privileges on the default database without necessary grants. #64769 (pufit).

NO CL CATEGORY

• Backported in #63304:. #63297 (Alexey Milovidov).
• Backported in #63708:. #63415 (Nikolai Kochetov).

NO CL ENTRY

• NO CL ENTRY: 'Revert "Backport #64363 to 24.3: Split tests 03039_dynamic_all_merge_algorithms to avoid timeouts"'. #64907 (Raúl Marín).

NOT FOR CHANGELOG / INSIGNIFICANT

• Backported in #63751: group_by_use_nulls strikes back. #62922 (Nikolai Kochetov).
• Backported in #63558: Try fix segfault in MergeTreeReadPoolBase::createTask. #63323 (Antonio Andelic).
• Backported in #63336: The commit url has different pattern. #63331 (Mikhail f. Shiryaev).
• Backported in #63374: Add tags for the test 03000_traverse_shadow_system_data_paths.sql to make it stable. #63366 (Aleksei Filatov).
• Backported in #63625: Workaround for oklch() inside canvas bug for firefox. #63404 (Sergei Trifonov).
• Backported in #63569: Add jwcrypto to integration tests runner. #63551 (Konstantin Bogdanov).
• Backported in #63649: Fix 02362_part_log_merge_algorithm flaky test. #63635 (Miсhael Stetsyuk).
• Backported in #63762: Cancel S3 reads properly when parallel reads are used. #63687 (Antonio Andelic).
• Backported in #63741: Userspace page cache: don't collect stats if cache is unused. #63730 (Michael Kolupaev).
• Backported in #63826: Fix test_odbc_interaction for arm64 on linux. #63787 (alesapin).
• Backported in #63895: Fix test_catboost_evaluate for aarch64. #63789 (alesapin).
• Backported in #63887: Fix test_disk_types for aarch64. #63832 (alesapin).
• Backported in #63879: Fix test_short_strings_aggregation for arm. #63836 (alesapin).
• Backported in #63916: Disable test_non_default_compression/test.py::test_preconfigured_deflateqpl_codec on arm. #63839 (alesapin).
• Backported in #63969: fix 02124_insert_deduplication_token_multiple_blocks. #63950 (Han Fei).
• Backported in #64047: Do not create new release in release branch automatically. #64039 (Mikhail f. Shiryaev).
• Backported in #64076: Files without shebang have mime 'text/plain' or 'inode/x-empty'. #64062 (Mikhail f. Shiryaev).
• Backported in #64142: Fix sanitizers. #64090 (Azat Khuzhin).
• Backported in #64159: Add retries in git submodule update. #64125 (Alexey Milovidov).
• Backported in #64473: Split tests 03039_dynamic_all_merge_algorithms to avoid timeouts. #64363 (Kruglov Pavel).
• Backported in #65113: Adjust the version_helper and script to a new release scheme. #64759 (Mikhail f. Shiryaev).
• Backported in #64999: Fix crash with DISTINCT and window functions. #64767 (Igor Nikonov).