mirror of
https://github.com/ClickHouse/ClickHouse.git
synced 2024-12-13 09:52:38 +00:00
68 KiB
68 KiB
sidebar_position | sidebar_label |
---|---|
1 | 2024 |
2024 Changelog
ClickHouse release v24.5.1.1763-stable (647c154a94
) FIXME as compared to v24.4.1.2088-stable (6d4b31322d
)
Backward Incompatible Change
- Renamed "inverted indexes" to "full-text indexes" which is a less technical / more user-friendly name. This also changes internal table metadata and breaks tables with existing (experimental) inverted indexes. Please make to drop such indexes before upgrade and re-create them after upgrade. #62884 (Robert Schulze).
- Usage of functions
neighbor
,runningAccumulate
,runningDifferenceStartingWithFirstValue
,runningDifference
deprecated (because it is error-prone). Proper window functions should be used instead. To enable them back, setallow_deprecated_functions=1
. #63132 (Nikita Taranov). - Queries from
system.columns
will work faster if there is a large number of columns, but many databases or tables are not granted forSHOW TABLES
. Note that in previous versions, if you grantSHOW COLUMNS
to individual columns without grantingSHOW TABLES
to the corresponding tables, thesystem.columns
table will show these columns, but in a new version, it will skip the table entirely. Remove trace log messages "Access granted" and "Access denied" that slowed down queries. #63439 (Alexey Milovidov).
New Feature
- Provide support for AzureBlobStorage function in ClickHouse server to use Azure Workload identity to authenticate against Azure blob storage. If
use_workload_identity
parameter is set in config, workload identity is used for authentication. #57881 (Vinay Suryadevara). - Introduce bulk loading to StorageEmbeddedRocksDB by creating and ingesting SST file instead of relying on rocksdb build-in memtable. This help to increase importing speed, especially for long-running insert query to StorageEmbeddedRocksDB tables. Also, introduce
StorageEmbeddedRocksDB
table settings. #59163 (Duc Canh Le). - User can now parse CRLF with TSV format using a setting
input_format_tsv_crlf_end_of_line
. Closes #56257. #59747 (Shaun Struwig). - Adds the Form Format to read/write a single record in the application/x-www-form-urlencoded format. #60199 (Shaun Struwig).
- Added possibility to compress in CROSS JOIN. #60459 (p1rattttt).
- New setting
input_format_force_null_for_omitted_fields
that forces NULL values for omitted fields. #60887 (Constantine Peresypkin). - Support join with inequal conditions which involve columns from both left and right table. e.g.
t1.y < t2.y
. To enable,SET allow_experimental_join_condition = 1
. #60920 (lgbo). - Earlier our s3 storage and s3 table function didn't support selecting from archive files. I created a solution that allows to iterate over files inside archives in S3. #62259 (Daniil Ivanik).
- Support for conditional function
clamp
. #62377 (skyoct). - Add npy output format. #62430 (豪肥肥).
- Added SQL functions
generateUUIDv7
,generateUUIDv7ThreadMonotonic
,generateUUIDv7NonMonotonic
(with different monotonicity/performance trade-offs) to generate version 7 UUIDs aka. timestamp-based UUIDs with random component. Also added a new functionUUIDToNum
to extract bytes from a UUID and a new functionUUIDv7ToDateTime
to extract timestamp component from a UUID version 7. #62852 (Alexey Petrunyaka). - Backported in #64307: Implement Dynamic data type that allows to store values of any type inside it without knowing all of them in advance. Dynamic type is available under a setting
allow_experimental_dynamic_type
. Reference: #54864. #63058 (Kruglov Pavel). - Introduce bulk loading to StorageEmbeddedRocksDB by creating and ingesting SST file instead of relying on rocksdb build-in memtable. This help to increase importing speed, especially for long-running insert query to StorageEmbeddedRocksDB tables. Also, introduce StorageEmbeddedRocksDB table settings. #63324 (Duc Canh Le).
- Raw as a synonym for TSVRaw. #63394 (Unalian).
- Added possibility to do cross join in temporary file if size exceeds limits. #63432 (p1rattttt).
- On Linux and MacOS, if the program has STDOUT redirected to a file with a compression extension, use the corresponding compression method instead of nothing (making it behave similarly to
INTO OUTFILE
). #63662 (v01dXYZ). - Change warning on high number of attached tables to differentiate tables, views and dictionaries. #64180 (Francisco J. Jurado Moreno).
Performance Improvement
- Skip merging of newly created projection blocks during
INSERT
-s. #59405 (Nikita Taranov). - Process string functions XXXUTF8 'asciily' if input strings are all ascii chars. Inspired by https://github.com/apache/doris/pull/29799. Overall speed up by 1.07x~1.62x. Notice that peak memory usage had been decreased in some cases. #61632 (李扬).
- Improved performance of selection (
{}
) globs in StorageS3. #62120 (Andrey Zvonov). - HostResolver has each IP address several times. If remote host has several IPs and by some reason (firewall rules for example) access on some IPs allowed and on others forbidden, than only first record of forbidden IPs marked as failed, and in each try these IPs have a chance to be chosen (and failed again). Even if fix this, every 120 seconds DNS cache dropped, and IPs can be chosen again. #62652 (Anton Ivashkin).
- Add a new configuration
prefer_merge_sort_block_bytes
to control the memory usage and speed up sorting 2 times when merging when there are many columns. #62904 (LiuNeng). clickhouse-local
will start faster. In previous versions, it was not deleting temporary directories by mistake. Now it will. This closes #62941. #63074 (Alexey Milovidov).- Micro-optimizations for the new analyzer. #63429 (Raúl Marín).
- Index analysis will work if
DateTime
is compared toDateTime64
. This closes #63441. #63443 (Alexey Milovidov). - Index analysis will work if
DateTime
is compared toDateTime64
. This closes #63441. #63532 (Raúl Marín). - Speed up indices of type
set
a little (around 1.5 times) by removing garbage. #64098 (Alexey Milovidov).
Improvement
- Maps can now have
Float32
,Float64
,Array(T)
,Map(K,V)
andTuple(T1, T2, ...)
as keys. Closes #54537. #59318 (李扬). - Multiline strings with border preservation and column width change. #59940 (Volodyachan).
- Make rabbitmq nack broken messages. Closes #45350. #60312 (Kseniia Sumarokova).
- Fix a crash in asynchronous stack unwinding (such as when using the sampling query profiler) while interpreting debug info. This closes #60460. #60468 (Alexey Milovidov).
- Distinct messages for s3 error 'no key' for cases disk and storage. #61108 (Sema Checherinda).
- Less contention in filesystem cache (part 4). Allow to keep filesystem cache not filled to the limit by doing additional eviction in the background (controlled by
keep_free_space_size(elements)_ratio
). This allows to release pressure from space reservation for queries (ontryReserve
method). Also this is done in a lock free way as much as possible, e.g. should not block normal cache usage. #61250 (Kseniia Sumarokova). - The progress bar will work for trivial queries with LIMIT from
system.zeros
,system.zeros_mt
(it already works forsystem.numbers
andsystem.numbers_mt
), and thegenerateRandom
table function. As a bonus, if the total number of records is greater than themax_rows_to_read
limit, it will throw an exception earlier. This closes #58183. #61823 (Alexey Milovidov). - YAML Merge Key support. #62685 (Azat Khuzhin).
- Enhance error message when non-deterministic function is used with Replicated source. #62896 (Grégoire Pineau).
- Fix interserver secret for Distributed over Distributed from
remote
. #63013 (Azat Khuzhin). - Allow using
clickhouse-local
and its shortcutsclickhouse
andch
with a query or queries file as a positional argument. Examples:ch "SELECT 1"
,ch --param_test Hello "SELECT {test:String}"
,ch query.sql
. This closes #62361. #63081 (Alexey Milovidov). - Support configuration substitutions from YAML files. #63106 (Eduard Karacharov).
- Add TTL information in system parts_columns table. #63200 (litlig).
- Keep previous data in terminal after picking from skim suggestions. #63261 (FlameFactory).
- Width of fields now correctly calculate, ignoring ANSI escape sequences. #63270 (Shaun Struwig).
- Enable plain_rewritable metadata for local and Azure (azure_blob_storage) object storages. #63365 (Julia Kartseva).
- Support English-style Unicode quotes, e.g. “Hello”, ‘world’. This is questionable in general but helpful when you type your query in a word processor, such as Google Docs. This closes #58634. #63381 (Alexey Milovidov).
- Allowed to create MaterializedMySQL database without connection to MySQL. #63397 (Kirill).
- Remove copying data when writing to filesystem cache. #63401 (Kseniia Sumarokova).
- Update the usage of error code
NUMBER_OF_ARGUMENTS_DOESNT_MATCH
by more accurate error codes when appropriate. #63406 (Yohann Jardin). os_user
andclient_hostname
are now correctly set up for queries for command line suggestions in clickhouse-client. This closes #63430. #63433 (Alexey Milovidov).- Fixed tabulation from line numbering, correct handling of length when moving a line if the value has a tab, added tests. #63493 (Volodyachan).
- Add this
aggregate_function_group_array_has_limit_size
setting to support discarding data in some scenarios. #63516 (zhongyuankai). - Automatically mark a replica of Replicated database as lost and start recovery if some DDL task fails more than
max_retries_before_automatic_recovery
(100 by default) times in a row with the same error. Also, fixed a bug that could cause skipping DDL entries when an exception is thrown during an early stage of entry execution. #63549 (Alexander Tokmakov). - Automatically correct
max_block_size=0
to default value. #63587 (Antonio Andelic). - Account failed files in
s3queue_tracked_file_ttl_sec
ands3queue_traked_files_limit
forStorageS3Queue
. #63638 (Kseniia Sumarokova). - Add a build_id ALIAS column to trace_log to facilitate auto renaming upon detecting binary changes. This is to address #52086. #63656 (Zimu Li).
- Enable truncate operation for object storage disks. #63693 (MikhailBurdukov).
- The loading of the keywords list is now dependent on the server revision and will be disabled for the old versions of ClickHouse server. CC @azat. #63786 (Nikita Mikhaylov).
- Allow trailing commas in the columns list in the INSERT query. For example,
INSERT INTO test (a, b, c, ) VALUES ...
. #63803 (Alexey Milovidov). - Better exception messages for the
Regexp
format. #63804 (Alexey Milovidov). - Allow trailing commas in the
Values
format. For example, this query is allowed:INSERT INTO test (a, b, c) VALUES (4, 5, 6,);
. #63810 (Alexey Milovidov). - Clickhouse disks have to read server setting to obtain actual metadata format version. #63831 (Sema Checherinda).
- Disable pretty format restrictions (
output_format_pretty_max_rows
/output_format_pretty_max_value_width
) when stdout is not TTY. #63942 (Azat Khuzhin). - Exception handling now works when ClickHouse is used inside AWS Lambda. Author: Alexey Coolnev. #64014 (Alexey Milovidov).
- Throw
CANNOT_DECOMPRESS
instread ofCORRUPTED_DATA
on invalid compressed data passed via HTTP. #64036 (vdimir). - A tip for a single large number in Pretty formats now works for Nullable and LowCardinality. This closes #61993. #64084 (Alexey Milovidov).
- Now backups with azure blob storage will use multicopy. #64116 (alesapin).
- Add metrics, logs, and thread names around parts filtering with indices. #64130 (Alexey Milovidov).
- Allow to use native copy for azure even with different containers. #64154 (alesapin).
- Finally enable native copy for azure. #64182 (alesapin).
- Ignore
allow_suspicious_primary_key
onATTACH
and verify onALTER
. #64202 (Azat Khuzhin).
Build/Testing/Packaging Improvement
- ClickHouse is built with clang-18. A lot of new checks from clang-tidy-18 have been enabled. #60469 (Alexey Milovidov).
- Re-enable broken s390x build in CI. #63135 (Harry Lee).
- The Dockerfile is reviewed by the docker official library in https://github.com/docker-library/official-images/pull/15846. #63400 (Mikhail f. Shiryaev).
- Information about every symbol in every translation unit will be collected in the CI database for every build in the CI. This closes #63494. #63495 (Alexey Milovidov).
- Experimentally support loongarch64 as a new platform for ClickHouse. #63733 (qiangxuhui).
- Update Apache Datasketches library. It resolves #63858. #63923 (Alexey Milovidov).
- Enable GRPC support for aarch64 linux while cross-compiling binary. #64072 (alesapin).
Bug Fix (user-visible misbehavior in an official stable release)
- Fix making backup when multiple shards are used. This PR fixes #56566. #57684 (Vitaly Baranov).
- Fix passing projections/indexes from CREATE query into inner table of MV. #59183 (Azat Khuzhin).
- Fix boundRatio incorrect merge. #60532 (Tao Wang).
- Fix crash when using some functions with low-cardinality columns. #61966 (Michael Kolupaev).
- Fix queries with FINAL give wrong result when table does not use adaptive granularity. #62432 (Duc Canh Le).
- Improve the detection of cgroups v2 memory controller in unusual locations. This fixes a warning that the cgroup memory observer was disabled because no cgroups v1 or v2 current memory file could be found. #62903 (Robert Schulze).
- Fix subsequent use of external tables in client. #62964 (Azat Khuzhin).
- Fix crash with untuple and unresolved lambda. #63131 (Raúl Marín).
- Fix bug which could lead to server to accept connections before server is actually loaded. #63181 (alesapin).
- Fix intersect parts when restart after drop range. #63202 (Han Fei).
- Fix a misbehavior when SQL security defaults don't load for old tables during server startup. #63209 (pufit).
- JOIN filter push down filled join fix. Closes #63228. #63234 (Maksim Kita).
- Fix infinite loop while listing objects in Azure blob storage. #63257 (Julia Kartseva).
- CROSS join can be executed with any value
join_algorithm
setting, close #62431. #63273 (vdimir). - Fixed a potential crash caused by a
no space left
error when temporary data in the cache is used. #63346 (vdimir). - Fix bug which could potentially lead to rare LOGICAL_ERROR during SELECT query with message:
Unexpected return type from materialize. Expected type_XXX. Got type_YYY.
Introduced in #59379. #63353 (alesapin). - Fix
X-ClickHouse-Timezone
header returning wrong timezone when usingsession_timezone
as query level setting. #63377 (Andrey Zvonov). - Fix debug assert when using grouping WITH ROLLUP and LowCardinality types. #63398 (Raúl Marín).
- Fix logical errors in queries with
GROUPING SETS
andWHERE
andgroup_by_use_nulls = true
, close #60538. #63405 (vdimir). - Fix backup of projection part in case projection was removed from table metadata, but part still has projection. #63426 (Kseniia Sumarokova).
- Fix 'Every derived table must have its own alias' error for MYSQL dictionary source, close #63341. #63481 (vdimir).
- Insert QueryFinish on AsyncInsertFlush with no data. #63483 (Raúl Marín).
- Fix
system.query_log.used_dictionaries
logging. #63487 (Eduard Karacharov). - Avoid segafult in
MergeTreePrefetchedReadPool
while fetching projection parts. #63513 (Antonio Andelic). - Fix rabbitmq heap-use-after-free found by clang-18, which can happen if an error is thrown from RabbitMQ during initialization of exchange and queues. #63515 (Kseniia Sumarokova).
- Fix crash on exit with sentry enabled (due to openssl destroyed before sentry). #63548 (Azat Khuzhin).
- Fix support for Array and Map with Keyed hashing functions and materialized keys. #63628 (Salvatore Mesoraca).
- Fixed Parquet filter pushdown not working with Analyzer. #63642 (Michael Kolupaev).
- It is forbidden to convert MergeTree to replicated if the zookeeper path for this table already exists. #63670 (Kirill).
- Read only the necessary columns from VIEW (new analyzer). Closes #62594. #63688 (Maksim Kita).
- Fix rare case with missing data in the result of distributed query. #63691 (vdimir).
- Fix #63539. Forbid WINDOW redefinition in new analyzer. #63694 (Dmitry Novik).
- Flatten_nested is broken with replicated database. #63695 (Nikolai Kochetov).
- Fix
SIZES_OF_COLUMNS_DOESNT_MATCH
error for queries witharrayJoin
function inWHERE
. Fixes #63653. #63722 (Nikolai Kochetov). - Fix
Not found column
andCAST AS Map from array requires nested tuple of 2 elements
exceptions for distributed queries which useMap(Nothing, Nothing)
type. Fixes #63637. #63753 (Nikolai Kochetov). - Fix possible
ILLEGAL_COLUMN
error inpartial_merge
join, close #37928. #63755 (vdimir). query_plan_remove_redundant_distinct
can break queries with WINDOW FUNCTIONS (withallow_experimental_analyzer
is on). Fixes #62820. #63776 (Igor Nikonov).- Fix possible crash with SYSTEM UNLOAD PRIMARY KEY. #63778 (Raúl Marín).
- Fix a query with a duplicating cycling alias. Fixes #63320. #63791 (Nikolai Kochetov).
- Fixed performance degradation of parsing data formats in INSERT query. This closes #62918. This partially reverts #42284, which breaks the original design and introduces more problems. #63801 (Alexey Milovidov).
- Add 'endpoint_subpath' S3 URI setting to allow plain_rewritable disks to share the same endpoint. #63806 (Julia Kartseva).
- Fix queries using parallel read buffer (e.g. with max_download_thread > 0) getting stuck when threads cannot be allocated. #63814 (Antonio Andelic).
- Allow JOIN filter push down to both streams if only single equivalent column is used in query. Closes #63799. #63819 (Maksim Kita).
- Remove the data from all disks after DROP with the Lazy database engines. Without these changes, orhpaned will remain on the disks. #63848 (MikhailBurdukov).
- Fix incorrect select query result when parallel replicas were used to read from a Materialized View. #63861 (Nikita Taranov).
- Fixes in
find_super_nodes
andfind_big_family
command of keeper-client: - do not fail on ZNONODE errors - find super nodes inside super nodes - properly calculate subtree node count. #63862 (Alexander Gololobov). - Fix a error
Database name is empty
for remote queries with lambdas over the cluster with modified default database. Fixes #63471. #63864 (Nikolai Kochetov). - Fix SIGSEGV due to CPU/Real (
query_profiler_real_time_period_ns
/query_profiler_cpu_time_period_ns
) profiler (has been an issue since 2022, that leads to periodic server crashes, especially if you were using distributed engine). #63865 (Azat Khuzhin). - Fixed
EXPLAIN CURRENT TRANSACTION
query. #63926 (Anton Popov). - Fix analyzer - IN function with arbitrary deep sub-selects in materialized view to use insertion block. #63930 (Yakov Olkhovskiy).
- Allow
ALTER TABLE .. MODIFY|RESET SETTING
andALTER TABLE .. MODIFY COMMENT
for plain_rewritable disk. #63933 (Julia Kartseva). - Fix Recursive CTE with distributed queries. Closes #63790. #63939 (Maksim Kita).
- Fix resolve of unqualified COLUMNS matcher. Preserve the input columns order and forbid usage of unknown identifiers. #63962 (Dmitry Novik).
- Fix the
Not found column
error for queries withskip_unused_shards = 1
,LIMIT BY
, and the new analyzer. Fixes #63943. #63983 (Nikolai Kochetov). - (Low-quality third-party Kusto Query Language). Resolve Client Abortion Issue When Using KQL Table Function in Interactive Mode. #63992 (Yong Wang).
- Backported in #64356: Fix an
Cyclic aliases
error for cyclic aliases of different type (expression and function). Fixes #63205. #63993 (Nikolai Kochetov). - Deserialize untrusted binary inputs in a safer way. #64024 (Robert Schulze).
- Do not throw
Storage doesn't support FINAL
error for remote queries over non-MergeTree tables withfinal = true
and new analyzer. Fixes #63960. #64037 (Nikolai Kochetov). - Add missing settings to recoverLostReplica. #64040 (Raúl Marín).
- Fix unwind on SIGSEGV on aarch64 (due to small stack for signal). #64058 (Azat Khuzhin).
- Backported in #64324: This fix will use a proper redefined context with the correct definer for each individual view in the query pipeline Closes #63777. #64079 (pufit).
- Backported in #64384: Fix analyzer: "Not found column" error is fixed when using INTERPOLATE. #64096 (Yakov Olkhovskiy).
- Fix azure backup writing multipart blocks as 1mb (read buffer size) instead of max_upload_part_size. #64117 (Kseniia Sumarokova).
- Backported in #64541: Fix creating backups to S3 buckets with different credentials from the disk containing the file. #64153 (Antonio Andelic).
- Prevent LOGICAL_ERROR on CREATE TABLE as MaterializedView. #64174 (Raúl Marín).
- Backported in #64332: The query cache now considers two identical queries against different databases as different. The previous behavior could be used to bypass missing privileges to read from a table. #64199 (Robert Schulze).
- Ignore
text_log
config when using Keeper. #64218 (Antonio Andelic). - Backported in #64692: Fix Query Tree size validation. Closes #63701. #64377 (Dmitry Novik).
- Backported in #64411: Fix
Logical error: Bad cast
forBuffer
table withPREWHERE
. Fixes #64172. #64388 (Nikolai Kochetov). - Backported in #64625: Fix an error
Cannot find column
in distributed queries with constant CTE in theGROUP BY
key. #64519 (Nikolai Kochetov). - Backported in #64682: Fix #64612. Do not rewrite aggregation if
-If
combinator is already used. #64638 (Dmitry Novik).
CI Fix or Improvement (changelog entry is not required)
- Implement cumulative A Sync status. #61464 (Mikhail f. Shiryaev).
- Add ability to run Azure tests in PR with label. #63196 (alesapin).
- Add azure run with msan. #63238 (alesapin).
- Improve cloud backport script. #63282 (Raúl Marín).
- Use
/commit/
to have the URLs in reports like44f8bc5308
and not like44f8bc5308
. #63331 (Mikhail f. Shiryaev). - Extra constraints for stress and fuzzer tests. #63470 (Raúl Marín).
- Fix 02362_part_log_merge_algorithm flaky test. #63635 (Miсhael Stetsyuk).
- Fix test_odbc_interaction from aarch64 #61457. #63787 (alesapin).
- Fix test
test_catboost_evaluate
for aarch64. #61457. #63789 (alesapin). - Remove HDFS from disks config for one integration test for arm. #61457. #63832 (alesapin).
- Bump version for old image in test_short_strings_aggregation to make it work on arm. #61457. #63836 (alesapin).
- Disable test
test_non_default_compression/test.py::test_preconfigured_deflateqpl_codec
on arm. #61457. #63839 (alesapin). - Include checks like
Stateless tests (asan, distributed cache, meta storage in keeper, s3 storage) [2/3]
inMergeable Check
andA Sync
. #63945 (Mikhail f. Shiryaev). - Fix 02124_insert_deduplication_token_multiple_blocks. #63950 (Han Fei).
- Add
ClickHouseVersion.copy
method. Create a branch release in advance without spinning out the release to increase the stability. #64039 (Mikhail f. Shiryaev). - The mime type is not 100% reliable for Python and shell scripts without shebangs; add a check for file extension. #64062 (Mikhail f. Shiryaev).
- Add retries in git submodule update. #64125 (Alexey Milovidov).
Critical Bug Fix (crash, LOGICAL_ERROR, data loss, RBAC)
- Backported in #64591: Disabled
enable_vertical_final
setting by default. This feature should not be used because it has a bug: #64543. #64544 (Alexander Tokmakov).
NO CL ENTRY
- NO CL ENTRY: 'Revert "Do not remove server constants from GROUP BY key for secondary query."'. #63297 (Alexey Milovidov).
- NO CL ENTRY: 'Revert "Introduce bulk loading to StorageEmbeddedRocksDB"'. #63316 (Alexey Milovidov).
- NO CL ENTRY: 'Add tags for the test 03000_traverse_shadow_system_data_paths.sql to make it stable'. #63366 (Aleksei Filatov).
- NO CL ENTRY: 'Revert "Revert "Do not remove server constants from GROUP BY key for secondary query.""'. #63415 (Nikolai Kochetov).
- NO CL ENTRY: 'Revert "Fix index analysis for
DateTime64
"'. #63525 (Raúl Marín). - NO CL ENTRY: 'Add
jwcrypto
to integration tests runner'. #63551 (Konstantin Bogdanov). - NO CL ENTRY: 'Follow-up for the
binary_symbols
table in CI'. #63802 (Alexey Milovidov). - NO CL ENTRY: 'chore(ci-workers): remove reusable from tailscale key'. #63999 (Gabriel Martinez).
- NO CL ENTRY: 'Revert "Update gui.md - Add ch-ui to open-source available tools."'. #64064 (Alexey Milovidov).
- NO CL ENTRY: 'Prevent stack overflow in Fuzzer and Stress test'. #64082 (Alexey Milovidov).
- NO CL ENTRY: 'Revert "Prevent conversion to Replicated if zookeeper path already exists"'. #64214 (Sergei Trifonov).
NOT FOR CHANGELOG / INSIGNIFICANT
- Remove http_max_chunk_size setting (too internal) #60852 (Azat Khuzhin).
- Fix race in refreshable materialized views causing SELECT to fail sometimes #60883 (Michael Kolupaev).
- Parallel replicas: table check failover #61935 (Igor Nikonov).
- Avoid crashing on column type mismatch in a few dozen places #62087 (Michael Kolupaev).
- Fix optimize_if_chain_to_multiif const NULL handling #62104 (Michael Kolupaev).
- Use intrusive lists for
ResourceRequest
instead of deque #62165 (Sergei Trifonov). - Analyzer: Fix validateAggregates for tables with different aliases #62346 (vdimir).
- Improve code and tests of
DROP
of multiple tables #62359 (zhongyuankai). - Fix exception message during writing to partitioned s3/hdfs/azure path with globs #62423 (Kruglov Pavel).
- Support UBSan on Clang-19 (master) #62466 (Alexey Milovidov).
- Save the stacktrace of thread waiting on failing AsyncLoader job #62719 (Sergei Trifonov).
- group_by_use_nulls strikes back #62922 (Nikolai Kochetov).
- Analyzer: prefer column name to alias from array join #62995 (vdimir).
- CI: try separate the workflows file for GitHub's Merge Queue #63123 (Max K.).
- Try to fix coverage tests #63130 (Raúl Marín).
- Fix azure backup flaky test #63158 (SmitaRKulkarni).
- Merging #60920 #63159 (vdimir).
- QueryAnalysisPass improve QUALIFY validation #63162 (Maksim Kita).
- Add numpy tests for different endianness #63189 (Yarik Briukhovetskyi).
- Fallback action-runner to autoupdate when it's unable to start #63195 (Mikhail f. Shiryaev).
- Fix possible endless loop while reading from azure #63197 (Anton Popov).
- Add information about materialized view security bug fix into the changelog #63204 (pufit).
- Disable one query from 02994_sanity_check_settings #63208 (Raúl Marín).
- Enable custom parquet encoder by default, attempt 2 #63210 (Michael Kolupaev).
- Update version after release #63215 (Alexey Milovidov).
- Update version_date.tsv and changelogs after v24.4.1.2088-stable #63217 (robot-clickhouse).
- Update version_date.tsv and changelogs after v24.3.3.102-lts #63226 (robot-clickhouse).
- Update version_date.tsv and changelogs after v24.2.3.70-stable #63227 (robot-clickhouse).
- Return back #61551 (More optimal loading of marks) #63233 (Anton Popov).
- Hide CI options under a spoiler #63237 (Konstantin Bogdanov).
- Add
FROM
keyword toTRUNCATE ALL TABLES
#63241 (Yarik Briukhovetskyi). - Minor follow-up to a renaming PR #63260 (Robert Schulze).
- More checks for concurrently deleted files and dirs in system.remote_data_paths #63274 (Alexander Gololobov).
- Fix SettingsChangesHistory.h for allow_experimental_join_condition #63278 (Raúl Marín).
- Update version_date.tsv and changelogs after v23.8.14.6-lts #63285 (robot-clickhouse).
- Fix azure flaky test #63286 (SmitaRKulkarni).
- Fix deadlock in
CacheDictionaryUpdateQueue
in case of exception in constructor #63287 (Nikita Taranov). - DiskApp: fix 'list --recursive /' and crash on invalid arguments #63296 (Michael Kolupaev).
- Fix terminate because of unhandled exception in
MergeTreeDeduplicationLog::shutdown
#63298 (Nikita Taranov). - Move s3_plain_rewritable unit test to shell #63317 (Julia Kartseva).
- Add tests for #63264 #63321 (Raúl Marín).
- Try fix segfault in
MergeTreeReadPoolBase::createTask
#63323 (Antonio Andelic). - Update README.md #63326 (Tyler Hannan).
- Skip unaccessible table dirs in system.remote_data_paths #63330 (Alexander Gololobov).
- Add test for #56287 #63340 (Raúl Marín).
- Update README.md #63350 (Tyler Hannan).
- Add test for #48049 #63351 (Raúl Marín).
- Add option
query_id_prefix
toclickhouse-benchmark
#63352 (Anton Popov). - Rollback azurite to working version #63354 (alesapin).
- Randomize setting
enable_block_offset_column
in stress tests #63355 (Anton Popov). - Fix AST parsing of invalid type names #63357 (Michael Kolupaev).
- Fix some 00002_log_and_exception_messages_formatting flakiness #63358 (Michael Kolupaev).
- Add a test for #55655 #63380 (Alexey Milovidov).
- Fix data race in
reportBrokenPart
#63396 (Antonio Andelic). - Workaround for
oklch()
inside canvas bug for firefox #63404 (Sergei Trifonov). - Add test for issue #47862 #63424 (Robert Schulze).
- Fix parsing of
CREATE INDEX
query #63425 (Anton Popov). - We are using Shared Catalog in the CI Logs cluster #63442 (Alexey Milovidov).
- Fix collection of coverage data in the CI Logs cluster #63453 (Alexey Milovidov).
- Fix flaky test for rocksdb bulk sink #63457 (Duc Canh Le).
- io_uring: refactor get reader from context #63475 (Tomer Shafir).
- Analyzer setting max_streams_to_max_threads_ratio overflow fix #63478 (Maksim Kita).
- Add setting for better rendering of multiline string for pretty format #63479 (Yarik Briukhovetskyi).
- Fix logical error when reloading config with customly created web disk broken after #56367 #63484 (Kseniia Sumarokova).
- Add test for #49307 #63486 (Anton Popov).
- Remove leftovers of GCC support in cmake rules #63488 (Azat Khuzhin).
- Fix ProfileEventTimeIncrement code #63489 (Azat Khuzhin).
- MergeTreePrefetchedReadPool: Print parent name when logging projection parts #63522 (Raúl Marín).
- Correctly stop
asyncCopy
tasks in all cases #63523 (Antonio Andelic). - Almost everything should work on AArch64 (Part of #58061) #63527 (Alexey Milovidov).
- Update randomization of
old_parts_lifetime
#63530 (Alexander Tokmakov). - Update 02240_system_filesystem_cache_table.sh #63531 (Kseniia Sumarokova).
- Fix data race in
DistributedSink
#63538 (Antonio Andelic). - Fix azure tests run on master #63540 (alesapin).
- Find a proper commit for cumulative
A Sync
status #63543 (Mikhail f. Shiryaev). - Add
no-s3-storage
tag to local_plain_rewritable ut #63546 (Julia Kartseva). - Go back to upstream lz4 submodule #63574 (Raúl Marín).
- Fix logical error in ColumnTuple::tryInsert() #63583 (Michael Kolupaev).
- harmonize sumMap error messages on ILLEGAL_TYPE_OF_ARGUMENT #63619 (Yohann Jardin).
- Update README.md #63631 (Tyler Hannan).
- Ignore global profiler if system.trace_log is not enabled and fix really disable it for keeper standalone build #63632 (Azat Khuzhin).
- Fixes for 00002_log_and_exception_messages_formatting #63634 (Azat Khuzhin).
- Fix tests flakiness due to long SYSTEM FLUSH LOGS (explicitly specify old_parts_lifetime) #63639 (Azat Khuzhin).
- Update clickhouse-test help section #63663 (Ali).
- Fix bad test
02950_part_log_bytes_uncompressed
#63672 (Alexey Milovidov). - Remove leftovers of
optimize_monotonous_functions_in_order_by
#63674 (Nikita Taranov). - tests: attempt to fix 02340_parts_refcnt_mergetree flakiness #63684 (Azat Khuzhin).
- Parallel replicas: simple cleanup #63685 (Igor Nikonov).
- Cancel S3 reads properly when parallel reads are used #63687 (Antonio Andelic).
- Explain map insertion order #63690 (Mark Needham).
- selectRangesToRead() simple cleanup #63692 (Igor Nikonov).
- Fix fuzzed analyzer_join_with_constant query #63702 (Nikolai Kochetov).
- Add missing explicit instantiations of ColumnUnique #63718 (Raúl Marín).
- Better asserts in ColumnString.h #63719 (Raúl Marín).
- Don't randomize some settings in 02941_variant_type_* tests to avoid timeouts #63721 (Kruglov Pavel).
- Fix flaky 03145_non_loaded_projection_backup.sh #63728 (Kseniia Sumarokova).
- Userspace page cache: don't collect stats if cache is unused #63730 (Michael Kolupaev).
- Fix insignificant UBSAN error in QueryAnalyzer::replaceNodesWithPositionalArguments() #63734 (Michael Kolupaev).
- Fix a bug in resolving matcher inside lambda inside ARRAY JOIN #63744 (Nikolai Kochetov).
- Remove unused CaresPTRResolver::cancel_requests method #63754 (Arthur Passos).
- Do not hide disk name #63756 (Kseniia Sumarokova).
- CI: remove Cancel and Debug workflows as redundant #63757 (Max K.).
- Security Policy: Add notification process #63773 (Leticia Webb).
- Fix typo #63774 (Anton Popov).
- Fix fuzzer when only explicit faults are used #63775 (Raúl Marín).
- Settings typo #63782 (Rory Crispin).
- Changed the previous value of
output_format_pretty_preserve_border_for_multiline_string
setting #63783 (Yarik Briukhovetskyi). - fix antlr insertStmt for issue 63657 #63811 (GG Bond).
- Fix race in
ReplicatedMergeTreeLogEntryData
#63816 (Antonio Andelic). - Allow allocation during job destructor in
ThreadPool
#63829 (Antonio Andelic). - io_uring: add basic io_uring clickhouse perf test #63835 (Tomer Shafir).
- fix typo #63838 (Alexander Gololobov).
- Remove unnecessary logging statements in MergeJoinTransform.cpp #63860 (vdimir).
- CI: disable ARM integration test cases with libunwind crash #63867 (Max K.).
- Fix some settings values in 02455_one_row_from_csv_memory_usage test to make it less flaky #63874 (Kruglov Pavel).
- Randomise
allow_experimental_parallel_reading_from_replicas
in stress tests #63899 (Nikita Taranov). - Fix logs test for binary data by converting it to a valid UTF8 string. #63909 (Alexey Katsman).
- More sanity checks for parallel replicas #63910 (Nikita Taranov).
- Insignificant libunwind build fixes #63946 (Azat Khuzhin).
- Revert multiline pretty changes due to performance problems #63947 (Raúl Marín).
- Some usability improvements for c++expr script #63948 (Azat Khuzhin).
- CI: aarch64: disable arm integration tests with kerberaized kafka #63961 (Max K.).
- Slightly better setting
force_optimize_projection_name
#63997 (Anton Popov). - Better script to collect symbols statistics #64013 (Alexey Milovidov).
- Fix a typo in Analyzer #64022 (Alexey Milovidov).
- Fix libbcrypt for FreeBSD build #64023 (Azat Khuzhin).
- Fix searching for libclang_rt.builtins.*.a on FreeBSD #64051 (Azat Khuzhin).
- Fix waiting for mutations with retriable errors #64063 (Alexander Tokmakov).
- harmonize h3PointDist* error messages #64080 (Yohann Jardin).
- This log message is better in Trace #64081 (Alexey Milovidov).
- tests: fix expected error for 03036_reading_s3_archives (fixes CI) #64089 (Azat Khuzhin).
- Fix sanitizers #64090 (Azat Khuzhin).
- Update llvm/clang to 18.1.6 #64091 (Azat Khuzhin).
- CI: mergeable check redesign #64093 (Max K.).
- Move
isAllASCII
from UTFHelper to StringUtils #64108 (Robert Schulze). - Clean up .clang-tidy after transition to Clang 18 #64111 (Robert Schulze).
- Ignore exception when checking for cgroupsv2 #64118 (Robert Schulze).
- Fix UBSan error in negative positional arguments #64127 (Alexey Milovidov).
- Syncing code #64135 (Antonio Andelic).
- Losen build resource limits for unusual architectures #64152 (Alexey Milovidov).
- fix clang tidy #64179 (Han Fei).
- Fix global query profiler #64187 (Azat Khuzhin).
- CI: cancel running PR wf after adding to MQ #64188 (Max K.).
- Add debug logging to EmbeddedRocksDBBulkSink #64203 (vdimir).
- Fix special builds (due to excessive resource usage - memory/CPU) #64204 (Azat Khuzhin).
- Add gh to style-check dockerfile #64227 (Nikita Mikhaylov).
- Followup for #63691 #64285 (vdimir).
- Rename allow_deprecated_functions to allow_deprecated_error_prone_win… #64358 (Raúl Marín).
- Update description for settings
cross_join_min_rows_to_compress
andcross_join_min_bytes_to_compress
#64360 (Nikita Fomichev). - Rename aggregate_function_group_array_has_limit_size #64362 (Raúl Marín).
- Split tests 03039_dynamic_all_merge_algorithms to avoid timeouts #64363 (Kruglov Pavel).
- Clean settings in 02943_variant_read_subcolumns test #64437 (Kruglov Pavel).
- CI: Critical bugfix category in PR template #64480 (Max K.).