mirror of
https://github.com/ClickHouse/ClickHouse.git
synced 2024-11-30 03:22:14 +00:00
82 KiB
82 KiB
sidebar_position | sidebar_label |
---|---|
1 | 2022 |
2022 Changelog
ClickHouse release v22.1.1.2542-prestable FIXME as compared to v21.12.1.9017-prestable
Backward Incompatible Change
- Change ZooKeeper path for zero-copy marks for shared data. Fix for remove marks in ZooKeeper for renamed parts. #32061 (ianton-ru).
-
- Account for scalar subqueries. With this change, rows read in scalar subqueries are now reported in the query_log. If the scalar subquery is cached (repeated or called for several rows) the rows read are only counted once. This change allows KILLing queries and reporting progress while they are executing scalar subqueries. #32271 (Raúl Marín).
- Add
left
,right
,leftUTF8
,rightUTF8
functions. Fix error in implementation ofsubstringUTF8
function with negative offset (offset from the end of string). The functionsleft
andright
were previously implemented in parser. Upgrade notes: distributed queries withleft
orright
functions without aliases may throw exception if cluster contains different versions of clickhouse-server. If you are upgrading your cluster and encounter this error, you should finish upgrading your cluster to ensure all nodes have the same version. Also you can add aliases (AS something
) to the columns in your queries to avoid this issue. #33407 (Alexey Milovidov).
New Feature
- Implemented sparse serialization. It can reduce usage of disk space and improve performance of some queries for columns, which contain a lot of default (zero) values. It can be enabled by setting
ratio_of_defaults_for_sparse_serialization
. Sparse serialization will be chosen dynamically for column, if it has ratio of number of default values to number of all values above that threshold. Serialization (default or sparse) will be fixed for every column in part, but may varies between parts. #22535 (Anton Popov). - add grouping sets function, like GROUP BY grouping sets (a, b, (a, b)). #26869 (taylor12805).
- Added an ability to read from all replicas within a shard during distributed query. To enable this, set
allow_experimental_parallel_reading_from_replicas=true
andmax_parallel_replicas
to any number. This closes #26748. #29279 (Nikita Mikhaylov). - Start and stop servers when hosts and ports configuration changes. #30549 (Kevin Michel).
- Create any kind of view with comment. ... #31062 (Vasily Nemkov).
- Implement hive table engine to access apache hive from clickhouse. Related RFC: #29245. #31104 (李扬).
-
- Automatic cluster discovery via Zoo/Keeper. #31442 (Vladimir C).
- Adding support for disks backed by Azure Blob Storage, in a similar way it has been done for disks backed by AWS S3. Current implementation allows for all the basic disk operations. #31505 (Jakub Kuklis).
-
- Add "TABLE OVERRIDE" feature for customizing MaterializedMySQL table schemas. #32325 (Stig Bakken).
- Implement data schema inference for input formats. Allow to skip structure (or write just
auto
) in table functionsfile
,url
,s3
,hdfs
and in parameters ofclickhouse-local
. Allow to skip structure in create query for table enginesFile
,HDFS
,S3
,URL
,Merge
,Buffer
,Distributed
andReplicatedMergeTree
(if we add new replicas). #32455 (Kruglov Pavel). - Support TABLE OVERRIDE clause for MaterializedPostgreSQL. RFC: #31480. #32749 (Kseniia Sumarokova).
- Add
EXPLAIN TABLE OVERRIDE
query. #32836 (Stig Bakken). - If an invalid setting is defined using the
SET
query or using the query parameters in the HTTP request, error message will contain suggestions that are similar to the invalid setting string (if any exists). #32946 (Antonio Andelic). - Add aggregate functions
cramersV
,cramersVBiasCorrected
,theilsU
andcontingency
. These functions calculate dependency (measure of association) between categorial values. All these functions are using cross-tab (histogram on pairs) for implementation. You can imagine it like a correlation coefficient but for any discrete values (not necessary numbers). #33366 (Alexey Milovidov). - Added function
arrayLast
. Closes #33390. #33415 (Maksim Kita). - Add MONTHNAME function. #33436 (usurai).
- Auto detect file extension. Close #30918. #33443 (zhongyuankai).
- Added function
arrayLastIndex
. #33465 (Maksim Kita). - Add new h3 miscellaneous functions:
h3DegsToRads
,h3RadsToDegs
,h3HexAreaKm2
,h3CellAreaM2
,h3CellAreaRads2
. #33479 (Bharat Nallan). - Detect format by file extension in file/hdfs/s3/url table functions and HDFS/S3/URL table engines. #33565 (Kruglov Pavel).
Performance Improvement
- Non significant change. In extremely rare cases when data part is lost on every replica, after merging of some data parts, the subsequent queries may skip less amount of partitions during partition pruning. This hardly affects anything. #32220 (Azat Khuzhin).
- Slight performance improvement of
reinterpret
function. #32587 (Alexey Milovidov). - Reduce allocated memory for dictionaries with string attributes. #33466 (Maksim Kita).
- Avoid exponential backtracking in parser. This closes #20158. #33481 (Alexey Milovidov).
Improvement
- Now date time conversion functions that generates time before 1970-01-01 00:00:00 will be saturated to zero instead of overflow. #29953 (Amos Bird).
- Added settings
command_read_timeout
,command_write_timeout
forStorageExecutable
,StorageExecutablePool
,ExecutableDictionary
,ExecutablePoolDictionary
,ExecutableUserDefinedFunctions
. Settingcommand_read_timeout
controls timeout for reading data from command stdout in milliseconds. Settingcommand_write_timeout
timeout for writing data to command stdin in milliseconds. Added settingscommand_termination_timeout
forExecutableUserDefinedFunction
,ExecutableDictionary
,StorageExecutable
. Added settingexecute_direct
forExecutableUserDefinedFunction
, by default true. Added settingexecute_direct
forExecutableDictionary
,ExecutablePoolDictionary
, by default false. #30957 (Maksim Kita). - Optimize single part projection materialization. This closes #31669. #31885 (Amos Bird).
- Enable comparison between
Decimal
andFloat
. Closes #22626. #31966 (flynn). -
- Ignore parse failure of opentelemetry's
traceparent
header. #32116 (Frank Chen).
- Ignore parse failure of opentelemetry's
- Improve keeper writing performance by optimization the size calculation logic. #32366 (zhanglistar).
- Allows to connect to mongodb 5.0. Closes #31483,. #32416 (Kseniia Sumarokova).
- Disable some optimizations for window functions. Closes #31535. Closes #31620. #32453 (Kseniia Sumarokova).
- Allow empty credentials for mongo engine. Closes #26267. #32460 (Kseniia Sumarokova).
- Improve handling nested structures with missing columns while reading protobuf. Follow-up to https://github.com/ClickHouse/ClickHouse/pull/31988. #32531 (Vitaly Baranov).
- Events clause support for window view watch query. #32607 (vxider).
- Add settings
max_concurrent_select_queries
andmax_concurrent_insert_queries
for control concurrent queries by query kind. Close #3575. #32609 (SuperDJY). - support Date32 for
genarateRandom
engine. #32643 (nauta). - Support authSource option for storage MongoDB. Closes #32594. #32702 (Kseniia Sumarokova).
- Allow to control connection timeouts for mysql (previously was supported only for dictionary source). Closes #16669. Previously default connect_timeout was rather small, now it is configurable. #32734 (Kseniia Sumarokova).
- Flush all In-Memory data parts when WAL is not enabled while shutdown server or detaching table. #32742 (nauta).
- Improve gRPC compression support for #28671. #32747 (Vitaly Baranov).
- Added support for specifying subquery as SQL user defined function. Example:
CREATE FUNCTION test AS () -> (SELECT 1)
. Closes #30755. #32758 (Maksim Kita). - Support hints for clickhouse-client and clickhouse-local. Closes #32237,. #32841 (凌涛).
-
- Do not prepend THREADS_COUNT with -j to avoid additional prepending in subprocesses. #32844 (Ernest Zaslavsky).
- Added support for
BIT
data type inMaterializedMySQL
. Closes #15182, #32233. #32900 (zzsmdfj). - More efficient handling of globs for url storage. Closes #32866. #32907 (Kseniia Sumarokova).
- This only happens in unofficial builds. Fixed segfault when inserting data into compressed Decimal, String, FixedString and Array columns. This closes #32939. #32940 (N. Kolotov).
- Dictionaries added
Date32
date type support. Closes #32913. #32971 (Maksim Kita). - Short circuit evaluation function
throwIf
support. Closes #32969. #32973 (Maksim Kita). - Improve Bool type serialization and deserialization. #32984 (Kruglov Pavel).
- Send profile info in clickhouse-local. Closes #33093. #33097 (Kseniia Sumarokova).
- Inject git information into clickhouse binary file. So we can get source code revision easily from clickhouse binary file. #33124 (李扬).
- Validate config keys for external dictionaries. #33095#issuecomment-1000577517. #33130 (Kseniia Sumarokova).
- Add retry for Postgres connect in case nothing has been fetched yet. Closes #33199. #33209 (Kseniia Sumarokova).
- Correctly prevent nullable primary keys if necessary. This is for #32780. #33218 (Amos Bird).
- If storage supports SETTINGS allow to pass them as key value or via config. Add this support for mysql. #33231 (Kseniia Sumarokova).
- Allow to cancel formats Arrow / Parquet / ORC which failed to be cancelled it case of big files and setting input_format_allow_seeks as false. Closes #29678. #33238 (Kseniia Sumarokova).
- Always display resource usage (total CPU usage, total RAM usage and max RAM usage per host) in client. #33271 (Alexey Milovidov).
- parseDateTimeBestEffort support Unix Timestamp with Milliseconds. #33276 (Ben).
- Support moving conditions to
PREWHERE
(settingoptimize_move_to_prewhere
) for tables ofMerge
engine if its all underlying tables supportsPREWHERE
. #33300 (Anton Popov). - Pressing Ctrl+C twice will terminate
clickhouse-benchmark
immediately without waiting for in-flight queries. This closes #32586. #33303 (Alexey Milovidov). - support
<secure/>
in cluster configuration. Close #33270. #33330 (SuperDJY). LineAsString
can be used as output format. This closes #30919. #33331 (Sergei Trifonov).- Allow negative intervals in function
intervalLengthSum
. Their length will be added as well. This closes #33323. #33335 (Alexey Milovidov). - clickhouse-local: track memory under --max_memory_usage_in_client option. #33341 (Azat Khuzhin).
- Make installation script working on FreeBSD. This closes #33384. #33418 (Alexey Milovidov).
- Add some building options in system.build_options. #33431 (李扬).
- Abuse of
untuple
function was leading to exponential complexity of query analysis (found by fuzzer). This closes #33297. #33445 (Alexey Milovidov). - Add config to enable ipv4 or ipv6. This close #33381. #33450 (Wu Xueyang).
- add function decodeURLFormComponent. Close #10298. #33451 (SuperDJY).
- Implement Materialized view
getVirtuals
function. Close #11210. #33482 (zhongyuankai).
Bug Fix
- Quota limit was not reached, but the limit was exceeded. This PR fixes #31174. #31656 (sunny).
- Fix null pointer dereference in low cardinality data when deserializing LowCardinality data in the Native format. #33021 (Harry Lee).
- Specifically crafted input data for
Native
format may lead to reading uninitialized memory or crash. This is relevant ifclickhouse-server
is open for write access to adversary. #33050 (Heena Bansal).
Build/Testing/Packaging Improvement
-
- Add arm64 packages - Stream python logs in realtime with
PYTHONUNBUFFERED=1
- Fix building docker images in docker/packager/packager script. #32415 (Mikhail f. Shiryaev).
- Add arm64 packages - Stream python logs in realtime with
- Terminate build when linker path not found. #32437 (JackyWoo).
-
- Create a global ENV per job - Clean CCACHE after a build is over. #32478 (Mikhail f. Shiryaev).
- PENDING (Should mention submodule updates and versions). #32484 (Raúl Marín).
- Remove readline support. #32574 (Azat Khuzhin).
- Fix build issue related to azure blob storage. #32788 (Amos Bird).
-
- Unify init scripts for every worker runner type - Install pigz in AMI. #32800 (Mikhail f. Shiryaev).
- Use all available in container processors for PVS studio check and fast tests. Delete coverage image. #32854 (Mikhail f. Shiryaev).
-
- Rename main to pull_request - Add BuilderDebAarch64 to all workflows - Use docker buildkit, save building cache to docker hub and reuse it - Build x86_64 and arm64 docker images separately, then merge them together to a multi-architecture manifest - Tune many docker images to being multi-architecture - Use the images from the current PR/commit in the following dependent builds - Upgrade mysql client in stateless-tests image - Add functional tests for aarch64 for PR actions (forced green for a while) - Add python typing to some scripts - Add docker buildkit to runners' init script - Add func-tester-aarch64 runners - Use
docker login --password-stdin
to not expose password on exception. #32911 (Mikhail f. Shiryaev).
- Rename main to pull_request - Add BuilderDebAarch64 to all workflows - Use docker buildkit, save building cache to docker hub and reuse it - Build x86_64 and arm64 docker images separately, then merge them together to a multi-architecture manifest - Tune many docker images to being multi-architecture - Use the images from the current PR/commit in the following dependent builds - Upgrade mysql client in stateless-tests image - Add functional tests for aarch64 for PR actions (forced green for a while) - Add python typing to some scripts - Add docker buildkit to runners' init script - Add func-tester-aarch64 runners - Use
- Enable hermetic build for shared builds. This is mainly for developers. #32968 (Amos Bird).
- Prepare ClickHouse to be built with musl-libc. It is not enabled by default. #33134 (Alexey Milovidov).
- Add a simple tool to visualize flaky tests in web browser. #33185 (Alexey Milovidov).
- Avoid strict checking when
ENABLE_AZURE_BLOB_STORAGE = 0
. https://github.com/ClickHouse/ClickHouse/pull/32948#discussion_r773168611 cc @nikitamikhaylov. #33219 (Amos Bird). - Add more tests for the nullable primary key feature. Add more tests with different types and merge tree kinds, plus randomly generated data. #33228 (Amos Bird).
- Don't use particular encoding for diff-strings, it may contain multiple different encodings. #33336 (Mikhail f. Shiryaev).
- Avoid strict checking when ENABLE_AZURE_BLOB_STORAGE = 0. This is another try on behalf of https://github.com/ClickHouse/ClickHouse/pull/33219 , which was reverted likely due to CI issues. #33346 (Amos Bird).
- During migration from Yandex to github actions we've lost static links to the latest master (doc) It solves issue #33480 partially. #33559 (Mikhail f. Shiryaev).
- Restore a lost description checking. #33591 (Mikhail f. Shiryaev).
- Add
actionlint
for workflows and verify workflow files viaact --list
to check the correct workflow syntax. #33612 (Mikhail f. Shiryaev). - Remove editing /etc/hosts from Dockerfile. #33635 (Mikhail f. Shiryaev).
- Properly separate thrift-cmake from arrow-cmake after https://github.com/ClickHouse/ClickHouse/pull/31104 . cc @taiyang-li. #33661 (Amos Bird).
Bug Fix (user-visible misbehaviour in official stable release)
- Fixed CAST from String to IPv4 or IPv6 and back. Fixed error message in case of failed conversion. #29224 (Dmitry Novik).
- Fix base64Encode adding trailing bytes on small strings. #31797 (Kevin Michel).
- Fix unexpected projection removal when detaching parts. #32067 (Amos Bird).
- Fix 'APPLY lambda' parsing which could lead to client/server crash. #32138 (Kruglov Pavel).
- Some replication queue entries might hang for
temporary_directories_lifetime
(1 day by default) withDirectory tmp_merge_<part_name>
orPart ... (state Deleting) already exists, but it will be deleted soon
or similar error. It's fixed. Fixes #29616. #32201 (Alexander Tokmakov). - Fix unix timestamp Millisecond convert to DateTime64, fractional part calc reversed. #32240 (Ben).
- Fix broken select query when there are more than 2 row policies on same column, begin at second queries on the same session. #31606. #32291 (SuperDJY).
- Fix failures in queries that are trying to use skipping indices, which are not materialized yet. Fixes #32292 and #30343. #32359 (Anton Popov).
- Fix issue with ambiguous query formatting in distributed queries that led to errors when some table columns were named ALL or DISTINCT. This closes #32391. #32490 (Alexey Milovidov).
- The Proper handle of the case with apache arrow column duplication. #32507 (Dmitriy Mokhnatkin).
- Fix crash in
JoinCommon::removeColumnNullability
, close #32458. #32508 (Vladimir C). - fix groupBitmapAnd function on distributed table. #32529 (minhthucdao).
- Fix async inserts with formats CustomSeparated, Template, Regexp, MsgPack and JSONAsString. Previousely async inserts with these formats didn't read any data. #32530 (Kruglov Pavel).
- Fix sparse_hashed dict performance with sequential keys (wrong hash function). #32536 (Azat Khuzhin).
- Fix table lifetime (i.e. possible use-after-free) in case of parallel DROP TABLE and INSERT. #32572 (Azat Khuzhin).
- Fix possible exception at RabbitMQ storage startup by delaying channel creation. #32584 (Kseniia Sumarokova).
- Fix surprisingly bad code in function
file
. #32640 (Alexey Milovidov). - close #32504. #32649 (Vladimir C).
- Fix LOGICAL_ERROR when the target of a materialized view is a JOIN or a SET table. #32669 (Raúl Marín).
- Fix
optimize_read_in_order
optimization in case when table engine isDistributed
orMerge
and its underlyingMergeTree
tables have monotonous function in prefix of sorting key. #32670 (Anton Popov). - Fix
ALTER TABLE ... MATERIALIZE TTL
query withTTL ... DELETE WHERE ...
andTTL ... GROUP BY ...
modes. #32695 (Anton Popov). - Fix error
Column is not under aggregate function
in case of MV withGROUP BY (list of columns)
(which is pared asGROUP BY tuple(...)
) over Kafka/RabbitMQ. Fixes #32668 and #32744. #32751 (Nikolai Kochetov). - fix crash when used fuzzBits with multiply same FixedString, Close #32737. #32755 (SuperDJY).
- Fix
--database
option for clickhouse-local. #32797 (Kseniia Sumarokova). - Server might fail to start if database with
MySQL
engine cannot connect to MySQL server, it's fixed. Fixes #14441. #32802 (Alexander Tokmakov). - Avoid reusing the scalar subquery cache when processing MV blocks. This fixes a bug when the scalar query reference the source table but it means that all subscalar queries in the MV definition will be calculated for each block. #32811 (Raúl Marín).
MergeTree
table engine might silently skip some mutations if there are too many running mutations or in case of high memory consumption, it's fixed. Fixes #17882. #32814 (Alexander Tokmakov).- Fix optimization with lazy seek for async reads from remote fs. Closes #32803. #32835 (Kseniia Sumarokova).
- Fixed --echo option is not used by clickhouse-client in batch mode with single query. #32843 (N. Kolotov).
- Fix MV query with multiple chunk result. Fixes #31419. #32862 (Nikolai Kochetov).
- Close #32487. #32914 (Vladimir C).
- Fix ORC stripe reading. #32929 (Ernest Zaslavsky).
- Fix a regression in
replaceRegexpAll
function. The function worked incorrectly when matched substring was empty. This closes #32777. This closes #30245. #32945 (Alexey Milovidov). - Fix UB in case of unexpected EOF during filling a set from HTTP query (i.e. if the client interrupted in the middle, i.e.
timeout 0.15s curl -Ss -F 's=@t.csv;' 'http://127.0.0.1:8123/?s_structure=key+Int&query=SELECT+dummy+IN+s'
and with large enought.csv
). #32955 (Azat Khuzhin). - Fix throwing exception like positional argument out of bounds for non-positional arguments. Closes #31173#event-5789668239. #32961 (Kseniia Sumarokova).
- Fix hdfs url check that didn't allow using HA namenode address. Bug was introduced in https://github.com/ClickHouse/ClickHouse/pull/31042. #32976 (Kruglov Pavel).
- Fix wrong tuple output in CSV format in case of custom csv delimiter. #32981 (Kruglov Pavel).
- Fix Context leak in case of cancel_http_readonly_queries_on_client_close (i.e. leaking of external tables that had been uploaded the the server and other resources). #32982 (Azat Khuzhin).
- Remove obsolete code from ConfigProcessor. Yandex specific code is not used anymore. The code contained one minor defect. This defect was reported by Mallik Hassan in #33032. This closes #33032. #33026 (Alexey Milovidov).
- Fix s3 table function reading empty file. Closes #33008. #33037 (Kseniia Sumarokova).
- Fix error
Invalid version for SerializationLowCardinality key column
in case of reading fromLowCardinality
column withlocal_filesystem_read_prefetch
orremote_filesystem_read_prefetch
enabled. #33046 (Nikolai Kochetov). - Don't allow to write into S3 if path contains globs. #33142 (Kruglov Pavel).
- fix incorrect metric: StorageBufferBytes. #33159 (xuyatian).
- Fix MaterializedPostreSQL detach/attach (removing / adding to replication) tables with non-default schema. Found in #29535. #33179 (Kseniia Sumarokova).
- Make sure unused replication slots are always removed. Found in #26952,. #33187 (Kseniia Sumarokova).
- Fix ddl validation. Fix setting
materialized_postgresql_allow_automatic_update
. Closes #29535. #33200 (Kseniia Sumarokova). - Fix WHERE 1=0 for external databases query. Closes #33152. #33214 (Kseniia Sumarokova).
- Add asynchronous inserts (with enabled setting
async_insert
) to query log. Previously such queries didn't appear in query log. #33239 (Anton Popov). - Fix ACLMap num, because acl_to_num will erase. #33246 (小路).
- Fix ACL with explicit digit hash in clickhouse-keeper: now the behavior consistent with zookeeper and generated digest is always accepted. #33249 (小路).
- Fix when
COMMENT
for dictionaries does not appear insystem.tables
,system.dictionaries
. Allow to modify comment forDictionary
engine. Closes #33251. #33261 (Maksim Kita). - The commands
SYSTEM SUSPEND
andSYSTEM ... THREAD FUZZER
missed access control. It is fixed. Author: Kevin Michel. #33333 (Alexey Milovidov). - Do not try to read pass EOF (to workaround a bug in a kernel), this bug can be reproduced on kernels (3.14..5.9), and requires
index_granularity_bytes=0
(i.e. turn off adaptive index granularity). #33372 (Azat Khuzhin). - Fix possible use-after-free for INSERT into MV with concurrent DROP (#32572 significantly reduce the race window, this one should completely eliminate it). #33386 (Azat Khuzhin).
- Fix query cancellation in case of allow_experimental_parallel_reading_from_replicas. #33456 (Azat Khuzhin).
- Fix DROP MaterializedPostgreSQL database. #33468 (Kseniia Sumarokova).
- Fix dictionary expressions for RangeHashedDictionary range min and range max attributes when created using DDL. Closes #30809. #33478 (Maksim Kita).
- Fix an exception
Block structure mismatch
which may happen during insertion into table with default nestedLowCardinality
column. Fixes #33028. #33504 (Nikolai Kochetov). - Close issue: #33289 Fix bug when query view with setting offset and limit. #33518 (hexiaoting).
- Fix parsing incorrect queries with FROM INFILE statement. #33521 (Kruglov Pavel).
- Fix segfault in arrowSchemaToCHHeader if schema contains Dictionary type. Closes #33507. #33529 (Kruglov Pavel).
- session_id_counter poniter to next slot. #33555 (小路).
- Fix segfault in Avro that appears after the second insert into file. #33566 (Kruglov Pavel).
- Fix wrong database for JOIN w/o explicit database in distributed queries (Fixes: #10471). #33611 (Azat Khuzhin).
Bug Fix (user-visible misbehaviour in official stable release):
- Fix possible crash (or incorrect result) in case of
LowCardinality
arguments of window function. Fixes #31114. #31888 (Nikolai Kochetov).
Bug Fix (v21.9.4.35-stable)
- Fix #32964. #32965 (save-my-heart).
NO CL CATEGORY
- Fix Regular Expression while key path search. #33023 (mreddy017).
-
- Allow to split GraphiteMergeTree rollup rules for plain/tagged metrics (optional rule_type field). #33494 (Michail Safronov).
NO CL ENTRY
- NO CL ENTRY: 'Update CHANGELOG.md'. #32472 (Rich Raposa).
- NO CL ENTRY: 'Revert "Split long tests into multiple checks"'. #32514 (alesapin).
- NO CL ENTRY: 'Revert "Revert "Split long tests into multiple checks""'. #32515 (alesapin).
- NO CL ENTRY: 'blog post how to enable predictive capabilities in ClickHouse'. #32768 (Tom Risse).
- NO CL ENTRY: 'Revert "Fix build issue related to azure blob storage"'. #32845 (alesapin).
- NO CL ENTRY: 'Revert "Dictionaries added Date32 type support"'. #33053 (Alexander Tokmakov).
- NO CL ENTRY: 'Updated Lawrence Berkeley National Lab stats'. #33066 (Michael Smitasin).
- NO CL ENTRY: 'fix AggregateFunctionGroupBitmapData function rb_contains rb_remove'. #33127 (DR).
- NO CL ENTRY: 'Fix for example request with settings'. #33143 (Vitaly Artemyev).
- NO CL ENTRY: 'Revert "Grouping sets dev"'. #33186 (Alexey Milovidov).
- NO CL ENTRY: 'Optimize MergeTreePartsMover'. #33225 (zhongyuankai).
- NO CL ENTRY: 'rm redundant judge in hashmap iter operation'. #33285 (zbtzbtzbt).
- NO CL ENTRY: 'fix hang up with command 'drop table system.query_log sync''. #33293 (zhanghuajie).
- NO CL ENTRY: 'Improve query performance of system tables'. #33312 (zhongyuankai).
- NO CL ENTRY: 'Revert "Better cmake script for azure blob"'. #33319 (Nikita Mikhaylov).
- NO CL ENTRY: 'Added Superwall to adopters list'. #33573 (Justin Hilliard).
- NO CL ENTRY: 'Revert "Ignore parse failure of opentelemetry header"'. #33594 (Nikita Mikhaylov).
NOT FOR CHANGELOG / INSIGNIFICANT
- Merging #26074 #26559 (Nikita Mikhaylov).
- Fix data race in ProtobufSchemas #27822 (filimonov).
- Add performance tests to new CI #31467 (alesapin).
- refactor CI tests #31882 (Constantine Peresypkin).
- Add ability to drain connections synchronously #31965 (Azat Khuzhin).
- Add docker container for AWS lambda #32205 (Mikhail f. Shiryaev).
- test for #28280 #32235 (Denny Crane).
- Rename window functions in WindowView #32324 (vxider).
- Follow-up to #32140 #32389 (Alexander Tokmakov).
- clickhouse-local: fix CREATE DATABASE with Atomic engine #32417 (Azat Khuzhin).
- Add a test #16171 #32421 (Alexey Milovidov).
- Fix images names in integration tests #32438 (alesapin).
- Fix build check empty report #32440 (alesapin).
- Fix ASTFuzzer #32447 (Alexander Tokmakov).
- Try fix attaching gdb in tests #32448 (Alexander Tokmakov).
- Fix arraySlice with null args. #32456 (Nikolai Kochetov).
- Fix unit tests (ubsan) on master #32459 (alesapin).
- Remove dependency between integration and functional tests #32461 (alesapin).
- Add automatic workflow rerun #32462 (alesapin).
- Fix crash in case of MATERIALIZE COLUMN with no default expression. #32464 (Nikolai Kochetov).
- Update odbc-bridge.md #32475 (Kseniia Sumarokova).
- Fix test_prometheus_endpoint #32476 (Vladimir C).
- 02122_parallel_formatting: Address grep binary warnings #32477 (Raúl Marín).
- 01950_kill_large_group_by_query: Increase timeout #32479 (Raúl Marín).
- Fix backport workflow #32485 (alesapin).
- Make 01675_distributed_bytes_to_delay_insert less flaky (use http over client) #32492 (Azat Khuzhin).
- Fix 02050_client_profile_events flakiness #32493 (Azat Khuzhin).
- Fix integration tests docker images path #32494 (alesapin).
- Split long tests into multiple checks #32496 (alesapin).
- Add test for clickhouse-client history navigation #32497 (Amos Bird).
- Rename window-view function to time window function #32498 (vxider).
- Disable flaky tests with Window View #32500 (Alexander Tokmakov).
- Fix flaky window view tests #32503 (vxider).
- Fix queries with hasColumnInTable constant condition and non existing column #32506 (Nikolai Kochetov).
- Try to fix attaching gdb 2 #32511 (Alexander Tokmakov).
- clickhouse-test: use basename of the test for *.sh tests #32533 (Azat Khuzhin).
- Fix processing initial table (--table/stdin) in clickhouse-local #32534 (Azat Khuzhin).
- Suppress UBSan errors for avg() function #32535 (Azat Khuzhin).
- Fix LOGICAL_ERROR for MATERIALIZED VIEW over table functions (i.e. numbers()) #32571 (Azat Khuzhin).
- Improve quota's end-of-interval calculations. #32575 (Vitaly Baranov).
- remove unused headers in test #32578 (Bharat Nallan).
- Remove arcadia build support #32580 (Azat Khuzhin).
- Cleanup perf test runner #32582 (Azat Khuzhin).
- [RFC] perf: do not fail in case of slow queries (to avoid hiding possible issues) #32583 (Azat Khuzhin).
- Add test for issue 28316 #32585 (Kseniia Sumarokova).
- Fix bad test #32571 #32588 (Alexey Milovidov).
- Fix perf test
reinterpret_as
#32589 (Alexey Milovidov). - Fix indecent error message #32591 (Alexey Milovidov).
- Fix strange code in TCPHandler #32592 (Alexey Milovidov).
- CI: upload logs if task failed #32618 (Alexander Tokmakov).
- clickhouse-test: avoid failing with UNKNOWN status in some cases #32625 (Azat Khuzhin).
- avoid inconsistent state in Block #32641 (gulige).
- Rerun workflows more times #32642 (alesapin).
- Remove flaky check from master and split asan test #32645 (alesapin).
- Split database replicated #32650 (alesapin).
- Improve exceptions usage in access control #32662 (Vitaly Baranov).
- Follow-up to #32140 #32667 (Alexander Tokmakov).
- Add test_s3_zero_copy_concurrent_merge #32694 (Nikolai Kochetov).
- Check trusted contributors in lowercase #32696 (Vladimir C).
- Mention ClickHouse CLA in CONTRIBUTING.md #32697 (Ivan Blinkov).
- Rerun release workflows #32701 (alesapin).
- plausible analytic blog post #32719 (Tom Risse).
- Update backport.py #32720 (Kruglov Pavel).
- Pass -no-pie to the linker call to disable it #32731 (Raúl Marín).
- Add severity table to support case form #32736 (Cody Baker).
- tests/integration: fix wait_start()/start_clickhouse() #32739 (Azat Khuzhin).
- tests/integration: fix waiting of mysql client container #32740 (Azat Khuzhin).
- Better control build artifacts #32745 (alesapin).
- Fix race in skipping index of type
hypothesis
#32756 (Anton Popov). - Fix build performance #32766 (alesapin).
- Add test for issue 26912 #32771 (Kseniia Sumarokova).
- Add a test for CAST to named tuple just in case. #32776 (Alexey Milovidov).
- Fix performance build #32796 (alesapin).
- Trying another stress servers #32798 (alesapin).
- More diagnostics in gdb script #32801 (Alexander Tokmakov).
- CacheDictionary dictionary source access race fix #32805 (Maksim Kita).
- Update NuRaft #32808 (alesapin).
- Add retries to curl in performance tests. #32809 (alesapin).
- Made Azure blob storage to obey ENABLE_LIBRARIES flag #32815 (Nikita Mikhaylov).
- Remove recursive submodules #32820 (Alexey Milovidov).
- test for summap nullable(0) #32822 (Denny Crane).
- Update CHANGELOG.md #32823 (Denny Crane).
- Make
test_storage_s3
less flaky #32825 (Azat Khuzhin). - Fix error message for reading from url #32826 (Kseniia Sumarokova).
- Revert docs release #32827 (alesapin).
- Fix docs release one more time #32828 (alesapin).
- Trigger also for workflows changes #32830 (alesapin).
- Fix docs release one more time #32831 (alesapin).
- Add dispatch event to docs release #32832 (alesapin).
- Remove repository before checkout #32834 (alesapin).
- Fix release branches filter #32837 (alesapin).
- StorageLiveView fix function style #32838 (Maksim Kita).
- Try fix flaky test: order for test_s3_zero_copy_replication #32846 (Vladimir C).
- Update TRUSTED_CONTIBUTORS #32850 (Vladimir C).
- Followup docs check workflow #32857 (alesapin).
- Always apply const-condition-if optimization. #32858 (Nikolai Kochetov).
- Use a proper syntax for multiline env in GITHUB_ENV #32864 (Mikhail f. Shiryaev).
- Fix multiline SSH_KEY in GITHUB_ENV file #32865 (Mikhail f. Shiryaev).
- warm up for test_kafka_json_as_string_no_kdc #32885 (Ilya Golshtein).
- Rename files and code from BlobStorage to AzureBlobStorage #32886 (Kseniia Sumarokova).
- Add dockerhub proxy to CI #32905 (alesapin).
- Update 01069_window_view_proc_tumble_watch.py #32908 (Kseniia Sumarokova).
- Update test azure_blob_storage::test_table_manipulations #32909 (Kseniia Sumarokova).
- More retries in perf tests. #32910 (alesapin).
- fix wrong testcase in gtest_Parser #32912 (SuperDJY).
- Disable percpu arena in jemalloc in case of non deterministic CPU count #32916 (Azat Khuzhin).
- [RFC] Add replxx/jemalloc into fasttest build of clickhouse #32923 (Azat Khuzhin).
- tests/integration/cleanup_environment: fix obtaining PYTEST_CLEANUP_CONTAINERS #32931 (Azat Khuzhin).
- fix typo #32936 (Denny Crane).
- Fix build issue related to azure blob storage [another try] #32948 (Amos Bird).
- test for base64encode_trailing_bytes #31797 #32954 (Denny Crane).
- simplify looping in S2 functions #32960 (Bharat Nallan).
- Sync release CI branches in master #32967 (alesapin).
- Loops remove postfix increment #32970 (Maksim Kita).
- Containers iteration fix erase #32972 (Maksim Kita).
- Merging #32400 #32974 (Nikita Mikhaylov).
- Decrease log level for some s3 messages. #32979 (Nikolai Kochetov).
- Trying to add woboq to new CI #32983 (alesapin).
- RabbitMQ tests fix #32985 (Kseniia Sumarokova).
- Fix clang-tidy #32987 (Kseniia Sumarokova).
- Fix typo #32992 (Kseniia Sumarokova).
- Fix weird permission on log directories #32994 (Håvard Kvålen).
- Add Keeper Jepsen check to new CI #32998 (alesapin).
- Add backport workflow rerun #33005 (alesapin).
- Remove the possibility of adding columns with table overrides #33017 (Stig Bakken).
- Merge #33023 #33027 (Alexey Milovidov).
- Fix cron expression #33035 (alesapin).
- Make
can be tested
great again #33036 (alesapin). - Fix exception in azure write buffer desctructor #33039 (Kseniia Sumarokova).
- Add manual run for woboq #33042 (alesapin).
- Update Cassandra driver #33043 (Alexander Tokmakov).
- Decrease default timeout for integration test #33044 (Alexander Tokmakov).
- Fix merge #33021 #33049 (Nikolay Degterinsky).
- Update banner for january 20 release webinar #33052 (Cody Baker).
- Update harmful library #33058 (Alexey Milovidov).
- Merge #33024 #33061 (Alexey Milovidov).
- Merge #33022 #33062 (Alexey Milovidov).
- Merge #33025 #33063 (Alexey Milovidov).
- Merge #33050 #33065 (Alexey Milovidov).
- Add alternative LRUCache version #33098 (lgbo).
- Fix test that was dependent on time zone #33122 (Alexey Milovidov).
- Fix clang tidy #33131 (alesapin).
- Fix PVS check #33135 (alesapin).
- Upload build artifact in case of build failures #33136 (alesapin).
- Fix woboq codebrowser #33137 (alesapin).
- Longer timeout for server start in fuzzer #33138 (alesapin).
- Fix azure blob storage tests failures #33140 (Kseniia Sumarokova).
- Fix functions with sparse arguments in case when result type doesn't support sparse serialization #33146 (Anton Popov).
- Add pretty print unknow event #33148 (alesapin).
- Better pr info for unknown events #33149 (alesapin).
- Better jepsen #33150 (alesapin).
- Debugging PR info #33151 (alesapin).
- Fix shared hermetic builds on Arch linux #33153 (Azat Khuzhin).
- Fix ccache with ENABLE_CHECK_HEAVY_BUILDS (ccache 4.0 and 4.1 only affected) #33154 (Azat Khuzhin).
- Cleanup trash from Kafka, HDFS and Azure #33160 (Alexey Milovidov).
- Fix Date32 test #33161 (Alexey Milovidov).
- Make test_input_format_parallel_parsing_memory_tracking less flaky #33163 (Azat Khuzhin).
- Fix test_async_drain_connection flakiness #33164 (Azat Khuzhin).
- Fix clang-tidy #33168 (Alexey Milovidov).
- Fix flaky test 01622_defaults_for_url_engine #33169 (Alexey Milovidov).
- materialized postgresql better startup #33177 (Kseniia Sumarokova).
- Fix possible uncaught exception in clickhouse-local #33189 (Kseniia Sumarokova).
- Fix tests with event_time/event_date = today(), and add a style check #33198 (Azat Khuzhin).
- Fix 01370_client_autocomplete_word_break_characters test logic #33202 (Azat Khuzhin).
- More debug in jepsen test #33207 (alesapin).
- Fix some flaky integration tests #33215 (alesapin).
- Remove old trash #33217 (Alexey Milovidov).
- Fix cancel lambda #33222 (alesapin).
- Fix keeper log messages #33224 (alesapin).
- Fix clang tidy #33235 (alesapin).
- Fix flaky test 01650 #33250 (alesapin).
- Add retries for github api #33252 (alesapin).
- Add retries to AST fuzzer download and fix flaky test. #33256 (alesapin).
- Do not ignore eof in expect tests #33263 (Azat Khuzhin).
- Fix parsing symbols from resources (for shared builds) #33264 (Azat Khuzhin).
- test for #24410 #33265 (Denny Crane).
- Wait for RabbitMQ container to actually start when it was restarted in test on purpose #33266 (Kseniia Sumarokova).
- Mark max_alter_threads as obsolete #33268 (Denny Crane).
- Fix azure tests flakyness because of azure server closing connection #33269 (Kseniia Sumarokova).
- Test for #26920 #33272 (Denny Crane).
- Fix test_storage_kafka failures by adjusting retention.ms #33278 (Azat Khuzhin).
- Disable FunctionConvertFromString::canBeExecutedOnDefaultArguments #33286 (Vladimir C).
- Add IAST::QueryKind enum and use it in query limiter #33294 (Mikhail f. Shiryaev).
- Fix clang tidy 3 #33296 (alesapin).
- Fix jepsen check #33304 (alesapin).
- Add test for broken connection #33305 (nvartolomei).
- Fix launcher not being defined for ccache < 4.0 and slightly cleanup #33306 (nvartolomei).
- Return early if azure blob storage is not used, otherwise it might with fail with irrelevant errors #33307 (nvartolomei).
- Minor refactor of read buffers with compression #33318 (Nikolay Degterinsky).
- Rename Committed data part state to Active #33327 (Alexander Tokmakov).
- Tiny follow-up to pr 33098 #33334 (Kseniia Sumarokova).
- Fix inner table parser in window view #33340 (vxider).
- Cover CustomSeparated/Template formats for Kafka #33343 (Azat Khuzhin).
- update copyright in docs #33353 (Bharat Nallan).
- UserDefinedExecutableFunction fix exception #33362 (Maksim Kita).
- Trying to merge #23230 #33368 (Alexey Milovidov).
- Print alter command names in EXPLAIN AST #33383 (Stig Bakken).
- DictionaryStructure fixes #33388 (Maksim Kita).
- tests/stress: add core dumps into artifacts #33389 (Azat Khuzhin).
- Update success.html #33397 (Adri Fernandez).
- Remove obsolete and unsupported Docker Builder #33345 #33399 (Alexey Milovidov).
- Maybe improve robustness of the "query profiler" test #33422 (Alexey Milovidov).
- fix misleading log message in StorageWindowView #33432 (flynn).
- Preparation for #33167. #33444 (Alexey Milovidov).
- Rerun docs release check as well #33447 (alesapin).
- Update AsynchronousReadIndirectBufferFromRemoteFS.h #33452 (xiedeyantu).
- Tests visualizer better #33453 (Dmitry Khorkin).
- Function monthName small fix #33464 (Maksim Kita).
- Add a test for operator priorities in SQL #33487 (Alexey Milovidov).
- Add new team members to company page #33506 (Cody Baker).
- fix variable name in h3 misc funcs #33510 (Bharat Nallan).
- H3 functions bad arguments possible crash fix #33512 (Maksim Kita).
- Build with ENABLE_TESTS fix #33513 (Maksim Kita).
- IAST QueryKind style fix #33514 (Maksim Kita).
- Don't print exception twice in client in case of exception in parallel parsing #33524 (Kruglov Pavel).
- HashTable constant fix #33525 (Maksim Kita).
- Add admixer blog post #33528 (Cody Baker).
- Fix clickhouse local interactive exception case #33535 (Kseniia Sumarokova).
- Fix parsing queries with FROM INFILE statement again #33556 (Kruglov Pavel).
- Fix logic for upload upload_master_static_binaries #33560 (Mikhail f. Shiryaev).
- Don't upload splitted binaries to builds.clickhouse.com #33562 (Mikhail f. Shiryaev).
- Fix minor bug in TTL and flaky test #33564 (Alexander Tokmakov).
- skip MySQLCreateRewritten unit testsuite when enable_mysql is off #33577 (Suzy Wang).
- Fix test
02156_storage_merge_prewhere
#33580 (Anton Popov). - Update mongodb.md #33585 (Kseniia Sumarokova).
- Restore existing static builds links #33597 (Mikhail f. Shiryaev).
- Fix pylint for run_check.py #33600 (Mikhail f. Shiryaev).
- Fix flaky test_dictionaries_postgresql/ #33601 (Kseniia Sumarokova).
- Make ZooKeeper client better interpret keeper server connection reject #33602 (alesapin).
- Fix broken workflow dependencies #33608 (Mikhail f. Shiryaev).
- Force rebuild images in CI #33609 (Mikhail f. Shiryaev).
- YetAnother workflow fix #33610 (Mikhail f. Shiryaev).
- Metrics lambda: fix deletion #33616 (Mikhail f. Shiryaev).
- Add an exception message example #33623 (Mikhail f. Shiryaev).
- Fix two flaky integration tests #33625 (alesapin).
- Update version to 22.1 not 21.13 #33626 (alesapin).
- do not construct std::string if there is no error #33628 (Sergei Trifonov).
- Fix test 00900_long_parquet_load #33629 (Kruglov Pavel).
- Fix error codes order #33633 (Kruglov Pavel).
- Fix s3 integration tests #33641 (Kruglov Pavel).
- test for #33592 #33658 (Denny Crane).
- Update "gosu" version #33660 (Alexey Milovidov).
- Fix 01814_distributed_push_down_limit flakiness #33662 (Azat Khuzhin).
- Add amosbird to trusted user. #33663 (Amos Bird).
- Fix pr ci restart #33667 (Mikhail f. Shiryaev).
New Feature / New Tool
- Tool for collecting diagnostics data. #33175 (Alexander Burmak).