mirror of
https://github.com/ClickHouse/ClickHouse.git
synced 2024-11-27 10:02:01 +00:00
70 KiB
70 KiB
sidebar_position | sidebar_label |
---|---|
1 | 2022 |
2022 Changelog
ClickHouse release v22.2.1.2139-prestable FIXME as compared to v22.1.1.2542-prestable
New Feature
- (Not ready for production, put into experimental features) Add memory overcommit to
MemoryTracker
. Addedguaranteed
settings for memory limits which represent soft memory limits. In case when hard memory limit is reached,MemoryTracker
tries to cancel the most overcommited query. New settingmemory_usage_overcommit_max_wait_microseconds
specifies how long queries may wait another query to stop. Closes #28375. #31182 (Dmitry Novik). - The setting allows a user to provide own deduplication semantic in MergeTree/ReplicatedMergeTree If provided, it's used instead of data digest to generate block ID. So, for example, by providing a unique value for the setting in each INSERT statement, the user can avoid the same inserted data being deduplicated. This closes: #7461. #32304 (Igor Nikonov).
- Add support of DEFAULT keyword for INSERT statements. Closes #6331. #33141 (Andrii Buriachevskyi).
- Add confidence intervals to ttests. #33260 (achimbab).
- Allow to create new files on insert for File/S3/HDFS engines. Allow to owerwrite file in HDFS. Throw an exception in attempt to overwrite a file in S3 by default. Throw an exception in attempt to append data to file in formats that have suffix. Closes #31640 Closes #31622 Closes #23862 Closes #15022 Closes #16674. #33302 (Kruglov Pavel).
- Add
h3ToCenterChild
function. #33313 (Bharat Nallan). - Merge functions for text classification. See #23271. #33314 (Nikolay Degterinsky).
- Implemented meanZTest. #33354 (achimbab).
- Add new h3 miscellaneous functions:
edgeLengthKm
,exactEdgeLengthKm
,exactEdgeLengthM
,exactEdgeLengthRads
,numHexagons
. #33621 (Bharat Nallan). - Add
DEGREES
andRADIANS
functions. #33769 (Bharat Nallan). - Parameter
--host
can accept multiple hosts. In case of unavailability of one of them, the client will try to connect to the next one. #33824 (Filippov Denis). - Detect format in clickhouse-local by file name. #33829 (Kruglov Pavel).
- Add a new method
expire()
in PoolBase which is used to reallocate an invalid object in the pool. #34076 (lgbo). - Add table function
format(format_name, data)
. #34125 (Kruglov Pavel). - Allow to create default table engine. #34187 (Ilya Yatsishin).
EPHEMERAL
column specifier is added toCREATE TABLE
query. Closes #9436. #34424 (Yakov Olkhovskiy).
Performance Improvement
- For inserts and merges into S3, write files in parallel whenever possible. #33291 (Nikolai Kochetov).
- Improve RangeHashedDictionary performance if for key there are a lot of intervals. Fixes #23821. #33516 (Maksim Kita).
- Add x86 avx512 support for memcmpSmall functions to accelerate memory comparison. It works only if you compile ClickHouse by yourself. #33706 (hanqf-git).
- Reworks and reintroduces the scalar cache to MV execution. #33958 (Raúl Marín).
- Make ORDER BY tuple almost as fast as ORDER BY columns. We have special optimizations for multiple column ORDER BY: https://github.com/ClickHouse/ClickHouse/pull/10831 . It's beneficial to also apply to tuple columns. #34060 (Amos Bird).
- Minor improvement to potential hot-path in
ExecuteScalarSubqueriesMatcher::visit
, wherestd::set<String>
was constructed on every function invocation. #34128 (Federico Rodriguez). - Slightly improve performance of
Regexp
format. #34202 (Alexey Milovidov). - Optimize quantilesExact{Low,High} to use nth_element instead of sort. #34287 (Daniel Kutenin).
- Improve performance of
LineAsString
format. This closes #34303. #34306 (Alexey Milovidov). - Speed up loading of data parts. It was not parallelized before: the setting
part_loading_threads
did not have effect. See #4699. #34310 (Alexey Milovidov). _file
and_path
virtual columns (in file-like table engines) are madeLowCardinality
- it will make queries for multiple files faster. Closes #34300. #34317 (flynn).- Improve performance of
mapPopulateSeries
function. Closes #33944. #34318 (Maksim Kita). - Use a vector to collect useless list iterators when doing a snapshot, and in latter clearOutdatedNodes, we can just traverse the vector, not the list, which is faster. #34484 (zhanglistar).
- Improve performance of insert into table functions URL, S3, File, HDFS. Closes #34348. #34510 (Maksim Kita).
- According https://github.com/eBay/NuRaft/issues/209, there is no need to lock the mothod. #34523 (zhanglistar).
Improvement
- Now ReplicatedMergeTree can recover data when some of its disks are broken. #13544 (Amos Bird).
- Dynamic reload of server TLS certificates on config reload. Closes #15764. #15765 (johnskopis).
- Merge #15765 (Dynamic reload of server TLS certificates on config reload) cc @johnskopis. #31257 (Filatenkov Artur).
- Added
UUID
data type support for functionshex
,bin
. #32170 (Frank Chen). - Support
optimize_read_in_order
if prefix of sorting key is already sorted. E.g. if we have sorting keyORDER BY (a, b)
in table and query withWHERE a = const ORDER BY b
clauses, now it will be applied reading in order of sorting key instead of full sort. #32748 (Anton Popov). - Add new keeper setting
min_session_timeout_ms
. Now keeper server will determine client session timeout according tomin_session_timeout_ms
andsession_timeout_ms
settings. #33288 (JackyWoo). - Improve keeper performance and fix several memory leaks. #33329 (alesapin).
- Respect cgroup limits for CPU quota. #33342 (JaySon).
- Enable binary arithmetic(plus, minus, multiply, division, least, greates) between Decimal and Float. #33355 (flynn).
- Replace
_shard_num
via constants (from #7624) withshardNum()
function (from #27020), to avoid possible issues (like those that had been found in #16947). #33392 (Azat Khuzhin). - Support
SET
,YEAR
,TIME
andGEOMETRY
data types inMaterializedMySQL
. Fixes #18091, #21536, #26361. #33429 (zzsmdfj). - add function addressToLineWithInlines. Close #26211. #33467 (SuperDJY).
- Improvement for
fromUnixTimestamp64
family functions.. They now accept any integer value that can be converted toInt64
. This closes: #14648. #33505 (Andrey Zvonov). - Functions
dictGet
,dictHas
implicitly cast key argument to dictionary key structure, if they are different. #33672 (Maksim Kita). -
- Parse and store OpenTelemetry trace-id in big-endian order. #33723 (Frank Chen).
- Enable stream to table join in WindowView. #33729 (vxider).
- Create parent directories in DiskS3::restoreFileOperations method. #33730 (ianton-ru).
- Add some improvements and fixes for Bool data type. Fixes #33244. #33737 (Kruglov Pavel).
- Added support for cast from
Map(Key, Value)
toArray(Tuple(Key, Value))
. #33794 (Maksim Kita). - Support explain create function query ``` sql :) explain ast create function mycast AS (n) -> cast(n as String); EXPLAIN AST CREATE FUNCTION mycast AS n -> CAST(n, 'String'). #33819 (李扬).
- Try every resolved ip address while getting S3 proxy. #33862 (Nikolai Kochetov).
FlatDictionary
improve performance of dictionary data load. #33871 (Maksim Kita).- fix disk using the same path, close #29072. #33905 (zhongyuankai).
- Dictionaries added support for DateTime64. #33914 (Maksim Kita).
FlatDictionary
,HashedDictionary
,HashedArrayDictionary
added support for creating with empty attributes, with support of read all keys, anddictHas
. Fixes #33820. #33918 (Maksim Kita).RangeHashedDictionary
improvements. Improve performance of load time if there are multiple attributes. Allow to create without attributes. Added option to specify strategy when intervalsstart
andend
haveNullable
typeconvert_null_range_bound_to_open
by default istrue
. Closes #29791. Allow to specifyFloat
,Decimal
,DateTime64
,Int128
,Int256
,UInt128
,UInt256
as range types.RangeHashedDictionary
added support for range values that extendInt64
type. Closes #28322. Added optionrange_lookup_strategy
to specify range lookup typemin
,max
by default ismin
. Closes #21647. Fixed allocated bytes calculations. Fixed type name insystem.dictionaries
in case ofComplexKeyHashedDictionary
. #33927 (Maksim Kita).- Fix getauxval() in glibc-compatibility, this should fix vsyscalls after
setenv
(i.e. timezone is set in config), and LSan (and also fix some leaks that had been found by LSan). #33957 (Azat Khuzhin). - Detect format and schema from stdin in clickhouse-local. #33960 (Kruglov Pavel).
- Fixed UTF-8 string case-insensitive search when lowercase and uppercase characters are represented by different number of bytes. Example is
ẞ
andß
. This closes #7334. #33992 (Harry Lee). - Fix memory accounting for queries that uses < max_untracker_memory. #34001 (Azat Khuzhin).
- Supports all types of SYSTEM query ON CLUSTER clause. #34005 (小路).
- Add schema inference for values() table function. Closes #33811. #34017 (Kruglov Pavel).
- Tracing context is now propagated from GRPC client metadata. #34064 (andremarianiello).
- Add UUID suport in MsgPack input/output format. #34065 (Kruglov Pavel).
- Improving the experience of multiple line editing for clickhouse-client. This is a follow-up of https://github.com/ClickHouse/ClickHouse/pull/31123. #34114 (Amos Bird).
- Maxsplit argument for splitByChar. close #34081. #34140 (李扬).
- Allow to parse dictionary
PRIMARY KEY
asPRIMARY KEY (id, value)
, previously supported onlyPRIMARY KEY id, value
. Closes #34135. #34141 (Maksim Kita). - Allow carriage return in the middle of the line while parsing by
Regexp
format. This closes #34200. #34205 (Alexey Milovidov). - Recognize
YYYYMMDD-hhmmss
format inparseDateTimeBestEffort
function. This closes #34206. #34208 (Alexey Milovidov). - Add ability to compose PostgreSQL-style cast operator
::
withArrayElement
andTupleElement
. #34229 (Nikolay Degterinsky). - Added
#!
and#
as a recognised start of a single line comment. Reference to task #34138. #34230 (Aaron Katz). - Change severity of the "Cancelled merging parts" message in logs, because it's not an error. This closes #34148. #34232 (Alexey Milovidov).
- Apply data skipping indexes for queries with FINAL may produce incorrect result. Disable data skipping indexes by default for queries with FINAL (introduce new
use_skip_indexes_if_final
setting and disable it by default). #34243 (Azat Khuzhin). - Support asynchronous inserts in
clickhouse-client
for queries with inlined data. #34267 (Anton Popov). - Cancel merges before acquiring table lock for
TRUNCATE
query to avoidDEADLOCK_AVOIDED
error in some cases. Fixes #34302. #34304 (Alexander Tokmakov). - Some servers expect a User-Agent header in their HTTP requests. A
User-Agent
header entry has been added to HTTP requests of the form: User-Agent: ClickHouse/VERSION_STRING. #34330 (Saad Ur Rahman). - REGEXP_MATCHES and REGEXP_REPLACE function aliases for compatibility with PostgreSQL. Close #30885. #34334 (李扬).
- Better handle pre-inputs before client start. This is for #34308 . #34336 (Amos Bird).
- Add options for clickhouse-format. Which close #30528 - max_query_size - max_parser_depth. #34349 (李扬).
- Default input and output formats that can be overriden by --input-format and --output-format. Close #30631. #34352 (李扬).
- Allow to skip not found urls for globs when using URL storage / table function. Also closes #34359. #34392 (Kseniia Sumarokova).
- Add two new settings:
s3_upload_part_size_multiply_factor
ands3_upload_part_size_multiply_parts_count_threshold
. Now each times3_upload_part_size_multiply_parts_count_threshold
uploaded to S3 from a single querys3_min_upload_part_size
multiplied bys3_upload_part_size_multiply_factor
. Fixes #34244. #34422 (alesapin). - Allow
allow_experimental_projection_optimization
by default. #34456 (Nikolai Kochetov). - Privileges CREATE/ALTER/DROP ROW POLICY now can be granted on a table or on
database.*
as well as globally*.*
. #34489 (Vitaly Baranov). - Refactor client fault tolerant connection (https://github.com/ClickHouse/ClickHouse/pull/33824#issuecomment-1033690860). The new way to use it:
bash clickhouse-client ... --host host1 --host host2 --port port2 --host host3 --port port --host host4
. #34490 (Kruglov Pavel). - Improve schema inference in clickhouse-local. Allow to write just
clickhouse-local -q "select * from table" < data.format
. #34495 (Kruglov Pavel). - Support
.jsonl
extension for JSONEachRow format. #34496 (Kruglov Pavel). - Send ProfileEvents statistics in case of INSERT SELECT query. #34498 (Dmitry Novik).
- Added sending of the output format back to client like it's done in HTTP protocol as suggested in #34362. Closes #34362. #34499 (Vitaly Baranov).
- Allow to write
s3(url, access_key_id, secret_access_key)
. #34503 (Kruglov Pavel). - Support
IF EXISTS
clause forTTL expr TO [DISK|VOLUME] [IF EXISTS] 'xxx'
feature. Parts will be moved to disk or volume only if it exists on replica, soMOVE TTL
rules will be able to behave differently on replicas according to the existing storage policies. Resolves #34455. #34504 (Anton Popov). - Little improvement no need to clone log entry. #34587 (zhanglistar).
- Slightly improve performance in case of filtering by sparse columns (which can be enabled by setting
ratio_of_defaults_for_sparse_serialization
inMergeTree
tables). #34601 (Anton Popov).
Bug Fix
- This PR allows using multiple LDAP storages in the same list of user directories. It worked earlier but was broken because LDAP tests are disabled (they are part of the testflows tests). #33574 (Vitaly Baranov).
- This PR fixes #18206. #33977 (Vitaly Baranov).
- This PR fixes #19429. #34225 (Vitaly Baranov).
- Fix inserting to temporary tables via gRPC. This PR fixes #34347, issue
#2
. #34364 (Vitaly Baranov). - add HashMethodSingleLowCardinalityColumn::findKey, avoid crash. #34506 (DR).
Build/Testing/Packaging Improvement
- Add action for published releases. #32218 (Mikhail f. Shiryaev).
- Remove unbundled support. #33690 (Azat Khuzhin).
- Some improvement over current build system. #33695 (Amos Bird).
- Removed "Yandex ClickHouse" terms from descriptions. Change to default mirrors for packages. #33745 (Ilya Yatsishin).
-
- Fix unconditional
--build-arg FROM_TAG=
docker argument - Add some tests for docker tests/ci. #33751 (Mikhail f. Shiryaev).
- Fix unconditional
- Disable dh_update_autotools_config that updates config.guess/config.sub in sources directory on build. It will be more deterministic in terms of different build hosts used as config.guess is provided with sources. #33752 (Ilya Yatsishin).
- clickhouse-test.deb is not used in stateless CI checks. #33948 (Ilya Yatsishin).
-
- Add on-demand style-checker-aarch64 hosts - Run dockerpush CI jobs there. #33954 (Mikhail f. Shiryaev).
- Add back the missing
-Werror
flag globally. This fixes https://github.com/ClickHouse/ClickHouse/pull/33940#issuecomment-1020466537. #33970 (Amos Bird). - Separate base parts out of SystemLog. Common code can use system log without fully linking to Interpreters. This helps with errors like https://s3.amazonaws.com/clickhouse-builds/33970/49b229f9c781854861254350d3407f209fb99dfd/binary_splitted/build_log.log. #33978 (Amos Bird).
- Fix broken dependencies tree building, improve tests. #33983 (Mikhail f. Shiryaev).
-
- Add get_with_retries to a download helper - Use it un PRInfo class - Replace
labels_from_api
bypr_event_from_api
- Use it in description check to have always actual body and labels. #34012 (Mikhail f. Shiryaev).
- Add get_with_retries to a download helper - Use it un PRInfo class - Replace
-
- Fix style check for tags_stable.yml - Run StyleCheck always in PR - Mark
Run Check
as failed only for some cases. #34283 (Mikhail f. Shiryaev).
- Fix style check for tags_stable.yml - Run StyleCheck always in PR - Mark
- Add verbosity to a style check. #34289 (Mikhail f. Shiryaev).
- Fix previously wrong OK_SKIP_LABELS in run_check.py. #34340 (Mikhail f. Shiryaev).
-
- Migrate docker images from Moscow timezone to UTC - Update ubuntu version for performance comparison from 18.04 to 20.04. #34373 (Mikhail f. Shiryaev).
- Ensure that tests don't depend on the result of non-stable sorting of equal elements. Added equal items ranges randomization in debug after sort to prevent issues when we rely on equal items sort order. #34393 (Maksim Kita).
-
- Rebuild docker images on a daily base - Add
--all
flag to rebuild all images - Addonly_amd64
parameter for some images - Revert all workarounds foronly_amd64
images - Fix all broken images. #34492 (Mikhail f. Shiryaev).
- Rebuild docker images on a daily base - Add
- Fix broken Hadoop tests after updated paths in an image. #34556 (Mikhail f. Shiryaev).
- I test compile ClickHouse without HDFS but failed, because the code in DiskHDFS doesn`t judge whether use HDFS. #34573 (zxealous).
- Set timeout 40 minutes for fast tests. #34614 (Mikhail f. Shiryaev).
- Reverts ClickHouse/ClickHouse#34614. #34622 (Mikhail f. Shiryaev).
-
- Rework version_helper, make it executable - Reimplement StorageSystemContributors.sh in version_helper - Create a release script. #34641 (Mikhail f. Shiryaev).
-
- Fix path in workflows/release.yml - To be backported to branch 22.1. #34646 (Mikhail f. Shiryaev).
Bug Fix (user-visible misbehaviour in official stable release)
- Fix lz4 compression for output. Closes #31421. #31862 (Kruglov Pavel).
- Create a function escapeForLDAPFilter and use it to escape characters '(' and ')' in a final_user_dn variable. #33401 (IlyaTsoi).
- TODO. #33492 (huzhichengdd).
- Fix error
Bad cast from type ... to DB::DataTypeArray
which may happen when table hasNested
column with dots in name, and default value is generated for it (e.g. during insert, when column is not listed). Continuation of #28762. #33588 (Alexey Pavlenko). - Fix
Chunk should have AggregatedChunkInfo in GroupingAggregatedTransform
(in case ofoptimize_aggregation_in_order=1
). #33637 (Azat Khuzhin). - Fix bug in zero copy replication which lead to data duplication in case of TTL move. Fixes #33643. #33642 (alesapin).
- Allow some queries with sorting, LIMIT BY, ARRAY JOIN and lambda functions. This closes #7462. #33675 (Alexey Milovidov).
- Correctly determine current database if
CREATE TEMPORARY TABLE AS SELECT
is queried inside a named HTTP session. This is a very rare use case. This closes #8340. #33676 (Alexey Milovidov). - Fix mutation when table contains projections. This fixes #33010 . This fixes #33275 . #33679 (Amos Bird).
- Throw exception when storage hdfs list directory failed. #33724 (LiuNeng).
- Fix tiny race between count() and INSERT/merges/... in MergeTree (it is possible to return incorrect number of rows for SELECT with optimize_trivial_count_query). #33753 (Azat Khuzhin).
- Fix bug of check table when creating data part with wide format and projection. #33774 (李扬).
- Fix parsing query INSERT INTO ... VALUES SETTINGS ... (...), ... #33776 (Kruglov Pavel).
- Fix bug in client that led to 'Connection reset by peer' in server. Closes #33309. #33790 (Kruglov Pavel).
- Fix usage of external dictionaries with
Redis
source and large number of keys. #33804 (Anton Popov). - Fix schema inference for JSONEachRow and JSONCompactEachRow. #33830 (Kruglov Pavel).
- Fix KeyCondition with no common types available. #33833 (Amos Bird).
- Fix memory leak in
clickhouse-keeper
in case of compression is used (default). #33840 (Azat Khuzhin). - Fixed
replica is not readonly
logical error onSYSTEM RESTORE REPLICA
query when replica is actually readonly. Fixes #33806. #33847 (Alexander Tokmakov). - Fix usage of sparse columns (which can be enabled by experimental setting
ratio_of_defaults_for_sparse_serialization
). #33849 (Anton Popov). - Fix crash if sql user defined function is created with lambda with non identifier arguments. Closes #33866. #33868 (Maksim Kita).
- Fix potential race condition when doing remote disk read. cc @Jokser. #33912 (Amos Bird).
- Aggregate function combinator
-If
did not correctly processNullable
filter argument. This closes #27073. #33920 (Alexey Milovidov). - Fix parsing ZK metadata: now metadata from zookeeper compared with local metadata in canonical form. #33933 (sunny).
- Fix usage of functions
array
andtuple
with literal arguments in distributed queries. Previously it could lead toNot found columns
exception. #33938 (Anton Popov). - Fix crash while reading of nested tuples. Fixes #33838. #33956 (Anton Popov).
- Fix parsing IPv6 from query parameter and fix IPv6 to string conversion. Closes #33928. #33971 (Kruglov Pavel).
- Fix segfault while parsing ORC file with corrupted footer. Closes #33797. #33984 (Kruglov Pavel).
- Fix bug which lead to inability for server to start when both replicated access storage and keeper are used. Introduced two settings for keeper socket timeout instead of settings from default user:
keeper_server.socket_receive_timeout_sec
andkeeper_server.socket_send_timeout_sec
. Fixes #33973. #33988 (alesapin). -
- Fixes
parallel_view_processing=0
not working when inserting into a table usingVALUES
. - Fixesview_duration_ms
in thequery_views_log
not being set correctly for materialized views. #34067 (Raúl Marín).
- Fixes
- Fix asynchronous inserts with
Native
format. #34068 (Anton Popov). - Fixed minor race condition that might cause "intersecting parts" error in extremely rare cases after ZooKeeper connection loss. #34096 (Alexander Tokmakov).
- Fix possible data race in StorageFile that was introduced in https://github.com/ClickHouse/ClickHouse/pull/33960. Closes #34111. #34113 (Kruglov Pavel).
- Fix inserts to distributed tables in case of change of native protocol. The last change was in the version version 22.1, so there may be some failures of inserts to distributed tables after upgrade to that version. #34132 (Anton Popov).
- Fix bug which can rarely lead to error "Cannot read all data" while reading LowCardinality columns of MergeTree table engines family which stores data on remote file system like S3. #34139 (alesapin).
- Fix rare and benign race condition in
HDFS
,S3
andURL
storage engines which can lead to additional connections. #34172 (alesapin). - Fix schema inference for table runction s3. #34186 (Kruglov Pavel).
- Fix metric
Query
, which shows number of executing queries. In last several releases it was always 0. #34224 (Anton Popov). - Fix reading of subcolumns with dots in their names. In particular fixed reading of
Nested
columns, if their element names contain dots (e.gNested(`keys.name` String, `keys.id` UInt64, values UInt64)
). #34228 (Anton Popov). - Fix memory leak in case of some Exception during query processing with
optimize_aggregation_in_order=1
. #34234 (Azat Khuzhin). - Fix current_user/current_address for interserver mode (Before this patch current_user/current_address will be preserved from the previous query). #34263 (Azat Khuzhin).
- Fix progress bar width. It was incorrectly rounded to integer number of characters. #34275 (Alexey Milovidov).
- Fixed a couple of extremely rare race conditions that might lead to broken state of replication queue and "intersecting parts" error. #34297 (Alexander Tokmakov).
- Fix various issues when projection is enabled by default. Each issue is described in separate commit. This is for #33678 . This fixes #34273. #34305 (Amos Bird).
- Try to fix rare bug while reading of empty arrays, which could lead to
Data compressed with different methods
error. #34327 (Anton Popov). - Fix wrong engine syntax in result of
SHOW CREATE DATABASE
query for databases with engineMemory
. This closes #34335. #34345 (Alexey Milovidov). - For SQLUserDefinedFunctions change privilege level from DATABASE to GLOBAL. Closes #34281. #34404 (Maksim Kita).
- Fix segfault in schema inference from url. Closes #34147. #34405 (Kruglov Pavel).
- Fix possible error 'Cannot convert column Function to mask' in short circuit function evaluation. Closes #34171. #34415 (Kruglov Pavel).
- Add missing lock for storage. Fixes possible race with table deletion. #34416 (Kseniia Sumarokova).
- Fix possible error 'file_size: Operation not supported'. #34479 (Kruglov Pavel).
- Fix compression support in URL engine. #34524 (Frank Chen).
- Fix comparison between integers and floats in index analysis. Previously it could lead to skipping some granules for reading by mistake. Fixes #34493. #34528 (Anton Popov).
- Fix exception
Chunk should have AggregatedChunkInfo in MergingAggregatedTransform
(in case ofoptimize_aggregation_in_order=1
anddistributed_aggregation_memory_efficient=0
). Fixes #34526. #34532 (Anton Popov). - In case of cancelation S3 and HDFS canceled only current reader, but continued to execute the initial query. Fixes #34301 Relates to #34397. #34539 (Dmitry Novik).
- Fix bug of round/roundBankers, close #33267. #34562 (李扬).
- Fixed the assertion in case of using
allow_experimental_parallel_reading_from_replicas
withmax_parallel_replicas
equals to 1. This fixes #34525. #34613 (Nikita Mikhaylov). -
- Add Debug workflow to get variables for all actions on demand - Fix lack of pr_info.number for some edge case. #34644 (Mikhail f. Shiryaev).
NO CL CATEGORY
- Reverting to previous docker images, will take a closer look at failing tests from #34373. #34413 (Mikhail f. Shiryaev).
NO CL ENTRY
- NO CL ENTRY: 'Switch gosu to su-exec'. #33563 (Anselmo D. Adams).
- NO CL ENTRY: 'Revert "Additionally check remote_fs_execute_merges_on_single_replica_time_threshold inside ReplicatedMergeTreeQueue"'. #34201 (Alexey Milovidov).
- NO CL ENTRY: 'Revert "Add func tests run with s3"'. #34211 (Alexey Milovidov).
- NO CL ENTRY: 'Revert "Add pool to WriteBufferFromS3"'. #34212 (Alexey Milovidov).
- NO CL ENTRY: 'Add support agreement page and snippets.'. #34512 (Tom Risse).
- NO CL ENTRY: 'Add Gigasheet to adopters'. #34589 (Brian Hunter).
NOT FOR CHANGELOG / INSIGNIFICANT
- Fix status of SKIPPED integration tests (was incorrectly marked as ERROR) #33162 (Azat Khuzhin).
- Client interactive suggest (extract info from CREATE queries) #33201 (Azat Khuzhin).
- Fix flushing of in-memory parts #33234 (Anton Popov).
- improvements to tests for h3kRing and h3ToChildren funcs #33311 (Bharat Nallan).
- Simplify different block structure (i.e. after ALTER) support for Buffer #33324 (Azat Khuzhin).
- Dictionary rename fix #33526 (Maksim Kita).
- RFC: Split headers, move SystemLog into module, more forward declarations #33534 (Azat Khuzhin).
- add check for h3 empty column arguments #33552 (Bharat Nallan).
- Fix testflows tests #33575 (Vitaly Baranov).
- Ignore parse failure of opentelemetry header. Another try. #33595 (Nikita Mikhaylov).
- Fix mongo no_auth compose #33634 (Ilya Yatsishin).
- AsynchronousMetrics: Ignore inaccessible sensors #33639 (Raúl Marín).
- Slightly reduce memory usage for parsing collections (by using move ctor) #33665 (Azat Khuzhin).
- Merge #33563 #33669 (Alexey Milovidov).
- Update version after release 22.1 #33673 (Mikhail f. Shiryaev).
- Fix sumIf rewrite #33677 (flynn).
- DictionarySourceCoordinator update interface #33682 (Maksim Kita).
- Fix LDAP and Kerberos config handling #33689 (Denis Glazachev).
- Add some helping comments for API endpoints #33700 (Mikhail f. Shiryaev).
- Fix hive tests #33703 (Kseniia Sumarokova).
- H3 remove functions degsToRads, radsToDegs #33707 (Maksim Kita).
- Remove unused variable #33731 (vxider).
- Add test issue_31009 #33739 (Vladimir C).
- Cleanup build: .gitignore more debian directories, libpqxx-cmake without configure_file #33742 (Ilya Yatsishin).
- Better exception text on suspicious broken parts #33743 (alesapin).
- Fix release_branches workflow for some cases #33744 (Mikhail f. Shiryaev).
- Add new team members to company page #33755 (Cody Baker).
- Remove duplicated header #33760 (vxider).
- Hotfix of missing header #33765 (Amos Bird).
- rewrite bitHammingDistance with FunctionBinaryArithmetic #33772 (flynn).
- Use tb64senc for base64Decode on aarch64 #33779 (Vladimir C).
- Support USE_* build flags in tests' tags #33780 (Vladimir C).
- Use workflow names in approve lambda #33789 (Mikhail f. Shiryaev).
- Dictionaries remove unnecessary copy of keys during read #33791 (Maksim Kita).
- Remove debug logging from TableFunctionFile #33796 (Kruglov Pavel).
- RangeHashedDictionary handle invalid intervals #33827 (Maksim Kita).
- Dictionaries added Date32 type support #33831 (Maksim Kita).
- TypeId better naming #33832 (Maksim Kita).
- FunctionsConversion fix typo #33841 (Maksim Kita).
- More cmake external modules cleanups #33842 (Azat Khuzhin).
- Remove harmful code and check what will happen #33844 (Alexander Tokmakov).
- Fix DESCRIBE TABLE query formatting #33846 (Kruglov Pavel).
- Fix build with ENABLE_EXAMPLES #33848 (Maksim Kita).
- Add Trademark Policy Page #33851 (Cody Baker).
- updates to min2 and max2 funcs #33852 (Bharat Nallan).
- Use correct logging level #33857 (李扬).
- Fix zookeeper library dependency from interpreters (by marking library STATIC) #33860 (Azat Khuzhin).
- FunctionBase64Conversion warning fix #33863 (Maksim Kita).
- Dictionary ATTACH, DETACH added test #33870 (Maksim Kita).
- Fix perf comparison rerun #33872 (alesapin).
- Improve postgresql integration test #33880 (Ilya Yatsishin).
- Fix cmake for mac. #33882 (Nikolai Kochetov).
- SQLUserDefinedFunctions invalid lambda additional fixes #33889 (Maksim Kita).
- Update upcoming and past webinar links on homepage #33890 (Cody Baker).
- disable animation on docs menu #33903 (SuperDJY).
- Add more retries in CI for AWS "spot" instances #33907 (Alexey Milovidov).
- FunctionMathUnary remove macro usage #33916 (Maksim Kita).
- explicitly checkAndGetColumn for remaining H3 funcs #33921 (Bharat Nallan).
- SQLUserDefinedFunctions invalid lambda additional cases #33924 (Maksim Kita).
- when not DEBUG set USE_DEBUG_HELPERS OFF #33925 (Ben).
- Fix test_replica_is_active flaky test #33926 (alesapin).
- Fix bug in keeper which can lead to inconsistent snapshots #33941 (alesapin).
- Fix keeper data dumper build #33942 (alesapin).
- Remove MAKE_STATIC_LIBRARIES (in favor of USE_STATIC_LIBRARIES) #33946 (Azat Khuzhin).
- Revert glibc compatibility (via .symver) in favor of hermetic build (bundled libc) #33950 (Azat Khuzhin).
- add c++expr script for C++ one-liners #33962 (Sergei Trifonov).
- docker: fix root squashed data dirs #33963 (Constantine Peresypkin).
- Disable parallel run for 00985_merge_stack_overflow #33976 (Azat Khuzhin).
- Cancel lambda #33990 (Mikhail f. Shiryaev).
- reduce signal_pipe_buf_size #33996 (save-my-heart).
- make systemd to use EnvironmentFile #34024 (Denny Crane).
- CurrentlyExecuting: Require mutex usage explicitly #34034 (Raúl Marín).
- Add symlinks to keeper #34042 (Alexey Milovidov).
- Remove DecimalPaddedPODArray #34052 (Maksim Kita).
- Less flaky test_inconsistent_parts_if_drop_while_replica_not_active #34057 (Raúl Marín).
- Small test for
FINAL
#34058 (Filatenkov Artur). - Slightly optimize ColumnArray::get()/operator[] (by using reserve over resize) #34074 (Azat Khuzhin).
- Tiny cleanup of AggregateFunctionSimpleState/AggregateFunctionState #34075 (Azat Khuzhin).
- Fix builds #34090 (Alexander Tokmakov).
- add c++expr script examples #34112 (Sergei Trifonov).
- Make clickhouse-diagnostics also work for altinity release #34116 (Ramazan Polat).
- Small improvement in schema inference from stdin in local #34117 (Kruglov Pavel).
- Slightly optimize Array/Tuple/Map #34126 (Azat Khuzhin).
- Sort block refactoring #34143 (Maksim Kita).
- pdqsort performance check #34145 (Maksim Kita).
- Revert #33957 #34146 (Alexey Milovidov).
- Add func tests run with s3 #34153 (alesapin).
- Close #10197 #34159 (Alexey Milovidov).
- Cmake leftovers cleanup #34167 (Azat Khuzhin).
- bitsetsort peformance check #34175 (Maksim Kita).
- Add authorisation for dockerhub proxy container #34183 (Mikhail f. Shiryaev).
- Additionally check remote_fs_execute_merges_on_single_replica_time_threshold inside ReplicatedMergeTreeQueue #34189 (Nikolai Kochetov).
- Fix some perf tests #34191 (Kruglov Pavel).
- Clean up: insert_deduplication_token setting for INSERT statement #34192 (Igor Nikonov).
- Add func tests run with s3 and fix several bugs #34215 (alesapin).
- Revert "Revert "Add pool to WriteBufferFromS3"" #34219 (Nikolai Kochetov).
- Revert "Revert "Additionally check remote_fs_execute_merges_on_single_replica_time_threshold inside ReplicatedMergeTreeQueue"" #34221 (Nikolai Kochetov).
- Add const to make clang-tidy happy #34222 (Vitaly Baranov).
- Bump fmtlib from 7.0.0 to 8.1.1 #34223 (Azat Khuzhin).
- Add submodule minizip #34226 (Vitaly Baranov).
- Update list-versions.sh, update version_date.tsv #34240 (Mikhail f. Shiryaev).
- Add missing fmt::runtime() in MergeTreeBackgroundExecutor (fixes the build) #34245 (Azat Khuzhin).
- Update clickhouse-keeper.md #34264 (Andrew).
- print query id when using
--interactive
with--queries-file
in client/local #34265 (Kseniia Sumarokova). - Update and add new team members #34268 (Cody Baker).
- Add a test for shebang #34274 (Alexey Milovidov).
- Fix fractional_progress_bar test #34282 (Maksim Kita).
- Minor fixes for #34267 #34284 (Anton Popov).
- Add support policy page content. #34309 (Tom Risse).
- Probably fix data race in WriteBufferFromS3 destructor. #34316 (Nikolai Kochetov).
- Decrease severity for "Reading ... ranges ..." log message to Trace #34319 (Azat Khuzhin).
- use LowCardinality type for _file and _path in some Storages, continue of #34317 #34333 (flynn).
- Function mapPopulateSeries added additional performance test #34339 (Maksim Kita).
- Add test for propagating OpenTelemetry context via gRPC protocol #34341 (Vitaly Baranov).
- explicitly check and get columns for s2 funcs #34344 (Bharat Nallan).
- Small improvements #34351 (Alexey Milovidov).
- Fix USE database for clickhouse-local #34357 (Kseniia Sumarokova).
- Fix clang-tidy issue #34365 (Heena Bansal).
- Delete empty file DateOrDateTimeFunctionsConvertion.cpp #34371 (Kruglov Pavel).
- Fix consecutive backward seeks in seekable read buffers #34376 (Anton Popov).
- Enable one more check for clang-tidy #34388 (Heena Bansal).
- Method called on already moved #34398 (Rajkumar Varada).
- Fix wrong destruction order in CreatingSetsTransform. #34406 (Nikolai Kochetov).
- Split and rename compression fields in gRPC #34408 (Vitaly Baranov).
- Fixing test_storage_postgresql #34410 (Kseniia Sumarokova).
- asynchronous_inserts engine AsynchronousInserts -> SystemAsynchronousInserts #34429 (filimonov).
- clang-tidy move fix build #34431 (Maksim Kita).
static-files-disk-uploader
: add a mode to create symlinks #34432 (Alexey Milovidov).- Fix bug in URL engine #34448 (Kruglov Pavel).
- Fix style #34450 (alesapin).
- Added test 33734 #34454 (Maksim Kita).
- Update http_max_tries setting default #34457 (Kseniia Sumarokova).
- Use
cpp_bin_float_double
inset_multiplier
forwide_integer_from_builtin
for aarch64 #34463 (Vladimir C). - test for #13907 toColumnTypeName_toLowCardinality_const #34471 (Denny Crane).
- Remove invalid IOS setting for RocksDB CMAKE to fix Apple M1 build #34472 (Geoff Genz).
- clang-tidy reported potential chance for divide by zero exception #34473 (Rajkumar Varada).
- accessing nested_column after already moved to data #34475 (Rajkumar Varada).
- Avoid unnecessary copying of
Settings
#34476 (Anton Popov). - Update buildPushingToViewsChain.h #34515 (William.Walliams.Wong).
- More gdb introspection on CI #34517 (Azat Khuzhin).
- add BeforeLambdaBody to .clang-format #34533 (Vladimir C).
- Remove very old cruft #34547 (Alexey Milovidov).
- Tiny fixes for client/local suggestions #34550 (Kseniia Sumarokova).
- Fix gtest_archive_reader_and_writer in case of !USE_MINIZIP #34554 (Azat Khuzhin).
- TableFunctionFile added performance test #34555 (Maksim Kita).
- check and get columns in geoToH3 func #34557 (Bharat Nallan).
- try fix data race in StorageLog #34558 (flynn).
- Postpone a bit nightly builds to the least loaded time #34569 (Mikhail f. Shiryaev).
- Always remove unused actions from addMissingDefaults #34577 (Nikolai Kochetov).
- Fix indentation in ARRAY JOIN formatting #34578 (Azat Khuzhin).
- Fix deadlock in OvercommitTracker #34591 (Dmitry Novik).
- ASTCreateQuery: Remove usused
tables
member #34610 (Raúl Marín). - Add test for #19222 #34615 (Raúl Marín).
- Attempt to fix freeBSD build #34617 (Raúl Marín).
- Fix quadratic complexity while adding subcolumns #34623 (Anton Popov).
- Fix typo in welchttest.md #34634 (achimbab).
- Improve the release.py script #34659 (Mikhail f. Shiryaev).
- Disable memory overcommit if timeout is not set #34663 (Dmitry Novik).