mirror of
https://github.com/ClickHouse/ClickHouse.git
synced 2024-12-13 01:41:59 +00:00
99 KiB
99 KiB
sidebar_position | sidebar_label |
---|---|
1 | 2024 |
2024 Changelog
ClickHouse release v24.7.1.2915-stable (a37d2d43da
) FIXME as compared to v24.7.1.1-new (aa023477a9
)
Backward Incompatible Change
- Change binary serialization of Variant data type: add
compact
mode to avoid writing the same discriminator multiple times for granules with single variant or with only NULL values. Add MergeTree settinguse_compact_variant_discriminators_serialization
that is enabled by default. Note that Variant type is still experimental and backward-incompatible change in serialization is ok. #62774 (Kruglov Pavel). - Forbid
CREATE MATERIALIZED VIEW ... ENGINE Replicated*MergeTree POPULATE AS SELECT ...
with Replicated databases. #63963 (vdimir). clickhouse-keeper-client
will only accept paths in string literals, such asls '/hello/world'
, not bare strings such asls /hello/world
. #65494 (Alexey Milovidov).- Metric
KeeperOutstandingRequets
was renamed toKeeperOutstandingRequests
. This fixes a typo reported in #66179. #66206 (Robert Schulze). - Remove
is_deterministic
field from thesystem.functions
table. #66630 (Alexey Milovidov).
New Feature
- Extend function
tuple
to construct named tuples in query. Introduce functiontupleNames
to extract names from tuples. #54881 (Amos Bird). ASOF JOIN
support forfull_sorting_join
algorithm Close #54493. #55051 (vdimir).- A new table function,
fuzzQuery,
was added. This function allows you to modify a given query string with random variations. Example:SELECT query FROM fuzzQuery('SELECT 1');
. #62103 (pufit). - Add new window function
percent_rank
. #62747 (lgbo). - Support JWT authentication in
clickhouse-client
. #62829 (Konstantin Bogdanov). - Add SQL functions
changeYear
,changeMonth
,changeDay
,changeHour
,changeMinute
,changeSecond
. For example,SELECT changeMonth(toDate('2024-06-14'), 7)
returns date2024-07-14
. #63186 (cucumber95). - Introduce startup scripts, which allow the execution of preconfigured queries at the startup stage. #64889 (pufit).
- Support accept_invalid_certificate in client's config in order to allow for client to connect over secure TCP to a server running with self-signed certificate - can be used as a shorthand for corresponding
openSSL
client settingsverificationMode=none
+invalidCertificateHandler.name=AcceptCertificateHandler
. #65238 (peacewalker122). - Add system.error_log which contains history of error values from table system.errors, periodically flushed to disk. #65381 (Pablo Marcos).
- Add aggregate function
groupConcat
. About the same asarrayStringConcat( groupArray(column), ',')
Can receive 2 parameters: a string delimiter and the number of elements to be processed. #65451 (Yarik Briukhovetskyi). - Add AzureQueue storage. #65458 (Kseniia Sumarokova).
- Add a new setting to disable/enable writing page index into parquet files. #65475 (lgbo).
- Allow system administrators to configure
logger.console_log_level
. #65559 (Azat Khuzhin). - Automatically append a wildcard
*
to the end of a directory path with table functionfile
. #66019 (Zhidong (David) Guo). - Add
--memory-usage
option to client in non interactive mode. #66393 (vdimir).
Performance Improvement
- Enable
optimize_functions_to_subcolumns
by default. #58661 (Anton Popov). - Replace int to string algorithm with a faster one (from a modified amdn/itoa to a modified jeaiii/itoa). #61661 (Raúl Marín).
- Sizes of hash tables created by join (
parallel_hash
algorithm) is collected and cached now. This information will be used to preallocate space in hash tables for subsequent query executions and save time on hash table resizes. #64553 (Nikita Taranov). - Optimized queries with
ORDER BY
primary key andWHERE
that have a condition with high selectivity by using of buffering. It is controlled by settingread_in_order_use_buffering
(enabled by default) and can increase memory usage of query. #64607 (Anton Popov). - Improve performance of loading
plain_rewritable
metadata. #65634 (Alexey Milovidov). - Attaching tables on read-only disks will use fewer resources by not loading outdated parts. #65635 (Alexey Milovidov).
- Support minmax hyperrectangle for Set indices. #65676 (AntiTopQuark).
- Unload primary index of outdated parts to reduce total memory usage. #65852 (Anton Popov).
- Functions
replaceRegexpAll
andreplaceRegexpOne
are now significantly faster if the pattern is trivial, i.e. contains no metacharacters, pattern classes, flags, grouping characters etc. (Thanks to Taiyang Li). #66185 (Robert Schulze).
Improvement
- Support rocksdb as backend storage of keeper. #56626 (Han Fei).
- The setting
optimize_trivial_insert_select
is disabled by default. In most cases, it should be beneficial. Nevertheless, if you are seeing slower INSERT SELECT or increased memory usage, you can enable it back orSET compatibility = '24.6'
. #58970 (Alexey Milovidov). - Print stacktrace and diagnostic info if
clickhouse-client
orclickhouse-local
crashes. #61109 (Alexander Tokmakov). - The result of
SHOW INDEX | INDEXES | INDICES | KEYS
was previously sorted by the primary key column names. Since this was unintuitive, the result is now sorted by the position of the primary key columns within the primary key. #61131 (Robert Schulze). - This PR changes how deduplication for MV works. Fixed a lot of cases like: - on destination table: data is split for 2 or more blocks and that blocks is considered as duplicate when that block is inserted in parallel. - on MV destination table: the equal blocks are deduplicated, that happens when MV often produces equal data as a result for different input data due to performing aggregation. - on MV destination table: the equal blocks which comes from different MV are deduplicated. #61601 (Sema Checherinda).
- Allow matching column names in a case insensitive manner when reading json files (
input_format_json_case_insensitive_column_matching
). #61750 (kevinyhzou). - Support reading partitioned data DeltaLake data. Infer DeltaLake schema by reading metadata instead of data. #63201 (Kseniia Sumarokova).
- In composable protocols TLS layer accepted only
certificateFile
andprivateKeyFile
parameters. https://clickhouse.com/docs/en/operations/settings/composable-protocols. #63985 (Anton Ivashkin). - Make an interactive client for clickhouse-disks, add local disk from the local directory. Fixes #56791. #64446 (Daniil Ivanik).
- Added profile event
SelectQueriesWithPrimaryKeyUsage
which indicates how many SELECT queries use the primary key to evaluate the WHERE clause. #64492 (0x01f). StorageS3Queue
related fixes and improvements. Deduce a default value ofs3queue_processing_threads_num
according to the number of physical cpu cores on the server (instead of the previous default value as 1). Set default value ofs3queue_loading_retries
to 10. Fix possible vague "Uncaught exception" in exception column ofsystem.s3queue
. Do not increment retry count onMEMORY_LIMIT_EXCEEDED
exception. Move files commit to a stage after insertion into table fully finished to avoid files being commited while not inserted. Add settingss3queue_max_processed_files_before_commit
,s3queue_max_processed_rows_before_commit
,s3queue_max_processed_bytes_before_commit
,s3queue_max_processing_time_sec_before_commit
, to better control commit and flush time. #65046 (Kseniia Sumarokova).- Fixed broken multiple columns aggregation on s390x. #65062 (Harry Lee).
- Support aliases in parametrized view function (only new analyzer). #65190 (Kseniia Sumarokova).
- S3. reduce retires time for queries, increase retries count for backups. 8.5 minutes and 100 retires for queries, 1.2 hours and 1000 retries for backup restore. #65232 (Sema Checherinda).
- Updated to mask account key in logs in azureBlobStorage. #65273 (SmitaRKulkarni).
- Partition pruning for
IN
predicates when filter expression is a part ofPARTITION BY
expression. #65335 (Eduard Karacharov). - Add system tables with main information about all detached tables. #65400 (Konstantin Morozov).
- Add support for
cluster_for_parallel_replicas
when using custom key parallel replicas. It allows you to use parallel replicas with custom key with MergeTree tables. #65453 (Antonio Andelic). - Support query plan LIMIT optimization. Support LIMIT pushdown for PostgreSQL storage and table function. #65454 (Maksim Kita).
- Arraymin/max can be applicable to all data types that are comparable. #65455 (pn).
- Improved memory accounting for cgroups v2 to exclude the amount occupied by the page cache. #65470 (Nikita Taranov).
- Do not create format settings for each rows when serializing chunks to insert to EmbeddedRocksDB table. #65474 (Duc Canh Le).
- Fixed out-of-range exception in parsing Dwarf5 on s390x. #65501 (Harry Lee).
- Reduce
clickhouse-local
prompt to just:)
.getFQDNOrHostName()
takes too long on macOS, and we don't want a hostname in the prompt forclickhouse-local
anyway. #65510 (Konstantin Bogdanov). - Avoid printing a message from jemalloc about per-CPU arenas on low-end virtual machines. #65532 (Alexey Milovidov).
- Disable filesystem cache background download by default. It will be enabled back when we fix the issue with possible "Memory limit exceeded" because memory deallocation is done outside of query context (while buffer is allocated inside of query context) if we use background download threads. Plus we need to add a separate setting to define max size to download for background workers (currently it is limited by max_file_segment_size, which might be too big). #65534 (Kseniia Sumarokova).
- Add new option to config
<config_reload_interval_ms>
which allow to specify how often clickhouse will reload config. #65545 (alesapin). - Implement binary encoding for ClickHouse data types and add its specification in docs. Use it in Dynamic binary serialization, allow to use it in RowBinaryWithNamesAndTypes and Native formats under settings. #65546 (Kruglov Pavel).
- Improved ZooKeeper load balancing. The current session doesn't expire until the optimal nodes become available despite
fallback_session_lifetime
. Added support for AZ-aware balancing. #65570 (Alexander Tokmakov). - Server settings
compiled_expression_cache_size
andcompiled_expression_cache_elements_size
are now shown insystem.server_settings
. #65584 (Robert Schulze). - When lightweight delete happens on a table with projection(s), users have choices either throw an exception (by default) or drop the projection lightweight delete would happen. #65594 (jsc0218).
- Add support for user identification based on x509 SubjectAltName extension. #65626 (Anton Kozlov).
clickhouse-local
will respect themax_server_memory_usage
andmax_server_memory_usage_to_ram_ratio
from the configuration file. It will also set the max memory usage to 90% of the system memory by default, likeclickhouse-server
does. This closes #65695. #65697 (Alexey Milovidov).- Add a script to backup your files to ClickHouse. This is strange, but works. #65699 (Alexey Milovidov).
- PostgreSQL source support cancel. #65722 (Maksim Kita).
- Make allow_experimental_analyzer be controlled by the initiator for distributed queries. This ensures compatibility and correctness during operations in mixed version clusters. #65777 (Nikita Mikhaylov).
- Respect cgroup CPU limit in Keeper. #65819 (Antonio Andelic).
- Allow to use
concat
function with empty arguments ``` sql :) select concat();. #65887 (李扬). - Allow controlling named collections in clickhouse-local. #65973 (Alexey Milovidov).
- Improve Azure profile events. #65999 (alesapin).
Query was cancelled
might have been printed twice in clickhouse-client. This behaviour is fixed. #66005 (Nikita Mikhaylov).- Support ORC file read by writer time zone. #66025 (kevinyhzou).
- Refactor JSONExtract functions, support more types including experimental Dynamic type. #66046 (Kruglov Pavel).
- DatabaseCatalog drops tables faster by using up to database_catalog_drop_table_concurrency threads. #66065 (Sema Checherinda).
- This PR changes how deduplication for MV works. Fixed a lot of cases like: - on destination table: data is split for 2 or more blocks and that blocks is considered as duplicate when that block is inserted in parallel. - on MV destination table: the equal blocks are deduplicated, that happens when MV often produces equal data as a result for different input data due to performing aggregation. - on MV destination table: the equal blocks which comes from different MV are deduplicated. #66144 (Sema Checherinda).
- Support null map subcolumn for Variant and Dynamic subcolumns. #66178 (Kruglov Pavel).
- Add settings to control connection to the PostgreSQL. * Setting
postgresql_connection_attempt_timeout
specifies the value passed toconnect_timeout
parameter of connection URL. * Settingpostgresql_connection_pool_retries
specifies the number of retries to establish a connection to the PostgreSQL end-point. #66232 (Dmitry Novik). - Reduce inaccuracy of input_wait_elapsed_us/input_wait_elapsed_us/elapsed_us. #66239 (Azat Khuzhin).
- Improve FilesystemCache ProfileEvents. #66249 (zhukai).
- Add settings to ignore ON CLUSTER clause in queries for named collection management with replicated storage. #66288 (MikhailBurdukov).
- Upgraded
pocketfft
dependency to the recent commitf4c1aa8aa9
. #66291 (Nikita Mikhaylov). - Upgraded
azure-sdk-for-cpp
to the recent commitea3e19a7be
. #66292 (Nikita Mikhaylov). - Function
generateSnowflakeID
now allows to specify a machine ID as a parameter to prevent collisions in large clusters. #66374 (ZAWA_ll). - Disable suspending on Ctrl+Z in interactive mode. This is a common trap and is not expected behavior for almost all users. I imagine only a few extreme power users could appreciate suspending terminal applications to the background, but I don't know any. #66511 (Alexey Milovidov).
- Add option for validating the Primary key type in Dictionaries. Without this option for simple layouts any column type will be implicitly converted to UInt64. ### Documentation entry for user-facing changes. #66595 (MikhailBurdukov).
- Fix SHOW MERGES remaining time. #66735 (Alexey Milovidov).
Critical Bug Fix (crash, LOGICAL_ERROR, data loss, RBAC)
- Fix unexpeced size of low cardinality column in function calls. #65298 (Raúl Marín).
- Check cyclic dependencies on CREATE/REPLACE/RENAME/EXCHANGE queries and throw an exception if there is a cyclic dependency. Previously such cyclic dependencies could lead to a deadlock during server startup. Closes #65355. Also fix some bugs in dependencies creation. #65405 (Kruglov Pavel).
- Fix crash in maxIntersections. #65689 (Raúl Marín).
- Fix the VALID UNTIL clause in the user definition resetting after a restart. Closes #66405. #66409 (Nikolay Degterinsky).
Bug Fix (user-visible misbehavior in an official stable release)
- Fixed crash while using MaterializedMySQL with TABLE OVERRIDE that maps MySQL NULL field into ClickHouse not NULL field. #54649 (Filipp Ozinov).
- Fix logical error when PREWHERE expression read no columns and table has no adaptive index granularity (very old table). Fix #56640. #59173 (Alexander Gololobov).
- Fix bug with cancelation buffer when canceling a query. #64478 (Sema Checherinda).
- Fix filling parts columns from metadata (when columns.txt does not exists). #64757 (Azat Khuzhin).
- Fix AST formatting of 'create table b empty as a'. #64951 (Michael Kolupaev).
- Fix crash for
ALTER TABLE ... ON CLUSTER ... MODIFY SQL SECURITY
. #64957 (pufit). - Fix crash on destroying AccessControl: add explicit shutdown. #64993 (Vitaly Baranov).
- Eliminate injective function in argument of functions
uniq*
recursively. This used to work correctly but was broken in the new analyzer. #65140 (Duc Canh Le). - Fix unexpected projection name when query with CTE. #65267 (wudidapaopao).
- Require
dictGet
privilege when accessing dictionaries via direct query or theDictionary
table engine. #65359 (Joe Lynch). - Fix user-specific S3 auth with incremental backups. #65481 (Antonio Andelic).
- Disable
non-intersecting-parts
optimization for queries withFINAL
in case ofread-in-order
optimization was enabled. This could lead to an incorrect query result. As a workaround, disabledo_not_merge_across_partitions_select_final
andsplit_parts_ranges_into_intersecting_and_non_intersecting_final
before this fix is merged. #65505 (Nikolai Kochetov). - Fix getting exception
Index out of bound for blob metadata
in case all files from list batch were filtered out. #65523 (Kseniia Sumarokova). - Fix NOT_FOUND_COLUMN_IN_BLOCK for deduplicate merge of projection. #65573 (Yakov Olkhovskiy).
- Fixed bug in MergeJoin. Column in sparse serialisation might be treated as a column of its nested type though the required conversion wasn't performed. #65632 (Nikita Taranov).
- Fixed a bug that compatibility level '23.4' was not properly applied. #65737 (cw5121).
- Fix odbc table with nullable fields. #65738 (Rodolphe Dugé de Bernonville).
- Fix data race in
TCPHandler
, which could happen on fatal error. #65744 (Kseniia Sumarokova). - Fix invalid exceptions in function
parseDateTime
with%F
and%D
placeholders. #65768 (Antonio Andelic). - For queries that read from
PostgreSQL
, cancel the internalPostgreSQL
query if the ClickHouse query is finished. Otherwise,ClickHouse
query cannot be canceled until the internalPostgreSQL
query is finished. #65771 (Maksim Kita). - Fix a bug in short circuit logic when old analyzer and dictGetOrDefault is used. #65802 (jsc0218).
- Fix a bug leads to EmbeddedRocksDB with TTL write corrupted SST files. #65816 (Duc Canh Le).
- Functions
bitTest
,bitTestAll
, andbitTestAny
now return an error if the specified bit index is out-of-bounds (issue #65517). #65818 (Pablo Marcos). - Setting
join_any_take_last_row
is supported in any query with hash join. #65820 (vdimir). - Better handling of join conditions involving
IS NULL
checks (for exampleON (a = b AND (a IS NOT NULL) AND (b IS NOT NULL) ) OR ( (a IS NULL) AND (b IS NULL) )
is rewritten toON a <=> b
), fix incorrect optimization when condition other thenIS NULL
are present. #65835 (vdimir). - Functions
bitShiftLeft
andbitShitfRight
return an error for out of bounds shift positions (issue #65516). #65838 (Pablo Marcos). - Fix growing memory usage in S3Queue. #65839 (Kseniia Sumarokova).
- Fix tie handling in
arrayAUC
to match sklearn. #65840 (gabrielmcg44). - Fix possible issues with MySQL server protocol TLS connections. #65917 (Azat Khuzhin).
- Fix possible issues with MySQL client protocol TLS connections. #65938 (Azat Khuzhin).
- Fix handling of
SSL_ERROR_WANT_READ
/SSL_ERROR_WANT_WRITE
with zero timeout. #65941 (Azat Khuzhin). - Add missing settings
input_format_csv_skip_first_lines/input_format_tsv_skip_first_lines/input_format_csv_try_infer_numbers_from_strings/input_format_csv_try_infer_strings_from_quoted_tuples
in schema inference cache because they can change the resulting schema. It prevents from incorrect result of schema inference with these settings changed. #65980 (Kruglov Pavel). - Column _size in s3 engine and s3 table function denotes the size of a file inside the archive, not a size of the archive itself. #65993 (Daniil Ivanik).
- Fix resolving dynamic subcolumns in analyzer, avoid reading the whole column on dynamic subcolumn reading. #66004 (Kruglov Pavel).
- Fix config merging for from_env with replace overrides. #66034 (Azat Khuzhin).
- Fix a possible hanging in
GRPCServer
during shutdown. This PR fixes #65622. #66061 (Vitaly Baranov). - Fix reading dynamic subcolumns from altered Memory table. Previously if
max_types
peremeter of a Dynamic type was changed in Memory table via alter, further subcolumns reading can return wrong result. #66066 (Kruglov Pavel). - Fixed several cases in function
has
with non-constantLowCardinality
arguments. #66088 (Anton Popov). - Fix for
groupArrayIntersect
. It had incorrect behavior in themerge()
function. Also, fixed behavior indeserialise()
for numeric and general data. #66103 (Yarik Briukhovetskyi). - Fixed buffer overflow bug in
unbin
/unhex
implementation. #66106 (Nikita Taranov). - Disable the
merge-filters
optimization introduced in #64760. It may cause an exception if optimization merges two filter expressions and does not apply a short-circuit evaluation. #66126 (Nikolai Kochetov). - Fixed the issue when the server failed to parse Avro files with negative block size arrays encoded, which is now allowed by the Avro specification. #66130 (Serge Klochkov).
- Fixed a bug in ZooKeeper client: a session could get stuck in unusable state after receiving a hardware error from ZooKeeper. For example, this might happen due to "soft memory limit" in ClickHouse Keeper. #66140 (Alexander Tokmakov).
- Fix issue in SumIfToCountIfVisitor and signed integers. #66146 (Raúl Marín).
- Fix rare case with missing data in the result of distributed query, close #61432. #66174 (vdimir).
- Fix order of parsing metadata fields in StorageDeltaLake. #66211 (Kseniia Sumarokova).
- Don't throw
TIMEOUT_EXCEEDED
fornone_only_active
mode ofdistributed_ddl_output_mode
. #66218 (Alexander Tokmakov). - Fix handling limit for
system.numbers_mt
when no index can be used. #66231 (János Benjamin Antal). - Fixed how the ClickHouse server detects the maximum number of usable CPU cores as specified by cgroups v2 if the server runs in a container such as Docker. In more detail, containers often run their process in the root cgroup which has an empty name. In that case, ClickHouse ignored the CPU limits set by cgroups v2. #66237 (filimonov).
- Fix the
Not-ready set
error when a subquery withIN
is used in the constraint. #66261 (Nikolai Kochetov). - Fix indexHint function case found by fuzzer. #66286 (Anton Popov).
- Fix error reporting while copying to S3 or AzureBlobStorage. #66295 (Vitaly Baranov).
- Prevent watchdog from keeping descriptors of unlinked(rotated) log files. #66334 (Aleksei Filatov).
- Fix the bug that logicalexpressionoptimizerpass lost logical type of constant. closes #64487. #66344 (pn).
- Fix
Column identifier is already registered
error withgroup_by_use_nulls=true
and new analyzer. #66400 (Nikolai Kochetov). - Fix possible incorrect result for queries joining and filtering table external engine (like PostgreSQL), due to too aggressive filter pushdown. Since now, conditions from where section won't be send to external database in case of outer join with external table. #66402 (vdimir).
- Added missing column materialization for cross join. #66413 (lgbo).
- Fix
Cannot find column
error for queries with constant expression inGROUP BY
key and new analyzer enabled. #66433 (Nikolai Kochetov). - Avoid possible logical error during import from Npy format in case of bad array nesting level, fix testing of other kinds of errors. #66461 (Yarik Briukhovetskyi).
- Fix wrong count() result when there is non-deterministic function in predicate. #66510 (Duc Canh Le).
- Correctly track memory for
Allocator::realloc
. #66548 (Antonio Andelic). - Fix reading of uninitialized memory when hashing empty tuples. This closes #66559. #66562 (Alexey Milovidov).
- Fix an invalid result for queries with
WINDOW
. This could happen whenPARTITION
columns have sparse serialization and window functions are executed in parallel. #66579 (Nikolai Kochetov). - Fix removing named collections in local storage. #66599 (János Benjamin Antal).
- Fix logical error in
PrometheusRequestHandler
. #66621 (Vitaly Baranov). column_length
is not updated inColumnTuple::insertManyFrom
. #66626 (lgbo).- Fix
Unknown identifier
andColumn is not under aggregate function
errors for queries with the expression(column IS NULL).
The bug was triggered by #65088, with the disabled analyzer only. #66654 (Nikolai Kochetov). - Fix
Method getResultType is not supported for QUERY query node
error when scalar subquery was used as the first argument of IN (with new analyzer). #66655 (Nikolai Kochetov). - Fix possible PARAMETER_OUT_OF_BOUND error during reading variant subcolumn. #66659 (Kruglov Pavel).
- Fix rare case of stuck merge after drop column. #66707 (Raúl Marín).
- Fix assertion
isUniqTypes
when insert select from remote sources. #66722 (Sema Checherinda). - Backported in #67026: In rare cases ClickHouse could consider parts as broken because of some unexpected projections on disk. Now it's fixed. #66898 (alesapin).
- Backported in #67443: Forbid create as select even when database_replicated_allow_heavy_create is set. It was unconditionally forbidden in 23.12 and accidentally allowed under the setting in unreleased 24.7. #66980 (vdimir).
- Backported in #67201: TRUNCATE DATABASE used to stop replication as if it was a DROP DATABASE query, it's fixed. #67129 (Alexander Tokmakov).
- Backported in #67383: Fix error
Cannot convert column because it is non constant in source stream but must be constant in result.
for a query that reads from theMerge
table over theDistriburted
table with one shard. #67146 (Nikolai Kochetov). - Backported in #67246: This closes #67156. This closes #66447. The bug was introduced in https://github.com/ClickHouse/ClickHouse/pull/62907. #67178 (Maksim Kita).
Build/Testing/Packaging Improvement
- Instantiate template methods ahead in different .cpp files, avoid too large translation units during compiling. #64818 (lgbo).
- Stateless tests: Improve tests speed and decrease number of parallel jobs. #65186 (Nikita Fomichev).
- Add tests for
base64URLEncode
andbase64URLDecode
. Add analyzer tests. #65979 (Nikita Fomichev). - Fix problem when github terminate instances by timeout and artifacts are not collected and full test report is not generated. #66036 (Nikita Fomichev).
- Fix test test_grpc_protocol/test.py::test_progress. #66063 (Vitaly Baranov).
- Stateless tests: Improve tests speed and decrease number of parallel jobs. #66305 (Nikita Fomichev).
- Stateless tests: Improve tests speed and decrease number of parallel jobs 3. #66363 (Nikita Fomichev).
- Tests: fix tests hang up in cases when gdb catches error. #66411 (Nikita Fomichev).
- ... since Release v24.6.1.4423-stable when build in ppc64le with dynamic openssl build (
cmake -DENABLE_OPENSSL_DYNAMIC=1 -DCMAKE_TOOLCHAIN_FILE= cmake/linux/toolchain-ppc64le.cmake
) got error:ld.lld: error: duplicate symbol: OPENSSL_cleanse
. #66733 (Yong Wang).
NO CL CATEGORY
NO CL ENTRY
- NO CL ENTRY: 'Revert "Revert "Small fix for 02340_parts_refcnt_mergetree""'. #65155 (Nikita Taranov).
- NO CL ENTRY: 'Revert "Use 1MB HTTP buffers to avoid frequent send syscalls"'. #65498 (Sergei Trifonov).
- NO CL ENTRY: 'Revert "Resubmit http_external_tables_memory_tracking test"'. #65500 (Nikita Taranov).
- NO CL ENTRY: 'Revert "Add an assertion in ReplicatedMergeTreeQueue"'. #65686 (Raúl Marín).
- NO CL ENTRY: 'Revert "insertion deduplication on retries for materialised views"'. #66134 (Sema Checherinda).
NOT FOR CHANGELOG / INSIGNIFICANT
- Return and fix 01600_parts_states_metrics_long test. #58748 (Yakov Olkhovskiy).
- Add azure_cache as storage policy to tests. #59943 (SmitaRKulkarni).
- Minor: replaced expression with LEGACY_MAX_LEVEL. #61268 (Vasily Nemkov).
- Make write to temporary data in cache do all checks and assertions as during write to ordinary cache. #63348 (Kseniia Sumarokova).
- Refactoring near azure blob storage. #63636 (Anton Popov).
- Everything should work with Analyzer. #63643 (Alexey Milovidov).
- add some log for non using detached tables. #64992 (Konstantin Morozov).
- Remove dag flags. #65234 (Nikolai Kochetov).
- Fix flaky autocompletion test. #65246 (Konstantin Bogdanov).
- Disable userspace page cache by default. #65305 (Michael Kolupaev).
- Update version_date.tsv and changelogs after v24.4.3.25-stable. #65308 (robot-clickhouse).
- Do not raise a NOT_IMPLEMENTED error when getting s3 metrics with a multiple disk configuration. #65403 (Elena Torró).
- Dodging reading from wrong table with parallel replicas. #65417 (Nikita Taranov).
- Fix: return error if can't connect to any replicas chosen for query execution. #65467 (Igor Nikonov).
- Fix
AzureObjectStorage::exists
method. #65471 (Anton Popov). - Update version after release. #65483 (Raúl Marín).
- Generate 24.6 changelog. #65485 (Raúl Marín).
- Fix of
PlanSquashingTransform
: pipeline stuck. #65487 (Yarik Briukhovetskyi). - Fix bad test
02922_deduplication_with_zero_copy
. #65492 (Alexey Milovidov). - Disable clang-format in special areas. #65495 (Nikita Taranov).
- Fix
test_keeper_snapshots
. #65497 (Antonio Andelic). - Update to libunwind 8.1.7. #65509 (Michael Kolupaev).
- Setting
uniform_snowflake_conversion_functions
(not in any release yet) was replaced by settingallow_deprecated_snowflake_conversion_functions
. The latter controls if the legacy snowflake conversion functions are available (by default, they are not). #65522 (Robert Schulze). - Try CI without RerunCheck, jobs can be easily rerun manually though extra amount of work in CI will follow on workflow restart. #65524 (Max K.).
- Bump re2 to latest HEAD. #65526 (Robert Schulze).
- OpenSSL: Replace temporary fix for unsynchronized access by official fix. #65529 (Robert Schulze).
- Update README.md. #65531 (Tyler Hannan).
- CI: some time there are timeouts on DROP TABLES for random tests. #65535 (Sema Checherinda).
- Synchronize
MARK_CACHE_SIZE
value in default settings and config. #65547 (Denny Crane). - CI: Skip removed test files in stateless flaky check job. #65553 (Max K.).
- Renames Build report jobs. #65554 (Max K.).
- Parse user from URL for dashboard.html (useful for sharing). #65556 (Azat Khuzhin).
- Remove tech debt. #65561 (Alexey Milovidov).
- Maybe fix test
00763_lock_buffer_long.sh
. #65562 (Alexey Milovidov). - Fix clickhouse-keeper with not system-wide directories and provide override for local development. #65563 (Azat Khuzhin).
- Re-configure yamllint to allow document-start. #65565 (Azat Khuzhin).
- Fix flaky test
01254_dict_load_after_detach_attach.sql
. #65571 (Alexey Milovidov). - Improve flaky test to provide more diagnostics. #65586 (Alexey Milovidov).
- Fix test_parallel_replicas_distributed_skip_shards flakiness. #65588 (Igor Nikonov).
- Fix an error in the test about metadata_type. #65592 (Alexey Milovidov).
- Fix slow test. #65593 (Alexey Milovidov).
- fix flaky 02864_statistics_uniq. #65599 (Han Fei).
- Fix 03172_error_log_table_not_empty. #65604 (Pablo Marcos).
- Enable realtime digest for Jepsen tests. #65608 (Antonio Andelic).
- CI: Return Job Rerun check. #65613 (Max K.).
- Update CHANGELOG.md. #65624 (Alexey Milovidov).
- Module is required for authenticating in GH (in cloud). #65628 (Max K.).
- Update IObjectStorage.h. #65631 (Kseniia Sumarokova).
- Fix 02834_apache_arrow_abort flakiness with MSAN. #65640 (Michael Kolupaev).
- Fix overflow in StorageWindowView. #65641 (Michael Kolupaev).
- Fix inconsistent AST formatting when a keyword is used as type name. #65648 (Michael Kolupaev).
- CI: Single point of setting mergeable check status. #65658 (Max K.).
- Miscellaneous and insignificant changes around Client/ClientBase. #65669 (Nikita Mikhaylov).
- Add Replicated database names to ZooKeeper for introspection. #65675 (Alexander Tokmakov).
- Introduce type contract checks in
IColumn
. #65687 (Nikita Taranov). - Print slightly more information in 02982_aggregation_states_destruction. #65688 (Michael Kolupaev).
- Disable stacktrace collection in GWPAsan by default. #65701 (Antonio Andelic).
- Build jemalloc with profiler. #65702 (Antonio Andelic).
- Fix duplicate symbol linkage error. #65705 (Nikita Taranov).
- Fix server restarts in performance tests. #65717 (Antonio Andelic).
- Update 03002_part_log_rmt_fetch_mutate_error.sql. #65720 (Alexander Tokmakov).
- Fix bug with session closing in Keeper. #65735 (Antonio Andelic).
- Fix flaky
02265_column_ttl
. Closes #65719. #65742 (János Benjamin Antal). - See #65745. It doesn't solve the issue, but helps a bit. #65746 (Alexander Tokmakov).
- Update CHANGELOG.md. #65752 (Alexey Milovidov).
- document declarative ssh-keys authentication. #65756 (Tobias Florek).
base64En/Decode64Url
-->base64En/Decode64URL
. #65760 (Robert Schulze).- Fix for issue #65757. #65763 (Yarik Briukhovetskyi).
- Fix flaky
test_replicated_database::test_alter_attach
. #65766 (Antonio Andelic). - Fix: progress bar for read in order queries. #65769 (Igor Nikonov).
- CI: Fix for Builds report job in backports and releases. #65774 (Max K.).
- CI: New create release workflow. #65775 (Max K.).
- fixed misspelled word. #65778 (Linh Giang).
- Refactor statistics interface. #65792 (Robert Schulze).
- Try to make
test_ldap_external_user_directory
less flaky. #65794 (Andrey Zvonov). - AMI image with gh and jwt. #65795 (Max K.).
- Forbid join algorithm randomisation for 03094_one_thousand_joins. #65798 (Nikita Taranov).
- Fix 02931_rewrite_sum_column_and_constant flakiness. #65800 (Michael Kolupaev).
- Update StorageMaterializedView.cpp. #65801 (Nikolay Degterinsky).
- Fix slow
getFQDNOrHostNameImpl
on macOS. #65803 (Konstantin Bogdanov). - No jemalloc profiler for non-Linux. #65834 (Antonio Andelic).
- Add missing workload identity changes. #65848 (SmitaRKulkarni).
- Fix rocksdb. #65858 (Alexey Milovidov).
- Update the list of easy tasks. #65865 (Alexey Milovidov).
- Update CHANGELOG.md. #65866 (Alexey Milovidov).
- This closes #43003. #65870 (Alexey Milovidov).
- Uninteresting changes. #65871 (Alexey Milovidov).
- Max sessions for user tests improvements. #65888 (Alexey Gerasimchuck).
- Update version_date.tsv and changelogs after v24.6.1.4423-stable. #65909 (robot-clickhouse).
- Remove standalone Keeper build. #65910 (Antonio Andelic).
- Add extra profiling helpers for Keeper. #65918 (Antonio Andelic).
- PostgreSQL source cancel query comments. #65919 (Maksim Kita).
- Remove mysqlxx::Pool::Entry assignment operator. #65920 (Azat Khuzhin).
- No random settings for a test with
Object(JSON)
. #65921 (Nikita Mikhaylov). - Follow up to #65046. #65928 (Kseniia Sumarokova).
- add restriction for storage join. #65936 (Han Fei).
- Update version_date.tsv and changelogs after v24.5.4.49-stable. #65937 (robot-clickhouse).
- Add table name to MergeTreeSource spans. #65940 (Nikita Taranov).
- Fix SettingsChangesHistory 24.7. #65945 (Raúl Marín).
- Fix logical error "Expected ReadBufferFromFile, but got DB::EmptyReadBuffer". #65949 (Kseniia Sumarokova).
- Use -Og instead of -O0 for debug builds. #65953 (Michael Kolupaev).
- Fix data race for Keeper snapshot queue. #65970 (Antonio Andelic).
- Minor changes in CHANGELOG. #65971 (Alexey Milovidov).
- Remove unnatural punctuation from Parquet. #65972 (Alexey Milovidov).
- Try fix "Check timeout expired" without any server logs in report in stateless tests. #65977 (Kseniia Sumarokova).
- Fix support of non-const scale arguments in rounding functions. #65983 (Mikhail Gorshkov).
- More aesthetic error messages. #65985 (Robert Schulze).
- Fix race in s3queue. #65986 (Kseniia Sumarokova).
- Now it's possible to specify
s3-storage
,azure-object-storage
and in generalobject-storage
. #65988 (alesapin). - Fix flaky test_storage_s3_queue tests. #66009 (Kseniia Sumarokova).
- Relax the check in 02982_aggregation_states_destruction. #66011 (Nikita Taranov).
- Fix
01158_zookeeper_log_long
. #66012 (Alexander Tokmakov). - Remove scary jemalloc log. #66028 (Antonio Andelic).
- Move experimental settings to the experimental block. #66030 (Raúl Marín).
- Fix lock-order-inversion in DatabaseCatalog. #66038 (Nikolay Degterinsky).
- Try disabling jemalloc background threads. #66041 (Antonio Andelic).
- Try to avoid conflicts in
SettingsChangesHistory.cpp
. #66042 (Anton Popov). - Add profile events for regex cache. #66050 (Antonio Andelic).
- Bump vectorscan to 5.4.10.1. #66056 (Robert Schulze).
- Remove obsolete comment. #66059 (Robert Schulze).
- Maybe fix tsan assert in
test_mysql_killed_while_insert_8_0
. #66064 (Robert Schulze). - Move some of
HTTPHandler
stuff to separate source files in order to reuse it inPrometheusRequestHandler
. This PR is required for https://github.com/ClickHouse/ClickHouse/pull/64183. #66067 (Vitaly Baranov). - Bump rocksdb to v6.23.3. #66068 (Robert Schulze).
- Add protobufs for
Prometheus
remote-write
/remote-read
protocols to our repository. Fix cmake script for compiling protobufs. #66069 (Vitaly Baranov). - Use pinned versions of all python packages in CI docker images. Also makes clang-18.1.8 work with sanitizers and surprisingly fixes #66049. #66070 (alesapin).
- Clean-up custom LLVM 15 patches. #66072 (Robert Schulze).
- Minor JWT client fixes. #66073 (Konstantin Bogdanov).
- Bump vectorscan to 5.4.11. #66082 (Robert Schulze).
- Print stacktrace in case of abort after logical error. #66091 (Nikolai Kochetov).
- fix flaky 03172_error_log_table_not_empty. #66093 (Sema Checherinda).
- Bump s2geometry to latest master. #66094 (Robert Schulze).
- update keeper bench example config file. #66095 (Han Fei).
- Avoid using source directory for generated files. #66097 (Azat Khuzhin).
- More precise warning message about sanitizers. #66098 (Anton Popov).
- Slightly better calculation of primary index. #66099 (Anton Popov).
- Bump Azure to 1.12. #66100 (Robert Schulze).
- Add a test for #58998. #66101 (Anton Popov).
- CI: Fix sync pr merge. #66105 (Max K.).
- Remove flaky case from 02956_rocksdb_bulk_sink. #66107 (vdimir).
- Fix bugfix checker. #66120 (Raúl Marín).
- Correctly print long processing requests in Keeper. #66124 (Antonio Andelic).
- Update version_date.tsv and changelogs after v24.6.2.17-stable. #66127 (robot-clickhouse).
- Bump s2geometry again. #66136 (Robert Schulze).
- Switch submodule
contrib/orc
to a proper commit in the main branch. Previously a commit from a removed branch was used (see). #66137 (Vitaly Baranov). - Finalize MergedBlockOutputStream in dtor. #66138 (Nikita Taranov).
- Proper destruction order of AsyncLoader::Pool fields. #66145 (Sergei Trifonov).
- Playing minesweeper with build system. #66147 (Nikita Taranov).
- Fix clang-tidy error in BufferWithOwnMemory.h. #66161 (Nikita Taranov).
- Use peak_threads_usage instead of arrayUniq(thread_ids) in tests. #66162 (Azat Khuzhin).
- Fix crash when adding empty tuple to query cache. #66168 (Michael Kolupaev).
- tests: fix 01563_distributed_query_finish flakiness (due to system.*_log_sender). #66171 (Azat Khuzhin).
- Refactor
OptimizeIfWithConstantConditionVisitor
usingInDepthNodeVisitor
. #66184 (zhongyuankai). - Update README.md. #66186 (Tyler Hannan).
- Fix 01246_buffer_flush flakiness. #66188 (Azat Khuzhin).
- Avoid using harmful function
rand()
in grpc. #66191 (Vitaly Baranov). - Bump RocksDB. #66216 (Robert Schulze).
- Update README.md. #66217 (Tyler Hannan).
- Fixes peak_threads_usage metric when materialised views are involved. #66230 (Sema Checherinda).
- Remove test as requested in https://github.com/ClickHouse/ClickHouse/pull/65277#issuecomment-2211361465. #66233 (Arthur Passos).
- Fix test
00504_mergetree_arrays_rw.sql
. #66248 (Anton Popov). - CI: Do not finalize CI running status unless all success. #66276 (Max K.).
- Collect core dumps in more tests. #66281 (Antonio Andelic).
- Add a stateless test for gRPC protocol. #66284 (Vitaly Baranov).
- Log message: Failed to connect to replica ... #66289 (Igor Nikonov).
- Update run.sh. #66290 (Kseniia Sumarokova).
- Some changes in the codebase as a preparation for LLVM 18. #66293 (Nikita Mikhaylov).
- There's some problem with iptables in parallel tests. #66304 (Alexander Tokmakov).
- Disable broken cases from 02911_join_on_nullsafe_optimization. #66310 (vdimir).
- Build failure if ENABLE_AWS_S3 is OFF fixed. #66335 (Ilya Golshtein).
- Enable checks in assert_cast under sanitizers. #66336 (Nikita Taranov).
- Create release workflow. #66339 (Max K.).
- Fix invalid XML. #66342 (János Benjamin Antal).
- Fix possible deadlock for jemalloc with enabled profiler. #66346 (Azat Khuzhin).
- Fix test_parallel_replicas_custom_key. #66349 (Antonio Andelic).
- Collect logs from
minio
in stateless and statefull tests. #66353 (János Benjamin Antal). - Fix "Sending a batch of X files to Y (0.00 rows, 0.00 B bytes)." in case of batch restoring. #66375 (Azat Khuzhin).
- Fix 03030_system_flush_distributed_settings flakiness. #66376 (Azat Khuzhin).
- PR cleanup: remove redundant code. #66380 (Igor Nikonov).
- New slack bot to post messages about CI events - Post message if OOM. #66392 (Max K.).
- Ignore subquery for IN in DDLLoadingDependencyVisitor. #66395 (Nikolai Kochetov).
- Update test_storage_rabbitmq/test.py. #66396 (Kseniia Sumarokova).
- Add query elapsed time for non-default format in play UI. #66398 (Azat Khuzhin).
- Untangle setting headers. #66404 (Raúl Marín).
- Remove noisy message. #66406 (Alexey Milovidov).
- If job detected as in-progress in PR workflow run - just remove it from todo list, as it not affected by the change. #66407 (Max K.).
- CI: CIBuddy to post from master only. #66417 (Max K.).
- Add a test for #66333. #66432 (max-vostrikov).
- Limit number of linker jobs on arm to avoid OOM during build. #66435 (Nikita Taranov).
- [RFC] Fix jemalloc assertion due to non-monotonic CLOCK_MONOTONIC_COARSE. #66439 (Azat Khuzhin).
- CI: Do not block CI on few number of test failures. #66440 (Max K.).
- Stateless tests: fix flaky tests 01037_polygon_dicts*. #66445 (Nikita Fomichev).
- Related to https://github.com/ClickHouse/ClickHouse/pull/62067 https://s3.amazonaws.com/clickhouse-test-reports/66410/5557dce188cabc7477bb4e874d47e3b80278ee66/stateless_tests__release_.html
2024-07-12 16:04:29 +Queries for alter_table did not finish automatically after 250+ seconds 2024-07-12 16:04:29 +==================== QUERIES ==================== 2024-07-12 16:04:29 +Row 1: 2024-07-12 16:04:29 +────── 2024-07-12 16:04:29 +is_initial_query: 1 2024-07-12 16:04:29 +user: default 2024-07-12 16:04:29 +query_id: b43ffd7d-aee6-4161-aa82-bf9fff9d78c0 2024-07-12 16:04:29 +address: ::1 2024-07-12 16:04:29 +port: 58360 2024-07-12 16:04:29 +initial_user: default 2024-07-12 16:04:29 +initial_query_id: b43ffd7d-aee6-4161-aa82-bf9fff9d78c0 ... 2024-07-12 16:04:29 +query: OPTIMIZE TABLE alter_table0 FINAL
. #66460 (Alexander Tokmakov). - OOM error was not visible since process is killed and status is not set Change sets ERROR status if job was killed. #66463 (Max K.).
- Add AST fuzzers jobs for CI caching so that they can be skipped in PRs not related to build or tests. #66468 (Max K.).
- If job with the same digest has been seen in master's CI it should be skipped in PR run. #66471 (Max K.).
- CI: Check job's exit status and report if killed. #66477 (Max K.).
- This closes #37557. #66482 (Alexey Milovidov).
- CI: Add retry for GH set_status_comment call. #66488 (Max K.).
- OpenSSL: Minor follow-up to #66064. #66489 (Robert Schulze).
- CI: Fix for job filtering in PRs. #66490 (Max K.).
- CI: Create release workflow updates. #66498 (Max K.).
- Add one more revision to ignore. #66499 (Alexey Milovidov).
- Unit tests vomit a ton of garbage, see https://s3.amazonaws.com/clickhouse-test-reports/66457/0c82dc91f07b29ba503d7579c7d3ebecba532b73/unit_tests__tsan_/run.log - remove it. #66501 (Alexey Milovidov).
- Fix double whitespace in EXPLAIN AST CREATE. #66505 (Alexey Milovidov).
- Fix bad test
02530_dictionaries_update_field
. #66507 (Alexey Milovidov). - Https://play.clickhouse.com/play?user=play#u0vmrunuignozwnrx3n0yxj0x3rpbwusignozwnrx25hbwusihrlc3rfbmftzswgcmvwb3j0x3vybapguk9nignozwnrcwpxsevsrsbjagvja19zdgfydf90aw1lid49ig5vdygpic0gsu5urvjwquwgmjqwiehpvvikicagieforcbwdwxsx3jlcxvlc3rfbnvtymvyid0gmaogicagqu5eihrlc3rfc3rhdhvzice9icdts0lquevejwogicagqu5eihrlc3rfc3rhdhvziexjs0ugj0yljwogicagqu5eignozwnrx3n0yxr1cyahpsanc3vjy2vzcyckicagieforcbwb3npdglvbih0zxn0x25hbwusicdhcgfjagvfyxjyb3cnksa+idakt1jervigqlkgy2hly2tfc3rhcnrfdgltzq==. #66508 (Alexey Milovidov).
- Fix MSan report in GRPC. #66509 (Alexey Milovidov).
- CI: Fix for skipping Builds_2 in PRs' CI. #66512 (Max K.).
- CI: Do not block Tests_3 unless MAX_FAILED_TESTS exceeded. #66513 (Max K.).
- Fix
02918_parallel_replicas_custom_key_unavailable_replica
. #66516 (Antonio Andelic). - Stateless tests: improvements related to OOM of test runs. #66520 (Nikita Fomichev).
- Tests: rename bad log names. #66522 (Nikita Fomichev).
- Add additional log masking in CI. #66523 (Raúl Marín).
- CI: Multiple fixes for handling killed jobs. #66524 (Max K.).
- Allow GWP Asan allocations only when initialization is finished. #66526 (Alexey Katsman).
- Update 02443_detach_attach_partition.sh. #66529 (Alexander Tokmakov).
- Follow up #66435. #66530 (Nikita Taranov).
- fix log in keeper tcp handler. #66531 (Han Fei).
- CI: Report job start and finish to CI DB. #66533 (Max K.).
- Update 01396_inactive_replica_cleanup_nodes_zookeeper.sh. #66535 (Alexander Tokmakov).
- Add dedicated runner to libfuzzer, update docker. #66551 (Yakov Olkhovskiy).
- fix tidy build. #66552 (Sema Checherinda).
- No-op env change. #66553 (Raúl Marín).
- Fix typo in new_delete.cpp. #66554 (alesapin).
- Fix something in Fast Test. #66558 (Alexey Milovidov).
- update trusted contributors. #66561 (Xu Jia).
- Delete bad test
02805_distributed_queries_timeouts
. #66563 (Alexey Milovidov). - More clarity in the test
03001_consider_lwd_when_merge
. #66564 (Alexey Milovidov). - Stateless tests: temporary disable sequential tests in parallel. #66585 (Nikita Fomichev).
- Move view targets to separate AST class
ASTViewTargets
in order to allow extending it to support more kinds of view targets. #66590 (Vitaly Baranov). - Fix bsdtar for @nikitamikhaylov. #66592 (alesapin).
- CI: POC for Auto Releases. #66593 (Max K.).
- Fix clang tidy after #66402. #66597 (vdimir).
- Adjust the runtime of some slow performance test. #66619 (Robert Schulze).
- CI: Scale down AutoScaling Groups from runners. #66622 (Max K.).
- Allow to run clang-tidy with clang-19. #66625 (Alexey Milovidov).
- Fix terrible test @arthurpassos. #66632 (Alexey Milovidov).
- Fix bad log message. #66633 (Alexey Milovidov).
- Negative sign in prewhere optimization. #66637 (cangyin).
- Closes #66639. #66640 (Kruglov Pavel).
- Avoid generating named tuple for special keywords (null, true, false). #66641 (Amos Bird).
- rearrange heavy tests 03008_deduplication. #66642 (Sema Checherinda).
- Fix data race in S3::ClientCache. #66644 (Konstantin Morozov).
- CI: Remove aws lambda packages from oss. #66651 (Max K.).
- Introduce separate DEBUG_OR_SANITIZER_BUILD macro. #66652 (Nikita Taranov).
- Increase backoff because with slow builds sometimes 100ms is not enough to recover. #66653 (alesapin).
- Fix wrong queries hung error because of 02044_url_glob_parallel_connection_refused. #66657 (Nikita Taranov).
- add log for splitBlockIntoParts. #66658 (Han Fei).
- Minor: Make
CaseSensitiveness
an enum class. #66673 (Robert Schulze). - Fix bad test
02210_processors_profile_log
. #66684 (Alexey Milovidov). - Fix something around clang-tidy. #66694 (Alexey Milovidov).
- ci: dump dmesg in case of OOM. #66705 (Azat Khuzhin).
- fix clang tidy. #66706 (Han Fei).
- Https://s3.amazonaws.com/clickhouse-test-reports/61109/5cf2b53f146c1a4f24d8212f9f810d587c46bfc0/stateless_tests__release_.html. #66724 (Alexander Tokmakov).
- Support one more case in JOIN ON ... IS NULL. #66725 (vdimir).
- CI: Fix issue with a skipped Build report. #66726 (Max K.).
- relax condition in test, remove unused counters. #66730 (Sema Checherinda).
- Remove bad test
host_resolver_fail_count
. #66731 (Alexey Milovidov). - Fix bad test
03036_join_filter_push_down_equivalent_sets
. #66736 (Alexey Milovidov). - Fix bad tests
long_select_and_alter
. #66737 (Alexey Milovidov). - Add test test_storage_mysql/test.py::test_joins. #66743 (vdimir).
- Disallow build exclusion only by CI settings (ci_include_, ci_exclude_) to avoid running builds in auto sync prs. #66744 (Max K.).
- Use non-existent address to check connection error at table creation. #66760 (János Benjamin Antal).
- Backported in #67063: Increase asio pool size in case the server is tiny. #66761 (alesapin).
- Fix flakiness of async insert tests due to adaptive timeout. #66771 (Raúl Marín).
- Attempt to fix flakiness of 01194_http_query_id. #66774 (Raúl Marín).
- Turn off randomization of harmful setting. #66776 (alesapin).
- The number of batches was reduced in https://github.com/ClickHouse/ClickHouse/pull/65186, but then the parallel execution was disabled in https://github.com/ClickHouse/ClickHouse/pull/66585. So now tasks fail with timeout sometimes: https://s3.amazonaws.com/clickhouse-test-reports/66724/36275fdacc34206931f69087fe77539e25bbbedd/stateless_tests__tsan__s3_storage__[2_3].html. #66783 (Alexander Tokmakov).
- Remove obsolete code from CMakeLists. #66786 (Alexey Milovidov).
- Stateless tests: split parallel tests more evenly. #66787 (Nikita Fomichev).
- Fix test
02724_limit_num_mutations.sh
. #66788 (Anton Popov). - Better diagnostics in
test_disk_configuration
. #66802 (Alexey Milovidov). - Fix bad test
02950_part_log_bytes_uncompressed
. #66803 (Alexey Milovidov). - Better diagnostics for test trace_events_stress. #66804 (Alexey Milovidov).
- Make test
00997_set_index_array
lighter. #66817 (Alexey Milovidov). - Miscellaneous. #66818 (Alexey Milovidov).
- Fix inconsistent formatting of lambda functions inside composite types. #66819 (Alexey Milovidov).
- Small fix in realloc memory tracking. #66820 (Antonio Andelic).
- Never await in CI on BuildReport - just redo (await can be longer) - Remove BuildReport if no build jobs in workflow (for instance: Docs change) - Do not fail CheckReadyForMerge job if the only non-green status is Cloud Sync. #66822 (Max K.).
- Remove bad tests @azat. #66823 (Alexey Milovidov).
- CI: New Release workflow updates and fixes. #66830 (Max K.).
- Fix signed integer overflow in function
age
. #66831 (Robert Schulze). - Fix RocksDB bs. #66838 (Alexey Milovidov).
- Split a test for index. #66839 (Alexey Milovidov).
- Fix inconsistent formatting of
NOT ((SELECT ...))
. #66840 (Alexey Milovidov). - Make test
01592_long_window_functions1
lighter. #66841 (Alexey Milovidov). - What if I will change the test for SSL authentication?. #66844 (Alexey Milovidov).
- Functions
[a-g]*
: Iterate overinput_rows_count
where appropriate. #66846 (Robert Schulze). - Revert libunwind patch. #66850 (Antonio Andelic).
- Split test 03038_nested_dynamic_merges to avoid timeouts. #66863 (Kruglov Pavel).
- CI: Print instance info in runner's init script. #66868 (Max K.).
- Backported in #67257: Followup #66725. #66869 (vdimir).
- CI: CI Buddy to notify about fatal workflow failures. #66890 (Max K.).
- CI: Add ec2 instance lifecycle metadata to CIDB. #66918 (Max K.).
- CI: Remove ci runners scripts from oss. #66920 (Max K.).
- Backported in #67209: Decrease rate limit in
01923_network_receive_time_metric_insert
. #66924 (János Benjamin Antal). - Backported in #67227: Grouparrayintersect: fix serialization bug. #66928 (Raúl Marín).
- Backported in #67207: Un-flake test_runtime_configurable_cache_size. #66934 (Robert Schulze).
- Backported in #66975: CI: Fixes docker server build for release branches. #66955 (Max K.).
- Backported in #67213: [CI Fest] Split dynamic tests and rewrite them from sh to sql to avoid timeouts. #66981 (Kruglov Pavel).
- Backported in #67033: [CI Fest] Fix use-of-uninitialized-value in JSONExtract* numeric functions. #66984 (Kruglov Pavel).
- Backported in #67051: CI: Fix for workflow results parsing. #67000 (Max K.).
- Backported in #67116: Disable setting
optimize_functions_to_subcolumns
. #67046 (Anton Popov). - Backported in #67205: Increase max allocation size for sanitizers. #67049 (János Benjamin Antal).
- Backported in #67124: Very sad failure:
2024.07.24 13:28:45.517777 [ 10 ] {08745bf9-4bc1-4946-b9a8-c03d82ec55dc} <Debug> executeQuery: (from 172.16.11.1:55890) OPTIMIZE TABLE replicated_mt FINAL (stage: Complete) 2024.07.24 13:28:45.525945 [ 10 ] {08745bf9-4bc1-4946-b9a8-c03d82ec55dc} <Trace> default.replicated_mt (ReplicatedMergeTreeQueue): Waiting for 4 entries to be processed: queue-0000000004, queue-0000000002, queue-0000000001, queue-0000000000 2024.07.24 13:29:15.528024 [ 10 ] {08745bf9-4bc1-4946-b9a8-c03d82ec55dc} <Debug> default.replicated_mt (6581a6fb-8458-466d-8350-89951eb1ac8e) (MergerMutator): Selected 3 parts from all_0_0_0 to all_2_2_0 2024.07.24 13:29:15.530736 [ 10 ] {08745bf9-4bc1-4946-b9a8-c03d82ec55dc} <Trace> default.replicated_mt (6581a6fb-8458-466d-8350-89951eb1ac8e): Created log entry /clickhouse/tables/replicated_mt/log/log-0000000004 for merge all_0_2_1 2024.07.24 13:29:15.530873 [ 10 ] {08745bf9-4bc1-4946-b9a8-c03d82ec55dc} <Debug> default.replicated_mt (6581a6fb-8458-466d-8350-89951eb1ac8e): Waiting for node1 to process log entry 2024.07.24 13:29:15.530919 [ 10 ] {08745bf9-4bc1-4946-b9a8-c03d82ec55dc} <Debug> default.replicated_mt (6581a6fb-8458-466d-8350-89951eb1ac8e): Waiting for node1 to pull log-0000000004 to queue 2024.07.24 13:29:15.534286 [ 10 ] {08745bf9-4bc1-4946-b9a8-c03d82ec55dc} <Debug> default.replicated_mt (6581a6fb-8458-466d-8350-89951eb1ac8e): Looking for node corresponding to log-0000000004 in node1 queue 2024.07.24 13:29:15.534793 [ 10 ] {08745bf9-4bc1-4946-b9a8-c03d82ec55dc} <Debug> default.replicated_mt (6581a6fb-8458-466d-8350-89951eb1ac8e): Waiting for queue-0000000005 to disappear from node1 queue 2024.07.24 13:29:15.585533 [ 10 ] {08745bf9-4bc1-4946-b9a8-c03d82ec55dc} <Debug> TCPHandler: Processed in 30.067804125 sec.
. #67067 (alesapin). - Backported in #67203: Fix flaky
test_seekable_formats_url
andtest_seekable_formats
S3 storage tests. #67070 (János Benjamin Antal). - Backported in #67222: Fix 2680 flasky. #67078 (jsc0218).
- Backported in #67190: Attempt to fix flakiness of some window view tests. #67130 (Robert Schulze).
- Backported in #67272: Rename (unreleased) bad setting. #67149 (Raúl Marín).
- Backported in #67441: Try to fix 2572. #67158 (jsc0218).
- Backported in #67416: CI: Fix build results for release branches. #67402 (Max K.).