Commit Graph

159816 Commits

Author SHA1 Message Date
Anton Popov
6e5582f899
Merge pull request #72599 from CurtizJ/revert-65488
Revert "Merge pull request #65488 from zvonand/zvonand-ttl"
2024-11-29 23:44:00 +00:00
Anton Popov
6e760f4e45
Merge pull request #72611 from CurtizJ/fix-prewarm-caches-race
Fix data race in prewarm of mark cache
2024-11-29 22:14:24 +00:00
Alexander Gololobov
fc01a17c89
Fix description 2024-11-29 22:31:35 +01:00
Alexander Gololobov
333b2918ba
Update check-style 2024-11-29 21:25:28 +01:00
Yarik Briukhovetskyi
bc3bc8913e
Add nullable check for data types 2024-11-29 20:59:07 +01:00
Alexander Gololobov
5e0285d38a Measure time consumed by logging 2024-11-29 20:49:55 +01:00
Sema Checherinda
043d6e7bbf
Revert "make d-tor Finalizer more obvious" 2024-11-29 20:37:03 +01:00
Yarik Briukhovetskyi
ca5faf14ca
Update Set.cpp 2024-11-29 20:18:41 +01:00
Miсhael Stetsyuk
af04a3ce68
Merge pull request #72490 from ClickHouse/add-index-granularity-internal-array-size-metric
add metric MergeTreeIndexGranularityInternalArraysTotalSize
2024-11-29 19:17:03 +00:00
Yarik Briukhovetskyi
98a358db10
Fix tests 2024-11-29 18:49:09 +01:00
Yarik Briukhovetskyi
27ffde3f3e
Init 2024-11-29 18:45:53 +01:00
vdimir
0a5bc248fd
Merge branch 'master' into vdimir/join_select_inner_table 2024-11-29 15:50:25 +00:00
Michael Stetsyuk
485f53e95e add test 2024-11-29 14:42:36 +00:00
Anton Popov
407e135231 Merge remote-tracking branch 'upstream/master' into HEAD 2024-11-29 14:02:22 +00:00
János Benjamin Antal
62368fb2a3
Merge pull request #72375 from jiebinn/shared_mutex_optimization
Optimize the mutex with shared_mutex in the memory tracker
2024-11-29 13:29:13 +00:00
Anton Popov
1bcc53dbf3 Merge remote-tracking branch 'upstream/master' into HEAD 2024-11-29 12:57:54 +00:00
Antonio Andelic
f56b9c353c Reserve exact size 2024-11-29 13:57:01 +01:00
Antonio Andelic
88db1fe07f Lock commit before creating snapshot manually 2024-11-29 13:39:57 +01:00
Mikhail Artemenko
b81ee27750
Merge pull request #71406 from azat/automatic-external-aggregation
Automatic GROUP/ORDER BY to disk based on the memory usage
2024-11-29 12:27:43 +00:00
Anton Popov
938b7ad848
Merge pull request #72615 from CurtizJ/fix-system-load-primary-key
Fix tests for `SYSTEM LOAD PRIMARY KEY`
2024-11-29 12:22:06 +00:00
Alexey Katsman
d7167bd103
Merge pull request #72548 from alexkats/dict
Add source query validation for dictionaries
2024-11-29 11:25:40 +00:00
Robert Schulze
4c4c7b4fce
Update 03202_system_load_primary_key.sql 2024-11-29 12:08:57 +01:00
Antonio Andelic
f9113db7a4 Better memory usage approx 2024-11-29 12:00:35 +01:00
Daniil Ivanik
300d36bb72
Merge pull request #72277 from ClickHouse/divanik/iceberg_format_1_version_inconsistency_warning
Fix iceberg v1 format metadata json inconsistency
2024-11-29 10:49:15 +00:00
alesapin
d25b15a3b1
Merge pull request #72613 from ClickHouse/nopctest
Remove flaky test_page_cache
2024-11-29 10:16:13 +00:00
alesapin
427b16a717 Merge branch 'devirtualize_serialize_call' of github.com:ClickHouse/ClickHouse into devirtualize_serialize_call 2024-11-29 11:12:08 +01:00
alesapin
f3f0a2bb88 Bump 2024-11-29 11:11:50 +01:00
Antonio Andelic
07d2bf1df4 Fix race 2024-11-29 10:49:11 +01:00
zhanglistar
fec8f60629 move composed_data_type_output_format_mode to 24.12 2024-11-29 16:18:59 +08:00
zhanglistar
7d2bda17a7 Merge branch 'tostring-fix' of https://github.com/bigo-sg/ClickHouse into tostring-fix 2024-11-29 16:16:28 +08:00
zhanglistar
67504deac4 move composed_data_type_output_format_mode to 24.12 2024-11-29 16:14:41 +08:00
Sema Checherinda
54424ade94
Merge pull request #72395 from ClickHouse/chesema-dtor-Finalizer
make d-tor Finalizer more obvious
2024-11-29 08:05:14 +00:00
zhanglistar
a80df289ef Merge branch 'master' of https://github.com/bigo-sg/ClickHouse into tostring-fix 2024-11-29 15:56:49 +08:00
Nikita Taranov
523d3b4af7
Merge pull request #72555 from ClickHouse/raise_default_for_prealloc_in_ht_optimisation
Raise defaults for preallocation in HTs optimisation
2024-11-28 23:20:48 +00:00
Robert Schulze
4c36e8f427
Merge pull request #65519 from KevinyhZou/Fix_least_greast_diff
Make functions `least` and `greatest` ignore NULL arguments
2024-11-28 23:04:45 +00:00
Anton Popov
35133ebed9 fix tests for SYSTEM LOAD PRIMARY KEY 2024-11-28 22:58:45 +00:00
Anton Popov
c512c23c26 fix data race in prewarmCaches when thread is failed to allocate 2024-11-28 22:11:03 +00:00
Michael Kolupaev
29b722df29 Remove flaky test_page_cache 2024-11-28 21:09:12 +00:00
Nikita Taranov
f00b0b02c9
Merge pull request #72566 from ClickHouse/fix_03167_improvement_table_name_too_long
Fix 03167_improvement_table_name_too_long
2024-11-28 17:02:26 +00:00
Anton Popov
af67fbee95 Revert "Merge pull request #65488 from zvonand/zvonand-ttl"
This reverts commit 2517e8a7e3, reversing
changes made to c907ad13f6.
2024-11-28 16:48:31 +00:00
Vladimir Cherkasov
bc79653eed
Merge pull request #72586 from ClickHouse/vdimir/race_col_const_for_each_subsol
Fix data race in Squashing with ColumnConst
2024-11-28 16:21:47 +00:00
Pablo Marcos
d8a235b785
Merge pull request #67733 from Zawa-ll/66073-system-load-primary-key-rebase
Added statement `SYSTEM LOAD PRIMARY KEY`
2024-11-28 16:02:31 +00:00
Alex Katsman
23086e1424 Add source query validation for dictionaries 2024-11-28 15:38:07 +00:00
Nikita Taranov
f3f41d82df
Merge pull request #70598 from bigo-sg/more_jits
Enable JIT compilation for more expressions
2024-11-28 15:29:29 +00:00
Azat Khuzhin
dad435a10f Ignore max_bytes_ratio_before_external_{order,group_by} if memory limit is not configured
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:10:04 +01:00
Azat Khuzhin
b0da170e62 Fix default value for group_by_overflow_mode
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
a8eaf3ecde Fix copy-paste typo for max_bytes_ratio_before_external_group_by doc
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
bdb39a6fef Change logic of automatic ORDER/GROUP BY to be based on available memory
- remove max_bytes_ratio_before_external_{order,group_by}_for_server
- change the way max_bytes_ratio_before_external_{order,group_by} works

Note, that it is not enough to transform ratio to bytes in
executeQuery(), since in this case it will not work for merges and
internal queries, plus, you have to reset them for Distributed engine
and update it for Merge/View/...

This patch also introduce some helpers (see MemoryTrackerUtils) and
adjust Aggregator::Params constructor to accept Settings object instead
of tons of arguments.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
14e27b7de9 Move settings changes to 24.12
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
ee271c2a06 Reduce copy-paste by introducing Aggregator::writeToTemporaryFileIfNeeded()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00