Commit Graph

886 Commits

Author SHA1 Message Date
Nikita Taranov
201f021db1 allow with parallel_hash 2024-12-09 23:05:06 +01:00
Raúl Marín
90a03e149a Remove deps from SipHash 2024-12-04 15:45:26 +01:00
Nikolai Kochetov
c00a85a601 Merge branch 'master' into query-plan-serialization-steps 2024-12-03 16:16:01 +01:00
Nikolai Kochetov
6cc668bd88 Add serializetion to some query plan steps. 2024-12-03 15:00:05 +00:00
vdimir
ceea266253
fix 2024-12-02 11:09:03 +00:00
Vladimir Cherkasov
7b9973ef8f
Merge branch 'master' into vdimir/residual_join_conditions 2024-12-02 11:38:00 +01:00
vdimir
0a5bc248fd
Merge branch 'master' into vdimir/join_select_inner_table 2024-11-29 15:50:25 +00:00
Azat Khuzhin
bdb39a6fef Change logic of automatic ORDER/GROUP BY to be based on available memory
- remove max_bytes_ratio_before_external_{order,group_by}_for_server
- change the way max_bytes_ratio_before_external_{order,group_by} works

Note, that it is not enough to transform ratio to bytes in
executeQuery(), since in this case it will not work for merges and
internal queries, plus, you have to reset them for Distributed engine
and update it for Merge/View/...

This patch also introduce some helpers (see MemoryTrackerUtils) and
adjust Aggregator::Params constructor to accept Settings object instead
of tons of arguments.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
d5a990346c Implement max_bytes_ratio_before_external_group_by_for_server
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
a856c30c7c Automatic GROUP BY to disk (max_bytes_ratio_before_external_group_by)
Simpler then max_bytes_before_external_group_by, that allows you not to
think about memory consumption of the query, and can be set globally to
i.e. 0.5 so that the external aggregation will be enabled once the
memory usage reaches the 50%.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Vladimir Cherkasov
9344c1e679
Merge branch 'master' into vdimir/join_select_inner_table 2024-11-27 18:05:07 +01:00
vdimir
a8b0b748d0
Resubmit #68682, att2 2024-11-26 12:59:38 +00:00
Raúl Marín
4585a6225c
Revert "Resubmit #68682" 2024-11-25 19:20:14 +01:00
Igor Nikonov
6c4c8155d8 PR: ANTI JOIN fix 2024-11-25 13:39:28 +00:00
Vladimir Cherkasov
62789dab31
Merge branch 'master' into vdimir/join_select_inner_table 2024-11-21 20:11:55 +01:00
Vladimir Cherkasov
95e72b7588
Merge branch 'master' into vdimir/join_select_inner_table 2024-11-21 12:42:38 +01:00
Konstantin Bogdanov
b2c81981fb
Use clang-19 2024-11-20 23:08:47 +01:00
Raúl Marín
6b55754bc9 Remove some nested includes in IFunction usage 2024-11-18 18:25:37 +01:00
vdimir
c224366513
fix 2024-11-18 16:57:09 +00:00
vdimir
b03f48807a
Merge branch 'master' into vdimir/join_select_inner_table 2024-11-18 10:06:39 +00:00
Nikita Taranov
3a2dca0193
Merge branch 'master' into better_parallel_hash2 2024-11-16 20:09:46 +01:00
Nikita Taranov
1f7e2845be
Merge pull request #71868 from ClickHouse/fix_hash_table_stats
More accurate `calculateCacheKey` implementation
2024-11-16 13:48:46 +00:00
Igor Nikonov
7d3d940b08 Cleanup 2024-11-14 21:11:01 +00:00
Igor Nikonov
b2dbbea179 Code cleanup 2024-11-13 21:10:59 +00:00
Nikita Taranov
04e80e675a impl 2024-11-13 15:26:07 +01:00
vdimir
37176374a9
Merge branch 'master' into vdimir/join_select_inner_table 2024-11-13 12:53:53 +00:00
vdimir
7865eb1ce8
style 2024-11-12 18:30:03 +00:00
vdimir
1929029882
fix 2024-11-12 15:35:38 +00:00
Igor Nikonov
39e01d47b1 Fix style check 2024-11-11 11:54:04 +00:00
Igor Nikonov
9baa5911f9 Debugging stack with PR queries 2024-11-10 20:54:59 +00:00
Igor Nikonov
d57a6b1e74 Merge remote-tracking branch 'origin/master' into pr-right-joins 2024-11-10 20:04:53 +00:00
Nikita Taranov
db30c33d04
Merge branch 'master' into better_parallel_hash2 2024-11-10 20:24:37 +01:00
Nikita Taranov
56f6062bd8 better 2024-11-10 14:51:19 +01:00
Alexey Milovidov
bc79d9bad3 Only with analyzer 2024-11-10 00:01:51 +01:00
Igor Nikonov
3c37c1e6c4 Merge remote-tracking branch 'origin/master' into pr-right-joins 2024-11-07 12:17:24 +00:00
vdimir
0fb51df9ab
Revert "Merge pull request #71527 from ClickHouse/revert-68682-vdimir/join_select_inner_table"
This reverts commit dd5061a4d3, reversing
changes made to 0011bc5e07.
2024-11-07 12:16:19 +00:00
Mikhail Artemenko
b0393274f7
Merge pull request #71151 from ClickHouse/issues/71020/staleness
WITH FILL STALENESS extension
2024-11-07 10:12:58 +00:00
Igor Nikonov
70a01f45ad Merge remote-tracking branch 'origin/master' into pr-right-joins 2024-11-06 17:48:16 +00:00
Raúl Marín
12ab488453
Revert "Selection of hash join inner table" 2024-11-06 16:20:57 +01:00
Mikhail Artemenko
69dcd96bd3 Merge branch 'master' into issues/71020/staleness 2024-11-06 14:43:38 +00:00
Mikhail Artemenko
3d7c560a25 Merge branch 'master' into issues/71020/staleness 2024-11-06 11:16:42 +00:00
Nikita Taranov
bac948ec0e
Merge pull request #71224 from ClickHouse/fix_parallel_replicas_complex_subqueries
Fix `WITH TOTALS` in subquery with parallel replicas
2024-11-06 11:15:45 +00:00
vdimir
19a46944b7
fix 2024-11-06 10:46:35 +00:00
vdimir
de3f052912
fix build 2024-11-05 16:53:31 +00:00
vdimir
43486bd634
simple 2024-11-05 16:35:40 +00:00
vdimir
955ecec5ce
Merge branch 'master' into vdimir/residual_join_conditions 2024-11-05 16:26:52 +00:00
Nikita Taranov
8e1d85b0b8 new setting 2024-11-05 15:07:18 +01:00
Igor Nikonov
5fbced454d Merge remote-tracking branch 'origin/master' into pr-right-joins 2024-11-04 22:45:58 +00:00
Igor Nikonov
8c5ab63345 Cleanup 2024-11-04 22:45:40 +00:00
Igor Nikonov
a6b55563c7 Fix FULL joins 2024-11-04 18:32:05 +00:00