Commit Graph

11371 Commits

Author SHA1 Message Date
robot-clickhouse
18cdbf26ec Automatic style fix 2024-12-06 02:47:00 +00:00
pufit
0cdaf0d893 Fix and comments 2024-12-05 21:39:44 -05:00
pufit
bb35fcbdc7 Merge branch 'master' into pufit/correct-access-rights-check-restore 2024-12-05 20:50:41 -05:00
Yakov Olkhovskiy
617af1d3c0
Merge pull request #71297 from lzydmxy/force-connect-on-retry
Force_connected for retry resume connection establisher
2024-12-03 01:21:31 +00:00
Raúl Marín
0a5a0a2973
Merge pull request #72402 from Algunenano/keeper_fault
Better error message on bad keeper snapshots
2024-12-02 09:24:16 +00:00
vdimir
0a5bc248fd
Merge branch 'master' into vdimir/join_select_inner_table 2024-11-29 15:50:25 +00:00
Mikhail Artemenko
b81ee27750
Merge pull request #71406 from azat/automatic-external-aggregation
Automatic GROUP/ORDER BY to disk based on the memory usage
2024-11-29 12:27:43 +00:00
Alexey Katsman
d7167bd103
Merge pull request #72548 from alexkats/dict
Add source query validation for dictionaries
2024-11-29 11:25:40 +00:00
alesapin
d25b15a3b1
Merge pull request #72613 from ClickHouse/nopctest
Remove flaky test_page_cache
2024-11-29 10:16:13 +00:00
Michael Kolupaev
29b722df29 Remove flaky test_page_cache 2024-11-28 21:09:12 +00:00
Pablo Marcos
d8a235b785
Merge pull request #67733 from Zawa-ll/66073-system-load-primary-key-rebase
Added statement `SYSTEM LOAD PRIMARY KEY`
2024-11-28 16:02:31 +00:00
Alex Katsman
23086e1424 Add source query validation for dictionaries 2024-11-28 15:38:07 +00:00
Azat Khuzhin
bdb39a6fef Change logic of automatic ORDER/GROUP BY to be based on available memory
- remove max_bytes_ratio_before_external_{order,group_by}_for_server
- change the way max_bytes_ratio_before_external_{order,group_by} works

Note, that it is not enough to transform ratio to bytes in
executeQuery(), since in this case it will not work for merges and
internal queries, plus, you have to reset them for Distributed engine
and update it for Merge/View/...

This patch also introduce some helpers (see MemoryTrackerUtils) and
adjust Aggregator::Params constructor to accept Settings object instead
of tons of arguments.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
db1f459cc4 tests: disable test_max_bytes_ratio_before_external_order_group_by_for_server under TSan
The problem is that TSan has some memory overhead which increases
process RSS to 10Gi in the middle of the query and it will fail.
Another option is to avoid syncing with RSS too frequently, but I doubt
that it is significant to run this test under TSan

v1: increase memory to 20Gi
    Fixes: https://s3.amazonaws.com/clickhouse-test-reports/71406/b33be86dee3c7616e9193c339837b9e250810557/integration_tests__tsan__[6_6].html
v2: instead just disable under TSan
    Fixes: https://s3.amazonaws.com/clickhouse-test-reports/71406/df68cf7362d825c3d83991fd74c391a49e73a8b1/integration_tests__tsan__[6_6].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
02aa6eac82 Cover max_bytes_ratio_before_external_{order,group_by}_for_server
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Pablo Marcos
f1f5304484 Update test_grant_and_revoke/test_with_table_engine_grant.py::test_grant_all_on_table 2024-11-28 08:59:49 +00:00
Igor Nikonov
97bd43894d Merge remote-tracking branch 'origin/master' into pr-skip-index-analysis-on-workers 2024-11-28 08:12:31 +00:00
Vitaly Baranov
e7e30d67fb
Merge pull request #72552 from vitlibar/increase-timeout-in-test_short_disconnection_doesnt_stop_restore
Increase timeout in test_short_disconnection_doesnt_stop_restore
2024-11-27 20:17:22 +00:00
robot-clickhouse
dbf217f32a Automatic style fix 2024-11-27 19:57:56 +00:00
Igor Nikonov
10d721991e Remove local_plan duplication 2024-11-27 19:46:41 +00:00
Igor Nikonov
ff2f791e57 Merge remote-tracking branch 'origin/master' into pr-skip-index-analysis-on-workers 2024-11-27 19:24:42 +00:00
Vladimir Cherkasov
9344c1e679
Merge branch 'master' into vdimir/join_select_inner_table 2024-11-27 18:05:07 +01:00
Vitaly Baranov
6657d04553 Increase timeout in test_short_disconnection_doesnt_stop_restore. 2024-11-27 17:42:28 +01:00
Nikita Taranov
d59fe5fd7f
Merge pull request #70788 from ClickHouse/parallel_hash_by_def
Use `parallel_hash` join algorithm by default
2024-11-27 16:18:02 +00:00
Vladimir Cherkasov
d77794d285
Merge branch 'master' into vdimir/join_select_inner_table 2024-11-27 11:05:26 +01:00
Robert Schulze
e9f083b26d
Merge pull request #71997 from allmazz/delete_old_mongodb_integration
Get rid of the legacy mongodb integration
2024-11-26 21:51:46 +00:00
Konstantin Bogdanov
ca2d9ccef5
Merge pull request #72429 from ClickHouse/fix-backups-except-tables-formatting
Fix `BACKUP ... EXCEPT TABLES` queries formatting and parsing
2024-11-26 18:08:19 +00:00
Vladimir Cherkasov
96be57aed2
Merge branch 'master' into vdimir/join_select_inner_table 2024-11-26 18:40:18 +01:00
Robert Schulze
6a899f97eb
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration 2024-11-26 17:33:41 +00:00
Raúl Marín
dd092411ff
Merge pull request #72455 from Algunenano/rename_setting
Rename allowed_feature_tier to allow_feature_tier
2024-11-26 15:54:01 +00:00
vdimir
a8b0b748d0
Resubmit #68682, att2 2024-11-26 12:59:38 +00:00
Robert Schulze
45e1702f82
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration 2024-11-26 12:44:06 +00:00
Robert Schulze
2ed07b21d3
Fix test_mask_sensitive_info 2024-11-26 12:43:08 +00:00
Raúl Marín
575e17758d Adjust tests 2024-11-26 13:34:00 +01:00
Vladimir Cherkasov
37cd162397
Merge pull request #72357 from aalexfvk/fix_move_zero_copy_part_test
Remove flaky test test_move_shared_lock_fail_keeper_unavailable and extend the stable one
2024-11-26 11:39:23 +00:00
Raúl Marín
b487f59496 Rename allowed_feature_tier to allow_feature_tier 2024-11-26 12:30:57 +01:00
Igor Nikonov
53fcfe4180 Merge remote-tracking branch 'origin/master' into pr-skip-index-analysis-on-workers 2024-11-26 10:54:28 +00:00
Igor Nikonov
2b1b4d0516 fix test_parallel_replicas_all_marks_read 2024-11-26 10:54:23 +00:00
Kseniia Sumarokova
ecd1fcb21a
Merge pull request #71301 from MikhailBurdukov/fix_zombies_in_lib_bridge
Fixed zombie processes after library bridge crash.
2024-11-26 10:03:14 +00:00
robot-clickhouse
7ed67942e8 Automatic style fix 2024-11-26 04:14:42 +00:00
Konstantin Bogdanov
b2d358c27b
Add tests 2024-11-26 05:06:14 +01:00
robot-clickhouse
8226903918 Automatic style fix 2024-11-25 21:41:10 +00:00
Igor Nikonov
38132c1451 Update test_parallel_replicas_protocol 2024-11-25 21:32:57 +00:00
Igor Nikonov
62b256422a Merge remote-tracking branch 'origin/master' into pr-skip-index-analysis-on-workers 2024-11-25 20:53:05 +00:00
Nikita Taranov
879035e841 Merge branch 'master' into parallel_hash_by_def 2024-11-25 20:18:04 +01:00
Nikita Taranov
63e9204c52 fix 2024-11-25 19:30:35 +01:00
Raúl Marín
4585a6225c
Revert "Resubmit #68682" 2024-11-25 19:20:14 +01:00
Robert Schulze
17f27275ae
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration 2024-11-25 17:23:15 +00:00
Vladimir Cherkasov
95b21f4a44
Merge pull request #71577 from ClickHouse/vdimir/join_select_inner_table
Resubmit #68682
2024-11-25 13:24:51 +00:00
Aleksei Filatov
bf102d2a00 Remove flaky test and extend stable one 2024-11-24 14:26:38 +00:00