Commit Graph

123101 Commits

Author SHA1 Message Date
Filipp Ozinov
5003406ef7
Style 2023-08-17 13:52:21 +04:00
Robert Schulze
f420006e09
Make the code consistent with Annoy index and fix build 2023-08-17 09:42:13 +00:00
Robert Schulze
456a02da1b
Merge remote-tracking branch 'rschu1ze/master' 2023-08-17 09:30:27 +00:00
Robert Schulze
5253a7f650
Respect cgroup memory limit when reloading configuration
Cgroups allows to change the amount of memory available to a process
while it runs. The previous logic calculated the amount of available
memory only once at server startup. As a result, memory thresholds set
via cgroups were not picked up when the settings changed. We now always
incorporate the current limits during re-configuraton.

Note 1: getMemoryAmount() opens/reads a file which is potentially
        expensive. Should be fine though since that happens only when
        the server configuration changes.

Note 2: An better approach would be to treat cgroup limit changes as
        another trigger for ClickHouse server re-configuration (which
        currently only happens when the config files change). Shied away
        from that for now because of the case that when the cgroup limit
        is lowered, there is no guarantee that ClickHouse can shrink the
        memory amount accordingly in time (afaik, it does so only lazily
        by denying new allocations). As a result, the OOM killer would
        kill the server. The same will happen with this PR but at a
        lower implementation complexity.
2023-08-17 09:22:13 +00:00
Robert Schulze
1215a23de6
Merge pull request #53422 from rschu1ze/consistency-fixes-for-caches
Refactorings for configuration of in-memory caches
2023-08-17 11:08:32 +02:00
Robert Schulze
4e77984344
Merge pull request #53487 from rschu1ze/curl-head
curl: update to latest master (fixes CVE-2023-32001)
2023-08-17 11:08:04 +02:00
Robert Schulze
067623a4c9
Merge pull request #53444 from rschu1ze/factorize-constants
Minor: Factorize constants in Annoy index
2023-08-17 11:05:56 +02:00
Robert Schulze
d250adf0a5
Merge pull request #53428 from rschu1ze/invalid-async-metrics-update-period
Protect against invalid asynchronous_metrics_update_period_s settings
2023-08-17 11:05:15 +02:00
李扬
cfea6db997
Update native_orc.cpp 2023-08-17 16:57:41 +08:00
Filipp Ozinov
f402d80bce
Test for system.data_skipping_indices with MaterializedMySQL 2023-08-17 12:51:41 +04:00
Filipp Ozinov
e609a9f3d1
Test for system.data_skipping_indices with MaterializedMySQL 2023-08-17 12:50:44 +04:00
Alexey Gerasimchuck
adc73beb93 Added waiting to other PostgreSQL tests 2023-08-17 08:24:17 +00:00
Alexey Gerasimchuck
6b44088a8b Added waiting for PostgreSQL port open 2023-08-17 07:51:44 +00:00
Mikhail f. Shiryaev
fd3e6c93ee
Produce standard report for cases when AST failed 2023-08-17 09:39:02 +02:00
Azat Khuzhin
17ca2661a1 Add ability to turn off flush of Distributed on DETACH/DROP/server shutdown
Sometimes you can have tons of data there, i.e. few TiBs, and sending
them on server shutdown does not looks sane (maybe there is a bug and
you need to update/restart to fix flushing).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-17 08:58:06 +02:00
taiyang-li
c4777397f7 fix integration test test_kafka_formats 2023-08-17 14:42:51 +08:00
Alexey Milovidov
525cc46b0b
Merge pull request #53400 from rschu1ze/follow-up-52695
Follow-up to #52695: Move tests to a more appropriate place
2023-08-17 07:53:34 +03:00
Alexey Milovidov
51876c9a56
Merge pull request #53499 from ClickHouse/simplify-performance-test
Simplify performance test
2023-08-17 07:47:32 +03:00
robot-ch-test-poll3
30dadcfdcc
Merge pull request #53425 from ClickHouse/trash_for_rdb
Add trash for Replicated database
2023-08-17 04:11:40 +02:00
Alexey Milovidov
c3e6f7e9ae Leave only simplifications 2023-08-17 03:59:15 +02:00
Alexey Milovidov
857856b8b6 Leave only simplifications 2023-08-17 03:58:32 +02:00
Alexey Milovidov
64c829807c Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci-performance 2023-08-17 03:56:27 +02:00
Michael Kolupaev
ff04660972
Merge pull request #53433 from ClickHouse/exp
Fix 'Context has expired' error properly
2023-08-16 18:40:53 -07:00
Zhiguo Zhou
9467addace
Merge branch 'ClickHouse:master' into 20230815-date-arrayjoin-fix 2023-08-17 09:17:57 +08:00
Igor Nikonov
49f7b4acd6 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-16 23:31:49 +00:00
Igor Nikonov
2e4d346e44 Fixes 2023-08-16 23:31:20 +00:00
Igor Nikonov
21ef1f1d1c Remove unnecessary Scalars usage for cluster_for_parallel_replicas 2023-08-16 23:24:01 +00:00
Mikhail f. Shiryaev
87685a7c0c
Address shellcheck issues 2023-08-17 01:08:18 +02:00
Nikolay Degterinsky
c6fc31c1e3 Review suggestions 2023-08-16 23:06:42 +00:00
Nikolay Degterinsky
a893f75884 Merge remote-tracking branch 'upstream/master' into better-stop-listen 2023-08-16 23:06:18 +00:00
Alexander Tokmakov
d7272410bd the worst fix for a deadlock ever 2023-08-17 00:42:51 +02:00
Alexey Milovidov
368191af2f
Update 02841_parallel_final_wrong_columns_order.sql 2023-08-17 01:18:00 +03:00
Alexey Milovidov
53fdbac7b0
Update 02841_parallel_final_wrong_columns_order.sql 2023-08-17 01:16:58 +03:00
Alexey Milovidov
a0a6ec1809
Update 02841_parallel_final_wrong_columns_order.sql 2023-08-17 01:15:40 +03:00
Mikhail f. Shiryaev
3c36af111d
Update style checker 2023-08-17 00:03:58 +02:00
Robert Schulze
1008d7a9ce
Merge remote-tracking branch 'rschu1ze/master' into follow-up-52695 2023-08-16 21:26:29 +00:00
Robert Schulze
8a58e0df3e
Merge remote-tracking branch 'rschu1ze/master' into consistency-fixes-for-caches 2023-08-16 21:26:04 +00:00
Robert Schulze
336262fc8e
Merge remote-tracking branch 'rschu1ze/master' into invalid-async-metrics-update-period 2023-08-16 21:25:39 +00:00
Robert Schulze
353854520c
Merge remote-tracking branch 'rschu1ze/master' into factorize-constants 2023-08-16 21:24:21 +00:00
Robert Schulze
b711802c43
Fix spelling 2023-08-16 21:23:11 +00:00
Alexander Tokmakov
69bc4f5139 Merge branch 'master' into exception_message_patterns6 2023-08-16 22:58:24 +02:00
Alexander Tokmakov
970eb24067 fix 2023-08-16 22:57:49 +02:00
Nikolai Kochetov
3a6a3d491e Fix typo 2023-08-16 20:40:28 +00:00
Alexander Tokmakov
08e4e2bb0b fix 2023-08-16 22:35:45 +02:00
Nikolai Kochetov
91c241532f Add a check for header structure. 2023-08-16 20:26:23 +00:00
Nikolai Kochetov
30ccfa1638 Fix wrong columns order for queries with parallel FINAL. 2023-08-16 20:23:10 +00:00
Alexander Tokmakov
d5ed014ec4
Fix flaky test 02443_detach_attach_partition (#53478)
* fix flaky test

* empty commit
2023-08-16 22:56:32 +03:00
Robert Schulze
ea8a99c103
Sort stuff 2023-08-16 19:04:28 +00:00
Robert Schulze
5688891236
curl: update to latest master (fixes CVE-2023-32001) 2023-08-16 19:00:27 +00:00
Alexander Tokmakov
42e0b91c53
Merge pull request #53474 from ClickHouse/merging_53304
Merging #53304
2023-08-16 21:57:22 +03:00