Commit Graph

122816 Commits

Author SHA1 Message Date
Alexander Tokmakov
72b52250ea
Merge pull request #53501 from azat/dist-flush_on_detach
Add ability to turn off flush of Distributed on DETACH/DROP/server shutdown
2023-08-17 16:56:04 +03:00
Salvatore Mesoraca
c2340d588f
Fix issue found by fuzzer 2023-08-17 14:57:34 +02:00
avogar
bca91548ad Add setting input_format_parquet_local_file_min_bytes_for_seek 2023-08-17 12:28:01 +00:00
Azat Khuzhin
fcb66379d1 Remove outdated code in ReplicatedMergeTreeQueue::initialize()
Initially added in #28817
But got cleaned up in #41981

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-17 13:45:26 +02:00
Robert Schulze
ec7daed52f
Merge pull request #50276 from ClibMouse/feature/mergetree-checksum-big-endian-support
MergeTree & SipHash checksum big-endian support
2023-08-17 13:27:18 +02:00
Nikolai Kochetov
8dbe82c192
Merge pull request #53489 from ClickHouse/fix-wrong-column-order-in-parallel-final
Fix wrong columns order for queries with parallel FINAL.
2023-08-17 13:22:13 +02:00
Alexander Tokmakov
f83d0dabea
Merge pull request #53295 from ClickHouse/less_no_parallel
Remove no-parallel tag from some tests
2023-08-17 14:08:35 +03:00
Mikhail f. Shiryaev
b7866ce75f
Merge pull request #53493 from ClickHouse/update-style-checker
Update style checker
2023-08-17 12:56:20 +02:00
Robert Schulze
ab0bdda3fc
Merge remote-tracking branch 'rschu1ze/master' into CVE-2023-36054 2023-08-17 10:09:41 +00:00
Alexander Tokmakov
76702a03bb
Update materialized_with_ddl.py (#53494) 2023-08-17 13:08:27 +03:00
Alexander Tokmakov
9e69120bee fix 2023-08-17 12:03:38 +02:00
Filipp Ozinov
5003406ef7
Style 2023-08-17 13:52:21 +04:00
Robert Schulze
5253a7f650
Respect cgroup memory limit when reloading configuration
Cgroups allows to change the amount of memory available to a process
while it runs. The previous logic calculated the amount of available
memory only once at server startup. As a result, memory thresholds set
via cgroups were not picked up when the settings changed. We now always
incorporate the current limits during re-configuraton.

Note 1: getMemoryAmount() opens/reads a file which is potentially
        expensive. Should be fine though since that happens only when
        the server configuration changes.

Note 2: An better approach would be to treat cgroup limit changes as
        another trigger for ClickHouse server re-configuration (which
        currently only happens when the config files change). Shied away
        from that for now because of the case that when the cgroup limit
        is lowered, there is no guarantee that ClickHouse can shrink the
        memory amount accordingly in time (afaik, it does so only lazily
        by denying new allocations). As a result, the OOM killer would
        kill the server. The same will happen with this PR but at a
        lower implementation complexity.
2023-08-17 09:22:13 +00:00
Robert Schulze
1215a23de6
Merge pull request #53422 from rschu1ze/consistency-fixes-for-caches
Refactorings for configuration of in-memory caches
2023-08-17 11:08:32 +02:00
Robert Schulze
4e77984344
Merge pull request #53487 from rschu1ze/curl-head
curl: update to latest master (fixes CVE-2023-32001)
2023-08-17 11:08:04 +02:00
Robert Schulze
067623a4c9
Merge pull request #53444 from rschu1ze/factorize-constants
Minor: Factorize constants in Annoy index
2023-08-17 11:05:56 +02:00
Robert Schulze
d250adf0a5
Merge pull request #53428 from rschu1ze/invalid-async-metrics-update-period
Protect against invalid asynchronous_metrics_update_period_s settings
2023-08-17 11:05:15 +02:00
Filipp Ozinov
f402d80bce
Test for system.data_skipping_indices with MaterializedMySQL 2023-08-17 12:51:41 +04:00
Filipp Ozinov
e609a9f3d1
Test for system.data_skipping_indices with MaterializedMySQL 2023-08-17 12:50:44 +04:00
Alexey Gerasimchuck
adc73beb93 Added waiting to other PostgreSQL tests 2023-08-17 08:24:17 +00:00
Alexey Gerasimchuck
6b44088a8b Added waiting for PostgreSQL port open 2023-08-17 07:51:44 +00:00
Mikhail f. Shiryaev
fd3e6c93ee
Produce standard report for cases when AST failed 2023-08-17 09:39:02 +02:00
Azat Khuzhin
17ca2661a1 Add ability to turn off flush of Distributed on DETACH/DROP/server shutdown
Sometimes you can have tons of data there, i.e. few TiBs, and sending
them on server shutdown does not looks sane (maybe there is a bug and
you need to update/restart to fix flushing).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-17 08:58:06 +02:00
Alexey Milovidov
525cc46b0b
Merge pull request #53400 from rschu1ze/follow-up-52695
Follow-up to #52695: Move tests to a more appropriate place
2023-08-17 07:53:34 +03:00
Alexey Milovidov
51876c9a56
Merge pull request #53499 from ClickHouse/simplify-performance-test
Simplify performance test
2023-08-17 07:47:32 +03:00
robot-ch-test-poll3
30dadcfdcc
Merge pull request #53425 from ClickHouse/trash_for_rdb
Add trash for Replicated database
2023-08-17 04:11:40 +02:00
Alexey Milovidov
c3e6f7e9ae Leave only simplifications 2023-08-17 03:59:15 +02:00
Alexey Milovidov
857856b8b6 Leave only simplifications 2023-08-17 03:58:32 +02:00
Alexey Milovidov
64c829807c Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci-performance 2023-08-17 03:56:27 +02:00
Michael Kolupaev
ff04660972
Merge pull request #53433 from ClickHouse/exp
Fix 'Context has expired' error properly
2023-08-16 18:40:53 -07:00
Zhiguo Zhou
9467addace
Merge branch 'ClickHouse:master' into 20230815-date-arrayjoin-fix 2023-08-17 09:17:57 +08:00
Mikhail f. Shiryaev
87685a7c0c
Address shellcheck issues 2023-08-17 01:08:18 +02:00
Alexander Tokmakov
d7272410bd the worst fix for a deadlock ever 2023-08-17 00:42:51 +02:00
Alexey Milovidov
368191af2f
Update 02841_parallel_final_wrong_columns_order.sql 2023-08-17 01:18:00 +03:00
Alexey Milovidov
53fdbac7b0
Update 02841_parallel_final_wrong_columns_order.sql 2023-08-17 01:16:58 +03:00
Alexey Milovidov
a0a6ec1809
Update 02841_parallel_final_wrong_columns_order.sql 2023-08-17 01:15:40 +03:00
Mikhail f. Shiryaev
3c36af111d
Update style checker 2023-08-17 00:03:58 +02:00
Robert Schulze
1008d7a9ce
Merge remote-tracking branch 'rschu1ze/master' into follow-up-52695 2023-08-16 21:26:29 +00:00
Robert Schulze
8a58e0df3e
Merge remote-tracking branch 'rschu1ze/master' into consistency-fixes-for-caches 2023-08-16 21:26:04 +00:00
Robert Schulze
336262fc8e
Merge remote-tracking branch 'rschu1ze/master' into invalid-async-metrics-update-period 2023-08-16 21:25:39 +00:00
Robert Schulze
353854520c
Merge remote-tracking branch 'rschu1ze/master' into factorize-constants 2023-08-16 21:24:21 +00:00
Alexander Tokmakov
69bc4f5139 Merge branch 'master' into exception_message_patterns6 2023-08-16 22:58:24 +02:00
Alexander Tokmakov
970eb24067 fix 2023-08-16 22:57:49 +02:00
Nikolai Kochetov
3a6a3d491e Fix typo 2023-08-16 20:40:28 +00:00
Alexander Tokmakov
08e4e2bb0b fix 2023-08-16 22:35:45 +02:00
Nikolai Kochetov
91c241532f Add a check for header structure. 2023-08-16 20:26:23 +00:00
Nikolai Kochetov
30ccfa1638 Fix wrong columns order for queries with parallel FINAL. 2023-08-16 20:23:10 +00:00
Alexander Tokmakov
d5ed014ec4
Fix flaky test 02443_detach_attach_partition (#53478)
* fix flaky test

* empty commit
2023-08-16 22:56:32 +03:00
Robert Schulze
ea8a99c103
Sort stuff 2023-08-16 19:04:28 +00:00
Robert Schulze
5688891236
curl: update to latest master (fixes CVE-2023-32001) 2023-08-16 19:00:27 +00:00