Commit Graph

95677 Commits

Author SHA1 Message Date
Robert Schulze
df889351ad
feat: replace unbounded vectorscan cache by bounded cache
VectorScan patterns can grow large (up to multiple MBs) and queries
involving different VectorScan patterns lead to an ever increasing
pattern cache size.

With this commit, the unbounded cache for vectorscan patterns is
replaced by a bounded cache with "CacheTable" eviction strategy, similar
to what we have for re2 patterns. The cache size is currently hard-coded
to 500 entries.

Fixes #19869
2022-08-16 21:09:47 +00:00
Robert Schulze
89bf69c35f
style: improve code aesthetics and make it slightly safer 2022-08-16 21:09:32 +00:00
Alexander Tokmakov
4482465ce3
Merge pull request #40134 from arthurpassos/fix_cares_reverse_dns_race_condition
Fix CaresPTRResolver race condition
2022-08-16 21:06:17 +03:00
Kruglov Pavel
afd5221d58
FIx check black 2022-08-16 18:53:55 +02:00
Nikolai Kochetov
feab1eb0a3
Update CurrentMemoryTracker.cpp 2022-08-16 18:40:06 +02:00
Igor Nikonov
fdd699e8a3 Rename tests according to new setting name 2022-08-16 16:37:31 +00:00
Igor Nikonov
d4367de7bb Rename setting to optimize_sorting_by_input_stream_properties 2022-08-16 16:27:41 +00:00
Nikolai Kochetov
8e4c967fc9 Try to account untracked memory (per thread) more correctly. 2022-08-16 18:09:05 +02:00
Azat Khuzhin
ded70fbd53 Fix memory accounting in case of MEMORY_LIMIT_EXCEEDED errors
In case of memory allocation had been failed, it should not be take into
account anywhere, otherwise it will report incorrect memory usage for
query and in logs.

I found this while was digging into OOM in stress tests, and saw memory
allocations that had been significantly greater the memory limit (even
with overcommit).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-16 18:08:56 +02:00
Alexander Tokmakov
0136262a2a fix 2022-08-16 18:03:02 +02:00
kssenii
43991729ef Fix 2022-08-16 17:08:12 +02:00
Igor Nikonov
51f4716b29 Fix review comments 2022-08-16 14:59:53 +00:00
avogar
d5f7337ba3 Try fix tests 2022-08-16 14:57:19 +00:00
Yakov Olkhovskiy
18c3ae5b37
Merge pull request #40269 from ClickHouse/ci-mergeable-add-unit-1
Add update_mergeable_check trigger for Unit tests
2022-08-16 10:52:59 -04:00
Kruglov Pavel
cebe9d273c
Fix build 2022-08-16 16:46:17 +02:00
Kruglov Pavel
af2bc42ee1
Fix special build 2022-08-16 16:32:13 +02:00
Kruglov Pavel
b580789802
Fix special build 2022-08-16 16:31:22 +02:00
Suzy Wang
6539273c86 update lz4.c from upstream, cve fixes 2022-08-16 06:50:37 -07:00
Alexander Tokmakov
832d7c6e7c Merge branch 'master' into replicated_database_improvements 2022-08-16 15:49:13 +02:00
Vladimir Chebotaryov
3cc03b141e Fixed tests on Debug build type. 2022-08-16 15:43:37 +02:00
Vladimir Chebotaryov
66f9bfca61 Fixed point of origin for exponential decay window functions to the last value in window. 2022-08-16 15:43:37 +02:00
Alexander Tokmakov
47bdd8a3e2
Merge pull request #40248 from ClickHouse/stacktraces_in_integration_tests
Try to print stacktraces if query timeouts in integration tests
2022-08-16 16:39:49 +03:00
Kseniia Sumarokova
37d522fd6e
Merge pull request #40260 from kssenii/add-current-metrics-for-cache
Add more current metrics for cache
2022-08-16 15:14:29 +02:00
kssenii
93816e7366 Review fixes 2022-08-16 15:11:55 +02:00
robot-clickhouse
15bbb21a09 Automatic style fix 2022-08-16 13:10:28 +00:00
Yakov Olkhovskiy
dfbbc51045
add update_mergeable_check trigger 2022-08-16 09:02:03 -04:00
avogar
99d8727335 Fix tests 2022-08-16 12:56:51 +00:00
Alexander Tokmakov
99ad09e9f3
Merge pull request #40268 from ClickHouse/revert-40027-perf-sparse-hashed
Revert "tests/performance: cover sparse_hashed dictionary"
2022-08-16 15:33:49 +03:00
Alexander Tokmakov
6fd4d2cfb3 Revert "tests/performance: cover sparse_hashed dictionary (#40027)"
This reverts commit 6a30c23252.
2022-08-16 15:32:50 +03:00
Alexander Tokmakov
387b69caea fix race condition 2022-08-16 14:03:31 +02:00
Alexander Tokmakov
d4fb75c8db Revert "fix race with check thread"
This reverts commit 45284108ba.
2022-08-16 12:49:17 +02:00
Kruglov Pavel
169b38c878
Fix s3 test 2022-08-16 12:40:10 +02:00
Kruglov Pavel
795262f16c
Fix hdfs test 2022-08-16 12:39:35 +02:00
Kruglov Pavel
9d764a547c
Fix test 2022-08-16 12:37:40 +02:00
kssenii
52832ea788 May be fix database replicated check 2022-08-16 11:51:57 +02:00
avogar
936c457734 Remove unnended field 2022-08-16 09:51:52 +00:00
avogar
e1ff996ec3 Allow to specify structure hints in schema inference 2022-08-16 09:46:57 +00:00
kssenii
3901778d49 Add more current metrics for cache 2022-08-16 11:32:23 +02:00
Antonio Andelic
b33f3a4e16 Extract common KV storage logic 2022-08-16 09:32:01 +00:00
Maksim Kita
110470809b
Merge pull request #40121 from amosbird/profile-processor-1
Extend processors_profile_log with more info
2022-08-16 09:49:12 +02:00
Alexander Tokmakov
1e6f7a7c52 make it work with python3.8 2022-08-16 09:35:45 +02:00
Alexey Milovidov
a54db7d501
Merge pull request #40241 from Avogar/fix-capnproto-sigsev
Fix possible segfault in CapnProto input format
2022-08-16 08:25:49 +03:00
Alexey Milovidov
328ab25660
Merge pull request #40250 from ClickHouse/ci-mergeable-add-unit
Add Unit tests to Mergeable
2022-08-16 08:14:27 +03:00
Yakov Olkhovskiy
b865787b3c
add Unit tests to Mergeable 2022-08-15 19:05:40 -04:00
kssenii
eb26b219b9 Merge master 2022-08-16 00:56:27 +02:00
Igor Nikonov
7a9bdbe81a Merge remote-tracking branch 'origin/master' into skipping_sorting_step 2022-08-15 20:59:37 +00:00
Igor Nikonov
aba00952f5 Fix: don't set sort mode in ReadFromMergeTree if sort description empty 2022-08-15 20:58:20 +00:00
Maksim Kita
2f5a63e87f
Merge pull request #40247 from den-crane/Docs/array_join
Doc. some notes about arrayJoin
2022-08-15 22:26:20 +02:00
robot-clickhouse
1b11a5c6fe Automatic style fix 2022-08-15 20:19:41 +00:00
Alexander Tokmakov
26c2a0ce5e try to print stacktraces if query timeouts 2022-08-15 22:12:07 +02:00