Azat Khuzhin
6064f3ef1d
Fix memory tracking with min_bytes_to_use_mmap_io
...
With min_bytes_to_use_mmap_io=1 memory regions for mmap() will not be
accounted. But this creates issues, since if you will run simple
"SELECT * FROM big_enough_table" it will mmap lot's of files and the
process RSS will grow at some point, and before the kernel will
understand that it needs to unmap physical pages the clickhouse-server
will sync total_memory_tracker with RSS of the process and the
allocations will fail by per-server memory limits.
Also note, that this does not address all the issues with mmap()
regions.
v2: move track/untrack into the MMapReadBufferFromFileWithCache to avoid
data-race [1]
[1]: https://clickhouse-test-reports.s3.yandex.net/23211/6acf6cb9b22cee7db8d1aa523a6208f63e792f7a/functional_stateful_tests_(thread).html#fail1
2021-04-17 10:37:38 +03:00
Maksim Kita
3f3f928c1f
Merge pull request #21639 from changvvb/support-apple-m1
...
Support Apple m1
2021-04-17 02:44:15 +03:00
alexey-milovidov
786f340256
Merge pull request #22755 from kssenii/postgresql-protocol-with-row-policy
...
Allow row policy in postgresql protocol
2021-04-17 01:55:30 +03:00
robot-clickhouse
88445294b4
Update version_date.tsv after release 20.8.18.32
2021-04-17 01:11:03 +03:00
robot-clickhouse
d2101c05ce
Update version_date.tsv after release 21.2.10.48
2021-04-17 00:40:38 +03:00
robot-clickhouse
a1f6b0e560
Update version_date.tsv after release 21.3.7.62
2021-04-17 00:28:08 +03:00
robot-clickhouse
df2e75bf00
Update version_date.tsv after release 21.4.4.30
2021-04-16 23:56:52 +03:00
Maksim Kita
d381e59791
Merge pull request #23114 from kitaisreal/fix-arcadia-build-s3
...
Fix arcadia build S3
2021-04-16 23:35:10 +03:00
Maksim Kita
4be441c6d5
Merge branch 'master' into support-apple-m1
2021-04-16 23:33:12 +03:00
Alexander Kuzmenkov
7adc0fde82
Merge pull request #23088 from azat/jemalloc-tunning
...
jemalloc tuning
2021-04-16 22:17:03 +03:00
alexey-milovidov
74a0ac6917
Merge pull request #23160 from azat/logging-v2
...
[RFC] Change logging from trace to debug for messages with rows/bytes
2021-04-16 21:18:32 +03:00
Maksim Kita
a809323179
Updated zlib version
2021-04-16 21:15:32 +03:00
Maksim Kita
2ff5fe24c7
Merge pull request #23153 from kitaisreal/updated-zlib
...
Updated zlib
2021-04-16 21:06:06 +03:00
tavplubix
3d1885f08c
Merge pull request #23177 from marsno1/fix-exception-log
...
Fix exception message for "parts_to_throw_insert"
2021-04-16 18:15:07 +03:00
Nikita Mikhaylov
0ddb396338
add Y_IGNORE
2021-04-16 15:52:48 +03:00
Vitaly Baranov
936c1bfc53
Merge pull request #23164 from vitlibar/improve-row-policy-docs
...
Improve documentation for CREATE ROW POLICY command.
2021-04-16 15:15:40 +03:00
Kruglov Pavel
deb86ee520
Merge pull request #22986 from azat/StorageBuffer-flush
...
[RFC] Add ability to flush buffer only in background for StorageBuffer
2021-04-16 15:14:24 +03:00
Alexander Kuzmenkov
74b4c56ba4
Merge pull request #21589 from dmalkr/dmalkr/arrayFold
...
Function `arrayFold` for folding over array with accumulator
2021-04-16 14:23:53 +03:00
Alexander Kuzmenkov
440efb6fb6
Update arrayFold.cpp
2021-04-16 14:22:23 +03:00
Maksim Kita
6e65a3604b
Merge pull request #23187 from kitaisreal/mac-os-clang-build-instructions-fix
...
MacOS clang build instructions fix
2021-04-16 14:03:45 +03:00
Maksim Kita
4d323fa556
MacOS clang build instructions fix
2021-04-16 13:59:54 +03:00
tavplubix
b5cbbce314
Merge pull request #22706 from songenjie/fetch_part
...
[clickhouse][server][ddl]support fetch part
2021-04-16 12:26:51 +03:00
tavplubix
ae3dc3dfc0
Merge pull request #23161 from ClickHouse/logs_for_debuging_test_failures
...
More verbose logs for debuging test failures with Replicated and Keeper
2021-04-16 12:01:58 +03:00
Vitaly Baranov
88e2d28666
Improve documentation for CREATE ROW POLICY command.
2021-04-16 10:57:33 +03:00
Azat Khuzhin
29281ea6e0
jemalloc: set muzzy_decay_ms/dirty_decay_ms to 5s
2021-04-16 10:54:11 +03:00
Maksim Kita
1797a67cf8
Merge pull request #22925 from kitaisreal/flat_dictionary_performance_test_fix
...
Dictionaries updated performance tests
2021-04-16 10:46:41 +03:00
Maksim Kita
75d18a6d27
Updated zlib-ng aarch64
2021-04-16 10:45:53 +03:00
madianjun
9238d8e54a
Fix exception message for parts_to_throw_insert
2021-04-16 14:28:52 +08:00
Maksim Kita
55b1fc5a21
Updated zlib-ng
2021-04-16 00:18:52 +03:00
Alexey Milovidov
9110a76d00
Reordered settings to avoid confusion
2021-04-16 00:14:37 +03:00
alexey-milovidov
dcb5d1b395
Merge pull request #23096 from ClickHouse/markdown-bad-alignment
...
Fix unpleasant behaviour of `Markdown` format
2021-04-16 00:06:58 +03:00
alexey-milovidov
081bb6e275
Merge pull request #23000 from ClickHouse/speedup-intdiv
...
Dynamic dispatch for `intDiv`
2021-04-16 00:05:43 +03:00
Maksim Kita
4affe01ffb
Backport zlib x86 arm check features constructor
2021-04-15 23:30:41 +03:00
Maksim Kita
09571ca91f
Updated zlib-ng submodule
2021-04-15 22:22:40 +03:00
Maksim Kita
94b228acc9
Update PocoHTTPClient.h
2021-04-15 21:51:15 +03:00
Alexander Tokmakov
0ad6205fa6
logs for debuging test failures with Replicated and Keeper
2021-04-15 21:34:53 +03:00
Azat Khuzhin
19e0439629
Add ability to flush buffer only in background for StorageBuffer
...
Add 3 new engine arguments:
- flush_time
- flush_rows
- flush_bytes
That will be checked only for background flush, this maybe useful if
INSERT latency is "crucial".
2021-04-15 21:22:13 +03:00
Azat Khuzhin
d2cf03ea41
Change logging from trace to debug for messages with rows/bytes
2021-04-15 21:00:16 +03:00
changvvb
0be5976967
Merge branch 'support-apple-m1' of github.com:changvvb/ClickHouse into support-apple-m1
2021-04-15 22:57:23 +08:00
changvvb
4eee2d0977
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1
2021-04-15 22:54:26 +08:00
Maksim Kita
77bc9e04c6
Updated zlib with apple linker fix
2021-04-15 17:50:28 +03:00
Maksim Kita
aead70e72a
Updated zlib version
2021-04-15 17:47:31 +03:00
Alexey Milovidov
bd49e696c4
Minor change
2021-04-15 16:59:00 +03:00
alexey-milovidov
02e77c3ef1
Merge pull request #23111 from ClickHouse/fix_test_name
...
Rename strange tests
2021-04-15 15:03:31 +03:00
Dmitry Krylov
bf51f94f37
Fix constness
2021-04-15 21:46:15 +10:00
Alexey Milovidov
d19b2cb948
Fix build
2021-04-15 14:41:55 +03:00
alexey-milovidov
b097140bb4
Merge pull request #23083 from azat/logging
...
Tiny logging improvements
2021-04-15 14:39:47 +03:00
alexey-milovidov
0c097417a7
Merge pull request #22942 from ianton-ru/fix_flapping_test
...
Fix flapping test_merge_tree_s3 test
2021-04-15 14:38:36 +03:00
Maksim Kita
e361f5943f
Merge pull request #22999 from azat/no-optimize_skip_unused_shards-single-node
...
Do not perform optimize_skip_unused_shards for cluster with one node
2021-04-15 14:36:56 +03:00
alexey-milovidov
69eac517b6
Merge pull request #23086 from azat/memory-blocking
...
Block all memory tracking limits in dtors/SCOPE_EXIT_*SAFE/tryLogCurrentException
2021-04-15 14:36:10 +03:00