mirror of
https://github.com/ClickHouse/ClickHouse.git
synced 2024-11-29 11:02:08 +00:00
6fba6f7ddd
Reading files using mmap() does not have any significant benefits over plain read() [1]. [1]: https://gist.github.com/azat/3d6c8d82bdd91e7a38d997fd6bcfd574 And not only it does not have significant benefits, it also has some issues, due to max_server_memory_usage (default to 90% of available RAM), since when you read files with mmap() eventually process RSS may exceed max_server_memory_usage, and in this case any allocation will fail (with "Memory limit exceeded (total)") error (yes kernel will unload pages, but likely it will happens after queries will starting to fail), like in this test [2]. [2]: https://gist.github.com/azat/4813489828162e6c2ce131963c6a1acb TL;DR; Note that there was also an idea to take those mmap()'ed regions in memory tracking (#23211), but there are some drawbacks (since accounting mmap() is tricky, first of all you need to account only once per inode for file and plus kernel can unload some pages and those memory will not be used by the server anymore). And as an adddition to #23211 there was #23212, that adds max_bytes_to_use_mmap_io, but since mmap is not a subject for memory accounting there is no need in it.
31 lines
1.2 KiB
XML
31 lines
1.2 KiB
XML
<yandex>
|
|
<profiles>
|
|
<default>
|
|
<allow_introspection_functions>1</allow_introspection_functions>
|
|
<log_queries>1</log_queries>
|
|
<metrics_perf_events_enabled>1</metrics_perf_events_enabled>
|
|
<!--
|
|
If a test takes too long by mistake, the entire test task can
|
|
time out and the author won't get a proper message. Put some cap
|
|
on query execution time to prevent this. Test query run time is
|
|
limited to about 2 seconds, but this limit applies to all queries,
|
|
including fill/create and maintenance such as downloading trace
|
|
logs, so it must be generous enough. As a second line of defense,
|
|
we might also add time check to perf.py script.
|
|
-->
|
|
<max_execution_time>300</max_execution_time>
|
|
|
|
<!-- One NUMA node w/o hyperthreading -->
|
|
<max_threads>12</max_threads>
|
|
|
|
<!-- mmap shows some improvements in perf tests -->
|
|
<min_bytes_to_use_mmap_io>64Mi</min_bytes_to_use_mmap_io>
|
|
</default>
|
|
</profiles>
|
|
<users>
|
|
<default>
|
|
<access_management>1</access_management>
|
|
</default>
|
|
</users>
|
|
</yandex>
|