thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-26 09:32:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
5871ca0836
ClickHouse/docker/test
History
Azat Khuzhin 5871ca0836 Fix performance tests due to warnings from jemalloc about Per-CPU arena disabled 
jemalloc can show the following warning:

    Number of CPUs detected is not deterministic. Per-CPU arena disabled

It will be shown if one of the following returns different number of
CPUs:
- _SC_NPROCESSORS_ONLN
- _SC_NPROCESSORS_CONF
- sched_getaffinity()

And actually for my CPU linux returns different numbers, because there
are more possible CPUs then online, from dmesg:

    smpboot: Allowing 128 CPUs, 64 hotplug CPUs

And from sysfs:

    # grep . /sys/devices/system/cpu/{possible,online,offline}
    /sys/devices/system/cpu/possible:0-127
    /sys/devices/system/cpu/online:0-63
    /sys/devices/system/cpu/offline:64-127

From ACPI:

    # acpidump -o acpi
    # acpixtract -a acpi
    # iasl -d *.dat
    # grep -e 'Processor Enabled' apic.dsl | sort | uniq -c
        64                            Processor Enabled : 0
        64                            Processor Enabled : 1

So I guess this is the same as what happened in this perf run [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/51360/5d43a64112711b339b82b1c0e8df7882546a1a3c/performance_comparison_[4_4]/report.html

P.S. personally I, just use cmdline=possible_cpus=64 to fix this for my
setup.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-25 09:37:37 +02:00
..
base Add second_deadlock_stack=1 for TSan on CI 2023-04-10 15:05:57 +02:00
codebrowser Move tunnings for woboq codebrowser to cmake out from build.sh 2023-05-18 18:18:30 +02:00
compatibility Preparation 2021-09-06 14:33:39 +03:00
fasttest Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-10 16:28:36 +02:00
fuzzer Use LLVM 16 2023-03-18 23:45:57 +01:00
install Add tests for packages' installation 2023-02-03 12:16:16 +01:00
integration Using a proper --tls=false option to disable TLS 2023-04-19 13:33:15 +02:00
keeper-jepsen Use LLVM 16 2023-03-18 23:45:57 +01:00
performance-comparison Fix performance tests due to warnings from jemalloc about Per-CPU arena disabled 2023-06-25 09:37:37 +02:00
server-jepsen Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-08 22:33:52 +02:00
sqlancer Fix branch name 2023-06-19 10:06:56 +00:00
sqllogic turn on all CI back 2023-04-17 14:07:56 +02:00
stateful Merge pull request #47790 from CurtizJ/apply-black-to-all-files 2023-03-24 14:20:50 +03:00
stateless Fix the statless tests image for old commits 2023-06-13 17:53:19 +02:00
stress Enable back thread fuzzuer under TSan 2023-05-08 22:35:09 +02:00
style Update black version, run it for the repository 2023-03-24 11:54:38 +01:00
unit Update run.sh 2023-06-01 23:28:19 +03:00
upgrade suppress check for covered parts in zk 2023-06-20 23:53:32 +02:00
util docker: install libclang-16-dev for woboq code browser 2023-05-09 10:25:50 +02:00
README.md Changed repository URL 2019-09-23 19:18:19 +03:00

README.md

ClickHouse Test Docker Image

License

View license information for the software contained in this image.