ClickHouse/docs/en/operations/performance_test.md

77 lines
2.7 KiB
Markdown
Raw Normal View History

# How To Test Your Hardware With ClickHouse
With this instruction you can run basic ClickHouse performance test on any server without installation of ClickHouse packages.
2020-01-17 21:42:18 +00:00
\1. Go to "commits" page: [https://github.com/ClickHouse/ClickHouse/commits/master](https://github.com/ClickHouse/ClickHouse/commits/master)
2020-01-17 21:42:18 +00:00
\2. Click on the first green check mark or red cross with green "ClickHouse Build Check" and click on the "Details" link near "ClickHouse Build Check".
2020-01-17 21:42:18 +00:00
\3. Copy the link to "clickhouse" binary for amd64 or aarch64.
2020-01-17 21:42:18 +00:00
\4. ssh to the server and download it with wget:
```
# For amd64:
wget https://clickhouse-builds.s3.yandex.net/0/00ba767f5d2a929394ea3be193b1f79074a1c4bc/1578163263_binary/clickhouse
# For aarch64:
wget https://clickhouse-builds.s3.yandex.net/0/00ba767f5d2a929394ea3be193b1f79074a1c4bc/1578161264_binary/clickhouse
# Then do:
chmod a+x clickhouse
```
2020-01-17 21:42:18 +00:00
\5. Download configs:
```
wget https://raw.githubusercontent.com/ClickHouse/ClickHouse/master/dbms/programs/server/config.xml
wget https://raw.githubusercontent.com/ClickHouse/ClickHouse/master/dbms/programs/server/users.xml
mkdir config.d
wget https://raw.githubusercontent.com/ClickHouse/ClickHouse/master/dbms/programs/server/config.d/path.xml -O config.d/path.xml
wget https://raw.githubusercontent.com/ClickHouse/ClickHouse/master/dbms/programs/server/config.d/log_to_console.xml -O config.d/log_to_console.xml
```
2020-01-17 21:42:18 +00:00
\6. Download benchmark files:
```
wget https://raw.githubusercontent.com/ClickHouse/ClickHouse/master/dbms/benchmark/clickhouse/benchmark-new.sh
chmod a+x benchmark-new.sh
wget https://raw.githubusercontent.com/ClickHouse/ClickHouse/master/dbms/benchmark/clickhouse/queries.sql
```
2020-01-17 21:42:18 +00:00
\7. Download test data:
According to the instruction:
2020-01-17 21:42:18 +00:00
[https://clickhouse.yandex/docs/en/getting_started/example_datasets/metrica/](https://clickhouse.yandex/docs/en/getting_started/example_datasets/metrica/)
("hits" table containing 100 million rows)
```
wget https://clickhouse-datasets.s3.yandex.net/hits/partitions/hits_100m_obfuscated_v1.tar.xz
tar xvf hits_100m_obfuscated_v1.tar.xz -C .
mv hits_100m_obfuscated_v1/* .
```
2020-01-17 21:42:18 +00:00
\8. Run the server:
```
./clickhouse server
```
2020-01-17 21:42:18 +00:00
\9. Check the data:
ssh to the server in another terminal
```
./clickhouse client --query "SELECT count() FROM hits_100m_obfuscated"
100000000
```
2020-01-17 21:42:18 +00:00
\10. Edit the benchmark-new.sh, change "clickhouse-client" to "./clickhouse client" and add "--max_memory_usage 100000000000" parameter.
```
mcedit benchmark-new.sh
```
2020-01-17 21:42:18 +00:00
\11. Run the benchmark:
```
./benchmark-new.sh hits_100m_obfuscated
```
2020-01-17 21:42:18 +00:00
\12. Send the numbers and the info about your hardware configuration to clickhouse-feedback@yandex-team.com
All the results are published here: [https://clickhouse.yandex/benchmark_hardware.html](https://clickhouse.yandex/benchmark_hardware.html)