ClickHouse/tests/performance
alexey-milovidov d296e1b6d7
Merge pull request #10216 from Avogar/msgpack_format
Update MsgPack format
2020-04-16 00:44:08 +03:00
..
agg_functions_min_max_any.xml
analyze_array_tuples.xml Performance comparison fixes 2020-04-02 21:44:58 +03:00
and_function.xml
arithmetic.xml
array_auc.xml
array_element.xml
array_fill.xml Performance comparison fixes 2020-04-02 21:44:58 +03:00
array_join.xml
array_reduce.xml
base64_hits.xml
base64.xml
basename.xml
bit_operations_fixed_string_numbers.xml
bit_operations_fixed_string.xml
bitCount.xml
bloom_filter.xml
bounding_ratio.xml
cidr.xml
codecs_float_insert.xml
codecs_float_select.xml
codecs_int_insert.xml
codecs_int_select.xml
collations.xml
column_column_comparison.xml
columns_hashing.xml
complex_array_creation.xml
concat_hits.xml Performance comparison fixes 2020-04-02 21:44:58 +03:00
conditional.xml
consistent_hashes.xml
constant_column_comparison.xml
constant_column_search.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
count.xml
cpu_synthetic.xml
create_benchmark_page.py
cryptographic_hashes.xml
date_parsing.xml
date_time_64.xml
date_time.xml
decimal_aggregates.xml
distributed_aggregation.xml
early_constant_folding.xml
empty_string_deserialization.xml
empty_string_serialization.xml
entropy.xml
first_significant_subdomain.xml
fixed_string16.xml
float_formatting.xml
float_parsing.xml
format_date_time.xml
functions_coding.xml
functions_geo.xml
general_purpose_hashes_on_UUID.xml
general_purpose_hashes.xml
generate_table_function.xml
great_circle_dist.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
group_array_moving_sum.xml
h3.xml
if_array_num.xml
if_array_string.xml
if_string_const.xml
if_string_hits.xml
if_to_multiif.xml
information_value.xml
insert_values_with_expressions.xml
inserts_arrays_lowcardinality.xml
int_parsing.xml
IPv4.xml
IPv6.xml
jit_large_requests.xml
jit_small_requests.xml
joins_in_memory_pmj.xml
joins_in_memory.xml
json_extract_rapidjson.xml
json_extract_simdjson.xml
leftpad.xml
linear_regression.xml
logical_functions_large.xml
logical_functions_medium.xml
logical_functions_small.xml
math.xml
merge_table_streams.xml
merge_tree_huge_pk.xml
merge_tree_many_partitions_2.xml
merge_tree_many_partitions.xml
merge_tree_simple_select.xml
mingroupby-orderbylimit1.xml
modulo.xml
ngram_distance.xml
number_formatting_formats.xml
nyc_taxi.xml
order_by_decimals.xml
order_by_read_in_order.xml
order_by_single_column.xml
parallel_insert.xml
parse_engine_file.xml Update parse_engine_file.xml 2020-04-15 22:07:50 +03:00
pre_limit_no_sorting.xml
prewhere.xml
random_printable_ascii.xml
range.xml
read_hits_with_aio.xml
README.md
right.xml
round_down.xml
round_methods.xml
scalar.xml
select_format.xml Update select_format.xml 2020-04-16 00:43:58 +03:00
set_hits.xml
set_index.xml improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
set.xml
simple_join_query.xml
slices_hits.xml
sort.xml
string_join.xml
string_set.xml
string_sort.xml
sum_map.xml
synthetic_hardware_benchmark.xml
trim_numbers.xml
trim_urls.xml
trim_whitespace.xml
uniq.xml
url_hits.xml
vectorize_aggregation_combinators.xml
visit_param_extract_raw.xml
website.xml

ClickHouse performance tests

This directory contains .xml-files with performance tests for clickhouse-performance-test tool.

How to write performance test

First of all you should check existing tests don't cover your case. If there are no such tests than you should write your own.

You have to specify preconditions. It contains table names. Only hits_100m_single, hits_10m_single, test.hits are available in CI.

The most important part of test is stop_conditions. Also you should always specify total_time_ms metric. Endless tests will be ignored by CI.

You can use substitions, create, fill and drop queries to prepare test. You can find examples in this folder.

Take into account, that these tests will run in CI which consists of 56-cores and 512 RAM machines. Queries will be executed much faster than on local laptop.

If your test continued more than 10 minutes, please, add tag long to have an opportunity to run all tests and skip long ones.

How to run performance test

You have to run clickhouse-server and after you can start testing:

$ clickhouse-performance-test --input-file my_lovely_test1.xml --input-file my_lovely_test2.xml
$ clickhouse-performance-test --input-file /my_lovely_test_dir/