ClickHouse/tests/performance
alexey-milovidov d1b72f10d5
Merge pull request #10325 from Avogar/msgpack_format
Improve MsgPackRowInputFormat
2020-04-18 14:27:11 +03:00
..
agg_functions_min_max_any.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
analyze_array_tuples.xml Performance comparison fixes 2020-04-02 21:44:58 +03:00
and_function.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
arithmetic.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
array_auc.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
array_element.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
array_fill.xml performance comparison 2020-04-16 23:55:21 +03:00
array_join.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
array_reduce.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
base64_hits.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
base64.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
basename.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
bit_operations_fixed_string_numbers.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
bit_operations_fixed_string.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
bitCount.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
bloom_filter.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
bounding_ratio.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
cidr.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
codecs_float_insert.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
codecs_float_select.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
codecs_int_insert.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
codecs_int_select.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
collations.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
column_column_comparison.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
columns_hashing.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
complex_array_creation.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
concat_hits.xml Performance comparison fixes 2020-04-02 21:44:58 +03:00
conditional.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
consistent_hashes.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
constant_column_comparison.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
constant_column_search.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
count.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
cpu_synthetic.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
create_benchmark_page.py Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
cryptographic_hashes.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
date_parsing.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
date_time_64.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
date_time.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
decimal_aggregates.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
distributed_aggregation.xml Merge remote-tracking branch 'origin/master' into HEAD 2020-04-16 23:03:17 +03:00
early_constant_folding.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
empty_string_deserialization.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
empty_string_serialization.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
entropy.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
first_significant_subdomain.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
fixed_string16.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
float_formatting.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
float_parsing.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
format_date_time.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
functions_coding.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
functions_geo.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
general_purpose_hashes_on_UUID.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
general_purpose_hashes.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
generate_table_function.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
great_circle_dist.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
group_array_moving_sum.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
h3.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
if_array_num.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
if_array_string.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
if_string_const.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
if_string_hits.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
if_to_multiif.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
information_value.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
insert_values_with_expressions.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
inserts_arrays_lowcardinality.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
int_parsing.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
IPv4.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
IPv6.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
jit_large_requests.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
jit_small_requests.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
joins_in_memory_pmj.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
joins_in_memory.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
json_extract_rapidjson.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
json_extract_simdjson.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
leftpad.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
linear_regression.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
logical_functions_large.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
logical_functions_medium.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
logical_functions_small.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
math.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
merge_table_streams.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
merge_tree_huge_pk.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
merge_tree_many_partitions_2.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
merge_tree_many_partitions.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
merge_tree_simple_select.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
mingroupby-orderbylimit1.xml performance comparison 2020-04-16 23:55:21 +03:00
modulo.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
ngram_distance.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
number_formatting_formats.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
nyc_taxi.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
order_by_decimals.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
order_by_read_in_order.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
order_by_single_column.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
parallel_insert.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
parse_engine_file.xml Update parse_engine_file.xml 2020-04-15 22:07:50 +03:00
pre_limit_no_sorting.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
prewhere.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
random_printable_ascii.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
range.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
read_hits_with_aio.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
README.md Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
right.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
round_down.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
round_methods.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
scalar.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
select_format.xml Improve MsgPackRowInputFormat 2020-04-17 12:35:38 +03:00
set_hits.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
set_index.xml improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
set.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
simple_join_query.xml performance comparison 2020-04-16 23:55:21 +03:00
slices_hits.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
sort.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
string_join.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
string_set.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
string_sort.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
sum_map.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
synthetic_hardware_benchmark.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
trim_numbers.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
trim_urls.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
trim_whitespace.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
uniq.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
url_hits.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
vectorize_aggregation_combinators.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
visit_param_extract_raw.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
website.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00

ClickHouse performance tests

This directory contains .xml-files with performance tests for clickhouse-performance-test tool.

How to write performance test

First of all you should check existing tests don't cover your case. If there are no such tests than you should write your own.

You have to specify preconditions. It contains table names. Only hits_100m_single, hits_10m_single, test.hits are available in CI.

The most important part of test is stop_conditions. Also you should always specify total_time_ms metric. Endless tests will be ignored by CI.

You can use substitions, create, fill and drop queries to prepare test. You can find examples in this folder.

Take into account, that these tests will run in CI which consists of 56-cores and 512 RAM machines. Queries will be executed much faster than on local laptop.

If your test continued more than 10 minutes, please, add tag long to have an opportunity to run all tests and skip long ones.

How to run performance test

You have to run clickhouse-server and after you can start testing:

$ clickhouse-performance-test --input-file my_lovely_test1.xml --input-file my_lovely_test2.xml
$ clickhouse-performance-test --input-file /my_lovely_test_dir/