ClickHouse/tests/performance
alexey-milovidov d296e1b6d7
Merge pull request #10216 from Avogar/msgpack_format
Update MsgPack format
2020-04-16 00:44:08 +03:00
..
agg_functions_min_max_any.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
analyze_array_tuples.xml Performance comparison fixes 2020-04-02 21:44:58 +03:00
and_function.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
arithmetic.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
array_auc.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
array_element.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
array_fill.xml Performance comparison fixes 2020-04-02 21:44:58 +03:00
array_join.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
array_reduce.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
base64_hits.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
base64.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
basename.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
bit_operations_fixed_string_numbers.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
bit_operations_fixed_string.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
bitCount.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
bloom_filter.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
bounding_ratio.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
cidr.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
codecs_float_insert.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
codecs_float_select.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
codecs_int_insert.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
codecs_int_select.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
collations.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
column_column_comparison.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
columns_hashing.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
complex_array_creation.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
concat_hits.xml Performance comparison fixes 2020-04-02 21:44:58 +03:00
conditional.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
consistent_hashes.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
constant_column_comparison.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
constant_column_search.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
count.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
cpu_synthetic.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
create_benchmark_page.py Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
cryptographic_hashes.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
date_parsing.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
date_time_64.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
date_time.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
decimal_aggregates.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
distributed_aggregation.xml Move more dbms/tests to top-level 2020-04-02 03:32:39 +03:00
early_constant_folding.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
empty_string_deserialization.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
empty_string_serialization.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
entropy.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
first_significant_subdomain.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
fixed_string16.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
float_formatting.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
float_parsing.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
format_date_time.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
functions_coding.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
functions_geo.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
general_purpose_hashes_on_UUID.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
general_purpose_hashes.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
generate_table_function.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
great_circle_dist.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
group_array_moving_sum.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
h3.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
if_array_num.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
if_array_string.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
if_string_const.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
if_string_hits.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
if_to_multiif.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
information_value.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
insert_values_with_expressions.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
inserts_arrays_lowcardinality.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
int_parsing.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
IPv4.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
IPv6.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
jit_large_requests.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
jit_small_requests.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
joins_in_memory_pmj.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
joins_in_memory.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
json_extract_rapidjson.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
json_extract_simdjson.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
leftpad.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
linear_regression.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
logical_functions_large.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
logical_functions_medium.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
logical_functions_small.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
math.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
merge_table_streams.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
merge_tree_huge_pk.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
merge_tree_many_partitions_2.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
merge_tree_many_partitions.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
merge_tree_simple_select.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
mingroupby-orderbylimit1.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
modulo.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
ngram_distance.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
number_formatting_formats.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
nyc_taxi.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
order_by_decimals.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
order_by_read_in_order.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
order_by_single_column.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
parallel_insert.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
parse_engine_file.xml Update parse_engine_file.xml 2020-04-15 22:07:50 +03:00
pre_limit_no_sorting.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
prewhere.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
random_printable_ascii.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
range.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
read_hits_with_aio.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
README.md Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
right.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
round_down.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
round_methods.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
scalar.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
select_format.xml Update select_format.xml 2020-04-16 00:43:58 +03:00
set_hits.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
set_index.xml improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
set.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
simple_join_query.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
slices_hits.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
sort.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
string_join.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
string_set.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
string_sort.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
sum_map.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
synthetic_hardware_benchmark.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
trim_numbers.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
trim_urls.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
trim_whitespace.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
uniq.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
url_hits.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
vectorize_aggregation_combinators.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
visit_param_extract_raw.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
website.xml Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00

ClickHouse performance tests

This directory contains .xml-files with performance tests for clickhouse-performance-test tool.

How to write performance test

First of all you should check existing tests don't cover your case. If there are no such tests than you should write your own.

You have to specify preconditions. It contains table names. Only hits_100m_single, hits_10m_single, test.hits are available in CI.

The most important part of test is stop_conditions. Also you should always specify total_time_ms metric. Endless tests will be ignored by CI.

You can use substitions, create, fill and drop queries to prepare test. You can find examples in this folder.

Take into account, that these tests will run in CI which consists of 56-cores and 512 RAM machines. Queries will be executed much faster than on local laptop.

If your test continued more than 10 minutes, please, add tag long to have an opportunity to run all tests and skip long ones.

How to run performance test

You have to run clickhouse-server and after you can start testing:

$ clickhouse-performance-test --input-file my_lovely_test1.xml --input-file my_lovely_test2.xml
$ clickhouse-performance-test --input-file /my_lovely_test_dir/