ClickHouse/dbms/tests/performance
Alexander Kuzmenkov 9b4e45748a fixup
2020-03-12 21:26:02 +03:00
..
agg_functions_min_max_any.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
and_function.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
arithmetic.xml fixup 2020-03-12 20:04:06 +03:00
array_element.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
array_fill.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
array_join.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
base64_hits.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
base64.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
basename.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
bit_operations_fixed_string_numbers.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
bit_operations_fixed_string.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
bitCount.xml Normalize running time of some queries in performance tests 2020-03-08 23:28:17 +03:00
bloom_filter.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
bounding_ratio.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
cidr.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
codecs_float_insert.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
codecs_float_select.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
codecs_int_insert.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
codecs_int_select.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
collations.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
column_column_comparison.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
columns_hashing.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
complex_array_creation.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
concat_hits.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
conditional.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
consistent_hashes.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
constant_column_comparison.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
constant_column_search.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
count.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
cpu_synthetic.xml more stable queries 2020-03-12 00:14:25 +03:00
create_benchmark_page.py add string comparisons performance test [#CLICKHOUSE-3070] 2017-06-22 23:10:43 +03:00
cryptographic_hashes.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
date_parsing.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
date_time_64.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
date_time.xml Normalize running time of some queries in performance tests 2020-03-08 23:28:17 +03:00
decimal_aggregates.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
early_constant_folding.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
empty_string_deserialization.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
empty_string_serialization.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
entropy.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
first_significant_subdomain.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
fixed_string16.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
float_formatting.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
float_parsing.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
format_date_time.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
functions_coding.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
functions_geo.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
general_purpose_hashes_on_UUID.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
general_purpose_hashes.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
generate_table_function.xml Normalize running time of some queries in performance tests 2020-03-08 23:28:17 +03:00
great_circle_dist.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
group_array_moving_sum.xml fixup 2020-03-12 20:04:06 +03:00
h3.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
if_array_num.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
if_array_string.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
if_string_const.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
if_string_hits.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
if_to_multiif.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
information_value.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
insert_values_with_expressions.xml Fix some performance tests 2020-03-12 00:08:08 +03:00
inserts_arrays_lowcardinality.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
int_parsing.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
IPv4.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
IPv6.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
jit_large_requests.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
jit_small_requests.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
joins_in_memory_pmj.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
joins_in_memory.xml fixup 2020-03-12 12:37:57 +03:00
json_extract_rapidjson.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
json_extract_simdjson.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
leftpad.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
linear_regression.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
logical_functions_large.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
logical_functions_medium.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
logical_functions_small.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
math.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
merge_table_streams.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
merge_tree_huge_pk.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
merge_tree_many_partitions_2.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
merge_tree_many_partitions.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
merge_tree_simple_select.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
mingroupby-orderbylimit1.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
modulo.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
ngram_distance.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
number_formatting_formats.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
nyc_taxi.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
order_by_decimals.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
order_by_read_in_order.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
order_by_single_column.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
parallel_insert.xml fixup 2020-03-12 21:26:02 +03:00
parse_engine_file.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
prewhere.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
random_printable_ascii.xml more stable queries 2020-03-12 00:14:25 +03:00
range.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
read_hits_with_aio.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
README.md Removed outdated info 2020-03-07 22:41:16 +03:00
right.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
round_down.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
round_methods.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
scalar.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
select_format.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
set_hits.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
set_index.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
set.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
simple_join_query.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
slices_hits.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
sort.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
string_join.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
string_set.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
string_sort.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
sum_map.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
synthetic_hardware_benchmark.xml Fix some performance tests 2020-03-12 00:08:08 +03:00
trim_numbers.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
trim_urls.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
trim_whitespace.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
uniq.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
url_hits.xml Addition to prev. revision 2020-03-07 22:44:18 +03:00
vectorize_aggregation_combinators.xml fixup 2020-03-11 23:40:26 +03:00
visit_param_extract_raw.xml Update perftest after zeros. 2020-03-11 14:22:10 +03:00
website.xml fixup 2020-03-12 20:04:06 +03:00

ClickHouse performance tests

This directory contains .xml-files with performance tests for clickhouse-performance-test tool.

How to write performance test

First of all you should check existing tests don't cover your case. If there are no such tests than you should write your own.

You have to specify preconditions. It contains table names. Only hits_100m_single, hits_10m_single, test.hits are available in CI.

The most important part of test is stop_conditions. Also you should always specify total_time_ms metric. Endless tests will be ignored by CI.

You can use substitions, create, fill and drop queries to prepare test. You can find examples in this folder.

Take into account, that these tests will run in CI which consists of 56-cores and 512 RAM machines. Queries will be executed much faster than on local laptop.

If your test continued more than 10 minutes, please, add tag long to have an opportunity to run all tests and skip long ones.

How to run performance test

You have to run clickhouse-server and after you can start testing:

$ clickhouse-performance-test --input-file my_lovely_test1.xml --input-file my_lovely_test2.xml
$ clickhouse-performance-test --input-file /my_lovely_test_dir/