ClickHouse/dbms/tests/performance
2020-03-07 22:41:16 +03:00
..
agg_functions_min_max_any.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
and_function.xml Enforce single threaded check in existing test for logical functions 2020-02-28 20:05:10 +03:00
arithmetic.xml Add performance tests 2020-02-25 18:10:03 +08:00
array_element.xml fixup 2020-03-03 15:01:25 +03:00
array_fill.xml Remove infinite performance tests 2020-03-07 22:32:36 +03:00
array_join.xml Update array_join.xml 2020-03-02 23:02:55 +03:00
base64_hits.xml Remove infinite performance tests 2020-03-07 22:32:36 +03:00
base64.xml fixup 2020-03-03 15:01:25 +03:00
basename.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
bit_operations_fixed_string_numbers.xml Added another performance test for bit operations on FixedString #9091 2020-02-24 19:39:44 +03:00
bit_operations_fixed_string.xml add bitNot performance tests 2020-02-14 10:09:46 +01:00
bitCount.xml fixup 2020-03-02 18:37:44 +03:00
bloom_filter.xml Remove infinite performance tests 2020-03-07 22:32:36 +03:00
bounding_ratio.xml Change some endless performance tests (2) 2020-02-28 19:50:13 +03:00
cidr.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
codecs_float_insert.xml Fixed codec performance test 2020-01-10 19:00:31 +03:00
codecs_float_select.xml Fixed codec performance test 2020-01-10 19:00:31 +03:00
codecs_int_insert.xml Update codecs_int_insert.xml 2020-02-14 22:44:59 +03:00
codecs_int_select.xml Fixed codec performance test 2020-01-10 19:00:31 +03:00
collations.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
column_column_comparison.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
columns_hashing.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
complex_array_creation.xml Change some endless performance tests (2) 2020-02-28 19:50:13 +03:00
concat_hits.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
conditional.xml Change some endless performance tests (2) 2020-02-28 19:50:13 +03:00
consistent_hashes.xml Update consistent_hashes.xml 2020-03-02 23:40:17 +03:00
constant_column_comparison.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
constant_column_search.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
count.xml Change some endless performance tests (2) 2020-02-28 19:50:13 +03:00
cpu_synthetic.xml Update cpu_synthetic.xml 2020-02-13 11:56:06 +03:00
create_benchmark_page.py add string comparisons performance test [#CLICKHOUSE-3070] 2017-06-22 23:10:43 +03:00
cryptographic_hashes.xml fixup 2020-03-02 18:34:43 +03:00
date_parsing.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
date_time_64.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
date_time.xml fixup 2020-03-02 20:13:49 +03:00
decimal_aggregates.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
early_constant_folding.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
empty_string_deserialization.xml Faster performance tests (2) 2020-03-02 19:15:01 +03:00
empty_string_serialization.xml Added performance test to show degradation of performance in gcc-9 in more isolated way 2019-08-02 23:18:03 +03:00
entropy.xml Change endless performance tests (3) 2020-02-28 19:56:34 +03:00
first_significant_subdomain.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
fixed_string16.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
float_formatting.xml Change endless performance tests (3) 2020-02-28 19:56:34 +03:00
float_parsing.xml Change endless performance tests (3) 2020-02-28 19:56:34 +03:00
format_date_time.xml Change endless performance tests (3) 2020-02-28 19:56:34 +03:00
functions_coding.xml Change endless performance tests (3) 2020-02-28 19:56:34 +03:00
functions_geo.xml Change endless performance tests (4) 2020-02-28 20:02:43 +03:00
general_purpose_hashes_on_UUID.xml Update general_purpose_hashes_on_UUID.xml 2020-02-14 22:46:27 +03:00
general_purpose_hashes.xml Update general_purpose_hashes.xml 2020-02-07 22:01:13 +03:00
generate_table_function.xml fix query in perf test 2020-03-04 11:53:48 +03:00
great_circle_dist.xml Change endless performance tests (4) 2020-02-28 20:02:43 +03:00
group_array_moving_sum.xml fixup 2020-03-03 13:17:23 +03:00
h3.xml Change endless performance tests (4) 2020-02-28 20:02:43 +03:00
if_array_num.xml fixup 2020-03-03 13:17:23 +03:00
if_array_string.xml fixup 2020-03-03 13:17:23 +03:00
if_string_const.xml Change endless performance tests (5) 2020-03-02 19:51:12 +03:00
if_string_hits.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
if_to_multiif.xml Fixed error 2020-03-07 06:19:28 +03:00
information_value.xml Change endless performance tests (5) 2020-03-02 19:51:12 +03:00
insert_values_with_expressions.xml update tests 2019-12-16 13:24:02 +03:00
inserts_arrays_lowcardinality.xml Update inserts_arrays_lowcardinality.xml 2020-02-13 21:58:46 +03:00
int_parsing.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
IPv4.xml Remove <name> and <metrics> from performance tests fixed-5634 2019-06-18 19:55:13 +03:00
IPv6.xml Remove <name> and <metrics> from performance tests fixed-5634 2019-06-18 19:55:13 +03:00
jit_large_requests.xml Update jit_large_requests.xml 2019-07-05 15:59:52 +03:00
jit_small_requests.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
joins_in_memory_pmj.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
joins_in_memory.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
json_extract_rapidjson.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
json_extract_simdjson.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
leftpad.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
linear_regression.xml fixup 2020-03-03 13:09:47 +03:00
logical_functions_large.xml Adjusted test queries execution times to be between 200ms and 300ms 2020-03-03 16:07:57 +03:00
logical_functions_medium.xml Adjusted test queries execution times to be between 200ms and 300ms 2020-03-03 16:07:57 +03:00
logical_functions_small.xml Adjusted test queries execution times to be between 200ms and 300ms 2020-03-03 16:07:57 +03:00
math.xml Faster cases. 2020-02-27 22:40:22 +03:00
merge_table_streams.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
merge_tree_huge_pk.xml Update merge_tree_huge_pk.xml 2019-09-18 23:07:23 +03:00
merge_tree_many_partitions_2.xml Update merge_tree_many_partitions_2.xml 2020-03-02 23:38:11 +03:00
merge_tree_many_partitions.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
merge_tree_simple_select.xml Faster performance tests (2) 2020-03-02 19:15:01 +03:00
mingroupby-orderbylimit1.xml Remove infinite performance tests 2020-03-07 22:32:36 +03:00
modulo.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
ngram_distance.xml fixup 2020-03-02 18:59:37 +03:00
number_formatting_formats.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
nyc_taxi.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
order_by_decimals.xml [wip] performance comparison test 2020-01-16 17:29:53 +03:00
order_by_read_in_order.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
order_by_single_column.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
parallel_insert.xml updated perftest. 2019-12-19 22:31:06 +03:00
parse_engine_file.xml Added performance test for Avro format 2020-01-18 23:10:11 +03:00
prewhere.xml fixes 2020-02-28 21:49:31 +03:00
random_printable_ascii.xml Change endless performance tests (5) 2020-03-02 19:51:12 +03:00
range.xml Change endless performance tests (6) 2020-03-02 20:06:57 +03:00
read_hits_with_aio.xml fixup 2020-03-03 13:00:51 +03:00
README.md Removed outdated info 2020-03-07 22:41:16 +03:00
right.xml Change endless performance tests (6) 2020-03-02 20:06:57 +03:00
round_down.xml fixup 2020-03-03 13:00:51 +03:00
round_methods.xml Change endless performance tests (6) 2020-03-02 20:06:57 +03:00
scalar.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
select_format.xml Added performance test for Avro format 2020-01-18 23:10:11 +03:00
set_hits.xml Update set_hits.xml 2020-02-14 14:15:26 +03:00
set_index.xml optimization for one-element tuples at 'in' 2020-02-25 12:59:18 +03:00
set.xml fixup 2020-03-03 13:00:51 +03:00
simple_join_query.xml Update simple_join_query.xml 2020-03-07 04:04:41 +03:00
slices_hits.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
sort.xml Remove <name> and <metrics> from performance tests fixed-5634 2019-06-18 19:55:13 +03:00
string_join.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
string_set.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
string_sort.xml less flappy 2020-02-06 16:11:02 +03:00
sum_map.xml Remove infinite performance tests 2020-03-07 22:32:36 +03:00
synthetic_hardware_benchmark.xml Renamed a test 2020-03-07 22:33:06 +03:00
trim_numbers.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
trim_urls.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
trim_whitespace.xml faster 2020-03-03 16:38:20 +03:00
uniq.xml [wip] performance comparison test 2020-01-16 22:39:07 +03:00
url_hits.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
vectorize_aggregation_combinators.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
visit_param_extract_raw.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00
website.xml Removed some garbage from Performance Test 2020-01-07 12:10:36 +03:00

ClickHouse performance tests

This directory contains .xml-files with performance tests for clickhouse-performance-test tool.

How to write performance test

First of all you should check existing tests don't cover your case. If there are no such tests than you should write your own.

You have to specify preconditions. It contains table names. Only hits_100m_single, hits_10m_single, test.hits are available in CI.

The most important part of test is stop_conditions. Also you should always specify total_time_ms metric. Endless tests will be ignored by CI.

You can use substitions, create, fill and drop queries to prepare test. You can find examples in this folder.

Take into account, that these tests will run in CI which consists of 56-cores and 512 RAM machines. Queries will be executed much faster than on local laptop.

If your test continued more than 10 minutes, please, add tag long to have an opportunity to run all tests and skip long ones.

How to run performance test

You have to run clickhouse-server and after you can start testing:

$ clickhouse-performance-test --input-file my_lovely_test1.xml --input-file my_lovely_test2.xml
$ clickhouse-performance-test --input-file /my_lovely_test_dir/