ClickHouse/tests/performance
Alexander Kuzmenkov 1c52fdb265 cleanup
2020-12-28 13:08:38 +03:00
..
agg_functions_min_max_any.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
aggregate_functions_of_group_by_keys.xml
aggregating_merge_tree_simple_aggregate_function_string.xml Update aggregating_merge_tree_simple_aggregate_function_string.xml 2020-11-30 12:31:30 +03:00
aggregating_merge_tree.xml
aggregation_in_order.xml
analyze_array_tuples.xml
and_function.xml
any_anyLast.xml more fixes 2020-10-30 18:54:38 +03:00
arithmetic_operations_in_aggr_func.xml fixup 2020-07-03 11:39:43 +03:00
arithmetic.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
array_auc.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
array_element.xml
array_fill.xml
array_index_low_cardinality_numbers.xml In perf test array_index_lc: adjusted iterations count 2020-08-24 12:02:48 +03:00
array_index_low_cardinality_strings.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
array_join.xml
array_reduce.xml
async_remote_read.xml Added perftest. 2020-12-09 17:11:20 +03:00
avg_weighted.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
base64_hits.xml
base64.xml
basename.xml
bigint_arithm.xml Faster 256-bit multiplication (#15418) 2020-09-29 20:52:34 +03:00
bit_operations_fixed_string_numbers.xml
bit_operations_fixed_string.xml
bitCount.xml
bloom_filter_insert.xml Fix perf tests 2020-11-08 16:55:26 +03:00
bloom_filter_select.xml Update bloom_filter_select.xml 2020-11-09 17:58:27 +03:00
bounding_ratio.xml
cidr.xml
codecs_float_insert.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
codecs_float_select.xml
codecs_int_insert.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
codecs_int_select.xml
collations.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
column_column_comparison.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
ColumnMap.xml Update ColumnMap.xml 2020-12-22 01:16:51 +03:00
columns_hashing.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
complex_array_creation.xml
concat_hits.xml
conditional.xml
consistent_hashes.xml Remove perf test of sumbur hash, because we do not care 2020-11-08 21:17:30 +03:00
constant_column_comparison.xml
constant_column_search.xml Make some perf tests faster on slower machines 2020-12-23 05:40:55 +03:00
count.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
countMatches.xml Make some perf tests faster on slower machines 2020-12-23 05:40:55 +03:00
cpu_synthetic.xml Translate comments to english 2020-11-05 21:51:36 +03:00
cryptographic_hashes.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
date_parsing.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
date_time_64.xml fixup 2020-07-02 10:44:16 +03:00
date_time_long.xml Added tests for date_trunc function. 2020-08-25 16:41:23 -07:00
date_time_short.xml Update date_time_short perf test for toUnixTimestamp(Date()) 2020-11-25 21:17:11 +03:00
datetime_comparison.xml Fix datetime comparison 2020-09-23 10:29:55 +08:00
decimal_aggregates.xml Adjust ignore thresholds for unstable perf tests 2020-09-16 18:27:51 +03:00
decimal_casts.xml more fixes 2020-10-30 18:54:38 +03:00
decimal_parse.xml
distinct_combinator.xml
distributed_aggregation_memory_efficient.xml
distributed_aggregation.xml
duplicate_order_by_and_distinct.xml
early_constant_folding.xml
empty_string_deserialization.xml fixup 2020-07-02 10:44:16 +03:00
empty_string_serialization.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
encodeXMLComponent.xml Add perf test 2020-12-13 00:17:37 +03:00
encrypt_decrypt_empty_string_slow.xml Queries are too fast 2020-12-20 12:01:51 +03:00
encrypt_decrypt_empty_string.xml Remove unsupported ciphers 2020-12-17 22:09:27 +03:00
encrypt_decrypt.xml Update performance tests after speedup 2020-12-20 07:04:29 +03:00
entropy.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
extract.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
fixed_string16.xml
float_formatting.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
float_mod.xml Add performance test 2020-07-21 13:38:14 +03:00
float_parsing.xml fixup 2020-07-02 10:44:16 +03:00
format_date_time.xml
format_readable.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
functions_coding.xml
functions_geo.xml
functions_with_hash_tables.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
fuzz_bits.xml
general_purpose_hashes_on_UUID.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
general_purpose_hashes.xml Make some perf tests faster on slower machines 2020-12-23 05:40:55 +03:00
generate_table_function.xml Make some perf tests faster on slower machines 2020-12-23 05:40:55 +03:00
great_circle_dist.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
group_array_moving_sum.xml
group_by_sundy_li.xml Update group_by_sundy_li.xml 2020-11-04 18:07:18 +03:00
h3.xml
if_array_num.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
if_array_string.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
if_string_const.xml
if_string_hits.xml
if_to_multiif.xml fixup 2020-07-02 10:44:16 +03:00
if_transform_strings_to_enum.xml Try to make if_transform_strings perf test faster (#12598) 2020-07-21 13:34:55 +03:00
information_value.xml
injective_functions_inside_uniq.xml Delete injective functions inside uniq (#12337) 2020-07-10 13:42:41 +03:00
insert_parallel.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
insert_select_default_small_block.xml
insert_sequential_and_background_merges.xml Rename test 2020-10-23 13:42:15 +03:00
insert_values_with_expressions.xml Update insert_values_with_expressions.xml 2020-09-22 13:23:10 +03:00
inserts_arrays_lowcardinality.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
int_parsing.xml Update int_parsing.xml 2020-07-08 12:40:33 +03:00
ip_trie.xml Regenerate ya.make, add format null to ip_trie.xml 2020-11-24 11:20:11 +03:00
IPv4.xml
IPv6.xml
jit_large_requests.xml more fixes 2020-10-30 18:54:38 +03:00
jit_small_requests.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
joins_in_memory_pmj.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
joins_in_memory.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
json_extract_rapidjson.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
json_extract_simdjson.xml
least_greatest_hits.xml fixes 2020-07-09 13:46:16 +03:00
leftpad.xml fixup 2020-07-02 10:44:16 +03:00
linear_regression.xml More robust 2020-08-24 03:14:24 +03:00
local_replica.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
logical_functions_large.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
logical_functions_medium.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
logical_functions_small.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
materialized_view_parallel_insert.xml Do not use SET via <full_query> in perf tests 2020-11-21 14:02:21 +03:00
math.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
merge_table_streams.xml
merge_tree_huge_pk.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
merge_tree_many_partitions_2.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
merge_tree_many_partitions.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
merge_tree_simple_select.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
mingroupby-orderbylimit1.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
modulo.xml
monotonous_order_by.xml Optimize monotonous ORDER BY (#12467) 2020-07-15 13:10:21 +03:00
ngram_distance.xml
number_formatting_formats.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
nyc_taxi.xml
optimized_select_final.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
or_null_default.xml Add a test 2020-11-04 14:00:43 +03:00
order_by_decimals.xml
order_by_read_in_order.xml more fixes 2020-10-30 18:54:38 +03:00
order_by_single_column.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
order_with_limit.xml Merge branch 'master' into remove-useless-setting-from-perf-test 2020-07-14 09:31:34 +03:00
parallel_final.xml
parallel_index.xml Don't account for short queries, we'll deal with them separately. 2020-09-17 13:00:51 +03:00
parallel_insert.xml Do not use SET via <full_query> in perf tests 2020-11-21 14:02:21 +03:00
parallel_mv.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
parse_engine_file.xml Try 12 threads max in perf test. 2020-11-09 19:14:05 +03:00
point_in_polygon_const.xml
point_in_polygon.xml Disable "optimize_trivial_insert_select" for one perf test 2020-08-26 01:33:31 +03:00
polymorphic_parts_l.xml Update polymorphic_parts_l.xml 2020-07-03 11:46:48 +03:00
polymorphic_parts_m.xml Update polymorphic_parts_m.xml 2020-07-03 11:46:29 +03:00
polymorphic_parts_s.xml Merge remote-tracking branch 'origin' into CurtizJ-polymorphic-parts 2020-07-06 21:34:17 +03:00
pre_limit_no_sorting.xml
prewhere.xml
push_down_limit.xml Make some perf tests faster on slower machines 2020-12-23 05:40:55 +03:00
quantile_merge.xml Marked some perf test queries as short 2020-11-11 19:58:31 +03:00
questdb_sum_float32.xml split 2020-07-07 11:01:50 +03:00
questdb_sum_float64.xml too slow 2020-07-07 20:07:04 +03:00
questdb_sum_int32.xml split 2020-07-07 11:01:50 +03:00
rand.xml Try 12 threads max in perf test. 2020-11-09 19:14:05 +03:00
random_fixed_string.xml fixup 2020-07-02 10:44:16 +03:00
random_printable_ascii.xml Adjust ignore thresholds for unstable perf tests 2020-09-16 18:27:51 +03:00
random_string_utf8.xml more fixes 2020-10-30 18:54:38 +03:00
random_string.xml more fixes 2020-10-30 18:54:38 +03:00
range.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
read_from_comp_parts.xml Mark query short 2020-07-24 16:59:50 +03:00
read_hits_with_aio.xml
read_in_order_many_parts.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
README.md Update instruction for perf tests 2020-08-26 20:34:05 +03:00
redundant_functions_in_order_by.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
removing_group_by_keys.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
right.xml
round_down.xml make the test longer 2020-10-30 18:16:30 +03:00
round_methods.xml fixup 2020-07-02 10:44:16 +03:00
scalar.xml
select_format.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
set_hits.xml
set_index.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
set.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
simple_join_query.xml
single_fixed_string_groupby.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
slices_hits.xml
sort_radix_trivial.xml
sort.xml
string_join.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
string_set.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
string_sort.xml Make some perf tests faster on slower machines 2020-12-23 05:40:55 +03:00
sum_map.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
sum.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
synthetic_hardware_benchmark.xml Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
trim_numbers.xml
trim_urls.xml fix 2020-11-13 08:00:43 +03:00
trim_whitespace.xml
uniq.xml Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
url_hits.xml Make some perf tests faster on slower machines 2020-12-23 05:40:55 +03:00
vectorize_aggregation_combinators.xml
visit_param_extract_raw.xml
website.xml Make some perf tests faster on slower machines 2020-12-23 05:40:55 +03:00
window_functions.xml cleanup 2020-12-28 13:08:38 +03:00

ClickHouse performance tests

This directory contains .xml-files with performance tests for @akuzm tool.

How to write performance test

First of all you should check existing tests don't cover your case. If there are no such tests than you should write your own.

You have to specify preconditions. It contains table names. Only hits_100m_single, hits_10m_single, test.hits are available in CI.

You can use substitions, create, fill and drop queries to prepare test. You can find examples in this folder.

Take into account, that these tests will run in CI which consists of 56-cores and 512 RAM machines. Queries will be executed much faster than on local laptop.

If your test continued more than 10 minutes, please, add tag long to have an opportunity to run all tests and skip long ones.

How to run performance test

TODO @akuzm

How to validate single test

pip3 install clickhouse_driver
../../docker/test/performance-comparison/perf.py --runs 1 insert_parallel.xml