ClickHouse/tests/performance
alexey-milovidov 626b709085
Merge pull request #13055 from ClickHouse/fixed-hash-map-implicit-zero
Slightly improve the inner loop of aggregation by UInt8/UInt16 keys
2020-08-02 01:09:00 +03:00
..
agg_functions_min_max_any.xml Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
aggregate_functions_of_group_by_keys.xml Eliminate min/max/any aggregators of GROUP BY keys in SELECT section (#11667) 2020-06-17 12:32:43 +03:00
aggregating_merge_tree.xml Update aggregating_merge_tree.xml 2020-06-09 01:41:57 +03:00
aggregation_in_order.xml better test 2020-05-31 03:00:16 +03:00
analyze_array_tuples.xml Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
and_function.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
any_anyLast.xml Any input optimize (#11529) 2020-06-18 19:34:29 +03:00
arithmetic_operations_in_aggr_func.xml fixup 2020-07-03 11:39:43 +03:00
arithmetic.xml remove vectorization from binary arithmetic 2020-05-29 07:35:04 +02:00
array_auc.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
array_element.xml More stable perf tests 2020-06-08 16:57:33 +03:00
array_fill.xml
array_join.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
array_reduce.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
base64_hits.xml fixup 2020-06-09 16:29:07 +03:00
base64.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
basename.xml fixup 2020-06-09 16:29:07 +03:00
bit_operations_fixed_string_numbers.xml More stable perf tests 2020-06-08 16:57:33 +03:00
bit_operations_fixed_string.xml fixup 2020-06-09 01:13:08 +03:00
bitCount.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
bloom_filter.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
bounding_ratio.xml Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
cidr.xml Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
codecs_float_insert.xml Improve data layout in perf test 2020-07-13 14:31:15 +03:00
codecs_float_select.xml Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
codecs_int_insert.xml More stable perf tests 2020-06-08 16:57:33 +03:00
codecs_int_select.xml Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
collations.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
column_column_comparison.xml fix more queries 2020-06-26 22:11:43 +03:00
columns_hashing.xml Fix long tests, part 2 2020-05-24 23:35:49 +03:00
complex_array_creation.xml fix more queries 2020-06-26 22:11:43 +03:00
concat_hits.xml Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
conditional.xml fix more queries 2020-06-26 22:11:43 +03:00
consistent_hashes.xml Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
constant_column_comparison.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
constant_column_search.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
count.xml fix more queries 2020-06-26 22:11:43 +03:00
cpu_synthetic.xml Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:19:26 +03:00
cryptographic_hashes.xml fixes 2020-07-08 13:35:49 +03:00
date_parsing.xml Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
date_time_64.xml fixup 2020-07-02 10:44:16 +03:00
date_time_long.xml make a short test for DateTime 2020-06-29 10:58:50 +03:00
date_time_short.xml make a short test for DateTime 2020-06-29 10:58:50 +03:00
decimal_aggregates.xml Update decimal_aggregates.xml 2020-07-17 18:27:05 +03:00
decimal_parse.xml Added performance test 2020-05-17 06:16:34 +03:00
distinct_combinator.xml more optimal aggregate functions with both 'if' and 'distinct' combinators 2020-06-22 17:57:30 +03:00
distributed_aggregation_memory_efficient.xml Try fix perftest. 2020-05-06 21:53:40 +03:00
distributed_aggregation.xml
duplicate_order_by_and_distinct.xml fix more queries 2020-06-26 22:11:43 +03:00
early_constant_folding.xml fix more queries 2020-06-26 22:11:43 +03:00
empty_string_deserialization.xml fixup 2020-07-02 10:44:16 +03:00
empty_string_serialization.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
entropy.xml fixup 2020-07-03 11:39:43 +03:00
extract.xml extractAllGroupsHorizontal and extractAllGroupsVertical 2020-06-11 11:03:17 +03:00
first_significant_subdomain.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
fixed_string16.xml fix more queries 2020-06-26 22:11:43 +03:00
float_formatting.xml fixup 2020-06-29 17:09:51 +03:00
float_mod.xml Add performance test 2020-07-21 13:38:14 +03:00
float_parsing.xml fixup 2020-07-02 10:44:16 +03:00
format_date_time.xml fix more queries 2020-06-26 22:11:43 +03:00
functions_coding.xml fix more queries 2020-06-26 22:11:43 +03:00
functions_geo.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
functions_with_hash_tables.xml Update functions_with_hash_tables.xml 2020-05-27 10:58:29 +03:00
fuzz_bits.xml fix issues 2020-05-29 05:06:21 +03:00
general_purpose_hashes_on_UUID.xml performance comparison 2020-04-30 08:10:34 +03:00
general_purpose_hashes.xml Update general_purpose_hashes.xml 2020-06-21 21:32:12 +03:00
generate_table_function.xml fixup 2020-07-03 11:39:43 +03:00
great_circle_dist.xml Update great_circle_dist.xml 2020-06-21 21:31:58 +03:00
group_array_moving_sum.xml performance comparison 2020-04-29 09:30:37 +03:00
h3.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
if_array_num.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
if_array_string.xml performance comparison 2020-04-28 10:45:56 +03:00
if_string_const.xml fix more queries 2020-06-26 22:11:43 +03:00
if_string_hits.xml fix more queries 2020-06-26 22:11:43 +03:00
if_to_multiif.xml fixup 2020-07-02 10:44:16 +03:00
if_transform_strings_to_enum.xml Try to make if_transform_strings perf test faster (#12598) 2020-07-21 13:34:55 +03:00
information_value.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
injective_functions_inside_uniq.xml Delete injective functions inside uniq (#12337) 2020-07-10 13:42:41 +03:00
insert_select_default_small_block.xml Add performance test 2020-05-29 05:30:49 +03:00
insert_values_with_expressions.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
inserts_arrays_lowcardinality.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
int_parsing.xml Update int_parsing.xml 2020-07-08 12:40:33 +03:00
IPv4.xml fix more queries 2020-06-26 22:11:43 +03:00
IPv6.xml fix more queries 2020-06-26 22:11:43 +03:00
jit_large_requests.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
jit_small_requests.xml fix more queries 2020-06-26 22:11:43 +03:00
joins_in_memory_pmj.xml RIGHT and FULL JOIN for MergeJoin (#12118) 2020-07-10 21:10:06 +03:00
joins_in_memory.xml RIGHT and FULL JOIN for MergeJoin (#12118) 2020-07-10 21:10:06 +03:00
json_extract_rapidjson.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
json_extract_simdjson.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
least_greatest_hits.xml fixes 2020-07-09 13:46:16 +03:00
leftpad.xml fixup 2020-07-02 10:44:16 +03:00
linear_regression.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
local_replica.xml Added perftest. 2020-07-27 17:27:26 +03:00
logical_functions_large.xml performance comparison 2020-05-19 18:28:03 +03:00
logical_functions_medium.xml performance comparison 2020-05-19 18:28:03 +03:00
logical_functions_small.xml performance comparison 2020-05-19 18:28:03 +03:00
materialized_view_parallel_insert.xml Update materialized_view_parallel_insert.xml 2020-04-18 15:41:15 +03:00
math.xml performance comparison 2020-04-28 10:45:56 +03:00
merge_table_streams.xml Update merge_table_streams.xml 2020-05-23 23:45:28 +03:00
merge_tree_huge_pk.xml fix more queries 2020-06-26 22:11:43 +03:00
merge_tree_many_partitions_2.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
merge_tree_many_partitions.xml fix more queries 2020-06-26 22:11:43 +03:00
merge_tree_simple_select.xml fix more queries 2020-06-26 22:11:43 +03:00
mingroupby-orderbylimit1.xml performance comparison 2020-05-19 18:28:03 +03:00
modulo.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
monotonous_order_by.xml Optimize monotonous ORDER BY (#12467) 2020-07-15 13:10:21 +03:00
ngram_distance.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
number_formatting_formats.xml fixup 2020-06-09 01:13:08 +03:00
nyc_taxi.xml Edited strange test 2020-05-23 17:53:54 +03:00
order_by_decimals.xml Updated perftests. 2020-06-17 13:00:28 +03:00
order_by_read_in_order.xml Edited strange test 2020-05-23 17:53:54 +03:00
order_by_single_column.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
order_with_limit.xml Merge branch 'master' into remove-useless-setting-from-perf-test 2020-07-14 09:31:34 +03:00
parallel_final.xml Try make tests faster. 2020-04-30 20:58:09 +03:00
parallel_index.xml Added perftest. 2020-07-21 19:28:30 +03:00
parallel_insert.xml Edited strange test 2020-05-23 17:53:54 +03:00
parallel_mv.xml Update test. 2020-06-01 12:12:03 +03:00
parse_engine_file.xml performance comparison 2020-04-30 08:10:34 +03:00
point_in_polygon_const.xml fix more queries 2020-06-26 22:11:43 +03:00
point_in_polygon.xml fixup 2020-06-09 01:13:08 +03:00
polymorphic_parts_l.xml Update polymorphic_parts_l.xml 2020-07-03 11:46:48 +03:00
polymorphic_parts_m.xml Update polymorphic_parts_m.xml 2020-07-03 11:46:29 +03:00
polymorphic_parts_s.xml Merge remote-tracking branch 'origin' into CurtizJ-polymorphic-parts 2020-07-06 21:34:17 +03:00
pre_limit_no_sorting.xml Added performance test to resemble questionable benchmark 2020-06-25 23:40:07 +03:00
prewhere.xml Added performance test to resemble questionable benchmark 2020-06-25 23:40:07 +03:00
questdb_sum_float32.xml split 2020-07-07 11:01:50 +03:00
questdb_sum_float64.xml too slow 2020-07-07 20:07:04 +03:00
questdb_sum_int32.xml split 2020-07-07 11:01:50 +03:00
rand.xml use vectorized rand in generateUUIDv4, add multitarget build in intHash32/64 2020-05-29 07:35:03 +02:00
random_fixed_string.xml fixup 2020-07-02 10:44:16 +03:00
random_printable_ascii.xml fix more queries 2020-06-26 22:11:43 +03:00
random_string_utf8.xml Fix too long perf test. 2020-05-21 09:49:15 +03:00
random_string.xml fix more queries 2020-06-26 22:11:43 +03:00
range.xml Mark some performance tests with very high variance 2020-05-07 00:52:03 +03:00
read_from_comp_parts.xml Mark query short 2020-07-24 16:59:50 +03:00
read_hits_with_aio.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
read_in_order_many_parts.xml Update read_in_order_many_parts.xml 2020-07-17 15:12:49 +03:00
README.md Fix readme in performance tests #10345 2020-04-18 15:44:46 +03:00
redundant_functions_in_order_by.xml Update redundant_functions_in_order_by.xml 2020-07-17 15:11:17 +03:00
removing_group_by_keys.xml Remove functions of other keys in GROUP BY section (#10051) 2020-06-16 12:14:25 +03:00
right.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
round_down.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
round_methods.xml fixup 2020-07-02 10:44:16 +03:00
scalar.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
select_format.xml Small update ORCBlockOutputFormat and add ORC output format to performance test. 2020-06-26 23:17:28 +03:00
set_hits.xml fixup 2020-06-10 02:37:48 +03:00
set_index.xml fix performance with large tuples, which are interpreted as functions in IN section 2020-07-23 02:33:14 +03:00
set.xml fixup 2020-06-29 17:09:51 +03:00
simple_join_query.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
slices_hits.xml fix more queries 2020-06-26 22:11:43 +03:00
sort_radix_trivial.xml fix some broken performance tests 2020-05-28 10:45:03 +03:00
sort.xml Add performance test #10981 2020-05-23 17:41:13 +03:00
string_join.xml Edited strange test 2020-05-23 17:53:54 +03:00
string_set.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
string_sort.xml Merge branch 'master' into remove-useless-setting-from-perf-test 2020-07-14 09:31:34 +03:00
sum_map.xml fixup 2020-07-02 10:13:02 +03:00
sum.xml Add performance test 2020-05-18 07:55:06 +03:00
synthetic_hardware_benchmark.xml More perf tests 2020-07-31 21:19:54 +03:00
trim_numbers.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
trim_urls.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
trim_whitespace.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
uniq.xml performance comparison 2020-04-23 23:19:04 +03:00
url_hits.xml Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
vectorize_aggregation_combinators.xml Added performance test to resemble questionable benchmark 2020-06-25 23:40:07 +03:00
visit_param_extract_raw.xml performance comparison 2020-04-28 10:45:56 +03:00
website.xml fixup 2020-07-03 11:39:43 +03:00

ClickHouse performance tests

This directory contains .xml-files with performance tests for @akuzm tool.

How to write performance test

First of all you should check existing tests don't cover your case. If there are no such tests than you should write your own.

You have to specify preconditions. It contains table names. Only hits_100m_single, hits_10m_single, test.hits are available in CI.

You can use substitions, create, fill and drop queries to prepare test. You can find examples in this folder.

Take into account, that these tests will run in CI which consists of 56-cores and 512 RAM machines. Queries will be executed much faster than on local laptop.

If your test continued more than 10 minutes, please, add tag long to have an opportunity to run all tests and skip long ones.

How to run performance test

TODO @akuzm