ClickHouse/tests/performance
Antonio Andelic d9f15cb062 Fix
2024-10-02 13:44:24 +02:00
..
scripts Fix 2024-10-02 13:44:24 +02:00
agg_functions_argmin_argmax.xml Implement findExtremeMinIndex / findExtremeMaxIndex 2024-01-17 16:22:40 +01:00
agg_functions_min_max_any.xml Add perf tests with tuples 2023-12-29 17:00:01 +01:00
aggregate_functions_of_group_by_keys.xml
aggregate_with_serialized_method.xml Improve the performance of serialized aggregation method when involving multiple [nullable] columns. 2024-02-29 21:48:15 +08:00
aggregating_merge_tree_simple_aggregate_function_string.xml Enable allow_suspicious_primary_key for perf tests that need it 2024-03-26 11:09:03 +00:00
aggregating_merge_tree.xml
aggregation_by_partitions.xml Enable perf tests added in #45364 (#46623) 2023-02-28 00:26:11 +01:00
aggregation_external.xml Added performance test 2023-10-11 19:01:00 +03:00
aggregation_in_order_2.xml
aggregation_in_order.xml
aggregation_overflow.xml
all_join_opt.xml rebase and resolve conflict 2024-08-13 19:16:32 +08:00
alter_select.xml Reduce overhead of the mutations for SELECTs (v2) 2024-04-25 14:35:21 +02:00
analyze_array_tuples.xml
and_function.xml
any_anyLast.xml
arithmetic_operations_in_aggr_func.xml
arithmetic.xml
array_auc.xml
array_element.xml Update tests/performance/array_element.xml 2024-01-10 10:46:29 +08:00
array_fill.xml
array_fold.xml Revert "Remove arrayFold" 2023-12-14 09:52:29 +00:00
array_index_low_cardinality_numbers.xml Update tests 2024-02-14 12:48:05 +00:00
array_index_low_cardinality_strings.xml
array_join.xml add perf test 2024-03-13 18:57:33 +08:00
array_reduce.xml impl 2024-06-19 16:41:50 +01:00
arrow_format.xml
ascii.xml add more tests 2024-03-21 10:29:35 +08:00
asof.xml Fixed tests 2024-02-13 15:41:17 +03:00
async_remote_read.xml Update async_remote_read.xml 2022-11-28 14:00:49 +01:00
avg_weighted.xml Update avg_weighted.xml (#56797) 2023-11-16 20:46:17 +01:00
avg.xml
base64_hits.xml
base64.xml
basename.xml
bigint_arithm.xml
bigint_formatting.xml Add perf tests 2024-03-08 15:17:59 +01:00
bit_operations_fixed_string_numbers.xml
bit_operations_fixed_string.xml
bitmap_array_element.xml Update bitmap_array_element.xml 2022-10-03 14:56:34 +02:00
bloom_filter_insert.xml
bloom_filter_select.xml
bounding_ratio.xml Reduce bounding_ratio.xml 2024-01-04 11:20:07 +00:00
casts.xml
cidr.xml
classification.xml
coalesce.xml Trivial optimize of function coalesce. (#59627) 2024-02-14 11:29:45 +01:00
codec_none.xml
codecs_float_insert.xml
codecs_float_select.xml
codecs_int_insert.xml Deprecate Gorilla compression of non-float columns 2023-01-20 17:31:16 +00:00
codecs_int_select.xml Deprecate Gorilla compression of non-float columns 2023-01-20 17:31:16 +00:00
collations.xml
column_array_filter.xml Update tests/performance/column_array_filter.xml 2023-02-04 18:49:13 +08:00
column_array_replicate.xml add performance tests 2023-02-02 20:16:16 +08:00
ColumnMap.xml
columns_hashing.xml
complex_array_creation.xml
concat_hits.xml
conditional.xml
consistent_hashes.xml
constant_column_comparison.xml
constant_column_search.xml
count_from_formats.xml Disable cache in perf test 2023-08-23 21:01:18 +00:00
count.xml
countDigits.xml Add performance test 2023-02-09 04:52:33 +01:00
countIf.xml
countMatches.xml
cpu_synthetic.xml
cryptographic_hashes.xml Print nicer exception if BLAKE3 is unavailable 2022-10-05 00:11:41 +03:00
date_parsing.xml
date_time_64.xml
date_time_long.xml Various test, code and docs fixups 2023-01-15 13:47:34 +00:00
date_time_short.xml Various test, code and docs fixups 2023-01-15 13:47:34 +00:00
datetime64_conversion.xml Add a test 2023-02-08 02:17:23 +01:00
datetime_comparison.xml
decimal_aggregates.xml Update tests/performance/decimal_aggregates.xml 2024-07-25 12:12:23 +02:00
decimal_casts.xml Whitespace 2023-02-08 03:38:23 +01:00
decimal_format.xml
decimal_parse.xml Reduce the size of decimal_parse 2024-01-03 17:29:30 +00:00
destroy_aggregate_states.xml
dict_join.xml
direct_dictionary.xml tests/perf: fix dependency check during DROP 2022-12-16 15:15:15 +01:00
distinct_combinator.xml
distinct_in_order.xml Polishing 2023-02-05 13:38:20 +00:00
distributed_aggregation_memory_efficient.xml
distributed_aggregation.xml
dotProduct.xml Implement const/non-const shortcut 2024-03-06 16:56:01 +00:00
empty_string_deserialization.xml
empty_string_serialization.xml
encodeXMLComponent.xml
encrypt_decrypt_empty_string.xml
entropy.xml
enum_in_set.xml Cache cast function in set during execution (#55712) 2023-10-23 13:31:44 +02:00
explain_ast.xml Make explain_ast even larger 2022-10-14 14:06:44 +02:00
extract.xml
file_table_function.xml
final_big_column.xml Fixups 2024-07-16 20:21:21 +00:00
final_with_lonely_parts.xml more stable stateless test + add perf. test 2023-08-31 06:27:06 +00:00
fixed_string16.xml
flat_dictionary.xml tests/perf: fix dependency check during DROP 2022-12-16 15:15:15 +01:00
float_formatting.xml
float_mod.xml
float_parsing.xml
format_date_time.xml
format_readable.xml
formats_columns_sampling.xml
function_calculation_after_sorting_and_limit.xml
function_tokens.xml Fixups 2024-07-16 20:21:21 +00:00
functions_coding.xml
functions_geo.xml
functions_with_hash_tables.xml
fuse_sumcount.xml
fuzz_bits.xml
general_purpose_hashes_on_UUID.xml
general_purpose_hashes.xml Add xxh3 hash function (#43411) 2022-11-26 00:14:08 +01:00
generate_table_function.xml Fix performance test about the generateRandom table function, supposedly 2024-07-23 02:30:45 +02:00
get_map_value.xml Optimization for getting value from map, arrayElement(1/2) (#55929) 2023-10-27 09:54:25 +02:00
grace_hash_join.xml Small fixes 2022-11-25 12:04:12 +00:00
great_circle_dist.xml
group_array_moving_sum.xml
group_array_sorted.xml Revert "Revert "Add new aggregation function groupArraySorted()"" 2024-01-30 17:15:29 +03:00
group_by_consecutive_keys.xml slightly faster and perf test 2023-12-16 03:35:59 +00:00
group_by_fixed_keys.xml Adapt more tests 2024-01-04 11:36:33 +00:00
group_by_sundy_li.xml Make test more reasonable 2024-01-03 17:19:44 +00:00
groupby_onekey_nullable.xml Make projections production-ready 2023-05-10 03:35:13 +02:00
h3.xml
has_all.xml
hash_table_sizes_stats_small.xml Apply preallocation optimisation more carefully (#44455) 2023-01-09 13:30:48 +01:00
hash_table_sizes_stats.xml fix (#41648) 2022-09-21 19:04:03 +02:00
hashed_array_dictionary.xml tests/perf: fix dependency check during DROP 2022-12-16 15:15:15 +01:00
hashed_dictionary_load_factor.xml Add ability to configure maximum load factor for the HASHED/SPARSE_HASHED layout 2023-05-19 06:07:21 +02:00
hashed_dictionary_sharded.xml Optimize SPARSE_HASHED layout (by using PackedHashMap) 2023-05-19 06:07:21 +02:00
hashed_dictionary.xml Reduce hashed_dictionary.xml 2024-01-04 11:29:17 +00:00
hashjoin_with_large_output.xml Add tests/performance/hashjoin_with_large_output.xml 2023-12-22 15:52:45 +00:00
hierarchical_dictionaries.xml Add ability to load hashed dictionaries using multiple threads 2023-01-13 13:39:25 +01:00
if_array_num.xml
if_array_string.xml
if_string_const.xml
if_string_hits.xml
if_to_multiif.xml
if_transform_strings_to_enum.xml
if.xml merge master 2024-02-01 10:58:33 +08:00
information_value.xml
injective_functions_inside_uniq.xml
insert_parallel.xml
insert_select_default_small_block.xml
insert_select_squashing_dynamic.xml Add perf tests for Dynamic and Variant 2024-07-30 14:54:42 +00:00
insert_select_squashing_variant.xml Add perf tests for Dynamic and Variant 2024-07-30 14:54:42 +00:00
insert_select_squashing.xml Improve columns squashing for String/Array/Map/Variant/Dynamic types 2024-07-24 13:10:20 +00:00
insert_sequential_and_background_merges.xml
insert_sparse_column.xml fix tests 2024-09-26 00:11:25 +00:00
insert_values_with_expressions.xml
inserts_arrays_lowcardinality.xml
int_parsing.xml
intDiv.xml
io_uring.xml fix io_uring.xml 2024-05-15 19:15:53 +03:00
ip_trie.xml
IPv4.xml
IPv6.xml
jit_aggregate_functions.xml Fix table names 2024-01-17 11:36:07 +01:00
jit_large_requests.xml
jit_small_requests.xml
jit_sort.xml
join_append_block.xml
join_convert_outer_to_inner.xml Added performance tests 2024-04-28 12:52:04 +03:00
join_filter_pushdown_equivalent_sets.xml Updated implementation 2024-04-11 11:09:08 +03:00
join_filter_pushdown.xml add perf test 2023-07-24 20:34:01 +02:00
join_max_streams.xml
join_used_flags.xml Adapt more tests 2024-01-04 11:36:33 +00:00
joins_in_memory.xml
json_extract_rapidjson.xml
json_extract_simdjson.xml update benckmark test 2023-09-15 18:09:58 +08:00
json_input_format_part_fields.xml update test 2024-04-12 10:00:52 +08:00
json_type.xml Fix and rewrite tests 2024-07-24 19:11:51 +00:00
least_greatest_hits.xml
least_greatest.xml improve least/greatest by allow nullable numberic fields compare 2024-06-05 15:47:42 +08:00
leftpad.xml
lightweight_delete.xml Enable lightweight delete support by default 2023-03-01 19:35:55 +01:00
line_as_string_parsing.xml Support parallel parsing for LineAsString input format 2022-10-28 21:56:09 +00:00
linear_regression.xml
local_replica.xml
logical_functions_large.xml
logical_functions_medium.xml
logical_functions_small.xml
lot_of_subcolumns.xml
low_cardinality_argument.xml
low_cardinality_from_json.xml Added reverted files and fixes for failing fuzzer tests 2022-10-28 12:37:59 +02:00
low_cardinality_query.xml Add perftest: low_cardinality_query 2022-11-08 17:19:18 +08:00
lower_upper_utf8.xml tests: add perf test for lowerUTF8()/upperUTF8() 2022-09-17 11:16:45 +02:00
lz4_hits_columns.xml Skip empty literals in lz4 decompression (#40142) 2022-09-06 13:58:26 +02:00
lz4.xml Skip empty literals in lz4 decompression (#40142) 2022-09-06 13:58:26 +02:00
map_populate_series.xml
map_update.xml add tests 2023-03-28 17:20:05 +00:00
materialized_view_deduplication.xml squash! materialized_view_deduplication performance comparison test performance comparison test to check deduplication in MATERIALIZED VIEW's. Logic is similar to, but with a bigger insert tests/queries/0_stateless/03008_deduplication_cases_from_docs.sql 2024-08-21 12:49:33 +02:00
materialized_view_parallel_insert.xml enable parallel_view_processing in perf tests 2024-08-02 15:11:31 +02:00
materialized_view_parallelize_output_from_storages.xml Adjust min_insert_block_size_rows for materialized_view_parallelize_output_from_storages 2023-06-14 19:11:23 +03:00
math.xml
memory_bound_merging.xml Parallel replicas. Part [2] (#43772) 2023-02-03 14:34:18 +01:00
memory_cache_friendliness.xml
merge_table_streams.xml
merge_tree_huge_pk.xml
merge_tree_insert.xml Revert "Merge pull request #55682 from ClickHouse/revert-35961-decimal-column-improve-get-permutation" 2023-10-25 21:48:13 +03:00
merge_tree_many_partitions_2.xml
merge_tree_many_partitions.xml
merge_tree_simple_select.xml
min_max_index.xml Reduce setup time of min_max_index.xml 2024-01-03 17:16:45 +00:00
mingroupby-orderbylimit1.xml
mmap_io.xml
modulo.xml
monotonous_order_by.xml
multiif.xml fix failed uts 2024-02-29 15:00:09 +08:00
new_json_type.xml Fix and rewrite tests 2024-07-24 19:11:51 +00:00
ngram_distance.xml
nlp.xml
norm_distance.xml Add performance test for dotProduct() 2024-02-20 21:41:10 +00:00
normalize_utf8.xml
number_formatting_formats.xml
one_thousand_joins.xml Add test for bug 33446 2024-04-23 13:20:27 +00:00
optimize_functions_to_subcolumns.xml Update optimize_functions_to_subcolumns.xml 2024-08-09 22:56:25 +02:00
optimize_sorting_for_input_stream.xml
optimize_window_funnel.xml
optimized_select_final_one_part.xml
optimized_select_final.xml
or_null_default.xml
orc_filter_push_down.xml fix code style 2023-11-02 10:49:18 +08:00
orc_tuple_field_prune.xml fix failed perf test 2023-11-02 15:27:48 +08:00
order_by_decimals.xml
order_by_read_in_order.xml
order_by_single_column.xml
order_by_tuple.xml
order_with_limit.xml Implement findExtremeMinIndex / findExtremeMaxIndex 2024-01-17 16:22:40 +01:00
parallel_final.xml simplify perf tests and minor code change 2024-01-11 08:25:35 +00:00
parallel_index.xml
parallel_insert.xml
parallel_mv.xml Fix parallel_mv perf test 2024-06-25 08:44:36 +00:00
parquet_filter.xml Performance test 2023-08-21 14:15:52 -07:00
parquet_read_with_index.xml performance comparison test for output_format_parquet_write_page_index setting 2024-08-15 02:31:10 +02:00
parquet_read.xml improve parquet struct field reading 2023-11-01 15:18:39 +08:00
parse_engine_file.xml
parse_illegal_datetime.xml Reduce performance test size 2024-04-16 10:09:17 +00:00
point_in_polygon_const.xml
point_in_polygon_index.xml Support NaN number 2024-04-03 15:06:27 +08:00
point_in_polygon.xml
polymorphic_parts_l.xml Reduce polymorphic_parts_m 2024-01-03 17:24:15 +00:00
polymorphic_parts_m.xml Reduce polymorphic_parts_m 2024-01-03 17:24:15 +00:00
polymorphic_parts_s.xml Fixups 2024-07-16 20:21:21 +00:00
position_empty_needle.xml change as request 2023-01-30 16:13:12 +08:00
pre_limit_no_sorting.xml
prefetch_in_aggregation.xml Prefetching in aggregation (#39304) 2022-09-21 18:59:07 +02:00
prepare_hash_before_merge.xml Optimize the merge if all hashSets are singleLevel in UniqExactSet (#52973) 2023-08-30 11:26:16 +02:00
prewhere_with_row_level_filter.xml
prewhere.xml
push_down_limit.xml
quantile_merge.xml
quantile.xml
queries_over_aggregation.xml
query_interpretation_join.xml Add benchmark for query interpretation with JOINs 2022-11-23 13:15:35 +01:00
rand.xml Add function canonicalRand (#43124) 2022-11-15 00:27:19 +01:00
random_fixed_string.xml
random_printable_ascii.xml
random_string_utf8.xml
random_string.xml
range_hashed_dictionary.xml tests/perf: fix dependency check during DROP 2022-12-16 15:15:15 +01:00
range.xml
re2_regex_caching.xml Fix performance test for regexp cache 2023-07-09 02:21:48 +02:00
read_from_comp_parts.xml fix read_from_comp_parts 2024-06-21 23:42:56 +01:00
read_hits_with_aio.xml
read_in_order_many_parts.xml
reading_from_file.xml Perf test 2023-04-07 20:06:11 +00:00
README.md Update performance README 2024-09-25 12:43:39 +00:00
redundant_functions_in_order_by.xml
reinterpret_as.xml Halve the size of reinterpret_as.xml 2024-01-04 11:24:36 +00:00
removing_group_by_keys.xml
replaceRegexp_fallback.xml Use numbers_mt to reduce duration of tests 2024-07-10 17:28:10 +02:00
rewrite_array_exists.xml add perf test 2023-02-09 12:30:50 +08:00
rewrite_sumIf.xml
right.xml
round_down.xml
round_methods.xml
scalar2.xml
scalar.xml
schema_inference_text_formats.xml Refactor and improve schema inference for text formats 2022-12-07 21:19:27 +00:00
select_format.xml
sequence_match.xml
set_disable_skip_index.xml add perf test 2023-04-04 21:29:52 +00:00
set_hits.xml
set_index_analysis.xml Add a test 2024-05-19 10:45:05 +02:00
set_index.xml
set.xml
short_circuit_functions.xml
simple_join_query.xml
single_fixed_string_groupby.xml fix (#41648) 2022-09-21 19:04:03 +02:00
slices_hits.xml
small_block_contention.xml Remove lock from the ReadProgressCallback 2024-02-22 18:00:55 +01:00
sort_patterns.xml Revert "Merge pull request #55682 from ClickHouse/revert-35961-decimal-column-improve-get-permutation" 2023-10-25 21:48:13 +03:00
sort_radix_trivial.xml
sort.xml Enable query_plan_remove_redundant_sorting optimization by default 2023-01-24 13:38:21 +00:00
sparse_column_filter.xml Add isolated performance test 2024-05-29 01:12:28 +08:00
sparse_column.xml
split_filter.xml
storage_join_direct_join.xml Fix test storage_join_direct_join 2024-08-13 16:20:27 +02:00
string_join.xml
string_set.xml
string_sort.xml
string_to_int.xml
subqueries.xml
sum_map.xml Reduce sum_map.xml 2024-01-04 11:31:20 +00:00
sum.xml add some perf tests 2024-02-04 15:55:22 +08:00
sumIf.xml
synthetic_hardware_benchmark.xml fix (#41648) 2022-09-21 19:04:03 +02:00
trim_numbers.xml
trim_urls.xml
trim_whitespace.xml
trivial_insert_select_from_files.xml Restart CI 2024-04-09 12:33:18 +02:00
tsv_csv_nullable_parsing.xml
unary_arithmetic_functions.xml
unary_logical_functions.xml
uniq_stored.xml impl 2022-09-16 15:41:15 +02:00
uniq_to_count.xml Fixed performance tests 2024-08-05 15:29:15 +00:00
uniq_without_key_dist.xml add perf test 2024-01-19 17:57:11 +01:00
uniq_without_key.xml Optimize merge of uniqExact without_key (#43072) 2022-11-17 13:19:02 +01:00
uniq.xml
uniqExactIf.xml Add parallel state merge for some other combinator except If (#50413) 2023-06-08 00:41:32 +02:00
url_hits.xml Add tests and doc for some url-related functions 2022-10-26 10:52:57 +00:00
utc_timestamp_transform.xml modify test 2024-04-12 16:57:34 +08:00
vectorize_aggregation_combinators.xml
views_max_insert_threads.xml enable parallel_view_processing in perf tests 2024-08-02 15:11:31 +02:00
visit_param_extract_raw.xml
website.xml fix (#41648) 2022-09-21 19:04:03 +02:00
window_functions_downstream_multithreading.xml Multithreading after window functions (#50771) 2023-10-27 12:36:28 +02:00
window_functions.xml
writing_valid_utf8.xml

ClickHouse performance tests

This directory contains .xml-files with performance tests.

How to write a performance test

First of all please check that existing tests don't cover your case. If there are no such tests then you can write your own test.

Test template:

<test>
    <!-- Optional: Specify settings -->
    <settings>
        <max_threads>1</max_threads>
        <max_insert_threads>1</max_insert_threads>
    </settings>

    <!-- Optional: Variable substitutions, can be referenced to by curly brackets {} and used in any queries -->
    <substitutions>
        <substitution>
            <name>x</name>
            <values>
                <value>10</value>
                <value>50</value>
            </values>
        </substitution>
        <substitution>
            <name>y</name>
            <values>
                <value>5</value>
                <value>8</value>
            </values>
        </substitution>
    </substitutions>

    <!-- Optional: Table setup queries -->
    <create_query>CREATE TABLE tab1 [..]</create_query>
    <create_query>CREATE TABLE tab2 [..]</create_query>

    <!-- Optional: Table population queries -->
    <fill_query>INSERT INTO tab1 [...]</fill_query>
    <fill_query>INSERT INTO tab2 [...]</fill_query>

    <!-- Benchmark queries -->
    <query>SELECT [...] WHERE col BETWEEN {x} AND {y}</query>
    <query>SELECT [...]</query>
    <query>SELECT [...]</query>

    <!-- Optional: Table teardown queries -->
    <drop_query>DROP TABLE tab1</drop_query>
    <drop_query>DROP TABLE tab2</drop_query>
</test>

If your test takes more than 10 minutes, please, add tag long to have an opportunity to run all tests and skip long ones.

How to run performance test

TODO

How to validate single test

pip3 install clickhouse_driver scipy
../../tests/performance/scripts/perf.py --runs 1 insert_parallel.xml