12 Commits

Author	SHA1	Message	Date
Alexander Kuzmenkov	5da54c2745	calculate perf test precision thresholds from historical data	2021-05-26 16:30:43 +03:00
Alexander Kuzmenkov	a3277b183d	Adjust perf test thresholds	2020-11-27 15:08:42 +03:00
Alexander Kuzmenkov	3529100da9	Adjust ignored perf test changes after NUMA binding	2020-10-30 18:12:15 +03:00
Alexander Kuzmenkov	0f8aec59a3	Adjust ignore thresholds for unstable perf tests ... Based on historical data. ``` SELECT test, ceil(max(q[3]), 1) AS h FROM ( SELECT test, query_index, count(*), min(event_time), max(event_time) AS t, arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q, median(stat_threshold) AS m FROM perftest.query_metrics WHERE (metric = 'client_time') AND (abs(diff) < 0.05) GROUP BY test, query_index, query_display_name HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1) ORDER BY m DESC ) GROUP BY test ORDER BY h DESC FORMAT TSV cryptographic_hashes 1.3 collations 0.8 joins_in_memory_pmj 0.8 joins_in_memory 0.7 merge_tree_simple_select 0.7 set_index 0.7 decimal_casts 0.7 website 0.6 logical_functions_medium 0.5 count 0.5 merge_tree_many_partitions 0.5 decimal_aggregates 0.5 codecs_int_insert 0.5 column_column_comparison 0.5 insert_parallel 0.4 parse_engine_file 0.4 read_in_order_many_parts 0.4 logical_functions_small 0.4 parallel_insert 0.3 parallel_index 0.3 push_down_limit 0.3 jit_large_requests 0.3 select_format 0.3 arithmetic 0.3 merge_tree_huge_pk 0.3 materialized_view_parallel_insert 0.3 columns_hashing 0.3 if_array_string 0.3 random_string 0.2 random_printable_ascii 0.2 set 0.2 empty_string_serialization 0.2 ``` To apply: ``` sed 's/^\(.*\) \(.*\)$/sed -i "s\/^<test.*$\/<test max_ignored_relative_change="'"'"\2">\/g" tests\/performance\/\1.xml/g' ../bad.tsv | bash ```	2020-09-16 18:27:51 +03:00
Avogar	81d459a5a8	Small update ORCBlockOutputFormat and add ORC output format to performance test.	2020-06-26 23:17:28 +03:00
Alexander Kuzmenkov	a3843e1f42	performance comparison	2020-04-30 08:10:34 +03:00
Alexander Kuzmenkov	15e94d3de9	performance comparison	2020-04-29 09:30:37 +03:00
Alexey Milovidov	785d2c0e01	Remove garbage from performance tests	2020-04-18 15:54:16 +03:00
Avogar	b056dbce1c	Improve MsgPackRowInputFormat	2020-04-17 12:35:38 +03:00
alexey-milovidov	23ae3f4bff	Update select_format.xml	2020-04-16 00:43:58 +03:00
Avogar	9860ffee51	Add MsgPack performance test	2020-04-13 00:59:28 +03:00
Ivan	97f2a2213e	Move all folders inside /dbms one level up (#9974) ... * Move some code outside dbms/src folder * Fix paths	2020-04-02 02:51:21 +03:00