Alexander Kuzmenkov
|
3a4ac94901
|
make some perf test queries more stable
|
2021-03-29 22:43:34 +03:00 |
|
Alexey Milovidov
|
c32ed77976
|
Some queries become too fast
|
2021-02-11 16:37:46 +03:00 |
|
Alexander Kuzmenkov
|
0f8aec59a3
|
Adjust ignore thresholds for unstable perf tests
Based on historical data.
```
SELECT
test,
ceil(max(q[3]), 1) AS h
FROM
(
SELECT
test,
query_index,
count(*),
min(event_time),
max(event_time) AS t,
arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
median(stat_threshold) AS m
FROM perftest.query_metrics
WHERE (metric = 'client_time') AND (abs(diff) < 0.05)
GROUP BY
test,
query_index,
query_display_name
HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
ORDER BY m DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT TSV
cryptographic_hashes 1.3
collations 0.8
joins_in_memory_pmj 0.8
joins_in_memory 0.7
merge_tree_simple_select 0.7
set_index 0.7
decimal_casts 0.7
website 0.6
logical_functions_medium 0.5
count 0.5
merge_tree_many_partitions 0.5
decimal_aggregates 0.5
codecs_int_insert 0.5
column_column_comparison 0.5
insert_parallel 0.4
parse_engine_file 0.4
read_in_order_many_parts 0.4
logical_functions_small 0.4
parallel_insert 0.3
parallel_index 0.3
push_down_limit 0.3
jit_large_requests 0.3
select_format 0.3
arithmetic 0.3
merge_tree_huge_pk 0.3
materialized_view_parallel_insert 0.3
columns_hashing 0.3
if_array_string 0.3
random_string 0.2
random_printable_ascii 0.2
set 0.2
empty_string_serialization 0.2
```
To apply:
```
sed 's/^\(.*\) \(.*\)$/sed -i "s\/^<test.*$\/<test max_ignored_relative_change="'"'"\2">\/g" tests\/performance\/\1.xml/g' ../bad.tsv | bash
```
|
2020-09-16 18:27:51 +03:00 |
|
Alexander Kuzmenkov
|
1d954581eb
|
Fix some spurious perf test failures
|
2020-07-31 19:28:04 +03:00 |
|
Alexander Kuzmenkov
|
da5853f031
|
Update decimal_aggregates.xml
|
2020-07-17 18:27:05 +03:00 |
|
Alexander Kuzmenkov
|
b558aae851
|
disable profiler
|
2020-07-15 19:10:47 +03:00 |
|
Alexander Kuzmenkov
|
fa6fc719ab
|
fixup
|
2020-07-14 15:55:25 +03:00 |
|
Alexander Kuzmenkov
|
4da37fb3a0
|
Fix decimal aggregate perf test
|
2020-07-13 14:40:46 +03:00 |
|
Alexander Kuzmenkov
|
d911aa7496
|
temporarily disable decimal aggregates test
|
2020-07-13 14:28:35 +03:00 |
|
Alexander Kuzmenkov
|
48862a1edf
|
fixup
|
2020-07-11 13:35:44 +03:00 |
|
Alexander Kuzmenkov
|
70ba4e16f8
|
fixup
|
2020-07-10 17:18:39 +03:00 |
|
Alexander Kuzmenkov
|
3b428d6585
|
fixes
|
2020-07-09 13:46:16 +03:00 |
|
Alexander Kuzmenkov
|
5b3a106f7a
|
fixes
|
2020-07-08 13:35:49 +03:00 |
|
Alexander Kuzmenkov
|
2fbd3cb6a4
|
fixup
|
2020-07-06 13:51:26 +03:00 |
|
Alexander Kuzmenkov
|
10b6f98ca6
|
fixup
|
2020-07-03 11:39:43 +03:00 |
|
Alexander Kuzmenkov
|
a2b8412b41
|
fixup
|
2020-07-02 10:44:16 +03:00 |
|
Alexander Kuzmenkov
|
7e2f6937e0
|
fixup
|
2020-06-30 12:45:19 +03:00 |
|
Alexander Kuzmenkov
|
5d324751a0
|
fix more queries
|
2020-06-26 22:11:43 +03:00 |
|
Alexey Milovidov
|
785d2c0e01
|
Remove garbage from performance tests
|
2020-04-18 15:54:16 +03:00 |
|
Ivan
|
97f2a2213e
|
Move all folders inside /dbms one level up (#9974)
* Move some code outside dbms/src folder
* Fix paths
|
2020-04-02 02:51:21 +03:00 |
|