Commit Graph

29 Commits

Author SHA1 Message Date
Raúl Marín
d9bcb633de Change perf set_index test to check build index 2021-12-23 13:53:36 +01:00
Raúl Marín
f38ddb4f53 Mark affected tests as short 2021-12-10 10:33:08 +01:00
Alexander Kuzmenkov
86f639d0c3 fix test killed by github 2021-05-27 12:57:08 +03:00
Alexander Kuzmenkov
5da54c2745 calculate perf test precision thresholds from historical data 2021-05-26 16:30:43 +03:00
Alexander Kuzmenkov
67044d69f3
Update set_index.xml 2021-05-26 14:54:07 +03:00
Alexander Kuzmenkov
aeb8431004 update thresholds - 1 2021-05-20 17:14:55 +03:00
Alexander Kuzmenkov
a1749cf5c3 fix 2021-05-20 15:05:20 +03:00
Alexander Kuzmenkov
15564f32b2 Merge remote-tracking branch 'origin/master' into HEAD 2021-05-14 13:16:31 +03:00
Alexander Kuzmenkov
474eff5f9e fix 2021-05-14 13:14:52 +03:00
Alexander Kuzmenkov
3aa919b498 fixes 2021-05-13 12:16:43 +03:00
Anton Popov
576728829d fix perf test 2021-05-07 16:23:46 +03:00
Anton Popov
a8259a6158 fix perf test 2021-05-06 21:26:55 +03:00
Anton Popov
e51cd90c6f better cast operator 2021-05-06 21:21:10 +03:00
Alexander Kuzmenkov
b4afc49d3c update perf tests
sed -i s'/^<test.*$/<test>/g' tests/performance/*.xml

WITH ceil(max(q[3]), 1) AS h
SELECT concat('sed -i s\'/^<test.*$/<test max_ignored_relative_change="', toString(h), '">/g\' tests/performance/', test, '.xml') AS s
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics_v2
    WHERE ((pr_number != 0) AND (event_date > '2021-01-01')) AND (metric = 'client_time') AND (abs(diff) < 0.05) AND (old_value > 0.1)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2021-01-01 00:00:00') AND ((q[3]) > 0.1)
    ORDER BY test DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT PrettySpace
2021-02-02 17:21:43 +03:00
Alexander Kuzmenkov
a3277b183d Adjust perf test thresholds 2020-11-27 15:08:42 +03:00
Alexander Kuzmenkov
3529100da9 Adjust ignored perf test changes after NUMA binding 2020-10-30 18:12:15 +03:00
Alexander Kuzmenkov
0f8aec59a3 Adjust ignore thresholds for unstable perf tests
Based on historical data.

```
SELECT
    test,
    ceil(max(q[3]), 1) AS h
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY m DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT TSV

cryptographic_hashes	1.3
collations	0.8
joins_in_memory_pmj	0.8
joins_in_memory	0.7
merge_tree_simple_select	0.7
set_index	0.7
decimal_casts	0.7
website	0.6
logical_functions_medium	0.5
count	0.5
merge_tree_many_partitions	0.5
decimal_aggregates	0.5
codecs_int_insert	0.5
column_column_comparison	0.5
insert_parallel	0.4
parse_engine_file	0.4
read_in_order_many_parts	0.4
logical_functions_small	0.4
parallel_insert	0.3
parallel_index	0.3
push_down_limit	0.3
jit_large_requests	0.3
select_format	0.3
arithmetic	0.3
merge_tree_huge_pk	0.3
materialized_view_parallel_insert	0.3
columns_hashing	0.3
if_array_string	0.3
random_string	0.2
random_printable_ascii	0.2
set	0.2
empty_string_serialization	0.2
```

To apply:
```
sed 's/^\(.*\)        \(.*\)$/sed -i "s\/^<test.*$\/<test max_ignored_relative_change="'"'"\2">\/g" tests\/performance\/\1.xml/g' ../bad.tsv | bash
```
2020-09-16 18:27:51 +03:00
Anton Popov
fc515728f4 fix performance with large tuples, which are interpreted as functions in IN section 2020-07-23 02:33:14 +03:00
Alexander Kuzmenkov
10b6f98ca6 fixup 2020-07-03 11:39:43 +03:00
Alexander Kuzmenkov
a2b8412b41 fixup 2020-07-02 10:44:16 +03:00
Alexander Kuzmenkov
5d324751a0 fix more queries 2020-06-26 22:11:43 +03:00
Alexander Kuzmenkov
af1c8f8a5f fixup 2020-06-10 02:57:31 +03:00
Alexander Kuzmenkov
898d83491d fixup 2020-06-10 02:37:48 +03:00
Alexander Kuzmenkov
5719549ee1 fixup 2020-06-09 16:29:07 +03:00
Alexander Kuzmenkov
6a3df071a2 fixup 2020-06-09 01:13:08 +03:00
Anton Popov
e1b7e2de2f parse tuples of tuples as literals 2020-04-20 23:14:56 +03:00
Alexey Milovidov
785d2c0e01 Remove garbage from performance tests 2020-04-18 15:54:16 +03:00
Anton Popov
79024d73a2 improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
Ivan
97f2a2213e
Move all folders inside /dbms one level up (#9974)
* Move some code outside dbms/src folder
* Fix paths
2020-04-02 02:51:21 +03:00