thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-30 03:22:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
54,484 Commits 9,189 Branches 1,782 Tags 2.2 GiB
c70ab6a18a
Commit Graph

417 Commits

Author SHA1 Message Date
alesapin
60d14352f8 Merge branch 'master' into no_background_pool_no_more 2020-10-15 16:34:14 +03:00
alexey-milovidov
1d309c34c8
Merge pull request #15497 from filipecaixeta/master 
Add an SQL function formatReadableTimeDelta to format time delta
 2020-10-14 22:36:57 +03:00
Alexander Kuzmenkov
cb15e72229 make some perf tests slower 2020-10-14 18:39:27 +03:00
Vasily Nemkov
a6f36fc53b Performance tests for encrypt and decrypt functions 2020-10-14 16:33:07 +03:00
alesapin
163d33fd21 Add perftest for merges 
(cherry picked from commit e655f009d2)
 2020-10-13 15:12:28 +03:00
Alexey Milovidov
905bb859a5 Add performance test 2020-10-11 18:25:29 +03:00
Artem Zuikov
4fd1db73a1
Faster 256-bit multiplication (#15418) 2020-09-29 20:52:34 +03:00
Alexander Kuzmenkov
8cbfd69adf
Update decimal_casts.xml 2020-09-24 11:35:35 +03:00
Alexander Kuzmenkov
9b29e31d64 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-23 23:58:43 +03:00
alexey-milovidov
3bc09bb867
Merge pull request #15178 from amosbird/dtcf 
Fix performance issue when doing datetime comparison
 2020-09-23 20:33:23 +03:00
Alexander Kuzmenkov
9f137e77e7
Update decimal_casts.xml 2020-09-23 18:41:52 +03:00
Alexander Kuzmenkov
d2427a121f
Update decimal_casts.xml 2020-09-23 10:15:51 +03:00
Amos Bird
ee45395942
Fix datetime comparison 2020-09-23 10:29:55 +08:00
Artem Zuikov
f80ffc4dce restore decimal_casts perf test 2020-09-22 18:56:24 +03:00
Alexander Kuzmenkov
4937159f85
Merge pull request #14990 from ClickHouse/aku/longer-perf 
If perf test definition changed, run everything + longer (as in master)
 2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov
e646aa306f
Update columns_hashing.xml 2020-09-22 13:25:16 +03:00
Alexander Kuzmenkov
ba12e68d70
Update insert_values_with_expressions.xml 2020-09-22 13:23:10 +03:00
Alexander Kuzmenkov
4dae587e2d fix test 2020-09-21 15:02:34 +03:00
Alexander Kuzmenkov
85be1f1685 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-21 14:57:25 +03:00
alexey-milovidov
a4337635cc
Update single_fixed_string_groupby.xml 2020-09-20 19:42:11 +03:00
philip.han
2045bc9f8c Fix performance_test for bloom_filter 2020-09-20 19:06:46 +09:00
Amos Bird
8ca4d6634e
better fixed string group by support 2020-09-20 15:20:09 +08:00
Alexander Kuzmenkov
e7b9319e12 If perf test definition changed, run everything + longer (as in master) 
Also some other perf test fixes
 2020-09-18 16:28:46 +03:00
philip.han
cbedd44a60 Fix indexOf() to use BloomFilter 2020-09-18 17:43:07 +09:00
Alexander Kuzmenkov
36538ce08f Don't account for short queries, we'll deal with them separately. 
New query:

```
WITH ceil(max(q[3]), 1) AS h
SELECT concat('sed -i s\'/^<test.*$/<test max_ignored_relative_change="', toString(h), '">/g\' tests/performance/', test, '.xml') AS s
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05) AND (old > 0.2)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY test DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT PrettySpace
```
 2020-09-17 13:00:51 +03:00
Alexander Kuzmenkov
0f8aec59a3 Adjust ignore thresholds for unstable perf tests 
Based on historical data.

```
SELECT
    test,
    ceil(max(q[3]), 1) AS h
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY m DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT TSV

cryptographic_hashes	1.3
collations	0.8
joins_in_memory_pmj	0.8
joins_in_memory	0.7
merge_tree_simple_select	0.7
set_index	0.7
decimal_casts	0.7
website	0.6
logical_functions_medium	0.5
count	0.5
merge_tree_many_partitions	0.5
decimal_aggregates	0.5
codecs_int_insert	0.5
column_column_comparison	0.5
insert_parallel	0.4
parse_engine_file	0.4
read_in_order_many_parts	0.4
logical_functions_small	0.4
parallel_insert	0.3
parallel_index	0.3
push_down_limit	0.3
jit_large_requests	0.3
select_format	0.3
arithmetic	0.3
merge_tree_huge_pk	0.3
materialized_view_parallel_insert	0.3
columns_hashing	0.3
if_array_string	0.3
random_string	0.2
random_printable_ascii	0.2
set	0.2
empty_string_serialization	0.2
```

To apply:
```
sed 's/^\(.*\)        \(.*\)$/sed -i "s\/^<test.*$\/<test max_ignored_relative_change="'"'"\2">\/g" tests\/performance\/\1.xml/g' ../bad.tsv | bash
```
 2020-09-16 18:27:51 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf 
Do less runs in perf test
 2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
3113aa6cfe Avoid extra error in perf report on broken queries 2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271 fixup 2020-09-14 10:27:46 +03:00
Nikolai Kochetov
c3eeb8f71e
Merge pull request #14412 from ClickHouse/pipes-and-creating-sets 
Pipes and creating sets
 2020-09-08 10:47:56 +03:00
Alexander Kuzmenkov
0904433c87 Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229 
Also add one more timeout to perf test runner.
 2020-09-07 09:33:57 +03:00
Nikolai Kochetov
7a03dbaa2f Added test. 2020-09-04 12:11:37 +03:00
Alexander Kuzmenkov
134aae89f3
Merge pull request #14110 from 4ertus2/decimal 
Fix Decimal to Float conversion and toDecimal256() function
 2020-08-31 17:08:49 +03:00
Artem Zuikov
13113dafdc
Update decimal_casts.xml 2020-08-27 16:53:16 +03:00
Alexey Milovidov
dc889b5c42 Fixup #14120 2020-08-27 15:17:51 +03:00
alexey-milovidov
ea0122de7e
Merge pull request #14120 from ClickHouse/parallel-insert-more-storages 
Support parallel INSERT for more table engines
 2020-08-27 15:08:56 +03:00
alexey-milovidov
0f706c01ca
Merge pull request #13888 from vladimir-golovchenko/add-date-trunc-function 
Added date_trunc function
 2020-08-27 02:12:27 +03:00
Alexey Milovidov
83fa57a346 Update instruction for perf tests 2020-08-26 20:34:05 +03:00
Alexey Milovidov
9a4e7cc492 Add perf test 2020-08-26 20:33:14 +03:00
Artem Zuikov
7e984f877b better test 2020-08-26 19:21:26 +03:00
Artem Zuikov
fe5db661ce fix decimal to float conversion and toDecimal256() 2020-08-26 15:26:12 +03:00
vladimir golovchenko
fb06f59ceb Added tests for date_trunc function. 2020-08-25 16:41:23 -07:00
alexey-milovidov
00c697df06
Merge pull request #14005 from ClickHouse/ucasFL-new-branch 
Merging #12195
 2020-08-26 01:33:54 +03:00
Alexey Milovidov
86d99f7c7f Disable "optimize_trivial_insert_select" for one perf test 2020-08-26 01:33:31 +03:00
alexey-milovidov
6a164634d7
Merge pull request #12550 from myrrc/bug/low-cardinality-arrays-optimisations 
Optimising has(), indexOf(), and countEqual() for Array(LowCardinality(T)) and constant right arguments
 2020-08-24 22:31:29 +03:00
Alexander Kazakov
d99ddb9ca9 In perf test array_index_lc: adjusted iterations count 2020-08-24 12:02:48 +03:00
Alexey Milovidov
d44982072c More robust 2020-08-24 03:14:24 +03:00
Alexander Kazakov
48333b29f6 Minior rename 2020-08-24 00:42:00 +03:00
Alexander Kazakov
eac2c59055 Fix up 2020-08-24 00:16:16 +03:00
Alexander Kazakov
ce0ab0e28b Split array_index_low_cardinality performance test: numbers/strings 2020-08-24 00:13:57 +03:00
myrrc
a519559644 updated ColumnVector to compare with other U, cleaned ImplString 2020-08-14 21:08:30 +03:00
myrrc
0b53b0379b fixing perftest to get more relevant result 2020-08-14 03:09:44 +03:00
myrrc
82206e89dd fixed perftest long test and StringRef assert 2020-08-12 17:07:56 +03:00
Alexander Kazakov
6e0d536327
Merge branch 'master' into bug/low-cardinality-arrays-optimisations 2020-08-11 16:25:20 +03:00
Alexander Kuzmenkov
e06fd84ca7
Update synthetic_hardware_benchmark.xml 
https://github.com/ClickHouse/ClickHouse/pull/13099#issuecomment-671479904
 2020-08-10 20:16:23 +03:00
Alexey Milovidov
d1935bc967 Adjust query time in perf test 2020-08-09 02:14:23 +03:00
myrrc
5a742ec0fc test update 2020-08-08 21:12:38 +03:00
myrrc
c4ddabc327 updated perf test with integral example (cloning the column) 2020-08-06 21:54:21 +03:00
myrrc
c8f737c37c fix: re-resizing, Arcadia compatibility, updated perftest 2020-08-06 15:33:16 +03:00
myrrc
2f589c6856 added another query to perftest 2020-08-04 23:10:54 +03:00
myrrc
f2fecb4d1a re-adding the non-const test queries 2020-08-04 23:00:36 +03:00
myrrc
807f1887f4 some data flow fixes 2020-08-04 22:51:15 +03:00
myrrc
aa1582999a re-adding the test with removed slow requests. 2020-08-04 16:06:16 +03:00
myrrc
d4e747ffd7 deleted extra-slow perftest to figure out outer coverage 2020-08-04 16:04:28 +03:00
myrrc
e270706fdb Merge branch 'bug/low-cardinality-arrays-optimisations' of github:myrrc/clickhouse into bug/low-cardinality-arrays-optimisations 2020-08-04 15:37:22 +03:00
myrrc
98119af9de Merge remote-tracking branch 'upstream/master' into bug/low-cardinality-arrays-optimisations 2020-08-04 15:01:27 +03:00
Alexander Kazakov
059a3dcbd9 Fix up typo in test 2020-08-03 23:35:10 +03:00
Alexey Milovidov
006f9a831f More performance tests 2020-08-03 04:37:57 +03:00
alexey-milovidov
935533e841
Merge pull request #13193 from ClickHouse/aku/spurious-perf 
Fix some spurious perf test failures
 2020-08-03 01:02:53 +03:00
alexey-milovidov
1f19d7e9bd
Merge pull request #13016 from ClickHouse/limit-push-down 
Limit push down
 2020-08-02 01:23:06 +03:00
alexey-milovidov
626b709085
Merge pull request #13055 from ClickHouse/fixed-hash-map-implicit-zero 
Slightly improve the inner loop of aggregation by UInt8/UInt16 keys
 2020-08-02 01:09:00 +03:00
Alexey Milovidov
72bb5af15c More perf tests 2020-07-31 21:19:54 +03:00
Alexander Kuzmenkov
1d954581eb Fix some spurious perf test failures 2020-07-31 19:28:04 +03:00
alexey-milovidov
543d2da3da
Merge pull request #12700 from CurtizJ/fix-performance-with-in 
Fix performance with large tuples
 2020-07-31 14:40:38 +03:00
Alexey Milovidov
b6ac349126 Added another test case for perf test 2020-07-30 05:43:22 +03:00
Nikolai Kochetov
1c5ccd089f Added perftest. 2020-07-29 15:32:59 +03:00
myrrc
da9502e496 Merge remote-tracking branch 'upstream/master' into bug/low-cardinality-arrays-optimisations 2020-07-28 15:06:39 +03:00
Nikolai Kochetov
1f2390b65e
Merge pull request #12840 from ClickHouse/remove-wrong-threads-limiting 
Remove thread limiting.
 2020-07-28 12:03:07 +03:00
Nikolai Kochetov
abdd160db1
Merge pull request #12589 from bobrik/ivan/parallel-ranges 
Parallelize PK range and skipping index stages
 2020-07-27 19:23:00 +03:00
Nikolai Kochetov
be2132d437 Added perftest. 2020-07-27 17:27:26 +03:00
Nikolai Kochetov
05ec37d1c9 Added perftest. 2020-07-27 17:25:26 +03:00
Anton Popov
70022c7a6c
Mark query short 2020-07-24 16:59:50 +03:00
Anton Popov
61018c275d Merge remote-tracking branch 'upstream/master' into polymorphic-parts-4 2020-07-23 18:38:29 +03:00
Anton Popov
1d0493cfcc better code in ReaderCompact and perf test added 2020-07-23 18:37:44 +03:00
Nikolai Kochetov
dad9d369a1 Merge branch 'master' into bobrik-parallel-randes 2020-07-23 16:21:32 +03:00
Anton Popov
fc515728f4 fix performance with large tuples, which are interpreted as functions in IN section 2020-07-23 02:33:14 +03:00
myrrc
6af63213ce Merge remote-tracking branch 'upstream/master' into bug/low-cardinality-arrays-optimisations 2020-07-22 22:49:46 +03:00
alexey-milovidov
49adaf95aa
Merge pull request #12585 from ClickHouse/mod-compatible 
Make behaviour of remainder of division for floating point numbers compatible with most of DBMS
 2020-07-22 08:43:45 +03:00
Nikolai Kochetov
da4a66b443 Added perftest. 2020-07-21 19:28:30 +03:00
Alexey Milovidov
16ba0f91d7 Add performance test 2020-07-21 13:38:14 +03:00
Artem Zuikov
df1213f351
Try to make if_transform_strings perf test faster (#12598) 2020-07-21 13:34:55 +03:00
Alexander Kuzmenkov
da5853f031
Update decimal_aggregates.xml 2020-07-17 18:27:05 +03:00
Alexander Kuzmenkov
e095d04553
Update read_in_order_many_parts.xml 2020-07-17 15:12:49 +03:00
Alexander Kuzmenkov
c306476f1b
Update redundant_functions_in_order_by.xml 2020-07-17 15:11:17 +03:00
Artem Zuikov
c6e3e9b1ff
String convertion to enum in if() and transform() (#12515) 2020-07-17 12:28:51 +03:00
Alexander Kuzmenkov
b558aae851 disable profiler 2020-07-15 19:10:47 +03:00
Alexander Kuzmenkov
fda2595958 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-15 19:09:43 +03:00
Artem Zuikov
5f01a587f6
Optimize monotonous ORDER BY (#12467) 2020-07-15 13:10:21 +03:00
Alexander Kuzmenkov
fa6fc719ab fixup 2020-07-14 15:55:25 +03:00
Alexander Kuzmenkov
d05b984959 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-14 15:50:31 +03:00
alexey-milovidov
969d9c0d47
Merge branch 'master' into remove-useless-setting-from-perf-test 2020-07-14 09:31:34 +03:00
Alexander Kuzmenkov
4da37fb3a0 Fix decimal aggregate perf test 2020-07-13 14:40:46 +03:00
Alexander Kuzmenkov
5a15e03400 Improve data layout in perf test 
Also fix a bad test query found with new data.
 2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov
c13425f0e9 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-13 14:29:10 +03:00
Alexander Kuzmenkov
d911aa7496 temporarily disable decimal aggregates test 2020-07-13 14:28:35 +03:00
Artem Zuikov
b5c181c24e
Optimize redundant functions in ORDER BY (#12404) 2020-07-13 13:34:25 +03:00
Alexey Milovidov
4ace6f99fa Remove useless setting from performance tests #12424 2020-07-13 05:34:45 +03:00
Alexander Kuzmenkov
48862a1edf fixup 2020-07-11 13:35:44 +03:00
Alexander Kuzmenkov
920c62b629 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-11 13:32:31 +03:00
Artem Zuikov
6b26842ce5
RIGHT and FULL JOIN for MergeJoin (#12118) 2020-07-10 21:10:06 +03:00
Alexander Kuzmenkov
70ba4e16f8 fixup 2020-07-10 17:18:39 +03:00
Alexander Kuzmenkov
cd09cf8c0b Merge remote-tracking branch 'origin/master' into HEAD 2020-07-10 17:18:24 +03:00
Artem Zuikov
01b5c2663c
Delete injective functions inside uniq (#12337) 2020-07-10 13:42:41 +03:00
Alexander Kuzmenkov
394cf20673 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-09 13:46:54 +03:00
Alexander Kuzmenkov
3b428d6585 fixes 2020-07-09 13:46:16 +03:00
Alexander Kuzmenkov
5b3a106f7a fixes 2020-07-08 13:35:49 +03:00
alesapin
84f8bf1e14
Merge pull request #10697 from CurtizJ/polymorphic-parts 
Polymorphic parts (in-memory format)
 2020-07-08 13:25:45 +03:00
Alexander Kuzmenkov
41addf9173 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-08 13:22:06 +03:00
Alexander Kuzmenkov
68189db872
Update int_parsing.xml 2020-07-08 12:40:33 +03:00
Alexander Kuzmenkov
d85391f3ac too slow 2020-07-07 20:07:04 +03:00
Alexander Kuzmenkov
c49da9053d Merge remote-tracking branch 'origin/master' into HEAD 2020-07-07 20:06:27 +03:00
Alexander Kuzmenkov
62b83b412f split 2020-07-07 11:01:50 +03:00
alesapin
3f90f65678 Merge remote-tracking branch 'origin' into CurtizJ-polymorphic-parts 2020-07-06 21:34:17 +03:00
Nikita Mikhaylov
53522c728b
Merge pull request #11662 from Avogar/orc_output_format 
Add ORCBlockOutputFormat
 2020-07-06 18:51:35 +04:00
Alexander Kuzmenkov
c1fa01cabf
Update questdb_sum_double.xml 2020-07-06 13:58:47 +03:00
Alexander Kuzmenkov
2fbd3cb6a4 fixup 2020-07-06 13:51:26 +03:00
Alexander Kuzmenkov
432cadae15 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-06 11:44:09 +03:00
Alexander Kuzmenkov
9f32615d32
Merge pull request #11606 from CurtizJ/polymorphic-parts-2 
Make polymorphic_parts perf test not blazing fast
 2020-07-06 11:43:30 +03:00
Alexey Milovidov
91ca33de86 Merge branch 'perf-test-questdb' of github.com:yandex/ClickHouse into perf-test-questdb 2020-07-04 23:35:15 +03:00
Alexey Milovidov
43218567fa Merge branch 'master' into perf-test-questdb 2020-07-04 23:34:51 +03:00
Anton Popov
73676f5022
Improve performace of reading in order of sorting key. (#11696) 
* simplify reading in order of sorting key

* add perf test for reading many parts

* Revert "simplify reading in order of sorting key"

This reverts commit 7267d7c46e.

* add threshold for preliminary merge for reading in order

* better threshold

* limit threads in test
 2020-07-04 15:48:51 +03:00
Nikita Mikhaylov
5c97106ea3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into Avogar_orc_output_format 2020-07-03 18:00:28 +03:00
Alexander Kuzmenkov
e27e509667
Update polymorphic_parts_l.xml 2020-07-03 11:46:48 +03:00
Alexander Kuzmenkov
02ee988d80
Update polymorphic_parts_m.xml 2020-07-03 11:46:29 +03:00
Alexander Kuzmenkov
1ffc4ad88a
Update polymorphic_parts_s.xml 2020-07-03 11:46:10 +03:00
Alexander Kuzmenkov
10b6f98ca6 fixup 2020-07-03 11:39:43 +03:00
Alexander Kuzmenkov
7d8a31aff3 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-03 10:09:20 +03:00
Alexander Kuzmenkov
03becdbae4
Update polymorphic_parts_s.xml 2020-07-03 09:12:15 +03:00
Alexander Kuzmenkov
d1a93523b6
Update polymorphic_parts_m.xml 2020-07-03 09:11:46 +03:00
Alexander Kuzmenkov
68ca587a71
Update polymorphic_parts_l.xml 2020-07-03 09:11:17 +03:00
Anton Popov
4422df2e37 Merge remote-tracking branch 'upstream/master' into HEAD 2020-07-02 20:18:21 +03:00
Anton Popov
17d49af183 fix test with buffer table 2020-07-02 20:12:36 +03:00
Alexander Kuzmenkov
a2b8412b41 fixup 2020-07-02 10:44:16 +03:00
Alexander Kuzmenkov
f50f8d936e Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:19:26 +03:00
Alexander Kuzmenkov
41088c3416 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:13:11 +03:00
Alexander Kuzmenkov
99514a7e24 fixup 2020-07-02 10:13:02 +03:00
Alexander Kuzmenkov
f4869eca41
Update cpu_synthetic.xml 2020-06-30 15:14:18 +03:00
Alexander Kuzmenkov
7e2f6937e0 fixup 2020-06-30 12:45:19 +03:00
Alexander Kuzmenkov
b5f9e9de78 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 12:28:14 +03:00
Alexander Kuzmenkov
a4152cfb00 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 08:55:56 +03:00