BoloniniD
30712ead45
Merge branch 'master' into BLAKE3
2022-04-13 00:45:44 +03:00
Maksim Kita
04089be144
Fix hash_table_sizes_stats performance test
2022-04-12 17:46:16 +02:00
Maksim Kita
3d36698f56
Fix group_by_sundy_li performance test
2022-04-12 17:06:38 +02:00
Maksim Kita
9b332c1e31
Fix early_constant_folding performance test
2022-04-12 17:06:21 +02:00
Maksim Kita
8cf67ed4c0
Fix constant_column_search performance tests
2022-04-12 15:22:14 +02:00
Maksim Kita
7803ecaee5
Fix performance tests
2022-04-12 15:22:14 +02:00
Kruglov Pavel
73adbb4c15
Merge pull request #35986 from amosbird/better-scalar1
...
Fix performance regression of scalar query
2022-04-07 14:07:59 +02:00
Amos Bird
df06f9f974
Fix performance regression of scalar query
2022-04-06 17:50:22 +08:00
Nikolai Kochetov
4479b68980
Merge pull request #35623 from nickitat/function_calculation_after_sorting_and_limit
...
Functions calculation after sorting
2022-04-05 12:09:56 +02:00
Maksim Kita
b160ffd726
Merge pull request #35723 from ClickHouse/array-has-all-sse-avx2-optimizations
...
Merging #27653
2022-04-05 11:09:14 +02:00
Nickita Taranov
4c51329ad6
stash
2022-04-04 14:33:57 +02:00
Maksim Kita
3c472a7897
Simplified hasAll performance tests
2022-04-04 13:34:40 +02:00
Nikolay Degterinsky
f055d7b692
Merge pull request #34055 from palegre-tiny/groupSortedArray
...
Add groupSortedArray() function
2022-03-31 01:20:15 +03:00
Nikita Taranov
30f2a942c5
Predict size of hash table for GROUP BY ( #33439 )
...
* use AggregationMethod ctor with reserve
* add new settings
* add HashTablesStatistics
* support queries with limit
* support distributed and with external aggregation
* add new profile events
* add some tests
* add perf test
* export cache stats through AsynchronousMetrics
* rm redundant trace
* fix style
* fix 02122_parallel_formatting test
* review fixes
* fix 02122_parallel_formatting test
* apply also to two-level HTs
* try simpler strategy
* increase max_size_to_preallocate_for_aggregation for experiment
* fixes
* Revert "increase max_size_to_preallocate_for_aggregation for experiment"
This reverts commit 6cf6f75704
.
* fix test
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-03-30 22:47:51 +02:00
Maksim Kita
2742b88e6c
Merge pull request #27653 from ContentSquare/hasAllAny_SIMD
...
Implement HasAll specialization for SSE and AVX2
2022-03-29 16:35:59 +02:00
BoloniniD
2d2420c8a9
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-03-29 11:00:50 +03:00
mergify[bot]
bf5a9dcb7a
Merge branch 'master' into groupSortedArray
2022-03-28 20:57:07 +00:00
Alexey Milovidov
d54138425f
Rename yandexConsistentHash to kostikConsistentHash
2022-03-24 02:18:25 +01:00
mergify[bot]
5df84df596
Merge branch 'master' into groupSortedArray
2022-03-21 13:35:06 +00:00
Raúl Marín
90fd425117
Add ASOF performance test with random data
2022-03-17 19:48:25 +01:00
Raúl Marín
e2cec4e65b
Merge remote-tracking branch 'blessed/master' into asof_ftw
2022-03-17 16:33:29 +01:00
Maksim Kita
b202130841
Fixed performance tests
2022-03-15 15:43:39 +00:00
Maksim Kita
08bb39d869
Fixed performance tests
2022-03-15 15:43:39 +00:00
Maksim Kita
d49df02074
Fixed performance tests
2022-03-15 15:43:39 +00:00
Maksim Kita
98df85d2b7
Performance tests fix
2022-03-15 15:43:39 +00:00
BoloniniD
253afd032f
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-03-13 21:18:46 +03:00
Maksim Kita
0dd807d19d
Merge pull request #34750 from kitaisreal/merge-tree-improve-insert-performance
...
MergeTree improve insert performance
2022-03-13 13:39:18 +01:00
Alexey Milovidov
0995c63ea1
Adjust timezone in performance tests
2022-03-11 23:49:13 +01:00
Maksim Kita
f1d2f2a9e1
Updated tests
2022-03-11 21:16:25 +00:00
Maksim Kita
d12618cd2e
Updated performance tests
2022-03-10 21:45:31 +00:00
Maksim Kita
765cd09d06
MergeTree improve insert performance
2022-03-10 21:45:31 +00:00
BoloniniD
8474babe88
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-03-02 18:27:53 +03:00
mergify[bot]
93b13c0232
Merge branch 'master' into asof_ftw
2022-03-02 13:20:50 +00:00
mergify[bot]
cd6f1d8fa4
Merge branch 'master' into groupSortedArray
2022-02-25 11:45:48 +00:00
Raúl Marín
e0c6014ecd
Mention scipy dep in performance bench README
2022-02-20 02:43:28 +01:00
BoloniniD
3f149e88be
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-02-19 20:23:19 +03:00
Raúl Marín
2627c8d437
Add a performance test using ASOF
2022-02-18 17:37:24 +01:00
Maksim Kita
80b0efb367
Performance tests fix H3
2022-02-18 15:57:54 +00:00
Pablo Alegre
9466aafb3c
fixup! Add groupSortedArray() function
2022-02-15 14:48:20 +01:00
Anton Popov
5c316ffabe
support filtering by sparse columns without convertion to full
2022-02-15 14:30:54 +03:00
mergify[bot]
aab54f4c83
Merge branch 'master' into groupSortedArray
2022-02-14 12:47:48 +00:00
BoloniniD
c8bb6fb38a
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-02-13 12:47:18 +03:00
Maksim Kita
e2c8ba9ab2
Added performance test
2022-02-12 16:05:35 +00:00
Pablo Alegre
1e4b504ae2
fixup! Add groupSortedArray() function
2022-02-10 16:49:28 +01:00
avogar
bfa96463ca
Fix possible error 'file_size: Operation not supported'
2022-02-10 09:23:27 +03:00
Maksim Kita
613c9fa3c2
Merge pull request #34339 from kitaisreal/map-populate-series-refactoring
...
Function mapPopulateSeries added additional performance test
2022-02-06 01:19:32 +01:00
Maksim Kita
35235d2d7f
Added additional performance test
2022-02-05 16:11:36 +00:00
Maksim Kita
eff16baaf3
Merge pull request #34318 from kitaisreal/map-populate-series-refactoring
...
Function mapPopulateSeries refactoring
2022-02-05 12:51:02 +01:00
Maksim Kita
6e789f98ea
Added performance tests
2022-02-04 14:58:55 +00:00
BoloniniD
31e7093b5b
Updated Extras repo for BLAKE3
2022-02-03 22:04:28 +03:00
Danila Kutenin
c90b1f7794
Optimize quantilesExact{Low,High} to use nth_element instead of sort
2022-02-03 12:24:33 +00:00
BoloniniD
9b2292ec6c
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-02-02 12:09:01 +03:00
avogar
6229ec530d
Fix some perf tests
2022-01-31 21:07:20 +03:00
youenn lebras
c0864e6cd9
Update branch - Merge master
2022-01-31 10:22:25 +01:00
BoloniniD
b04ed43ebd
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-01-30 22:58:04 +03:00
Maksim Kita
f3453024ff
Merge pull request #34060 from amosbird/optimizetupleorderby
...
Make ORDER BY tuple almost as fast as ORDER BY columns
2022-01-29 15:58:09 +01:00
BoloniniD
44591b79ff
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-01-27 19:49:58 +03:00
Amos Bird
faee95b897
Make ORDER BY tuple almost as fast as ORDER BY columns
...
We have special optimizations for multiple column ORDER BY: https://github.com/ClickHouse/ClickHouse/pull/10831 . It's beneficial to also apply to tuple columns.
Before:
select * from numbers(300000000) order by (1 - number , number + 1 , number) limit 10;
2.613 sec.
After:
select * from numbers(300000000) order by (1 - number , number + 1 , number) limit 10;
0.755 sec
No tuple:
select * from numbers(300000000) order by 1 - number , number + 1 , number limit 10;
0.755 sec
2022-01-27 21:42:08 +08:00
Pablo Alegre
e813f6413f
Add groupSortedArray() function
2022-01-27 12:22:59 +01:00
BoloniniD
6f078c164d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-01-26 20:11:27 +03:00
Nikolay Degterinsky
5edbae6734
Merge branch 'master' into classification
2022-01-25 10:22:47 +00:00
Maksim Kita
1f72bde52f
Fix performance tests
2022-01-19 10:41:58 +00:00
Maksim Kita
6536c3aaee
Added performance tests
2022-01-18 13:20:54 +00:00
BoloniniD
b486f9462b
Fix the memory leak
2022-01-12 18:28:30 +03:00
BoloniniD
450f0a53b9
Add BLAKE3 to performance tests
2022-01-10 23:12:33 +03:00
Nikolay Degterinsky
2bdee0b0b8
Merge branch 'master' into classification
2021-12-30 02:17:47 +00:00
Nikolay Degterinsky
c5ccefb9df
Add tests
2021-12-27 13:43:19 +00:00
Raúl Marín
d9bcb633de
Change perf set_index test to check build index
2021-12-23 13:53:36 +01:00
Raúl Marín
eddccb0065
Merge remote-tracking branch 'blessed/master' into kill_scalar_github
2021-12-21 10:00:17 +01:00
alesapin
6bd7e425c6
Merge pull request #22535 from CurtizJ/sparse-serialization
...
Sparse serialization and ColumnSparse
2021-12-17 15:26:17 +03:00
mergify[bot]
bff0424139
Merge branch 'master' into kill_scalar_github
2021-12-15 09:22:58 +00:00
Anton Popov
16312e7e4a
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-14 18:58:17 +03:00
youenn lebras
c2b761acf2
Add cmake option to enable or not AVX2 instructions
...
This reverts commit bca8eca44fe382b6efe80a381d42e6ede8a91fa3.
2021-12-14 09:45:03 +01:00
youenn lebras
0154eab9cb
Modify performance tests for HasAll, removing Large tests to see if it helps passing CICD
2021-12-13 17:57:33 +01:00
Youenn Lebras
a71944d11d
Add performance tests for HasAll for int{64,16,8}
2021-12-13 17:57:30 +01:00
Youenn Lebras
ade754d444
Fix a bug for avx2 and add performance tests for HasAll<int32>
2021-12-13 17:57:29 +01:00
alesapin
e2a2d1cdc3
Merge branch 'master' into add_performance_tests
2021-12-13 12:01:31 +03:00
Alexey Milovidov
d677a5ab67
Fix perf test
2021-12-12 04:31:56 +03:00
Raúl Marín
f38ddb4f53
Mark affected tests as short
2021-12-10 10:33:08 +01:00
alesapin
b62de9b2f4
Merge branch 'master' into add_performance_tests
2021-12-09 11:40:32 +03:00
Anton Popov
d8367334a3
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-08 18:26:19 +03:00
Maksim Kita
4077d769e7
Merge pull request #31949 from Algunenano/parser_speedup
...
Speedup query parsing
2021-12-05 16:24:45 +03:00
Anton Popov
54f51444c0
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-01 15:49:02 +03:00
Raúl Marín
f3a22166a1
Merge remote-tracking branch 'blessed/master' into speedup_avg_sumcount
2021-11-29 19:50:28 +01:00
Raúl Marín
6ba1fb1bc9
Needs more data in avg tests
2021-11-29 19:50:03 +01:00
Raúl Marín
02035643c1
Add perf test
2021-11-29 13:09:53 +01:00
Raúl Marín
c346708f31
Make count performance tests longer
2021-11-26 09:06:37 +01:00
Raúl Marín
a22f7c159e
Implement AggregateFunctionCountNotNullUnary::addBatchSinglePlace
2021-11-25 16:41:48 +01:00
Raúl Marín
5662a94921
Reduce size of some performance tests
2021-11-25 09:31:02 +01:00
Raúl Marín
78656f4956
Merge remote-tracking branch 'blessed/master' into speedup_avg_sumcount
2021-11-25 09:17:10 +01:00
alesapin
58fad90351
Merge branch 'master' into add_performance_tests
2021-11-25 10:53:10 +03:00
Raúl Marín
1f0292cf7b
Add performance test for avg over floating points
2021-11-24 18:22:19 +01:00
avogar
2cabfd22d1
Add perf test for writing valid UTF8
2021-11-24 15:37:02 +03:00
alesapin
c83c484bdc
Trying to have smaller test
2021-11-24 14:13:59 +03:00
alesapin
2d84336706
Trying to have smaller test
2021-11-24 14:13:59 +03:00
Raúl Marín
8e19fd0345
Some extra perf tests around sumCount
2021-11-24 11:14:31 +01:00
Raúl Marín
c4c31fd946
Add some performance tests for avg
2021-11-24 11:14:31 +01:00
Alexander Tokmakov
416a82b99a
Merge branch 'master' into check_dependencies_on_drop
2021-11-15 13:35:45 +03:00
Anton Popov
66973a2a28
Merge remote-tracking branch 'upstream/master' into HEAD
2021-11-08 21:27:45 +03:00
alexey-milovidov
e5b811f96d
Merge pull request #31028 from azat/perf-drop-table
...
perf: add missing DROP TABLE queries
2021-11-04 00:31:19 +03:00
Alexander Tokmakov
23e8cc24b5
fix tests
2021-11-03 18:06:19 +03:00
Azat Khuzhin
82d6fead89
perf: add missing DROP TABLE queries
2021-11-03 08:26:52 +03:00
Kruglov Pavel
1f8535c02b
Merge branch 'master' into null-deserialization
2021-11-02 12:15:21 +03:00
Anton Popov
d50137013c
Merge remote-tracking branch 'upstream/master' into HEAD
2021-11-01 16:55:53 +03:00
avogar
d30aecbda8
Add performance test
2021-10-27 17:29:36 +03:00
Maksim Kita
5231e8b8d9
HashedDictionaries added read performance tests
2021-10-25 20:12:29 +03:00
Maksim Kita
772c326f2d
Merge pull request #30500 from kitaisreal/dictionaries-read-multiple-threads
...
Dictionaries read support multiple threads
2021-10-25 15:31:50 +03:00
Maksim Kita
f1748aef90
Updated perf tests
2021-10-25 15:31:27 +03:00
Alexey Milovidov
f9529c9d78
Adjust perf test
2021-10-24 00:11:28 +03:00
Anton Popov
0c80ebe787
Update read_in_order_many_parts.xml
2021-10-23 18:08:08 +03:00
Maksim Kita
4ccc619bd5
Added performance tests
2021-10-23 15:01:30 +03:00
Anton Popov
82b409e2b0
better perf test
2021-10-19 17:13:52 +03:00
Anton Popov
82bff416f6
Merge remote-tracking branch 'upstream/master' into HEAD
2021-10-19 16:48:47 +03:00
Anton Popov
c547ffa313
improve performance of aggregation in order primary key with function with heavy states
2021-10-19 16:36:31 +03:00
Anton Popov
d71ffc355a
Merge remote-tracking branch 'upstream/master' into HEAD
2021-10-18 15:18:22 +03:00
Anton Popov
1a947d30bf
add perf test
2021-10-16 16:43:10 +03:00
Maksim Kita
c9638bacbf
Added HashedArray dictionary
2021-10-15 18:53:17 +03:00
Anton Popov
7aa6068fb2
Merge remote-tracking branch 'upstream/master' into HEAD
2021-10-14 19:44:08 +03:00
Maksim Kita
ec898f1a94
Merge pull request #28633 from darkkeks/normalize-utf8-nfc
...
Add normalizeUTF8 function with NFC normalization
2021-10-12 12:25:07 +03:00
Azat Khuzhin
0b6063a902
Disable merges for parallel_mv
2021-10-02 11:54:47 +03:00
Anton Popov
914781052e
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-29 17:37:07 +03:00
Viachaslau Boben
762904adbd
Add nfd and perf test
2021-09-28 13:42:37 +03:00
Alexey Milovidov
91a81fdf3b
Adjust performance test
2021-09-21 22:19:13 +03:00
Anton Popov
eef436fe22
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-16 18:07:42 +03:00
vdimir
a3304a87a4
Rename optimize_syntax_fuse_aggregate -> optimize_syntax_fuse_functions
2021-09-14 15:27:12 +03:00
vdimir
a1463d5719
Merge remote-tracking branch 'origin/master' into fuse_quantile
2021-09-14 15:23:06 +03:00
vdimir
5a1aeeb044
Use optimize_syntax_fuse_aggregate
instead of optimize_fuse_sum_count_avg
and optimize_fuse_quantile
2021-09-14 15:21:16 +03:00
Raúl Marín
50360aa586
Add extra performance tests for Nullable floating point Sum
...
The existing ones aren't that representative since there isn't
any NULL values, so the branch predictor is correct 100% of the time
2021-09-11 22:37:45 +02:00
Anton Popov
8203bd1ac6
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-09 14:04:37 +03:00
Alexey Milovidov
ca6f6306f3
Merge branch 'master' into async-reads
2021-08-31 02:52:58 +03:00
Kruglov Pavel
95fd6197dc
Merge pull request #27729 from ContentSquare/sequenceMatchQuickCheck
...
Sequence match quick check
2021-08-30 13:04:23 +03:00
Alexey Milovidov
9027a663f7
Minor fix in perf test
2021-08-30 00:18:38 +03:00
Alexey Milovidov
e995796d3a
Fix one of perf tests
2021-08-28 02:12:05 +03:00
Alexey Milovidov
f56a1a84ae
Update perf test (non-significant)
2021-08-28 00:32:21 +03:00
Jakub Kuklis
7e3e050003
Changing the tests to use mainly test.hits dataset, as hits_10[0]m_single datasets have a slightly different schema
2021-08-27 10:14:17 +02:00
Jakub Kuklis
c60e935830
Adding Format Null to performance test queries, style improvement for the test, additional comments in the code
2021-08-26 16:42:39 +02:00
jkuklis
39ba4f660b
Use smaller dataset in the performance test so that it doesn't time out in PR
2021-08-25 09:26:48 +02:00
Jakub Kuklis
caf40d77ed
Adding a performance test with queries presented in the PR
2021-08-23 11:03:59 +02:00
Anton Popov
c3c3a06078
Merge remote-tracking branch 'upstream/master' into HEAD
2021-08-20 01:45:38 +03:00
alexey-milovidov
eb3bbdfab5
Merge pull request #27680 from ClickHouse/decimal-no-trailing-zeros
...
Remove trailing zeros from Decimal serialization #15794
2021-08-18 05:24:13 +03:00
Alexey Milovidov
4051db8eab
Add performance test
2021-08-17 09:11:35 +03:00
Pavel Kruglov
aa8b52fe58
Update tests
2021-08-13 14:55:33 +03:00
mergify[bot]
80eaea1c51
Merge branch 'master' into short-circuit
2021-08-12 08:38:45 +00:00
Maksim Kita
07c1a8e26e
Aggregation temporary disable compilation without key
2021-08-11 19:37:33 +03:00
Pavel Kruglov
95d52b9e5f
Refactor 2.0
2021-08-11 18:56:03 +03:00
Pavel Kruglov
09dad40461
Update test
2021-08-09 18:02:09 +03:00
Pavel Kruglov
9fd4d14521
Fix style, build, add test
2021-08-09 17:57:50 +03:00
Pavel Kruglov
a9cf67ecf2
Fix bugs, add tests
2021-08-09 17:57:49 +03:00
Pavel Kruglov
3ec2ab6156
Avoid using expand, fix bugs, add tests and comments
2021-08-09 17:54:49 +03:00
Pavel Kruglov
3cf0bd337f
Remove unrelated change
2021-08-09 17:54:14 +03:00
Pavel Kruglov
67ad60d69d
Add tests
2021-08-09 17:54:14 +03:00
Pavel Kruglov
1e89b5d01a
Mark tests as short
2021-08-09 17:54:14 +03:00
Kruglov Pavel
fd56210652
Update short_circuit_functions.xml
2021-08-09 17:50:09 +03:00
Pavel Kruglov
e792fa588f
Mark all Functions as sutable or not for executing as short circuit arguments
2021-08-09 17:50:09 +03:00
Pavel Kruglov
4e5db93af3
Add small perf test
2021-08-09 17:44:39 +03:00
Maksim Kita
e6b339fbb3
Merge pull request #26845 from kitaisreal/compile-aggregate-functions-without-key
...
Compile aggregate functions without key
2021-08-09 11:52:52 +03:00
alexey-milovidov
1a0570cdef
Merge pull request #27219 from evillique/perf
...
Fix NLP performance test
2021-08-05 22:05:59 +03:00
Alexander Kuzmenkov
4bc652699f
Merge pull request #27184 from ClickHouse/aku/window-functions
...
mark window functions as ready for general use
2021-08-05 14:18:28 +03:00
Nikolay Degterinsky
1e8badcf05
Improve NLP performance test
2021-08-05 11:07:31 +00:00
Maksim Kita
7264c7bf4b
Fixed performance tests
2021-08-05 12:37:15 +03:00
Alexander Kuzmenkov
0730e685b0
Mark window functions ready for general use.
2021-08-04 17:45:32 +03:00
Maksim Kita
8d061390f3
Updated performance tests
2021-08-03 16:19:56 +03:00
Amos Bird
4f7e007d35
Specialize date time comparision.
2021-08-03 16:49:39 +08:00
Anton Popov
16ed0f6ed4
Merge remote-tracking branch 'upstream/master' into HEAD
2021-08-02 17:55:17 +03:00
alesapin
02176fb4c7
Add experimental flag
2021-07-30 18:25:51 +03:00
alesapin
acc4e9e79d
Merge remote-tracking branch 'evillique/nlp' into evillique-nlp
2021-07-30 16:46:58 +03:00
Maksim Kita
3a6b37691a
Compile aggregate functions without key
2021-07-27 19:50:57 +03:00
Anton Popov
c4b454494f
Merge remote-tracking branch 'upstream/master' into HEAD
2021-07-20 15:41:01 +03:00
Alexey Milovidov
f13ed405a2
Fix perf test
2021-07-17 13:11:50 +03:00
Anton Popov
a2c493cd7f
add perf test for table with many arrays
2021-07-15 17:02:48 +03:00
Maksim Kita
36de61c6d0
Fixed performance test
2021-07-10 16:37:32 +03:00
Maksim Kita
dc81ae7c6e
Compile AggregateFunctionBitwise
2021-07-10 01:51:34 +03:00
vdimir
bff1fa1c58
Add tests/performance/join_max_streams.xml
2021-07-07 20:51:07 +03:00
Nikolay Degterinsky
0c2eb15223
Added performance test
2021-07-07 15:54:21 +00:00
Anton Popov
14168b11f2
Merge remote-tracking branch 'upstream/master' into HEAD
2021-07-07 17:05:11 +03:00
Maksim Kita
577e69898a
Compile aggregate functions perf tests fix
2021-07-05 12:17:01 +03:00
Maksim Kita
97e1ddbe94
Fix before merge
2021-07-01 22:56:36 +03:00
Maksim Kita
22491c8adc
Compile AggregateFunctionCount
2021-07-01 22:56:36 +03:00
Maksim Kita
246ba45082
Added hits_100m_single benchmark
2021-07-01 22:56:36 +03:00
Maksim Kita
0c395bc1ef
Added performance tests
2021-07-01 22:56:36 +03:00
Maksim Kita
1e9e073b0a
Merge pull request #25618 from vdimir/slow-dict-join-fix
...
Fix unnecessary dictionary re-reads in KeyGetterForDict
2021-06-30 10:54:48 +03:00
alexey-milovidov
11d9c36be0
Merge pull request #25742 from ClickHouse/fix-performance-test-2
...
Fix slow performance test
2021-06-27 23:52:33 +03:00
alexey-milovidov
8bcca162fc
Merge pull request #23311 from Avogar/uniq-theta-sketch
...
Add uniqTheta in performance test
2021-06-27 18:57:37 +03:00
Alexey Milovidov
887be640f9
Fix slow performance test
2021-06-27 18:54:21 +03:00
Alexey Milovidov
686bf75f78
This performance test does not run in CI - remove
2021-06-27 03:11:59 +03:00
vdimir
6fae921d65
Smaller table in performance/dict_join.xml
2021-06-24 11:27:55 +03:00
vdimir
ea7f798de4
Add tests/performance/dict_join.xml
2021-06-23 14:15:32 +03:00
Pavel Kruglov
57a9659c68
Add Arrow/Parquet/ORC in perf tests
2021-06-15 16:15:27 +03:00
mergify[bot]
043e7ccd37
Merge branch 'master' into uniq-theta-sketch
2021-06-11 12:23:09 +00:00
Kruglov Pavel
dde9ce5223
Use hits_10m_single only for uniqTheta
2021-06-11 15:22:35 +03:00
Anton Popov
018a303387
Merge remote-tracking branch 'upstream/master' into HEAD
2021-05-31 23:08:04 +03:00
Kruglov Pavel
e584b028e7
Merge pull request #24475 from amosbird/readint
...
Pedantic readInt
2021-05-28 15:44:23 +03:00
Kruglov Pavel
3d01028d19
Use hits_10m_single instead of hits_100m_single
2021-05-28 14:20:39 +03:00
Amos Bird
6f12781bf1
Safer readInt
2021-05-27 22:56:51 +08:00
Alexander Kuzmenkov
86f639d0c3
fix test killed by github
2021-05-27 12:57:08 +03:00
Alexander Kuzmenkov
5da54c2745
calculate perf test precision thresholds from historical data
2021-05-26 16:30:43 +03:00
Alexander Kuzmenkov
67044d69f3
Update set_index.xml
2021-05-26 14:54:07 +03:00
Alexander Kuzmenkov
4c7752951c
Update joins_in_memory_pmj.xml
2021-05-26 14:53:28 +03:00
Anton Popov
3e92c7f61a
Merge remote-tracking branch 'upstream/master' into HEAD
2021-05-25 21:45:19 +03:00
Alexander Kuzmenkov
f227020018
Merge pull request #24049 from ClickHouse/aku/perf-unstable
...
complain about unstable perf test queries
2021-05-24 12:59:12 +03:00
mergify[bot]
ee939d9b5f
Merge branch 'master' into uniq-theta-sketch
2021-05-21 20:52:02 +00:00
alexey-milovidov
7b38ad3a85
Merge pull request #23204 from RedClusive/feature-quantileBfloat16
...
Feature quantile bfloat16
2021-05-21 23:46:05 +03:00
Alexander Kuzmenkov
30fa7d4acc
Update group_by_sundy_li.xml
2021-05-21 14:07:15 +03:00
Alexey Milovidov
28c0e85dab
Add performance test
2021-05-21 09:29:56 +03:00
Anton Popov
9412a3a894
add perf test for sparse column
2021-05-21 01:06:41 +03:00
Alexander Kuzmenkov
b45ac02e7e
adjust thresholds
2021-05-20 17:24:05 +03:00
Alexander Kuzmenkov
aeb8431004
update thresholds - 1
2021-05-20 17:14:55 +03:00
Alexander Kuzmenkov
a1749cf5c3
fix
2021-05-20 15:05:20 +03:00
Alexander Kuzmenkov
0176aa1878
Merge remote-tracking branch 'origin/master' into HEAD
2021-05-20 14:44:01 +03:00
Kruglov Pavel
e832296768
Reorder values
2021-05-20 11:14:24 +03:00
Kruglov Pavel
b93d59e931
Try to limit all queries to see the changes
2021-05-20 11:13:27 +03:00
Maksim Kita
0ca9ba19c0
Remove performance test
2021-05-19 16:14:28 +03:00
Alexander Kuzmenkov
bcf85a6bc5
Merge remote-tracking branch 'origin/master' into HEAD
2021-05-19 13:25:58 +03:00
Pavel Kruglov
4b94532136
Adjust query with SearchPhrase
2021-05-18 17:34:11 +03:00
Kruglov Pavel
d3a9d6633f
Rename uniqThetaSketch to uniqTheta
2021-05-18 11:34:13 +03:00
Maksim Kita
448fe5a6f9
Updated comment message
2021-05-17 11:04:29 +03:00
Maksim Kita
3a822d2832
Added comments
2021-05-17 10:25:50 +03:00
Alexander Kuzmenkov
708f280605
fix the test
2021-05-15 09:35:00 +03:00
Alexander Kuzmenkov
5ed6a273d3
Merge pull request #24058 from ClickHouse/aku/uniq-two-level
...
lower two-level aggregation threshold for uniq test to avoid jitter
2021-05-14 15:50:48 +03:00
Alexander Kuzmenkov
15564f32b2
Merge remote-tracking branch 'origin/master' into HEAD
2021-05-14 13:16:31 +03:00
Alexander Kuzmenkov
474eff5f9e
fix
2021-05-14 13:14:52 +03:00
Alexander Kuzmenkov
3aa919b498
fixes
2021-05-13 12:16:43 +03:00
Alexander Kuzmenkov
d7b726045a
fixes
2021-05-13 01:32:53 +03:00
Alexander Kuzmenkov
f6cb9f95df
lower two-level aggregation threshold for uniq test to avoid jitter
2021-05-12 16:01:48 +03:00
mergify[bot]
6b2b2b09c3
Merge branch 'master' into uniq-theta-sketch
2021-05-11 09:51:02 +00:00
Alexey Milovidov
c404e6db2f
Merge branch 'master' of github.com:yandex/ClickHouse into normalize-bigint
2021-05-07 18:25:12 +03:00
Anton Popov
576728829d
fix perf test
2021-05-07 16:23:46 +03:00
Anton Popov
a8259a6158
fix perf test
2021-05-06 21:26:55 +03:00
Anton Popov
e51cd90c6f
better cast operator
2021-05-06 21:21:10 +03:00
Alexey Milovidov
089027920f
Fix perf test
2021-05-04 20:31:26 +03:00
Alexey Milovidov
2134a4f4c1
Fix error in perf test
2021-04-22 08:43:20 +03:00
Alexander Kuzmenkov
6f90fc449b
Merge pull request #23308 from ClickHouse/aku/fix-perf
...
fix broken perf test
2021-04-19 20:31:38 +03:00
Pavel Kruglov
cf0d8be8aa
Add uniqTHetaSketch in performance test
2021-04-19 17:45:46 +03:00
Alexander Kuzmenkov
d9d94752d1
fix broken perf test
2021-04-19 17:05:47 +03:00
Alexander Kuzmenkov
2a4bcb6e3f
Merge pull request #23159 from ClickHouse/aku/merge-fusecount
...
merging sumCount fusion PR #21337
2021-04-19 16:47:13 +03:00
alexey-milovidov
83038f84af
Revert "Function arrayFold
for folding over array with accumulator"
2021-04-18 03:34:05 +03:00
Alexander Kuzmenkov
74b4c56ba4
Merge pull request #21589 from dmalkr/dmalkr/arrayFold
...
Function `arrayFold` for folding over array with accumulator
2021-04-16 14:23:53 +03:00
Alexander Kuzmenkov
d4b8807016
Update fuse_sumcount.xml
2021-04-16 13:36:52 +03:00
Maksim Kita
1797a67cf8
Merge pull request #22925 from kitaisreal/flat_dictionary_performance_test_fix
...
Dictionaries updated performance tests
2021-04-16 10:46:41 +03:00
Alexander Kuzmenkov
2489b6af96
cleanup
2021-04-15 19:40:49 +03:00
Maksim Kita
b8a1ead3e9
Updated hashed_dictionary test
2021-04-15 13:51:40 +03:00
Alexey Milovidov
076c746e6d
Add perf test
2021-04-15 01:35:21 +03:00
Maksim Kita
2c3abcaad1
Updated test
2021-04-14 16:49:38 +03:00
Maksim Kita
da3d3e906a
Updated tests
2021-04-13 21:13:04 +03:00
Maksim Kita
8abaf01a5d
Updated dictionaries tests
2021-04-13 15:57:11 +03:00
hexiaoting
77c460e8d1
Merge remote-tracking branch 'origin/master' into dev-sumcount
2021-04-13 11:14:14 +08:00
Dmitry Krylov
5c24225d86
Fix performance tests
2021-04-12 10:23:31 +10:00
Dmitry Krylov
602fb190b0
Benchmarks for arrayFold
2021-04-12 10:23:31 +10:00
Maksim Kita
1557161d92
Updated test
2021-04-10 22:14:05 +03:00
Maksim Kita
f8c8b5e49d
Updated test
2021-04-10 22:14:05 +03:00
Maksim Kita
6eb75228e9
FlatDictionary performance test fix
2021-04-10 22:14:05 +03:00
Alexander Kuzmenkov
1e3c72caaa
Update flat_dictionary.xml
2021-04-10 00:50:21 +03:00
Nikolai Kochetov
28ca191102
Merge pull request #22087 from ClickHouse/better-filter-push-down
...
Better filter push down
2021-04-09 10:22:17 +03:00
Nikolai Kochetov
a9a11823e3
Try fix perftest.
2021-04-08 21:27:01 +03:00
Nikolai Kochetov
73ea362ef4
Fix perftest.
2021-04-08 11:52:09 +03:00
Maksim Kita
ef7571c226
Merge pull request #22521 from kitaisreal/dictionaries-update-field-fix
...
FlatDictionary, HashedDictionary update_field optimizations
2021-04-07 23:29:53 +03:00
Maksim Kita
7baafcb567
Merge pull request #22630 from kitaisreal/direct-dictionary-dict-get-multiple-columns-optimization
...
DirectDictionary dictGet multiple columns optimization
2021-04-07 10:29:42 +03:00
Nikolai Kochetov
6102652c99
Merge branch 'master' into better-filter-push-down
2021-04-06 13:38:03 +03:00
Alexander Kuzmenkov
4402ec3101
Merge pull request #22324 from ClickHouse/aku/perf-stable
...
make some perf test queries more stable
2021-04-06 13:15:38 +03:00
Nikolai Kochetov
44700d97e9
Add setting to disable query plan optimization. Fix perftest.
2021-04-06 11:25:54 +03:00
Maksim Kita
0cbfa5d125
Updated test
2021-04-06 11:19:28 +03:00
Anton Popov
8559958df4
try to fix perf test
2021-04-06 01:03:15 +03:00
Alexander Kuzmenkov
2d0de76375
fix
2021-04-05 13:03:29 +03:00
Maksim Kita
deb35c5f4e
DirectDictionary dictGet multiple columns optimization
2021-04-05 01:26:26 +03:00
Maksim Kita
63f2008725
FlatDictionary fix perf test
2021-04-05 00:47:29 +03:00
Maksim Kita
027ca2484e
FlatDictionary added layout options initial_array_size, max_array_size
2021-04-04 16:30:48 +03:00
Alexander Kuzmenkov
16c5658df6
Merge remote-tracking branch 'origin/master' into HEAD
2021-04-02 15:16:24 +03:00
Alexander Kuzmenkov
1599a0c0e0
fix
2021-04-02 15:14:25 +03:00
Alexander Kuzmenkov
b669b3aca9
Merge remote-tracking branch 'origin/master' into HEAD
2021-04-01 14:25:04 +03:00
Alexander Kuzmenkov
4bb40da52e
fixes
2021-04-01 14:24:56 +03:00
Maksim Kita
42ae39f78f
Updated tests
2021-04-01 12:13:36 +03:00
Maksim Kita
2ad29a541a
Updated interfaces
2021-04-01 00:12:21 +03:00
Alexander Kuzmenkov
73e72018fd
fixes
2021-03-31 16:04:55 +03:00
Maksim Kita
55984e849c
Merge branch 'master' into hierarchy-dictionaries-updated
2021-03-31 15:55:07 +03:00
Alexey Milovidov
64bfdb69d0
Adjust perf test
2021-03-30 15:24:22 +03:00
Alexander Kuzmenkov
54495136d4
more
2021-03-29 23:26:06 +03:00
Alexander Kuzmenkov
e5c48d5d4e
more
2021-03-29 23:12:54 +03:00
Alexander Kuzmenkov
3a4ac94901
make some perf test queries more stable
2021-03-29 22:43:34 +03:00
Maksim Kita
3071d45ade
Fixed tests
2021-03-29 16:41:03 +03:00
Maksim Kita
2e55d47bab
Updated benchmarks
2021-03-28 13:35:26 +03:00
Alexey Milovidov
699af9d034
Add perf test
2021-03-28 04:29:55 +03:00
Maksim Kita
4f298d54b9
Added perf tests
2021-03-27 17:00:00 +03:00
Alexey Milovidov
c7d2671f32
Merge branch 'speedup-none' into mmap-cache
2021-03-27 02:42:44 +03:00
Alexey Milovidov
1e08304fb1
Add performance test
2021-03-26 22:12:56 +03:00
Alexander Kuzmenkov
a5fb5a7183
Merge pull request #22148 from ClickHouse/aku/perf-thresholds
...
adjust perf test thresholds
2021-03-26 12:59:20 +03:00
Alexander Kuzmenkov
f3ca9db832
forgot abs()
2021-03-26 01:00:06 +03:00
Alexander Kuzmenkov
a12cc5f559
adjust perf test thresholds
2021-03-26 00:00:18 +03:00
Alexander Kuzmenkov
8ea697b7df
use camelCase
2021-03-25 18:49:45 +03:00
Alexander Kuzmenkov
b0284f20c3
Merge branch 'master' into aku/laglead
2021-03-22 21:16:27 +03:00
Nikolai Kochetov
bc63d4244b
Merge pull request #21856 from ClickHouse/aggregator-no-more-keys-batch
...
Batch aggregation for overflow rows.
2021-03-19 11:52:55 +03:00
Alexander Kuzmenkov
b5e344bf49
Update date_time_long.xml
2021-03-19 02:19:58 +03:00
Alexander Kuzmenkov
1beba597ca
Merge remote-tracking branch 'origin/master' into HEAD
2021-03-19 02:11:08 +03:00
Alexander Kuzmenkov
6aa9039f7d
float frames and lag/lead_in_frame
2021-03-19 02:05:43 +03:00
Nikolai Kochetov
b957162ca5
Add perftest.
2021-03-18 12:38:37 +03:00
Alexey Milovidov
1dd730d2d6
Fix perf test
2021-03-16 15:59:14 +03:00
Alexander Kuzmenkov
6fe1570ad8
Update fuse_sumcount.xml
2021-03-15 17:11:17 +03:00
Alexander Kuzmenkov
a7a79cae8b
Update fuse_sumcount.xml
2021-03-15 16:57:09 +03:00
alexey-milovidov
53e21443eb
Merge branch 'master' into DateTime64_extended_range
2021-03-14 12:27:17 +03:00
hexiaoting
ab2aaa7fe7
Rewriter visitor and add performance test
2021-03-12 15:29:38 +08:00
Maksim Kita
12083d0fa1
Fixed tests
2021-03-09 23:50:36 +03:00
Maksim Kita
69f8fb8c9a
Added dict has in benchmark
2021-03-09 23:50:36 +03:00
Maksim Kita
5e03418651
Added performance tests
2021-03-09 23:50:36 +03:00
Nikolai Kochetov
2a56697f6c
Update prewhere_with_row_level_filter.xml
2021-03-09 11:15:03 +03:00
Alexey Milovidov
0cdad60419
Try to enable long performance test
2021-03-08 03:28:25 +03:00
Denis Glazachev
6f4e883d8d
Factor out settings
...
Enable parallel insert select
Reduce the amount of data to process
2021-03-06 15:09:45 +04:00
Nikolai Kochetov
a195e783d2
Try fix perftests.
2021-03-04 13:25:49 +03:00
Alexander Kuzmenkov
f169be740a
Merge pull request #21381 from ClickHouse/aku/perf-negative
...
fix a rare false negative in perf tests
2021-03-03 15:55:14 +03:00
Alexander Kuzmenkov
08148e062f
Fix a rare false negative in perf tests
2021-03-02 19:21:30 +03:00
Nikolai Kochetov
ffbea93b10
Merge pull request #19576 from traceon/row-policy-with-prewhere
...
Allow row policies with PREWHERE
2021-03-02 13:51:37 +03:00
Denis Glazachev
14513e520e
Fix privileges
2021-03-01 18:03:29 +04:00
Denis Glazachev
eb80c189e4
Merge branch 'master' into row-policy-with-prewhere
2021-02-28 20:14:31 +04:00
Nikolai Kochetov
f63d7b45ce
Merge branch 'master' into fix-number-of-threads-in-subqueries
2021-02-26 11:15:03 +03:00
Alexey Milovidov
00e6b6232f
Revert "optimize aggfunc column data copy ( #19407 )"
...
This reverts commit 7e3186c826
.
2021-02-21 12:49:50 +03:00
Denis Glazachev
2ab643170d
Add 'SETTINGS optimize_move_to_prewhere = 0' in WHERE-only SELECTs
2021-02-20 00:45:19 +04:00
Denis Glazachev
8cc72b8fe0
Merge branch 'master' into row-policy-with-prewhere
...
* master: (160 commits)
Make Poco HTTP Server zero-copy again (#19516 )
Fixed documentation
ccache 4.2+ does not requires any quirks for SOURCE_DATE_EPOCH
Add a function `htmlOrXmlCoarseParse` to extract content from html or xml format string. (#19600 )
Reinterpret function added Decimal, DateTim64 support
Add test
Update InterpreterSelectQuery.cpp
Improved serialization for data types combined of Arrays and Tuples. Improved matching enum data types to protobuf enum type. Fixed serialization of the Map data type. Omitted values are now set by default.
Log stdout and stderr when failed to start docker in integration tests.
Added comment
Don't backport base commit of branch in the same branch (#20628 )
Fix fasttest retry for failed tests
Dictionary create source with functions crash fix
Added error reinterpretation tests
Update run.sh
Updated documentation
fix subquery with limit
Rename untyped function reinterpretAs into reinterpret
ignore data store files
Support vhost
...
2021-02-19 19:49:37 +04:00
Denis Glazachev
879d9206c1
Add tests for row-level security with prewhere
2021-02-19 02:47:28 +04:00
Anton Popov
e5cef576e5
Update subqueries.xml
2021-02-17 12:39:40 +03:00
Nikolai Kochetov
0b315fccc2
Merge branch 'master' into fix-number-of-threads-in-subqueries
2021-02-16 16:29:30 +03:00
Nikolai Kochetov
10f1432c5c
Added perftest.
2021-02-16 11:31:17 +03:00
Alexey Milovidov
5bdc570046
Improve performance of GROUP BY multiple fixed size keys
2021-02-14 01:56:04 +03:00
Alexander Kuzmenkov
716a3df6eb
Merge pull request #20337 from ClickHouse/aku/window-prototype
...
window function rank() and friends
2021-02-13 03:03:49 +03:00
alexey-milovidov
d15d340691
Merge pull request #20301 from azat/numbers-numeric-limit
...
Accept arbitrary numeric types for numbers() arguments (for scientific notation)
2021-02-11 20:41:15 +03:00
Alexander Kuzmenkov
1275be58bf
Merge remote-tracking branch 'origin/master' into HEAD
2021-02-11 19:49:37 +03:00
Alexander Kuzmenkov
62b3bf7b57
some tests and speedup
2021-02-11 19:20:57 +03:00
alexey-milovidov
263d751d64
Merge pull request #20169 from ClickHouse/no-excessive-squash-memory
...
Disable excessive squashing of blocks for StorageMemory #13052
2021-02-11 16:38:24 +03:00
Alexey Milovidov
c32ed77976
Some queries become too fast
2021-02-11 16:37:46 +03:00
Alexander Kuzmenkov
2571dac984
Merge pull request #20111 from ClickHouse/aku/window-prototype
...
RANGE OFFSET window frame
2021-02-11 10:39:21 +03:00
Alexey Milovidov
d3dba0e52a
Merge branch 'master' into no-excessive-squash-memory
2021-02-10 23:45:12 +03:00
Azat Khuzhin
b6dc721e33
Update tests for new numbers(limit) syntax
...
$ gg -e 'numbers(toUInt64' -e 'numbers_mt(toUInt64' | cut -d: -f1 | sort -u | xargs sed -i -E 's#numbers(_mt|)\(toUInt64\(([^()]*)\)\)#numbers\1(\2)#'
2021-02-10 22:32:32 +03:00
Alexander Kuzmenkov
c18749a704
fix a bug and add some tests
2021-02-09 17:44:04 +03:00
Alexander Kuzmenkov
e703390fce
Update reinterpret_as.xml
2021-02-09 00:31:30 +03:00
templarzq
7e3186c826
optimize aggfunc column data copy ( #19407 )
...
* optimize agg column data copy
* add aggfunc col data copy test
* fix null warning
* fix style
* fix style
* fix style
* fix style
* fix copy same dat to same pos bug
* fix style
* fix style
* Update ColumnAggregateFunction.cpp
fix type check
* control record buf size
* fix performance
* fix performance
* fix destroy data speed
* decrease run time.
* fix warning
* decrease test run time
* Update aggfunc_col_data_copy.xml
* replace unordered_map with HashMap
* fix compile err
* fix compile err
* fix compile err
* fix compile err
* fix compile err
* fix compile err
* fix compile err
* fix compile err
* fix compile err
* fix hash map compile err
* fix compile err
* fix compile err
* fix format
* faster test
Co-authored-by: centos7 <templarzq@localhost.localdomain>
2021-02-08 16:18:48 +03:00
Alexey Milovidov
e4b3ae34f1
Add perf test
2021-02-07 05:42:43 +03:00
Alexander Kuzmenkov
02ca7386b1
Merge pull request #19951 from ClickHouse/aku/window-prototype-3
...
CURRENT ROW and offset for start of ROWS frame
2021-02-04 14:33:13 +03:00
Alexey Milovidov
ab30c95b41
Adjust perf test
2021-02-04 10:35:30 +03:00
Alexander Kuzmenkov
d8a9d347fe
Merge pull request #20000 from ClickHouse/aku/perf
...
update perf tests
2021-02-03 16:06:58 +03:00
Alexander Kuzmenkov
53052f7040
Update group_by_sundy_li.xml
2021-02-03 12:22:02 +03:00
Alexander Kuzmenkov
bb45c5a8ff
Merge remote-tracking branch 'origin/master' into HEAD
2021-02-03 12:13:23 +03:00
Maksim Kita
ba45cf32ab
Merge pull request #19858 from kitaisreal/reinterpret-as-updated-to-big-integers
...
Function reinterpretAs updated to support big integers
2021-02-03 12:12:13 +03:00
Alexander Kuzmenkov
7e945bab03
fix the calculation for moving frame start
2021-02-03 08:53:21 +03:00
alexey-milovidov
a4d86c43e9
Merge pull request #19946 from ClickHouse/improve-performance-of-aggregate-functions
...
Improve performance of aggregate functions
2021-02-03 08:46:51 +03:00
Alexander Kuzmenkov
85f8918753
fix the row order to be like in the original test
2021-02-03 07:47:53 +03:00
Alexander Kuzmenkov
6317208add
Merge branch 'master' into aku/perf
2021-02-02 17:24:17 +03:00
Alexey Milovidov
b9647e5326
Fix double whitespace
2021-02-02 17:22:03 +03:00
Alexander Kuzmenkov
b4afc49d3c
update perf tests
...
sed -i s'/^<test.*$/<test>/g' tests/performance/*.xml
WITH ceil(max(q[3]), 1) AS h
SELECT concat('sed -i s\'/^<test.*$/<test max_ignored_relative_change="', toString(h), '">/g\' tests/performance/', test, '.xml') AS s
FROM
(
SELECT
test,
query_index,
count(*),
min(event_time),
max(event_time) AS t,
arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
median(stat_threshold) AS m
FROM perftest.query_metrics_v2
WHERE ((pr_number != 0) AND (event_date > '2021-01-01')) AND (metric = 'client_time') AND (abs(diff) < 0.05) AND (old_value > 0.1)
GROUP BY
test,
query_index,
query_display_name
HAVING (t > '2021-01-01 00:00:00') AND ((q[3]) > 0.1)
ORDER BY test DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT PrettySpace
2021-02-02 17:21:43 +03:00
Maksim Kita
c889f51e9e
Updated performance benchmark
2021-02-02 12:50:58 +03:00
Alexey Milovidov
0b166e1cbd
Add performance test
2021-02-02 12:11:20 +03:00
Maksim Kita
9a1e52a80d
Added performance test
2021-02-01 12:25:52 +03:00
Pavel Kruglov
71f4acd48b
Use one pool for lonely parts, update tests
2021-01-29 17:30:14 +03:00
Pavel Kruglov
a437ee4e31
Merge branch 'master' of github.com:ClickHouse/ClickHouse into select-final
2021-01-29 14:25:47 +03:00
Nikolai Kochetov
a6f787faea
Merge pull request #19253 from ClickHouse/split-actions-dag
...
Split actions dag
2021-01-25 18:13:42 +03:00
Alexey Milovidov
ea26e5e784
Remove unneeded case
2021-01-23 22:04:45 +03:00
Pavel Kruglov
39379bcd5c
Update performance test
2021-01-23 19:55:29 +03:00
Maksim Kita
f5deb6d523
Merge pull request #19354 from kitaisreal/accurate-cast-or-null-fixed-unitialized-values
...
Function accurateCastOrNull fixed unitialized values for numeric cast
2021-01-23 10:58:52 +03:00
Nikolai Kochetov
290eadc121
Merge branch 'master' into split-actions-dag
2021-01-22 18:09:34 +03:00
Pavel Kruglov
6d2b9ebbb2
Update performance test
2021-01-22 17:16:22 +03:00
Nikolai Kochetov
d683bf42ce
Review fixes.
2021-01-22 16:46:56 +03:00
Maksim Kita
d712748304
Function accurateCastOrNull fixed unitialized values for numeric cast
2021-01-22 16:24:51 +03:00
Pavel Kruglov
900580af02
Add parallel select when there is one part with level>0 in select final
2021-01-21 20:34:50 +03:00
flynn
e75b116466
Rewrite sum(if())
and sumIf
to countIf
in special cases ( #17041 )
...
Co-authored-by: vdimir <vdimir@yandex-team.ru>
2021-01-21 12:01:35 +03:00
Nikolai Kochetov
af7dca7bb7
Update perftest.
2021-01-21 11:54:56 +03:00
Nikolai Kochetov
0246e3eace
Added perftest.
2021-01-19 15:51:53 +03:00
Alexander Kuzmenkov
cafc6a492d
Update jit_large_requests.xml
2021-01-18 14:00:24 +03:00
alexey-milovidov
ecf9b9c392
Merge pull request #19154 from ClickHouse/aku/faster-perf
...
speed up some perf tests (for other machines)
2021-01-16 12:22:46 +03:00
Alexander Kuzmenkov
979d23208e
speed up some perf tests (for other machines)
2021-01-16 00:15:06 +03:00
Alexey Milovidov
aa51463c93
Adjust perf test
2021-01-15 13:22:51 +03:00
Alexey Milovidov
f6f7ef65a2
Add perf test
2021-01-15 00:34:53 +03:00
alexey-milovidov
9049599e36
Update optimize_window_funnel.xml
2021-01-09 05:15:40 +03:00
feng lv
04c07d59bf
add performance test
2021-01-08 15:43:49 +00:00
Alexey Milovidov
35255aecb3
Merge branch 'master' into fix-perf-test-2
2021-01-03 02:45:23 +03:00
alexey-milovidov
8b98465f10
Merge pull request #17043 from amosbird/countoptimization
...
Devirtualize -If and vectorize count
2020-12-31 03:34:16 +03:00
Alexey Milovidov
efa494b5e4
Fix too long perf test
2020-12-30 16:53:30 +03:00
Alexander Kuzmenkov
1c52fdb265
cleanup
2020-12-28 13:08:38 +03:00
Alexander Kuzmenkov
a38787553c
perf test fix
2020-12-25 06:15:36 +03:00
Alexander Kuzmenkov
912995cbae
some provision for aggregate fns as window fn args
...
(doesn't work yet)
also a perf test w/LIMIT BY
2020-12-24 11:49:55 +03:00
Alexander Kuzmenkov
e3fb30b9f7
Merge pull request #18386 from ClickHouse/aku/faster-perf
...
Make some perf tests faster on slower machines
2020-12-24 03:47:18 +03:00
Nikolai Kochetov
af7f5c9518
Merge pull request #17868 from ClickHouse/async-read-from-socket
...
Async read from socket
2020-12-23 12:20:42 +03:00
Alexander Kuzmenkov
d9180f1e3e
Make some perf tests faster on slower machines
2020-12-23 05:40:55 +03:00
alexey-milovidov
ea1b62cdc5
Merge pull request #18317 from Enmk/CoulmnMap_perf_test
...
Perf test for ColumnMap
2020-12-22 09:33:16 +03:00
alexey-milovidov
fbcea6d933
Update ColumnMap.xml
2020-12-22 01:16:51 +03:00
Vasily Nemkov
b93a2cfa25
Perf test for ColumnMap
2020-12-21 16:02:58 +02:00
Amos Bird
9348526078
Devirtualize -If and vectorize count
2020-12-21 11:35:38 +08:00
Alexey Milovidov
37fb7e707c
Queries are too fast
2020-12-20 12:01:51 +03:00
Alexey Milovidov
7340839d6d
Update performance tests after speedup
2020-12-20 07:04:29 +03:00
Alexey Milovidov
6e0bb11fe2
Tests become too fast
2020-12-17 22:11:03 +03:00
Alexey Milovidov
0e0a66b03b
Remove unsupported ciphers
2020-12-17 22:09:27 +03:00
Nikolai Kochetov
8de5cd5bc7
Merge branch 'master' into async-read-from-socket
2020-12-14 17:45:38 +03:00
Alexey Milovidov
ef064696e7
Add perf test
2020-12-13 00:17:37 +03:00
Azat Khuzhin
9b6b2b175f
perf: merge custom_tld.xml/first_significant_subdomain.xml into url_hits.xml
...
v2: smaller table for *firstSignificantSubdomain* (max_threads=1)
2020-12-09 21:08:30 +03:00
Azat Khuzhin
8b6256dc4b
Add performance test for custom TLD
...
And seems works with the same speed as default (that uses gperf):
- cutToFirstSignificantSubdomain
SELECT cutToFirstSignificantSubdomain(URL)
FROM datasets.hits
SETTINGS max_threads = 1
FORMAT Null
SETTINGS max_threads = 1
0 rows in set. Elapsed: 0.904 sec. Processed 8.87 million rows, 762.68 MB (9.82 million rows/s., 843.61 MB/s.)
- cutToFirstSignificantSubdomainCustom
SELECT cutToFirstSignificantSubdomainCustom(URL, 'public_suffix_list')
FROM datasets.hits
SETTINGS max_threads = 1
FORMAT Null
SETTINGS max_threads = 1
0 rows in set. Elapsed: 0.909 sec. Processed 8.87 million rows, 762.68 MB (9.76 million rows/s., 838.83 MB/s.)
2020-12-09 21:08:30 +03:00
Nikolai Kochetov
32b38f389e
Merge branch 'master' into async-read-from-socket
2020-12-09 17:15:36 +03:00
Nikolai Kochetov
effc94daaf
Added perftest.
2020-12-09 17:11:20 +03:00
Azat Khuzhin
68c4da1203
Use max_threads=2 for countMatches to keep it under 2 seconds
...
Although I don't like this idea.
2020-12-04 07:54:34 +03:00
Azat Khuzhin
cb68d5b5e7
Add performance test for countMatches() function
2020-12-01 22:26:07 +03:00
Alexander Kuzmenkov
5ad15e2018
Merge pull request #17109 from azat/perf-AggregatingMergeTree-INSERT
...
Improve performance of AggregatingMergeTree w/ SimpleAggregateFunction(String) in PK
2020-12-01 16:27:36 +03:00
Alexander Kuzmenkov
8fd0810142
Update aggregating_merge_tree_simple_aggregate_function_string.xml
...
`system stop merges` w/o table name has global effect, so the rest of the tests is affected. Also `optimize` is more suitable here so that the end result is the same every time.
2020-11-30 12:31:30 +03:00
Alexander Kuzmenkov
a3277b183d
Adjust perf test thresholds
2020-11-27 15:08:42 +03:00
Nikolai Kochetov
9291bbb04b
Merge pull request #16804 from vdimir/ip-dict-no-trie
...
sorted-array based ip_dict
2020-11-26 19:26:06 +03:00
Alexander Kuzmenkov
15a0f14445
Merge pull request #15419 from myrrc/improvement/diff-types-in-avg-weighted
...
Allow different types in avgWeighted. Allow avg and avgWeighed to operate on extended integral types.
2020-11-26 17:16:48 +03:00
Nikolai Kochetov
729272391f
Merge branch 'master' into ip-dict-no-trie
2020-11-25 23:07:19 +03:00
Azat Khuzhin
688cb6b4d9
Update date_time_short perf test for toUnixTimestamp(Date())
2020-11-25 21:17:11 +03:00
myrrc
420f2489a7
fixed decimal scales calc, updated the tests
2020-11-24 17:07:59 +03:00
myrrc
fbb0e6e6aa
Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted
2020-11-24 16:04:17 +03:00
vdimir
52bc290616
Regenerate ya.make, add format null to ip_trie.xml
2020-11-24 11:20:11 +03:00
Azat Khuzhin
8931d3eb6f
Do not use SET via <full_query> in perf tests
...
Since if the connection will be closed (by some reason), then the
setting will not be applied after transparent reconnect (since only
native clickhouse-client can do this, since it parses the query, but
perf tests uses python driver).
Just use inplace SETTINGS clause or <settings>.
2020-11-21 14:02:21 +03:00
Azat Khuzhin
a3116d5614
Tune aggregating_merge_tree_simple_aggregate_function_string to make it faster
2020-11-21 12:08:59 +03:00
Azat Khuzhin
35231662b3
Improve performance of AggregatingMergeTree w/ SimpleAggregateFunction(String)
...
While reading from AggregatingMergeTree with
SimpleAggregateFunction(String) in primary key and
optimize_aggregation_in_order perf top shows:
Samples: 1M of event 'cycles', 4000 Hz, Event count (approx.): 287759760270 lost: 0/0 drop: 0/0
Children Self Shared Object Symbol
+ 12.64% 11.39% clickhouse [.] memcpy
+ 9.08% 0.23% [unknown] [.] 0000000000000000
+ 8.45% 8.40% clickhouse [.] ProfileEvents::increment # <-- this, and in debug it has not 0.08x overhead, but 5.8x overhead
+ 7.68% 7.67% clickhouse [.] LZ4_compress_fast_extState
+ 5.29% 5.22% clickhouse [.] DB::IAggregateFunctionHelper<DB::AggregateFunctionNullUnary<true, true> >::addFree
The reason is obvious, ProfileEvents is atomic counters (and also they
are nested):
<details>
```
Samples: 7M of event 'cycles', 4000 Hz, Event count (approx.): 450726149337
ProfileEvents::increment /usr/bin/clickhouse [Percent: local period]
Percent│
│
│
│ Disassembly of section .text:
│
│ 00000000078d8900 <ProfileEvents::increment(unsigned long, unsigned long)@@Base>:
│ ProfileEvents::increment(unsigned long, unsigned long):
0.17 │ push %rbp
0.00 │ mov %rsi,%rbp
0.04 │ push %rbx
0.20 │ mov %rdi,%rbx
0.17 │ sub $0x8,%rsp
0.26 │ → callq DB::CurrentThread::getProfileEvents
│ ProfileEvents::Counters::increment(unsigned long, unsigned long):
0.00 │ lea 0x0(,%rbx,8),%rdi
0.05 │ nop
│ unsigned long std::__1::__cxx_atomic_fetch_add<unsigned long, unsigned long>(std::__1::__cxx_atomic_base_impl<unsigned long>*, unsigned long, std::__1::memory_order):
1.02 │ mov (%rax),%rdx
97.04 │ lock add %rbp,(%rdx,%rdi,1)
│ ProfileEvents::Counters::increment(unsigned long, unsigned long):
0.21 │ mov 0x10(%rax),%rax
0.04 │ test %rax,%rax
0.00 │ → jne 78d8920 <ProfileEvents::increment(unsigned long, unsigned long)@@Base+0x20>
│ ProfileEvents::increment(unsigned long, unsigned long):
0.38 │ add $0x8,%rsp
0.00 │ pop %rbx
0.04 │ pop %rbp
0.38 │ ← retq
```
</details>
These ProfileEvents was ArenaAllocChunks (it shows ~1.5M events per
second), and the reason is that the table has
SimpleAggregateFunction(String) in PK, which requires Arena.
But most of the time there Arena wasn't even used, so avoid this cost by
re-creating Arena only if it was "used" (i.e. has new chunks).
Another possibility is to avoid populating Arena::head in ctor, but this
will make the Arena code more complex, so for now this was preferred.
Also as a long-term solution it worth looking at implementing them via
RCU (to move the extra overhead out from the write code path into read
side).
2020-11-19 23:06:12 +03:00
vdimir
36544a45b7
Merge remote-tracking branch 'upstream/master' into ip-dict-no-trie
2020-11-19 18:56:24 +03:00
alesapin
cdceafdd89
Trying to make read_in_order_many_parts more stable
2020-11-19 13:25:39 +03:00
myrrc
dbc5284b73
replaced Memory by MergeTree in the test to get perftests
2020-11-18 12:51:02 +03:00
vdimir
6dcb38db3f
Minor changes in IP dictionary
2020-11-16 21:08:31 +03:00
Alexander Kuzmenkov
b0e660651a
cleanup
2020-11-16 19:09:58 +03:00
vdimir
5e0e22301b
Slightly improve ip_dict loading performance, handle v4 to v6 masks in prepossessing, add more tests
2020-11-15 18:55:34 +03:00
vdimir
ca8e4b1607
Minor fixes of ip dict
2020-11-14 20:03:13 +03:00
myrrc
b1c0089b78
Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted
2020-11-14 16:50:04 +03:00
Alexander Kuzmenkov
e4dd68039e
fix
2020-11-13 08:00:43 +03:00
myrrc
a8d8dd7d3e
Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted
2020-11-12 14:50:59 +03:00
Alexander Kuzmenkov
0d10a4990e
fix
2020-11-12 11:27:33 +03:00
Alexander Kuzmenkov
91f88c79f9
Merge remote-tracking branch 'origin/master' into HEAD
2020-11-12 11:20:09 +03:00
Alexey Milovidov
f1d721fa74
Marked some perf test queries as short
2020-11-11 19:58:31 +03:00
Alexander Kuzmenkov
f31d7869ac
Merge remote-tracking branch 'origin/master' into HEAD
2020-11-11 14:51:35 +03:00
Alexander Kuzmenkov
906b338a1d
fixes
2020-11-11 14:51:21 +03:00
Danila Kutenin
c36e6fe378
Fix tests finally
2020-11-10 18:22:59 +03:00
Danila Kutenin
c0308a5d85
Fix tests, I cannot count number of zeros sometimes
2020-11-10 18:21:39 +03:00
Danila Kutenin
847fa9ca3c
Merge
2020-11-10 18:15:26 +03:00
Danila Kutenin
8504efde77
Merge
2020-11-10 18:12:49 +03:00
Danila Kutenin
2057198779
Fix performance tests that became very fast
2020-11-10 17:58:05 +03:00
myrrc
e460248624
Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted
2020-11-10 14:54:24 +03:00
Alexander Kuzmenkov
84fb76bad4
fixes
2020-11-10 07:19:43 +03:00
Alexander Kuzmenkov
030419db90
Try 12 threads max in perf test.
...
This will allow us to use more machines, not only Gold 6320.
2020-11-09 19:14:05 +03:00
alexey-milovidov
e47ed55d32
Merge pull request #14977 from achimbab/indexOf_bloomfilter
...
Fix indexOf() to use BloomFilter
2020-11-09 17:58:42 +03:00
alexey-milovidov
2994499680
Update bloom_filter_select.xml
2020-11-09 17:58:27 +03:00
Alexey Milovidov
ff906369ea
Adjust time for perf test
2020-11-08 23:22:50 +03:00
vdimir
81671ceb39
Add tests/performance/ip_trie.xml [wip]
2020-11-08 21:32:22 +03:00
Alexey Milovidov
f07988eec7
Remove perf test of sumbur hash, because we do not care
2020-11-08 21:17:30 +03:00
Alexey Milovidov
7257a5c3d2
Fix perf tests
2020-11-08 16:55:36 +03:00
Alexey Milovidov
f4178dd91f
Fix perf tests
2020-11-08 16:55:26 +03:00
alexey-milovidov
c7aa0c851a
Update bloom_filter.xml
2020-11-08 16:51:45 +03:00
alexey-milovidov
d96914b044
Update bloom_filter.xml
2020-11-08 16:51:03 +03:00
Alexey Milovidov
cc012e2cc7
Merge branch 'master' into achimbab-indexOf_bloomfilter
2020-11-08 14:42:03 +03:00
Alexey Milovidov
990f8a23ab
Translate comments to english
2020-11-05 21:51:36 +03:00
alexey-milovidov
ee3e289ec2
Merge pull request #15983 from ClickHouse/no_background_pool_no_more
...
Replace BackgroundProcessingPool with SchedulePool task and ThreadPool.
2020-11-05 21:38:22 +03:00
myrrc
ddd40fc4ce
fixed the perf test
2020-11-05 12:20:05 +03:00
myrrc
9788065786
Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted
2020-11-05 08:44:37 +03:00
alexey-milovidov
dbdff0d779
Merge pull request #16661 from ClickHouse/optimize-or-fill
...
Optimize -OrNull and -OrDefault aggregate functions by providing specializations
2020-11-04 23:37:11 +03:00
alexey-milovidov
ca0037d18b
Update group_by_sundy_li.xml
2020-11-04 18:07:18 +03:00
myrrc
43b2d20314
updated the decimal template magic
2020-11-04 16:14:07 +03:00
myrrc
3d70ab7f3b
Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted
2020-11-04 14:29:59 +03:00
Alexey Milovidov
e0d962a3cf
Add a test for #8772
2020-11-04 14:22:02 +03:00
Alexey Milovidov
938ef62532
Add a test
2020-11-04 14:00:43 +03:00
Alexey Milovidov
fdd7f31cf7
Add a test
2020-11-03 23:28:23 +03:00
myrrc
5c6bd218ad
adjusted the perftest
2020-11-03 18:01:29 +03:00
myrrc
fcbc0fb91e
added specialized performance test
2020-11-03 16:12:27 +03:00
Anton Popov
a3a8e18637
Merge branch 'master' into select_final
2020-11-03 00:00:43 +03:00
alesapin
101aa9e931
Merge branch 'master' into no_background_pool_no_more
2020-11-02 10:49:19 +03:00
Alexander Kuzmenkov
e15a8d5ac0
fixup
2020-10-30 21:03:07 +03:00
Alexander Kuzmenkov
7e76b7b510
more fixes
2020-10-30 18:54:38 +03:00
Alexander Kuzmenkov
38726847fc
make the test longer
2020-10-30 18:16:30 +03:00
Alexander Kuzmenkov
3529100da9
Adjust ignored perf test changes after NUMA binding
2020-10-30 18:12:15 +03:00
Anton Popov
48185d437a
Update optimized_select_final.xml
2020-10-30 17:48:59 +03:00
Anton Popov
9f0f981642
Update optimized_select_final.xml
2020-10-29 14:03:50 +03:00
Pavel Kruglov
4592c5e59b
Add OPTIMIZE in perf test
2020-10-27 14:42:26 +03:00
alesapin
d5d0819698
Merge branch 'master' into no_background_pool_no_more
2020-10-26 12:58:51 +03:00
alesapin
84dbbdb312
Rename test
2020-10-23 13:42:15 +03:00
alesapin
166b3de466
Make insert test faster
2020-10-23 13:31:33 +03:00
Pavel Kruglov
0274c9e9eb
Add perf test
2020-10-23 12:05:57 +03:00
alesapin
7a63b373f9
Merge branch 'blind_fix_of_read_in_order' into no_background_pool_no_more
2020-10-22 15:47:11 +03:00
Alexander Kuzmenkov
6293d1dbbe
Merge remote-tracking branch 'origin/master' into HEAD
2020-10-21 18:39:59 +03:00
Alexander Kuzmenkov
242ec7e56c
make some tests faster
2020-10-20 15:12:06 +03:00
Vasily Nemkov
1cf9781d4e
AES: Attempt to make performance tests faster and more stable.
2020-10-20 08:05:39 +03:00
Vasily Nemkov
4124538b56
Merge remote-tracking branch 'upstream/master' into AES_encrypt_decrypt
2020-10-18 00:00:13 +03:00
alesapin
60d14352f8
Merge branch 'master' into no_background_pool_no_more
2020-10-15 16:34:14 +03:00
alexey-milovidov
1d309c34c8
Merge pull request #15497 from filipecaixeta/master
...
Add an SQL function formatReadableTimeDelta to format time delta
2020-10-14 22:36:57 +03:00
Alexander Kuzmenkov
cb15e72229
make some perf tests slower
2020-10-14 18:39:27 +03:00
Vasily Nemkov
a6f36fc53b
Performance tests for encrypt and decrypt functions
2020-10-14 16:33:07 +03:00
alesapin
163d33fd21
Add perftest for merges
...
(cherry picked from commit e655f009d2
)
2020-10-13 15:12:28 +03:00
Alexey Milovidov
905bb859a5
Add performance test
2020-10-11 18:25:29 +03:00
Artem Zuikov
4fd1db73a1
Faster 256-bit multiplication ( #15418 )
2020-09-29 20:52:34 +03:00
Alexander Kuzmenkov
8cbfd69adf
Update decimal_casts.xml
2020-09-24 11:35:35 +03:00
Alexander Kuzmenkov
9b29e31d64
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-23 23:58:43 +03:00
alexey-milovidov
3bc09bb867
Merge pull request #15178 from amosbird/dtcf
...
Fix performance issue when doing datetime comparison
2020-09-23 20:33:23 +03:00
Alexander Kuzmenkov
9f137e77e7
Update decimal_casts.xml
2020-09-23 18:41:52 +03:00
Alexander Kuzmenkov
d2427a121f
Update decimal_casts.xml
2020-09-23 10:15:51 +03:00
Amos Bird
ee45395942
Fix datetime comparison
2020-09-23 10:29:55 +08:00
Artem Zuikov
f80ffc4dce
restore decimal_casts perf test
2020-09-22 18:56:24 +03:00
Alexander Kuzmenkov
4937159f85
Merge pull request #14990 from ClickHouse/aku/longer-perf
...
If perf test definition changed, run everything + longer (as in master)
2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov
e646aa306f
Update columns_hashing.xml
2020-09-22 13:25:16 +03:00
Alexander Kuzmenkov
ba12e68d70
Update insert_values_with_expressions.xml
2020-09-22 13:23:10 +03:00
Alexander Kuzmenkov
4dae587e2d
fix test
2020-09-21 15:02:34 +03:00
Alexander Kuzmenkov
85be1f1685
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-21 14:57:25 +03:00
alexey-milovidov
a4337635cc
Update single_fixed_string_groupby.xml
2020-09-20 19:42:11 +03:00
philip.han
2045bc9f8c
Fix performance_test for bloom_filter
2020-09-20 19:06:46 +09:00
Amos Bird
8ca4d6634e
better fixed string group by support
2020-09-20 15:20:09 +08:00
Alexander Kuzmenkov
e7b9319e12
If perf test definition changed, run everything + longer (as in master)
...
Also some other perf test fixes
2020-09-18 16:28:46 +03:00
philip.han
cbedd44a60
Fix indexOf() to use BloomFilter
2020-09-18 17:43:07 +09:00
Alexander Kuzmenkov
36538ce08f
Don't account for short queries, we'll deal with them separately.
...
New query:
```
WITH ceil(max(q[3]), 1) AS h
SELECT concat('sed -i s\'/^<test.*$/<test max_ignored_relative_change="', toString(h), '">/g\' tests/performance/', test, '.xml') AS s
FROM
(
SELECT
test,
query_index,
count(*),
min(event_time),
max(event_time) AS t,
arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
median(stat_threshold) AS m
FROM perftest.query_metrics
WHERE (metric = 'client_time') AND (abs(diff) < 0.05) AND (old > 0.2)
GROUP BY
test,
query_index,
query_display_name
HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
ORDER BY test DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT PrettySpace
```
2020-09-17 13:00:51 +03:00
Alexander Kuzmenkov
0f8aec59a3
Adjust ignore thresholds for unstable perf tests
...
Based on historical data.
```
SELECT
test,
ceil(max(q[3]), 1) AS h
FROM
(
SELECT
test,
query_index,
count(*),
min(event_time),
max(event_time) AS t,
arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
median(stat_threshold) AS m
FROM perftest.query_metrics
WHERE (metric = 'client_time') AND (abs(diff) < 0.05)
GROUP BY
test,
query_index,
query_display_name
HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
ORDER BY m DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT TSV
cryptographic_hashes 1.3
collations 0.8
joins_in_memory_pmj 0.8
joins_in_memory 0.7
merge_tree_simple_select 0.7
set_index 0.7
decimal_casts 0.7
website 0.6
logical_functions_medium 0.5
count 0.5
merge_tree_many_partitions 0.5
decimal_aggregates 0.5
codecs_int_insert 0.5
column_column_comparison 0.5
insert_parallel 0.4
parse_engine_file 0.4
read_in_order_many_parts 0.4
logical_functions_small 0.4
parallel_insert 0.3
parallel_index 0.3
push_down_limit 0.3
jit_large_requests 0.3
select_format 0.3
arithmetic 0.3
merge_tree_huge_pk 0.3
materialized_view_parallel_insert 0.3
columns_hashing 0.3
if_array_string 0.3
random_string 0.2
random_printable_ascii 0.2
set 0.2
empty_string_serialization 0.2
```
To apply:
```
sed 's/^\(.*\) \(.*\)$/sed -i "s\/^<test.*$\/<test max_ignored_relative_change="'"'"\2">\/g" tests\/performance\/\1.xml/g' ../bad.tsv | bash
```
2020-09-16 18:27:51 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
...
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
3113aa6cfe
Avoid extra error in perf report on broken queries
2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271
fixup
2020-09-14 10:27:46 +03:00
Nikolai Kochetov
c3eeb8f71e
Merge pull request #14412 from ClickHouse/pipes-and-creating-sets
...
Pipes and creating sets
2020-09-08 10:47:56 +03:00
Alexander Kuzmenkov
0904433c87
Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229
...
Also add one more timeout to perf test runner.
2020-09-07 09:33:57 +03:00
Nikolai Kochetov
7a03dbaa2f
Added test.
2020-09-04 12:11:37 +03:00
Alexander Kuzmenkov
134aae89f3
Merge pull request #14110 from 4ertus2/decimal
...
Fix Decimal to Float conversion and toDecimal256() function
2020-08-31 17:08:49 +03:00
Artem Zuikov
13113dafdc
Update decimal_casts.xml
2020-08-27 16:53:16 +03:00
Alexey Milovidov
dc889b5c42
Fixup #14120
2020-08-27 15:17:51 +03:00
alexey-milovidov
ea0122de7e
Merge pull request #14120 from ClickHouse/parallel-insert-more-storages
...
Support parallel INSERT for more table engines
2020-08-27 15:08:56 +03:00
alexey-milovidov
0f706c01ca
Merge pull request #13888 from vladimir-golovchenko/add-date-trunc-function
...
Added date_trunc function
2020-08-27 02:12:27 +03:00
Alexey Milovidov
83fa57a346
Update instruction for perf tests
2020-08-26 20:34:05 +03:00
Alexey Milovidov
9a4e7cc492
Add perf test
2020-08-26 20:33:14 +03:00
Artem Zuikov
7e984f877b
better test
2020-08-26 19:21:26 +03:00
Artem Zuikov
fe5db661ce
fix decimal to float conversion and toDecimal256()
2020-08-26 15:26:12 +03:00
vladimir golovchenko
fb06f59ceb
Added tests for date_trunc function.
2020-08-25 16:41:23 -07:00
alexey-milovidov
00c697df06
Merge pull request #14005 from ClickHouse/ucasFL-new-branch
...
Merging #12195
2020-08-26 01:33:54 +03:00
Alexey Milovidov
86d99f7c7f
Disable "optimize_trivial_insert_select" for one perf test
2020-08-26 01:33:31 +03:00
alexey-milovidov
6a164634d7
Merge pull request #12550 from myrrc/bug/low-cardinality-arrays-optimisations
...
Optimising has(), indexOf(), and countEqual() for Array(LowCardinality(T)) and constant right arguments
2020-08-24 22:31:29 +03:00
Alexander Kazakov
d99ddb9ca9
In perf test array_index_lc: adjusted iterations count
2020-08-24 12:02:48 +03:00
Alexey Milovidov
d44982072c
More robust
2020-08-24 03:14:24 +03:00
Alexander Kazakov
48333b29f6
Minior rename
2020-08-24 00:42:00 +03:00
Alexander Kazakov
eac2c59055
Fix up
2020-08-24 00:16:16 +03:00
Alexander Kazakov
ce0ab0e28b
Split array_index_low_cardinality performance test: numbers/strings
2020-08-24 00:13:57 +03:00
myrrc
a519559644
updated ColumnVector to compare with other U, cleaned ImplString
2020-08-14 21:08:30 +03:00
myrrc
0b53b0379b
fixing perftest to get more relevant result
2020-08-14 03:09:44 +03:00
myrrc
82206e89dd
fixed perftest long test and StringRef assert
2020-08-12 17:07:56 +03:00
Alexander Kazakov
6e0d536327
Merge branch 'master' into bug/low-cardinality-arrays-optimisations
2020-08-11 16:25:20 +03:00
Alexander Kuzmenkov
e06fd84ca7
Update synthetic_hardware_benchmark.xml
...
https://github.com/ClickHouse/ClickHouse/pull/13099#issuecomment-671479904
2020-08-10 20:16:23 +03:00
Alexey Milovidov
d1935bc967
Adjust query time in perf test
2020-08-09 02:14:23 +03:00
myrrc
5a742ec0fc
test update
2020-08-08 21:12:38 +03:00
myrrc
c4ddabc327
updated perf test with integral example (cloning the column)
2020-08-06 21:54:21 +03:00
myrrc
c8f737c37c
fix: re-resizing, Arcadia compatibility, updated perftest
2020-08-06 15:33:16 +03:00
myrrc
2f589c6856
added another query to perftest
2020-08-04 23:10:54 +03:00
myrrc
f2fecb4d1a
re-adding the non-const test queries
2020-08-04 23:00:36 +03:00
myrrc
807f1887f4
some data flow fixes
2020-08-04 22:51:15 +03:00
myrrc
aa1582999a
re-adding the test with removed slow requests.
2020-08-04 16:06:16 +03:00
myrrc
d4e747ffd7
deleted extra-slow perftest to figure out outer coverage
2020-08-04 16:04:28 +03:00
myrrc
e270706fdb
Merge branch 'bug/low-cardinality-arrays-optimisations' of github:myrrc/clickhouse into bug/low-cardinality-arrays-optimisations
2020-08-04 15:37:22 +03:00
myrrc
98119af9de
Merge remote-tracking branch 'upstream/master' into bug/low-cardinality-arrays-optimisations
2020-08-04 15:01:27 +03:00
Alexander Kazakov
059a3dcbd9
Fix up typo in test
2020-08-03 23:35:10 +03:00
Alexey Milovidov
006f9a831f
More performance tests
2020-08-03 04:37:57 +03:00
alexey-milovidov
935533e841
Merge pull request #13193 from ClickHouse/aku/spurious-perf
...
Fix some spurious perf test failures
2020-08-03 01:02:53 +03:00
alexey-milovidov
1f19d7e9bd
Merge pull request #13016 from ClickHouse/limit-push-down
...
Limit push down
2020-08-02 01:23:06 +03:00
alexey-milovidov
626b709085
Merge pull request #13055 from ClickHouse/fixed-hash-map-implicit-zero
...
Slightly improve the inner loop of aggregation by UInt8/UInt16 keys
2020-08-02 01:09:00 +03:00
Alexey Milovidov
72bb5af15c
More perf tests
2020-07-31 21:19:54 +03:00
Alexander Kuzmenkov
1d954581eb
Fix some spurious perf test failures
2020-07-31 19:28:04 +03:00
alexey-milovidov
543d2da3da
Merge pull request #12700 from CurtizJ/fix-performance-with-in
...
Fix performance with large tuples
2020-07-31 14:40:38 +03:00
Alexey Milovidov
b6ac349126
Added another test case for perf test
2020-07-30 05:43:22 +03:00
Nikolai Kochetov
1c5ccd089f
Added perftest.
2020-07-29 15:32:59 +03:00
myrrc
da9502e496
Merge remote-tracking branch 'upstream/master' into bug/low-cardinality-arrays-optimisations
2020-07-28 15:06:39 +03:00
Nikolai Kochetov
1f2390b65e
Merge pull request #12840 from ClickHouse/remove-wrong-threads-limiting
...
Remove thread limiting.
2020-07-28 12:03:07 +03:00
Nikolai Kochetov
abdd160db1
Merge pull request #12589 from bobrik/ivan/parallel-ranges
...
Parallelize PK range and skipping index stages
2020-07-27 19:23:00 +03:00
Nikolai Kochetov
be2132d437
Added perftest.
2020-07-27 17:27:26 +03:00
Nikolai Kochetov
05ec37d1c9
Added perftest.
2020-07-27 17:25:26 +03:00
Anton Popov
70022c7a6c
Mark query short
2020-07-24 16:59:50 +03:00
Anton Popov
61018c275d
Merge remote-tracking branch 'upstream/master' into polymorphic-parts-4
2020-07-23 18:38:29 +03:00
Anton Popov
1d0493cfcc
better code in ReaderCompact and perf test added
2020-07-23 18:37:44 +03:00
Nikolai Kochetov
dad9d369a1
Merge branch 'master' into bobrik-parallel-randes
2020-07-23 16:21:32 +03:00
Anton Popov
fc515728f4
fix performance with large tuples, which are interpreted as functions in IN section
2020-07-23 02:33:14 +03:00
myrrc
6af63213ce
Merge remote-tracking branch 'upstream/master' into bug/low-cardinality-arrays-optimisations
2020-07-22 22:49:46 +03:00
alexey-milovidov
49adaf95aa
Merge pull request #12585 from ClickHouse/mod-compatible
...
Make behaviour of remainder of division for floating point numbers compatible with most of DBMS
2020-07-22 08:43:45 +03:00
Nikolai Kochetov
da4a66b443
Added perftest.
2020-07-21 19:28:30 +03:00
Alexey Milovidov
16ba0f91d7
Add performance test
2020-07-21 13:38:14 +03:00
Artem Zuikov
df1213f351
Try to make if_transform_strings perf test faster ( #12598 )
2020-07-21 13:34:55 +03:00
Alexander Kuzmenkov
da5853f031
Update decimal_aggregates.xml
2020-07-17 18:27:05 +03:00
Alexander Kuzmenkov
e095d04553
Update read_in_order_many_parts.xml
2020-07-17 15:12:49 +03:00
Alexander Kuzmenkov
c306476f1b
Update redundant_functions_in_order_by.xml
2020-07-17 15:11:17 +03:00
Artem Zuikov
c6e3e9b1ff
String convertion to enum in if() and transform() ( #12515 )
2020-07-17 12:28:51 +03:00
Alexander Kuzmenkov
b558aae851
disable profiler
2020-07-15 19:10:47 +03:00
Alexander Kuzmenkov
fda2595958
Merge remote-tracking branch 'origin/master' into HEAD
2020-07-15 19:09:43 +03:00
Artem Zuikov
5f01a587f6
Optimize monotonous ORDER BY ( #12467 )
2020-07-15 13:10:21 +03:00
Alexander Kuzmenkov
fa6fc719ab
fixup
2020-07-14 15:55:25 +03:00
Alexander Kuzmenkov
d05b984959
Merge remote-tracking branch 'origin/master' into HEAD
2020-07-14 15:50:31 +03:00
alexey-milovidov
969d9c0d47
Merge branch 'master' into remove-useless-setting-from-perf-test
2020-07-14 09:31:34 +03:00
Alexander Kuzmenkov
4da37fb3a0
Fix decimal aggregate perf test
2020-07-13 14:40:46 +03:00
Alexander Kuzmenkov
5a15e03400
Improve data layout in perf test
...
Also fix a bad test query found with new data.
2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov
c13425f0e9
Merge remote-tracking branch 'origin/master' into HEAD
2020-07-13 14:29:10 +03:00
Alexander Kuzmenkov
d911aa7496
temporarily disable decimal aggregates test
2020-07-13 14:28:35 +03:00
Artem Zuikov
b5c181c24e
Optimize redundant functions in ORDER BY ( #12404 )
2020-07-13 13:34:25 +03:00
Alexey Milovidov
4ace6f99fa
Remove useless setting from performance tests #12424
2020-07-13 05:34:45 +03:00
Alexander Kuzmenkov
48862a1edf
fixup
2020-07-11 13:35:44 +03:00
Alexander Kuzmenkov
920c62b629
Merge remote-tracking branch 'origin/master' into HEAD
2020-07-11 13:32:31 +03:00
Artem Zuikov
6b26842ce5
RIGHT and FULL JOIN for MergeJoin ( #12118 )
2020-07-10 21:10:06 +03:00
Alexander Kuzmenkov
70ba4e16f8
fixup
2020-07-10 17:18:39 +03:00
Alexander Kuzmenkov
cd09cf8c0b
Merge remote-tracking branch 'origin/master' into HEAD
2020-07-10 17:18:24 +03:00
Artem Zuikov
01b5c2663c
Delete injective functions inside uniq ( #12337 )
2020-07-10 13:42:41 +03:00
Alexander Kuzmenkov
394cf20673
Merge remote-tracking branch 'origin/master' into HEAD
2020-07-09 13:46:54 +03:00
Alexander Kuzmenkov
3b428d6585
fixes
2020-07-09 13:46:16 +03:00
Alexander Kuzmenkov
5b3a106f7a
fixes
2020-07-08 13:35:49 +03:00
alesapin
84f8bf1e14
Merge pull request #10697 from CurtizJ/polymorphic-parts
...
Polymorphic parts (in-memory format)
2020-07-08 13:25:45 +03:00
Alexander Kuzmenkov
41addf9173
Merge remote-tracking branch 'origin/master' into HEAD
2020-07-08 13:22:06 +03:00
Alexander Kuzmenkov
68189db872
Update int_parsing.xml
2020-07-08 12:40:33 +03:00
Alexander Kuzmenkov
d85391f3ac
too slow
2020-07-07 20:07:04 +03:00
Alexander Kuzmenkov
c49da9053d
Merge remote-tracking branch 'origin/master' into HEAD
2020-07-07 20:06:27 +03:00
Alexander Kuzmenkov
62b83b412f
split
2020-07-07 11:01:50 +03:00
alesapin
3f90f65678
Merge remote-tracking branch 'origin' into CurtizJ-polymorphic-parts
2020-07-06 21:34:17 +03:00
Nikita Mikhaylov
53522c728b
Merge pull request #11662 from Avogar/orc_output_format
...
Add ORCBlockOutputFormat
2020-07-06 18:51:35 +04:00
Alexander Kuzmenkov
c1fa01cabf
Update questdb_sum_double.xml
2020-07-06 13:58:47 +03:00
Alexander Kuzmenkov
2fbd3cb6a4
fixup
2020-07-06 13:51:26 +03:00
Alexander Kuzmenkov
432cadae15
Merge remote-tracking branch 'origin/master' into HEAD
2020-07-06 11:44:09 +03:00
Alexander Kuzmenkov
9f32615d32
Merge pull request #11606 from CurtizJ/polymorphic-parts-2
...
Make polymorphic_parts perf test not blazing fast
2020-07-06 11:43:30 +03:00
Alexey Milovidov
91ca33de86
Merge branch 'perf-test-questdb' of github.com:yandex/ClickHouse into perf-test-questdb
2020-07-04 23:35:15 +03:00