Commit Graph

1373 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
e7f93b5563
Merge pull request #18058 from azat/perf-test-zk-port-fix
Remove test_keeper_server in perf tests
2020-12-14 17:54:47 +03:00
Alexander Kuzmenkov
2edabd5519
Update zzz-perf-comparison-tweaks-config.xml 2020-12-14 17:45:58 +03:00
Azat Khuzhin
653ddab63e Remove test_keeper_server in perf tests
To avoid port overlaps for right and left server (anyway it is not
used).
2020-12-14 10:59:01 +03:00
Azat Khuzhin
6f2c559398 Convert top_level_domains_lists.xml into regular file
docker/test/performance-comparison/config/config.d is not allowed to has
symlinks, since it is copied with the COPY docker command.
2020-12-10 21:01:17 +03:00
Azat Khuzhin
0f1d9f3a6f Put top_level_domains into the docker/test/performance-comparison/config
Since in docker/test/performance-comparison there is Dockerfile that is
runned from that directory, so it cannot COPY anything outside of it.
2020-12-09 21:08:31 +03:00
Azat Khuzhin
8a4b29495b perf: override top_level_domains_path via command line arguments 2020-12-09 21:08:31 +03:00
Azat Khuzhin
352a1eea34 Use new top_level_domains_path 2020-12-09 21:08:31 +03:00
Azat Khuzhin
7b0c720922 Add top_level_domains into perf tests
And change Dockerfile to trigger image rebuild
2020-12-09 21:08:31 +03:00
Alexander Kuzmenkov
fa64d314df
Merge pull request #17907 from azat/perf-tiny-fix
Perf tests fixes
2020-12-09 12:29:57 +03:00
Azat Khuzhin
79e6348282 perf: load overrides last of all 2020-12-09 07:31:54 +03:00
Azat Khuzhin
d33b0ad33b Use interserver_http_port remove=remove over auto-port
Revert "perf: fix port conflict for tcp_with_proxy_port"

This reverts commit 89b3566824e5c0a87b6310fc4b6f9d300d2e17db.
2020-12-09 00:11:12 +03:00
Azat Khuzhin
75f9640fc2 perf: fix port conflict for tcp_with_proxy_port
Simply use zero port to do auto allocation, anyway it is not used in
perf tests.
2020-12-08 23:29:38 +03:00
alexey-milovidov
e127636a4b
Merge pull request #16787 from kitaisreal/fast-float-integration
FastFloat library integration
2020-12-08 21:34:34 +03:00
Azat Khuzhin
f1ac8775db perf: override config directives via command line over sed by config.xml 2020-12-08 21:25:03 +03:00
Alexey Milovidov
1ed329017b Merge branch 'master' into quota-by-x-forwarded-for 2020-12-07 18:22:19 +03:00
Maksim Kita
5b57c59a3b Updated fast_float integration 2020-12-06 23:37:55 +03:00
Maksim Kita
977da3d052 Removed ryu 2020-12-06 15:39:39 +03:00
Maksim Kita
64549702a2 DragonBox integration 2020-12-06 00:32:03 +03:00
alesapin
7c2a04d77d
Merge pull request #17671 from ClickHouse/update_integration_tests_image
Update docker image in integration tests runner
2020-12-04 15:51:08 +03:00
Ivan
315ff4f0d9
ANTLR4 Grammar for ClickHouse and new parser (#11298) 2020-12-04 05:15:44 +03:00
Alexey Milovidov
00dc21b0b9 Better tests 2020-12-03 13:02:20 +03:00
alesapin
031ddaedd4 Update docker image in integration tests runner 2020-12-01 14:32:33 +03:00
a.palagashvili
502355922d added errors checking, removed redundant variables 2020-11-29 15:14:42 +03:00
alesapin
1d179dac22
Merge pull request #17486 from ClickHouse/fix_more_flaky_tests
Fix more flaky integration tests
2020-11-28 10:43:29 +03:00
Alexander Kuzmenkov
8e855dc887
Merge pull request #17460 from azat/perf-tests-settings
Fail queries on unknown settings in perf tests
2020-11-27 22:42:37 +03:00
tavplubix
aaaa7ad59f
Merge pull request #16806 from TCeason/add_test_for_materialize_mysql
add network partition integration test for MaterializeMySQL
2020-11-27 20:39:06 +03:00
alesapin
239ed12458 Better defaults 2020-11-27 14:50:33 +03:00
Azat Khuzhin
3696916f44 perf: add setuptools into docker image (to built clikchouse-driver) 2020-11-27 07:20:41 +03:00
taichong
c8f7a56a25 fix CI timeout err 2020-11-27 11:34:49 +08:00
Azat Khuzhin
b390786a2e Cleanup fasttest/run.sh
- align functions
- align subshells ()
2020-11-27 00:38:49 +03:00
Azat Khuzhin
04a93f18e8 perf: fail on unknown settings 2020-11-27 00:16:41 +03:00
Azat Khuzhin
a591886740 perf: remove outdated comments from perf.py
Refs: https://github.com/ClickHouse/ClickHouse/pull/17255#discussion_r528822709
2020-11-27 00:16:41 +03:00
Azat Khuzhin
a38628d967 perf: use the latest available clickhouse-driver (from git)
Since later setting_is_important will be used, but there is no release
with this feature included.
2020-11-27 00:16:41 +03:00
Alexander Kuzmenkov
15a0f14445
Merge pull request #15419 from myrrc/improvement/diff-types-in-avg-weighted
Allow different types in avgWeighted. Allow avg and avgWeighed to operate on extended integral types.
2020-11-26 17:16:48 +03:00
Alexander Kuzmenkov
394b81ac46 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-25 23:38:55 +03:00
nikitamikhaylov
f764332070 better merge 2020-11-25 20:51:06 +03:00
Vitaly Baranov
3856ae1a5e Fix PVS Error "Unable to start the analysis on this file" for files
which include protobuf-generates files.
2020-11-24 17:53:34 +03:00
myrrc
fbb0e6e6aa Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted 2020-11-24 16:04:17 +03:00
Alexander Kuzmenkov
a543c8e468 Add an option to use existing tables to perf.py 2020-11-23 21:05:54 +03:00
taichong
a6c2a90756 modify integration test materialize mysql database
1. fix asan test err

2. reset pymysql conn if ping err

3. finish mysql & ck killed test

4. modify check_query
2020-11-23 17:55:07 +08:00
robot-clickhouse
dc19fba36f Auto version update to [20.13.1.1] [54444] 2020-11-23 10:29:26 +03:00
alesapin
9c8b0da382
Merge pull request #16033 from nvartolomei/nv/parts-uuid
Add unique identifiers IMergeTreeDataPart structure
2020-11-22 16:13:19 +03:00
Azat Khuzhin
d676e2f5c5 Pass settings for perf tests via protocol over SET query
Thus they will be applied on reconnects, since clickhouse-driver may
implicitly do it if the connection has been failed.
2020-11-21 14:02:33 +03:00
Azat Khuzhin
3ddb0ac53e Configure logging for perf test runner 2020-11-21 14:02:33 +03:00
Azat Khuzhin
f6d16ee43e Force clickhouse-driver >= 1.1.5 for settings-as-strings support for perf-tests image 2020-11-21 14:02:33 +03:00
alesapin
78860bf2bd Improvements in coverage images 2020-11-20 11:48:06 +03:00
a.palagashvili
1d09a67e9f empty commit for force run 2020-11-19 23:06:41 +03:00
alesapin
a15b8afa73 Don't add tons of client coverage files in stateful tests with coverage 2020-11-19 19:07:36 +03:00
Nicolae Vartolomei
b6a330de77 Allow running subset of tests in fasttest 2020-11-19 13:18:03 +00:00
a.palagashvili
0c4acef558 added zstd to docker image 2020-11-19 12:23:05 +03:00
Vitaliy Zakaznikov
dbb5f6722e Moving to using TestFlows version 1.6.65
Fixing unstable test in tests/testflows/ldap/external_user_directory/tests/authentications.py
2020-11-17 20:22:43 -05:00
Nikolai Kochetov
86395e11a2
Merge pull request #17006 from azat/fix-distributed-queries-finish
Fix Distributed queries finishing (avoid connection resets)
2020-11-17 11:11:27 +03:00
Alexander Kuzmenkov
b0e660651a cleanup 2020-11-16 19:09:58 +03:00
alesapin
7b784fb925 Fix stateful with coverage test download script 2020-11-16 16:05:00 +03:00
Azat Khuzhin
ed64f2ad67 Add a test for Distributed query finish does not produce any NETWORK_ERROR 2020-11-14 18:35:15 +03:00
Alexander Kuzmenkov
7313691140 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-12 20:31:17 +03:00
alexey-milovidov
ff29b2d2ee
Merge pull request #15073 from sundy-li/storage-rocksdb
StorageEmbeddedRocksDB
2020-11-12 13:17:58 +03:00
Alexander Kuzmenkov
91f88c79f9 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-12 11:20:09 +03:00
zhang2014
b13189baec Try fix fasttest submodule clone 2020-11-12 12:45:08 +08:00
sundyli
5ef809931e
Merge branch 'master' into storage-rocksdb 2020-11-12 08:26:27 +08:00
a.palagashvili
55d05c95bf fixed style, xz check fasttest skipped, removed fast-lzma2 2020-11-11 15:34:28 +03:00
Alexander Kuzmenkov
f31d7869ac Merge remote-tracking branch 'origin/master' into HEAD 2020-11-11 14:51:35 +03:00
a.palagashvili
124ef2f5fa added and successfully passed tests for content encoding and file() function, formatted code 2020-11-11 04:50:56 +03:00
sundy-li
46c01eb7a2 improve unbundle build 2020-11-11 09:08:53 +08:00
sundy-li
fb7066d73d * fix fasttest and cmake && pipline for all_scan
* unique the keys
* add inputstream && outputstream
2020-11-11 09:08:53 +08:00
sundy-li
84dab52e45 skip rocksdb test in fasttest 2020-11-11 09:08:52 +08:00
Danila Kutenin
a489f65c02
Merge branch 'master' into master 2020-11-10 20:16:29 +03:00
alesapin
c0ae61e306 Fix stress test script 2020-11-10 10:33:31 +03:00
Danila Kutenin
5d138f3475 Fix submodules for fast test 2020-11-10 01:31:24 +03:00
Alexander Kuzmenkov
030419db90 Try 12 threads max in perf test.
This will allow us to use more machines, not only Gold 6320.
2020-11-09 19:14:05 +03:00
a.palagashvili
268f289bd1 resolved conflict 2020-11-07 16:36:38 +03:00
alexey-milovidov
4e85d6a4c3
Merge pull request #16273 from Avogar/collation-support
Support collate in LowCardinality, Nullable, Array and Tuple, where nested type is String
2020-11-06 21:52:52 +03:00
Alexander Kuzmenkov
dc665d7c43
Update compare.sh 2020-11-06 13:45:42 +03:00
alexey-milovidov
e1a01edf29
Merge pull request #16719 from MyroTk/master
RBAC Testflows - Server log intrumentation for debug and new ALTER tests
2020-11-06 12:40:31 +03:00
Alexander Kuzmenkov
ccf57300eb
Merge pull request #16620 from ClickHouse/aku/perf-upload
Upload perf test results to the CI database
2020-11-05 23:47:29 +03:00
Alexander Kuzmenkov
ac487ab26a
Update compare.sh 2020-11-05 23:45:58 +03:00
robot-clickhouse
f7b7854ace Auto version update to [20.12.1.1] [54443] 2020-11-05 21:52:50 +03:00
MyroTk
02a071e88f RBAC Testflows - Instrumenting server log for debug and new ALTER tests 2020-11-05 17:51:17 +01:00
Alexander Kuzmenkov
9e2d7aa274 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-05 11:34:10 +03:00
Kruglov Pavel
c494f6f5ff
Merge branch 'master' into collation-support 2020-11-05 01:28:30 +03:00
alexey-milovidov
fa929b0312
Replace duplicate development config files with symlinks. (#16486)
* Fix test "max_memory_usage_for_user"

* Update test

* Update annoying boilerplate

* Support symlinks in tarballs

* Fix Fuzzer

* Remove "secondary" user

* Remove "secondary" user
2020-11-04 23:45:06 +03:00
a.palagashvili
ceda5cb9c5 fix codestyle, resolvec conflict 2020-11-04 19:47:04 +03:00
Alexander Kuzmenkov
8d5fe1148c add client config 2020-11-04 18:07:34 +03:00
Alexey Milovidov
5b9d48c715 Remove garbage from docs 2020-11-04 17:39:18 +03:00
Alexander Kuzmenkov
5cb708a50a fixup 2020-11-04 04:19:53 +03:00
alexey-milovidov
8a3f38f332
Merge branch 'master' into errorCode-v2 2020-11-04 01:40:41 +03:00
a.palagashvili
8ecf1d07c1 attempt to update fasttest version 2020-11-04 01:37:05 +03:00
Alexander Kuzmenkov
31ad6c8d48 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-03 17:38:08 +03:00
Alexander Kuzmenkov
4245c470ac fixes 2020-11-03 17:37:54 +03:00
Pavel Kruglov
4d399fff3e Support collation for Array and Tuple 2020-11-03 17:09:37 +03:00
Pavel Kruglov
97a6e3dde2 Skip collate test in fasttest 2020-11-03 17:08:40 +03:00
Alexander Kuzmenkov
268c80520f
Update run-fuzzer.sh 2020-11-03 11:09:14 +03:00
Alexander Kuzmenkov
a25996ed8d Upload perf test results to the CI database 2020-11-03 02:10:19 +03:00
a.palagashvili
8098f86e3e added record for fasttest 2020-11-03 01:05:50 +03:00
Azat Khuzhin
b2e2322895 Add system.errors table
Contains error codes with number of times they have been triggered.

Columns:

-   `name` ([String](../../sql-reference/data-types/string.md)) — name of the error (`errorCodeToName`).
-   `code` ([Int32](../../sql-reference/data-types/int-uint.md)) — code number of the error.
-   `value` ([UInt64](../../sql-reference/data-types/int-uint.md)) - number of times this error has been happened.

**Example**

``` sql
SELECT *
FROM system.errors
WHERE value > 0
ORDER BY code ASC
LIMIT 1

┌─name─────────────┬─code─┬─value─┐
│ CANNOT_OPEN_FILE │   76 │     1 │
└──────────────────┴──────┴───────┘
2020-10-29 10:55:38 +03:00
alesapin
1c9e24b5e2 Merge branch 'master' into system_fetches_table 2020-10-28 10:20:04 +03:00
Alexander Kuzmenkov
ba34145817
Merge pull request #16425 from filimonov/minumum
Fix typos reported by codespell
2020-10-28 08:07:18 +03:00
Vitaliy Zakaznikov
d4e640daae Updating TestFlows to 1.6.59
Updating AES encryption requirements.py to include Specification
Updating AES regression.py to link Specification
Fixing typos in LDAP authentication SRS
2020-10-27 18:50:59 -04:00
alesapin
dca35b1913 Add awesome test for fetch 2020-10-27 15:24:10 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell 2020-10-27 12:04:03 +01:00
Alexander Kuzmenkov
e27dd538fd performance comparison 2020-10-26 19:35:37 +03:00
Alexander Kuzmenkov
60db7c2aa5 fix a typo in test name 2020-10-26 19:17:54 +03:00
alesapin
6226377ac3
Merge pull request #16261 from ClickHouse/check_flaky_test
Checking flaky stateless tests
2020-10-26 18:07:36 +03:00
alesapin
1be7a182de
Revert "Revert "Optionally upload clickhouse binary in fast test"" 2020-10-26 14:08:37 +03:00
alesapin
7b456e6663 Merge branch 'check_flaky_test' of github.com:ClickHouse/ClickHouse into check_flaky_test 2020-10-26 09:23:52 +03:00
alesapin
265f84fd88 Merge branch 'master' into check_flaky_test 2020-10-26 09:23:21 +03:00
alexey-milovidov
e00f6c4a0d
Merge branch 'master' into total_memory_tracker-by-default 2020-10-24 21:17:53 +03:00
Nikita Mikhaylov
58b4342998
Merge pull request #15874 from nikitamikhaylov/welch-t-test
Student and Welch t-test
2020-10-24 15:13:12 +03:00
alexey-milovidov
1a1a6350aa
Merge pull request #16285 from sundy-li/cmake-roaring
try use cmake version for croaring instead of amalgamation.sh
2020-10-24 11:07:32 +03:00
alexey-milovidov
0748377ab1
Revert "Optionally upload clickhouse binary in fast test" 2020-10-24 07:59:08 +03:00
alexey-milovidov
fe0f6a9e01
Merge pull request #16288 from ClickHouse/upload_binary_in_fasttest
Optionally upload clickhouse binary in fast test
2020-10-24 07:27:32 +03:00
Azat Khuzhin
6e5b04fad8 Make 01540_MemoryTracking integration
01540_MemoryTracking is failing on CI for the following reasons:
- log_queries (fixed, by adding log_queries=0)
- profilers (fixed)
- but what can't be fixed is metric_log and so on, so we need separate
  instance with separate configuration (sigh).
2020-10-24 02:27:29 +03:00
nikitamikhaylov
0064a75916 Merge branch 'master' of github.com:ClickHouse/ClickHouse into welch-t-test 2020-10-23 23:06:15 +03:00
Azat Khuzhin
3f594ed3ad Add a test for memory drift in user memory tracker (max_memory_usage_for_user) 2020-10-23 22:13:34 +03:00
Azat Khuzhin
6c42ad564c Add a test for MemoryTracking drift
v2: disable query profiling and logging in 01540_MemoryTracking
    (This should make MemoryTracker drift zero).
2020-10-23 21:11:22 +03:00
alesapin
f0ef7dd1e9 Change default to zero 2020-10-23 16:31:45 +03:00
alesapin
a73a908264 Optionally upload clickhouse binary 2020-10-23 16:31:00 +03:00
Alexander Tokmakov
b29cfa7f82 fix test with uuid 2020-10-23 15:32:57 +03:00
sundy-li
f407504a7a try use cmake version for croaring instead of amalgamation.sh 2020-10-23 19:42:21 +08:00
Alexander Kuzmenkov
4476117ac6
Merge pull request #15144 from ClickHouse/aku/numa-perf
Perf test: bind server to one NUMA node
2020-10-23 14:10:35 +03:00
Alexander Kuzmenkov
acc5e3906a
Merge pull request #15476 from ClickHouse/aku/fasttest-debug
fix some tests for split build
2020-10-23 14:05:03 +03:00
alesapin
0abb62107a Exclude some tests from flaky check run 2020-10-23 13:18:06 +03:00
alexey-milovidov
121ebfdc81
Merge pull request #16249 from traceon/access-storage-added-log
Add a log message after an access storage is added
2020-10-23 09:17:10 +03:00
Vitaliy Zakaznikov
e743d2fd26 * Fixing tests in the tests/testflows/ldap/external_user_directory/tests/authentications.py suite
* Moving TestFlows runs to use classic output format for stdout
* Moving to TestFlows 1.6.57
* Updating LDAP test code styling
2020-10-22 19:14:58 -04:00
Alexander Kuzmenkov
b77e776db4 fixes 2020-10-22 20:30:50 +03:00
Alexander Kuzmenkov
0275e9c010 work around docker weirdness 2020-10-22 19:42:31 +03:00
alesapin
d91db2473e Fix bash 2020-10-22 17:33:23 +03:00
Alexander Kuzmenkov
ac7af67ede fixup 2020-10-22 15:52:43 +03:00
alesapin
369365bdb0 Fix run.sh 2020-10-21 23:11:35 +03:00
alesapin
dcf9a8cff0 Remove comment 2020-10-21 19:39:39 +03:00
Alexander Kuzmenkov
8cd560d5ad Merge remote-tracking branch 'origin/master' into HEAD 2020-10-21 19:13:56 +03:00
Alexander Kuzmenkov
6293d1dbbe Merge remote-tracking branch 'origin/master' into HEAD 2020-10-21 18:39:59 +03:00
Alexander Kuzmenkov
a678f03229 fixup 2020-10-21 18:21:54 +03:00
Alexander Kuzmenkov
c10dada3d4 try node 1 2020-10-21 18:06:42 +03:00
alesapin
ad655bcfc0 Add stateless flaky check 2020-10-21 17:23:45 +03:00
alesapin
a7f989193a Merge branch 'master' into stateless_test_flaky_check 2020-10-21 17:21:25 +03:00
alexey-milovidov
2b00b5391a
Merge pull request #11844 from Enmk/AES_encrypt_decrypt
encrypt and decrypt functions
2020-10-20 22:57:35 +03:00
Alexander Kuzmenkov
7f7e6e809d debug and -Og again 2020-10-20 20:48:55 +03:00
Alexander Kuzmenkov
abcb3c2ff9
Update report.py 2020-10-20 20:06:51 +03:00
Alexander Kuzmenkov
6b0225ab8c
Update README.md 2020-10-20 19:52:37 +03:00
Alexander Kuzmenkov
4080ad3cba Merge remote-tracking branch 'origin/master' into HEAD 2020-10-20 15:32:32 +03:00
Alexander Kuzmenkov
242ec7e56c make some tests faster 2020-10-20 15:12:06 +03:00
Alexander Kuzmenkov
c4acb227e4 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-20 00:44:05 +03:00
nikitamikhaylov
8a39b65fa2 fix build and tests 2020-10-19 19:15:22 +03:00
nikitamikhaylov
7a97329209 Merge branch 'master' of github.com:ClickHouse/ClickHouse into welch-t-test 2020-10-19 18:54:26 +03:00
Nikita Mikhaylov
846492d7a5
Revert "scipy" 2020-10-19 18:41:57 +03:00
Alexander Kuzmenkov
764f19820b max threads 2020-10-19 17:39:52 +03:00
Alexander Kuzmenkov
38a2dd55ce fix numactl parameters 2020-10-19 17:31:02 +03:00
Alexander Kuzmenkov
1829bd09cb Merge remote-tracking branch 'origin/master' into HEAD 2020-10-19 17:27:36 +03:00
Alexander Kuzmenkov
defcd29b31
Merge pull request #16036 from ClickHouse/stress_test_improvemets
Minor improvements of stress test
2020-10-19 16:12:30 +03:00
Alexander Kuzmenkov
0c1f8e6018
Merge pull request #16086 from ClickHouse/aku/integration-warnings
remove warnings in integration tests
2020-10-19 15:58:15 +03:00
Vasily Nemkov
4124538b56 Merge remote-tracking branch 'upstream/master' into AES_encrypt_decrypt 2020-10-18 00:00:13 +03:00
Alexander Kuzmenkov
12bb7a05ba
Merge pull request #16034 from ClickHouse/aku/fasttest-improve
Make the Fast Test easier to run locally
2020-10-16 23:29:04 +03:00
tavplubix
eb483fc72f
Update run.sh 2020-10-16 20:31:05 +03:00
Nikita Mikhaylov
650fe9a9c5
Merge pull request #16093 from nikitamikhaylov/fasttest
scipy
2020-10-16 19:53:34 +03:00
nikitamikhaylov
c65a2d638f done 2020-10-16 19:50:35 +03:00
Alexander Kuzmenkov
7581267c01 remove warnings in integration tests 2020-10-16 18:27:45 +03:00
Alexander Kuzmenkov
2241ea9f33 not sure what's going on... 2020-10-16 17:44:59 +03:00
Alexander Kuzmenkov
0825b8f4c2 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-16 17:41:40 +03:00
tavplubix
149c74b2b8
trigger CI 2020-10-15 23:48:10 +03:00
nikitamikhaylov
a80bbf6e0e fasttest + rm .py 2020-10-15 22:54:17 +03:00
Alexander Tokmakov
95ad45a3b0 minor improvements of stress test 2020-10-15 21:14:04 +03:00
Alexander Kuzmenkov
f46887dcaa improve fasttest usability 2020-10-15 20:29:07 +03:00
alesapin
e6650ed642 Fix options passing to functional tests scripts 2020-10-15 14:56:12 +03:00
tavplubix
04206db7da
Merge pull request #15974 from ClickHouse/merging_14295
Merging #14295
2020-10-14 23:51:42 +03:00
nikitamikhaylov
b1e1553061 style + docker + tests 2020-10-14 22:43:08 +03:00
nikitamikhaylov
2d29eab934 better 2020-10-14 22:00:20 +03:00
Alexander Kuzmenkov
aafec3d777 fixup 2020-10-14 21:53:35 +03:00
nikitamikhaylov
575354a6d3 add scipy to dockerfile 2020-10-14 21:52:23 +03:00
Alexander Kuzmenkov
c6a30e3b3f fixup 2020-10-14 18:53:14 +03:00
Alexander Kuzmenkov
4f14d40489 Fix server logs in fast test 2020-10-14 17:12:04 +03:00
Alexey Milovidov
5e502c52b3 Merge branch 'master' into AES_encrypt_decrypt 2020-10-14 16:30:23 +03:00
Alexander Tokmakov
72b1339656 Revert "Revert "Write structure of table functions to metadata""
This reverts commit c65d1e5c70.
2020-10-14 15:19:29 +03:00
tavplubix
c65d1e5c70
Revert "Write structure of table functions to metadata" 2020-10-14 13:59:29 +03:00
alexey-milovidov
f60ccb4edf
Merge pull request #14295 from ClickHouse/write_structure_of_table_functions
Write structure of table functions to metadata
2020-10-13 23:56:09 +03:00
robot-clickhouse
554fa482e6 Auto version update to [20.11.1.1] [54442] 2020-10-10 18:39:58 +03:00
nvartolomei
0e4fd5f24b
Use https protocol for llvm repository in fasttest 2020-10-05 16:27:03 +01:00
alesapin
0b67ee8e54 Trying with clang-9 2020-10-05 14:35:23 +03:00
alesapin
a940298eb4 One more fix 2020-10-05 13:54:36 +03:00
alesapin
0c73b3b99f Fix woboq codebrowser image 2020-10-05 13:20:06 +03:00
Alexander Tokmakov
6b2da861dc Merge branch 'master' into write_structure_of_table_functions 2020-10-02 20:46:58 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov
9bbc962c83 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-01 19:19:09 +03:00
Alexander Kuzmenkov
72c3ee74e8
Merge pull request #15479 from ClickHouse/aku/docker-shellcheck
Check docker scripts with shellcheck
2020-10-01 18:27:59 +03:00
Alexander Kuzmenkov
13c325597a Merge remote-tracking branch 'origin/master' into HEAD 2020-10-01 13:57:04 +03:00
Alexander Kuzmenkov
74f8e41b55 calculate on all nodes 2020-10-01 13:56:56 +03:00
Alexander Kuzmenkov
d0dff5b738 fixes 2020-10-01 12:27:05 +03:00
Alexander Kuzmenkov
eb3669e82f more fixes 2020-09-30 20:39:38 +03:00
Alexander Kuzmenkov
499e0766e5 Check docker scripts with shellcheck 2020-09-30 20:06:46 +03:00
Alexander Kuzmenkov
c5d1f51f58 just split 2020-09-30 19:14:20 +03:00
Alexander Kuzmenkov
af051ec2d9 fasttest compat with old script 2020-09-30 18:13:53 +03:00
Alexander Kuzmenkov
22a0ec0892 try split debug -Og build in fasttest 2020-09-30 17:55:40 +03:00
Alexander Kuzmenkov
8cfe24ac56 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-30 17:51:52 +03:00
Alexander Kuzmenkov
9194f1d7e5 fasttest fixup 3 2020-09-30 17:51:48 +03:00
Alexander Kuzmenkov
0516af03ce fasttest fixup 3 2020-09-30 17:51:48 +03:00
Alexander Kuzmenkov
aa543a2d3d quotes 2020-09-30 17:40:24 +03:00
Alexander Kuzmenkov
2523101302
Merge pull request #15230 from ClickHouse/aku/debug-perf
debug perf test run time
2020-09-30 15:05:32 +03:00
Alexander Kuzmenkov
9f63e882c7 fixup 2020-09-30 15:03:52 +03:00
Alexander Kuzmenkov
1617442242 fixup 2020-09-30 14:55:24 +03:00
Alexander Kuzmenkov
824d5b093c bind everything to node 0 2020-09-30 14:32:49 +03:00
Alexander Kuzmenkov
b1abed7d37 Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD 2020-09-30 14:22:20 +03:00
Alexander Kuzmenkov
b204bcd4b4 fasttest fixup 2 2020-09-29 23:11:20 +03:00
Alexander Kuzmenkov
f8047102fe fixup 2020-09-29 22:06:45 +03:00
Alexander Kuzmenkov
6062c55569 fasttest fixup 2020-09-29 21:59:45 +03:00
Alexander Kuzmenkov
e943a22d28 allow fast test to run locally 2020-09-29 21:02:44 +03:00
Alexander Kuzmenkov
dc15bceadc Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD 2020-09-29 16:41:38 +03:00
Alexander Kuzmenkov
ac4f0cdf22 fix 2020-09-29 14:07:31 +03:00
alesapin
a1f4d38019 Add ability to run tests multiple time in stateless image 2020-09-29 12:44:28 +03:00
Alexander Tokmakov
a7d3a024c7 Revert "Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka""
This reverts commit c298c633a7.
2020-09-29 11:56:37 +03:00
Alexander Kuzmenkov
6671b26f20 fixes 2020-09-28 21:43:47 +03:00
Alexander Kuzmenkov
3d1456a55d Merge remote-tracking branch 'origin/master' into HEAD 2020-09-28 21:19:53 +03:00
alesapin
071ff6c9af
Merge pull request #15063 from azat/symbolizers-settings-for-non-server
Set sanitizers options in the current shell too
2020-09-28 17:44:39 +03:00
Alexander Kuzmenkov
c48d212320 performance comparison 2020-09-28 15:09:08 +03:00
Alexander Kuzmenkov
1e7a0f0e5f typo 2020-09-28 14:44:49 +03:00
alesapin
fff9e5d592 Merge branch 'master' into azat-symbolizers-settings-for-non-server 2020-09-28 12:31:05 +03:00
Alexander Tokmakov
b0d99217fb Merge branch 'master' into write_structure_of_table_functions 2020-09-27 14:26:47 +03:00
Alexander Kuzmenkov
425150e783
bind to different nodes 2020-09-25 13:19:37 +03:00
Alexander Kuzmenkov
3ff16325d8 fix the profiler 2020-09-25 12:52:09 +03:00
Alexander Kuzmenkov
40209f9ed2 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-25 11:28:47 +03:00
Alexander Tokmakov
fb826557b7 Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 02:04:01 +03:00
Alexander Kuzmenkov
4ed4205647
Update run.sh 2020-09-24 19:54:09 +03:00
tavplubix
1c9398c5ee
Merge pull request #15215 from ClickHouse/better_image_for_stateless
Better images for CI tests
2020-09-24 18:54:34 +03:00
Vitaly Baranov
0605808ed1
Merge pull request #14492 from vitlibar/use-previous-users-xml-if-failed-to-reload
Use previous users.xml if failed to reload
2020-09-24 16:25:19 +03:00
Alexander Kuzmenkov
651518566a performance comparison 2020-09-24 16:24:44 +03:00
tavplubix
c298c633a7
Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka" 2020-09-24 16:10:24 +03:00
alesapin
cc305cf886 Fix fuzzer image 2020-09-24 15:34:03 +03:00
Alexander Kuzmenkov
dee34a834f debug perf test run time 2020-09-24 14:46:03 +03:00
Alexander Kuzmenkov
41ad365eaf
Increase fast test threads to 8
Tests don't often fail in parallel (1/10 runs), so we can make them faster.
2020-09-24 14:11:59 +03:00
Alexander Kuzmenkov
26abe8cb30
Update compare.sh 2020-09-24 12:24:30 +03:00
alesapin
4f3eb4532a Add missed changes 2020-09-24 11:37:20 +03:00
alesapin
bb8a2e1617 Better clickhouse-configs 2020-09-24 11:18:36 +03:00
alesapin
a85bb16c66 Remove zookeeper from CI images 2020-09-24 10:33:22 +03:00
Alexander Kuzmenkov
c2b11221a3 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-23 23:56:15 +03:00
Alexander Kuzmenkov
21f9cc65c9 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-23 23:54:55 +03:00
Alexander Kuzmenkov
179807b0b4 performance comparison 2020-09-23 23:45:39 +03:00
Alexander Tokmakov
f0f91f84af Merge branch 'master' into enable_atomic_database_by_default 2020-09-23 21:50:15 +03:00
Ilya Yatsishin
7dad84ea6b
Merge pull request #14265 from arenadata/ADQM-160
Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka
2020-09-23 19:02:58 +03:00
Alexander Kuzmenkov
d96c89972c
Update compare.sh 2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov
bb51aade56
Update docker/test/performance-comparison/compare.sh
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov
833c07f1f7
Update compare.sh 2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov
2b6f4134eb Parallel create/fill in perf test 2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov
5eaa2a08d4
Update report.py 2020-09-23 10:28:28 +03:00
alesapin
01237170af Fix fast test CMakeOptions 2020-09-22 17:25:48 +03:00
Alexander Kuzmenkov
0b01e62050 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov
4937159f85
Merge pull request #14990 from ClickHouse/aku/longer-perf
If perf test definition changed, run everything + longer (as in master)
2020-09-22 13:25:49 +03:00
Alexander Tokmakov
dc1cc11764 Merge branch 'master' into enable_atomic_database_by_default 2020-09-22 12:40:32 +03:00
Alexander Tokmakov
639466afdb fix docker images 2020-09-22 10:45:08 +03:00
Azat Khuzhin
3fd85430f2 Set sanitizers options in the current shell too
/etc/environment will not be read in current shell, so export variables
from that file manually, to make clickhouse-local/clickhouse-client use
them too.
2020-09-21 23:57:45 +03:00
Alexander Kuzmenkov
4696e22799
Update perf.py 2020-09-21 22:08:41 +03:00
alexey-milovidov
5e56f14d5f
Merge pull request #15027 from ClickHouse/perf-test-separate-profiler
Separate profile runs in performance test
2020-09-21 21:07:14 +03:00
Ilya Golshtein
494e59e7c1 DOCKER_KERBEROS_KDC_TAG 2020-09-21 19:12:31 +03:00
alesapin
084b40affe
Merge pull request #15069 from ClickHouse/fix_test_images
Use llvm-symbolizer-11 in all test images.
2020-09-21 17:02:27 +03:00
Alexander Kuzmenkov
679c5278e4 reword the diagnostic about short queries in perf test 2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov
2f8d7ae208 fix the conditions 2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov
85be1f1685 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-21 14:57:25 +03:00
Alexander Tokmakov
13e41cdd20 try enable atomic database by default 2020-09-21 13:55:34 +03:00
alesapin
1bd76c820c Back to 19.10 2020-09-21 12:05:10 +03:00
alesapin
fd469f1266 Remove redundant file 2020-09-21 10:41:23 +03:00
alesapin
27613f8346 Fix symbolizers path in test images 2020-09-21 10:38:11 +03:00
Vitaly Baranov
a288674867 Fix testflows tests. 2020-09-20 18:49:56 +03:00
Alexey Milovidov
ef800b5083 Perf test: development 2020-09-19 21:21:29 +03:00
Alexey Milovidov
35e8a895b6 Calculate profiler data in separate query runs 2020-09-19 20:38:21 +03:00
Alexey Milovidov
03aec83aec Remove obsolete code from performance test 2020-09-19 19:27:37 +03:00
Alexander Tokmakov
1ca9a92b21 Merge branch 'master' into write_structure_of_table_functions 2020-09-18 21:09:23 +03:00
Alexander Kuzmenkov
8995140ffb Merge remote-tracking branch 'origin/master' into HEAD 2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov
840586bd98
Merge pull request #14386 from ClickHouse/aku/perf-short
[wip] an experiment with short queries in perf test
2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov
e7b9319e12 If perf test definition changed, run everything + longer (as in master)
Also some other perf test fixes
2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov
cfc975d759
Merge pull request #14724 from ClickHouse/aku/perf-some
Run only some queries in perf tests, not all combos
2020-09-18 13:13:28 +03:00
Alexander Kuzmenkov
7f029ee03c
Update perf.py 2020-09-18 11:27:27 +03:00
Alexey Milovidov
799a675b5d Merge branch 'master' into AES_encrypt_decrypt 2020-09-17 21:42:51 +03:00
Alexander Kuzmenkov
4fc86f05da some fixes + docs + report queries that are not short 2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov
b1d7df80cd Merge remote-tracking branch 'origin/master' into HEAD 2020-09-17 18:20:14 +03:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
7a6f7a872a forgotten docker changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
Alexander Kuzmenkov
ada1c7c4a0 fixup 2020-09-17 13:15:46 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11
Move to clang-11 in CI builds
2020-09-17 13:14:00 +03:00
Alexander Kuzmenkov
dda88eebd1
test again 2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov
d55e3cd214
Update perf.py 2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov
3b8ca1f262
Update compare.sh 2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov
c5c5faf8ee fixup 2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov
e333a7bad4 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-16 12:05:22 +03:00
alesapin
d144421214 Disable lto for glibc-compatibility 2020-09-16 10:46:38 +03:00
alexey-milovidov
018f596d21
Merge pull request #14685 from ClickHouse/remap-executable
Attempt to make performance test more reliable
2020-09-15 15:09:47 +03:00
Alexander Kuzmenkov
df95f91d7c Merge remote-tracking branch 'origin/master' into HEAD 2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov
24dd33d5cb
Update compare.sh 2020-09-15 13:44:21 +03:00
Alexander Tokmakov
da6beb1a91 Merge branch 'master' into enable_some_tests_with_database_atomic 2020-09-14 23:00:14 +03:00
Alexey Milovidov
b87c108246 Enable remap in performance tests 2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov
ab6bc1ed59
Update compare.sh 2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
b3138605c7 performance comparison 2020-09-14 19:16:59 +03:00
Vasily Nemkov
b980cf354a Moving to TestFlows version 1.6.46 2020-09-14 18:24:57 +03:00
Alexander Kuzmenkov
3113aa6cfe Avoid extra error in perf report on broken queries 2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271 fixup 2020-09-14 10:27:46 +03:00
Vitaliy Zakaznikov
bb1d126ce5 Updating TestFlows to 1.6.45 to fix stability issues with multi line commands. 2020-09-10 22:54:40 +03:00
Alexander Kuzmenkov
8689797efc Run only some queries in perf tests, not all combos 2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov
26348ad014 fixup 2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov
ca2a33008b faster 2020-09-10 17:55:54 +03:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup 2020-09-09 23:01:41 +04:00
Alexander Tokmakov
d278d849e4 Merge branch 'master' into write_structure_of_table_functions 2020-09-09 17:12:35 +03:00
Alexander Tokmakov
b68782d285 enable more tests with Atomic database 2020-09-09 16:32:50 +03:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
robot-clickhouse
8def718661 Auto version update to [20.10.1.1] [54440] 2020-09-08 17:04:41 +03:00
alesapin
c40ba48822 Raise on error 2020-09-08 11:49:24 +03:00
alesapin
1a1bccf416 Add sleeps 2020-09-08 11:45:22 +03:00
alesapin
73253f058d Add sleep 2020-09-08 11:45:01 +03:00
alesapin
0193a132d4 Add retries to s3 downloader 2020-09-08 11:43:02 +03:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
Alexander Kuzmenkov
f7d631bf82 use fasttest script from sources 2020-09-07 13:19:01 +03:00
Alexey Milovidov
04a6965006 Fix error with executable dictionary source 2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov
0904433c87 Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229
Also add one more timeout to perf test runner.
2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov
1978968067 performance comparison 2020-09-07 02:49:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
Alexander Tokmakov
ed5f827708 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 16:38:57 +03:00
alesapin
5d897231e1
Merge pull request #14432 from ClickHouse/minor-changes-in-stateful-tests
Wait for clickhouse-server to start in stateful tests
2020-09-04 13:12:32 +03:00
Alexander Tokmakov
b840d741d0 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 13:00:07 +03:00
Alexander Tokmakov
df09bf3cb6 add suppressions for leak sanitizer 2020-09-03 22:50:26 +03:00
alexey-milovidov
fb56d0b9a3
Update run.sh 2020-09-03 21:21:27 +03:00
Alexander Kuzmenkov
29b97ff259
Merge pull request #14430 from ClickHouse/aku/perf4
[wip] perf experiment no.4 -- geomean
2020-09-03 21:13:07 +03:00
Vasily Nemkov
9ba4613381 Excluding tests from fasttest runs since they depend on external libraries: OpenSSL 2020-09-03 16:12:32 +03:00
Yatsishin Ilya
14b61e87d9 mysql bin log 2020-09-03 13:27:17 +03:00
Yatsishin Ilya
fc075e65da Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-03 11:49:48 +03:00
Alexey Milovidov
cd812d94de Wait for clickhouse-server to start in stateful tests 2020-09-03 04:54:50 +03:00
Alexander Kuzmenkov
a321d6970c adjust report and increase time 2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov
8e8e195e45 geomean 2020-09-03 03:58:40 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Yatsishin Ilya
5ab9f249e5 Merge branch 'try-dns-fix' into integration-explicit-configs 2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-02 12:48:07 +03:00
Yatsishin Ilya
5d39b8ce04 unnecessary change 2020-09-02 11:39:16 +03:00
Alexander Kuzmenkov
00c924b0dd whitespace 2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov
5fcb9bd163 short queries 2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov
e622e108f7 readme 2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov
0db5b4a72c Remove concurrent benchmark from the perf test
It's not stable enough and has only secondary utility.
2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov
f6cfb96748
Merge pull request #14346 from ClickHouse/aku/fuzzer
Don't let the fuzzer change max_execution_time
2020-09-02 01:59:50 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov
a6486490a2 performance comparison 2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov
0b70abe542 Don't let the fuzzer change max_execution_time 2020-09-01 18:51:46 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output 2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov
4620ac4c0d
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov
4e58f00305
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov
73d433a7dd
Merge pull request #14316 from ClickHouse/aku/html-fuzzer
Add a HTML report for AST Fuzzer
2020-09-01 16:46:30 +03:00
Azat Khuzhin
2d7cb03120 Suppress superfluous wget (-nv) output
Since for dowloading some of files wget logging may take 50% of overall
log [1].

  [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Yatsishin Ilya
6cb893f073 Draft. 2020-09-01 09:38:23 +03:00
Alexander Kuzmenkov
33c5815eb3 Add a HTML report for AST Fuzzer 2020-09-01 02:33:42 +03:00
robot-clickhouse
e2fa0eae2f Auto version update to [20.9.1.1] [54439] 2020-08-31 23:07:41 +03:00
Alexander Kuzmenkov
bc8765d5ad
Merge pull request #14095 from azat/DistributedFilesToInsert-fix
Fix DistributedFilesToInsert metric (zeroed when it should not)
2020-08-31 18:58:30 +03:00
Alexander Kuzmenkov
b601dd4596 cosmetic fixes for performance report 2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov
bb28320107 cosmetic fixes in performance report 2020-08-29 01:14:48 +03:00