Alexander Kuzmenkov
8554cb621e
some perf test script improvements
2021-06-03 20:40:05 +03:00
Alexander Kuzmenkov
5da54c2745
calculate perf test precision thresholds from historical data
2021-05-26 16:30:43 +03:00
hexiaoting
a1d521902c
Merge remote-tracking branch 'origin/master' into dev-continue-sundyli
2021-05-07 14:22:53 +08:00
Alexander Kuzmenkov
1e7fc204d8
Merge pull request #23554 from ClickHouse/aku/perf-numa-attributes
...
add numactl info to perf test run attributes
2021-04-27 14:09:57 +03:00
Alexander Kuzmenkov
bfa47f7c5f
Update compare.sh
2021-04-26 12:41:29 +03:00
Alexander Kuzmenkov
5d101336ff
fix
2021-04-26 12:39:54 +03:00
Alexander Kuzmenkov
c40a300d03
add numactl info to perf run attributes
2021-04-23 23:52:18 +03:00
Alexander Kuzmenkov
5f1c825e1d
Update compare.sh
2021-04-23 22:01:24 +03:00
Alexander Kuzmenkov
e052edc7df
Update compare.sh
2021-04-23 20:32:30 +03:00
Alexander Kuzmenkov
bcc0744adb
fix
2021-04-23 18:54:48 +03:00
Alexander Kuzmenkov
e51c844e2c
add more info to perf test report
2021-04-23 16:47:33 +03:00
Alexander Kuzmenkov
3f855cb714
more
2021-04-22 20:18:21 +03:00
Alexander Kuzmenkov
6a1414663f
upload cpu model to perf test db
2021-04-22 19:48:32 +03:00
alexey-milovidov
0c70b06960
Merge branch 'master' into system-querylog-map
2021-03-31 04:54:30 +03:00
Alexander Kuzmenkov
5ae5134147
Merge pull request #21846 from ClickHouse/aku/perf-test-error
...
more robust error handling in perf test
2021-03-22 17:18:37 +03:00
Alexander Kuzmenkov
8ab778e26a
Merge pull request #21754 from ClickHouse/aku/fuzzer-ci-sources
...
make the fuzzer use sources from the CI
2021-03-18 18:02:13 +03:00
Alexander Kuzmenkov
f2ac17cfba
Update compare.sh
2021-03-18 17:59:49 +03:00
Alexander Kuzmenkov
065faf1318
more robust error handling in perf test
2021-03-18 01:32:55 +03:00
Alexander Kuzmenkov
a78b234a6d
fixes
2021-03-15 21:45:57 +03:00
Alexander Kuzmenkov
08148e062f
Fix a rare false negative in perf tests
2021-03-02 19:21:30 +03:00
Azat Khuzhin
9a26409147
Fix performance tests (by avoid sharding status file for right and left server)
...
Since cp -al (hard links):
2021.02.21 01:09:09.991771 [ 243 ] {} <Information> StatusFile: Status file right/db/status already exists - unclean restart. Contents:
PID: 241
Started at: 2021-02-21 01:09:09
Revision: 54448
2021.02.21 01:09:09.992007 [ 243 ] {} <Error> Application: DB::Exception: Cannot lock file right/db/status. Another server instance in same directory is already running.
2021-02-21 10:56:48 +03:00
sundy-li
339133f32a
Support Map for OpenTelemetrySpanLog && improve docs update
2021-01-22 13:16:13 +08:00
Azat Khuzhin
de7909211d
Try using top_level_domains from the patched performance archive
...
If there is top_level_domains list in the upstream/master, use from the
patched version (this is required to run all performance tests for
upstream/master in the PR).
2021-01-02 17:27:03 +03:00
Azat Khuzhin
469b631ca6
Fix performance comparison
...
In #18113 the top_level_domains list copying was moved into
docker/packager/binary/build.sh, this was done to avoid symlinks (since
Dockerfile cannot dereference them).
But the patch was wrong, since it copied into the root (/), which is not
included into performance.tgz and also compare.sh was not modified.
This wasn't showed up with CI checks since the docker image wasn't
updated and it still included that top_level_domains, once it was
modified the image was updated and it became broken.
Cc: @akuzm
2021-01-02 17:09:20 +03:00
Azat Khuzhin
8a4b29495b
perf: override top_level_domains_path via command line arguments
2020-12-09 21:08:31 +03:00
Azat Khuzhin
d33b0ad33b
Use interserver_http_port remove=remove over auto-port
...
Revert "perf: fix port conflict for tcp_with_proxy_port"
This reverts commit 89b3566824e5c0a87b6310fc4b6f9d300d2e17db.
2020-12-09 00:11:12 +03:00
Azat Khuzhin
75f9640fc2
perf: fix port conflict for tcp_with_proxy_port
...
Simply use zero port to do auto allocation, anyway it is not used in
perf tests.
2020-12-08 23:29:38 +03:00
Azat Khuzhin
f1ac8775db
perf: override config directives via command line over sed by config.xml
2020-12-08 21:25:03 +03:00
Alexander Kuzmenkov
dc665d7c43
Update compare.sh
2020-11-06 13:45:42 +03:00
Alexander Kuzmenkov
ac487ab26a
Update compare.sh
2020-11-05 23:45:58 +03:00
Alexander Kuzmenkov
8d5fe1148c
add client config
2020-11-04 18:07:34 +03:00
Alexander Kuzmenkov
5cb708a50a
fixup
2020-11-04 04:19:53 +03:00
Alexander Kuzmenkov
4245c470ac
fixes
2020-11-03 17:37:54 +03:00
Alexander Kuzmenkov
a25996ed8d
Upload perf test results to the CI database
2020-11-03 02:10:19 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell
2020-10-27 12:04:03 +01:00
Alexander Kuzmenkov
e27dd538fd
performance comparison
2020-10-26 19:35:37 +03:00
Alexander Kuzmenkov
ac7af67ede
fixup
2020-10-22 15:52:43 +03:00
Alexander Kuzmenkov
c10dada3d4
try node 1
2020-10-21 18:06:42 +03:00
Alexander Kuzmenkov
242ec7e56c
make some tests faster
2020-10-20 15:12:06 +03:00
Alexander Kuzmenkov
38a2dd55ce
fix numactl parameters
2020-10-19 17:31:02 +03:00
Alexander Kuzmenkov
2241ea9f33
not sure what's going on...
2020-10-16 17:44:59 +03:00
Alexander Kuzmenkov
74f8e41b55
calculate on all nodes
2020-10-01 13:56:56 +03:00
Alexander Kuzmenkov
824d5b093c
bind everything to node 0
2020-09-30 14:32:49 +03:00
Alexander Kuzmenkov
dc15bceadc
Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD
2020-09-29 16:41:38 +03:00
Alexander Kuzmenkov
ac4f0cdf22
fix
2020-09-29 14:07:31 +03:00
Alexander Kuzmenkov
6671b26f20
fixes
2020-09-28 21:43:47 +03:00
Alexander Kuzmenkov
1e7a0f0e5f
typo
2020-09-28 14:44:49 +03:00
Alexander Kuzmenkov
425150e783
bind to different nodes
2020-09-25 13:19:37 +03:00
Alexander Kuzmenkov
3ff16325d8
fix the profiler
2020-09-25 12:52:09 +03:00
Alexander Kuzmenkov
dee34a834f
debug perf test run time
2020-09-24 14:46:03 +03:00
Alexander Kuzmenkov
26abe8cb30
Update compare.sh
2020-09-24 12:24:30 +03:00
Alexander Kuzmenkov
d96c89972c
Update compare.sh
2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov
bb51aade56
Update docker/test/performance-comparison/compare.sh
...
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov
833c07f1f7
Update compare.sh
2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov
2b6f4134eb
Parallel create/fill in perf test
2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov
0b01e62050
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov
4937159f85
Merge pull request #14990 from ClickHouse/aku/longer-perf
...
If perf test definition changed, run everything + longer (as in master)
2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov
679c5278e4
reword the diagnostic about short queries in perf test
2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov
2f8d7ae208
fix the conditions
2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov
8995140ffb
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov
840586bd98
Merge pull request #14386 from ClickHouse/aku/perf-short
...
[wip] an experiment with short queries in perf test
2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov
e7b9319e12
If perf test definition changed, run everything + longer (as in master)
...
Also some other perf test fixes
2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov
4fc86f05da
some fixes + docs + report queries that are not short
2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov
dda88eebd1
test again
2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov
3b8ca1f262
Update compare.sh
2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov
c5c5faf8ee
fixup
2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov
e333a7bad4
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-16 12:05:22 +03:00
Alexander Kuzmenkov
df95f91d7c
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov
24dd33d5cb
Update compare.sh
2020-09-15 13:44:21 +03:00
Alexander Kuzmenkov
ab6bc1ed59
Update compare.sh
2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov
b3138605c7
performance comparison
2020-09-14 19:16:59 +03:00
Alexander Kuzmenkov
3113aa6cfe
Avoid extra error in perf report on broken queries
2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
8689797efc
Run only some queries in perf tests, not all combos
2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov
1978968067
performance comparison
2020-09-07 02:49:34 +03:00
Alexander Kuzmenkov
a321d6970c
adjust report and increase time
2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov
8e8e195e45
geomean
2020-09-03 03:58:40 +03:00
Alexander Kuzmenkov
00c924b0dd
whitespace
2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov
0db5b4a72c
Remove concurrent benchmark from the perf test
...
It's not stable enough and has only secondary utility.
2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov
a6486490a2
performance comparison
2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov
a348bc4641
performance comparison
2020-08-24 17:15:11 +03:00
Alexander Kuzmenkov
f43457454e
warn on undefined shell variables
2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov
e9ad81b362
shellcheck
2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov
000326b627
Avoid timeouts in perf test
2020-08-19 18:08:23 +03:00
Alexander Kuzmenkov
5a97f0c19e
performance comparison
2020-08-11 14:53:25 +03:00
Alexander Kuzmenkov
88aa371e0c
performance comparison
2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov
d1554e76ec
Merge remote-tracking branch 'origin/master' into HEAD
2020-08-06 00:59:25 +03:00
Alexander Kuzmenkov
ff3f378e8a
try to rebuild package for 2b7c0167cb
2020-08-06 00:58:56 +03:00
alexey-milovidov
935533e841
Merge pull request #13193 from ClickHouse/aku/spurious-perf
...
Fix some spurious perf test failures
2020-08-03 01:02:53 +03:00
Alexander Kuzmenkov
a317f995be
performance comparison
2020-07-31 22:58:38 +03:00
Alexander Kuzmenkov
1d954581eb
Fix some spurious perf test failures
2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov
42e5f8ec44
Update compare.sh
2020-07-31 03:49:36 +03:00
Alexander Kuzmenkov
db15108005
add times speedup/slowdown to changed tests table
2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov
0e20507539
Update compare.sh
2020-07-30 17:26:47 +03:00
Alexander Kuzmenkov
15cd448afa
Update compare.sh
2020-07-23 17:59:32 +03:00
Alexander Kuzmenkov
186b2c3b1b
Support different query log format in perf test
2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov
2b7c0167cb
Update compare.sh
2020-07-22 21:02:56 +03:00
Alexander Kuzmenkov
3d89f0e9df
Perf test: bind server to one NUMA node
2020-07-21 15:41:14 +03:00
Alexander Kuzmenkov
00acf4173c
Fixes for perf test after #12469
2020-07-15 16:38:02 +03:00
Alexander Kuzmenkov
5a15e03400
Improve data layout in perf test
...
Also fix a bad test query found with new data.
2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov
10b6f98ca6
fixup
2020-07-03 11:39:43 +03:00