Azat Khuzhin
9e622b5add
perf: switch *_log tables to Memory engine (attempt to reduce cache misses)
...
trace_log/query_log from performance tests shows (for
cases when prewarm query fails with timeout, 15sec) excessive
writeTraceInfo() in trace_log and QueryProfilerRuns in query_log, but
this is not the root cause of the timeout, but consequence.
Also query_log shows that on failures the following profile events has
significantly higher values:
- PerfLocalMemoryMisses (6.3x more)
- PerfLocalMemoryReferences (7x more)
- PerfDataTLBMisses (6.9x more)
- PerfInstructionTLBMisses (6.4x more)
During looking at performance tests logs I noticed that once the prewarm
query fails other server (left/right) was merging (MergeTree) something
in *_log tables.
But, using MergeTree for *_log in performance tests is useless, since
anyway environment for performance tests uses ramdrive.
And so MergeTree merges just increase overhead.
Eventually I expect that this should decrease extra memory referencing
and so this should decrease cache/TLB misses.
CI: https://clickhouse-test-reports.s3.yandex.net/30886/c504e0c08df7a926bb479a1d297f326f5c48a32f/performance_comparison/report.html#fail1
v2: <partition_by remove="remove"/>
2021-11-04 09:26:46 +03:00
Azat Khuzhin
ff19d22305
perf: remove over *_log tables that does not exported into artifacts
2021-11-03 08:29:18 +03:00
Azat Khuzhin
837fe8554f
perf: remove zookeeper to avoid configuring DDLWorker
2021-11-03 08:29:18 +03:00
Azat Khuzhin
acef85b17d
perf: cleanup server overrides
2021-11-03 08:29:18 +03:00
Alexey Milovidov
e513a5db32
Change <yandex> to <clickhouse> in configs
2021-09-20 01:38:53 +03:00
Azat Khuzhin
7083d126f7
Disable postgresql_port in perf tests
...
To avoid port overlaps
2021-04-17 15:28:09 +03:00
Alexander Tokmakov
9925110713
rename other occurrances
2021-03-29 23:04:50 +03:00
Denis Glazachev
6f4e883d8d
Factor out settings
...
Enable parallel insert select
Reduce the amount of data to process
2021-03-06 15:09:45 +04:00
Nikolai Kochetov
a195e783d2
Try fix perftests.
2021-03-04 13:25:49 +03:00
Nikolai Kochetov
019513d869
Try fix perftests.
2021-03-03 13:42:44 +03:00
Alexander Kuzmenkov
5f424f7c5c
Update zzz-perf-comparison-tweaks-config.xml
2020-12-14 20:08:32 +03:00
Alexander Kuzmenkov
e7f93b5563
Merge pull request #18058 from azat/perf-test-zk-port-fix
...
Remove test_keeper_server in perf tests
2020-12-14 17:54:47 +03:00
Alexander Kuzmenkov
2edabd5519
Update zzz-perf-comparison-tweaks-config.xml
2020-12-14 17:45:58 +03:00
Azat Khuzhin
653ddab63e
Remove test_keeper_server in perf tests
...
To avoid port overlaps for right and left server (anyway it is not
used).
2020-12-14 10:59:01 +03:00
Azat Khuzhin
6f2c559398
Convert top_level_domains_lists.xml into regular file
...
docker/test/performance-comparison/config/config.d is not allowed to has
symlinks, since it is copied with the COPY docker command.
2020-12-10 21:01:17 +03:00
Azat Khuzhin
8a4b29495b
perf: override top_level_domains_path via command line arguments
2020-12-09 21:08:31 +03:00
Azat Khuzhin
7b0c720922
Add top_level_domains into perf tests
...
And change Dockerfile to trigger image rebuild
2020-12-09 21:08:31 +03:00
Azat Khuzhin
79e6348282
perf: load overrides last of all
2020-12-09 07:31:54 +03:00
Azat Khuzhin
d33b0ad33b
Use interserver_http_port remove=remove over auto-port
...
Revert "perf: fix port conflict for tcp_with_proxy_port"
This reverts commit 89b3566824e5c0a87b6310fc4b6f9d300d2e17db.
2020-12-09 00:11:12 +03:00
Alexey Milovidov
b87c108246
Enable remap in performance tests
2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov
8b82ff215f
muzzy decay 10 ms
2020-06-27 04:08:21 +03:00
Alexander Kuzmenkov
14c55b940e
peftest settings: use_uncompressed_cache goes to profile
2020-06-05 16:32:21 +03:00
Alexander Kuzmenkov
93e0313ed4
boop the CI
2020-04-14 01:40:07 +03:00
Alexander Kuzmenkov
bcc77fc96a
Update perf-comparison-tweaks-config.xml
2020-04-06 23:42:20 +03:00
Nikolai Kochetov
8e18f56d4f
Try fix perftest distributed_aggregation.xml
2020-04-01 14:53:09 +03:00
Alexander Kuzmenkov
5fd5b15c36
performance comparison
2020-03-24 20:33:42 +03:00
Alexander Kuzmenkov
fe1eb691fd
Update perf-comparison-tweaks-config.xml
2020-03-23 23:53:25 +03:00
Alexander Kuzmenkov
d396a7c650
Some tweaks for performance comparison
2020-03-23 12:39:12 +03:00
Alexander Kuzmenkov
ea67cba608
performance comparison
2020-02-25 22:51:27 +03:00
Alexander Kuzmenkov
ebe70f5bcb
performance comparison
2020-02-25 16:12:26 +03:00
