Commit Graph

356 Commits

Author SHA1 Message Date
Azat Khuzhin
adec690166 stress: SYSTEM DROP MARK CACHE 2021-12-06 09:02:56 +03:00
Azat Khuzhin
d3a7aed005 stress: tune memory_profiler_step too 2021-12-06 09:02:56 +03:00
Azat Khuzhin
169941c5d0 stress: allow 100MiB of memory to overcommit for SHOW/DROP DATABASE
CI: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__thread__actions_.html
2021-12-06 09:02:56 +03:00
Azat Khuzhin
445b0983ea stress: ignore server memory limits for hung check
In [1] hung check failed because the server was under memory pressure.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__undefined__actions_.html
2021-12-06 09:02:56 +03:00
mergify[bot]
b4f43c59a2
Merge branch 'master' into stress-test 2021-12-01 10:12:22 +00:00
alesapin
b4d4295c16 Followup 2021-11-30 13:24:04 +03:00
alesapin
085a30b98e Fixup 2021-11-30 13:22:50 +03:00
alesapin
bccd927aec Make stress tests slightly more stable 2021-11-30 13:19:03 +03:00
mergify[bot]
ae0b5df601
Merge branch 'master' into stress-test 2021-11-26 12:48:03 +00:00
alesapin
3562264404
Merge pull request #31803 from ClickHouse/faster_tests
Shorter stress and fuzzer tests
2021-11-26 10:17:26 +03:00
alesapin
5815429059 Shorter stress and fuzzer tests 2021-11-25 17:54:50 +03:00
mergify[bot]
ce0c112586
Merge branch 'master' into stress-test 2021-11-25 11:09:26 +00:00
Kruglov Pavel
18e60919c5
Update run.sh 2021-11-23 16:49:59 +03:00
Azat Khuzhin
d0ecdb617e Remove duplicated not compressed logs from CI (actions)
Right now we cannot remove that compression since non-github actions
check will upload non compressed files then, but once old CI will be
removed it seems to be possible to remove that manual compression.
2021-11-19 21:33:48 +03:00
mergify[bot]
66f7b81b5e
Merge branch 'master' into zookeeper_client_fault_injection 2021-11-17 09:41:12 +00:00
tavplubix
b1079ae309
Update run.sh 2021-11-16 20:03:50 +03:00
tavplubix
224a4c1b6b
Update run.sh 2021-11-16 17:45:37 +03:00
Kruglov Pavel
6180aedab6
Update download_previous_release 2021-11-15 23:16:35 +03:00
Kruglov Pavel
87df3c8272
Fix 2021-11-15 15:03:48 +03:00
Kruglov Pavel
08af98b4a1
Update download_previous_release 2021-11-09 16:34:13 +03:00
Kruglov Pavel
03f1e3c67d
Update run.sh 2021-11-08 14:02:36 +03:00
mergify[bot]
8ef9e61e36
Merge branch 'master' into stress-test 2021-11-03 08:28:43 +00:00
mergify[bot]
063ba2302c
Merge branch 'master' into zookeeper_client_fault_injection 2021-11-02 14:29:35 +00:00
alesapin
dbfa17aabf Add correct S3 2021-11-01 13:32:56 +03:00
mergify[bot]
d9d9d38e4f
Merge branch 'master' into stress-test 2021-10-27 19:00:31 +00:00
Azat Khuzhin
da90df5658 docker: switch <yandex> to <clickhouse> 2021-10-26 08:53:14 +03:00
Alexander Tokmakov
35b5cb9571 Merge branch 'master' into zookeeper_client_fault_injection 2021-10-25 19:03:37 +03:00
Azat Khuzhin
8f015764a7 Add metadata for *_log into tests artifacts
This will allow to use artifacts as-is, i.e.:

    clickhouse-local --path /path/to/log/artifact

v2: convert database to Ordinary to avoid extra symlinks dependencies.
2021-10-23 20:17:01 +03:00
Alexander Tokmakov
27ca943863 add fault injection in ZooKeeper client 2021-10-22 18:59:38 +03:00
mergify[bot]
943a1cbba0
Merge branch 'master' into stress-test 2021-10-21 04:41:23 +00:00
alesapin
3ae960e04b Review fixes 2021-10-11 16:40:12 +03:00
alesapin
9ad919d91a More timeouts in stress test 2021-10-11 13:25:54 +03:00
Kruglov Pavel
fd7d1131ec
Update run.sh 2021-10-06 13:17:48 +03:00
Kruglov Pavel
31302afe81 Update run.sh 2021-10-04 16:35:50 +03:00
avogar
821daa21da Update run.sh 2021-10-04 16:35:50 +03:00
Pavel Kruglov
6fc043026e Update run.sh 2021-10-04 16:35:50 +03:00
Pavel Kruglov
2db11bc6c5 Add backward compatibility check in stress test 2021-10-04 16:34:14 +03:00
tavplubix
8adfb9b593
Stop ThreadFuzzer before hung check (#29167)
* stop ThreadFuzzer before hung check

* fix

* fix
2021-09-20 17:23:10 +03:00
Vitaly Baranov
bbb192ee85 Convert skip_list.json into first line comments. 2021-09-12 17:15:23 +03:00
alesapin
0eac4529e0 Preparation 2021-09-06 14:33:39 +03:00
mergify[bot]
b81d479de4
Merge branch 'master' into stress-thread-fuzzer 2021-08-31 11:56:30 +00:00
Azat Khuzhin
fb311199ce test/stress: fix patterns for filtering out Raft messages 2021-08-28 19:21:07 +03:00
alesapin
91995ca3a6 More tries 2021-08-18 17:57:36 +03:00
Alexey Milovidov
7a16f331dc Enable thread fuzzer in Stress test 2021-08-10 23:49:05 +03:00
tavplubix
888d096ede
Update stress 2021-07-29 16:21:29 +03:00
Alexander Tokmakov
381634960e fix client options in stress test 2021-07-29 15:16:34 +03:00
Azat Khuzhin
984e9f2f50 test/stress: cleanup tail of log so that it will contain useful messages 2021-07-16 22:39:14 +03:00
Azat Khuzhin
41a5609b81 test/stress: preserve stderr across runs, to preserve errors for final commands 2021-07-16 22:39:14 +03:00
Azat Khuzhin
39a62cc2ef test/stress: fix sanitizers errors detection 2021-07-16 22:39:14 +03:00
Alexey Milovidov
c28f027b14 Fix error in stress test script 2021-07-15 10:24:35 +03:00
alesapin
32bd94a84b
Merge pull request #25741 from ClickHouse/stress-test-separate-logs
Separate log files for separate runs in stress test
2021-06-29 10:47:39 +03:00
alexey-milovidov
350445c5f1
Update run.sh 2021-06-29 01:29:14 +03:00
alexey-milovidov
1703bc91b0
Update run.sh 2021-06-28 16:21:17 +03:00
alexey-milovidov
ee935a3733
Update run.sh 2021-06-28 14:28:49 +03:00
Azat Khuzhin
f00a4668a4 Set follow-fork-mode child for gdb in stress/fasttest/fuzzer
Sometimes gdb does not catch SIGSEGV [1], let's try set this setting,
since maybe some code from contrib does fork.

  [1]: https://clickhouse-test-reports.s3.yandex.net/25605/cd5a3c8d7eb417f6df211b4507dc970933f8549a/stress_test_(thread).html#fail1
2021-06-28 10:04:08 +03:00
alexey-milovidov
f7663fe6eb
Update run.sh 2021-06-28 00:05:57 +03:00
Alexey Milovidov
45c4b62c3b Separate log files for separate runs in stress test 2021-06-27 18:41:25 +03:00
vdimir
e24ee509a4
Fix modulo division priority issue in test/stress/stress 2021-06-11 13:08:49 +03:00
vdimir
bf9df90296
Add join related options to stress test 2021-06-11 12:36:59 +03:00
alesapin
aeac53ac78 Update run script 2021-06-03 18:16:12 +03:00
alesapin
329380d6e5 Relaxed hung check in stress test 2021-06-03 18:13:29 +03:00
alesapin
82c90ebc05 Some improvements in stress test 2021-06-01 12:45:01 +03:00
Alexey Milovidov
e9e4ab3813 Less chance of OOM in stress tests 2021-04-24 03:27:23 +03:00
Azat Khuzhin
2575d03a33 Add trace_log into stateless/stress test artifacts 2021-04-20 08:03:29 +03:00
Alexander Tokmakov
0739dde734 improve hung check 2021-04-13 16:45:08 +03:00
Alexey Milovidov
a674188d39 Better diagnostics for OOM in stress test 2021-04-09 09:39:25 +03:00
Alexander Tokmakov
d7c43291b1 improve hung check in stress test 2021-03-15 17:23:04 +03:00
tavplubix
2acbfd834a
Merge branch 'master' into stress_test_results 2021-03-12 12:11:33 +03:00
alesapin
b2c12f3762 Upload coordination log after stress test 2021-03-07 17:44:30 +03:00
alesapin
76e10a4fb1 Missed files for tests 2021-03-03 23:05:33 +03:00
alesapin
56d9d99d1c Fix style and bayan 2021-02-26 09:59:40 +03:00
Alexander Tokmakov
d46fee0f04 Merge branch 'master' into stress_test_results 2021-02-26 00:24:22 +03:00
alesapin
84102a22e7 Trying to make testkeeper better in single server mode 2021-02-25 23:30:55 +03:00
Alexander Tokmakov
fbbb0c4b69 fix 2021-02-25 19:11:43 +03:00
Alexander Tokmakov
3632c1d879 add flacky check runner 2021-02-24 19:41:44 +03:00
Alexander Tokmakov
487b162343 fix 2021-02-22 16:53:43 +03:00
Alexander Tokmakov
eaed15b5e1 process result of func and unit tests 2021-02-20 23:04:24 +03:00
tavplubix
a697b578bc
Merge pull request #16193 from ClickHouse/database_replicated
DatabaseReplicated: continuation of #10485
2021-02-20 19:39:34 +03:00
Alexander Tokmakov
6d9990f378 Merge branch 'stress_test_results' of https://github.com/ClickHouse/ClickHouse into stress_test_results 2021-02-20 19:28:36 +03:00
Alexander Tokmakov
694d89ad81 fix 2021-02-20 19:27:04 +03:00
Alexander Tokmakov
b62a29728f Merge branch 'master' into stress_test_results 2021-02-20 16:22:43 +03:00
tavplubix
f5fc082ed0
Update run.sh 2021-02-19 22:39:42 +03:00
Alexander Tokmakov
033f55f498 fix 2021-02-19 17:38:20 +03:00
Alexander Tokmakov
4493c39bf7 fix 2021-02-19 12:57:09 +03:00
Alexander Tokmakov
afed8a8192 process stress test results 2021-02-19 01:08:44 +03:00
Alexander Tokmakov
8097532cb7 Merge branch 'master' into database_replicated 2021-02-18 17:42:06 +03:00
Azat Khuzhin
770c3406df test/stress: fix permissions for clickhouse directories 2021-02-18 00:13:03 +03:00
Azat Khuzhin
63eff6e8c8 test/stress: improve backtrace catching on server failures
Otherwise sometimes stracktraces may be lost [1]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/19580/6aecb62416ece880cbb8ee3a803e14d841388dde/stress_test_(thread).html#fail1
2021-02-18 00:13:03 +03:00
Azat Khuzhin
f483cd091a test/stress: use clickhouse builtin start/stop to run server from the same user
This will allow to attach with gdb for better diagnosis.
2021-02-18 00:13:03 +03:00
tavplubix
dd02106a08
Update run.sh 2021-02-17 12:01:41 +03:00
Alexander Tokmakov
6c9771484b add hung check to stress test 2021-02-16 22:39:25 +03:00
Alexander Tokmakov
3146a1a954 fix 2021-01-25 21:59:23 +03:00
alesapin
c0ae61e306 Fix stress test script 2020-11-10 10:33:31 +03:00
Alexey Milovidov
5b9d48c715 Remove garbage from docs 2020-11-04 17:39:18 +03:00
tavplubix
eb483fc72f
Update run.sh 2020-10-16 20:31:05 +03:00
tavplubix
149c74b2b8
trigger CI 2020-10-15 23:48:10 +03:00
Alexander Tokmakov
95ad45a3b0 minor improvements of stress test 2020-10-15 21:14:04 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov
d0dff5b738 fixes 2020-10-01 12:27:05 +03:00
Alexander Kuzmenkov
499e0766e5 Check docker scripts with shellcheck 2020-09-30 20:06:46 +03:00
alesapin
fff9e5d592 Merge branch 'master' into azat-symbolizers-settings-for-non-server 2020-09-28 12:31:05 +03:00
Alexander Tokmakov
fb826557b7 Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 02:04:01 +03:00
alesapin
bb8a2e1617 Better clickhouse-configs 2020-09-24 11:18:36 +03:00
Alexander Tokmakov
dc1cc11764 Merge branch 'master' into enable_atomic_database_by_default 2020-09-22 12:40:32 +03:00
Azat Khuzhin
3fd85430f2 Set sanitizers options in the current shell too
/etc/environment will not be read in current shell, so export variables
from that file manually, to make clickhouse-local/clickhouse-client use
them too.
2020-09-21 23:57:45 +03:00
Alexander Tokmakov
13e41cdd20 try enable atomic database by default 2020-09-21 13:55:34 +03:00
alesapin
27613f8346 Fix symbolizers path in test images 2020-09-21 10:38:11 +03:00
Alexander Tokmakov
b68782d285 enable more tests with Atomic database 2020-09-09 16:32:50 +03:00
Alexey Milovidov
fe5cfe3151 Increase number of threads in stress test 2020-08-26 23:39:02 +03:00
Alexey Milovidov
0bfe78636c Increase number of threads in stress test 2020-08-26 23:38:20 +03:00
alexey-milovidov
f62037e9dc
Update stress 2020-08-26 20:45:36 +03:00
Alexey Milovidov
07596b5323 Limit stress test to one hour 2020-08-26 20:44:03 +03:00
Alexey Milovidov
d44982072c More robust 2020-08-24 03:14:24 +03:00
Alexey Milovidov
1fb4294cdf Attempt to fix stress test 2020-08-24 00:13:21 +03:00
Alexey Milovidov
f4bf99fadc Better output of stress test 2020-08-23 23:48:27 +03:00
tavplubix
d95470f7c3
Update docker/test/stress/run.sh 2020-08-18 20:52:54 +03:00
Nikita Mikhaylov
e7f8c0af52 done 2020-08-18 15:28:38 +03:00
alexey-milovidov
3e6acf1329
Experiment with start/stop in stress test (#13779)
* Experiment with start/stop in stress test

* Support other installation options in "clickhouse start"

* Better diagnostics in install script

* Fixup

* Fixup

* Better diagnostics in stress test

* Update run.sh
2020-08-18 12:43:02 +03:00
Alexander Tokmakov
a5d74c44f1 run stress tests with Atomic database 2020-08-13 20:55:12 +03:00
alesapin
bd0322421b Better timeout 2020-08-04 17:28:35 +03:00
alesapin
caf0bcdc86 More timeouts 2020-08-04 11:48:47 +03:00
alesapin
ee5153bbc4 Restart server in stress test with timeout 2020-08-04 11:47:20 +03:00
alesapin
a061418dab Remove redundant cmd 2020-07-15 12:23:50 +03:00
alesapin
c483de8a35 Check result in separate file 2020-07-14 18:00:24 +03:00
alesapin
c400048a48 Check server able to restart in stateless tests 2020-07-14 17:47:23 +03:00
alesapin
dc8051f737 Fixes 2020-07-08 12:47:14 +03:00
alesapin
9ea3bdd054 Fix skip lists for old branches 2020-07-08 11:41:39 +03:00
alesapin
5098df8d0b Make skip-list optional 2020-07-03 14:15:30 +03:00
Nikolai Kochetov
e0de3aa7c9
Revert "Addition to #11184" 2020-06-09 19:39:26 +03:00
Alexey Milovidov
07205519b5 Addition to #11184 2020-05-29 16:31:27 +03:00
alesapin
104860b274 Fix stress script 2020-05-14 18:37:37 +03:00
Alexey Milovidov
aaba17665b Preparation for MSan UBSan stress tests 2020-05-13 03:50:21 +03:00
Nikita Mikhaylov
ac0939c037 remove too much logs from asan stress test 2020-04-22 19:29:04 +03:00
Nikita Mikhaylov
f76c32fd6e add allocator_release_to_os_interval_ms 2020-04-22 16:15:24 +03:00
Nikita Mikhaylov
5b37658535 first try 2020-04-22 16:13:08 +03:00
alesapin
3c98bfeeea Add correct version of llvm-symbolizer in stress-test 2020-03-28 15:01:55 +03:00
Alexander Tokmakov
9041977bb6 InterpreterCreateQuery code cleanup 2019-12-20 15:51:51 +03:00
Alexander Kuzmenkov
f5f6e73c84 Ignore non-instrumented modules in ThreadSanitizer.
libc++ seems not to be instrumented, which is why we get false positives about
data races in normal destruction of weak_ptr.

In passing, remove redundant configuration of llvm-symbolizer. One symlink
to llvm-8 should suffice.
2019-07-09 15:15:52 +03:00
alesapin
12693e5687 Run stateful tests in stress test 2019-06-25 15:04:05 +03:00
proller
859b35e0ff docker: use configs from clickhouse-test (#5531)
* CLICKHOUSE-3887 Debian init: Service stop timeout

* clean

* clean

* docker: use configs from clickhouse-test

* clean
2019-06-05 22:22:36 +03:00
alesapin
0060650bb0 Fix stress test exit code check and add brotli to image 2019-04-23 13:41:01 +03:00
Alexey Milovidov
b8a7d78e3a Tracking maximum amount of history in TSan 2019-03-29 19:58:02 +03:00
alesapin
eb4cc81176 Add llvm-8 to stress test docker image 2019-03-28 12:29:48 +03:00
alesapin
4e5ca0e0ba Better test images (with ts in output) 2019-01-17 13:35:22 +03:00
alesapin
7df80f52c1 Also install dbg package 2019-01-17 00:29:30 +03:00
alesapin
2ba25fa03d Add env variables systemwide 2019-01-17 00:05:37 +03:00
alesapin
ec0e350b5b Env variables to init.d file 2019-01-16 17:37:44 +03:00
alesapin
7984e4f8a4 Add env variables for test images 2019-01-16 11:58:40 +03:00
alesapin
99330c77ad Enable part_log in docker test images by default 2019-01-09 19:23:20 +03:00
alesapin
95a9b8b3f7 CLICKHOUSE-4245: Turn on query_log in stateless and stress tests 2019-01-09 19:04:39 +03:00
alesapin
43b099f20b Revert to ubuntu 18.04 2018-11-21 15:05:31 +03:00
alesapin
6ce13a08ef Move build and test images to 18.10, add libraries for unbundled build in debian image 2018-11-21 13:09:16 +03:00
alesapin
e20f38a855 Change default threads, num_procs/3 is enought 2018-10-22 20:04:43 +03:00
alesapin
b180c381c4 Change default threads value 2018-10-22 19:05:52 +03:00
alesapin
68352d8d63 Add small sleep before test run 2018-10-22 18:23:03 +03:00
alesapin
9191356158 CLICKHOUSE-4080: Add simple stress-test script and docker image for it 2018-10-22 17:31:25 +03:00