Azat Khuzhin
e307a728ca
tests: add no-stress tag
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
e79c24deda
docker/test/stress/stress: apply black
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
d154288fc6
tests/stress: fix TSan detection (enables thread fuzzer for non-TSan builds)
...
Follow-up for: #38106 (cc @tavplubix @alesapin)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-19 19:27:25 +03:00
alesapin
0ae0cc54aa
Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests
...
Some fixes for tests with tsan
2022-06-18 14:22:43 +02:00
Alexander Tokmakov
3e8aa2dc47
Update run.sh
2022-06-16 13:24:21 +03:00
Alexander Tokmakov
9cac78b498
make tests with tsan less flaky
2022-06-15 19:54:46 +02:00
Mikhail f. Shiryaev
4d45839f17
Generalize setup_minio.sh
...
- Cleanup apt garbage in the container
- Download the same binary in docker and setup_minio.sh
- Use binary and not rpm for minio
- Sort packages in Dockerfile's
2022-06-10 15:04:45 +02:00
Kruglov Pavel
83418ebba2
Merge pull request #37712 from vdimir/duplicate_download_previous_release
...
Get rid of duplicate download_previous_release
2022-06-07 12:51:34 +02:00
Kruglov Pavel
196863ade5
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check
2022-06-02 13:33:27 +02:00
Vladimir C
2622791b9e
upd
2022-06-01 16:17:17 +02:00
mergify[bot]
3866c27850
Merge branch 'master' into stress_s3
2022-06-01 12:02:33 +00:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release
2022-05-31 17:50:29 +00:00
vdimir
6d2fab49f4
Add join_algorithm='parallel_hash' to stress test
2022-05-23 10:18:22 +02:00
Alexander Tokmakov
425b31ba1b
Update stress
2022-05-12 15:04:12 +03:00
Alexander Tokmakov
c23bc01196
Merge branch 'master' into zookeeper_client_fault_injection
2022-05-11 17:20:42 +02:00
alesapin
af99183950
Disable thread fuzzer after server restart
2022-05-10 15:16:21 +02:00
mergify[bot]
5c742cf2d5
Merge branch 'master' into stress_s3
2022-05-10 12:26:26 +00:00
Alexander Tokmakov
9346c9363a
Merge pull request #37052 from ClickHouse/fix_server_termination_stress_tests
...
Print stacks if we cannot terminate server in stress tests
2022-05-10 13:12:44 +03:00
Alexander Tokmakov
17c954bea7
fix shellcheck
2022-05-10 11:48:55 +02:00
Alexander Tokmakov
92d423c478
print stacks if wa cannot terminate server in stress tests
2022-05-09 19:43:51 +02:00
Alexander Tokmakov
b647f8f9bf
Update run.sh
2022-05-09 17:48:10 +03:00
Alexey Milovidov
419687ac50
Update run.sh
2022-05-09 10:17:49 +02:00
Mikhail f. Shiryaev
b14dca2fac
Improve stress tests report a little bit
2022-05-09 10:17:40 +02:00
alesapin
85dda249b8
Don't download stateful table
2022-05-02 00:11:05 +02:00
alesapin
51345fa25b
Trying stress on top of S3
2022-05-01 19:07:02 +02:00
Kruglov Pavel
4e2b1cd981
Update run.sh
2022-04-20 16:48:54 +02:00
Kruglov Pavel
cd77f927b6
Fix putting logs into test_output
2022-04-20 15:06:09 +02:00
Kruglov Pavel
6bcdf21801
Fix stress test
2022-04-20 13:53:16 +02:00
tavplubix
5f31185125
Update stress
2022-04-14 14:35:46 +03:00
Kruglov Pavel
5b46e9655a
Merge pull request #36067 from ClickHouse/Avogar-patch-4
...
Try to turn off always green backward compatibility checks
2022-04-12 16:20:07 +02:00
tavplubix
ccb45ae943
Update stress
2022-04-12 12:42:45 +03:00
tavplubix
48f9b61bdb
Update stress
2022-04-12 12:22:03 +03:00
tavplubix
f7c17a8e86
Update stress
2022-04-11 18:03:19 +03:00
Kruglov Pavel
eaad99bd48
Try to turn off always green backward compatibility checks
2022-04-08 13:55:10 +02:00
tavplubix
6868223af0
Merge pull request #36026 from ClickHouse/tavplubix-patch-2
...
Fix Backward comapatibility check
2022-04-08 13:10:59 +03:00
Kruglov Pavel
9fa6e6e7df
Make backward compatibility check always green
2022-04-07 17:42:33 +02:00
tavplubix
b32800420c
Update stress
2022-04-07 13:30:11 +03:00
Azat Khuzhin
2fb6d6acb4
stress: use more meaningful names for clickhouse-server.log
...
But note, that stderr.log/stdout.log/clickhouse-server.err.log still not separated.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-06 14:09:53 +03:00
Azat Khuzhin
058cde820f
test/stress: improve error checks for backward compatiblity check
...
Before the log was analyzed only after the server had been restarted
after stressing, and hence it cannot find anything in case of error,
like here [1].
[1]: https://s3.amazonaws.com/clickhouse-test-reports/34355/acd48ebe2d51d20d0c2a5bc545d46d27f9bf7904/stress_test__thread__actions_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-06 14:09:52 +03:00
Alexander Tokmakov
307a2ca579
Merge branch 'master' into zookeeper_client_fault_injection
2022-03-31 15:32:41 +02:00
mergify[bot]
f9a0692e2c
Merge branch 'master' into Avogar-patch-3
2022-03-31 11:45:31 +00:00
alesapin
b838a7dcb0
Remove outdated links from CI
2022-03-28 15:53:22 +02:00
Kruglov Pavel
18ab49e788
Check all logs for crashes, logical errors, etc in backward compatibility check
2022-03-25 11:59:50 +01:00
Kruglov Pavel
5efad9699c
Update run.sh
2022-03-23 11:28:40 +01:00
Kruglov Pavel
8ef2f13524
Update run.sh
2022-03-23 11:26:31 +01:00
Kruglov Pavel
034d92d817
Fix removing empty files
2022-03-22 18:06:35 +01:00
avogar
c5245c1ad1
Improve backward compatibility check and stress test
2022-03-22 12:00:20 +00:00
avogar
288d08f3f2
Add retries in backward compatibility check
2022-03-21 17:26:24 +00:00
Alexander Tokmakov
5c760fd7ce
Merge branch 'master' into zookeeper_client_fault_injection
2022-03-21 11:57:40 +01:00
mergify[bot]
5295dd0ef2
Merge branch 'master' into stress-test
2022-03-17 11:10:37 +00:00
Kruglov Pavel
fa6d963f83
Update run.sh
2022-03-16 12:30:45 +01:00
Kruglov Pavel
6b3a25e20d
Update run.sh
2022-03-15 17:15:17 +01:00
avogar
b9496af3b3
Fix tests
2022-03-14 16:40:17 +00:00
Kruglov Pavel
3d36eced2d
Update run.sh
2022-03-10 17:55:45 +03:00
Kruglov Pavel
91b9c11939
Increase the number of attempts to start server
2022-03-10 14:38:39 +03:00
Kruglov Pavel
0f90996bb8
Update run.sh
2022-03-04 14:24:24 +03:00
Kruglov Pavel
8f6ba99fec
Update run.sh
2022-03-01 15:20:02 +03:00
Kruglov Pavel
6252588922
Update run.sh
2022-02-28 13:33:10 +03:00
kssenii
725f967ac6
Add stress test
2022-02-24 07:54:58 +01:00
Kruglov Pavel
500ed56061
Update docker/test/stress/run.sh
...
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-02-18 16:36:48 +03:00
Kruglov Pavel
de888db506
Update docker/test/stress/stress
...
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-02-18 16:36:38 +03:00
Kruglov Pavel
10c45bef67
Remove clickhouse-test package
2022-02-18 13:03:23 +03:00
Kruglov Pavel
71e7668fa6
Remove downloading clickhouse-test
2022-02-18 13:02:49 +03:00
Kruglov Pavel
74087470c2
Update run.sh
2022-02-18 12:52:56 +03:00
Kruglov Pavel
e77319bf01
Merge branch 'master' into stress-test
2022-02-17 20:28:46 +03:00
Yatsishin Ilya
bbe2c07a7b
remove clickhouse-test deb completely
2022-02-15 12:03:51 +00:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI ( #34517 )
...
* test/fuzzer: preserve core
This may help to capture things like in [1]:
Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)
[1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* test: do not run 'info locals' since 'backtrace full' includes it
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* test: try capture backtrace from all threads
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* test/stress: fix path for core artifacts
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes : #33389
* test/fuzzer: store core file in artifacts
v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-13 15:02:15 +03:00
Kruglov Pavel
e004dae25b
Update run.sh
2022-01-27 18:15:03 +03:00
Kruglov Pavel
b54bf18b27
Merge branch 'master' into stress-test
2022-01-25 14:35:42 +03:00
Kruglov Pavel
d5bde26bc1
Update run.sh
2022-01-20 15:22:00 +03:00
mergify[bot]
e492fe0a0f
Merge branch 'master' into zookeeper_client_fault_injection
2022-01-17 15:26:16 +00:00
alexey-milovidov
438519aeec
Merge pull request #33389 from azat/stress-core-dumps
...
tests/stress: add core dumps into artifacts
2022-01-14 01:26:35 +03:00
Mikhail f. Shiryaev
c465593706
Force rebuild images once again in master
2022-01-13 19:03:34 +01:00
Mikhail f. Shiryaev
e314eed992
Force rebuild images in CI
2022-01-13 17:49:23 +01:00
Mikhail f. Shiryaev
2a83a1c05d
Build dependent images from the current version
2022-01-12 17:07:52 +01:00
Azat Khuzhin
ebed6193b4
tests/stress: add core dumps into artifacts
...
gcore is used here because:
- default kernel.core_pattern is "|/usr/share/apport/apport %p %s %c %d %P %E" [1]
and so to make it work you need to install apport into container and
configure it propertly -- to complex
[1]: https://s3.amazonaws.com/clickhouse-test-reports/33389/204e459d259570e6bc7fe2903f7e516094a916ca/stress_test__address__actions_/runlog.log
- kernel.core_pattern cannot be changed, since proc is mounted in
read-only mode in non --privileged containers [2]
[2]: https://s3.amazonaws.com/clickhouse-test-reports/33389/dab3afbd94558f9654bf0aa1e06e06e2962f3bb0/stress_test__address__actions_/runlog.log
v2: change kernel.core_pattern
v3: use gcore, since you are not allowed to change kernel.core_pattern
in container (only under --privileged)
2022-01-04 14:03:40 +03:00
Kruglov Pavel
ffb6c5b37b
Merge branch 'master' into stress-test
2021-12-23 20:14:15 +03:00
Alexander Tokmakov
bd5931e5af
improve gdb script
2021-12-15 13:21:21 +03:00
Alexander Tokmakov
dfa31a6577
fix
2021-12-10 22:38:34 +03:00
tavplubix
5079134ffd
Update run.sh
2021-12-10 20:10:49 +03:00
Alexander Tokmakov
254d6c5d59
fix
2021-12-10 20:07:28 +03:00
Alexander Tokmakov
3ff8aff1b5
try to fix attaching gdb
2021-12-10 18:03:57 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests ( #32448 )
...
* attach gdb with sudo
* fix
* Update run.sh
2021-12-10 00:12:45 +03:00
Azat Khuzhin
f8bf3b1993
stress: use max_memory_usage_for_user as a soft limit to avoid memory limit exceeded
...
By using max_memory_usage_for_user as a soft limit, and after
max_server_memory_usage as a hard, we can allow normal overcommit, using
max_memory_usage_for_user=0 instead of relying on max_untracked_memory.
2021-12-06 09:05:34 +03:00
Azat Khuzhin
f9a95fce13
stress: allow memory overcommit for SELECT 1 query
2021-12-06 09:02:56 +03:00
Azat Khuzhin
1167313961
stress: allow memory overcommit for one more query
2021-12-06 09:02:56 +03:00
Azat Khuzhin
7063ea3ee2
stress: add make_query_command() helper
2021-12-06 09:02:56 +03:00
Azat Khuzhin
adec690166
stress: SYSTEM DROP MARK CACHE
2021-12-06 09:02:56 +03:00
Azat Khuzhin
d3a7aed005
stress: tune memory_profiler_step too
2021-12-06 09:02:56 +03:00
Azat Khuzhin
169941c5d0
stress: allow 100MiB of memory to overcommit for SHOW/DROP DATABASE
...
CI: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__thread__actions_.html
2021-12-06 09:02:56 +03:00
Azat Khuzhin
445b0983ea
stress: ignore server memory limits for hung check
...
In [1] hung check failed because the server was under memory pressure.
[1]: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__undefined__actions_.html
2021-12-06 09:02:56 +03:00
mergify[bot]
b4f43c59a2
Merge branch 'master' into stress-test
2021-12-01 10:12:22 +00:00
alesapin
b4d4295c16
Followup
2021-11-30 13:24:04 +03:00
alesapin
085a30b98e
Fixup
2021-11-30 13:22:50 +03:00
alesapin
bccd927aec
Make stress tests slightly more stable
2021-11-30 13:19:03 +03:00
mergify[bot]
ae0b5df601
Merge branch 'master' into stress-test
2021-11-26 12:48:03 +00:00
alesapin
3562264404
Merge pull request #31803 from ClickHouse/faster_tests
...
Shorter stress and fuzzer tests
2021-11-26 10:17:26 +03:00
alesapin
5815429059
Shorter stress and fuzzer tests
2021-11-25 17:54:50 +03:00
mergify[bot]
ce0c112586
Merge branch 'master' into stress-test
2021-11-25 11:09:26 +00:00
Kruglov Pavel
18e60919c5
Update run.sh
2021-11-23 16:49:59 +03:00
Azat Khuzhin
d0ecdb617e
Remove duplicated not compressed logs from CI (actions)
...
Right now we cannot remove that compression since non-github actions
check will upload non compressed files then, but once old CI will be
removed it seems to be possible to remove that manual compression.
2021-11-19 21:33:48 +03:00
mergify[bot]
66f7b81b5e
Merge branch 'master' into zookeeper_client_fault_injection
2021-11-17 09:41:12 +00:00
tavplubix
b1079ae309
Update run.sh
2021-11-16 20:03:50 +03:00
tavplubix
224a4c1b6b
Update run.sh
2021-11-16 17:45:37 +03:00
Kruglov Pavel
6180aedab6
Update download_previous_release
2021-11-15 23:16:35 +03:00
Kruglov Pavel
87df3c8272
Fix
2021-11-15 15:03:48 +03:00
Kruglov Pavel
08af98b4a1
Update download_previous_release
2021-11-09 16:34:13 +03:00
Kruglov Pavel
03f1e3c67d
Update run.sh
2021-11-08 14:02:36 +03:00
mergify[bot]
8ef9e61e36
Merge branch 'master' into stress-test
2021-11-03 08:28:43 +00:00
mergify[bot]
063ba2302c
Merge branch 'master' into zookeeper_client_fault_injection
2021-11-02 14:29:35 +00:00
alesapin
dbfa17aabf
Add correct S3
2021-11-01 13:32:56 +03:00
mergify[bot]
d9d9d38e4f
Merge branch 'master' into stress-test
2021-10-27 19:00:31 +00:00
Azat Khuzhin
da90df5658
docker: switch <yandex> to <clickhouse>
2021-10-26 08:53:14 +03:00
Alexander Tokmakov
35b5cb9571
Merge branch 'master' into zookeeper_client_fault_injection
2021-10-25 19:03:37 +03:00
Azat Khuzhin
8f015764a7
Add metadata for *_log into tests artifacts
...
This will allow to use artifacts as-is, i.e.:
clickhouse-local --path /path/to/log/artifact
v2: convert database to Ordinary to avoid extra symlinks dependencies.
2021-10-23 20:17:01 +03:00
Alexander Tokmakov
27ca943863
add fault injection in ZooKeeper client
2021-10-22 18:59:38 +03:00
mergify[bot]
943a1cbba0
Merge branch 'master' into stress-test
2021-10-21 04:41:23 +00:00
alesapin
3ae960e04b
Review fixes
2021-10-11 16:40:12 +03:00
alesapin
9ad919d91a
More timeouts in stress test
2021-10-11 13:25:54 +03:00
Kruglov Pavel
fd7d1131ec
Update run.sh
2021-10-06 13:17:48 +03:00
Kruglov Pavel
31302afe81
Update run.sh
2021-10-04 16:35:50 +03:00
avogar
821daa21da
Update run.sh
2021-10-04 16:35:50 +03:00
Pavel Kruglov
6fc043026e
Update run.sh
2021-10-04 16:35:50 +03:00
Pavel Kruglov
2db11bc6c5
Add backward compatibility check in stress test
2021-10-04 16:34:14 +03:00
tavplubix
8adfb9b593
Stop ThreadFuzzer before hung check ( #29167 )
...
* stop ThreadFuzzer before hung check
* fix
* fix
2021-09-20 17:23:10 +03:00
Vitaly Baranov
bbb192ee85
Convert skip_list.json into first line comments.
2021-09-12 17:15:23 +03:00
alesapin
0eac4529e0
Preparation
2021-09-06 14:33:39 +03:00
mergify[bot]
b81d479de4
Merge branch 'master' into stress-thread-fuzzer
2021-08-31 11:56:30 +00:00
Azat Khuzhin
fb311199ce
test/stress: fix patterns for filtering out Raft messages
2021-08-28 19:21:07 +03:00
alesapin
91995ca3a6
More tries
2021-08-18 17:57:36 +03:00
Alexey Milovidov
7a16f331dc
Enable thread fuzzer in Stress test
2021-08-10 23:49:05 +03:00
tavplubix
888d096ede
Update stress
2021-07-29 16:21:29 +03:00
Alexander Tokmakov
381634960e
fix client options in stress test
2021-07-29 15:16:34 +03:00
Azat Khuzhin
984e9f2f50
test/stress: cleanup tail of log so that it will contain useful messages
2021-07-16 22:39:14 +03:00
Azat Khuzhin
41a5609b81
test/stress: preserve stderr across runs, to preserve errors for final commands
2021-07-16 22:39:14 +03:00
Azat Khuzhin
39a62cc2ef
test/stress: fix sanitizers errors detection
2021-07-16 22:39:14 +03:00
Alexey Milovidov
c28f027b14
Fix error in stress test script
2021-07-15 10:24:35 +03:00
alesapin
32bd94a84b
Merge pull request #25741 from ClickHouse/stress-test-separate-logs
...
Separate log files for separate runs in stress test
2021-06-29 10:47:39 +03:00
alexey-milovidov
350445c5f1
Update run.sh
2021-06-29 01:29:14 +03:00
alexey-milovidov
1703bc91b0
Update run.sh
2021-06-28 16:21:17 +03:00
alexey-milovidov
ee935a3733
Update run.sh
2021-06-28 14:28:49 +03:00
Azat Khuzhin
f00a4668a4
Set follow-fork-mode child for gdb in stress/fasttest/fuzzer
...
Sometimes gdb does not catch SIGSEGV [1], let's try set this setting,
since maybe some code from contrib does fork.
[1]: https://clickhouse-test-reports.s3.yandex.net/25605/cd5a3c8d7eb417f6df211b4507dc970933f8549a/stress_test_(thread).html#fail1
2021-06-28 10:04:08 +03:00
alexey-milovidov
f7663fe6eb
Update run.sh
2021-06-28 00:05:57 +03:00
Alexey Milovidov
45c4b62c3b
Separate log files for separate runs in stress test
2021-06-27 18:41:25 +03:00
vdimir
e24ee509a4
Fix modulo division priority issue in test/stress/stress
2021-06-11 13:08:49 +03:00
vdimir
bf9df90296
Add join related options to stress test
2021-06-11 12:36:59 +03:00
alesapin
aeac53ac78
Update run script
2021-06-03 18:16:12 +03:00
alesapin
329380d6e5
Relaxed hung check in stress test
2021-06-03 18:13:29 +03:00
alesapin
82c90ebc05
Some improvements in stress test
2021-06-01 12:45:01 +03:00
Alexey Milovidov
e9e4ab3813
Less chance of OOM in stress tests
2021-04-24 03:27:23 +03:00
