Alexander Tokmakov
5c24cd979b
Merge pull request #39256 from ClickHouse/bc_check_fix_stacks_in_gdb
...
Fix stacktraces in gdb in BC check
2022-07-15 17:54:18 +03:00
Alexander Tokmakov
77487e996c
fix stacktraces in gdb in bc check
2022-07-15 12:23:28 +02:00
kssenii
15a2d60f23
Fix checks
2022-07-14 22:04:39 +02:00
Alexander Tokmakov
f8e23c1deb
Update run.sh
2022-07-14 17:29:08 +03:00
Alexander Tokmakov
991493e6fc
Update run.sh
2022-07-13 15:22:36 +03:00
Alexander Tokmakov
948f15eff3
Update run.sh
2022-07-12 14:01:53 +03:00
Alexander Tokmakov
2b886ddc2e
Update run.sh
2022-07-08 16:47:54 +03:00
Alexander Tokmakov
57b8a6a542
Update run.sh
2022-07-08 13:53:35 +03:00
Kruglov Pavel
8ffd6cd22c
Merge pull request #38717 from Avogar/improve-bc-check
...
Try to improve backward compatibility check
2022-07-07 18:52:34 +02:00
Kruglov Pavel
a3a94a1c09
Avoid false positive red sanitizer asserts check in stress test
2022-07-06 14:32:17 +02:00
Kruglov Pavel
45ac74617b
Fix
2022-07-04 20:38:21 +02:00
Kruglov Pavel
65dd81586b
Update run.sh
2022-07-04 17:30:22 +02:00
avogar
17da24b584
Try to improve backward compatibility check
2022-07-04 13:02:22 +00:00
Azat Khuzhin
8e9c1eaa73
tests/stress: redirect gdb output on stop hang to gdb.log
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-03 14:46:17 +03:00
Alexander Tokmakov
b238ed4093
fix stress tests
2022-07-01 17:19:00 +02:00
Alexander Tokmakov
3ff26939fc
Update run.sh
2022-06-29 15:46:40 +03:00
Alexander Tokmakov
428628238f
Merge branch 'master' into deprecate_ordinary_database
2022-06-28 15:40:33 +02:00
Kruglov Pavel
25100ad5e5
Merge pull request #38520 from ClickHouse/Avogar-patch-1
...
Fix application errors grep in stress test
2022-06-28 14:26:22 +02:00
Alexander Tokmakov
411512ed6f
Update run.sh
2022-06-28 14:28:06 +03:00
Kruglov Pavel
f7419e0703
Fix application errors grep in stress test
2022-06-28 13:12:21 +02:00
Alexander Tokmakov
dbf2763788
automatically convert system database to Atomic
2022-06-23 21:38:43 +02:00
Azat Khuzhin
dce71bbe06
tests/stress: fix TSan detection
...
+ test -f package_folder/clickhouse-client_22.7.1.1+tsan_all.deb package_folder/clickhouse-common-static-dbg_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-common-static_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-keeper_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-server_22.7.1.1+tsan_all.deb
/run.sh: line 13: test: too many arguments
Follow-up for: #38207 (cc @tavplubix)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 08:10:03 +03:00
Azat Khuzhin
d154288fc6
tests/stress: fix TSan detection (enables thread fuzzer for non-TSan builds)
...
Follow-up for: #38106 (cc @tavplubix @alesapin)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-19 19:27:25 +03:00
alesapin
0ae0cc54aa
Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests
...
Some fixes for tests with tsan
2022-06-18 14:22:43 +02:00
Alexander Tokmakov
3e8aa2dc47
Update run.sh
2022-06-16 13:24:21 +03:00
Alexander Tokmakov
9cac78b498
make tests with tsan less flaky
2022-06-15 19:54:46 +02:00
Mikhail f. Shiryaev
4d45839f17
Generalize setup_minio.sh
...
- Cleanup apt garbage in the container
- Download the same binary in docker and setup_minio.sh
- Use binary and not rpm for minio
- Sort packages in Dockerfile's
2022-06-10 15:04:45 +02:00
Kruglov Pavel
83418ebba2
Merge pull request #37712 from vdimir/duplicate_download_previous_release
...
Get rid of duplicate download_previous_release
2022-06-07 12:51:34 +02:00
Kruglov Pavel
196863ade5
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check
2022-06-02 13:33:27 +02:00
Vladimir C
2622791b9e
upd
2022-06-01 16:17:17 +02:00
mergify[bot]
3866c27850
Merge branch 'master' into stress_s3
2022-06-01 12:02:33 +00:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release
2022-05-31 17:50:29 +00:00
Alexander Tokmakov
c23bc01196
Merge branch 'master' into zookeeper_client_fault_injection
2022-05-11 17:20:42 +02:00
alesapin
af99183950
Disable thread fuzzer after server restart
2022-05-10 15:16:21 +02:00
mergify[bot]
5c742cf2d5
Merge branch 'master' into stress_s3
2022-05-10 12:26:26 +00:00
Alexander Tokmakov
9346c9363a
Merge pull request #37052 from ClickHouse/fix_server_termination_stress_tests
...
Print stacks if we cannot terminate server in stress tests
2022-05-10 13:12:44 +03:00
Alexander Tokmakov
17c954bea7
fix shellcheck
2022-05-10 11:48:55 +02:00
Alexander Tokmakov
92d423c478
print stacks if wa cannot terminate server in stress tests
2022-05-09 19:43:51 +02:00
Alexander Tokmakov
b647f8f9bf
Update run.sh
2022-05-09 17:48:10 +03:00
Alexey Milovidov
419687ac50
Update run.sh
2022-05-09 10:17:49 +02:00
Mikhail f. Shiryaev
b14dca2fac
Improve stress tests report a little bit
2022-05-09 10:17:40 +02:00
alesapin
85dda249b8
Don't download stateful table
2022-05-02 00:11:05 +02:00
alesapin
51345fa25b
Trying stress on top of S3
2022-05-01 19:07:02 +02:00
Kruglov Pavel
4e2b1cd981
Update run.sh
2022-04-20 16:48:54 +02:00
Kruglov Pavel
cd77f927b6
Fix putting logs into test_output
2022-04-20 15:06:09 +02:00
Kruglov Pavel
6bcdf21801
Fix stress test
2022-04-20 13:53:16 +02:00
Kruglov Pavel
eaad99bd48
Try to turn off always green backward compatibility checks
2022-04-08 13:55:10 +02:00
Kruglov Pavel
9fa6e6e7df
Make backward compatibility check always green
2022-04-07 17:42:33 +02:00
Azat Khuzhin
2fb6d6acb4
stress: use more meaningful names for clickhouse-server.log
...
But note, that stderr.log/stdout.log/clickhouse-server.err.log still not separated.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-06 14:09:53 +03:00
Azat Khuzhin
058cde820f
test/stress: improve error checks for backward compatiblity check
...
Before the log was analyzed only after the server had been restarted
after stressing, and hence it cannot find anything in case of error,
like here [1].
[1]: https://s3.amazonaws.com/clickhouse-test-reports/34355/acd48ebe2d51d20d0c2a5bc545d46d27f9bf7904/stress_test__thread__actions_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-06 14:09:52 +03:00
Alexander Tokmakov
307a2ca579
Merge branch 'master' into zookeeper_client_fault_injection
2022-03-31 15:32:41 +02:00
Kruglov Pavel
18ab49e788
Check all logs for crashes, logical errors, etc in backward compatibility check
2022-03-25 11:59:50 +01:00
Kruglov Pavel
5efad9699c
Update run.sh
2022-03-23 11:28:40 +01:00
Kruglov Pavel
8ef2f13524
Update run.sh
2022-03-23 11:26:31 +01:00
Kruglov Pavel
034d92d817
Fix removing empty files
2022-03-22 18:06:35 +01:00
avogar
c5245c1ad1
Improve backward compatibility check and stress test
2022-03-22 12:00:20 +00:00
Alexander Tokmakov
5c760fd7ce
Merge branch 'master' into zookeeper_client_fault_injection
2022-03-21 11:57:40 +01:00
mergify[bot]
5295dd0ef2
Merge branch 'master' into stress-test
2022-03-17 11:10:37 +00:00
Kruglov Pavel
fa6d963f83
Update run.sh
2022-03-16 12:30:45 +01:00
Kruglov Pavel
6b3a25e20d
Update run.sh
2022-03-15 17:15:17 +01:00
avogar
b9496af3b3
Fix tests
2022-03-14 16:40:17 +00:00
Kruglov Pavel
3d36eced2d
Update run.sh
2022-03-10 17:55:45 +03:00
Kruglov Pavel
91b9c11939
Increase the number of attempts to start server
2022-03-10 14:38:39 +03:00
Kruglov Pavel
0f90996bb8
Update run.sh
2022-03-04 14:24:24 +03:00
Kruglov Pavel
8f6ba99fec
Update run.sh
2022-03-01 15:20:02 +03:00
Kruglov Pavel
6252588922
Update run.sh
2022-02-28 13:33:10 +03:00
kssenii
725f967ac6
Add stress test
2022-02-24 07:54:58 +01:00
Kruglov Pavel
500ed56061
Update docker/test/stress/run.sh
...
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-02-18 16:36:48 +03:00
Kruglov Pavel
10c45bef67
Remove clickhouse-test package
2022-02-18 13:03:23 +03:00
Kruglov Pavel
74087470c2
Update run.sh
2022-02-18 12:52:56 +03:00
Kruglov Pavel
e77319bf01
Merge branch 'master' into stress-test
2022-02-17 20:28:46 +03:00
Yatsishin Ilya
bbe2c07a7b
remove clickhouse-test deb completely
2022-02-15 12:03:51 +00:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI ( #34517 )
...
* test/fuzzer: preserve core
This may help to capture things like in [1]:
Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)
[1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* test: do not run 'info locals' since 'backtrace full' includes it
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* test: try capture backtrace from all threads
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* test/stress: fix path for core artifacts
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes : #33389
* test/fuzzer: store core file in artifacts
v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-13 15:02:15 +03:00
Kruglov Pavel
e004dae25b
Update run.sh
2022-01-27 18:15:03 +03:00
Kruglov Pavel
b54bf18b27
Merge branch 'master' into stress-test
2022-01-25 14:35:42 +03:00
Kruglov Pavel
d5bde26bc1
Update run.sh
2022-01-20 15:22:00 +03:00
mergify[bot]
e492fe0a0f
Merge branch 'master' into zookeeper_client_fault_injection
2022-01-17 15:26:16 +00:00
Azat Khuzhin
ebed6193b4
tests/stress: add core dumps into artifacts
...
gcore is used here because:
- default kernel.core_pattern is "|/usr/share/apport/apport %p %s %c %d %P %E" [1]
and so to make it work you need to install apport into container and
configure it propertly -- to complex
[1]: https://s3.amazonaws.com/clickhouse-test-reports/33389/204e459d259570e6bc7fe2903f7e516094a916ca/stress_test__address__actions_/runlog.log
- kernel.core_pattern cannot be changed, since proc is mounted in
read-only mode in non --privileged containers [2]
[2]: https://s3.amazonaws.com/clickhouse-test-reports/33389/dab3afbd94558f9654bf0aa1e06e06e2962f3bb0/stress_test__address__actions_/runlog.log
v2: change kernel.core_pattern
v3: use gcore, since you are not allowed to change kernel.core_pattern
in container (only under --privileged)
2022-01-04 14:03:40 +03:00
Kruglov Pavel
ffb6c5b37b
Merge branch 'master' into stress-test
2021-12-23 20:14:15 +03:00
Alexander Tokmakov
bd5931e5af
improve gdb script
2021-12-15 13:21:21 +03:00
Alexander Tokmakov
dfa31a6577
fix
2021-12-10 22:38:34 +03:00
tavplubix
5079134ffd
Update run.sh
2021-12-10 20:10:49 +03:00
Alexander Tokmakov
254d6c5d59
fix
2021-12-10 20:07:28 +03:00
Alexander Tokmakov
3ff8aff1b5
try to fix attaching gdb
2021-12-10 18:03:57 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests ( #32448 )
...
* attach gdb with sudo
* fix
* Update run.sh
2021-12-10 00:12:45 +03:00
Azat Khuzhin
f8bf3b1993
stress: use max_memory_usage_for_user as a soft limit to avoid memory limit exceeded
...
By using max_memory_usage_for_user as a soft limit, and after
max_server_memory_usage as a hard, we can allow normal overcommit, using
max_memory_usage_for_user=0 instead of relying on max_untracked_memory.
2021-12-06 09:05:34 +03:00
mergify[bot]
b4f43c59a2
Merge branch 'master' into stress-test
2021-12-01 10:12:22 +00:00
alesapin
b4d4295c16
Followup
2021-11-30 13:24:04 +03:00
alesapin
085a30b98e
Fixup
2021-11-30 13:22:50 +03:00
alesapin
bccd927aec
Make stress tests slightly more stable
2021-11-30 13:19:03 +03:00
mergify[bot]
ae0b5df601
Merge branch 'master' into stress-test
2021-11-26 12:48:03 +00:00
mergify[bot]
ce0c112586
Merge branch 'master' into stress-test
2021-11-25 11:09:26 +00:00
Kruglov Pavel
18e60919c5
Update run.sh
2021-11-23 16:49:59 +03:00
Azat Khuzhin
d0ecdb617e
Remove duplicated not compressed logs from CI (actions)
...
Right now we cannot remove that compression since non-github actions
check will upload non compressed files then, but once old CI will be
removed it seems to be possible to remove that manual compression.
2021-11-19 21:33:48 +03:00
mergify[bot]
66f7b81b5e
Merge branch 'master' into zookeeper_client_fault_injection
2021-11-17 09:41:12 +00:00
tavplubix
b1079ae309
Update run.sh
2021-11-16 20:03:50 +03:00
tavplubix
224a4c1b6b
Update run.sh
2021-11-16 17:45:37 +03:00
Kruglov Pavel
03f1e3c67d
Update run.sh
2021-11-08 14:02:36 +03:00
mergify[bot]
8ef9e61e36
Merge branch 'master' into stress-test
2021-11-03 08:28:43 +00:00
mergify[bot]
063ba2302c
Merge branch 'master' into zookeeper_client_fault_injection
2021-11-02 14:29:35 +00:00
alesapin
dbfa17aabf
Add correct S3
2021-11-01 13:32:56 +03:00
mergify[bot]
d9d9d38e4f
Merge branch 'master' into stress-test
2021-10-27 19:00:31 +00:00
Azat Khuzhin
da90df5658
docker: switch <yandex> to <clickhouse>
2021-10-26 08:53:14 +03:00
Alexander Tokmakov
35b5cb9571
Merge branch 'master' into zookeeper_client_fault_injection
2021-10-25 19:03:37 +03:00
Azat Khuzhin
8f015764a7
Add metadata for *_log into tests artifacts
...
This will allow to use artifacts as-is, i.e.:
clickhouse-local --path /path/to/log/artifact
v2: convert database to Ordinary to avoid extra symlinks dependencies.
2021-10-23 20:17:01 +03:00
Alexander Tokmakov
27ca943863
add fault injection in ZooKeeper client
2021-10-22 18:59:38 +03:00
Kruglov Pavel
fd7d1131ec
Update run.sh
2021-10-06 13:17:48 +03:00
Kruglov Pavel
31302afe81
Update run.sh
2021-10-04 16:35:50 +03:00
avogar
821daa21da
Update run.sh
2021-10-04 16:35:50 +03:00
Pavel Kruglov
6fc043026e
Update run.sh
2021-10-04 16:35:50 +03:00
Pavel Kruglov
2db11bc6c5
Add backward compatibility check in stress test
2021-10-04 16:34:14 +03:00
mergify[bot]
b81d479de4
Merge branch 'master' into stress-thread-fuzzer
2021-08-31 11:56:30 +00:00
Azat Khuzhin
fb311199ce
test/stress: fix patterns for filtering out Raft messages
2021-08-28 19:21:07 +03:00
alesapin
91995ca3a6
More tries
2021-08-18 17:57:36 +03:00
Alexey Milovidov
7a16f331dc
Enable thread fuzzer in Stress test
2021-08-10 23:49:05 +03:00
Azat Khuzhin
984e9f2f50
test/stress: cleanup tail of log so that it will contain useful messages
2021-07-16 22:39:14 +03:00
Azat Khuzhin
41a5609b81
test/stress: preserve stderr across runs, to preserve errors for final commands
2021-07-16 22:39:14 +03:00
Azat Khuzhin
39a62cc2ef
test/stress: fix sanitizers errors detection
2021-07-16 22:39:14 +03:00
Alexey Milovidov
c28f027b14
Fix error in stress test script
2021-07-15 10:24:35 +03:00
alesapin
32bd94a84b
Merge pull request #25741 from ClickHouse/stress-test-separate-logs
...
Separate log files for separate runs in stress test
2021-06-29 10:47:39 +03:00
alexey-milovidov
350445c5f1
Update run.sh
2021-06-29 01:29:14 +03:00
alexey-milovidov
1703bc91b0
Update run.sh
2021-06-28 16:21:17 +03:00
alexey-milovidov
ee935a3733
Update run.sh
2021-06-28 14:28:49 +03:00
Azat Khuzhin
f00a4668a4
Set follow-fork-mode child for gdb in stress/fasttest/fuzzer
...
Sometimes gdb does not catch SIGSEGV [1], let's try set this setting,
since maybe some code from contrib does fork.
[1]: https://clickhouse-test-reports.s3.yandex.net/25605/cd5a3c8d7eb417f6df211b4507dc970933f8549a/stress_test_(thread).html#fail1
2021-06-28 10:04:08 +03:00
alexey-milovidov
f7663fe6eb
Update run.sh
2021-06-28 00:05:57 +03:00
Alexey Milovidov
45c4b62c3b
Separate log files for separate runs in stress test
2021-06-27 18:41:25 +03:00
alesapin
aeac53ac78
Update run script
2021-06-03 18:16:12 +03:00
Alexey Milovidov
e9e4ab3813
Less chance of OOM in stress tests
2021-04-24 03:27:23 +03:00
Azat Khuzhin
2575d03a33
Add trace_log into stateless/stress test artifacts
2021-04-20 08:03:29 +03:00
Alexey Milovidov
a674188d39
Better diagnostics for OOM in stress test
2021-04-09 09:39:25 +03:00
Alexander Tokmakov
d7c43291b1
improve hung check in stress test
2021-03-15 17:23:04 +03:00
tavplubix
2acbfd834a
Merge branch 'master' into stress_test_results
2021-03-12 12:11:33 +03:00
alesapin
b2c12f3762
Upload coordination log after stress test
2021-03-07 17:44:30 +03:00
alesapin
76e10a4fb1
Missed files for tests
2021-03-03 23:05:33 +03:00
alesapin
56d9d99d1c
Fix style and bayan
2021-02-26 09:59:40 +03:00
alesapin
84102a22e7
Trying to make testkeeper better in single server mode
2021-02-25 23:30:55 +03:00
Alexander Tokmakov
fbbb0c4b69
fix
2021-02-25 19:11:43 +03:00
Alexander Tokmakov
487b162343
fix
2021-02-22 16:53:43 +03:00
Alexander Tokmakov
6d9990f378
Merge branch 'stress_test_results' of https://github.com/ClickHouse/ClickHouse into stress_test_results
2021-02-20 19:28:36 +03:00
Alexander Tokmakov
694d89ad81
fix
2021-02-20 19:27:04 +03:00
Alexander Tokmakov
b62a29728f
Merge branch 'master' into stress_test_results
2021-02-20 16:22:43 +03:00
tavplubix
f5fc082ed0
Update run.sh
2021-02-19 22:39:42 +03:00
Alexander Tokmakov
4493c39bf7
fix
2021-02-19 12:57:09 +03:00
Alexander Tokmakov
afed8a8192
process stress test results
2021-02-19 01:08:44 +03:00
Azat Khuzhin
770c3406df
test/stress: fix permissions for clickhouse directories
2021-02-18 00:13:03 +03:00
Azat Khuzhin
63eff6e8c8
test/stress: improve backtrace catching on server failures
...
Otherwise sometimes stracktraces may be lost [1]:
[1]: https://clickhouse-test-reports.s3.yandex.net/19580/6aecb62416ece880cbb8ee3a803e14d841388dde/stress_test_(thread).html#fail1
2021-02-18 00:13:03 +03:00
Azat Khuzhin
f483cd091a
test/stress: use clickhouse builtin start/stop to run server from the same user
...
This will allow to attach with gdb for better diagnosis.
2021-02-18 00:13:03 +03:00
tavplubix
dd02106a08
Update run.sh
2021-02-17 12:01:41 +03:00
Alexander Tokmakov
6c9771484b
add hung check to stress test
2021-02-16 22:39:25 +03:00
tavplubix
eb483fc72f
Update run.sh
2020-10-16 20:31:05 +03:00
Alexander Kuzmenkov
d0dff5b738
fixes
2020-10-01 12:27:05 +03:00
Alexander Kuzmenkov
499e0766e5
Check docker scripts with shellcheck
2020-09-30 20:06:46 +03:00
alesapin
fff9e5d592
Merge branch 'master' into azat-symbolizers-settings-for-non-server
2020-09-28 12:31:05 +03:00
alesapin
bb8a2e1617
Better clickhouse-configs
2020-09-24 11:18:36 +03:00
Azat Khuzhin
3fd85430f2
Set sanitizers options in the current shell too
...
/etc/environment will not be read in current shell, so export variables
from that file manually, to make clickhouse-local/clickhouse-client use
them too.
2020-09-21 23:57:45 +03:00
alesapin
27613f8346
Fix symbolizers path in test images
2020-09-21 10:38:11 +03:00
Alexey Milovidov
d44982072c
More robust
2020-08-24 03:14:24 +03:00
Alexey Milovidov
1fb4294cdf
Attempt to fix stress test
2020-08-24 00:13:21 +03:00
Alexey Milovidov
f4bf99fadc
Better output of stress test
2020-08-23 23:48:27 +03:00
tavplubix
d95470f7c3
Update docker/test/stress/run.sh
2020-08-18 20:52:54 +03:00
Nikita Mikhaylov
e7f8c0af52
done
2020-08-18 15:28:38 +03:00
alexey-milovidov
3e6acf1329
Experiment with start/stop in stress test ( #13779 )
...
* Experiment with start/stop in stress test
* Support other installation options in "clickhouse start"
* Better diagnostics in install script
* Fixup
* Fixup
* Better diagnostics in stress test
* Update run.sh
2020-08-18 12:43:02 +03:00
alesapin
bd0322421b
Better timeout
2020-08-04 17:28:35 +03:00
alesapin
caf0bcdc86
More timeouts
2020-08-04 11:48:47 +03:00
alesapin
ee5153bbc4
Restart server in stress test with timeout
2020-08-04 11:47:20 +03:00
alesapin
a061418dab
Remove redundant cmd
2020-07-15 12:23:50 +03:00
alesapin
c483de8a35
Check result in separate file
2020-07-14 18:00:24 +03:00
alesapin
c400048a48
Check server able to restart in stateless tests
2020-07-14 17:47:23 +03:00
