Commit Graph

451 Commits

Author SHA1 Message Date
Alexander Tokmakov
3ff26939fc
Update run.sh 2022-06-29 15:46:40 +03:00
Alexander Tokmakov
428628238f Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:40:33 +02:00
Kruglov Pavel
25100ad5e5
Merge pull request #38520 from ClickHouse/Avogar-patch-1
Fix application errors grep in stress test
2022-06-28 14:26:22 +02:00
Alexander Tokmakov
411512ed6f
Update run.sh 2022-06-28 14:28:06 +03:00
Kruglov Pavel
f7419e0703
Fix application errors grep in stress test 2022-06-28 13:12:21 +02:00
Alexander Tokmakov
dbf2763788 automatically convert system database to Atomic 2022-06-23 21:38:43 +02:00
Alexander Tokmakov
b5a977ad54
Merge pull request #38213 from azat/stress-thread-fuzzer-v2
tests/stress: fix TSan detection
2022-06-20 16:46:31 +03:00
Azat Khuzhin
dce71bbe06 tests/stress: fix TSan detection
+ test -f package_folder/clickhouse-client_22.7.1.1+tsan_all.deb package_folder/clickhouse-common-static-dbg_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-common-static_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-keeper_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-server_22.7.1.1+tsan_all.deb
    /run.sh: line 13: test: too many arguments

Follow-up for: #38207 (cc @tavplubix)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 08:10:03 +03:00
Azat Khuzhin
e307a728ca tests: add no-stress tag
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
e79c24deda docker/test/stress/stress: apply black
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
d154288fc6 tests/stress: fix TSan detection (enables thread fuzzer for non-TSan builds)
Follow-up for: #38106 (cc @tavplubix @alesapin)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-19 19:27:25 +03:00
alesapin
0ae0cc54aa
Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests
Some fixes for tests with tsan
2022-06-18 14:22:43 +02:00
Alexander Tokmakov
3e8aa2dc47
Update run.sh 2022-06-16 13:24:21 +03:00
Alexander Tokmakov
9cac78b498 make tests with tsan less flaky 2022-06-15 19:54:46 +02:00
Mikhail f. Shiryaev
4d45839f17
Generalize setup_minio.sh
- Cleanup apt garbage in the container
- Download the same binary in docker and setup_minio.sh
- Use binary and not rpm for minio
- Sort packages in Dockerfile's
2022-06-10 15:04:45 +02:00
Kruglov Pavel
83418ebba2
Merge pull request #37712 from vdimir/duplicate_download_previous_release
Get rid of duplicate download_previous_release
2022-06-07 12:51:34 +02:00
Kruglov Pavel
196863ade5
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check 2022-06-02 13:33:27 +02:00
Vladimir C
2622791b9e
upd 2022-06-01 16:17:17 +02:00
mergify[bot]
3866c27850
Merge branch 'master' into stress_s3 2022-06-01 12:02:33 +00:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release 2022-05-31 17:50:29 +00:00
vdimir
6d2fab49f4
Add join_algorithm='parallel_hash' to stress test 2022-05-23 10:18:22 +02:00
Alexander Tokmakov
425b31ba1b
Update stress 2022-05-12 15:04:12 +03:00
Alexander Tokmakov
c23bc01196 Merge branch 'master' into zookeeper_client_fault_injection 2022-05-11 17:20:42 +02:00
alesapin
af99183950 Disable thread fuzzer after server restart 2022-05-10 15:16:21 +02:00
mergify[bot]
5c742cf2d5
Merge branch 'master' into stress_s3 2022-05-10 12:26:26 +00:00
Alexander Tokmakov
9346c9363a
Merge pull request #37052 from ClickHouse/fix_server_termination_stress_tests
Print stacks if we cannot terminate server in stress tests
2022-05-10 13:12:44 +03:00
Alexander Tokmakov
17c954bea7 fix shellcheck 2022-05-10 11:48:55 +02:00
Alexander Tokmakov
92d423c478 print stacks if wa cannot terminate server in stress tests 2022-05-09 19:43:51 +02:00
Alexander Tokmakov
b647f8f9bf
Update run.sh 2022-05-09 17:48:10 +03:00
Alexey Milovidov
419687ac50
Update run.sh 2022-05-09 10:17:49 +02:00
Mikhail f. Shiryaev
b14dca2fac
Improve stress tests report a little bit 2022-05-09 10:17:40 +02:00
alesapin
85dda249b8 Don't download stateful table 2022-05-02 00:11:05 +02:00
alesapin
51345fa25b Trying stress on top of S3 2022-05-01 19:07:02 +02:00
Kruglov Pavel
4e2b1cd981
Update run.sh 2022-04-20 16:48:54 +02:00
Kruglov Pavel
cd77f927b6
Fix putting logs into test_output 2022-04-20 15:06:09 +02:00
Kruglov Pavel
6bcdf21801
Fix stress test 2022-04-20 13:53:16 +02:00
tavplubix
5f31185125
Update stress 2022-04-14 14:35:46 +03:00
Kruglov Pavel
5b46e9655a
Merge pull request #36067 from ClickHouse/Avogar-patch-4
Try to turn off always green backward compatibility checks
2022-04-12 16:20:07 +02:00
tavplubix
ccb45ae943
Update stress 2022-04-12 12:42:45 +03:00
tavplubix
48f9b61bdb
Update stress 2022-04-12 12:22:03 +03:00
tavplubix
f7c17a8e86
Update stress 2022-04-11 18:03:19 +03:00
Kruglov Pavel
eaad99bd48
Try to turn off always green backward compatibility checks 2022-04-08 13:55:10 +02:00
tavplubix
6868223af0
Merge pull request #36026 from ClickHouse/tavplubix-patch-2
Fix Backward comapatibility check
2022-04-08 13:10:59 +03:00
Kruglov Pavel
9fa6e6e7df
Make backward compatibility check always green 2022-04-07 17:42:33 +02:00
tavplubix
b32800420c
Update stress 2022-04-07 13:30:11 +03:00
Azat Khuzhin
2fb6d6acb4 stress: use more meaningful names for clickhouse-server.log
But note, that stderr.log/stdout.log/clickhouse-server.err.log still not separated.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-06 14:09:53 +03:00
Azat Khuzhin
058cde820f test/stress: improve error checks for backward compatiblity check
Before the log was analyzed only after the server had been restarted
after stressing, and hence it cannot find anything in case of error,
like here [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/34355/acd48ebe2d51d20d0c2a5bc545d46d27f9bf7904/stress_test__thread__actions_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-06 14:09:52 +03:00
Alexander Tokmakov
307a2ca579 Merge branch 'master' into zookeeper_client_fault_injection 2022-03-31 15:32:41 +02:00
mergify[bot]
f9a0692e2c
Merge branch 'master' into Avogar-patch-3 2022-03-31 11:45:31 +00:00
alesapin
b838a7dcb0 Remove outdated links from CI 2022-03-28 15:53:22 +02:00
Kruglov Pavel
18ab49e788
Check all logs for crashes, logical errors, etc in backward compatibility check 2022-03-25 11:59:50 +01:00
Kruglov Pavel
5efad9699c
Update run.sh 2022-03-23 11:28:40 +01:00
Kruglov Pavel
8ef2f13524
Update run.sh 2022-03-23 11:26:31 +01:00
Kruglov Pavel
034d92d817
Fix removing empty files 2022-03-22 18:06:35 +01:00
avogar
c5245c1ad1 Improve backward compatibility check and stress test 2022-03-22 12:00:20 +00:00
avogar
288d08f3f2 Add retries in backward compatibility check 2022-03-21 17:26:24 +00:00
Alexander Tokmakov
5c760fd7ce Merge branch 'master' into zookeeper_client_fault_injection 2022-03-21 11:57:40 +01:00
mergify[bot]
5295dd0ef2
Merge branch 'master' into stress-test 2022-03-17 11:10:37 +00:00
Kruglov Pavel
fa6d963f83
Update run.sh 2022-03-16 12:30:45 +01:00
Kruglov Pavel
6b3a25e20d
Update run.sh 2022-03-15 17:15:17 +01:00
avogar
b9496af3b3 Fix tests 2022-03-14 16:40:17 +00:00
Kruglov Pavel
3d36eced2d
Update run.sh 2022-03-10 17:55:45 +03:00
Kruglov Pavel
91b9c11939
Increase the number of attempts to start server 2022-03-10 14:38:39 +03:00
Kruglov Pavel
0f90996bb8
Update run.sh 2022-03-04 14:24:24 +03:00
Kruglov Pavel
8f6ba99fec
Update run.sh 2022-03-01 15:20:02 +03:00
Kruglov Pavel
6252588922
Update run.sh 2022-02-28 13:33:10 +03:00
kssenii
725f967ac6 Add stress test 2022-02-24 07:54:58 +01:00
Kruglov Pavel
500ed56061
Update docker/test/stress/run.sh
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-02-18 16:36:48 +03:00
Kruglov Pavel
de888db506
Update docker/test/stress/stress
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-02-18 16:36:38 +03:00
Kruglov Pavel
10c45bef67
Remove clickhouse-test package 2022-02-18 13:03:23 +03:00
Kruglov Pavel
71e7668fa6
Remove downloading clickhouse-test 2022-02-18 13:02:49 +03:00
Kruglov Pavel
74087470c2
Update run.sh 2022-02-18 12:52:56 +03:00
Kruglov Pavel
e77319bf01
Merge branch 'master' into stress-test 2022-02-17 20:28:46 +03:00
Yatsishin Ilya
bbe2c07a7b remove clickhouse-test deb completely 2022-02-15 12:03:51 +00:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI (#34517)
* test/fuzzer: preserve core

This may help to capture things like in [1]:

    Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: do not run 'info locals' since 'backtrace full' includes it

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: try capture backtrace from all threads

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test/stress: fix path for core artifacts

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes: #33389

* test/fuzzer: store core file in artifacts

v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-13 15:02:15 +03:00
Kruglov Pavel
e004dae25b
Update run.sh 2022-01-27 18:15:03 +03:00
Kruglov Pavel
b54bf18b27
Merge branch 'master' into stress-test 2022-01-25 14:35:42 +03:00
Kruglov Pavel
d5bde26bc1
Update run.sh 2022-01-20 15:22:00 +03:00
mergify[bot]
e492fe0a0f
Merge branch 'master' into zookeeper_client_fault_injection 2022-01-17 15:26:16 +00:00
alexey-milovidov
438519aeec
Merge pull request #33389 from azat/stress-core-dumps
tests/stress: add core dumps into artifacts
2022-01-14 01:26:35 +03:00
Mikhail f. Shiryaev
c465593706
Force rebuild images once again in master 2022-01-13 19:03:34 +01:00
Mikhail f. Shiryaev
e314eed992
Force rebuild images in CI 2022-01-13 17:49:23 +01:00
Mikhail f. Shiryaev
2a83a1c05d
Build dependent images from the current version 2022-01-12 17:07:52 +01:00
Azat Khuzhin
ebed6193b4 tests/stress: add core dumps into artifacts
gcore is used here because:

- default kernel.core_pattern is "|/usr/share/apport/apport %p %s %c %d %P %E" [1]
  and so to make it work you need to install apport into container and
  configure it propertly -- to complex

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33389/204e459d259570e6bc7fe2903f7e516094a916ca/stress_test__address__actions_/runlog.log

- kernel.core_pattern cannot be changed, since proc is mounted in
  read-only mode in non --privileged containers [2]

  [2]: https://s3.amazonaws.com/clickhouse-test-reports/33389/dab3afbd94558f9654bf0aa1e06e06e2962f3bb0/stress_test__address__actions_/runlog.log

v2: change kernel.core_pattern
v3: use gcore, since you are not allowed to change kernel.core_pattern
    in container (only under --privileged)
2022-01-04 14:03:40 +03:00
Kruglov Pavel
ffb6c5b37b
Merge branch 'master' into stress-test 2021-12-23 20:14:15 +03:00
Alexander Tokmakov
bd5931e5af improve gdb script 2021-12-15 13:21:21 +03:00
Alexander Tokmakov
dfa31a6577 fix 2021-12-10 22:38:34 +03:00
tavplubix
5079134ffd
Update run.sh 2021-12-10 20:10:49 +03:00
Alexander Tokmakov
254d6c5d59 fix 2021-12-10 20:07:28 +03:00
Alexander Tokmakov
3ff8aff1b5 try to fix attaching gdb 2021-12-10 18:03:57 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests (#32448)
* attach gdb with sudo

* fix

* Update run.sh
2021-12-10 00:12:45 +03:00
Azat Khuzhin
f8bf3b1993 stress: use max_memory_usage_for_user as a soft limit to avoid memory limit exceeded
By using max_memory_usage_for_user as a soft limit, and after
max_server_memory_usage as a hard, we can allow normal overcommit, using
max_memory_usage_for_user=0 instead of relying on max_untracked_memory.
2021-12-06 09:05:34 +03:00
Azat Khuzhin
f9a95fce13 stress: allow memory overcommit for SELECT 1 query 2021-12-06 09:02:56 +03:00
Azat Khuzhin
1167313961 stress: allow memory overcommit for one more query 2021-12-06 09:02:56 +03:00
Azat Khuzhin
7063ea3ee2 stress: add make_query_command() helper 2021-12-06 09:02:56 +03:00
Azat Khuzhin
adec690166 stress: SYSTEM DROP MARK CACHE 2021-12-06 09:02:56 +03:00
Azat Khuzhin
d3a7aed005 stress: tune memory_profiler_step too 2021-12-06 09:02:56 +03:00
Azat Khuzhin
169941c5d0 stress: allow 100MiB of memory to overcommit for SHOW/DROP DATABASE
CI: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__thread__actions_.html
2021-12-06 09:02:56 +03:00
Azat Khuzhin
445b0983ea stress: ignore server memory limits for hung check
In [1] hung check failed because the server was under memory pressure.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__undefined__actions_.html
2021-12-06 09:02:56 +03:00
mergify[bot]
b4f43c59a2
Merge branch 'master' into stress-test 2021-12-01 10:12:22 +00:00
alesapin
b4d4295c16 Followup 2021-11-30 13:24:04 +03:00
alesapin
085a30b98e Fixup 2021-11-30 13:22:50 +03:00
alesapin
bccd927aec Make stress tests slightly more stable 2021-11-30 13:19:03 +03:00
mergify[bot]
ae0b5df601
Merge branch 'master' into stress-test 2021-11-26 12:48:03 +00:00
alesapin
3562264404
Merge pull request #31803 from ClickHouse/faster_tests
Shorter stress and fuzzer tests
2021-11-26 10:17:26 +03:00
alesapin
5815429059 Shorter stress and fuzzer tests 2021-11-25 17:54:50 +03:00
mergify[bot]
ce0c112586
Merge branch 'master' into stress-test 2021-11-25 11:09:26 +00:00
Kruglov Pavel
18e60919c5
Update run.sh 2021-11-23 16:49:59 +03:00
Azat Khuzhin
d0ecdb617e Remove duplicated not compressed logs from CI (actions)
Right now we cannot remove that compression since non-github actions
check will upload non compressed files then, but once old CI will be
removed it seems to be possible to remove that manual compression.
2021-11-19 21:33:48 +03:00
mergify[bot]
66f7b81b5e
Merge branch 'master' into zookeeper_client_fault_injection 2021-11-17 09:41:12 +00:00
tavplubix
b1079ae309
Update run.sh 2021-11-16 20:03:50 +03:00
tavplubix
224a4c1b6b
Update run.sh 2021-11-16 17:45:37 +03:00
Kruglov Pavel
6180aedab6
Update download_previous_release 2021-11-15 23:16:35 +03:00
Kruglov Pavel
87df3c8272
Fix 2021-11-15 15:03:48 +03:00
Kruglov Pavel
08af98b4a1
Update download_previous_release 2021-11-09 16:34:13 +03:00
Kruglov Pavel
03f1e3c67d
Update run.sh 2021-11-08 14:02:36 +03:00
mergify[bot]
8ef9e61e36
Merge branch 'master' into stress-test 2021-11-03 08:28:43 +00:00
mergify[bot]
063ba2302c
Merge branch 'master' into zookeeper_client_fault_injection 2021-11-02 14:29:35 +00:00
alesapin
dbfa17aabf Add correct S3 2021-11-01 13:32:56 +03:00
mergify[bot]
d9d9d38e4f
Merge branch 'master' into stress-test 2021-10-27 19:00:31 +00:00
Azat Khuzhin
da90df5658 docker: switch <yandex> to <clickhouse> 2021-10-26 08:53:14 +03:00
Alexander Tokmakov
35b5cb9571 Merge branch 'master' into zookeeper_client_fault_injection 2021-10-25 19:03:37 +03:00
Azat Khuzhin
8f015764a7 Add metadata for *_log into tests artifacts
This will allow to use artifacts as-is, i.e.:

    clickhouse-local --path /path/to/log/artifact

v2: convert database to Ordinary to avoid extra symlinks dependencies.
2021-10-23 20:17:01 +03:00
Alexander Tokmakov
27ca943863 add fault injection in ZooKeeper client 2021-10-22 18:59:38 +03:00
mergify[bot]
943a1cbba0
Merge branch 'master' into stress-test 2021-10-21 04:41:23 +00:00
alesapin
3ae960e04b Review fixes 2021-10-11 16:40:12 +03:00
alesapin
9ad919d91a More timeouts in stress test 2021-10-11 13:25:54 +03:00
Kruglov Pavel
fd7d1131ec
Update run.sh 2021-10-06 13:17:48 +03:00
Kruglov Pavel
31302afe81 Update run.sh 2021-10-04 16:35:50 +03:00
avogar
821daa21da Update run.sh 2021-10-04 16:35:50 +03:00
Pavel Kruglov
6fc043026e Update run.sh 2021-10-04 16:35:50 +03:00
Pavel Kruglov
2db11bc6c5 Add backward compatibility check in stress test 2021-10-04 16:34:14 +03:00
tavplubix
8adfb9b593
Stop ThreadFuzzer before hung check (#29167)
* stop ThreadFuzzer before hung check

* fix

* fix
2021-09-20 17:23:10 +03:00
Vitaly Baranov
bbb192ee85 Convert skip_list.json into first line comments. 2021-09-12 17:15:23 +03:00
alesapin
0eac4529e0 Preparation 2021-09-06 14:33:39 +03:00
mergify[bot]
b81d479de4
Merge branch 'master' into stress-thread-fuzzer 2021-08-31 11:56:30 +00:00
Azat Khuzhin
fb311199ce test/stress: fix patterns for filtering out Raft messages 2021-08-28 19:21:07 +03:00
alesapin
91995ca3a6 More tries 2021-08-18 17:57:36 +03:00
Alexey Milovidov
7a16f331dc Enable thread fuzzer in Stress test 2021-08-10 23:49:05 +03:00
tavplubix
888d096ede
Update stress 2021-07-29 16:21:29 +03:00
Alexander Tokmakov
381634960e fix client options in stress test 2021-07-29 15:16:34 +03:00
Azat Khuzhin
984e9f2f50 test/stress: cleanup tail of log so that it will contain useful messages 2021-07-16 22:39:14 +03:00
Azat Khuzhin
41a5609b81 test/stress: preserve stderr across runs, to preserve errors for final commands 2021-07-16 22:39:14 +03:00
Azat Khuzhin
39a62cc2ef test/stress: fix sanitizers errors detection 2021-07-16 22:39:14 +03:00
Alexey Milovidov
c28f027b14 Fix error in stress test script 2021-07-15 10:24:35 +03:00
alesapin
32bd94a84b
Merge pull request #25741 from ClickHouse/stress-test-separate-logs
Separate log files for separate runs in stress test
2021-06-29 10:47:39 +03:00
alexey-milovidov
350445c5f1
Update run.sh 2021-06-29 01:29:14 +03:00
alexey-milovidov
1703bc91b0
Update run.sh 2021-06-28 16:21:17 +03:00
alexey-milovidov
ee935a3733
Update run.sh 2021-06-28 14:28:49 +03:00
Azat Khuzhin
f00a4668a4 Set follow-fork-mode child for gdb in stress/fasttest/fuzzer
Sometimes gdb does not catch SIGSEGV [1], let's try set this setting,
since maybe some code from contrib does fork.

  [1]: https://clickhouse-test-reports.s3.yandex.net/25605/cd5a3c8d7eb417f6df211b4507dc970933f8549a/stress_test_(thread).html#fail1
2021-06-28 10:04:08 +03:00
alexey-milovidov
f7663fe6eb
Update run.sh 2021-06-28 00:05:57 +03:00
Alexey Milovidov
45c4b62c3b Separate log files for separate runs in stress test 2021-06-27 18:41:25 +03:00
vdimir
e24ee509a4
Fix modulo division priority issue in test/stress/stress 2021-06-11 13:08:49 +03:00
vdimir
bf9df90296
Add join related options to stress test 2021-06-11 12:36:59 +03:00
alesapin
aeac53ac78 Update run script 2021-06-03 18:16:12 +03:00
alesapin
329380d6e5 Relaxed hung check in stress test 2021-06-03 18:13:29 +03:00
alesapin
82c90ebc05 Some improvements in stress test 2021-06-01 12:45:01 +03:00
Alexey Milovidov
e9e4ab3813 Less chance of OOM in stress tests 2021-04-24 03:27:23 +03:00
Azat Khuzhin
2575d03a33 Add trace_log into stateless/stress test artifacts 2021-04-20 08:03:29 +03:00
Alexander Tokmakov
0739dde734 improve hung check 2021-04-13 16:45:08 +03:00
Alexey Milovidov
a674188d39 Better diagnostics for OOM in stress test 2021-04-09 09:39:25 +03:00
Alexander Tokmakov
d7c43291b1 improve hung check in stress test 2021-03-15 17:23:04 +03:00
tavplubix
2acbfd834a
Merge branch 'master' into stress_test_results 2021-03-12 12:11:33 +03:00
alesapin
b2c12f3762 Upload coordination log after stress test 2021-03-07 17:44:30 +03:00
alesapin
76e10a4fb1 Missed files for tests 2021-03-03 23:05:33 +03:00
alesapin
56d9d99d1c Fix style and bayan 2021-02-26 09:59:40 +03:00
Alexander Tokmakov
d46fee0f04 Merge branch 'master' into stress_test_results 2021-02-26 00:24:22 +03:00
alesapin
84102a22e7 Trying to make testkeeper better in single server mode 2021-02-25 23:30:55 +03:00
Alexander Tokmakov
fbbb0c4b69 fix 2021-02-25 19:11:43 +03:00
Alexander Tokmakov
3632c1d879 add flacky check runner 2021-02-24 19:41:44 +03:00
Alexander Tokmakov
487b162343 fix 2021-02-22 16:53:43 +03:00
Alexander Tokmakov
eaed15b5e1 process result of func and unit tests 2021-02-20 23:04:24 +03:00
tavplubix
a697b578bc
Merge pull request #16193 from ClickHouse/database_replicated
DatabaseReplicated: continuation of #10485
2021-02-20 19:39:34 +03:00
Alexander Tokmakov
6d9990f378 Merge branch 'stress_test_results' of https://github.com/ClickHouse/ClickHouse into stress_test_results 2021-02-20 19:28:36 +03:00
Alexander Tokmakov
694d89ad81 fix 2021-02-20 19:27:04 +03:00
Alexander Tokmakov
b62a29728f Merge branch 'master' into stress_test_results 2021-02-20 16:22:43 +03:00
tavplubix
f5fc082ed0
Update run.sh 2021-02-19 22:39:42 +03:00
Alexander Tokmakov
033f55f498 fix 2021-02-19 17:38:20 +03:00
Alexander Tokmakov
4493c39bf7 fix 2021-02-19 12:57:09 +03:00
Alexander Tokmakov
afed8a8192 process stress test results 2021-02-19 01:08:44 +03:00
Alexander Tokmakov
8097532cb7 Merge branch 'master' into database_replicated 2021-02-18 17:42:06 +03:00
Azat Khuzhin
770c3406df test/stress: fix permissions for clickhouse directories 2021-02-18 00:13:03 +03:00
Azat Khuzhin
63eff6e8c8 test/stress: improve backtrace catching on server failures
Otherwise sometimes stracktraces may be lost [1]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/19580/6aecb62416ece880cbb8ee3a803e14d841388dde/stress_test_(thread).html#fail1
2021-02-18 00:13:03 +03:00
Azat Khuzhin
f483cd091a test/stress: use clickhouse builtin start/stop to run server from the same user
This will allow to attach with gdb for better diagnosis.
2021-02-18 00:13:03 +03:00
tavplubix
dd02106a08
Update run.sh 2021-02-17 12:01:41 +03:00
Alexander Tokmakov
6c9771484b add hung check to stress test 2021-02-16 22:39:25 +03:00
Alexander Tokmakov
3146a1a954 fix 2021-01-25 21:59:23 +03:00
alesapin
c0ae61e306 Fix stress test script 2020-11-10 10:33:31 +03:00
Alexey Milovidov
5b9d48c715 Remove garbage from docs 2020-11-04 17:39:18 +03:00
tavplubix
eb483fc72f
Update run.sh 2020-10-16 20:31:05 +03:00
tavplubix
149c74b2b8
trigger CI 2020-10-15 23:48:10 +03:00
Alexander Tokmakov
95ad45a3b0 minor improvements of stress test 2020-10-15 21:14:04 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov
d0dff5b738 fixes 2020-10-01 12:27:05 +03:00
Alexander Kuzmenkov
499e0766e5 Check docker scripts with shellcheck 2020-09-30 20:06:46 +03:00
alesapin
fff9e5d592 Merge branch 'master' into azat-symbolizers-settings-for-non-server 2020-09-28 12:31:05 +03:00
Alexander Tokmakov
fb826557b7 Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 02:04:01 +03:00
alesapin
bb8a2e1617 Better clickhouse-configs 2020-09-24 11:18:36 +03:00
Alexander Tokmakov
dc1cc11764 Merge branch 'master' into enable_atomic_database_by_default 2020-09-22 12:40:32 +03:00
Azat Khuzhin
3fd85430f2 Set sanitizers options in the current shell too
/etc/environment will not be read in current shell, so export variables
from that file manually, to make clickhouse-local/clickhouse-client use
them too.
2020-09-21 23:57:45 +03:00
Alexander Tokmakov
13e41cdd20 try enable atomic database by default 2020-09-21 13:55:34 +03:00
alesapin
27613f8346 Fix symbolizers path in test images 2020-09-21 10:38:11 +03:00
Alexander Tokmakov
b68782d285 enable more tests with Atomic database 2020-09-09 16:32:50 +03:00
Alexey Milovidov
fe5cfe3151 Increase number of threads in stress test 2020-08-26 23:39:02 +03:00
Alexey Milovidov
0bfe78636c Increase number of threads in stress test 2020-08-26 23:38:20 +03:00
alexey-milovidov
f62037e9dc
Update stress 2020-08-26 20:45:36 +03:00
Alexey Milovidov
07596b5323 Limit stress test to one hour 2020-08-26 20:44:03 +03:00
Alexey Milovidov
d44982072c More robust 2020-08-24 03:14:24 +03:00
Alexey Milovidov
1fb4294cdf Attempt to fix stress test 2020-08-24 00:13:21 +03:00
Alexey Milovidov
f4bf99fadc Better output of stress test 2020-08-23 23:48:27 +03:00
tavplubix
d95470f7c3
Update docker/test/stress/run.sh 2020-08-18 20:52:54 +03:00
Nikita Mikhaylov
e7f8c0af52 done 2020-08-18 15:28:38 +03:00
alexey-milovidov
3e6acf1329
Experiment with start/stop in stress test (#13779)
* Experiment with start/stop in stress test

* Support other installation options in "clickhouse start"

* Better diagnostics in install script

* Fixup

* Fixup

* Better diagnostics in stress test

* Update run.sh
2020-08-18 12:43:02 +03:00
Alexander Tokmakov
a5d74c44f1 run stress tests with Atomic database 2020-08-13 20:55:12 +03:00
alesapin
bd0322421b Better timeout 2020-08-04 17:28:35 +03:00
alesapin
caf0bcdc86 More timeouts 2020-08-04 11:48:47 +03:00
alesapin
ee5153bbc4 Restart server in stress test with timeout 2020-08-04 11:47:20 +03:00
alesapin
a061418dab Remove redundant cmd 2020-07-15 12:23:50 +03:00
alesapin
c483de8a35 Check result in separate file 2020-07-14 18:00:24 +03:00
alesapin
c400048a48 Check server able to restart in stateless tests 2020-07-14 17:47:23 +03:00
alesapin
dc8051f737 Fixes 2020-07-08 12:47:14 +03:00
alesapin
9ea3bdd054 Fix skip lists for old branches 2020-07-08 11:41:39 +03:00
alesapin
5098df8d0b Make skip-list optional 2020-07-03 14:15:30 +03:00
Nikolai Kochetov
e0de3aa7c9
Revert "Addition to #11184" 2020-06-09 19:39:26 +03:00
Alexey Milovidov
07205519b5 Addition to #11184 2020-05-29 16:31:27 +03:00
alesapin
104860b274 Fix stress script 2020-05-14 18:37:37 +03:00
Alexey Milovidov
aaba17665b Preparation for MSan UBSan stress tests 2020-05-13 03:50:21 +03:00
Nikita Mikhaylov
ac0939c037 remove too much logs from asan stress test 2020-04-22 19:29:04 +03:00
Nikita Mikhaylov
f76c32fd6e add allocator_release_to_os_interval_ms 2020-04-22 16:15:24 +03:00
Nikita Mikhaylov
5b37658535 first try 2020-04-22 16:13:08 +03:00
alesapin
3c98bfeeea Add correct version of llvm-symbolizer in stress-test 2020-03-28 15:01:55 +03:00
Alexander Tokmakov
9041977bb6 InterpreterCreateQuery code cleanup 2019-12-20 15:51:51 +03:00
Alexander Kuzmenkov
f5f6e73c84 Ignore non-instrumented modules in ThreadSanitizer.
libc++ seems not to be instrumented, which is why we get false positives about
data races in normal destruction of weak_ptr.

In passing, remove redundant configuration of llvm-symbolizer. One symlink
to llvm-8 should suffice.
2019-07-09 15:15:52 +03:00
alesapin
12693e5687 Run stateful tests in stress test 2019-06-25 15:04:05 +03:00
proller
859b35e0ff docker: use configs from clickhouse-test (#5531)
* CLICKHOUSE-3887 Debian init: Service stop timeout

* clean

* clean

* docker: use configs from clickhouse-test

* clean
2019-06-05 22:22:36 +03:00
alesapin
0060650bb0 Fix stress test exit code check and add brotli to image 2019-04-23 13:41:01 +03:00
Alexey Milovidov
b8a7d78e3a Tracking maximum amount of history in TSan 2019-03-29 19:58:02 +03:00
alesapin
eb4cc81176 Add llvm-8 to stress test docker image 2019-03-28 12:29:48 +03:00
alesapin
4e5ca0e0ba Better test images (with ts in output) 2019-01-17 13:35:22 +03:00
alesapin
7df80f52c1 Also install dbg package 2019-01-17 00:29:30 +03:00
alesapin
2ba25fa03d Add env variables systemwide 2019-01-17 00:05:37 +03:00
alesapin
ec0e350b5b Env variables to init.d file 2019-01-16 17:37:44 +03:00
alesapin
7984e4f8a4 Add env variables for test images 2019-01-16 11:58:40 +03:00
alesapin
99330c77ad Enable part_log in docker test images by default 2019-01-09 19:23:20 +03:00
alesapin
95a9b8b3f7 CLICKHOUSE-4245: Turn on query_log in stateless and stress tests 2019-01-09 19:04:39 +03:00
alesapin
43b099f20b Revert to ubuntu 18.04 2018-11-21 15:05:31 +03:00
alesapin
6ce13a08ef Move build and test images to 18.10, add libraries for unbundled build in debian image 2018-11-21 13:09:16 +03:00
alesapin
e20f38a855 Change default threads, num_procs/3 is enought 2018-10-22 20:04:43 +03:00
alesapin
b180c381c4 Change default threads value 2018-10-22 19:05:52 +03:00
alesapin
68352d8d63 Add small sleep before test run 2018-10-22 18:23:03 +03:00