thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-30 11:32:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
92,731 Commits 9,189 Branches 1,782 Tags 2.2 GiB
351d14f8a3
Commit Graph

250 Commits

Author SHA1 Message Date
tavplubix
b32800420c
Update stress 2022-04-07 13:30:11 +03:00
Azat Khuzhin
2fb6d6acb4 stress: use more meaningful names for clickhouse-server.log 
But note, that stderr.log/stdout.log/clickhouse-server.err.log still not separated.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-06 14:09:53 +03:00
Azat Khuzhin
058cde820f test/stress: improve error checks for backward compatiblity check 
Before the log was analyzed only after the server had been restarted
after stressing, and hence it cannot find anything in case of error,
like here [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/34355/acd48ebe2d51d20d0c2a5bc545d46d27f9bf7904/stress_test__thread__actions_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-06 14:09:52 +03:00
mergify[bot]
f9a0692e2c
Merge branch 'master' into Avogar-patch-3 2022-03-31 11:45:31 +00:00
alesapin
b838a7dcb0 Remove outdated links from CI 2022-03-28 15:53:22 +02:00
Kruglov Pavel
18ab49e788
Check all logs for crashes, logical errors, etc in backward compatibility check 2022-03-25 11:59:50 +01:00
Kruglov Pavel
5efad9699c
Update run.sh 2022-03-23 11:28:40 +01:00
Kruglov Pavel
8ef2f13524
Update run.sh 2022-03-23 11:26:31 +01:00
Kruglov Pavel
034d92d817
Fix removing empty files 2022-03-22 18:06:35 +01:00
avogar
c5245c1ad1 Improve backward compatibility check and stress test 2022-03-22 12:00:20 +00:00
avogar
288d08f3f2 Add retries in backward compatibility check 2022-03-21 17:26:24 +00:00
mergify[bot]
5295dd0ef2
Merge branch 'master' into stress-test 2022-03-17 11:10:37 +00:00
Kruglov Pavel
fa6d963f83
Update run.sh 2022-03-16 12:30:45 +01:00
Kruglov Pavel
6b3a25e20d
Update run.sh 2022-03-15 17:15:17 +01:00
avogar
b9496af3b3 Fix tests 2022-03-14 16:40:17 +00:00
Kruglov Pavel
3d36eced2d
Update run.sh 2022-03-10 17:55:45 +03:00
Kruglov Pavel
91b9c11939
Increase the number of attempts to start server 2022-03-10 14:38:39 +03:00
Kruglov Pavel
0f90996bb8
Update run.sh 2022-03-04 14:24:24 +03:00
Kruglov Pavel
8f6ba99fec
Update run.sh 2022-03-01 15:20:02 +03:00
Kruglov Pavel
6252588922
Update run.sh 2022-02-28 13:33:10 +03:00
kssenii
725f967ac6 Add stress test 2022-02-24 07:54:58 +01:00
Kruglov Pavel
500ed56061
Update docker/test/stress/run.sh 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2022-02-18 16:36:48 +03:00
Kruglov Pavel
de888db506
Update docker/test/stress/stress 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2022-02-18 16:36:38 +03:00
Kruglov Pavel
10c45bef67
Remove clickhouse-test package 2022-02-18 13:03:23 +03:00
Kruglov Pavel
71e7668fa6
Remove downloading clickhouse-test 2022-02-18 13:02:49 +03:00
Kruglov Pavel
74087470c2
Update run.sh 2022-02-18 12:52:56 +03:00
Kruglov Pavel
e77319bf01
Merge branch 'master' into stress-test 2022-02-17 20:28:46 +03:00
Yatsishin Ilya
bbe2c07a7b remove clickhouse-test deb completely 2022-02-15 12:03:51 +00:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI (#34517) 
* test/fuzzer: preserve core

This may help to capture things like in [1]:

    Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: do not run 'info locals' since 'backtrace full' includes it

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: try capture backtrace from all threads

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test/stress: fix path for core artifacts

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes: #33389

* test/fuzzer: store core file in artifacts

v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-13 15:02:15 +03:00
Kruglov Pavel
e004dae25b
Update run.sh 2022-01-27 18:15:03 +03:00
Kruglov Pavel
b54bf18b27
Merge branch 'master' into stress-test 2022-01-25 14:35:42 +03:00
Kruglov Pavel
d5bde26bc1
Update run.sh 2022-01-20 15:22:00 +03:00
alexey-milovidov
438519aeec
Merge pull request #33389 from azat/stress-core-dumps 
tests/stress: add core dumps into artifacts
 2022-01-14 01:26:35 +03:00
Mikhail f. Shiryaev
c465593706
Force rebuild images once again in master 2022-01-13 19:03:34 +01:00
Mikhail f. Shiryaev
e314eed992
Force rebuild images in CI 2022-01-13 17:49:23 +01:00
Mikhail f. Shiryaev
2a83a1c05d
Build dependent images from the current version 2022-01-12 17:07:52 +01:00
Azat Khuzhin
ebed6193b4 tests/stress: add core dumps into artifacts 
gcore is used here because:

- default kernel.core_pattern is "|/usr/share/apport/apport %p %s %c %d %P %E" [1]
  and so to make it work you need to install apport into container and
  configure it propertly -- to complex

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33389/204e459d259570e6bc7fe2903f7e516094a916ca/stress_test__address__actions_/runlog.log

- kernel.core_pattern cannot be changed, since proc is mounted in
  read-only mode in non --privileged containers [2]

  [2]: https://s3.amazonaws.com/clickhouse-test-reports/33389/dab3afbd94558f9654bf0aa1e06e06e2962f3bb0/stress_test__address__actions_/runlog.log

v2: change kernel.core_pattern
v3: use gcore, since you are not allowed to change kernel.core_pattern
    in container (only under --privileged)
 2022-01-04 14:03:40 +03:00
Kruglov Pavel
ffb6c5b37b
Merge branch 'master' into stress-test 2021-12-23 20:14:15 +03:00
Alexander Tokmakov
bd5931e5af improve gdb script 2021-12-15 13:21:21 +03:00
Alexander Tokmakov
dfa31a6577 fix 2021-12-10 22:38:34 +03:00
tavplubix
5079134ffd
Update run.sh 2021-12-10 20:10:49 +03:00
Alexander Tokmakov
254d6c5d59 fix 2021-12-10 20:07:28 +03:00
Alexander Tokmakov
3ff8aff1b5 try to fix attaching gdb 2021-12-10 18:03:57 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests (#32448) 
* attach gdb with sudo

* fix

* Update run.sh
 2021-12-10 00:12:45 +03:00
Azat Khuzhin
f8bf3b1993 stress: use max_memory_usage_for_user as a soft limit to avoid memory limit exceeded 
By using max_memory_usage_for_user as a soft limit, and after
max_server_memory_usage as a hard, we can allow normal overcommit, using
max_memory_usage_for_user=0 instead of relying on max_untracked_memory.
 2021-12-06 09:05:34 +03:00
Azat Khuzhin
f9a95fce13 stress: allow memory overcommit for SELECT 1 query 2021-12-06 09:02:56 +03:00
Azat Khuzhin
1167313961 stress: allow memory overcommit for one more query 2021-12-06 09:02:56 +03:00
Azat Khuzhin
7063ea3ee2 stress: add make_query_command() helper 2021-12-06 09:02:56 +03:00
Azat Khuzhin
adec690166 stress: SYSTEM DROP MARK CACHE 2021-12-06 09:02:56 +03:00
Azat Khuzhin
d3a7aed005 stress: tune memory_profiler_step too 2021-12-06 09:02:56 +03:00
Azat Khuzhin
169941c5d0 stress: allow 100MiB of memory to overcommit for SHOW/DROP DATABASE 
CI: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__thread__actions_.html
 2021-12-06 09:02:56 +03:00
Azat Khuzhin
445b0983ea stress: ignore server memory limits for hung check 
In [1] hung check failed because the server was under memory pressure.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__undefined__actions_.html
 2021-12-06 09:02:56 +03:00
mergify[bot]
b4f43c59a2
Merge branch 'master' into stress-test 2021-12-01 10:12:22 +00:00
alesapin
b4d4295c16 Followup 2021-11-30 13:24:04 +03:00
alesapin
085a30b98e Fixup 2021-11-30 13:22:50 +03:00
alesapin
bccd927aec Make stress tests slightly more stable 2021-11-30 13:19:03 +03:00
mergify[bot]
ae0b5df601
Merge branch 'master' into stress-test 2021-11-26 12:48:03 +00:00
alesapin
3562264404
Merge pull request #31803 from ClickHouse/faster_tests 
Shorter stress and fuzzer tests
 2021-11-26 10:17:26 +03:00
alesapin
5815429059 Shorter stress and fuzzer tests 2021-11-25 17:54:50 +03:00
mergify[bot]
ce0c112586
Merge branch 'master' into stress-test 2021-11-25 11:09:26 +00:00
Kruglov Pavel
18e60919c5
Update run.sh 2021-11-23 16:49:59 +03:00
Azat Khuzhin
d0ecdb617e Remove duplicated not compressed logs from CI (actions) 
Right now we cannot remove that compression since non-github actions
check will upload non compressed files then, but once old CI will be
removed it seems to be possible to remove that manual compression.
 2021-11-19 21:33:48 +03:00
tavplubix
b1079ae309
Update run.sh 2021-11-16 20:03:50 +03:00
tavplubix
224a4c1b6b
Update run.sh 2021-11-16 17:45:37 +03:00
Kruglov Pavel
6180aedab6
Update download_previous_release 2021-11-15 23:16:35 +03:00
Kruglov Pavel
87df3c8272
Fix 2021-11-15 15:03:48 +03:00
Kruglov Pavel
08af98b4a1
Update download_previous_release 2021-11-09 16:34:13 +03:00
Kruglov Pavel
03f1e3c67d
Update run.sh 2021-11-08 14:02:36 +03:00
mergify[bot]
8ef9e61e36
Merge branch 'master' into stress-test 2021-11-03 08:28:43 +00:00
alesapin
dbfa17aabf Add correct S3 2021-11-01 13:32:56 +03:00
mergify[bot]
d9d9d38e4f
Merge branch 'master' into stress-test 2021-10-27 19:00:31 +00:00
Azat Khuzhin
da90df5658 docker: switch <yandex> to <clickhouse> 2021-10-26 08:53:14 +03:00
Azat Khuzhin
8f015764a7 Add metadata for *_log into tests artifacts 
This will allow to use artifacts as-is, i.e.:

    clickhouse-local --path /path/to/log/artifact

v2: convert database to Ordinary to avoid extra symlinks dependencies.
 2021-10-23 20:17:01 +03:00
mergify[bot]
943a1cbba0
Merge branch 'master' into stress-test 2021-10-21 04:41:23 +00:00
alesapin
3ae960e04b Review fixes 2021-10-11 16:40:12 +03:00
alesapin
9ad919d91a More timeouts in stress test 2021-10-11 13:25:54 +03:00
Kruglov Pavel
fd7d1131ec
Update run.sh 2021-10-06 13:17:48 +03:00
Kruglov Pavel
31302afe81 Update run.sh 2021-10-04 16:35:50 +03:00
avogar
821daa21da Update run.sh 2021-10-04 16:35:50 +03:00
Pavel Kruglov
6fc043026e Update run.sh 2021-10-04 16:35:50 +03:00
Pavel Kruglov
2db11bc6c5 Add backward compatibility check in stress test 2021-10-04 16:34:14 +03:00
tavplubix
8adfb9b593
Stop ThreadFuzzer before hung check (#29167) 
* stop ThreadFuzzer before hung check

* fix

* fix
 2021-09-20 17:23:10 +03:00
Vitaly Baranov
bbb192ee85 Convert skip_list.json into first line comments. 2021-09-12 17:15:23 +03:00
alesapin
0eac4529e0 Preparation 2021-09-06 14:33:39 +03:00
mergify[bot]
b81d479de4
Merge branch 'master' into stress-thread-fuzzer 2021-08-31 11:56:30 +00:00
Azat Khuzhin
fb311199ce test/stress: fix patterns for filtering out Raft messages 2021-08-28 19:21:07 +03:00
alesapin
91995ca3a6 More tries 2021-08-18 17:57:36 +03:00
Alexey Milovidov
7a16f331dc Enable thread fuzzer in Stress test 2021-08-10 23:49:05 +03:00
tavplubix
888d096ede
Update stress 2021-07-29 16:21:29 +03:00
Alexander Tokmakov
381634960e fix client options in stress test 2021-07-29 15:16:34 +03:00
Azat Khuzhin
984e9f2f50 test/stress: cleanup tail of log so that it will contain useful messages 2021-07-16 22:39:14 +03:00
Azat Khuzhin
41a5609b81 test/stress: preserve stderr across runs, to preserve errors for final commands 2021-07-16 22:39:14 +03:00
Azat Khuzhin
39a62cc2ef test/stress: fix sanitizers errors detection 2021-07-16 22:39:14 +03:00
Alexey Milovidov
c28f027b14 Fix error in stress test script 2021-07-15 10:24:35 +03:00
alesapin
32bd94a84b
Merge pull request #25741 from ClickHouse/stress-test-separate-logs 
Separate log files for separate runs in stress test
 2021-06-29 10:47:39 +03:00
alexey-milovidov
350445c5f1
Update run.sh 2021-06-29 01:29:14 +03:00
alexey-milovidov
1703bc91b0
Update run.sh 2021-06-28 16:21:17 +03:00
alexey-milovidov
ee935a3733
Update run.sh 2021-06-28 14:28:49 +03:00
Azat Khuzhin
f00a4668a4 Set follow-fork-mode child for gdb in stress/fasttest/fuzzer 
Sometimes gdb does not catch SIGSEGV [1], let's try set this setting,
since maybe some code from contrib does fork.

  [1]: https://clickhouse-test-reports.s3.yandex.net/25605/cd5a3c8d7eb417f6df211b4507dc970933f8549a/stress_test_(thread).html#fail1
 2021-06-28 10:04:08 +03:00
alexey-milovidov
f7663fe6eb
Update run.sh 2021-06-28 00:05:57 +03:00