thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-14 10:22:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
97,308 Commits 9,328 Branches 1,783 Tags 2.1 GiB
cc9f6d47be
Commit Graph

319 Commits

Author SHA1 Message Date
alesapin
51345fa25b Trying stress on top of S3 2022-05-01 19:07:02 +02:00
Kruglov Pavel
4e2b1cd981
Update run.sh 2022-04-20 16:48:54 +02:00
Kruglov Pavel
cd77f927b6
Fix putting logs into test_output 2022-04-20 15:06:09 +02:00
Kruglov Pavel
6bcdf21801
Fix stress test 2022-04-20 13:53:16 +02:00
tavplubix
5f31185125
Update stress 2022-04-14 14:35:46 +03:00
Kruglov Pavel
5b46e9655a
Merge pull request #36067 from ClickHouse/Avogar-patch-4 
Try to turn off always green backward compatibility checks
 2022-04-12 16:20:07 +02:00
tavplubix
ccb45ae943
Update stress 2022-04-12 12:42:45 +03:00
tavplubix
48f9b61bdb
Update stress 2022-04-12 12:22:03 +03:00
tavplubix
f7c17a8e86
Update stress 2022-04-11 18:03:19 +03:00
Kruglov Pavel
eaad99bd48
Try to turn off always green backward compatibility checks 2022-04-08 13:55:10 +02:00
tavplubix
6868223af0
Merge pull request #36026 from ClickHouse/tavplubix-patch-2 
Fix Backward comapatibility check
 2022-04-08 13:10:59 +03:00
Kruglov Pavel
9fa6e6e7df
Make backward compatibility check always green 2022-04-07 17:42:33 +02:00
tavplubix
b32800420c
Update stress 2022-04-07 13:30:11 +03:00
Azat Khuzhin
2fb6d6acb4 stress: use more meaningful names for clickhouse-server.log 
But note, that stderr.log/stdout.log/clickhouse-server.err.log still not separated.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-06 14:09:53 +03:00
Azat Khuzhin
058cde820f test/stress: improve error checks for backward compatiblity check 
Before the log was analyzed only after the server had been restarted
after stressing, and hence it cannot find anything in case of error,
like here [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/34355/acd48ebe2d51d20d0c2a5bc545d46d27f9bf7904/stress_test__thread__actions_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-06 14:09:52 +03:00
Alexander Tokmakov
307a2ca579 Merge branch 'master' into zookeeper_client_fault_injection 2022-03-31 15:32:41 +02:00
mergify[bot]
f9a0692e2c
Merge branch 'master' into Avogar-patch-3 2022-03-31 11:45:31 +00:00
alesapin
b838a7dcb0 Remove outdated links from CI 2022-03-28 15:53:22 +02:00
Kruglov Pavel
18ab49e788
Check all logs for crashes, logical errors, etc in backward compatibility check 2022-03-25 11:59:50 +01:00
Kruglov Pavel
5efad9699c
Update run.sh 2022-03-23 11:28:40 +01:00
Kruglov Pavel
8ef2f13524
Update run.sh 2022-03-23 11:26:31 +01:00
Kruglov Pavel
034d92d817
Fix removing empty files 2022-03-22 18:06:35 +01:00
avogar
c5245c1ad1 Improve backward compatibility check and stress test 2022-03-22 12:00:20 +00:00
avogar
288d08f3f2 Add retries in backward compatibility check 2022-03-21 17:26:24 +00:00
Alexander Tokmakov
5c760fd7ce Merge branch 'master' into zookeeper_client_fault_injection 2022-03-21 11:57:40 +01:00
mergify[bot]
5295dd0ef2
Merge branch 'master' into stress-test 2022-03-17 11:10:37 +00:00
Kruglov Pavel
fa6d963f83
Update run.sh 2022-03-16 12:30:45 +01:00
Kruglov Pavel
6b3a25e20d
Update run.sh 2022-03-15 17:15:17 +01:00
avogar
b9496af3b3 Fix tests 2022-03-14 16:40:17 +00:00
Kruglov Pavel
3d36eced2d
Update run.sh 2022-03-10 17:55:45 +03:00
Kruglov Pavel
91b9c11939
Increase the number of attempts to start server 2022-03-10 14:38:39 +03:00
Kruglov Pavel
0f90996bb8
Update run.sh 2022-03-04 14:24:24 +03:00
Kruglov Pavel
8f6ba99fec
Update run.sh 2022-03-01 15:20:02 +03:00
Kruglov Pavel
6252588922
Update run.sh 2022-02-28 13:33:10 +03:00
kssenii
725f967ac6 Add stress test 2022-02-24 07:54:58 +01:00
Kruglov Pavel
500ed56061
Update docker/test/stress/run.sh 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2022-02-18 16:36:48 +03:00
Kruglov Pavel
de888db506
Update docker/test/stress/stress 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2022-02-18 16:36:38 +03:00
Kruglov Pavel
10c45bef67
Remove clickhouse-test package 2022-02-18 13:03:23 +03:00
Kruglov Pavel
71e7668fa6
Remove downloading clickhouse-test 2022-02-18 13:02:49 +03:00
Kruglov Pavel
74087470c2
Update run.sh 2022-02-18 12:52:56 +03:00
Kruglov Pavel
e77319bf01
Merge branch 'master' into stress-test 2022-02-17 20:28:46 +03:00
Yatsishin Ilya
bbe2c07a7b remove clickhouse-test deb completely 2022-02-15 12:03:51 +00:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI (#34517) 
* test/fuzzer: preserve core

This may help to capture things like in [1]:

    Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: do not run 'info locals' since 'backtrace full' includes it

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: try capture backtrace from all threads

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test/stress: fix path for core artifacts

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes: #33389

* test/fuzzer: store core file in artifacts

v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-13 15:02:15 +03:00
Kruglov Pavel
e004dae25b
Update run.sh 2022-01-27 18:15:03 +03:00
Kruglov Pavel
b54bf18b27
Merge branch 'master' into stress-test 2022-01-25 14:35:42 +03:00
Kruglov Pavel
d5bde26bc1
Update run.sh 2022-01-20 15:22:00 +03:00
mergify[bot]
e492fe0a0f
Merge branch 'master' into zookeeper_client_fault_injection 2022-01-17 15:26:16 +00:00
alexey-milovidov
438519aeec
Merge pull request #33389 from azat/stress-core-dumps 
tests/stress: add core dumps into artifacts
 2022-01-14 01:26:35 +03:00
Mikhail f. Shiryaev
c465593706
Force rebuild images once again in master 2022-01-13 19:03:34 +01:00
Mikhail f. Shiryaev
e314eed992
Force rebuild images in CI 2022-01-13 17:49:23 +01:00
Mikhail f. Shiryaev
2a83a1c05d
Build dependent images from the current version 2022-01-12 17:07:52 +01:00
Azat Khuzhin
ebed6193b4 tests/stress: add core dumps into artifacts 
gcore is used here because:

- default kernel.core_pattern is "|/usr/share/apport/apport %p %s %c %d %P %E" [1]
  and so to make it work you need to install apport into container and
  configure it propertly -- to complex

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33389/204e459d259570e6bc7fe2903f7e516094a916ca/stress_test__address__actions_/runlog.log

- kernel.core_pattern cannot be changed, since proc is mounted in
  read-only mode in non --privileged containers [2]

  [2]: https://s3.amazonaws.com/clickhouse-test-reports/33389/dab3afbd94558f9654bf0aa1e06e06e2962f3bb0/stress_test__address__actions_/runlog.log

v2: change kernel.core_pattern
v3: use gcore, since you are not allowed to change kernel.core_pattern
    in container (only under --privileged)
 2022-01-04 14:03:40 +03:00
Kruglov Pavel
ffb6c5b37b
Merge branch 'master' into stress-test 2021-12-23 20:14:15 +03:00
Alexander Tokmakov
bd5931e5af improve gdb script 2021-12-15 13:21:21 +03:00
Alexander Tokmakov
dfa31a6577 fix 2021-12-10 22:38:34 +03:00
tavplubix
5079134ffd
Update run.sh 2021-12-10 20:10:49 +03:00
Alexander Tokmakov
254d6c5d59 fix 2021-12-10 20:07:28 +03:00
Alexander Tokmakov
3ff8aff1b5 try to fix attaching gdb 2021-12-10 18:03:57 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests (#32448) 
* attach gdb with sudo

* fix

* Update run.sh
 2021-12-10 00:12:45 +03:00
Azat Khuzhin
f8bf3b1993 stress: use max_memory_usage_for_user as a soft limit to avoid memory limit exceeded 
By using max_memory_usage_for_user as a soft limit, and after
max_server_memory_usage as a hard, we can allow normal overcommit, using
max_memory_usage_for_user=0 instead of relying on max_untracked_memory.
 2021-12-06 09:05:34 +03:00
Azat Khuzhin
f9a95fce13 stress: allow memory overcommit for SELECT 1 query 2021-12-06 09:02:56 +03:00
Azat Khuzhin
1167313961 stress: allow memory overcommit for one more query 2021-12-06 09:02:56 +03:00
Azat Khuzhin
7063ea3ee2 stress: add make_query_command() helper 2021-12-06 09:02:56 +03:00
Azat Khuzhin
adec690166 stress: SYSTEM DROP MARK CACHE 2021-12-06 09:02:56 +03:00
Azat Khuzhin
d3a7aed005 stress: tune memory_profiler_step too 2021-12-06 09:02:56 +03:00
Azat Khuzhin
169941c5d0 stress: allow 100MiB of memory to overcommit for SHOW/DROP DATABASE 
CI: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__thread__actions_.html
 2021-12-06 09:02:56 +03:00
Azat Khuzhin
445b0983ea stress: ignore server memory limits for hung check 
In [1] hung check failed because the server was under memory pressure.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__undefined__actions_.html
 2021-12-06 09:02:56 +03:00
mergify[bot]
b4f43c59a2
Merge branch 'master' into stress-test 2021-12-01 10:12:22 +00:00
alesapin
b4d4295c16 Followup 2021-11-30 13:24:04 +03:00
alesapin
085a30b98e Fixup 2021-11-30 13:22:50 +03:00
alesapin
bccd927aec Make stress tests slightly more stable 2021-11-30 13:19:03 +03:00
mergify[bot]
ae0b5df601
Merge branch 'master' into stress-test 2021-11-26 12:48:03 +00:00
alesapin
3562264404
Merge pull request #31803 from ClickHouse/faster_tests 
Shorter stress and fuzzer tests
 2021-11-26 10:17:26 +03:00
alesapin
5815429059 Shorter stress and fuzzer tests 2021-11-25 17:54:50 +03:00
mergify[bot]
ce0c112586
Merge branch 'master' into stress-test 2021-11-25 11:09:26 +00:00
Kruglov Pavel
18e60919c5
Update run.sh 2021-11-23 16:49:59 +03:00
Azat Khuzhin
d0ecdb617e Remove duplicated not compressed logs from CI (actions) 
Right now we cannot remove that compression since non-github actions
check will upload non compressed files then, but once old CI will be
removed it seems to be possible to remove that manual compression.
 2021-11-19 21:33:48 +03:00
mergify[bot]
66f7b81b5e
Merge branch 'master' into zookeeper_client_fault_injection 2021-11-17 09:41:12 +00:00
tavplubix
b1079ae309
Update run.sh 2021-11-16 20:03:50 +03:00
tavplubix
224a4c1b6b
Update run.sh 2021-11-16 17:45:37 +03:00
Kruglov Pavel
6180aedab6
Update download_previous_release 2021-11-15 23:16:35 +03:00
Kruglov Pavel
87df3c8272
Fix 2021-11-15 15:03:48 +03:00
Kruglov Pavel
08af98b4a1
Update download_previous_release 2021-11-09 16:34:13 +03:00
Kruglov Pavel
03f1e3c67d
Update run.sh 2021-11-08 14:02:36 +03:00
mergify[bot]
8ef9e61e36
Merge branch 'master' into stress-test 2021-11-03 08:28:43 +00:00
mergify[bot]
063ba2302c
Merge branch 'master' into zookeeper_client_fault_injection 2021-11-02 14:29:35 +00:00
alesapin
dbfa17aabf Add correct S3 2021-11-01 13:32:56 +03:00
mergify[bot]
d9d9d38e4f
Merge branch 'master' into stress-test 2021-10-27 19:00:31 +00:00
Azat Khuzhin
da90df5658 docker: switch <yandex> to <clickhouse> 2021-10-26 08:53:14 +03:00
Alexander Tokmakov
35b5cb9571 Merge branch 'master' into zookeeper_client_fault_injection 2021-10-25 19:03:37 +03:00
Azat Khuzhin
8f015764a7 Add metadata for *_log into tests artifacts 
This will allow to use artifacts as-is, i.e.:

    clickhouse-local --path /path/to/log/artifact

v2: convert database to Ordinary to avoid extra symlinks dependencies.
 2021-10-23 20:17:01 +03:00
Alexander Tokmakov
27ca943863 add fault injection in ZooKeeper client 2021-10-22 18:59:38 +03:00
mergify[bot]
943a1cbba0
Merge branch 'master' into stress-test 2021-10-21 04:41:23 +00:00
alesapin
3ae960e04b Review fixes 2021-10-11 16:40:12 +03:00
alesapin
9ad919d91a More timeouts in stress test 2021-10-11 13:25:54 +03:00
Kruglov Pavel
fd7d1131ec
Update run.sh 2021-10-06 13:17:48 +03:00
Kruglov Pavel
31302afe81 Update run.sh 2021-10-04 16:35:50 +03:00
avogar
821daa21da Update run.sh 2021-10-04 16:35:50 +03:00
Pavel Kruglov
6fc043026e Update run.sh 2021-10-04 16:35:50 +03:00
Pavel Kruglov
2db11bc6c5 Add backward compatibility check in stress test 2021-10-04 16:34:14 +03:00
tavplubix
8adfb9b593
Stop ThreadFuzzer before hung check (#29167) 
* stop ThreadFuzzer before hung check

* fix

* fix
 2021-09-20 17:23:10 +03:00
Vitaly Baranov
bbb192ee85 Convert skip_list.json into first line comments. 2021-09-12 17:15:23 +03:00
alesapin
0eac4529e0 Preparation 2021-09-06 14:33:39 +03:00
mergify[bot]
b81d479de4
Merge branch 'master' into stress-thread-fuzzer 2021-08-31 11:56:30 +00:00
Azat Khuzhin
fb311199ce test/stress: fix patterns for filtering out Raft messages 2021-08-28 19:21:07 +03:00
alesapin
91995ca3a6 More tries 2021-08-18 17:57:36 +03:00
Alexey Milovidov
7a16f331dc Enable thread fuzzer in Stress test 2021-08-10 23:49:05 +03:00
tavplubix
888d096ede
Update stress 2021-07-29 16:21:29 +03:00
Alexander Tokmakov
381634960e fix client options in stress test 2021-07-29 15:16:34 +03:00
Azat Khuzhin
984e9f2f50 test/stress: cleanup tail of log so that it will contain useful messages 2021-07-16 22:39:14 +03:00
Azat Khuzhin
41a5609b81 test/stress: preserve stderr across runs, to preserve errors for final commands 2021-07-16 22:39:14 +03:00
Azat Khuzhin
39a62cc2ef test/stress: fix sanitizers errors detection 2021-07-16 22:39:14 +03:00
Alexey Milovidov
c28f027b14 Fix error in stress test script 2021-07-15 10:24:35 +03:00
alesapin
32bd94a84b
Merge pull request #25741 from ClickHouse/stress-test-separate-logs 
Separate log files for separate runs in stress test
 2021-06-29 10:47:39 +03:00
alexey-milovidov
350445c5f1
Update run.sh 2021-06-29 01:29:14 +03:00
alexey-milovidov
1703bc91b0
Update run.sh 2021-06-28 16:21:17 +03:00
alexey-milovidov
ee935a3733
Update run.sh 2021-06-28 14:28:49 +03:00
Azat Khuzhin
f00a4668a4 Set follow-fork-mode child for gdb in stress/fasttest/fuzzer 
Sometimes gdb does not catch SIGSEGV [1], let's try set this setting,
since maybe some code from contrib does fork.

  [1]: https://clickhouse-test-reports.s3.yandex.net/25605/cd5a3c8d7eb417f6df211b4507dc970933f8549a/stress_test_(thread).html#fail1
 2021-06-28 10:04:08 +03:00
alexey-milovidov
f7663fe6eb
Update run.sh 2021-06-28 00:05:57 +03:00
Alexey Milovidov
45c4b62c3b Separate log files for separate runs in stress test 2021-06-27 18:41:25 +03:00
vdimir
e24ee509a4
Fix modulo division priority issue in test/stress/stress 2021-06-11 13:08:49 +03:00
vdimir
bf9df90296
Add join related options to stress test 2021-06-11 12:36:59 +03:00
alesapin
aeac53ac78 Update run script 2021-06-03 18:16:12 +03:00
alesapin
329380d6e5 Relaxed hung check in stress test 2021-06-03 18:13:29 +03:00
alesapin
82c90ebc05 Some improvements in stress test 2021-06-01 12:45:01 +03:00
Alexey Milovidov
e9e4ab3813 Less chance of OOM in stress tests 2021-04-24 03:27:23 +03:00
Azat Khuzhin
2575d03a33 Add trace_log into stateless/stress test artifacts 2021-04-20 08:03:29 +03:00
Alexander Tokmakov
0739dde734 improve hung check 2021-04-13 16:45:08 +03:00
Alexey Milovidov
a674188d39 Better diagnostics for OOM in stress test 2021-04-09 09:39:25 +03:00
Alexander Tokmakov
d7c43291b1 improve hung check in stress test 2021-03-15 17:23:04 +03:00
tavplubix
2acbfd834a
Merge branch 'master' into stress_test_results 2021-03-12 12:11:33 +03:00
alesapin
b2c12f3762 Upload coordination log after stress test 2021-03-07 17:44:30 +03:00
alesapin
76e10a4fb1 Missed files for tests 2021-03-03 23:05:33 +03:00
alesapin
56d9d99d1c Fix style and bayan 2021-02-26 09:59:40 +03:00
Alexander Tokmakov
d46fee0f04 Merge branch 'master' into stress_test_results 2021-02-26 00:24:22 +03:00
alesapin
84102a22e7 Trying to make testkeeper better in single server mode 2021-02-25 23:30:55 +03:00
Alexander Tokmakov
fbbb0c4b69 fix 2021-02-25 19:11:43 +03:00
Alexander Tokmakov
3632c1d879 add flacky check runner 2021-02-24 19:41:44 +03:00
Alexander Tokmakov
487b162343 fix 2021-02-22 16:53:43 +03:00
Alexander Tokmakov
eaed15b5e1 process result of func and unit tests 2021-02-20 23:04:24 +03:00
tavplubix
a697b578bc
Merge pull request #16193 from ClickHouse/database_replicated 
DatabaseReplicated: continuation of #10485
 2021-02-20 19:39:34 +03:00
Alexander Tokmakov
6d9990f378 Merge branch 'stress_test_results' of https://github.com/ClickHouse/ClickHouse into stress_test_results 2021-02-20 19:28:36 +03:00
Alexander Tokmakov
694d89ad81 fix 2021-02-20 19:27:04 +03:00
Alexander Tokmakov
b62a29728f Merge branch 'master' into stress_test_results 2021-02-20 16:22:43 +03:00
tavplubix
f5fc082ed0
Update run.sh 2021-02-19 22:39:42 +03:00
Alexander Tokmakov
033f55f498 fix 2021-02-19 17:38:20 +03:00
Alexander Tokmakov
4493c39bf7 fix 2021-02-19 12:57:09 +03:00
Alexander Tokmakov
afed8a8192 process stress test results 2021-02-19 01:08:44 +03:00
Alexander Tokmakov
8097532cb7 Merge branch 'master' into database_replicated 2021-02-18 17:42:06 +03:00
Azat Khuzhin
770c3406df test/stress: fix permissions for clickhouse directories 2021-02-18 00:13:03 +03:00