Alexey Milovidov
0bdaa57023
Fix diagnostics in the test script
2024-08-04 23:53:54 +02:00
Azat Khuzhin
43cf85ef28
ci: collect basic issues in stateless tests (dmesg, fatal and similar)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 23:19:33 +02:00
Azat Khuzhin
c200f43774
ci: fix stateless runner to correctly gather artifacts when server failed
...
Right now it simply does not work due to "set -e", with it you cannot
use "foo=$(false)" since bash will break execution after, rewrite it to
a plain shell, with "if".
Also use ZSTD everywhere (ugh)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 23:19:33 +02:00
Alexey Milovidov
f08b32d528
Merge branch 'master' into tighten-limits-functional-tests
2024-08-04 21:44:38 +02:00
Alexey Milovidov
a433115434
Fix typo
2024-08-04 19:18:00 +02:00
Azat Khuzhin
1f2bb6676f
Remove outdated comments about workaround for #64086
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 16:14:05 +02:00
Azat Khuzhin
dea95e6c33
Ensure that llvm-symbolizer is used for symbolizing sanitizer reports
...
Since you don't want to fallback to addr2line:
# addr2line
$ time /bin/test
set_flag_impl: Success
set_flag_if: Success
/usr/bin/addr2line: DWARF error: invalid or unhandled FORM value: 0x23
==================
WARNING: ThreadSanitizer: data race (pid=18)
...
real 3m8.580s
user 0m21.967s
sys 0m40.628s
# llvm-symbolizer
$ time ./test
set_flag_impl: Success
set_flag_if: Success
==================
WARNING: ThreadSanitizer: data race (pid=24884)
real 0m0.028s
user 0m0.003s
sys 0m0.006s
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 16:14:05 +02:00
Raúl Marín
86bab5a78a
Unit test: Don't return ok if leaks are detected
2024-08-02 16:09:43 +02:00
Raúl Marín
e5cf376c4f
Don't attach gdb in ASAN runs of fuzzer, stateless or stress checks
2024-08-02 12:56:49 +02:00
Raúl Marín
97f1f6e221
Don't hide errors on clickhouse local runs
2024-08-02 12:46:37 +02:00
Nikolay Degterinsky
2e7a15df89
Update setup_export_logs.sh
2024-08-01 23:23:06 +02:00
Raúl Marín
35b6112b7b
Try to stop on leaks
2024-08-01 19:50:13 +02:00
Raúl Marín
c5a8653daf
Playing with Docker and the CI
2024-08-01 19:27:12 +02:00
Raúl Marín
4e9761acf9
Don't run ASAN unit tests under gdb
2024-08-01 18:59:17 +02:00
maxvostrikov
928d5df3f0
added tests for https://github.com/ClickHouse/ClickHouse/pull/65475
...
Support writting page index into parquet file
2024-08-01 12:32:43 +02:00
Nikolay Degterinsky
89ca6aee4e
Check for timeout when we stop logs replication
2024-07-31 20:00:37 +00:00
Alexey Milovidov
59b85fb788
Merge branch 'master' into tighten-limits-functional-tests
2024-07-30 23:19:38 +02:00
kssenii
bf25f1815e
Merge remote-tracking branch 'origin' into add-no-distributed-cache-tag
2024-07-30 13:45:23 +02:00
Yarik Briukhovetskyi
f0da5c528f
Merge branch 'master' into hive_style_partitioning
2024-07-30 11:49:14 +02:00
kssenii
161e794618
Add no-distributed-cache tag
2024-07-29 14:03:22 +02:00
Antonio Andelic
6f2d25cc39
Merge branch 'master' into add-numactl
2024-07-28 11:29:26 +02:00
Alexey Milovidov
8dd0542fc1
Merge branch 'master' into tighten-limits-functional-tests
2024-07-27 13:19:59 +02:00
Alexey Milovidov
b8b6188cbf
Merge branch 'master' into tighten-limits-functional-tests
2024-07-27 01:28:19 +02:00
Alexey Milovidov
c4d772557f
Merge pull request #66790 from ClickHouse/better-diagnostics-in-functional-tests
...
Better diagnostics in functional tests
2024-07-26 23:15:42 +00:00
Nikita Fomichev
c95c1a7232
Merge pull request #66901 from ClickHouse/stable-test-runs
...
Stateless tests: Change status of failed tests in case of server crash and add no-parallel to high-load tests
2024-07-26 18:42:42 +00:00
Alexey Milovidov
ffe15e2e37
Merge branch 'master' into tighten-limits-functional-tests
2024-07-26 14:11:59 +02:00
Nikita Fomichev
7f80dab692
CI push
2024-07-26 12:34:36 +02:00
Antonio Andelic
287cce7d21
Fixes
2024-07-26 09:20:15 +02:00
Alexey Milovidov
8f91fa8b78
Merge branch 'fix-unit-tests' into better-diagnostics-in-functional-tests
2024-07-26 04:51:46 +02:00
Ilya Yatsishin
638937674f
Merge remote-tracking branch 'origin/master' into qoega-patch-6
2024-07-25 23:19:00 +02:00
Alexey Milovidov
6b56f427d3
Merge pull request #67145 from ClickHouse/lower-max-allocation-size-in-query-fuzzer
...
Lower max allocation size in query fuzzer
2024-07-25 21:00:58 +00:00
Alexey Milovidov
02461263f2
Merge branch 'master' into tighten-limits-functional-tests
2024-07-25 21:27:14 +02:00
Antonio Andelic
cba75018ee
Merge pull request #66847 from ClickHouse/dont-ignore-sigsegv
...
Stop ignoring SIGSEGV in GDB
2024-07-25 17:53:42 +00:00
Alexey Milovidov
1059c7b76e
Merge branch 'master' into tighten-limits-functional-tests
2024-07-25 19:34:47 +02:00
Alexey Milovidov
ee193ffa01
Lower max allocation size in query fuzzer
2024-07-25 19:25:58 +02:00
Alexey Milovidov
782d829d87
Merge branch 'master' into better-diagnostics-in-functional-tests
2024-07-25 18:47:09 +02:00
Antonio Andelic
c5e01c91d2
Merge branch 'master' into dont-ignore-sigsegv
2024-07-25 11:23:39 +02:00
János Benjamin Antal
2def300631
Merge pull request #67049 from ClickHouse/fix-sanitizer-allocation-size-is-too-big
...
Increase max allocation size for sanitizers
2024-07-25 08:32:38 +00:00
János Benjamin Antal
e498b86f50
Add option for LSAN in shell also
2024-07-24 14:00:28 +00:00
János Benjamin Antal
c5d262c23b
Increase max allocation size for sanitizers
2024-07-24 13:55:59 +00:00
Alexey Milovidov
e2c78844a0
Fix tests
2024-07-24 14:53:09 +02:00
Alexey Milovidov
036485a657
Fix error
2024-07-24 12:15:48 +02:00
Alexey Milovidov
878a340317
Fix tests
2024-07-24 11:47:07 +02:00
Alexey Milovidov
e50e28ac62
Merge branch 'master' into tighten-limits-functional-tests
2024-07-24 03:50:08 +02:00
Alexey Milovidov
a18ac1aa19
Merge branch 'master' into better-diagnostics-in-functional-tests
2024-07-24 03:44:14 +02:00
Ilya Yatsishin
8925060366
Touch dockerfile to forcefully rebuild image
2024-07-24 00:18:12 +02:00
Nikita Fomichev
b6ad57aa37
Stateless tests: change status for failed tests in case of server crash
2024-07-23 10:30:00 +02:00
Michael Kolupaev
997f94169e
Merge remote-tracking branch 'origin/master' into reg
2024-07-22 20:52:29 +00:00
Raúl Marín
9f86b22d30
Speed up stateful tests table setup
2024-07-22 14:42:30 +02:00
Ilya Yatsishin
d296e62bf3
Update docker/test/integration/runner/Dockerfile
2024-07-22 14:31:50 +02:00
Ilya Yatsishin
340214a246
Unpin docker-ce in integration-tests-runner
2024-07-22 12:55:50 +02:00
Antonio Andelic
8217dcccc1
Stop ignoring SIGSEGV in GDB
2024-07-22 09:53:56 +02:00
Alexey Milovidov
8c264230e3
Loosen the limit
2024-07-22 07:20:33 +02:00
Alexey Milovidov
ebc05f53c3
Merge branch 'master' into better-diagnostics-in-functional-tests
2024-07-21 04:28:22 +02:00
Alexey Milovidov
444303cb71
Better diagnostics
2024-07-20 00:25:57 +02:00
Alexey Milovidov
5ae3a421e0
Copy-paste
2024-07-20 00:12:02 +02:00
Alexey Milovidov
ba6b7b86ba
Log messages
2024-07-20 00:09:53 +02:00
Alexey Milovidov
134c006540
Whitespace
2024-07-20 00:08:25 +02:00
Alexey Milovidov
a373b62bbf
Better diagnostics in functional tests
2024-07-20 00:04:52 +02:00
Nikita Fomichev
1e160189f0
Increase parallel jobs for stateless tests
2024-07-19 20:10:41 +02:00
Nikita Fomichev
fa2659a87c
Increase CI timeout for stateless tests
2024-07-19 20:10:08 +02:00
Nikita Fomichev
7c1ed1b445
Stateless tests: check parallelization
2024-07-18 21:50:21 +02:00
Nikita Fomichev
bd10951db8
Stateless tests: tune MAX_RUN_TIME
2024-07-18 21:50:21 +02:00
Nikita Fomichev
626e1f70cb
Stateful tests: decrease tests timeout
2024-07-18 21:49:47 +02:00
Alexey Milovidov
60f45cb993
A fix
2024-07-17 03:52:35 +02:00
Alexey Milovidov
408fda417e
Merge branch 'master' into fix-fasttest-expect
2024-07-17 03:51:53 +02:00
Alexey Milovidov
c913a36ed6
Minor modifications
2024-07-17 02:13:57 +02:00
Alexey Milovidov
0d1789292b
Add sudo for convenience
2024-07-17 02:11:09 +02:00
Nikita Fomichev
77c4e6ae8c
Stateless tests: disable sequential tests in parallel tests
2024-07-16 12:21:08 +02:00
Alexey Milovidov
e292358ade
Update run.sh
2024-07-16 06:12:42 +02:00
Alexey Milovidov
68aedc2191
Fix something in Fast Test
2024-07-16 03:58:55 +02:00
Yakov Olkhovskiy
0176e0b2ae
fix
2024-07-15 19:27:54 +00:00
Yakov Olkhovskiy
5361ade8e7
optimize
2024-07-15 19:10:07 +00:00
robot-clickhouse
97c9739abc
Automatic style fix
2024-07-15 17:21:59 +00:00
Yarik Briukhovetskyi
4a7c52900a
Merge branch 'master' into hive_style_partitioning
2024-07-15 19:05:21 +02:00
Yakov Olkhovskiy
50f068efe9
add dedicated runner to libfuzzer, update docker
2024-07-15 17:00:53 +00:00
Nikita Fomichev
2a0253d1e2
Tests: rename bad log names
2024-07-15 13:14:29 +02:00
Alexey Milovidov
e3a2a2e487
Merge pull request #66353 from ClickHouse/collect-minio-logs
...
Collect logs from `minio` in stateless and statefull tests
2024-07-13 21:34:50 +00:00
Max K
1050217445
add support for new release branch
...
Automatic style fix
2024-07-13 16:21:22 +02:00
Max K
f8e71707f2
update black
2024-07-13 16:21:22 +02:00
Yarik Briukhovetskyi
c09c7a4568
Merge branch 'ClickHouse:master' into hive_style_partitioning
2024-07-13 01:13:46 +02:00
Vitaly Baranov
90142b73ad
Merge pull request #66284 from vitlibar/add-stateless-test-for-grpc
...
Add a stateless test for gRPC protocol
2024-07-12 17:32:06 +00:00
Yarik Briukhovetskyi
17d2f8ed20
Merge branch 'ClickHouse:master' into hive_style_partitioning
2024-07-12 16:33:48 +02:00
Nikita Fomichev
258ae45aa8
Merge pull request #66411 from ClickHouse/fix-hanging-on-gdb
...
Stateless tests: deal with hang-ups more roughly
2024-07-12 13:25:46 +00:00
Nikita Fomichev
dd6dac6c5a
Stateless tests: better sort checks in test report
2024-07-12 12:15:59 +02:00
Nikita Fomichev
f30cd12434
Stateless tests: add "Server died" check
2024-07-12 08:38:22 +02:00
Nikita Fomichev
4a56c601b2
Stateless tests: decrease CI timeout
2024-07-12 01:11:13 +02:00
Vitaly Baranov
355a56d1b0
Add a stateless test for gRPC protocol.
2024-07-11 15:36:41 +02:00
Kseniia Sumarokova
60c0957abd
Merge pull request #66290 from ClickHouse/kssenii-patch-10
...
Update run.sh
2024-07-11 10:45:37 +00:00
Antonio Andelic
fbb7a3ed52
Merge pull request #66281 from ClickHouse/collect-core-dumps-stateless
...
Collect core dumps in more tests
2024-07-11 09:45:17 +00:00
János Benjamin Antal
321a58c519
Fix relative path to mc
2024-07-11 08:33:10 +00:00
János Benjamin Antal
4729161f41
Collect logs from minio
2024-07-10 18:41:48 +00:00
Kseniia Sumarokova
e5020690be
Merge branch 'master' into kssenii-patch-10
2024-07-10 20:02:15 +02:00
Yarik Briukhovetskyi
052520fa03
Merge branch 'master' into hive_style_partitioning
2024-07-10 19:46:07 +02:00
Nikita Fomichev
481a1570aa
Run sequential tests in parallel to non-sequential
2024-07-10 19:21:32 +02:00
Nikita Fomichev
2662760572
debug tests hung on gdb error 8
2024-07-10 16:38:54 +02:00
Nikita Fomichev
83cfe164bd
debug tests hung on gdb error 7
2024-07-10 15:55:30 +02:00
Antonio Andelic
ccffc05681
Fix asan
2024-07-10 15:45:17 +02:00
Nikita Fomichev
ba176a9c4a
debug tests hung on gdb error 6
2024-07-10 14:51:27 +02:00
Nikita Fomichev
ede43721b4
debug tests hung on gdb error 4
2024-07-10 13:30:06 +02:00
Kruglov Pavel
7b58722c07
Update setup_minio.sh
2024-07-10 13:15:44 +02:00
Antonio Andelic
1eec1fd77f
Merge branch 'master' into collect-core-dumps-stateless
2024-07-10 13:01:41 +02:00
Kseniia Sumarokova
36b9a5641f
Update run.sh
2024-07-10 11:56:43 +02:00
Kseniia Sumarokova
ebc87d0c70
Update run.sh
2024-07-09 22:58:06 +02:00
Kruglov Pavel
d7f08ffdb7
Update setup_minio.sh
2024-07-09 21:01:37 +02:00
Kseniia Sumarokova
5a12659f43
Update run.sh
2024-07-09 20:18:03 +02:00
Nikita Fomichev
eeb3561c37
Stateless tests: run sequential tests in parallel to other tests
2024-07-09 19:41:06 +02:00
Yarik Briukhovetskyi
362bf4befc
Update setup_minio.sh
2024-07-09 17:30:08 +02:00
Antonio Andelic
0821d72f1c
Collect core dumps in more tests
2024-07-09 17:06:37 +02:00
Yarik Briukhovetskyi
3cc6a133c6
Update setup_minio.sh
2024-07-09 12:38:16 +02:00
yariks5s
a3c4cbfce2
clang-tidy, fix cp with minio
2024-07-08 13:57:54 +00:00
Raúl Marín
18e2f0da9f
Merge remote-tracking branch 'blessed/master' into fix_bugfix_checker
2024-07-08 11:23:47 +02:00
Nikita Fomichev
be8945f2a0
Merge remote-tracking branch 'origin/master' into fix-missing-tests-reports
2024-07-07 10:04:58 +02:00
alesapin
e2ff0c6809
Merge remote-tracking branch 'origin/master' into pin_python_packages
2024-07-05 22:16:08 +02:00
Raúl Marín
ad70710f4b
stateless/run.sh cleanup
2024-07-05 16:45:32 +02:00
alesapin
964047bf8c
Yarrrr
2024-07-05 16:31:00 +02:00
alesapin
1f07f33bd2
Less dirty still hack
2024-07-05 12:18:18 +02:00
Michael Kolupaev
90df83438f
more shellcheck
2024-07-05 04:42:58 +00:00
Michael Kolupaev
158f59fd83
Merge remote-tracking branch 'origin/master' into reg
2024-07-04 19:10:07 +00:00
alesapin
e176587c59
Trying even worse fix
2024-07-04 17:16:25 +02:00
alesapin
963f39ede8
Revert "Update docker/test/fasttest/Dockerfile"
...
This reverts commit 1af3caf2b7
2024-07-04 15:56:44 +02:00
alesapin
1af3caf2b7
Update docker/test/fasttest/Dockerfile
...
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2024-07-04 15:48:12 +02:00
alesapin
8d6c0147e2
Add comment
2024-07-04 15:30:27 +02:00
alesapin
2c77371b8b
Better
2024-07-04 15:27:23 +02:00
alesapin
8040150de8
Very dirty hack
2024-07-04 14:22:30 +02:00
Nikita Fomichev
c4005d7e06
Fix fasttest
2024-07-03 23:13:50 +02:00
alesapin
31ca631ac5
Pin all python packages in CI images
2024-07-03 21:58:18 +02:00
Nikita Fomichev
a19eb86864
Review fixes 2
2024-07-03 19:39:00 +02:00
Nikita Fomichev
af845234a2
Review fixes
2024-07-03 17:53:05 +02:00
alesapin
4e6bdb15b0
Azure policy
2024-07-03 14:35:17 +02:00
alesapin
59246cdf92
Merge remote-tracking branch 'origin/master' into unify_tests_with_object_storage
2024-07-03 14:25:59 +02:00
Nikita Fomichev
fe43ea27d2
Tests: fix timeouts handling in case of github timeout termination
2024-07-03 13:37:36 +02:00
alesapin
a2626037bc
Improve object storage tags in tests
2024-07-02 14:15:59 +02:00
Kseniia Sumarokova
ee0c4093d4
Update run.sh
2024-07-02 12:03:27 +02:00
Max K
f66c065d11
CI: JWT python module in Style check image
2024-06-24 19:16:10 +02:00
Michael Kolupaev
557cd2c08f
Escape the $
2024-06-20 18:56:06 +00:00
Michael Kolupaev
16baecf5a6
attach_gdb.lib: print registers before all stacks
2024-06-20 18:54:36 +00:00
Pablo Marcos
71f8937abd
Merge branch 'master' into system-error-log
2024-06-20 16:33:44 +00:00
Alexander Tokmakov
5798898314
Merge pull request #65309 from ClickHouse/save_server_data
...
Save server data for failed stateless tests
2024-06-18 18:46:24 +00:00
Pablo Marcos
216d26987a
Add test and config changes for system.error_log
2024-06-18 08:37:40 +00:00
Alexander Tokmakov
fb110827f8
save server data for failed stateless tests
2024-06-17 23:29:03 +02:00
Alexey Milovidov
24dfc10755
Remove outdated override in stress tests
2024-06-16 12:57:05 +02:00
Alexey Milovidov
02677892e3
Fix libunwind in CI
2024-06-13 21:03:02 +02:00
Mikhail f. Shiryaev
f1707998d2
Fix search issues for progress_func, add zstd for GH cache
2024-06-13 15:40:38 +02:00
Mikhail f. Shiryaev
94c82787c5
Add a progress function for searching PRs in changelog.py
2024-06-12 14:43:26 +02:00
Mikhail f. Shiryaev
182f85b25c
Test if unit-tests can be decreased
2024-06-11 16:09:31 +02:00
Alexey Milovidov
821c7322bd
Merge pull request #58349 from azat/ci/flake8
...
Check python code with flake8
2024-06-06 19:03:58 +02:00
Mikhail f. Shiryaev
1156233ea8
Use a proper way to download packages from releases
2024-06-06 07:24:58 +02:00
alesapin
59784a4cf2
Upload blob_storage_log from stateless tests
2024-06-05 15:04:15 +02:00
Azat Khuzhin
11905682a9
Check python code with flake8
...
Recently assert-on-tuple had been introduced in tests [1], let's prevent
this.
[1]: https://github.com/ClickHouse/ClickHouse/pull/56367#discussion_r1437098533
v2: pin flake8 to 4.0.1 (instead of originally 6.1) due to other dependencies, hope that it will find such errors
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-06-05 14:46:38 +02:00
