Commit Graph

5187 Commits

Author SHA1 Message Date
Nikita Fomichev
b6ad57aa37 Stateless tests: change status for failed tests in case of server crash 2024-07-23 10:30:00 +02:00
Michael Kolupaev
997f94169e Merge remote-tracking branch 'origin/master' into reg 2024-07-22 20:52:29 +00:00
Raúl Marín
9f86b22d30 Speed up stateful tests table setup 2024-07-22 14:42:30 +02:00
Antonio Andelic
8217dcccc1 Stop ignoring SIGSEGV in GDB 2024-07-22 09:53:56 +02:00
Alexey Milovidov
ebc05f53c3 Merge branch 'master' into better-diagnostics-in-functional-tests 2024-07-21 04:28:22 +02:00
Alexey Milovidov
444303cb71 Better diagnostics 2024-07-20 00:25:57 +02:00
Alexey Milovidov
5ae3a421e0 Copy-paste 2024-07-20 00:12:02 +02:00
Alexey Milovidov
ba6b7b86ba Log messages 2024-07-20 00:09:53 +02:00
Alexey Milovidov
134c006540 Whitespace 2024-07-20 00:08:25 +02:00
Alexey Milovidov
a373b62bbf Better diagnostics in functional tests 2024-07-20 00:04:52 +02:00
Nikita Fomichev
1e160189f0 Increase parallel jobs for stateless tests 2024-07-19 20:10:41 +02:00
Nikita Fomichev
fa2659a87c Increase CI timeout for stateless tests 2024-07-19 20:10:08 +02:00
Nikita Fomichev
7c1ed1b445 Stateless tests: check parallelization 2024-07-18 21:50:21 +02:00
Nikita Fomichev
bd10951db8 Stateless tests: tune MAX_RUN_TIME 2024-07-18 21:50:21 +02:00
Nikita Fomichev
626e1f70cb Stateful tests: decrease tests timeout 2024-07-18 21:49:47 +02:00
Yakov Olkhovskiy
f07a395bf1 Merge branch 'master' into ci-fuzzer-enable 2024-07-17 03:43:57 +00:00
Alexey Milovidov
60f45cb993 A fix 2024-07-17 03:52:35 +02:00
Alexey Milovidov
408fda417e Merge branch 'master' into fix-fasttest-expect 2024-07-17 03:51:53 +02:00
Alexey Milovidov
c913a36ed6
Minor modifications 2024-07-17 02:13:57 +02:00
Alexey Milovidov
0d1789292b
Add sudo for convenience 2024-07-17 02:11:09 +02:00
Nikita Fomichev
77c4e6ae8c Stateless tests: disable sequential tests in parallel tests 2024-07-16 12:21:08 +02:00
Alexey Milovidov
e292358ade
Update run.sh 2024-07-16 06:12:42 +02:00
Alexey Milovidov
68aedc2191 Fix something in Fast Test 2024-07-16 03:58:55 +02:00
Yakov Olkhovskiy
7de367d692 Merge branch 'master' into ci-fuzzer-enable 2024-07-15 20:58:42 +00:00
Yakov Olkhovskiy
0176e0b2ae fix 2024-07-15 19:27:54 +00:00
Yakov Olkhovskiy
5361ade8e7 optimize 2024-07-15 19:10:07 +00:00
robot-clickhouse
97c9739abc Automatic style fix 2024-07-15 17:21:59 +00:00
Yarik Briukhovetskyi
4a7c52900a
Merge branch 'master' into hive_style_partitioning 2024-07-15 19:05:21 +02:00
Yakov Olkhovskiy
50f068efe9 add dedicated runner to libfuzzer, update docker 2024-07-15 17:00:53 +00:00
Nikita Fomichev
2a0253d1e2 Tests: rename bad log names 2024-07-15 13:14:29 +02:00
Yakov Olkhovskiy
698b5ce7fa Merge branch 'master' into ci-fuzzer-enable 2024-07-14 05:31:56 +00:00
Yakov Olkhovskiy
3ccc2aed4c add fuzzer_arguments to fuzzer runner 2024-07-13 23:44:13 +00:00
Alexey Milovidov
e3a2a2e487
Merge pull request #66353 from ClickHouse/collect-minio-logs
Collect logs from `minio` in stateless and statefull tests
2024-07-13 21:34:50 +00:00
Max K
1050217445 add support for new release branch
Automatic style fix
2024-07-13 16:21:22 +02:00
Max K
f8e71707f2 update black 2024-07-13 16:21:22 +02:00
Yarik Briukhovetskyi
c09c7a4568
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-07-13 01:13:46 +02:00
Vitaly Baranov
90142b73ad
Merge pull request #66284 from vitlibar/add-stateless-test-for-grpc
Add a stateless test for gRPC protocol
2024-07-12 17:32:06 +00:00
Yarik Briukhovetskyi
17d2f8ed20
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-07-12 16:33:48 +02:00
Nikita Fomichev
258ae45aa8
Merge pull request #66411 from ClickHouse/fix-hanging-on-gdb
Stateless tests: deal with hang-ups more roughly
2024-07-12 13:25:46 +00:00
Nikita Fomichev
dd6dac6c5a Stateless tests: better sort checks in test report 2024-07-12 12:15:59 +02:00
Nikita Fomichev
f30cd12434 Stateless tests: add "Server died" check 2024-07-12 08:38:22 +02:00
Nikita Fomichev
4a56c601b2 Stateless tests: decrease CI timeout 2024-07-12 01:11:13 +02:00
Vitaly Baranov
355a56d1b0 Add a stateless test for gRPC protocol. 2024-07-11 15:36:41 +02:00
Kseniia Sumarokova
60c0957abd
Merge pull request #66290 from ClickHouse/kssenii-patch-10
Update run.sh
2024-07-11 10:45:37 +00:00
Antonio Andelic
fbb7a3ed52
Merge pull request #66281 from ClickHouse/collect-core-dumps-stateless
Collect core dumps in more tests
2024-07-11 09:45:17 +00:00
János Benjamin Antal
321a58c519 Fix relative path to mc 2024-07-11 08:33:10 +00:00
János Benjamin Antal
4729161f41 Collect logs from minio 2024-07-10 18:41:48 +00:00
Kseniia Sumarokova
e5020690be
Merge branch 'master' into kssenii-patch-10 2024-07-10 20:02:15 +02:00
Yarik Briukhovetskyi
052520fa03
Merge branch 'master' into hive_style_partitioning 2024-07-10 19:46:07 +02:00
Nikita Fomichev
481a1570aa Run sequential tests in parallel to non-sequential 2024-07-10 19:21:32 +02:00
Nikita Fomichev
2662760572 debug tests hung on gdb error 8 2024-07-10 16:38:54 +02:00
Nikita Fomichev
83cfe164bd debug tests hung on gdb error 7 2024-07-10 15:55:30 +02:00
Antonio Andelic
ccffc05681 Fix asan 2024-07-10 15:45:17 +02:00
Nikita Fomichev
ba176a9c4a debug tests hung on gdb error 6 2024-07-10 14:51:27 +02:00
Nikita Fomichev
ede43721b4 debug tests hung on gdb error 4 2024-07-10 13:30:06 +02:00
Kruglov Pavel
7b58722c07
Update setup_minio.sh 2024-07-10 13:15:44 +02:00
Antonio Andelic
1eec1fd77f Merge branch 'master' into collect-core-dumps-stateless 2024-07-10 13:01:41 +02:00
Kseniia Sumarokova
36b9a5641f
Update run.sh 2024-07-10 11:56:43 +02:00
Kseniia Sumarokova
ebc87d0c70
Update run.sh 2024-07-09 22:58:06 +02:00
Kruglov Pavel
d7f08ffdb7
Update setup_minio.sh 2024-07-09 21:01:37 +02:00
Kseniia Sumarokova
5a12659f43
Update run.sh 2024-07-09 20:18:03 +02:00
Nikita Fomichev
eeb3561c37 Stateless tests: run sequential tests in parallel to other tests 2024-07-09 19:41:06 +02:00
Yarik Briukhovetskyi
362bf4befc
Update setup_minio.sh 2024-07-09 17:30:08 +02:00
Antonio Andelic
0821d72f1c Collect core dumps in more tests 2024-07-09 17:06:37 +02:00
Yarik Briukhovetskyi
3cc6a133c6
Update setup_minio.sh 2024-07-09 12:38:16 +02:00
yariks5s
a3c4cbfce2 clang-tidy, fix cp with minio 2024-07-08 13:57:54 +00:00
Raúl Marín
18e2f0da9f Merge remote-tracking branch 'blessed/master' into fix_bugfix_checker 2024-07-08 11:23:47 +02:00
Nikita Fomichev
be8945f2a0 Merge remote-tracking branch 'origin/master' into fix-missing-tests-reports 2024-07-07 10:04:58 +02:00
alesapin
bb92716d3c
Merge pull request #66070 from ClickHouse/pin_python_packages
Pin all python packages in CI images and do some dirty job with clang version
2024-07-06 10:13:32 +00:00
Yakov Olkhovskiy
a9aaa2ab78 Merge remote-tracking branch 'origin/master' into ci-fuzzer-enable 2024-07-06 00:48:09 +00:00
alesapin
e2ff0c6809 Merge remote-tracking branch 'origin/master' into pin_python_packages 2024-07-05 22:16:08 +02:00
Raúl Marín
ad70710f4b stateless/run.sh cleanup 2024-07-05 16:45:32 +02:00
alesapin
964047bf8c Yarrrr 2024-07-05 16:31:00 +02:00
robot-clickhouse
b189902a36 Update version_date.tsv and changelogs after v24.6.2.17-stable 2024-07-05 10:50:22 +00:00
alesapin
1f07f33bd2 Less dirty still hack 2024-07-05 12:18:18 +02:00
Michael Kolupaev
90df83438f more shellcheck 2024-07-05 04:42:58 +00:00
Michael Kolupaev
158f59fd83 Merge remote-tracking branch 'origin/master' into reg 2024-07-04 19:10:07 +00:00
alesapin
e176587c59 Trying even worse fix 2024-07-04 17:16:25 +02:00
alesapin
963f39ede8 Revert "Update docker/test/fasttest/Dockerfile"
This reverts commit 1af3caf2b7.
2024-07-04 15:56:44 +02:00
alesapin
1af3caf2b7
Update docker/test/fasttest/Dockerfile
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2024-07-04 15:48:12 +02:00
alesapin
8d6c0147e2 Add comment 2024-07-04 15:30:27 +02:00
alesapin
2c77371b8b Better 2024-07-04 15:27:23 +02:00
alesapin
8040150de8 Very dirty hack 2024-07-04 14:22:30 +02:00
Antonio Andelic
975e8ee14a
Merge pull request #65910 from ClickHouse/keeper-remove-standalone-build
Remove standalone Keeper build
2024-07-04 12:14:42 +00:00
Nikita Fomichev
c4005d7e06 Fix fasttest 2024-07-03 23:13:50 +02:00
robot-clickhouse
afac188ae3 Automatic style fix 2024-07-03 20:53:04 +00:00
alesapin
31ca631ac5 Pin all python packages in CI images 2024-07-03 21:58:18 +02:00
Nikita Fomichev
a19eb86864 Review fixes 2 2024-07-03 19:39:00 +02:00
Nikita Fomichev
af845234a2 Review fixes 2024-07-03 17:53:05 +02:00
Antonio Andelic
cddd2312fb Merge branch 'master' into keeper-remove-standalone-build 2024-07-03 16:23:31 +02:00
Antonio Andelic
ce4d361cd7 Merge branch 'master' into keeper-remove-standalone-build 2024-07-03 16:23:06 +02:00
alesapin
4e6bdb15b0 Azure policy 2024-07-03 14:35:17 +02:00
alesapin
59246cdf92 Merge remote-tracking branch 'origin/master' into unify_tests_with_object_storage 2024-07-03 14:25:59 +02:00
Nikita Fomichev
fe43ea27d2 Tests: fix timeouts handling in case of github timeout termination 2024-07-03 13:37:36 +02:00
alesapin
a2626037bc Improve object storage tags in tests 2024-07-02 14:15:59 +02:00
Kseniia Sumarokova
ee0c4093d4
Update run.sh 2024-07-02 12:03:27 +02:00
robot-clickhouse
46ed186250 Update version_date.tsv and changelogs after v24.5.4.49-stable 2024-07-01 15:05:48 +00:00
Antonio Andelic
4a9daa202d Remove Keeper standalone build 2024-07-01 11:24:45 +02:00
Antonio Andelic
6b47171f2c Keeper binary with different entrypoint 2024-07-01 10:52:08 +02:00
Max K
f66c065d11 CI: JWT python module in Style check image 2024-06-24 19:16:10 +02:00
Michael Kolupaev
557cd2c08f Escape the $ 2024-06-20 18:56:06 +00:00
Michael Kolupaev
16baecf5a6 attach_gdb.lib: print registers before all stacks 2024-06-20 18:54:36 +00:00
Pablo Marcos
71f8937abd Merge branch 'master' into system-error-log 2024-06-20 16:33:44 +00:00
Alexander Tokmakov
5798898314
Merge pull request #65309 from ClickHouse/save_server_data
Save server data for failed stateless tests
2024-06-18 18:46:24 +00:00
Pablo Marcos
216d26987a Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
Alexander Tokmakov
fb110827f8 save server data for failed stateless tests 2024-06-17 23:29:03 +02:00
Alexey Milovidov
24dfc10755 Remove outdated override in stress tests 2024-06-16 12:57:05 +02:00
Alexey Milovidov
f27880eb81
Merge pull request #65240 from ClickHouse/auto/v24.5.3.5-stable
Update version_date.tsv and changelogs after v24.5.3.5-stable
2024-06-14 03:42:48 +00:00
Alexey Milovidov
e3f16ea491
Merge pull request #65247 from ClickHouse/fix-libunwind
Fix libunwind in CI
2024-06-14 00:22:15 +00:00
Alexey Milovidov
02677892e3 Fix libunwind in CI 2024-06-13 21:03:02 +02:00
robot-clickhouse
3bba8e80f1 Update version_date.tsv and changelogs after v24.5.3.5-stable 2024-06-13 17:51:46 +00:00
robot-clickhouse
833d138383 Update version_date.tsv and changelogs after v24.3.4.147-lts 2024-06-13 16:28:12 +00:00
Mikhail f. Shiryaev
f1707998d2
Fix search issues for progress_func, add zstd for GH cache 2024-06-13 15:40:38 +02:00
Mikhail f. Shiryaev
94c82787c5
Add a progress function for searching PRs in changelog.py 2024-06-12 14:43:26 +02:00
Mikhail f. Shiryaev
182f85b25c
Test if unit-tests can be decreased 2024-06-11 16:09:31 +02:00
Alexey Milovidov
821c7322bd
Merge pull request #58349 from azat/ci/flake8
Check python code with flake8
2024-06-06 19:03:58 +02:00
Mikhail f. Shiryaev
1156233ea8
Use a proper way to download packages from releases 2024-06-06 07:24:58 +02:00
alesapin
59784a4cf2 Upload blob_storage_log from stateless tests 2024-06-05 15:04:15 +02:00
Azat Khuzhin
11905682a9 Check python code with flake8
Recently assert-on-tuple had been introduced in tests [1], let's prevent
this.

  [1]: https://github.com/ClickHouse/ClickHouse/pull/56367#discussion_r1437098533

v2: pin flake8 to 4.0.1 (instead of originally 6.1) due to other dependencies, hope that it will find such errors
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-06-05 14:46:38 +02:00
Mikhail f. Shiryaev
bad3f2d384
Migrate changelog from outdated fuzzywuzzy to a new thefuzz 2024-06-04 21:29:53 +02:00
Alexey Milovidov
955db75a0d
Merge pull request #64542 from Algunenano/upgrade_tests
Upgrade tests: Update config and work with release candidates
2024-06-02 20:12:32 +02:00
robot-clickhouse
eef5875506 Update version_date.tsv and changelogs after v24.5.1.1763-stable 2024-06-01 07:48:53 +00:00
Raúl Marín
b9af76538e Upgrade test: Detect setting changes across multiple releases (RC) 2024-05-28 19:49:54 +02:00
Raúl Marín
5b6c738532 Remove old config changes 2024-05-28 17:31:49 +02:00
Nikita Mikhaylov
7c9f36ad1e
Add gh to style-check dockerfile 2024-05-22 19:46:08 +02:00
Alexey Milovidov
d5c52e08df Merge branch 'master' into retries-in-submodules 2024-05-20 17:32:00 +02:00
Azat Khuzhin
434816820d Fix upgrade settings changes check
settings changes check simply checks that the settings are either the
same, or there is a record in system.settings_changes, however, the
problem is that clickhouse-local now adjusts some settings for Pretty
format in case of stdout is not a tty, and this is the case for this
check.

So to avoid this, just run the clickhouse-local under script(1) to fool
it.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-05-20 10:19:11 +02:00
Alexey Milovidov
63f31d3c1e Add retries in git submodule update 2024-05-20 06:13:06 +02:00
Alexey Milovidov
ce4158f496
Merge pull request #64082 from ClickHouse/prevent-stack-overflow-ci
Prevent stack overflow in Fuzzer and Stress test
2024-05-20 05:14:59 +02:00
Azat Khuzhin
3743b4a2ed Fix sanitizers build by updating llvm/clang that includes fix for it
Rebuild for clang 18.1.3, that contains a workaround [1] for sanitizers
issue [2]:

    $ git tag --contains  c2a57034eff048cd36c563c8e0051db3a70991b3 | tail -1
    llvmorg-18.1.3

 [1]: c2a57034ef
 [2]: https://github.com/ClickHouse/ClickHouse/issues/64086

Since right now version is not enough:

    $ docker run --rm -it clickhouse/test-util llvm-nm-18 --version
    llvm-nm, compatible with GNU nm
    Ubuntu LLVM version 18.1.2
      Optimized build.

But I don't see any fix for TSan, only MSan, but let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-05-18 16:43:19 +02:00
Alexey Milovidov
a2d9a32652
Merge pull request #63733 from qiangxuhui/qiangxuhui-loongarch64
Initial support for loongarch64
2024-05-18 05:26:26 +02:00
Alexey Milovidov
cafd074e0a Prevent stack overflow in Fuzzer and Stress test 2024-05-18 05:11:18 +02:00
Alexey Milovidov
26501178e6 Fix analyzer 2024-05-17 10:23:32 +02:00
Robert Schulze
5fb8ea4c62
Merge remote-tracking branch 'ClickHouse/master' into qiangxuhui-loongarch64 2024-05-17 07:56:01 +00:00
qiangxuhui
c30dea2d30 Fix loongarch64's CI code 2024-05-14 11:05:55 +00:00
qiangxuhui
13508de9a4 Fix code according to review suggestions 2024-05-14 10:49:09 +00:00
qiangxuhui
537b56b139 Add loongarch64 CI support 2024-05-14 08:15:28 +00:00
divanik
faef8807d2 Resolve conflicts 2024-05-13 12:04:06 +00:00
divanik
d468a0a577 Add archives reading support to s3 2024-05-13 12:00:15 +00:00
Alexey Milovidov
a1e6d1a6a9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-11 00:42:14 +02:00
Mikhail f. Shiryaev
544875fd2f
Apply markdownfmt.sh from https://github.com/docker-library/docs 2024-05-10 10:55:24 +02:00
Mikhail f. Shiryaev
291bb14696
The Dockerfile is reviewed by docker-official
`apt-get upgrade` shouldn't be executed during the build
`apt-get clean` is a noop
`gpg` should use batch and download key by full fingreprints
The CI specific steps shouln't be presented in docker library
Using `COPY --chmod` instead of two layers is not possible yet, but
  entrypoint.sh already contains +x bit in the git repo
2024-05-10 10:54:27 +02:00
Alexey Milovidov
dd58af7d4f Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-10 07:17:39 +02:00
Konstantin Bogdanov
27551ca3c7
Add jwcrypto to integration tests runner 2024-05-09 04:08:21 +03:00
Alexey Milovidov
773654c46e Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-08 21:24:04 +02:00
Raúl Marín
92bb69e062
Merge pull request #63470 from Algunenano/stress_constraints
Extra constraints for stress and fuzzer tests
2024-05-07 15:29:25 +00:00
Raúl Marín
463f95e956 Extra constraints for stress and fuzzer tests 2024-05-07 13:47:35 +02:00
Alexey Milovidov
fd430585e1 Merge remote-tracking branch 'origin/master' into fix-coverage 2024-05-07 09:34:00 +02:00
Alexey Milovidov
5f52cb43b4 Fix coverage. 2024-05-07 09:33:47 +02:00
Alexey Milovidov
98fb9f36a9 We are using Shared Catalog in the CI Logs cluster 2024-05-07 05:35:04 +02:00