Commit Graph

3162 Commits

Author SHA1 Message Date
Alexey Milovidov
7bd89bbfce Support for inline documentation in CI 2024-10-17 13:19:09 +02:00
Max Kainov
16ad5c2bee CI: Aarch64 build with Asan 2024-10-17 11:27:37 +02:00
robot-clickhouse
4ba099cd7d Automatic style fix 2024-10-17 02:29:44 +00:00
Yakov Olkhovskiy
b8f095b626 fix upload corpus, fix s3 helper to allow listing more than 1000 2024-10-17 02:23:38 +00:00
Yakov Olkhovskiy
0b82913507 fix style 2024-10-17 01:11:45 +00:00
Yakov Olkhovskiy
84c664dada move all s3 stuff to check script 2024-10-17 01:00:27 +00:00
Mikhail f. Shiryaev
c776aebad2
Handle buddy errors in the reset backport branches 2024-10-16 18:18:21 +02:00
Yakov Olkhovskiy
7981e99bee use func-tester 2024-10-16 14:18:19 +00:00
Mikhail f. Shiryaev
6d7091c224
Add report file to the test results 2024-10-15 13:41:22 +02:00
Mikhail f. Shiryaev
450a1ecf0c
Do not report critical alarm into slack on failed run_check.py 2024-10-14 18:05:29 +02:00
Mikhail f. Shiryaev
58a249263c
Use global StatusNames.PR_CHECK 2024-10-14 17:51:02 +02:00
Mikhail f. Shiryaev
12ffb1700b
Remove indent 2024-10-11 22:40:42 +02:00
Yakov Olkhovskiy
97b3e00940 Merge branch 'master' into impl-libfuzzer-3 2024-10-09 16:36:09 +00:00
Julia Kartseva
53879083a9 Merge remote-tracking branch 'upstream/master' into interactive-metrics-table 2024-10-04 03:02:02 +00:00
Yakov Olkhovskiy
4d917d80b4 fix 2024-10-03 17:32:05 +00:00
Yakov Olkhovskiy
da5ebde4d5 add CI env 2024-10-03 16:16:39 +00:00
Max Kainov
967dfb0044 CI: Remove await feature from release branches 2024-10-03 11:04:57 +02:00
Mikhail f. Shiryaev
45475a16ee
Distribute tests by batched jobs more equally 2024-10-02 14:52:24 +02:00
Mikhail f. Shiryaev
4ed0abcb13
Add ClickhouseIntegrationTestsRunner.repo_path 2024-10-02 13:44:14 +02:00
Mikhail f. Shiryaev
004f159548
Launch BUGFIX_VALIDATE job for a set of labels 2024-10-01 18:00:27 +02:00
Mikhail f. Shiryaev
998fb7e341
Make JobConfig.run_by_label a set run_by_labels 2024-10-01 17:59:48 +02:00
robot-clickhouse
7c6ce8611c Automatic style fix 2024-09-27 10:19:49 +00:00
Mikhail f. Shiryaev
bed8a9ae07
Autofix both black and isort 2024-09-27 12:06:01 +02:00
Mikhail f. Shiryaev
dfe29a5312
Enable a few more pylint checks 2024-09-26 16:20:55 +02:00
Mikhail f. Shiryaev
c67a781725
Address the rest of minor issues 2024-09-26 16:09:55 +02:00
Mikhail f. Shiryaev
dfe27694b3
Address f-strings and too-long-lines 2024-09-26 16:09:54 +02:00
Mikhail f. Shiryaev
b9338750cb
Handle pylint global-statement 2024-09-26 16:09:54 +02:00
Mikhail f. Shiryaev
42097b0abc
Remove if-return-elif-return-else statements 2024-09-26 16:09:52 +02:00
Mikhail f. Shiryaev
117a846f87
Add pyproject.toml to is_python for style checks 2024-09-26 14:55:01 +02:00
Nikita Mikhaylov
32fa2415ba Parallel replicas is Beta 2024-09-25 10:47:56 +00:00
Mikhail f. Shiryaev
bffa6f9e42
Replace renamed files in bugfix test results 2024-09-24 12:47:50 +02:00
Mikhail f. Shiryaev
e243277e6b
Increase bugfix timeout to 40 minutes 2024-09-24 12:47:49 +02:00
Mikhail f. Shiryaev
4b8a3d9e92
Do not fail the job if an additional log is missing 2024-09-24 12:47:48 +02:00
Mikhail f. Shiryaev
8a86cbf4fe
Multiple improvements of docs_check.py
- Run the script as a current user, not root
- Add `--no-pull-image` to use a local one
- Simplify logs analyze
2024-09-23 14:35:05 +02:00
Mikhail f. Shiryaev
99976a476b
Update a log file in TeePopen on write 2024-09-23 14:33:48 +02:00
Mikhail f. Shiryaev
d986e1da19
Merge branch 'master' into html-test-ci 2024-09-23 12:30:38 +02:00
Julia Kartseva
5473e0b64b Merge remote-tracking branch 'upstream/master' into interactive-metrics-table 2024-09-19 22:34:13 +00:00
Mikhail f. Shiryaev
cb503ec2ec
Make env_helper importable from any module 2024-09-19 10:22:05 +02:00
Julia Kartseva
9c74e77d52 stress.py 2024-09-19 03:13:56 +00:00
Mikhail f. Shiryaev
fdee35cccc
Merge pull request #69557 from ClickHouse/integration-prepull-kill-runner
Kill runner when integration tests fail to pre-pull
2024-09-17 17:27:20 +00:00
Mikhail f. Shiryaev
8d5babf65f
Kill the runner process if integration tests fail to pre-pull 2024-09-12 15:26:21 +02:00
Mikhail f. Shiryaev
99ede620be
Add kill_ci_runner to ci_utils, will allow restarts 2024-09-12 15:24:25 +02:00
Mikhail f. Shiryaev
8a70017815
Merge pull request #69538 from ClickHouse/fix-latest-sync-commit
Get rid of broken `get_commits().reversed`
2024-09-12 05:34:35 +00:00
Mikhail f. Shiryaev
370ce5ef63
Get rid of broken get_commits().reversed 2024-09-11 22:37:30 +02:00
Igor Nikonov
42d3cd2b91 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-09-06 20:10:50 +00:00
robot-clickhouse
b3b8abb413 Automatic style fix 2024-09-06 09:13:48 +00:00
Igor Nikonov
2ace0c55eb Increase timeout for intergration test tsan job 2024-09-06 08:35:39 +00:00
Igor Nikonov
536e0808e3
Merge branch 'master' into pr-local-plan 2024-09-05 16:19:47 +02:00
Mikhail f. Shiryaev
94a62b1df2
Merge pull request #69260 from ClickHouse/make-worker-private
Make infrastructure related scripts private
2024-09-05 12:49:30 +00:00
Max K.
708d5bbc2d
Merge pull request #69257 from ClickHouse/ci_stress_to_func_runners
CI: Merge stress and func runners type
2024-09-04 13:32:58 +00:00
Mikhail f. Shiryaev
63931be6a0
Make infrastructure related scripts private 2024-09-04 15:28:35 +02:00
Mikhail f. Shiryaev
938b5ba0ed
Merge pull request #69252 from Algunenano/backport_pr
Backports should read tags from its repo only
2024-09-04 12:43:58 +00:00
Max Kainov
ea7cff43f6 CI: Merge stress and func runners type 2024-09-04 14:21:44 +02:00
Raúl Marín
3807bea354 Backports should read tags from its repo only 2024-09-04 13:28:04 +02:00
Igor Nikonov
3898f52868 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-09-04 11:15:54 +00:00
Max K.
a3e5a3cd10
Merge pull request #69181 from ClickHouse/ci_rerun_check_rollback
CI: Rerun check: do not check if manual rerun
2024-09-04 08:29:54 +00:00
Antonio Andelic
a5d7298446
Merge pull request #69199 from ClickHouse/fix-jepsen-aarch64
Fix jepsen for aarch64
2024-09-04 07:48:40 +00:00
Igor Nikonov
8629f7e592
Merge branch 'master' into pr-local-plan 2024-09-03 22:43:20 +02:00
Ilya Yatsishin
959e8567bb
Merge pull request #68380 from qoega/improve-integration-tests-5
Rework integration test flaky tests runner to split per module as a separate group
2024-09-03 16:38:17 +00:00
Antonio Andelic
2ae4cf375b Fix jepsen for aarch64 2024-09-03 15:24:11 +02:00
Igor Nikonov
d0d2509c69
Merge branch 'master' into pr-local-plan 2024-09-03 13:31:36 +02:00
Max Kainov
214f8a0102 CI: Rerun check: do not check if manual rerun 2024-09-03 11:44:25 +02:00
Max Kainov
c6b2d81af7 fix flaky check results processing 2024-09-03 10:25:10 +02:00
Igor Nikonov
db8ce31bb7 Increase flaky check timeout 2024-09-02 14:08:22 +00:00
Nikita Mikhaylov
cbf8271254 Better 2024-08-30 15:45:51 +02:00
Yatsishin Ilya
82eae9f09f tune 2024-08-28 16:18:57 +00:00
Yatsishin Ilya
fc2aade699 Merge remote-tracking branch 'qoega/improve-integration-tests-5' into improve-integration-tests-5 2024-08-27 11:33:26 +00:00
Yatsishin Ilya
6c84f9ccfb Merge remote-tracking branch 'origin/master' into improve-integration-tests-5 2024-08-27 11:28:32 +00:00
robot-clickhouse
0ad66778da Automatic style fix 2024-08-27 10:19:30 +00:00
Max Kainov
94f168e5ef CI: Fix job rerun check 2024-08-27 12:13:21 +02:00
Ilya Yatsishin
f9f960a5ed
Update ci_config.py 2024-08-26 22:04:54 +02:00
Ilya Yatsishin
34d13bd746
Update ci_config.py 2024-08-26 19:33:04 +02:00
Max Kainov
d799a0b6ee increase timeout for flaky check 2024-08-26 18:43:21 +02:00
Max Kainov
9339c0593b handle timeout in flaky check 2024-08-26 13:37:37 +02:00
Yatsishin Ilya
66be44e7aa better 2024-08-23 19:09:09 +00:00
Max K.
b5406a4be1
Merge pull request #68751 from ClickHouse/ci_rerun_check_upd
CI: Make job rerun possible if triggered manually
2024-08-23 10:20:14 +00:00
Max K.
894bbbf021
Merge pull request #68654 from ClickHouse/ci_fix_sqllogic
CI: Disable SQLLogic job
2024-08-23 09:29:02 +00:00
Max Kainov
f5739dfe06 CI: Make job rerun possible if triggered manually 2024-08-23 02:58:50 +02:00
Max Kainov
fa453c3664 Disable SqlLogic job 2024-08-22 18:20:33 +02:00
Max K.
72400a58b7
Merge pull request #68685 from ClickHouse/ci_integration_tests_asan_3h
CI: Integration tests timeout to 3h
2024-08-21 21:28:55 +00:00
Max K.
a9880f3ab5
Merge pull request #68683 from ClickHouse/ci_binary_tidy_4h_limit
CI: Binary tidy timeout 3h -> 4h
2024-08-21 20:48:55 +00:00
Max Kainov
a1f312495d CI: Integration tests timeout to 3h 2024-08-21 22:36:00 +02:00
Max Kainov
6e5465ae51 CI: SQLLogix job fix 2024-08-21 22:31:48 +02:00
Max Kainov
725f1791f4 CI: Binary tidy timeout 3h -> 4h 2024-08-21 21:34:25 +02:00
Max K.
8599a9f3c5
Merge pull request #68525 from ClickHouse/ci_autoreleases_continue
CI: Auto Releases in prod
2024-08-21 15:14:02 +00:00
Max Kainov
653c978dfa autorelease to check builds and functional tests 2024-08-20 13:45:52 +02:00
Max Kainov
9b55180184 CI: Move out scripts from dockers 2024-08-20 10:17:17 +02:00
Yatsishin Ilya
718957886d Merge remote-tracking branch 'origin/master' into improve-integration-tests-5 2024-08-19 16:32:08 +00:00
Max Kainov
cc8a40ef98 CI: tidy build timeout 2h -> 3h 2024-08-19 17:23:50 +02:00
Ilya Yatsishin
65087d88b5 Merge remote-tracking branch 'origin/master' into improve-integration-tests-5 2024-08-19 14:11:54 +02:00
Max Kainov
dde7ee29fc sort tests in report by status 2024-08-18 15:54:23 +02:00
Max Kainov
1deeca40db Handling timeout in integration tests 2024-08-18 15:54:23 +02:00
Max Kainov
66fa5a154a tune timeouts, batches 2024-08-18 15:54:23 +02:00
Max Kainov
8e35b082b2 teepopen fix 2024-08-18 15:54:23 +02:00
Max Kainov
427016a450 CI: Functional tests to store artifacts on timeout 2024-08-18 15:54:23 +02:00
Max Kainov
a42b12725a CI: Native build for package_aarch64 2024-08-17 18:53:43 +02:00
Max Kainov
5ff4d990e1 CI: Auto Releases in prod 2024-08-16 12:34:54 +02:00
Ilya Yatsishin
7c691cbb79 style 2024-08-16 10:44:11 +02:00
Ilya Yatsishin
1d2aa037b8 Merge remote-tracking branch 'origin/master' into improve-integration-tests-5 2024-08-15 18:48:10 +02:00
Yatsishin Ilya
d31b36ca50 Rework integration flaky check as it was timeouting too fast as run as a single group 2024-08-15 07:16:01 +00:00
Max Kainov
5e037e5ba8 CI: Minor fixes for changelog and release exceptions 2024-08-14 20:45:50 +02:00
Max Kainov
962bf1d821 CI: Fix for critical bug fix regex 2024-08-14 13:37:14 +02:00
Max K.
a51f867ce0
Merge pull request #68294 from ClickHouse/ci_create_new_release_branch
CI: Create new release branch workflow updates
2024-08-14 10:01:47 +00:00
Max Kainov
0c9e1a061f CI: Create new release branch workflow updates 2024-08-14 00:14:13 +02:00
Yakov Olkhovskiy
3e8a177622
Merge pull request #61908 from ClickHouse/ci-fuzzer-enable
CI: enable libfuzzer (fixing build and docker)
2024-08-13 14:22:09 +00:00
János Benjamin Antal
ac6826392d
Merge pull request #67554 from ClickHouse/fix-message-queue-sink-from-http-interface
Fix message queue sink from http interface
2024-08-12 21:29:14 +00:00
János Benjamin Antal
6cde029ed9 Fix style 2024-08-12 13:48:44 +00:00
János Benjamin Antal
34643ee16c Run test only from modified files 2024-08-12 13:30:25 +00:00
Robert Schulze
037a1006fd
Merge remote-tracking branch 'ClickHouse/master' into ci-fuzzer-enable 2024-08-12 12:28:32 +00:00
János Benjamin Antal
613ebe367c Only add extra cell when necessary 2024-08-10 22:05:11 +00:00
Nikita Fomichev
4a31ccd653
Merge pull request #68013 from ClickHouse/pass-job-timeout-to-tests
CI: Pass job timeout into tests config
2024-08-10 10:38:41 +00:00
János Benjamin Antal
8cf5f6d616 Add empty cell to reports when time is missing 2024-08-09 13:20:05 +00:00
Max K.
706144a4ba
Merge pull request #68022 from ClickHouse/ci_pr_filter_job_fix
CI: Fix for filtering jobs in PRs
2024-08-08 09:19:26 +00:00
Nikita Fomichev
59b737c9ac CI: set correct timeout for stateless tests 2024-08-08 10:50:14 +02:00
Max K.
01b6d4043b
Merge pull request #67978 from ClickHouse/ci_integration_tests_uncover_logs
CI: Integration tests uncover some logging
2024-08-08 08:45:23 +00:00
Max K.
beb43734ae
Merge pull request #67898 from ClickHouse/ci_mergeable_check_fix_2
CI: Fix for setting Mergeable Check from sync
2024-08-08 08:20:01 +00:00
Max Kainov
59a63cd110 CI: Fix for filtering jobs in PRs 2024-08-08 09:56:31 +02:00
Nikita Fomichev
55ad7d3094 Fix stylelint 2024-08-08 00:08:12 +02:00
Nikita Fomichev
086b3d240d CI: push CI 2024-08-07 23:34:36 +02:00
Nikita Fomichev
1dece979fe CI: pass job timout into tests 2024-08-07 23:22:05 +02:00
Alexey Milovidov
8b3e85dd8d
Merge pull request #67785 from arenadata/ADQM-FixedTestRaceCondition
Fixed session_log related tests race condition on logout
2024-08-07 20:01:48 +00:00
Yakov Olkhovskiy
b246f7c17c merge master 2024-08-07 16:25:31 +00:00
Max K.
ebc4ef393b
Merge pull request #67986 from ClickHouse/revert-67934-ci_strict_job_timeout
Revert "CI: Strict job timeout 1.5h for tests, 2h for builds"
2024-08-07 14:33:16 +00:00
Max K.
b8fec3bce4
Merge pull request #67923 from ClickHouse/ci_buddy_with_channel_dispatcher
CI: CiBuddy with channel dispatcher
2024-08-07 14:21:02 +00:00
Max K.
9a812fc535
Revert "CI: Strict job timeout 1.5h for tests, 2h for builds" 2024-08-07 15:55:03 +02:00
Max Kainov
016d1fea6d CI: Integration tests uncover some logging 2024-08-07 13:58:03 +02:00
Raúl Marín
c9340cba32
Merge pull request #67622 from Algunenano/unit_test_asan
Don't run ASAN unit tests under gdb
2024-08-07 10:48:00 +00:00
Alexey Milovidov
65297524de
Merge pull request #67934 from ClickHouse/ci_strict_job_timeout
CI: Strict job timeout 1.5h for tests, 2h for builds
2024-08-06 22:50:39 +00:00
Max K.
a15fb8be75
Merge pull request #67919 from ClickHouse/ci_no_critical_bug_fix_in_changleog
CI: Changelog: Critical Bug Fix to Bug Fix
2024-08-06 20:11:55 +00:00
Robert Schulze
4cdb6db1b7
Merge pull request #67855 from azat/ci/fix-use_query_cache-stressing
Fix query cache randomization in stress tests
2024-08-06 17:59:10 +00:00
Max Kainov
f0fdba3bbe CI: Strict job timeout 1.5h for tests, 2h for builds 2024-08-06 19:02:49 +02:00
robot-clickhouse
e1e298f14e Automatic style fix 2024-08-06 14:57:04 +00:00
Max Kainov
f2591bd1a6 CI: CiBuddy with channel dispatcher 2024-08-06 16:55:04 +02:00
Max Kainov
dbcc5cf133 CI: Changelog: Critical Bug Fix to Bug Fix 2024-08-06 15:39:08 +02:00
Max Kainov
913b902864 CI: Fix for setting Mergeable Check from sync 2024-08-06 14:11:37 +02:00
Max K.
8cca8ecb34
Merge pull request #67101 from ClickHouse/ci_mergeable_check_fix
CI: CheckReadyForMerge fixes
2024-08-06 11:08:45 +00:00
Azat Khuzhin
27569815d5 Fix query cache randomization in stress tests
Right now it fails with [1]:

    2024.08.05 12:53:53.659422 [ 3559 ] {123237a2-5f08-47e4-996e-21e20bc4a51a} <Error> executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.8.1.1356) (from [::1]:42534) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

    Uexpected exception, will not retry:  HTTPError :  Code: 500. Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.8.1.1356)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/67737/e68c9c8d16f37f6c25739076c9b071ed97952269/stress_test__asan_/stress_test_run_10.txt

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 11:38:55 +02:00
Raúl Marín
25fa63f7e6 Merge remote-tracking branch 'blessed/master' into unit_test_asan 2024-08-06 11:19:57 +02:00
Alexey Milovidov
8e19f46829
Merge pull request #67706 from ClickHouse/ci_minot_utils_refactoring
CI: Minor refactoring in ci_utils
2024-08-05 21:34:43 +00:00
Max K
529f21c6b8 CI: CheckReadyForMerge fixes 2024-08-05 20:41:16 +02:00
Raúl Marín
a296beb390 Unit test: Mark as FAILURE if retcode != 0 2024-08-05 13:31:53 +02:00
Max K
67bddde628 move Check Descriptions to commit_status_helper 2024-08-05 13:18:37 +02:00
Azat Khuzhin
cdbc4f3573 ci: fail the test if the entrypoint script failed
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 11:16:08 +02:00
Alexey Gerasimchuck
e5134e14ea Disabled parallel run 2024-08-05 07:59:51 +00:00
Max K
3dedd8d76b CI: Minor refactoring in ci_utils 2024-08-03 21:19:51 +02:00
Alexey Milovidov
4a10d26eb1
Merge pull request #67696 from ClickHouse/fix-test-reports
Fix check names in test reports and the CI Logs database
2024-08-03 14:55:03 +02:00
robot-clickhouse
a45ba44dba Automatic style fix 2024-08-02 18:28:46 +00:00
Max K
b282be83c5 remove old workflows 2024-08-02 20:26:04 +02:00
Alexey Milovidov
675afda172 Fix check names in the CI Logs database 2024-08-02 20:22:08 +02:00
Alexey Milovidov
bd3606dac4 Fix typos 2024-08-02 20:17:07 +02:00