Yakov Olkhovskiy
84c664dada
move all s3 stuff to check script
2024-10-17 01:00:27 +00:00
Mikhail f. Shiryaev
c776aebad2
Handle buddy errors in the reset backport branches
2024-10-16 18:18:21 +02:00
Yakov Olkhovskiy
7981e99bee
use func-tester
2024-10-16 14:18:19 +00:00
Mikhail f. Shiryaev
6d7091c224
Add report file to the test results
2024-10-15 13:41:22 +02:00
Mikhail f. Shiryaev
450a1ecf0c
Do not report critical alarm into slack on failed run_check.py
2024-10-14 18:05:29 +02:00
Mikhail f. Shiryaev
58a249263c
Use global StatusNames.PR_CHECK
2024-10-14 17:51:02 +02:00
Mikhail f. Shiryaev
12ffb1700b
Remove indent
2024-10-11 22:40:42 +02:00
Yakov Olkhovskiy
97b3e00940
Merge branch 'master' into impl-libfuzzer-3
2024-10-09 16:36:09 +00:00
Julia Kartseva
53879083a9
Merge remote-tracking branch 'upstream/master' into interactive-metrics-table
2024-10-04 03:02:02 +00:00
Yakov Olkhovskiy
4d917d80b4
fix
2024-10-03 17:32:05 +00:00
Yakov Olkhovskiy
da5ebde4d5
add CI env
2024-10-03 16:16:39 +00:00
Max Kainov
967dfb0044
CI: Remove await feature from release branches
2024-10-03 11:04:57 +02:00
Mikhail f. Shiryaev
45475a16ee
Distribute tests by batched jobs more equally
2024-10-02 14:52:24 +02:00
Mikhail f. Shiryaev
4ed0abcb13
Add ClickhouseIntegrationTestsRunner.repo_path
2024-10-02 13:44:14 +02:00
Mikhail f. Shiryaev
004f159548
Launch BUGFIX_VALIDATE job for a set of labels
2024-10-01 18:00:27 +02:00
Mikhail f. Shiryaev
998fb7e341
Make JobConfig.run_by_label a set run_by_labels
2024-10-01 17:59:48 +02:00
robot-clickhouse
7c6ce8611c
Automatic style fix
2024-09-27 10:19:49 +00:00
Mikhail f. Shiryaev
bed8a9ae07
Autofix both black and isort
2024-09-27 12:06:01 +02:00
Mikhail f. Shiryaev
dfe29a5312
Enable a few more pylint checks
2024-09-26 16:20:55 +02:00
Mikhail f. Shiryaev
c67a781725
Address the rest of minor issues
2024-09-26 16:09:55 +02:00
Mikhail f. Shiryaev
dfe27694b3
Address f-strings and too-long-lines
2024-09-26 16:09:54 +02:00
Mikhail f. Shiryaev
b9338750cb
Handle pylint global-statement
2024-09-26 16:09:54 +02:00
Mikhail f. Shiryaev
42097b0abc
Remove if-return-elif-return-else statements
2024-09-26 16:09:52 +02:00
Mikhail f. Shiryaev
117a846f87
Add pyproject.toml to is_python for style checks
2024-09-26 14:55:01 +02:00
Nikita Mikhaylov
32fa2415ba
Parallel replicas is Beta
2024-09-25 10:47:56 +00:00
Mikhail f. Shiryaev
bffa6f9e42
Replace renamed files in bugfix test results
2024-09-24 12:47:50 +02:00
Mikhail f. Shiryaev
e243277e6b
Increase bugfix timeout to 40 minutes
2024-09-24 12:47:49 +02:00
Mikhail f. Shiryaev
4b8a3d9e92
Do not fail the job if an additional log is missing
2024-09-24 12:47:48 +02:00
Mikhail f. Shiryaev
8a86cbf4fe
Multiple improvements of docs_check.py
...
- Run the script as a current user, not root
- Add `--no-pull-image` to use a local one
- Simplify logs analyze
2024-09-23 14:35:05 +02:00
Mikhail f. Shiryaev
99976a476b
Update a log file in TeePopen on write
2024-09-23 14:33:48 +02:00
Mikhail f. Shiryaev
d986e1da19
Merge branch 'master' into html-test-ci
2024-09-23 12:30:38 +02:00
Julia Kartseva
5473e0b64b
Merge remote-tracking branch 'upstream/master' into interactive-metrics-table
2024-09-19 22:34:13 +00:00
Mikhail f. Shiryaev
cb503ec2ec
Make env_helper importable from any module
2024-09-19 10:22:05 +02:00
Julia Kartseva
9c74e77d52
stress.py
2024-09-19 03:13:56 +00:00
Mikhail f. Shiryaev
fdee35cccc
Merge pull request #69557 from ClickHouse/integration-prepull-kill-runner
...
Kill runner when integration tests fail to pre-pull
2024-09-17 17:27:20 +00:00
Mikhail f. Shiryaev
8d5babf65f
Kill the runner process if integration tests fail to pre-pull
2024-09-12 15:26:21 +02:00
Mikhail f. Shiryaev
99ede620be
Add kill_ci_runner to ci_utils, will allow restarts
2024-09-12 15:24:25 +02:00
Mikhail f. Shiryaev
8a70017815
Merge pull request #69538 from ClickHouse/fix-latest-sync-commit
...
Get rid of broken `get_commits().reversed`
2024-09-12 05:34:35 +00:00
Mikhail f. Shiryaev
370ce5ef63
Get rid of broken get_commits().reversed
2024-09-11 22:37:30 +02:00
Igor Nikonov
42d3cd2b91
Merge remote-tracking branch 'origin/master' into pr-local-plan
2024-09-06 20:10:50 +00:00
robot-clickhouse
b3b8abb413
Automatic style fix
2024-09-06 09:13:48 +00:00
Igor Nikonov
2ace0c55eb
Increase timeout for intergration test tsan job
2024-09-06 08:35:39 +00:00
Igor Nikonov
536e0808e3
Merge branch 'master' into pr-local-plan
2024-09-05 16:19:47 +02:00
Mikhail f. Shiryaev
94a62b1df2
Merge pull request #69260 from ClickHouse/make-worker-private
...
Make infrastructure related scripts private
2024-09-05 12:49:30 +00:00
Max K.
708d5bbc2d
Merge pull request #69257 from ClickHouse/ci_stress_to_func_runners
...
CI: Merge stress and func runners type
2024-09-04 13:32:58 +00:00
Mikhail f. Shiryaev
63931be6a0
Make infrastructure related scripts private
2024-09-04 15:28:35 +02:00
Mikhail f. Shiryaev
938b5ba0ed
Merge pull request #69252 from Algunenano/backport_pr
...
Backports should read tags from its repo only
2024-09-04 12:43:58 +00:00
Max Kainov
ea7cff43f6
CI: Merge stress and func runners type
2024-09-04 14:21:44 +02:00
Raúl Marín
3807bea354
Backports should read tags from its repo only
2024-09-04 13:28:04 +02:00
Igor Nikonov
3898f52868
Merge remote-tracking branch 'origin/master' into pr-local-plan
2024-09-04 11:15:54 +00:00
Max K.
a3e5a3cd10
Merge pull request #69181 from ClickHouse/ci_rerun_check_rollback
...
CI: Rerun check: do not check if manual rerun
2024-09-04 08:29:54 +00:00
Antonio Andelic
a5d7298446
Merge pull request #69199 from ClickHouse/fix-jepsen-aarch64
...
Fix jepsen for aarch64
2024-09-04 07:48:40 +00:00
Igor Nikonov
8629f7e592
Merge branch 'master' into pr-local-plan
2024-09-03 22:43:20 +02:00
Ilya Yatsishin
959e8567bb
Merge pull request #68380 from qoega/improve-integration-tests-5
...
Rework integration test flaky tests runner to split per module as a separate group
2024-09-03 16:38:17 +00:00
Antonio Andelic
2ae4cf375b
Fix jepsen for aarch64
2024-09-03 15:24:11 +02:00
Igor Nikonov
d0d2509c69
Merge branch 'master' into pr-local-plan
2024-09-03 13:31:36 +02:00
Max Kainov
214f8a0102
CI: Rerun check: do not check if manual rerun
2024-09-03 11:44:25 +02:00
Max Kainov
c6b2d81af7
fix flaky check results processing
2024-09-03 10:25:10 +02:00
Igor Nikonov
db8ce31bb7
Increase flaky check timeout
2024-09-02 14:08:22 +00:00
Nikita Mikhaylov
cbf8271254
Better
2024-08-30 15:45:51 +02:00
Yatsishin Ilya
82eae9f09f
tune
2024-08-28 16:18:57 +00:00
Yatsishin Ilya
fc2aade699
Merge remote-tracking branch 'qoega/improve-integration-tests-5' into improve-integration-tests-5
2024-08-27 11:33:26 +00:00
Yatsishin Ilya
6c84f9ccfb
Merge remote-tracking branch 'origin/master' into improve-integration-tests-5
2024-08-27 11:28:32 +00:00
robot-clickhouse
0ad66778da
Automatic style fix
2024-08-27 10:19:30 +00:00
Max Kainov
94f168e5ef
CI: Fix job rerun check
2024-08-27 12:13:21 +02:00
Ilya Yatsishin
f9f960a5ed
Update ci_config.py
2024-08-26 22:04:54 +02:00
Ilya Yatsishin
34d13bd746
Update ci_config.py
2024-08-26 19:33:04 +02:00
Max Kainov
d799a0b6ee
increase timeout for flaky check
2024-08-26 18:43:21 +02:00
Max Kainov
9339c0593b
handle timeout in flaky check
2024-08-26 13:37:37 +02:00
Yatsishin Ilya
66be44e7aa
better
2024-08-23 19:09:09 +00:00
Max K.
b5406a4be1
Merge pull request #68751 from ClickHouse/ci_rerun_check_upd
...
CI: Make job rerun possible if triggered manually
2024-08-23 10:20:14 +00:00
Max K.
894bbbf021
Merge pull request #68654 from ClickHouse/ci_fix_sqllogic
...
CI: Disable SQLLogic job
2024-08-23 09:29:02 +00:00
Max Kainov
f5739dfe06
CI: Make job rerun possible if triggered manually
2024-08-23 02:58:50 +02:00
Max Kainov
fa453c3664
Disable SqlLogic job
2024-08-22 18:20:33 +02:00
Max K.
72400a58b7
Merge pull request #68685 from ClickHouse/ci_integration_tests_asan_3h
...
CI: Integration tests timeout to 3h
2024-08-21 21:28:55 +00:00
Max K.
a9880f3ab5
Merge pull request #68683 from ClickHouse/ci_binary_tidy_4h_limit
...
CI: Binary tidy timeout 3h -> 4h
2024-08-21 20:48:55 +00:00
Max Kainov
a1f312495d
CI: Integration tests timeout to 3h
2024-08-21 22:36:00 +02:00
Max Kainov
6e5465ae51
CI: SQLLogix job fix
2024-08-21 22:31:48 +02:00
Max Kainov
725f1791f4
CI: Binary tidy timeout 3h -> 4h
2024-08-21 21:34:25 +02:00
Max K.
8599a9f3c5
Merge pull request #68525 from ClickHouse/ci_autoreleases_continue
...
CI: Auto Releases in prod
2024-08-21 15:14:02 +00:00
Max Kainov
653c978dfa
autorelease to check builds and functional tests
2024-08-20 13:45:52 +02:00
Max Kainov
9b55180184
CI: Move out scripts from dockers
2024-08-20 10:17:17 +02:00
Yatsishin Ilya
718957886d
Merge remote-tracking branch 'origin/master' into improve-integration-tests-5
2024-08-19 16:32:08 +00:00
Max Kainov
cc8a40ef98
CI: tidy build timeout 2h -> 3h
2024-08-19 17:23:50 +02:00
Ilya Yatsishin
65087d88b5
Merge remote-tracking branch 'origin/master' into improve-integration-tests-5
2024-08-19 14:11:54 +02:00
Max Kainov
dde7ee29fc
sort tests in report by status
2024-08-18 15:54:23 +02:00
Max Kainov
1deeca40db
Handling timeout in integration tests
2024-08-18 15:54:23 +02:00
Max Kainov
66fa5a154a
tune timeouts, batches
2024-08-18 15:54:23 +02:00
Max Kainov
8e35b082b2
teepopen fix
2024-08-18 15:54:23 +02:00
Max Kainov
427016a450
CI: Functional tests to store artifacts on timeout
2024-08-18 15:54:23 +02:00
Max Kainov
a42b12725a
CI: Native build for package_aarch64
2024-08-17 18:53:43 +02:00
Max Kainov
5ff4d990e1
CI: Auto Releases in prod
2024-08-16 12:34:54 +02:00
Ilya Yatsishin
7c691cbb79
style
2024-08-16 10:44:11 +02:00
Ilya Yatsishin
1d2aa037b8
Merge remote-tracking branch 'origin/master' into improve-integration-tests-5
2024-08-15 18:48:10 +02:00
Yatsishin Ilya
d31b36ca50
Rework integration flaky check as it was timeouting too fast as run as a single group
2024-08-15 07:16:01 +00:00
Max Kainov
5e037e5ba8
CI: Minor fixes for changelog and release exceptions
2024-08-14 20:45:50 +02:00
Max Kainov
962bf1d821
CI: Fix for critical bug fix regex
2024-08-14 13:37:14 +02:00
Max K.
a51f867ce0
Merge pull request #68294 from ClickHouse/ci_create_new_release_branch
...
CI: Create new release branch workflow updates
2024-08-14 10:01:47 +00:00
Max Kainov
0c9e1a061f
CI: Create new release branch workflow updates
2024-08-14 00:14:13 +02:00
Yakov Olkhovskiy
3e8a177622
Merge pull request #61908 from ClickHouse/ci-fuzzer-enable
...
CI: enable libfuzzer (fixing build and docker)
2024-08-13 14:22:09 +00:00
János Benjamin Antal
ac6826392d
Merge pull request #67554 from ClickHouse/fix-message-queue-sink-from-http-interface
...
Fix message queue sink from http interface
2024-08-12 21:29:14 +00:00
János Benjamin Antal
6cde029ed9
Fix style
2024-08-12 13:48:44 +00:00
János Benjamin Antal
34643ee16c
Run test only from modified files
2024-08-12 13:30:25 +00:00
Robert Schulze
037a1006fd
Merge remote-tracking branch 'ClickHouse/master' into ci-fuzzer-enable
2024-08-12 12:28:32 +00:00
János Benjamin Antal
613ebe367c
Only add extra cell when necessary
2024-08-10 22:05:11 +00:00
Nikita Fomichev
4a31ccd653
Merge pull request #68013 from ClickHouse/pass-job-timeout-to-tests
...
CI: Pass job timeout into tests config
2024-08-10 10:38:41 +00:00
János Benjamin Antal
8cf5f6d616
Add empty cell to reports when time is missing
2024-08-09 13:20:05 +00:00
Max K.
706144a4ba
Merge pull request #68022 from ClickHouse/ci_pr_filter_job_fix
...
CI: Fix for filtering jobs in PRs
2024-08-08 09:19:26 +00:00
Nikita Fomichev
59b737c9ac
CI: set correct timeout for stateless tests
2024-08-08 10:50:14 +02:00
Max K.
01b6d4043b
Merge pull request #67978 from ClickHouse/ci_integration_tests_uncover_logs
...
CI: Integration tests uncover some logging
2024-08-08 08:45:23 +00:00
Max K.
beb43734ae
Merge pull request #67898 from ClickHouse/ci_mergeable_check_fix_2
...
CI: Fix for setting Mergeable Check from sync
2024-08-08 08:20:01 +00:00
Max Kainov
59a63cd110
CI: Fix for filtering jobs in PRs
2024-08-08 09:56:31 +02:00
Nikita Fomichev
55ad7d3094
Fix stylelint
2024-08-08 00:08:12 +02:00
Nikita Fomichev
086b3d240d
CI: push CI
2024-08-07 23:34:36 +02:00
Nikita Fomichev
1dece979fe
CI: pass job timout into tests
2024-08-07 23:22:05 +02:00
Alexey Milovidov
8b3e85dd8d
Merge pull request #67785 from arenadata/ADQM-FixedTestRaceCondition
...
Fixed session_log related tests race condition on logout
2024-08-07 20:01:48 +00:00
Yakov Olkhovskiy
b246f7c17c
merge master
2024-08-07 16:25:31 +00:00
Max K.
ebc4ef393b
Merge pull request #67986 from ClickHouse/revert-67934-ci_strict_job_timeout
...
Revert "CI: Strict job timeout 1.5h for tests, 2h for builds"
2024-08-07 14:33:16 +00:00
Max K.
b8fec3bce4
Merge pull request #67923 from ClickHouse/ci_buddy_with_channel_dispatcher
...
CI: CiBuddy with channel dispatcher
2024-08-07 14:21:02 +00:00
Max K.
9a812fc535
Revert "CI: Strict job timeout 1.5h for tests, 2h for builds"
2024-08-07 15:55:03 +02:00
Max Kainov
016d1fea6d
CI: Integration tests uncover some logging
2024-08-07 13:58:03 +02:00
Raúl Marín
c9340cba32
Merge pull request #67622 from Algunenano/unit_test_asan
...
Don't run ASAN unit tests under gdb
2024-08-07 10:48:00 +00:00
Alexey Milovidov
65297524de
Merge pull request #67934 from ClickHouse/ci_strict_job_timeout
...
CI: Strict job timeout 1.5h for tests, 2h for builds
2024-08-06 22:50:39 +00:00
Max K.
a15fb8be75
Merge pull request #67919 from ClickHouse/ci_no_critical_bug_fix_in_changleog
...
CI: Changelog: Critical Bug Fix to Bug Fix
2024-08-06 20:11:55 +00:00
Robert Schulze
4cdb6db1b7
Merge pull request #67855 from azat/ci/fix-use_query_cache-stressing
...
Fix query cache randomization in stress tests
2024-08-06 17:59:10 +00:00
Max Kainov
f0fdba3bbe
CI: Strict job timeout 1.5h for tests, 2h for builds
2024-08-06 19:02:49 +02:00
robot-clickhouse
e1e298f14e
Automatic style fix
2024-08-06 14:57:04 +00:00
Max Kainov
f2591bd1a6
CI: CiBuddy with channel dispatcher
2024-08-06 16:55:04 +02:00
Max Kainov
dbcc5cf133
CI: Changelog: Critical Bug Fix to Bug Fix
2024-08-06 15:39:08 +02:00
Max Kainov
913b902864
CI: Fix for setting Mergeable Check from sync
2024-08-06 14:11:37 +02:00
Max K.
8cca8ecb34
Merge pull request #67101 from ClickHouse/ci_mergeable_check_fix
...
CI: CheckReadyForMerge fixes
2024-08-06 11:08:45 +00:00
Azat Khuzhin
27569815d5
Fix query cache randomization in stress tests
...
Right now it fails with [1]:
2024.08.05 12:53:53.659422 [ 3559 ] {123237a2-5f08-47e4-996e-21e20bc4a51a} <Error> executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.8.1.1356) (from [::1]:42534) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):
Uexpected exception, will not retry: HTTPError : Code: 500. Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.8.1.1356)
[1]: https://s3.amazonaws.com/clickhouse-test-reports/67737/e68c9c8d16f37f6c25739076c9b071ed97952269/stress_test__asan_/stress_test_run_10.txt
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 11:38:55 +02:00
Raúl Marín
25fa63f7e6
Merge remote-tracking branch 'blessed/master' into unit_test_asan
2024-08-06 11:19:57 +02:00
Alexey Milovidov
8e19f46829
Merge pull request #67706 from ClickHouse/ci_minot_utils_refactoring
...
CI: Minor refactoring in ci_utils
2024-08-05 21:34:43 +00:00
Max K
529f21c6b8
CI: CheckReadyForMerge fixes
2024-08-05 20:41:16 +02:00
Raúl Marín
a296beb390
Unit test: Mark as FAILURE if retcode != 0
2024-08-05 13:31:53 +02:00
Max K
67bddde628
move Check Descriptions to commit_status_helper
2024-08-05 13:18:37 +02:00
Azat Khuzhin
cdbc4f3573
ci: fail the test if the entrypoint script failed
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 11:16:08 +02:00
Alexey Gerasimchuck
e5134e14ea
Disabled parallel run
2024-08-05 07:59:51 +00:00
Max K
3dedd8d76b
CI: Minor refactoring in ci_utils
2024-08-03 21:19:51 +02:00
Alexey Milovidov
4a10d26eb1
Merge pull request #67696 from ClickHouse/fix-test-reports
...
Fix check names in test reports and the CI Logs database
2024-08-03 14:55:03 +02:00
robot-clickhouse
a45ba44dba
Automatic style fix
2024-08-02 18:28:46 +00:00
Max K
b282be83c5
remove old workflows
2024-08-02 20:26:04 +02:00
Alexey Milovidov
675afda172
Fix check names in the CI Logs database
2024-08-02 20:22:08 +02:00
Alexey Milovidov
bd3606dac4
Fix typos
2024-08-02 20:17:07 +02:00
Alexey Milovidov
2c9b61d047
Miscellaneous
2024-08-02 20:16:44 +02:00
Alexey Milovidov
ce39957983
Remove capitalization in test reports
2024-08-02 20:11:25 +02:00
Max K
cebb366838
more fixes
2024-08-02 18:23:52 +02:00
Raúl Marín
900e08d6e7
Try fix
2024-08-02 11:32:09 +02:00
Max K
e034558f74
add automerge prs step
2024-08-01 21:18:14 +02:00
