Commit Graph

161 Commits

Author SHA1 Message Date
Alexey Milovidov
d977e221b4 Upload build time-trace data to CI database 2023-08-07 03:26:59 +02:00
Mikhail f. Shiryaev
8499956321
Refactor CI_CONFIG from dict to dataclasses 2023-08-03 14:37:19 +02:00
Mikhail f. Shiryaev
6dcdc4cd38
Remove mark_failed_report_pending, it's already in builds_report_config 2023-08-02 19:20:22 +02:00
Mikhail f. Shiryaev
e5087d14ab
Merge branch 'master' into fix-packager 2023-08-01 12:04:06 +02:00
Alexey Milovidov
41ffc09771 Upload build statistics to the CI database 2023-07-30 09:18:06 +02:00
Alexey Milovidov
463c2ba5ce
Revert "Add documentation for building in docker" 2023-07-04 14:07:10 +03:00
Mikhail f. Shiryaev
c715ee5cef
Replace --build-type=debug by --debug-build 2023-07-03 19:58:47 +02:00
Mikhail f. Shiryaev
469da1831a
Replace --build-type=debug by --debug-build 2023-07-03 17:42:15 +02:00
Mikhail f. Shiryaev
2aaaec2abe
Catch issues with dockerd during the build 2023-06-08 14:01:41 +02:00
Mikhail f. Shiryaev
e8cf417350
Use NotSet in post_commit_status for optional arguments 2023-04-28 23:52:33 +02:00
Mikhail f. Shiryaev
df33b99907
Rework post_commit_status, add set_status_comment there 2023-04-28 23:52:31 +02:00
Mikhail f. Shiryaev
ccd4fd7e64
Use commit_status_helper.post_commit_status everywhere 2023-04-28 23:52:28 +02:00
Mikhail f. Shiryaev
fcc14ae724
Enable s3 caching 2023-03-29 23:33:27 +02:00
Mikhail f. Shiryaev
c4870ad7bc
Move PRs artifacts to the PRs prefix in S3 2023-03-24 08:54:06 +01:00
Mikhail f. Shiryaev
f2b1654a44
Add overwriting failed reports as pending on rerun 2023-02-23 10:38:22 +01:00
Alexey Milovidov
03ae644ea3 Fix performance test 2023-01-09 01:58:42 +01:00
Robert Schulze
cfb6feffde
What happens if I remove these 139 lines of code? 2023-01-03 18:35:31 +00:00
Mikhail f. Shiryaev
ab0aab2c15
Fix false success rerun on similar prefix for another builds 2022-12-16 14:23:31 +01:00
Mikhail f. Shiryaev
ec0684dfce
Fix typing issues in build_check.py 2022-11-29 14:12:22 +01:00
Mikhail f. Shiryaev
c2b02c2ae9
Download ccache from release PRs for backports 2022-09-14 18:24:55 +02:00
Yakov Olkhovskiy
31a7ed09a1 disable default ENABLE_CLICKHOUSE_SELF_EXTRACTING and add to env 2022-08-27 21:08:01 +00:00
Alexey Milovidov
91ed3ebe9a Remove the remaining parts of "unbundled" build 2022-08-27 02:18:47 +02:00
Mikhail f. Shiryaev
372481e770
Rework S3Helper a little bit 2022-08-11 15:01:32 +02:00
Mikhail f. Shiryaev
2fb68078e8
Replace S3 URLs by parameter 2022-08-10 15:22:04 +02:00
Robert Schulze
729d19fa4f
Rename "splitted build" to "shared libraries build" in CI tools
- The old name made sense for (dev option) "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1 -DSPLIT_BINARY=1" but that was removed with
  #39520.

- What still exists is "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1" which does a shared library build
2022-07-31 12:26:51 +00:00
Mikhail f. Shiryaev
19516c768f
Revert "Upload to S3 compressed self-extracting clickhouse" 2022-07-04 10:15:27 +02:00
Yakov Olkhovskiy
12290dd644
upload from self-extracting directory 2022-06-30 17:35:42 -04:00
Mikhail f. Shiryaev
5d4e96cc30
Change order of uploaded artifacts to rebuild failed binaries 2022-06-15 13:17:45 +02:00
Mikhail f. Shiryaev
e1ed2aa3dc
Add failed builds to the build report 2022-05-25 23:00:33 +02:00
Mikhail f. Shiryaev
de39a48c33
Append performance_url to build_urls 2022-05-19 22:44:10 +02:00
Mikhail f. Shiryaev
121571ec5d
Ugly hacks for performance.tgz artifacts 2022-05-19 22:37:54 +02:00
Mikhail f. Shiryaev
48751f5a91
Checkout master:master for performance output in packager 2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
b929eee8db
Remove redundant CHECK_NAME from build_check.py 2022-05-18 01:38:41 +02:00
bkuschel
16e4b0db20
Fix coverity build 2022-05-13 10:22:23 -07:00
Mikhail f. Shiryaev
c65c832edb
Adjust git_helper and version_helper for shallow clone 2022-04-21 20:08:55 +02:00
Mikhail f. Shiryaev
fc5107623f
Checkout shallow repository for builds 2022-04-21 20:08:52 +02:00
Mikhail f. Shiryaev
a09fcdac1f
Do not fail on a poisoned ccache 2022-04-09 00:41:39 +02:00
Mikhail f. Shiryaev
cb962b8ad5
Stop rewriting BUILD_NAME env in build_check.py 2022-04-08 22:34:58 +02:00
Mikhail f. Shiryaev
f506b6c1a3
Fix linter issues and missed formatting 2022-04-08 19:50:41 +02:00
Mikhail f. Shiryaev
dd4bd4abba
Simplify and fix coverity 2022-04-07 18:35:58 +02:00
Mikhail f. Shiryaev
62fa528e7d
Fix syntax error in build_check.py 2022-04-06 10:15:36 +02:00
Boris Kuschel
2298b80ed8
Add coverity scan
Signed-off-by: Boris Kuschel <Boris.Kuschel@ibm.com>
2022-04-05 19:52:33 +02:00
Mikhail f. Shiryaev
3e7c46075a
Clean out dead code from version_helper 2022-04-01 11:59:49 +02:00
alesapin
fcd4e0be65 Black 2022-03-30 19:15:27 +02:00
alesapin
8980994faa Resurrect build hash 2022-03-30 16:29:13 +02:00
Mikhail f. Shiryaev
a0edb3e593
Build tgz and rpm for every running 2022-03-22 11:10:01 +01:00
Mikhail f. Shiryaev
0dd1f4af76
Rename alien arguments and parameters 2022-03-22 11:10:01 +01:00
Mikhail f. Shiryaev
342f7ba567
Migrate to nfpm 2022-03-22 11:09:59 +01:00
Azat Khuzhin
4b770343e1 Mark build action as failed if it was retried and there was no succeeded builds
Builder actions does not shows errors after retries, for example [1]
failed, but the check is green:

    Dump json report {
      'log_url': 'https://s3.amazonaws.com/clickhouse-builds/35204/c5a71a7f10e9d20b116b3e1db02bb444b203c32a/binary_gcc/build_log.log',
      'build_urls': [], <-- empty
      'build_config': {...},
      'elapsed_seconds': 0, 'status': False
    } to build_urls_binary_gcc.json with env build_urls_{build_name}

  [1]: https://github.com/ClickHouse/ClickHouse/runs/5510262456?check_suite_focus=true#logs

And previous build indeed failed [2]:

    Mar 11 08:19:45 ninja: build stopped: subcommand failed.

  [2]: https://s3.amazonaws.com/clickhouse-builds/35204/c5a71a7f10e9d20b116b3e1db02bb444b203c32a/binary_gcc/build_log.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-14 13:23:51 +03:00
Mikhail f. Shiryaev
546cee5512
Huge refactoring of version_helper 2022-02-16 12:16:42 +01:00
Mikhail f. Shiryaev
080c56d91a
Fix pylint for build_check.py 2022-01-13 15:13:58 +01:00
Mikhail f. Shiryaev
25476e2d7d
Restore existing static builds links 2022-01-13 13:55:51 +01:00
Mikhail f. Shiryaev
830edf76cc
Don't upload splitted binaries to builds.clickhouse.com 2022-01-12 14:57:11 +01:00
Mikhail f. Shiryaev
9188b8afc2
Fix logic for upload upload_master_static_binaries 2022-01-12 14:30:32 +01:00
Mikhail f. Shiryaev
325c786f68
Add uploading binary builds from master to static URLs 2022-01-12 13:17:54 +01:00
Mikhail f. Shiryaev
3614b0c4ed
Slightly refactor build_check.py 2022-01-12 13:17:21 +01:00
Mikhail f. Shiryaev
80a452cca0
Apply black on build_check.py and tee_popen.py 2022-01-11 19:36:34 +01:00
alesapin
1a3cdc3388 Upload build artifact in case of build failures 2021-12-24 12:56:09 +03:00
alesapin
73a593b676
Merge branch 'master' into refactor_ci_tests1 2021-12-15 16:11:28 +03:00
alesapin
d962d92896
Merge pull request #32745 from ClickHouse/fix_special_build_check
Better control build artifacts
2021-12-15 14:51:02 +03:00
alesapin
2c78e7ed72 Fix performance build 2021-12-15 11:07:12 +03:00
alesapin
2753fe01a3 Merge branch 'master' into fix_special_build_check 2021-12-15 10:35:28 +03:00
alesapin
e124e5807f Fix build performance 2021-12-14 19:29:30 +03:00
alesapin
c46c912507 Followup 2021-12-14 19:16:22 +03:00
alesapin
7b29377338 Better control build artifacts 2021-12-14 13:40:03 +03:00
alesapin
b62de9b2f4 Merge branch 'master' into add_performance_tests 2021-12-09 11:40:32 +03:00
Constantine Peresypkin
7c90d4f8e3 refactor CI tests 2021-12-03 12:22:50 +02:00
alesapin
ec0bfa7bcf Better output for some actions 2021-12-03 11:33:16 +03:00
alesapin
f2140be90b Fix CI 2021-12-02 22:03:59 +03:00
alesapin
c07450a7dc Fixup one more time 2021-12-02 10:49:44 +03:00
alesapin
a29b7105da fixup 2021-12-01 22:17:23 +03:00
alesapin
bf5858a6b3 Fix build urls 2021-12-01 22:14:46 +03:00
alesapin
c13a72991b Fix style 2021-12-01 17:47:10 +03:00
alesapin
71e6c7e92e Add ability to rerun checks 2021-12-01 17:23:51 +03:00
Mikhail f. Shiryaev
23f9c8bbba
Fix building rpm and tgz for branch pushes 2021-12-01 12:44:39 +01:00
alesapin
adf6ff8477 Fix build on master 2021-11-30 18:58:45 +03:00
Mikhail f. Shiryaev
b5c9f09f9b
Push packages from master actions to a version bucket 2021-11-29 16:07:19 +01:00
Mikhail f. Shiryaev
d7cf4f78c3
Create get_event function to read event data 2021-11-29 16:07:18 +01:00
alesapin
464b943b38 fix comment 2021-11-26 13:59:38 +03:00
alesapin
081bfdfe82 Get rid of build numbers and simplify builds paths in S3 2021-11-26 13:57:36 +03:00
alesapin
f60fdc7a8b
Merge pull request #31767 from ClickHouse/fail_fasttest_if_some_tests_was_not_successful
Fail fasttest, builds and functional checks if some tests was not successful
2021-11-25 17:47:12 +03:00
alesapin
3d811aeec1 Use version from git describe in builds 2021-11-25 14:19:26 +03:00
alesapin
c09feaf2a8 Also fail builds and functional tests 2021-11-25 13:01:29 +03:00
alesapin
42c77323e8
Merge branch 'master' into add_performance_tests 2021-11-23 22:14:32 +03:00
Alexey Milovidov
d604cf5573 Remove the infamous "unbundled" build 2021-11-21 13:58:26 +03:00
alesapin
fb54bd8026 Remove redundant code 2021-11-18 12:16:00 +03:00
alesapin
9fb5c26640 Fix 2021-11-18 11:07:54 +03:00
alesapin
8b052cdd25 Update perf build 2021-11-18 10:32:20 +03:00
alesapin
1cec1d3aaa Hack for performance build 2021-11-17 14:03:09 +03:00
alesapin
17f2e61cd6 Underscores everywhere 2021-11-12 16:16:17 +03:00
alesapin
43c70c1c36 Fix build check 2021-11-12 16:08:06 +03:00
alesapin
373fda6eb8 More fixes 2021-11-12 15:36:25 +03:00
alesapin
2e6da9ea71 Fixes 2021-11-12 15:13:13 +03:00
alesapin
68ed04afe4 Build check 2021-11-11 10:33:44 +03:00
alesapin
7920724a81 Moar logging 2021-11-10 12:08:43 +03:00
mergify[bot]
a94b8902dd
Merge branch 'master' into trying_actions 2021-10-28 15:57:28 +00:00
alesapin
5dc2f9a04e Fix path to changed images 2021-10-28 15:15:23 +03:00
Azat Khuzhin
d8a64a7ece tests/ci: fix wrong-import-order pylint warning 2021-10-27 10:14:39 +03:00
Azat Khuzhin
c47617a612 tests/ci/build_check.py: fix pylint warnings 2021-10-27 10:03:23 +03:00
alesapin
f757ceade4 Fix build check 2021-10-25 18:14:49 +03:00