Commit Graph

1847 Commits

Author SHA1 Message Date
Alexey Milovidov
9b7fcf17bc Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci 2023-08-11 22:54:24 +02:00
Alexey Milovidov
b6c47ee157 Merge branch 'master' into export-logs-in-ci 2023-08-11 03:44:18 +02:00
Mikhail f. Shiryaev
dcb1d3ed00
Rewrite compress_file to pathlib.Path 2023-08-10 22:41:57 +02:00
Mikhail f. Shiryaev
c8d5deda83
Add typing to compress_files 2023-08-10 22:41:56 +02:00
Mikhail f. Shiryaev
18a291a4c7
Upload cargo cache for rust to S3 and reuse 2023-08-10 22:41:55 +02:00
Mikhail f. Shiryaev
dbd3fdd437
Clean ccache_utils a little bit 2023-08-10 22:09:20 +02:00
Mikhail f. Shiryaev
cbd81b3758
Partially revert changes from #52395 2023-08-10 22:09:19 +02:00
Alexey Milovidov
3acb10b8bc Inhibit randomization in 00906_low_cardinality_cache 2023-08-10 20:51:03 +02:00
Alexey Milovidov
561e043868
Merge branch 'master' into sqltest 2023-08-10 21:47:56 +03:00
Alexey Milovidov
269f54b49e
Merge branch 'master' into export-logs-in-ci 2023-08-10 16:56:14 +03:00
Alexey Milovidov
47b5d13367
Merge branch 'master' into fix-stress-test 2023-08-10 16:55:49 +03:00
Alexey Milovidov
e4fbca2e2e Apply review recommendations 2023-08-10 04:47:44 +02:00
Alexey Milovidov
cfdccb95d5 Merge branch 'master' into export-logs-in-ci 2023-08-10 04:30:23 +02:00
Alexey Milovidov
53151610a0
Merge branch 'master' into sqltest 2023-08-10 03:47:26 +03:00
Mikhail f. Shiryaev
ce30b93b34
Move repeated code for ClickHouseHelper to _insert_post 2023-08-09 23:46:45 +02:00
Mikhail f. Shiryaev
c7b045fdde
Process build profiles in the python script, not in docker 2023-08-09 21:48:05 +02:00
Mikhail f. Shiryaev
239d198cf2
Add insert_file to ClickHouseHelper, make insert_json_str public 2023-08-09 21:11:21 +02:00
Mikhail f. Shiryaev
1405346830
Rewrite build_check to use pathlib.Path 2023-08-09 18:56:19 +02:00
Mikhail f. Shiryaev
5341c5c8dd
Use CMAKE_FLAGS and args for cmake profiler 2023-08-09 18:26:25 +02:00
Alexey Milovidov
964c407d48
Revert "Revert "Upload build time-trace data to CI database"" 2023-08-09 16:11:17 +03:00
Alexander Gololobov
63183c56f1
Revert "Upload build time-trace data to CI database" 2023-08-09 13:58:05 +02:00
Alexey Milovidov
10bc51514b Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci 2023-08-09 04:28:50 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest 2023-08-09 05:10:47 +03:00
Yakov Olkhovskiy
d8a231e0cb Add Linux s390x build to CI 2023-08-09 00:44:01 +00:00
Alexey Milovidov
acb43266ad
Merge branch 'master' into fix-stress-test 2023-08-08 23:41:59 +03:00
robot-clickhouse
b397d11c91 Automatic style fix 2023-08-08 19:26:19 +00:00
Alexey Milovidov
23eee8d10d Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile 2023-08-08 21:02:26 +02:00
Alexey Milovidov
2b59c1778c More info 2023-08-08 21:02:13 +02:00
Alexey Milovidov
ed34f3c46f Fix error 2023-08-08 21:00:30 +02:00
robot-clickhouse
2eff5928d9 Automatic style fix 2023-08-08 13:44:10 +00:00
Alexey Milovidov
7ce8266c8a Fix errors 2023-08-08 15:17:20 +02:00
János Benjamin Antal
67a87a4b95
Merge pull request #53051 from ClickHouse/only-debug-upgrade-check
Require only ASAN based upgrade check to minimize false positives
2023-08-08 11:44:11 +02:00
Alexey Milovidov
a91edb8b55 Fix mypy 2023-08-08 04:11:32 +02:00
Alexey Milovidov
161de7c12f Fix error 2023-08-08 03:34:44 +02:00
Alexey Milovidov
5644216429 Fix whitespace 2023-08-07 23:40:34 +02:00
Alexey Milovidov
27559b0349 Adjust a test 2023-08-07 23:09:34 +02:00
Alexey Milovidov
cafe4354c5 Merge branch 'master' into export-logs-in-ci 2023-08-07 23:08:26 +02:00
Alexey Milovidov
77e1693f3c Fix mypy 2023-08-07 21:18:56 +02:00
Alexey Milovidov
8ce4ff0f95 Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile 2023-08-07 21:18:30 +02:00
Alexey Milovidov
ab64845740 Fix mypy 2023-08-07 18:45:32 +02:00
Alexey Milovidov
5275062eaf Fix trailing whitespaces 2023-08-07 18:44:25 +02:00
Mikhail f. Shiryaev
2347f5886b
Update Mergeable Check at the finishing CI 2023-08-07 18:06:50 +02:00
Alexey Milovidov
9cb949b60b Fix style 2023-08-07 14:53:38 +02:00
János Benjamin Antal
55c3581242
Replace Upgrade check (debug) with a less flaky upgrade check 2023-08-07 10:27:10 +02:00
robot-clickhouse
19ad81dabd Automatic style fix 2023-08-07 01:50:29 +00:00
Alexey Milovidov
d977e221b4 Upload build time-trace data to CI database 2023-08-07 03:26:59 +02:00
robot-clickhouse
333ed6425c Automatic style fix 2023-08-06 11:30:50 +00:00
Alexey Milovidov
9428040d05 Fix hung check in stress test 2023-08-06 13:07:48 +02:00
Alexey Milovidov
fbb2be21cc Slightly better 2023-08-06 13:04:35 +02:00
robot-clickhouse
2edda961d2 Automatic style fix 2023-08-06 02:55:26 +00:00
Alexey Milovidov
f1eee292c9 Enable export (first try) 2023-08-06 04:38:04 +02:00
Alexey Milovidov
580f207b8d
Merge branch 'master' into sqltest 2023-08-04 22:16:56 +03:00
János Benjamin Antal
c874e5955b Remove upgrade checks with sanitizers 2023-08-04 12:33:11 +00:00
robot-ch-test-poll2
c556ad96f6
Merge pull request #52948 from ClickHouse/refactor-ci-config
Refactor CI_CONFIG
2023-08-04 11:10:12 +02:00
Alexey Milovidov
388feb953d Fix paths 2023-08-03 19:28:59 +02:00
Mikhail f. Shiryaev
ca67576720
Do not use inline cache in server images 2023-08-03 18:06:00 +02:00
Alexey Milovidov
65e8ee8fb7 Fix paths 2023-08-03 15:28:18 +02:00
Mikhail f. Shiryaev
8499956321
Refactor CI_CONFIG from dict to dataclasses 2023-08-03 14:37:19 +02:00
Alexey Milovidov
5ec6a4695f Fix log paths 2023-08-02 23:22:15 +02:00
Alexey Milovidov
a98e869912 Merge branch 'master' into sqltest 2023-08-02 20:08:39 +02:00
Mikhail f. Shiryaev
6dcdc4cd38
Remove mark_failed_report_pending, it's already in builds_report_config 2023-08-02 19:20:22 +02:00
Mikhail f. Shiryaev
40cdfa2384
Merge branch 'master' into fix-packager 2023-08-02 11:21:54 +02:00
Mikhail f. Shiryaev
3a07b80f34
Merge pull request #52277 from ClickHouse/kill-runner-with-subprocesses
Kill the runner process with all subprocesses
2023-08-02 11:18:56 +02:00
alesapin
0abd5a058b
Merge pull request #52871 from ClickHouse/cont-server-after-gdb-killed
Try to continue clickhouse process in stress test after terminating gdb.
2023-08-02 10:55:38 +02:00
Mikhail f. Shiryaev
8537b32de1
Merge branch 'master' into docker-improvements 2023-08-02 08:40:24 +02:00
Alexey Milovidov
3b6247e3f5 Merge branch 'sqltest' of github.com:ClickHouse/ClickHouse into sqltest 2023-08-01 22:33:19 +02:00
Alexey Milovidov
0641dfd7e6 Add missing modification 2023-08-01 22:33:04 +02:00
Alexey Milovidov
97bd68d5c7 Merge branch 'master' into sqltest 2023-08-01 22:31:18 +02:00
Mikhail f. Shiryaev
f87e53c042
Merge branch 'master' into sqltest 2023-08-01 17:42:58 +02:00
Mikhail f. Shiryaev
6b29cccf3e
Rename docker_images.json to docker_images_for_tests.json 2023-08-01 17:30:54 +02:00
Mikhail f. Shiryaev
79d49a006c
Fix the PR body check for Reverts #number 2023-08-01 17:06:23 +02:00
Nikolai Kochetov
09cb5cbe87 Try to continue clickhouse process in stress test after terminating gdb. 2023-08-01 14:30:41 +00:00
Mikhail f. Shiryaev
0931e87989
Merge branch 'master' into sqltest 2023-08-01 16:14:28 +02:00
Alexey Milovidov
8646eefc9c
Update docker_test.py 2023-08-01 17:05:24 +03:00
Mikhail f. Shiryaev
e5087d14ab
Merge branch 'master' into fix-packager 2023-08-01 12:04:06 +02:00
Kseniia Sumarokova
40ce9cf9ed
Merge pull request #51843 from ClickHouse/kssenii-nginx
Replace kssenii/nginx-test by clickhouse/nginx-dav
2023-08-01 11:36:20 +02:00
Alexey Milovidov
afb76101b7 Remove obsolete part of a check name 2023-07-31 05:23:28 +02:00
Alexey Milovidov
d243602e74
Merge pull request #52773 from ClickHouse/upload-build-check-statistics
Upload build statistics to the CI database
2023-07-31 06:18:41 +03:00
Alexey Milovidov
8155659f87
Merge pull request #52775 from ClickHouse/remove-coverity-2
Remove Coverity (part 2)
2023-07-30 12:49:04 +03:00
Alexey Milovidov
bc1f80dd82 Remove Coverity (part 2) 2023-07-30 10:25:44 +02:00
robot-clickhouse
358773c620 Automatic style fix 2023-07-30 07:45:27 +00:00
Alexey Milovidov
448756d148 Add machine_type information to the CI database 2023-07-30 09:31:21 +02:00
Alexey Milovidov
41ffc09771 Upload build statistics to the CI database 2023-07-30 09:18:06 +02:00
Kruglov Pavel
93e10077ba
Fix attaching gdb in stress tests (#51445)
* Fix attaching gdb in stress tests

* Fix

* Update run.sh

* Try remove run_with_retry

* Return run_with_retry

* Don't set -e in run_with_retry if it was't set before

* Update tests/ci/utils.lib

* Fix bash

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-07-26 12:53:19 +03:00
Azat Khuzhin
0b258dda4e Reproducible builds for Rust
From now on cargo will not download anything from the internet during
builds. This step had been moved for docker image builds (via cargo
vendor).

And now cargo inside docker.io/clickhouse/binary-builder will not use
any crates from the internet, so we don't need to add --offline for
cargo commands in cmake (corrosion_import_crate()).

Also the docker build command had been adjusted to allow following
symlinks inside build context, by using tar, this is required for Rust
packages.

Note, that to make proper Cargo.lock that could be vendored I did the
following:
- per-project locks had been removed (since there is no automatic way to
  sync the workspace Cargo.lock with per-project Cargo.lock, since cargo
  update/generate-lockfile will use only per-project Cargo.toml files
  apparently, -Z minimal-versions does not helps either)
- and to generate Cargo.lock with less changes I've pinned version in
  the Cargo.toml strictly, i.e. not 'foo = "0.1"' but 'foo = "=0.1"'
  then the Cargo.lock for workspace had been generated and afterwards
  I've reverted this part.

Plus I have to update the dependencies afterwards, since otherwise there
are conflicts with dependencies for std library. Non trivial.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-22 22:46:22 +02:00
Alexey Milovidov
c3c8ea9c27 Do something 2023-07-22 17:30:55 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
Alexey Milovidov
3398355e46 Add something with unclear purpose 2023-07-22 02:04:30 +02:00
Mikhail f. Shiryaev
101214cb8f
Fix broken termination lambda by caching runners for at most 15 seconds 2023-07-21 18:32:32 +02:00
Mikhail f. Shiryaev
083be24a74
Improve logic of checking valid cached values in lambdas 2023-07-21 18:32:31 +02:00
Mikhail f. Shiryaev
a117997d5b
Show the runner type in the job logs 2023-07-21 18:32:31 +02:00
Mikhail f. Shiryaev
da37f32d4b
Attempt to delete the runner before shutting down 2023-07-21 18:32:30 +02:00
Mikhail f. Shiryaev
538d1f7c17
Kill the runner process with all subprocesses 2023-07-21 18:32:28 +02:00
Antonio Andelic
e181e602a7
Update ci_config.py 2023-07-21 12:43:32 +02:00
Alexey Milovidov
f458108c44 Fix style 2023-07-19 22:15:23 +02:00
Alexey Milovidov
29094a22cf Fix Docker 2023-07-19 20:00:00 +02:00
Alexey Milovidov
f7fcf079a4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sqltest 2023-07-19 19:58:10 +02:00
Mikhail f. Shiryaev
9c4005b33f
Add logging about all found workflows for merge_pr.py 2023-07-19 15:12:58 +02:00
Alexey Milovidov
8e3bd222f0 Add SQLTest 2023-07-19 03:42:32 +02:00
Antonio Andelic
3c2507ad7d
Merge branch 'master' into fix-packager 2023-07-18 09:18:03 +02:00