Commit Graph

4161 Commits

Author SHA1 Message Date
Azat Khuzhin
0b258dda4e Reproducible builds for Rust
From now on cargo will not download anything from the internet during
builds. This step had been moved for docker image builds (via cargo
vendor).

And now cargo inside docker.io/clickhouse/binary-builder will not use
any crates from the internet, so we don't need to add --offline for
cargo commands in cmake (corrosion_import_crate()).

Also the docker build command had been adjusted to allow following
symlinks inside build context, by using tar, this is required for Rust
packages.

Note, that to make proper Cargo.lock that could be vendored I did the
following:
- per-project locks had been removed (since there is no automatic way to
  sync the workspace Cargo.lock with per-project Cargo.lock, since cargo
  update/generate-lockfile will use only per-project Cargo.toml files
  apparently, -Z minimal-versions does not helps either)
- and to generate Cargo.lock with less changes I've pinned version in
  the Cargo.toml strictly, i.e. not 'foo = "0.1"' but 'foo = "=0.1"'
  then the Cargo.lock for workspace had been generated and afterwards
  I've reverted this part.

Plus I have to update the dependencies afterwards, since otherwise there
are conflicts with dependencies for std library. Non trivial.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-22 22:46:22 +02:00
Alexey Milovidov
de2016261e Get rid of it 2023-07-22 05:08:27 +02:00
Alexey Milovidov
e5797b7fea
Merge pull request #51514 from azat/tests/fix-integration-tests
Fix running integration tests with spaces in it's names
2023-07-22 03:38:51 +03:00
Ilya Golshtein
4259176f24 test_for_basic_auth_registry - original zk configuration restored 2023-07-19 08:32:45 +00:00
Ilya Golshtein
aa2b7e248d test_for_basic_auth_registry - fix port in test_kafka_formats 2023-07-19 08:32:45 +00:00
Ilya Golshtein
83569688cb test_for_basic_auth_registry - UnknownTopicOrPartitionException 2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a test_for_basic_auth_registry - both tests works, simplifications 2023-07-19 08:32:45 +00:00
Ilya Golshtein
db8e96147a test_for_basic_auth_registry - started, but only auth test works 2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f test_for_basic_auth_registry - one kafka instance again 2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4 test_for_basic_auth_registry - attempt to have two kafka instances 2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834 test_for_basic_auth_registry - mock up 2023-07-19 08:32:44 +00:00
Azat Khuzhin
6f6562c96b Fix running integration tests with spaces in it's names
Previously they were simply ignored, and not only them, but all the
tests in that group, here is an example [1]

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/51448/4ed462ac7834a8180f92ca7d7d3c076e687bfca9/integration_tests__asan__[4_6].html

Note, that I've replaced PYTEST_OPTS with handled by pytest itself
PYTEST_ADDOPTS, since "sh -c $PYTEST_OPTS" does not allows you to
preserve the arguments correctly.

v5: use double quotes for PYTEST_ADDOPTS value
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Azat Khuzhin
2720e9177d Fix flakiness of test_keeper_s3_snapshot
This is part of "Why my PR is not merged?" patch set series.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-13 14:25:24 +02:00
John Spurlock
7c7a447fd2
Fix a few typos in docker readme. 2023-07-11 12:16:55 -05:00
robot-clickhouse-ci-1
4666838a5d
Merge pull request #49438 from azat/build/unwind
Force libunwind usage (removes gcc_eh support)
2023-07-09 05:38:34 +02:00
robot-clickhouse
45d36b736a Update version_date.tsv and changelogs after v23.6.2.18-stable 2023-07-08 23:14:02 +00:00
Azat Khuzhin
a10aa9ad50 Force libunwind usage (removes gcc_eh support)
libunwind is reentrant and signal safe, and works faster then then
gcc_eh (plus it has some custom patches for problems that have been
found during it's usage in ClickHouse).

gcc_eh may be missing in the system (if gcc was not installed), and
even if it exists clickhouse uses -nodefaultlibs, so some care should be
made to make it work.

Also this library is tiny and there shouln't be any problem to require
it always (there is already tendency to require some contrib libraries,
i.e. poco).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-08 20:55:50 +02:00
Alexey Milovidov
c828db5720 Allow OOM in AST Fuzzer with Sanitizers 2023-07-08 05:57:23 +02:00
Alexey Milovidov
d15723997b
Merge pull request #51863 from ClickHouse/remove-useless-packages
Remove useless packages
2023-07-08 02:21:07 +03:00
Alexey Milovidov
f8eaa3e8e6
Merge pull request #51903 from azat/build/pin-rust
Pin rust nightly (to make it stable)
2023-07-07 20:28:57 +03:00
Alexey Milovidov
cf66be571f
Merge branch 'master' into remove-useless-packages 2023-07-07 13:44:13 +03:00
Alexey Milovidov
6cfeef00d7
Merge pull request #31398 from ClickHouse/riscv-in-ci
Add Linux RISC-V 64 build to CI
2023-07-06 22:49:16 +03:00
Azat Khuzhin
ec5e26a017 Pin rust nightly (to make it stable)
Because of using Rust nightly, and without #49601 the Rust toolchain is
very unstable, and can be frequently failed.

So let's ping particular version.

Also I've looked and it seems that Rust archives stores this archive
without any TTL, since there is even a version for 2015 year.

Follow-up for: #50541
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-06 21:17:50 +02:00
Antonio Andelic
c390c900c5
Merge branch 'master' into upgrade-check-fix-2 2023-07-06 21:10:41 +02:00
Mikhail f. Shiryaev
6bbaade4a6
Update sccache, do not fail on connection error 2023-07-06 16:09:52 +02:00
Antonio Andelic
085f7caccf Move config changes after configure 2023-07-06 06:30:47 +00:00
Alexey Milovidov
75d051dd55 Remove useless packages 2023-07-06 01:49:53 +02:00
Alexey Milovidov
70bcf28f4a
Merge pull request #51839 from ClickHouse/fix-upgrade-test-disks
Fix disk config for upgrade tests
2023-07-06 00:35:18 +03:00
Antonio Andelic
1124c7ae8b Correctly move config 2023-07-05 12:42:36 +00:00
Mikhail f. Shiryaev
bcc569b9e3
Add temporary pin for docker-ce 2023-07-05 10:28:57 +02:00
Alexey Milovidov
1eafba60d2 Merge branch 'master' into riscv-in-ci 2023-07-04 21:28:05 +02:00
Alexey Milovidov
aa2b8aa893
Merge pull request #51769 from ClickHouse/mypy-1.4.0
Version mypy=1.4.1 falsly reports unused ignore comment
2023-07-04 16:45:57 +03:00
Alexey Milovidov
463c2ba5ce
Revert "Add documentation for building in docker" 2023-07-04 14:07:10 +03:00
Mikhail f. Shiryaev
35c1321952
Version mypy=1.4.1 falsly reports unused ignore comment 2023-07-04 13:05:41 +02:00
Mikhail f. Shiryaev
c715ee5cef
Replace --build-type=debug by --debug-build 2023-07-03 19:58:47 +02:00
Mikhail f. Shiryaev
d0c3847427
Fix source image for sqllogic 2023-07-03 12:29:12 +02:00
Alexander Tokmakov
ce5ca7d2a5
Merge pull request #51502 from ClickHouse/fix_logical_error_on_mutation
Fix a logical error on mutation
2023-07-03 12:52:59 +03:00
Antonio Andelic
aeea3dc824 Add odbcinst dep to sqllogic docker 2023-07-03 07:40:05 +00:00
Alexander Tokmakov
43dba76cbf
Merge branch 'master' into fix_logical_error_on_mutation 2023-07-02 19:30:00 +03:00
Antonio Andelic
c06afc53b4 Make scripts backwards compatible 2023-07-02 09:57:06 +00:00
Antonio Andelic
d8238086c6
Merge branch 'master' into better-gdb-wait 2023-07-01 10:39:49 +02:00
robot-clickhouse
8ed1ec49d1 Update version_date.tsv and changelogs after v23.6.1.1524-stable 2023-06-30 15:21:13 +00:00
Antonio Andelic
00aeb407e5 Wait with retries 2023-06-30 14:52:21 +00:00
Alexander Tokmakov
d572eff106
Merge branch 'master' into fix_logical_error_on_mutation 2023-06-30 15:12:35 +03:00
Alexey Milovidov
1e6f6b522c
Merge pull request #51180 from ClickHouse/update-tests-docker
Update tests' docker containers
2023-06-30 11:24:59 +03:00
Antonio Andelic
447a4e7b2a
Merge branch 'master' into add-retries-for-zk-create 2023-06-29 20:38:37 +02:00
Antonio Andelic
d1bb8f24c0 Retry chroot creation in ZK 2023-06-29 15:18:32 +00:00
Mikhail f. Shiryaev
ef55e4e94d
Merge pull request #51561 from ClickHouse/ci-for-backports
Decoupled commits from #51180 for backports
2023-06-29 16:04:43 +02:00
robot-clickhouse
5656d18690 Update version_date.tsv and changelogs after v23.5.4.25-stable 2023-06-29 13:36:55 +00:00
Mikhail f. Shiryaev
340262814a
Avoid additional maven requests for spark tests 2023-06-29 12:24:19 +02:00