Commit Graph

4388 Commits

Author SHA1 Message Date
Alexey Milovidov
9adfcfae23
Merge pull request #53252 from ClickHouse/remove-outdated-docker
Remove outdated Dockerfile
2023-08-10 16:53:32 +03:00
Alexey Milovidov
e79c40981b
Merge pull request #53249 from ClickHouse/fix-performance-test
Remove unrecognizable garbage from the performance test
2023-08-10 16:51:56 +03:00
Alexey Milovidov
0ba3fea7fe Apply recommendations 2023-08-10 04:44:20 +02:00
Alexey Milovidov
8fba4d2c4a Protection if the repository is old 2023-08-10 04:41:19 +02:00
Alexey Milovidov
2a89587300 Address review comments 2023-08-10 04:32:39 +02:00
Alexey Milovidov
cfdccb95d5 Merge branch 'master' into export-logs-in-ci 2023-08-10 04:30:23 +02:00
Alexey Milovidov
fc3970e3ff Update readme 2023-08-10 04:30:03 +02:00
Alexey Milovidov
0b138fdf16 Remove outdated Dockerfile 2023-08-10 04:15:19 +02:00
Alexey Milovidov
f2621e70ae Remove unrecognizable garbage from the performance test 2023-08-10 03:27:07 +02:00
Alexey Milovidov
6edf4a777f Remove unrecognizable garbage from the performance test 2023-08-10 03:26:11 +02:00
Alexey Milovidov
53151610a0
Merge branch 'master' into sqltest 2023-08-10 03:47:26 +03:00
Mikhail f. Shiryaev
c7b045fdde
Process build profiles in the python script, not in docker 2023-08-09 21:48:05 +02:00
Mikhail f. Shiryaev
5341c5c8dd
Use CMAKE_FLAGS and args for cmake profiler 2023-08-09 18:26:25 +02:00
Alexey Milovidov
964c407d48
Revert "Revert "Upload build time-trace data to CI database"" 2023-08-09 16:11:17 +03:00
Alexander Gololobov
63183c56f1
Revert "Upload build time-trace data to CI database" 2023-08-09 13:58:05 +02:00
Yakov Olkhovskiy
c6c6d1ed9c fix 2023-08-09 02:42:04 +00:00
Alexey Milovidov
10bc51514b Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci 2023-08-09 04:28:50 +02:00
Alexey Milovidov
afdef1a21a Merge branch 'master' into allow-creating-system-tables-at-startup 2023-08-09 04:28:04 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest 2023-08-09 05:10:47 +03:00
Yakov Olkhovskiy
d8a231e0cb Add Linux s390x build to CI 2023-08-09 00:44:01 +00:00
Alexey Milovidov
3ffffb0b5e
Merge pull request #53100 from ClickHouse/upload-build-profile
Upload build time-trace data to CI database
2023-08-08 23:33:50 +03:00
robot-clickhouse
fe7168c1c3 Update version_date.tsv and changelogs after v23.7.4.5-stable 2023-08-08 19:16:27 +00:00
Alexey Milovidov
23eee8d10d Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile 2023-08-08 21:02:26 +02:00
Alexey Milovidov
8665f675c6 Investigation 2023-08-08 19:07:02 +02:00
Alexey Milovidov
65a9dd1d18 Fix style 2023-08-08 16:13:17 +02:00
Alexey Milovidov
7ce8266c8a Fix errors 2023-08-08 15:17:20 +02:00
Alexey Milovidov
a2001e15de Add jq 2023-08-08 02:32:57 +02:00
Alexey Milovidov
f1257e871d Correct the script 2023-08-08 01:46:03 +02:00
Alexey Milovidov
a38539ece0 Add missing argument 2023-08-08 00:16:22 +02:00
Sema Checherinda
796f874116
metrics_perf_events_enabled turn off in perf tests (#52072)
* metrics_perf_events_enabled turn off in perf tests

* turn on metrics_perf_events_enabled for heating and profile requests

* close_perf_descriptors fix the condition

* do not read opend but disabled perf event

* Revert "do not read opend but disabled perf event"

This reverts commit eeab1c9c63.
2023-08-07 23:25:16 +02:00
Alexey Milovidov
440424fd72 @felixoid said we do not need these 2023-08-07 21:23:39 +02:00
Alexey Milovidov
8ce4ff0f95 Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile 2023-08-07 21:18:30 +02:00
Alexey Milovidov
0bab88b7cb Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-07 18:58:32 +02:00
Alexey Milovidov
06f557a62b Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-creating-system-tables-at-startup 2023-08-07 18:58:18 +02:00
Alexey Milovidov
5fa0edc3b2 Make mypy happy 2023-08-07 18:47:16 +02:00
Alexey Milovidov
4696254887
Merge pull request #53065 from ClickHouse/nickitat-patch-15
Add `abort_on_error=1` to `TSAN_OPTIONS`
2023-08-07 17:17:04 +03:00
Alexey Milovidov
598a48fe22 Fix mypy 2023-08-07 14:56:50 +02:00
Alexey Milovidov
d977e221b4 Upload build time-trace data to CI database 2023-08-07 03:26:59 +02:00
Alexey Milovidov
fbb2be21cc Slightly better 2023-08-06 13:04:35 +02:00
Alexey Milovidov
695516ae74 Maybe fix bash 2023-08-06 12:51:37 +02:00
Antonio Andelic
53a60ba37a Merge branch 'master' into add-reading-from-archives 2023-08-06 10:22:05 +00:00
Antonio Andelic
cafa5ef2f3 Merge branch 'master' into add-reading-from-archives 2023-08-06 10:21:47 +00:00
Alexey Milovidov
f0a632f1f1 Fix shellcheck 2023-08-06 05:17:39 +02:00
Alexey Milovidov
f1eee292c9 Enable export (first try) 2023-08-06 04:38:04 +02:00
Alexey Milovidov
32a038cfd7 YAML is mandatory 2023-08-06 02:52:36 +02:00
robot-clickhouse
f65fa627e7 Update version_date.tsv and changelogs after v23.7.3.14-stable 2023-08-05 19:26:13 +00:00
Alexey Milovidov
6825b008e7
Merge pull request #52906 from azat/tests/fix-EADDRINUSE-v2
tests: fix possible EADDRINUSE v2
2023-08-05 13:39:25 +03:00
Alexey Milovidov
39883f9373 Add missing targets 2023-08-05 02:35:44 +02:00
Nikita Taranov
555c90a50c add to integration tests 2023-08-04 23:26:52 +02:00
Nikita Taranov
06717fa3dd
Add abort_on_error=1 to TSAN_OPTIONS for stress tests 2023-08-04 22:58:22 +02:00
Ilya Yatsishin
0f63a90206
Merge branch 'master' into create-index-unique-noop 2023-08-04 17:53:57 +02:00
Antonio Andelic
d4d93331dd Merge branch 'master' into add-reading-from-archives 2023-08-04 09:00:20 +00:00
Alexey Milovidov
65e8ee8fb7 Fix paths 2023-08-03 15:28:18 +02:00
Alexey Milovidov
2c085955d1 Merge branch 'master' into sqltest 2023-08-03 15:20:22 +02:00
robot-clickhouse
659c907d38 Update version_date.tsv and changelogs after v23.7.2.25-stable 2023-08-03 09:55:00 +00:00
Antonio Andelic
96bad0537a Merge branch 'master' into add-reading-from-archives 2023-08-03 08:36:42 +00:00
Azat Khuzhin
344d648cab tests: adjust net.ipv4.ip_local_port_range for some services to avoid EADDRINUSE
As it turns out, docker does not pass through the sysctls, so adjust
this for know users of unprivileged ports (>32K):
- HDFS
- kafka

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:17:49 +02:00
Azat Khuzhin
d2a264c9bb tests: use explicit address for console to avoid EADDRINUSE
The problem is that MinIO uses dynamic port for console address by
default, which may be below ip_local_port_range, and in this case it ca
be reused in a short time, sicne first MinIO allocates the socket, then
close this socket, and only after try to bind to it.

And even though this is a problem of MinIO I'm not a go developer to fix
it.

v2: use long notation of the 127.0.0.1 (that version of MinIO on CI
cannot handle 127.1, while 2023-07-21T21-12-44Z can)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:17:49 +02:00
Alexey Milovidov
a98e869912 Merge branch 'master' into sqltest 2023-08-02 20:08:39 +02:00
Mikhail f. Shiryaev
40cdfa2384
Merge branch 'master' into fix-packager 2023-08-02 11:21:54 +02:00
Antonio Andelic
e366ca61f5 Merge branch 'master' into add-reading-from-archives 2023-08-01 15:33:20 +00:00
Mikhail f. Shiryaev
a330a7ac38
PyYAML>=5.4 conflicts with cython 3 2023-08-01 17:30:53 +02:00
Mikhail f. Shiryaev
0931e87989
Merge branch 'master' into sqltest 2023-08-01 16:14:28 +02:00
Mikhail f. Shiryaev
e5087d14ab
Merge branch 'master' into fix-packager 2023-08-01 12:04:06 +02:00
Kseniia Sumarokova
40ce9cf9ed
Merge pull request #51843 from ClickHouse/kssenii-nginx
Replace kssenii/nginx-test by clickhouse/nginx-dav
2023-08-01 11:36:20 +02:00
Antonio Andelic
fe6202c1cc Disable for fasttest 2023-07-31 17:49:34 +00:00
Antonio Andelic
76331a9b49 Update dockerfile 2023-07-31 14:20:03 +00:00
Antonio Andelic
6a1cf5c683 Extend tests 2023-07-31 13:27:06 +00:00
Alexey Milovidov
0866d0a5bd Merge branch 'allow-oom-stress-upgrade-checks' into move-regions 2023-07-31 12:29:10 +02:00
Alexey Milovidov
7c49105cd5 Allow OOM in Stress and Upgrade checks 2023-07-31 12:27:35 +02:00
Alexey Milovidov
9ba8bfd3b1
Merge branch 'master' into move-regions 2023-07-30 12:53:16 +03:00
Alexey Milovidov
8155659f87
Merge pull request #52775 from ClickHouse/remove-coverity-2
Remove Coverity (part 2)
2023-07-30 12:49:04 +03:00
Alexey Milovidov
6bff19bd82 Remove Coverity (part 2) 2023-07-30 10:27:33 +02:00
Alexey Milovidov
bc1f80dd82 Remove Coverity (part 2) 2023-07-30 10:25:44 +02:00
Alexey Milovidov
7ad4f13caf
Merge branch 'master' into move-regions 2023-07-30 10:34:10 +03:00
Alexey Milovidov
2a88c240ca
Merge branch 'master' into no-export-dynamic 2023-07-30 09:48:52 +03:00
Alexey Milovidov
424fe43090
Update Dockerfile 2023-07-30 06:57:11 +03:00
Alexey Milovidov
ecfde7edc6 Fix Docker 2023-07-30 05:20:51 +02:00
Alexey Milovidov
972653cde3 Change the default timezones in Docker test images 2023-07-30 05:18:52 +02:00
Alexey Milovidov
1deebd3ae6 Fix Docker 2023-07-30 04:22:36 +02:00
Alexey Milovidov
abf058c87d Merge branch 'master' into no-export-dynamic 2023-07-30 01:49:12 +02:00
robot-clickhouse
28c49e3f20 Update version_date.tsv and changelogs after v23.7.1.2470-stable 2023-07-27 13:47:11 +00:00
Alexander Tokmakov
4d03c23166
Merge pull request #51851 from ClickHouse/add_delay_for_replicated
Make shutdown of `ReplicatedMergeTree` tables more soft
2023-07-26 12:59:37 +03:00
Kruglov Pavel
93e10077ba
Fix attaching gdb in stress tests (#51445)
* Fix attaching gdb in stress tests

* Fix

* Update run.sh

* Try remove run_with_retry

* Return run_with_retry

* Don't set -e in run_with_retry if it was't set before

* Update tests/ci/utils.lib

* Fix bash

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-07-26 12:53:19 +03:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Alexey Milovidov
34ff0e0ea9
Merge pull request #52184 from azat/tests/randomize-timezone
Randomize timezone in tests across non-deterministic around 1970 and default
2023-07-24 22:47:52 +03:00
Alexander Tokmakov
faca49a905 Merge branch 'master' into add_delay_for_replicated 2023-07-24 16:07:38 +02:00
Azat Khuzhin
2389e0f0b6 Randomize timezone in tests across non-deterministic around 1970 and default
There was some cases when some patches to the datetime code leads to
flaky tests, due to the tests itself had been runned using regular
timezone (TZ).

But if you will this tests with something "specific" (that is not
strictly defined around 1970 year), those tests will fail.

So to catch such issues in the PRs itself, let's randomize
session_timezone as well.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 06:13:12 +02:00
Alexey Milovidov
a17652a422 Merge branch 'master' into incbin 2023-07-24 05:33:52 +02:00
Alexey Milovidov
63659c55a1 Merge branch 'incbin' into no-export-dynamic 2023-07-23 21:34:12 +02:00
Alexey Milovidov
0f66d161d6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into no-export-dynamic 2023-07-23 21:33:51 +02:00
Ilya Yatsishin
7a24ed195d
Merge branch 'master' into create-index-unique-noop 2023-07-23 20:47:11 +02:00
Alexey Milovidov
4c1f8f38cd Fix CI 2023-07-23 17:30:23 +02:00
Alexey Milovidov
43cf31a98e
Merge branch 'master' into no-export-dynamic 2023-07-23 07:26:33 +03:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated 2023-07-23 00:12:29 +02:00
Azat Khuzhin
0b258dda4e Reproducible builds for Rust
From now on cargo will not download anything from the internet during
builds. This step had been moved for docker image builds (via cargo
vendor).

And now cargo inside docker.io/clickhouse/binary-builder will not use
any crates from the internet, so we don't need to add --offline for
cargo commands in cmake (corrosion_import_crate()).

Also the docker build command had been adjusted to allow following
symlinks inside build context, by using tar, this is required for Rust
packages.

Note, that to make proper Cargo.lock that could be vendored I did the
following:
- per-project locks had been removed (since there is no automatic way to
  sync the workspace Cargo.lock with per-project Cargo.lock, since cargo
  update/generate-lockfile will use only per-project Cargo.toml files
  apparently, -Z minimal-versions does not helps either)
- and to generate Cargo.lock with less changes I've pinned version in
  the Cargo.toml strictly, i.e. not 'foo = "0.1"' but 'foo = "=0.1"'
  then the Cargo.lock for workspace had been generated and afterwards
  I've reverted this part.

Plus I have to update the dependencies afterwards, since otherwise there
are conflicts with dependencies for std library. Non trivial.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-22 22:46:22 +02:00
Mikhail f. Shiryaev
cf01800a63 Sort DOCKER_*_TAG stuff 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
8c0113e02b Sanitize compose files in integration-tests-runner 2023-07-22 15:45:47 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated 2023-07-22 12:11:39 +02:00
Alexey Milovidov
de2016261e Get rid of it 2023-07-22 05:08:27 +02:00
Alexey Milovidov
e5797b7fea
Merge pull request #51514 from azat/tests/fix-integration-tests
Fix running integration tests with spaces in it's names
2023-07-22 03:38:51 +03:00
Alexey Milovidov
3398355e46 Add something with unclear purpose 2023-07-22 02:04:30 +02:00
Alexey Milovidov
999cce12b1 Merge branch 'master' into sqltest 2023-07-22 01:55:54 +02:00
Alexey Milovidov
fa44f84377 Fix style 2023-07-20 04:50:18 +02:00
Alexey Milovidov
f458108c44 Fix style 2023-07-19 22:15:23 +02:00
Alexey Milovidov
3c2fe6e716 Merge branch 'sqltest' of github.com:ClickHouse/ClickHouse into sqltest 2023-07-19 20:00:14 +02:00
Alexey Milovidov
29094a22cf Fix Docker 2023-07-19 20:00:00 +02:00
Yatsishin Ilya
bb4924ab63 Multiple sqllogictest improvements 2023-07-19 12:24:31 +00:00
Ilya Golshtein
4259176f24 test_for_basic_auth_registry - original zk configuration restored 2023-07-19 08:32:45 +00:00
Ilya Golshtein
aa2b7e248d test_for_basic_auth_registry - fix port in test_kafka_formats 2023-07-19 08:32:45 +00:00
Ilya Golshtein
83569688cb test_for_basic_auth_registry - UnknownTopicOrPartitionException 2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a test_for_basic_auth_registry - both tests works, simplifications 2023-07-19 08:32:45 +00:00
Ilya Golshtein
db8e96147a test_for_basic_auth_registry - started, but only auth test works 2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f test_for_basic_auth_registry - one kafka instance again 2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4 test_for_basic_auth_registry - attempt to have two kafka instances 2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834 test_for_basic_auth_registry - mock up 2023-07-19 08:32:44 +00:00
robot-clickhouse
891c01e6ab Automatic style fix 2023-07-19 02:37:02 +00:00
Alexey Milovidov
9b10e0a5bc Improvement 2023-07-19 04:09:19 +02:00
Alexey Milovidov
fe59729537 Improvement 2023-07-19 04:01:00 +02:00
Alexey Milovidov
76677e009b Improvement 2023-07-19 04:00:50 +02:00
Alexey Milovidov
50dac21483 Improvement 2023-07-19 03:54:09 +02:00
Alexey Milovidov
2255307a47 Improvement 2023-07-19 03:49:47 +02:00
Alexey Milovidov
fcf4a6ea88 Fix error 2023-07-19 03:48:48 +02:00
Alexey Milovidov
174166b233 Fix error 2023-07-19 03:47:41 +02:00
Alexey Milovidov
df5abcf685 Update Docker 2023-07-19 03:45:43 +02:00
Alexey Milovidov
8e3bd222f0 Add SQLTest 2023-07-19 03:42:32 +02:00
Antonio Andelic
3c2507ad7d
Merge branch 'master' into fix-packager 2023-07-18 09:18:03 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated 2023-07-17 19:04:29 +02:00
Azat Khuzhin
6f6562c96b Fix running integration tests with spaces in it's names
Previously they were simply ignored, and not only them, but all the
tests in that group, here is an example [1]

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/51448/4ed462ac7834a8180f92ca7d7d3c076e687bfca9/integration_tests__asan__[4_6].html

Note, that I've replaced PYTEST_OPTS with handled by pytest itself
PYTEST_ADDOPTS, since "sh -c $PYTEST_OPTS" does not allows you to
preserve the arguments correctly.

v5: use double quotes for PYTEST_ADDOPTS value
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Azat Khuzhin
2720e9177d Fix flakiness of test_keeper_s3_snapshot
This is part of "Why my PR is not merged?" patch set series.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-13 14:25:24 +02:00
John Spurlock
7c7a447fd2
Fix a few typos in docker readme. 2023-07-11 12:16:55 -05:00
robot-clickhouse-ci-1
4666838a5d
Merge pull request #49438 from azat/build/unwind
Force libunwind usage (removes gcc_eh support)
2023-07-09 05:38:34 +02:00
robot-clickhouse
45d36b736a Update version_date.tsv and changelogs after v23.6.2.18-stable 2023-07-08 23:14:02 +00:00
Azat Khuzhin
a10aa9ad50 Force libunwind usage (removes gcc_eh support)
libunwind is reentrant and signal safe, and works faster then then
gcc_eh (plus it has some custom patches for problems that have been
found during it's usage in ClickHouse).

gcc_eh may be missing in the system (if gcc was not installed), and
even if it exists clickhouse uses -nodefaultlibs, so some care should be
made to make it work.

Also this library is tiny and there shouln't be any problem to require
it always (there is already tendency to require some contrib libraries,
i.e. poco).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-08 20:55:50 +02:00
Alexey Milovidov
c828db5720 Allow OOM in AST Fuzzer with Sanitizers 2023-07-08 05:57:23 +02:00
Alexey Milovidov
d15723997b
Merge pull request #51863 from ClickHouse/remove-useless-packages
Remove useless packages
2023-07-08 02:21:07 +03:00
Alexey Milovidov
f8eaa3e8e6
Merge pull request #51903 from azat/build/pin-rust
Pin rust nightly (to make it stable)
2023-07-07 20:28:57 +03:00
Alexey Milovidov
cf66be571f
Merge branch 'master' into remove-useless-packages 2023-07-07 13:44:13 +03:00
Alexey Milovidov
6cfeef00d7
Merge pull request #31398 from ClickHouse/riscv-in-ci
Add Linux RISC-V 64 build to CI
2023-07-06 22:49:16 +03:00
Azat Khuzhin
ec5e26a017 Pin rust nightly (to make it stable)
Because of using Rust nightly, and without #49601 the Rust toolchain is
very unstable, and can be frequently failed.

So let's ping particular version.

Also I've looked and it seems that Rust archives stores this archive
without any TTL, since there is even a version for 2015 year.

Follow-up for: #50541
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-06 21:17:50 +02:00
Antonio Andelic
c390c900c5
Merge branch 'master' into upgrade-check-fix-2 2023-07-06 21:10:41 +02:00
Alexander Sapin
9ae0dc730c Review fixes + enable in ci 2023-07-06 17:15:26 +02:00
Mikhail f. Shiryaev
6bbaade4a6
Update sccache, do not fail on connection error 2023-07-06 16:09:52 +02:00
Antonio Andelic
f825c85c72
Merge branch 'master' into fix-packager 2023-07-06 08:36:43 +02:00
Antonio Andelic
085f7caccf Move config changes after configure 2023-07-06 06:30:47 +00:00
Alexey Milovidov
75d051dd55 Remove useless packages 2023-07-06 01:49:53 +02:00
Alexey Milovidov
70bcf28f4a
Merge pull request #51839 from ClickHouse/fix-upgrade-test-disks
Fix disk config for upgrade tests
2023-07-06 00:35:18 +03:00
Antonio Andelic
1124c7ae8b Correctly move config 2023-07-05 12:42:36 +00:00
Mikhail f. Shiryaev
bcc569b9e3
Add temporary pin for docker-ce 2023-07-05 10:28:57 +02:00