Commit Graph

338 Commits

Author SHA1 Message Date
Duc Canh Le
2406e9a987 allow non standalone keeper run in integration tests
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-08-17 11:10:35 +00:00
Arthur Passos
9781a8cee9 bring back dns tests, fix them by pining coredns version and modifying test_reverse_dns_query 2023-08-10 16:45:29 -03:00
Alexey Milovidov
4696254887
Merge pull request #53065 from ClickHouse/nickitat-patch-15
Add `abort_on_error=1` to `TSAN_OPTIONS`
2023-08-07 17:17:04 +03:00
Nikita Taranov
555c90a50c add to integration tests 2023-08-04 23:26:52 +02:00
Azat Khuzhin
344d648cab tests: adjust net.ipv4.ip_local_port_range for some services to avoid EADDRINUSE
As it turns out, docker does not pass through the sysctls, so adjust
this for know users of unprivileged ports (>32K):
- HDFS
- kafka

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:17:49 +02:00
Azat Khuzhin
d2a264c9bb tests: use explicit address for console to avoid EADDRINUSE
The problem is that MinIO uses dynamic port for console address by
default, which may be below ip_local_port_range, and in this case it ca
be reused in a short time, sicne first MinIO allocates the socket, then
close this socket, and only after try to bind to it.

And even though this is a problem of MinIO I'm not a go developer to fix
it.

v2: use long notation of the 127.0.0.1 (that version of MinIO on CI
cannot handle 127.1, while 2023-07-21T21-12-44Z can)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:17:49 +02:00
Mikhail f. Shiryaev
a330a7ac38
PyYAML>=5.4 conflicts with cython 3 2023-08-01 17:30:53 +02:00
Mikhail f. Shiryaev
cf01800a63 Sort DOCKER_*_TAG stuff 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
8c0113e02b Sanitize compose files in integration-tests-runner 2023-07-22 15:45:47 +02:00
Alexey Milovidov
e5797b7fea
Merge pull request #51514 from azat/tests/fix-integration-tests
Fix running integration tests with spaces in it's names
2023-07-22 03:38:51 +03:00
Ilya Golshtein
4259176f24 test_for_basic_auth_registry - original zk configuration restored 2023-07-19 08:32:45 +00:00
Ilya Golshtein
aa2b7e248d test_for_basic_auth_registry - fix port in test_kafka_formats 2023-07-19 08:32:45 +00:00
Ilya Golshtein
83569688cb test_for_basic_auth_registry - UnknownTopicOrPartitionException 2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a test_for_basic_auth_registry - both tests works, simplifications 2023-07-19 08:32:45 +00:00
Ilya Golshtein
db8e96147a test_for_basic_auth_registry - started, but only auth test works 2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f test_for_basic_auth_registry - one kafka instance again 2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4 test_for_basic_auth_registry - attempt to have two kafka instances 2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834 test_for_basic_auth_registry - mock up 2023-07-19 08:32:44 +00:00
Azat Khuzhin
6f6562c96b Fix running integration tests with spaces in it's names
Previously they were simply ignored, and not only them, but all the
tests in that group, here is an example [1]

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/51448/4ed462ac7834a8180f92ca7d7d3c076e687bfca9/integration_tests__asan__[4_6].html

Note, that I've replaced PYTEST_OPTS with handled by pytest itself
PYTEST_ADDOPTS, since "sh -c $PYTEST_OPTS" does not allows you to
preserve the arguments correctly.

v5: use double quotes for PYTEST_ADDOPTS value
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Azat Khuzhin
2720e9177d Fix flakiness of test_keeper_s3_snapshot
This is part of "Why my PR is not merged?" patch set series.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-13 14:25:24 +02:00
Mikhail f. Shiryaev
bcc569b9e3
Add temporary pin for docker-ce 2023-07-05 10:28:57 +02:00
Mikhail f. Shiryaev
340262814a
Avoid additional maven requests for spark tests 2023-06-29 12:24:19 +02:00
Mikhail f. Shiryaev
406896f9a9
Create cgroupsv2 subtree for docker-in-docker 2023-06-28 22:19:41 +02:00
Mikhail f. Shiryaev
ead81879b4
Update integration tests runner too 2023-06-28 22:19:32 +02:00
Mikhail f. Shiryaev
45cd7f35cd
Use clickhouse/integration-helper from changed images 2023-06-28 22:11:48 +02:00
Mikhail f. Shiryaev
95eb78a593
Using a proper --tls=false option to disable TLS 2023-04-19 13:33:15 +02:00
Mikhail f. Shiryaev
6a6a028a51
Reduce docker image size, fix slow startup 2023-04-19 09:44:53 +02:00
kssenii
4bf01c611c Fix 2023-04-13 16:56:11 +02:00
kssenii
6f53784f22 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-13 15:56:40 +02:00
Azat Khuzhin
a1272e8536 Pass existing TSAN_OPTIONS to integration tests and append new options
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 15:17:43 +02:00
kssenii
00282483c9 Address remaining review comments 2023-04-07 18:29:55 +02:00
kssenii
c40f17a276 One more attempt 2023-04-06 20:09:06 +02:00
kssenii
4a94074f71 Try fix java errors in CI 2023-04-06 15:11:45 +02:00
kssenii
44b9bc5a91 Remove redundant from dockerd-entrypoint.sh 2023-04-05 14:40:30 +02:00
kssenii
0240ad4c68 Add spark to tests, rewrite tests, fix bug 2023-03-08 15:45:35 +01:00
Roman Vasin
2995c6d866 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-634 2023-01-09 08:26:45 +00:00
Alexey Milovidov
983bd527dd Merge branch 'master' into modern-tools 2023-01-08 03:19:30 +01:00
Alexey Milovidov
869428f228 Remove adduser dependency 2023-01-07 01:45:54 +01:00
Alexey Milovidov
e54d30a812
Merge branch 'master' into modern-tools 2023-01-05 21:24:47 +03:00
Yatsishin Ilya
932a2f9e09 revert minio changes 2023-01-05 09:12:56 +00:00
Yatsishin Ilya
9cf599e58b Merge remote-tracking branch 'origin/master' into green-ci-2 2023-01-04 15:49:22 +00:00
Yatsishin Ilya
fb9e363204 remove unnecessary change 2023-01-02 17:06:07 +00:00
Yatsishin Ilya
631c55e379 Fix compose files to work without correct environment 2023-01-02 16:45:50 +00:00
Yatsishin Ilya
f779fe3c0a Improve some integration tests 2023-01-02 12:43:16 +01:00
Alexey Milovidov
0b324ab836 Modern tools 2023-01-01 20:53:06 +01:00
Roman Vasin
483e26cf2f
Merge branch 'master' into ADQM-634 2022-12-26 15:34:38 +03:00
Roman Vasin
64c0c6ae99 Refactor test_kerberos_auth test 2022-12-19 11:28:49 +00:00
Roman Vasin
e2ced517dd Add integration test test_kerberos_auth 2022-12-14 13:39:23 +00:00
Azat Khuzhin
6e52748af6 Improve pytest --pdb experience by preserving dockerd on SIGINT
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-19 10:47:44 +01:00
Alexey Milovidov
ecfd8cb5a6 Remove trash error message from integration tests 2022-09-17 20:24:56 +02:00
Igor Nikonov
dbfb448290 Fix: integration test, standalone keeper mode
There is logic regarding which keeper binary use to start keeper cluster in an integration test
There 2 options:
(1) standalone keeper binary (expected binary name clickhouse-keeper)
(2) clickhouse binary with keeper inside

Fixed:
- option (1) didn't work since docker_compose_keeper.yaml didn't create
target clickhouse-keeper at all
- if clickhouse-keeper existed, option (1) was taken but
  clickhouse-keeper could be just a link to clickhouse binary (the link
  is created always during build if cmake option BUILD_STANDALONE_KEEPER is OFF)
2022-09-09 14:51:34 +00:00
Constantine Peresypkin
10c76917ea fix nats-io TLS support
nats-io library needs `NATS_HAS_TLS` define to correctly compile-in TLS
support

fixes #39525
2022-08-05 11:20:05 +02:00
Alexander Tokmakov
9e9969cea7
Merge pull request #37827 from arthurpassos/host_regexp_multiple_domains
Test host_regexp against all PTR records instead of only one
2022-07-21 16:43:05 +03:00
Arthur Passos
828de2a674 Add host regexp multiple PTR records integration tests 2022-07-20 14:09:38 -03:00
Kseniia Sumarokova
f629fd7e57
Update docker_compose_meili.yml 2022-07-12 15:50:35 +02:00
Kseniia Sumarokova
bcd9453f33
Set meilieserach client version too 2022-07-12 12:15:20 +02:00
Kseniia Sumarokova
aebb73a24d
Update docker_compose_meili.yml 2022-07-11 21:41:15 +02:00
Kseniia Sumarokova
6c3d648f49
Merge branch 'master' into nats-integration 2022-07-04 21:06:07 +02:00
Alexander Tokmakov
0bb036dd21
Update Dockerfile 2022-06-28 20:35:20 +03:00
Vladimir Chebotarev
89dc2844db Fix for integration tests fix. 2022-06-27 23:13:40 +03:00
Vladimir Chebotarev
2b19e69930 Don't try to kill empty list of containers in integration/runner. 2022-06-27 06:12:10 +03:00
Mikhail f. Shiryaev
848ae7b130
Update docker-compose to try get rid of v1 errors 2022-06-24 16:49:48 +02:00
lgbo-ustc
eddb6443f2 rollback dockerd-entrypoint.sh 2022-06-21 16:25:24 +08:00
lgbo-ustc
cdd7a54995 improve stability for hive intergration test 2022-06-21 15:59:54 +08:00
Alexander Tokmakov
72fe5144ca
Revert "Don't try to kill empty list of containers in integration/runner" 2022-06-11 22:55:31 +03:00
Vladimir Chebotarev
91d9a074e1 Even more better. 2022-06-08 15:47:20 +03:00
tchepavel
2692d88a42
Merge branch 'master' into nats-integration 2022-05-17 16:59:57 +03:00
tchepavel
a3af94d49e Documentation; integration tests; subscribe on startup 2022-05-17 16:58:09 +03:00
tchepavel
35cbe48ca3 Fixing; preparing test 2022-05-16 13:03:28 +03:00
Mikhail Artemenko
12717f2417 fix <Breaking changes> in Meilisearch v0.27.0 2022-05-12 16:51:00 +03:00
mergify[bot]
0e2a86dcee
Merge branch 'master' into MeiliSearch 2022-05-11 08:49:19 +00:00
Mikhail f. Shiryaev
e31ac2e717
Fix cleaning up integration-runner docker volume 2022-05-10 17:41:49 +02:00
Mikhail Artemenko
6830b74925 fix ref after merge & change runner dockerfile 2022-05-01 23:57:44 +03:00
Mikhail Artemenko
41f657d8ed
Merge branch 'master' into MeiliSearch 2022-05-01 10:01:56 +03:00
Mikhail f. Shiryaev
a2dc780174
Make backward compatible integration tests runner 2022-04-25 21:16:02 +02:00
alesapin
ba81816dc1 Better cmake 2022-04-20 12:11:55 +02:00
Mikhail Artemenko
151eeb1a27
Merge branch 'master' into MeiliSearch 2022-04-06 17:07:55 +03:00
Mikhail Artemenko
1886d9c2ea refactor parseTypeOfField & fix tests 2022-03-27 23:00:28 +03:00
alesapin
2f8da04891 Fix timezones 2022-03-14 13:46:45 +01:00
Mikhail f. Shiryaev
23546ab825
Use the current kerberized-haddop image 2022-02-13 22:01:45 +01:00
Mikhail f. Shiryaev
7ca684aa9c
Revert checks for architectures in Dockerfiles 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
bd3812a462
Add a comment 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
2d02eab750
Revert "Merge pull request #34373 from ClickHouse/docker-tz"
This reverts commit efd8044ab7, reversing
changes made to 4bb69bcb15.
2022-02-08 15:34:01 +01:00
Mikhail f. Shiryaev
4a857d7d18
Use UTC in docker images 2022-02-07 12:35:32 +01:00
mergify[bot]
4ffc3bb589
Merge branch 'master' into fix-mongo2-compose 2022-01-14 18:36:37 +00:00
Mikhail Artemenko
698364f7b0 add tests 2022-01-14 20:58:56 +03:00
Mikhail f. Shiryaev
fdb88b75ec
Don't build integration tests on arm64 yet 2022-01-14 15:48:43 +01:00
Mikhail f. Shiryaev
73f06421b1
Use automatic architecture for docker repo 2022-01-14 15:03:43 +01:00
Mikhail f. Shiryaev
97e4151aff
Remove broken editing of /etc/hosts 2022-01-14 14:46:14 +01:00
Yatsishin Ilya
2fe8f6c60b Fix ports allocated for mongo2 that is w/o creds 2022-01-14 13:00:38 +00:00
taiyang-li
66813a3aa9 merge master 2022-01-12 16:56:29 +08:00
Alexey Milovidov
c3ab18d1b0 Merge branch 'feature/dotnet-integration-test' of github.com:DarkWanderer/ClickHouse into dotnet-integration-test 2022-01-03 03:00:01 +03:00
alexey-milovidov
f1b6bc1074
Update docker_compose_dotnet_client.yml 2022-01-03 02:55:49 +03:00
alexey-milovidov
817bb0ee6d
Update docker_compose_dotnet_client.yml 2022-01-03 02:46:08 +03:00
taiyang-li
2597925724 merge master 2021-12-21 15:55:39 +08:00
Vitaly Baranov
e61d3eef0c
Merge pull request #32747 from vitlibar/improve-grpc-compression
Improve gRPC compression support
2021-12-20 19:44:58 +03:00
Vitaly Baranov
708439b036 Support customized compression for input/output data in gRPC protocol. 2021-12-19 16:29:44 +03:00
Mikhail f. Shiryaev
6f6b7c7bac
Merge pull request #32905 from ClickHouse/add_dockerhub_proxy
Add dockerhub proxy to CI
2021-12-17 14:31:50 +01:00
alesapin
47c907d41a Add dockerhub proxy 2021-12-17 13:20:48 +03:00