Commit Graph

334 Commits

Author SHA1 Message Date
Kseniia Sumarokova
cb8af0fd4c
Merge pull request #11058 from overshov/master
Implement IDisk interface for HDFS
2021-05-26 14:14:06 +03:00
Yatsishin Ilya
3badb2afc9 shellcheck fix 2021-05-26 07:34:19 +03:00
Yatsishin Ilya
0ca1ce8ab3 shellcheck fix 2021-05-25 19:55:53 +03:00
Yatsishin Ilya
1a97db544d rm containers in entrypooint 2021-05-25 15:30:20 +03:00
Yatsishin Ilya
10372b12b7 rm containers in entrypooint 2021-05-25 15:29:22 +03:00
kssenii
a78c9e63e7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-23 12:07:26 +00:00
kssenii
0f98731c1f More integration tests 2021-05-23 07:33:31 +00:00
Yatsishin Ilya
d73d92ed7e revert some changes 2021-05-21 18:48:14 +03:00
Yatsishin Ilya
c6c180c35d fix shellcheck 2021-05-21 17:33:56 +03:00
Yatsishin Ilya
daf0b5ad2b rewrite zookeeper test 2021-05-21 16:29:43 +03:00
Yatsishin Ilya
1d35da6882 Merge remote-tracking branch 'origin' into integration-2 2021-05-20 19:12:04 +03:00
DarkWanderer
fae887e6b6 Fixed issue (docker/podman different behavior), added .gitignore 2021-05-19 15:59:12 +03:00
alesapin
31181095e7 Review fixes 2021-05-18 17:08:56 +03:00
Yatsishin Ilya
3c804556fb fix 2021-05-18 14:02:23 +03:00
Yatsishin Ilya
40e63646ca more 2021-05-17 14:16:16 +03:00
alesapin
18bf681a83 Fix pull 2021-05-14 18:35:30 +03:00
alesapin
123715300a Use keeper in integration tests 2021-05-14 15:30:49 +03:00
Yatsishin Ilya
fe0194aa4b s3 catch up 2021-05-12 10:03:53 +03:00
kssenii
7643d84095 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-04-30 22:02:51 +00:00
Yatsishin Ilya
fddc72fb49 fixes 2021-04-30 15:22:37 +03:00
Ilya Yatsishin
8e67cab2a3
Merge pull request #23138 from qoega/add-dockerproxy-to-runner
Add dockerhub-proxy to runner
2021-04-28 17:10:28 +03:00
Yatsishin Ilya
edabf8f5c3 wip 2021-04-27 12:07:04 +03:00
zhang2014
81496b2e63 Try fix MySQL 8.0 address already in use 2021-04-22 11:04:30 +08:00
DarkWanderer
eb8ba4eaa9 Adding integration test for ClickHouse.Client 2021-04-17 20:02:27 +03:00
Yatsishin Ilya
3288da2fcb fix 2021-04-15 15:56:02 +03:00
Yatsishin Ilya
647fd1b53b Add dockerhub-proxy to runner 2021-04-15 15:42:31 +03:00
Yatsishin Ilya
b520d28873 Add dockerhub-proxy to runner 2021-04-15 15:06:49 +03:00
Yatsishin Ilya
f6d455732e better 2021-04-14 19:04:17 +03:00
Yatsishin Ilya
10b7037d9c Merge remote-tracking branch 'origin' into integration-2 2021-04-14 14:21:40 +03:00
Yatsishin Ilya
c2707a8154 better 2021-04-13 17:55:31 +03:00
Yatsishin Ilya
b4dded3fc2 wip 2021-04-12 10:03:12 +03:00
Yatsishin Ilya
2cc9d314be fix 2021-04-08 17:43:57 +03:00
kssenii
9fa21a6272 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-04-08 12:18:54 +00:00
Yatsishin Ilya
5311278c29 Merge remote-tracking branch 'origin' into integration-2 2021-04-08 12:30:24 +03:00
Yatsishin Ilya
9115fd8cec wip 2021-04-07 15:22:53 +03:00
alesapin
86a843bb51
Merge pull request #21509 from kssenii/library-bridge
clickhouse-library-bridge for library dictionary source
2021-04-06 12:26:08 +03:00
kssenii
88df6afc84 More tests 2021-03-31 23:48:54 +00:00
kssenii
7dfcef9846 Add forgotten files 2021-03-31 21:46:07 +00:00
kssenii
03ce320926 Add a separate docker-compose with multiple servers for postgres and mysql 2021-03-31 17:04:57 +00:00
kssenii
f40c582e7a Replicas/shards for postgres storage 2021-03-27 20:11:48 +00:00
kssenii
f141f027f4 Make common class for external storages 2021-03-27 17:12:47 +00:00
kssenii
ae868208c2 Use pool with failover in mysql storage 2021-03-27 14:39:45 +00:00
Yatsishin Ilya
af1c14b4ee try other network 2021-03-23 18:42:36 +03:00
Yatsishin Ilya
e79b5b57fd try export dockerd.log 2021-03-23 14:35:45 +03:00
kssenii
619f0f51fd Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-03-20 09:47:05 +00:00
Yatsishin Ilya
5ae47bd2b4 Merge remote-tracking branch 'origin/master' into integration-2 2021-03-19 15:33:14 +03:00
kssenii
34dea63248 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-17 13:32:43 +00:00
kssenii
bd38a7a021 Fix tests 2021-03-15 06:37:07 +00:00
kssenii
8eea6a87e9 Support replicas priority for postgres dictionary source 2021-03-14 08:51:24 +00:00
kssenii
571590fcfb Update tests, dockerfile 2021-03-12 09:20:18 +00:00
kssenii
fd4a19bbf8 Update dockerfile and config.d 2021-03-11 21:21:14 +00:00
Yatsishin Ilya
e6f90298bb wip 2021-03-09 10:32:10 +03:00
Yatsishin Ilya
534500ef84 wip 2021-03-05 16:39:51 +03:00
Yatsishin Ilya
babea212c7 Merge remote-tracking branch 'origin' into integration-2 2021-03-03 11:56:15 +03:00
kssenii
a3c7402200 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-03-02 07:07:56 +00:00
alexey-milovidov
9f0400f015
Merge pull request #21171 from azat/tests-bump-zookeeper
Bump zookeeper version to 3.6.2 in tests
2021-02-28 02:35:58 +03:00
Azat Khuzhin
bc1a316b28 Bump zookeeper version to 3.6.2 in tests
3.4.12 was released 1.05.2018
2021-02-26 23:41:43 +03:00
alesapin
a48bb7e3a0 Fix redundant zookeeper reconnect and possibility of multiple zookeeper session for a single ClickHouse server 2021-02-26 22:05:25 +03:00
Yatsishin Ilya
7c61f6c957 Merge remote-tracking branch 'origin' into integration-2 2021-02-24 15:42:20 +03:00
kssenii
4cdb55babe Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-02-22 12:39:35 +00:00
Azat Khuzhin
91c4ebaf0b Merge remote-tracking branch 'upstream/master' into yamllint 2021-02-22 08:52:54 +03:00
Azat Khuzhin
e922690453 Fix yamllint issues 2021-02-20 23:25:21 +03:00
Azat Khuzhin
4784d09d17 tests/integration: increase verbosity for test_materialize_mysql_database 2021-02-20 22:09:01 +03:00
Azat Khuzhin
6873ad1983 tests/integration: fix yamllint issues in docker-compose.yaml for mysql 2021-02-20 22:09:01 +03:00
Yatsishin Ilya
65a55b1010 Merge remote-tracking branch 'origin' into integration-2 2021-02-19 20:07:16 +03:00
kssenii
79d5b40a99 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-02-19 16:02:31 +00:00
Yatsishin Ilya
d45cab4228 wip 2021-02-19 17:42:43 +03:00
Yatsishin Ilya
ee955038c1 wip 2021-02-19 15:58:11 +03:00
kssenii
1c5b10de41 Use fixed version for aerospike 2021-02-19 10:42:25 +00:00
Yatsishin Ilya
2df4317aba wip 2021-02-19 00:21:50 +03:00
Yatsishin Ilya
872e36c207 wip 2021-02-18 15:57:45 +03:00
Yatsishin Ilya
677528326f postgres 2021-02-17 18:40:01 +03:00
Yatsishin Ilya
8603855f5f fix 2021-02-16 17:16:15 +03:00
Yatsishin Ilya
e4b3511d28 no more separate compose files for materialize mysql 2021-02-16 10:37:35 +03:00
Yatsishin Ilya
06e1188d9e wip 2021-02-15 12:35:45 +03:00
kssenii
d255b63364 Slightly better 2021-02-12 21:13:01 +00:00
kssenii
b842ce114b Initial sync into ReplacingMergeTree table, select via nested table 2021-02-12 21:11:09 +00:00
Yatsishin Ilya
8aca6e9cd0 update runner 2021-02-12 18:50:52 +03:00
alesapin
6247d59c32 Use fixed version 2021-02-05 18:30:45 +03:00
alesapin
92a4c4e318 Add librdkafka to integration tests runner 2021-02-05 18:28:20 +03:00
Yatsishin Ilya
19d6e867c6 HDFS test had a clash with 9000 ClickHouse port. 2021-02-02 12:08:47 +03:00
alesapin
941f60a7b5 Temporary retrun dicttoxml to integration tests runner 2021-01-29 16:17:17 +03:00
Yatsishin Ilya
d21d838604 No more dicttoxml with excessive logs 2021-01-27 12:50:11 +03:00
Mikhail Filimonov
6bec839ab3
Touch dockerfiles to trigger rebuild 2021-01-14 12:46:24 +01:00
Ilya Golshtein
832d99515b tag for yandex/clickhouse-kerberized-hadoop 2020-12-17 12:05:49 +03:00
Ilya Golshtein
a5a33f1963 rpm rebuilddb and yum update in kerberized_hadoop/Dockerfile 2020-12-16 14:48:33 +03:00
Ilya Golshtein
39877b1a6f yum clean all in kerberized_hadoop/Dockerfile 2020-12-16 14:48:33 +03:00
Ilya Golshtein
a4dad0acb7 CentOS 6 became too old 2020-12-16 14:48:33 +03:00
Ilya Golshtein
09d1e89674 yandex/clickhouse-kerberized-hadoop + missed header 2020-12-16 14:48:33 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d9166a0645 HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities 2020-12-16 14:48:33 +03:00
Ilya Golshtein
eb10948ca2 kerberized_hdfs cluster started 2020-12-16 14:48:33 +03:00
alesapin
031ddaedd4 Update docker image in integration tests runner 2020-12-01 14:32:33 +03:00
alesapin
1d179dac22
Merge pull request #17486 from ClickHouse/fix_more_flaky_tests
Fix more flaky integration tests
2020-11-28 10:43:29 +03:00
alesapin
239ed12458 Better defaults 2020-11-27 14:50:33 +03:00
taichong
c8f7a56a25 fix CI timeout err 2020-11-27 11:34:49 +08:00
taichong
a6c2a90756 modify integration test materialize mysql database
1. fix asan test err

2. reset pymysql conn if ping err

3. finish mysql & ck killed test

4. modify check_query
2020-11-23 17:55:07 +08:00
alesapin
dca35b1913 Add awesome test for fetch 2020-10-27 15:24:10 +03:00
Alexander Kuzmenkov
7581267c01 remove warnings in integration tests 2020-10-16 18:27:45 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov
499e0766e5 Check docker scripts with shellcheck 2020-09-30 20:06:46 +03:00
Alexander Tokmakov
a7d3a024c7 Revert "Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka""
This reverts commit c298c633a7.
2020-09-29 11:56:37 +03:00
tavplubix
c298c633a7
Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka" 2020-09-24 16:10:24 +03:00
Ilya Yatsishin
7dad84ea6b
Merge pull request #14265 from arenadata/ADQM-160
Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka
2020-09-23 19:02:58 +03:00
Ilya Golshtein
494e59e7c1 DOCKER_KERBEROS_KDC_TAG 2020-09-21 19:12:31 +03:00
alesapin
27613f8346 Fix symbolizers path in test images 2020-09-21 10:38:11 +03:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
7a6f7a872a forgotten docker changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
Yatsishin Ilya
14b61e87d9 mysql bin log 2020-09-03 13:27:17 +03:00
Yatsishin Ilya
fc075e65da Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-03 11:49:48 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Yatsishin Ilya
5ab9f249e5 Merge branch 'try-dns-fix' into integration-explicit-configs 2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-02 12:48:07 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Azat Khuzhin
2d7cb03120 Suppress superfluous wget (-nv) output
Since for dowloading some of files wget logging may take 50% of overall
log [1].

  [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Yatsishin Ilya
6cb893f073 Draft. 2020-09-01 09:38:23 +03:00
Alexander Tokmakov
65a69ff6ad move docker-compose files 2020-08-27 14:46:19 +03:00
Ivan A. Torgashov
1006c4f11b Update tests for Redis dictionary requirepass authorization support 2020-08-15 14:18:17 +05:00
Yatsishin Ilya
73e9f4d421 update test_materialize_mysql_database test 2020-08-13 21:20:47 +03:00
Ilya Yatsishin
e6420c82ca
mysql/postgresql: move Dockerfiles and docker_compose to docker/test (#13448)
* mysql/postgresql: move Dockerfiles and docker_compose to docker/test
* Build client containers in CI
* pass tag to docker_compose
2020-08-12 18:04:36 +03:00
Yatsishin Ilya
730056a9f0 fix 2020-08-12 15:22:31 +03:00
Yatsishin Ilya
160776f183 Add explicit main_configs, user_configs and dictionaries in integration tests. 2020-08-12 11:55:04 +03:00
Yatsishin Ilya
fdd18e540d move reference files 2020-08-12 07:06:23 +03:00
Yatsishin Ilya
e3f7fea33a fix 2020-08-11 11:31:26 +03:00
Yatsishin Ilya
1d0e4ca670 pass tag to docker_compose 2020-08-10 16:35:08 +03:00
Yatsishin Ilya
70fca95a5a mysql/postgresql: move Dockerfiles and docker_compose to docker/test 2020-08-07 11:42:04 +03:00
Ilya Yatsishin
0517449e28
Update docker/test/integration/base/Dockerfile 2020-07-27 13:01:26 +03:00
Ilya Yatsishin
c2e0954f26
Fix MySQL broken link 2020-07-23 22:33:55 +03:00
Yatsishin Ilya
9633215684 Do not build helper_container image inside integrational tests. Part 1: build helper_container in CI 2020-07-21 17:40:48 +03:00
Anton Ivashkin
52fea6a5a3 Merge master 2020-07-14 15:56:38 +03:00
Anton Ivashkin
26fca949bd add profiling events from S3 request to system.events and system.query_log 2020-07-13 11:27:11 +03:00
Pavel Kovalenko
5a42dca252 Trigger integration-test-runner image rebuild. 2020-07-11 12:16:10 +03:00
Pavel Kovalenko
d4826a3df7 Replace build with proper images in docker_compose_minio.yml 2020-07-10 23:38:48 +03:00
Pavel Kovalenko
f43428a4d5 S3 HTTPS integration test. 2020-07-10 22:42:18 +03:00
Yatsishin Ilya
0c7a261bc6 Place common docker compose files to integration docker container 2020-07-06 16:45:54 +03:00
alexey-milovidov
1719ab1ec5
Merge pull request #12041 from azat/curl-proper-cmake
Rewrite curl dependency in a more ch compatible way
2020-07-06 06:31:51 +03:00
Azat Khuzhin
0700a705bc Rewrite curl dependency in a more ch compatible way
- add support of unbundled curl
- add CURL::libcurl libraries
- avoid explicit linkage of daemon with curl (added with sentry)
- set CACHE variables for non-direct users:
  - mariadb-connector-c
  - aws-s3-cmake
  - sentry-native

Cc: @alexey-milovidov
Cc: @alesapin (requires docker image update)
Cc: @abyss7

Refs: #11300
Refs: #8011
Refs: #8905

v2: replace cmake/find/curl.cmake with proper contrib/curl-cmake (as
pointed by @abyss7, cmake/find/*.cmake is deprecated)
2020-07-03 00:57:08 +03:00
alesapin
fb891ee4eb
Revert "[experiment] maybe fix warnings in integration tests" 2020-06-28 16:20:57 +03:00
alesapin
3fc65b3269 Merge branch 'master' into kssenii-rabbit-mq 2020-06-24 20:14:28 +03:00
Ivan Blinkov
d154ba227c
Update Dockerfile 2020-06-24 19:33:17 +03:00
Ivan Blinkov
aac17eb48d
[experiment] maybe fix warnings in integration tests 2020-06-24 11:38:00 +03:00
alesapin
afcf63ad89 Add alias for postgesql container 2020-06-22 16:29:35 +03:00
Alexey Milovidov
25f55bb5dd Remove duplicate entry 2020-06-20 15:39:02 +03:00
kssenii
18820814f5 Merge 2020-06-10 23:25:33 +00:00
Alexander Tokmakov
6bb68329f8 Merge branch 'master' into merging_external_source_cassandra 2020-06-09 19:51:14 +03:00
Alexander Tokmakov
e67837bc4a cleenup 2020-06-04 00:11:17 +03:00
Pervakov Grigorii
bc9381406f Add default credentials and custom headers for s3 table functions. 2020-06-02 20:48:49 +03:00
kssenii
e80b405359 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only 2020-05-31 10:30:53 +00:00
Alexander Tokmakov
e049290af7 add cassandra-driver to integration tests 2020-05-26 22:15:46 +03:00
kssenii
ad1c0de8db Merge 2020-05-26 17:45:39 +00:00
Alexander Tokmakov
ac54d470da Merge branch 'master' into merging_external_source_cassandra 2020-05-22 17:27:40 +03:00
Alexander Kuzmenkov
fecd84d3c0
Merge pull request #10915 from ClickHouse/aku/mongodb-uri
Support MongoDB URI
2020-05-21 23:02:12 +03:00
Alexander Tokmakov
31b6f5f0d2 Merge branch 'master' into merging_external_source_cassandra 2020-05-20 23:44:53 +03:00
kssenii
c3569882bb Update version of docker_compose_rabbitmq.yml 2020-05-20 18:24:40 +00:00
kssenii
4dc659b763 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only 2020-05-20 18:17:41 +00:00
kssenii
41b99edc04 Add base for RabbitMQ integration tests 2020-05-20 09:22:12 +03:00
Alexander Kuzmenkov
bc34e0ff94 fixup 2020-05-19 23:12:10 +03:00
alesapin
a17f034271 Bump compose version to 2.3, and make tmpfs for zookeeper optional 2020-05-19 18:27:10 +03:00
Alexander Tokmakov
175b7aedf3 Merge branch 'master' into merging_external_source_cassandra 2020-05-19 05:21:27 +03:00
alesapin
b4652625c7 Try to enable skipped tests 2020-05-18 13:02:52 +03:00
Pavel Kovalenko
506634786e Handle exceptions in ProxyResolverConfiguration properly. 2020-05-12 17:34:37 +03:00
Pavel Kovalenko
6165c2aa99 Add possibility to use proxy resolver in DiskS3. 2020-05-08 13:53:12 +03:00
kssenii
2c9e216132 Fix to python-pika 2020-05-07 02:52:33 +03:00
kssenii
d30a1dde0d Add pika python module 2020-05-07 02:14:13 +03:00
mnkonkova
b38a2f1d24 module add for grpc integratio test 2020-05-04 17:35:43 +00:00
Pavel Kovalenko
e5e84960ea S3 with proxy integration test and fixes. 2020-04-29 11:40:29 +03:00
Yatsishin Ilya
a0ce15befd Move integration tests docker files to docker/ directory. Rename image -> runner. 2020-04-17 19:01:16 +03:00
alesapin
049b86ff7d Bump llvm tools to 9 2020-03-25 15:12:03 +03:00
Alexander Kuzmenkov
fa9a02a292 Update docker with new msan flags 2019-12-13 19:23:20 +03:00
Alexander Kuzmenkov
5b67c55ec6 Update containers for #6892. 2019-12-13 16:57:10 +03:00
alesapin
854175406d Add gdb to integration tests image 2019-12-10 13:13:22 +03:00
alesapin
f3e34ec895 Correct llvm-symbolizer path 2019-07-09 22:41:22 +03:00
proller
64924f5ef3 Docker: add comments with current tags 2019-06-04 16:01:16 +03:00
Mikhail Filimonov
0b60d53fc6 Replace ENV with RUN 2019-05-22 10:43:27 +02:00
Mikhail Filimonov
8a1d773ced more dockerfile fixes 2019-05-21 08:17:46 +02:00
Alexey Milovidov
b8a7d78e3a Tracking maximum amount of history in TSan 2019-03-29 19:58:02 +03:00
alesapin
6b6ac59557 Add asserts to integration tests container 2019-03-21 12:21:56 +03:00
alesapin
22a54bbd77 Add python into integration tests image 2019-02-24 13:28:47 +03:00
alesapin
43b099f20b Revert to ubuntu 18.04 2018-11-21 15:05:31 +03:00
alesapin
6ce13a08ef Move build and test images to 18.10, add libraries for unbundled build in debian image 2018-11-21 13:09:16 +03:00