Commit Graph

2063 Commits

Author SHA1 Message Date
Maksim Kita
ae47a7ccce Integration test increase wait before dictionary update 2021-05-05 23:39:40 +03:00
Azat Khuzhin
a958f4178b Fix test_insert_into_distributed flaps
In [1] the order of the tests was different:

    Running pytest container as: 'docker run --net=host  --rm --name clickhouse_integration_tests --privileged         --volume=/place/sandbox-data/tasks/7/4/962738347/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/place/sandbox-data/tasks/7/4/962738347/clickhouse:/clickhouse         --volume=/place/sandbox-data/tasks/7/4/962738347/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/place/sandbox-data/tasks/7/4/962738347/clickhouse:/clickhouse         --volume=/place/sandbox-data/tasks/7/4/962738347/ClickHouse/programs/server:/clickhouse-config --volume=/place/sandbox-data/tasks/7/4/962738347/ClickHouse/tests/integration:/ClickHouse/tests/integration         --volume=/place/sandbox-data/tasks/7/4/962738347/ClickHouse/src/Server/grpc_protos:/ClickHouse/src/Server/grpc_protos         --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=latest -e DOCKER_MYSQL_JAVA_CLIENT_TAG=latest -e DOCKER_MYSQL_JS_CLIENT_TAG=latest -e DOCKER_MYSQL_PHP_CLIENT_TAG=latest -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=latest -e DOCKER_BASE_TAG=latest -e DOCKER_KERBEROS_KDC_TAG=latest -e PYTEST_OPTS='-ss test_insert_into_distributed/test.py::test_inserts_batching test_insert_into_distributed/test.py::test_inserts_local test_insert_into_distributed/test.py::test_inserts_low_cardinality test_insert_into_distributed/test.py::test_inserts_single_replica_internal_replication test_insert_into_distributed/test.py::test_inserts_single_replica_local_internal_replication test_insert_into_distributed/test.py::test_inserts_single_replica_no_internal_replication test_insert_into_distributed/test.py::test_prefer_localhost_replica test_insert_into_distributed/test.py::test_reconnect test_insert_into_distributed/test.py::test_table_function -rfEp --color=no --durations=0 ' yandex/clickhouse-integration-tests-runner:latest '.

  [1]: https://clickhouse-test-reports.s3.yandex.net/23874/80065b08f8182936ac57408bd84492d95f2322c1/integration_tests_(asan).html#fail1

So the table should be TRUNCATEd to avoid failures in this case.
2021-05-05 21:18:43 +03:00
alexey-milovidov
542c940941
Merge pull request #23874 from filimonov/librdkafka161
Update librdkafka 1.6.0-RC3 to 1.6.1
2021-05-05 13:48:14 +03:00
kssenii
0b6fb7660b Fix checks 2021-05-05 09:15:56 +00:00
kssenii
973ee4e9c4 Remove strange code, some fixes 2021-05-04 20:24:57 +00:00
kssenii
2112521304 Allow all RabbitMQ setup to be done only by user 2021-05-04 19:54:16 +00:00
kssenii
a3feaa48f4 Allow user to define specific queue settings 2021-05-04 18:57:49 +00:00
Alexey Milovidov
af41344cf5 @CurtizJ convinced me that this test has to be deleted 2021-05-04 20:59:42 +03:00
kssenii
13ba5287e3 Add cleanup in case of drop table 2021-05-04 16:26:47 +00:00
Mikhail Filimonov
80065b08f8
Revert "avoid race in librdkafka"
This reverts commit bd8c3eb117.
2021-05-04 10:06:33 +02:00
Vladimir
3b7c68196b
Merge pull request #23429 from Jokser/disk-s3-restart-possibility 2021-05-01 15:28:14 +03:00
Maksim Kita
a399ee88e1 Fixed test 2021-05-01 13:58:24 +03:00
Maksim Kita
3deb8cd410 HashedDictionary complex key update field initial load fix 2021-05-01 01:01:41 +03:00
Pavel Kovalenko
0050dbb75b Apply disk settings on config reload. 2021-04-29 23:32:19 +03:00
Azat Khuzhin
c4a1aa175c Improve test_insert_into_distributed 2021-04-29 10:35:09 +03:00
Maksim Kita
1f1a443798
Merge pull request #23152 from amosbird/distributedwriteha
Skip unavaiable replicas when writing to distributed tables
2021-04-28 22:46:50 +03:00
Maksim Kita
4090c66e1c
Merge pull request #23722 from vdimir/odbc_test_disable_msan
Disable test_odbc_interaction for MSan build
2021-04-28 22:45:40 +03:00
Alexander Tokmakov
bbf3bbc76d update metadata on replica recovery 2021-04-28 20:49:27 +03:00
Alexander Kuzmenkov
526f519c1f
Merge pull request #23446 from kssenii/globs-for-url
Support globs and failover for URL table function
2021-04-28 13:51:49 +03:00
Maksim Kita
b544037f03
Merge pull request #23436 from kitaisreal/storage-dictionary-updated
Refactored StorageDictionary
2021-04-28 13:11:48 +03:00
vdimir
b8acfa8312
Fix typo in tests/integration/README.md 2021-04-28 11:40:24 +03:00
vdimir
67efca21dd
Disable test_odbc_interaction for MSan build 2021-04-28 11:39:55 +03:00
alexey-milovidov
d3f4fb404a
Merge pull request #23650 from arenadata/ADQM-284
Kerberized HDFS test is fluky - retries and extra output if failure
2021-04-28 07:38:47 +03:00
Amos Bird
fd3aef0feb
Update tests/integration/test_insert_into_distributed/test.py
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2021-04-28 12:16:27 +08:00
Nicolae Vartolomei
1d47dcbe7f Cleanup env before running tests 2021-04-27 14:22:26 +01:00
Nicolae Vartolomei
1fa5871ff7 Fix bad rebase and introduce part_moves_between_shards_enable setting 2021-04-27 14:20:13 +01:00
Nicolae Vartolomei
53d57ffb52 Part movement between shards
Integrate query deduplication from #17348
2021-04-27 14:20:12 +01:00
Ilya Golshtein
6ae4cc6ca7 hdfs_api.py last minute format improvement went wrong .. fixed 2021-04-27 13:37:54 +03:00
Amos Bird
3d125e64a0
Try fix test 2021-04-27 18:33:37 +08:00
Alexey Milovidov
893d0052dd Skip integration test for library bridge under MSan 2021-04-27 07:02:59 +03:00
kssenii
4cf8f5370a Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into globs-for-url 2021-04-27 01:07:51 +00:00
Maksim Kita
71bccfdea1 Fixed integration test 2021-04-26 23:35:56 +03:00
Ilya Golshtein
95dad032a0 Kerberized HDFS test - retries and extra output if failure 2021-04-26 18:27:41 +03:00
Maksim Kita
c93666e0de Fixed code review issues 2021-04-26 13:52:41 +03:00
Maksim Kita
375b77dbcb Fixed integration tests 2021-04-26 13:52:41 +03:00
Alexey Milovidov
1629762fd4 Remove integration test for LIVE VIEW (experimental feature) - flaky, @vzakaznikov 2021-04-26 00:34:10 +03:00
alexey-milovidov
657a76d81c
Update cluster.py 2021-04-25 06:09:42 +03:00
Alexey Milovidov
5558a224b0 Skip CatBoost tests under MSan 2021-04-25 05:25:46 +03:00
alexey-milovidov
877d245d8f
Merge pull request #23462 from zhang2014/fix/ISSUE-23310
ISSUES-23310 Try fix MySQL 8.0 address already in use
2021-04-24 04:17:21 +03:00
kssenii
b37479ce29 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into globs-for-url 2021-04-22 11:42:47 +00:00
kssenii
afc77f277e Better test 2021-04-22 08:43:06 +00:00
kssenii
7d1e5e6a08 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-22 07:41:55 +00:00
mergify[bot]
29b605b4ea
Merge branch 'master' into rabbitmq-allow-multiple-hosts 2021-04-22 07:32:43 +00:00
zhang2014
81496b2e63 Try fix MySQL 8.0 address already in use 2021-04-22 11:04:30 +08:00
kssenii
bb6bc61f22 Fix checks 2021-04-21 19:53:38 +00:00
kssenii
2e6c753add Allow separate vhost for each table 2021-04-21 15:51:05 +00:00
kssenii
c1151cea23 Add failover 2021-04-21 14:39:51 +00:00
kssenii
4c4f765aba Globs for url table function 2021-04-21 12:32:57 +00:00
Chao Ma
713eb9486c Fix kafka storage does not work with arrow and arrowstream format messages 2021-04-21 19:44:09 +08:00
Pavel Kovalenko
64950d0b50 Speedup test_merge_tree_s3_restore using 'SYSTEM RESTART DISK s3' 2021-04-21 14:31:09 +03:00
Pavel Kovalenko
2ab8013455 DiskRestartProxy improvements and tests. 2021-04-21 12:53:46 +03:00
Amos Bird
a3b8681a5f
add test 2021-04-21 11:25:59 +08:00
kssenii
87b4843134 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-20 21:40:01 +00:00
kssenii
8689a24ca0 Slightly better, add integration test with hdfs disk as default 2021-04-20 20:51:00 +00:00
Kseniia Sumarokova
f9291d7624
Merge branch 'master' into fix-hdfs-virtual-columns 2021-04-20 22:01:32 +03:00
alexey-milovidov
4c1022ac03
Merge pull request #23318 from kssenii/fix-hdfs-with-spaces
Fix hdfs reading from files with spaces
2021-04-20 21:48:41 +03:00
kssenii
d5fb7ba094 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-20 13:38:29 +00:00
tavplubix
bef0ab182e
Merge branch 'master' into fix_prewhere_in_materialize_mysql 2021-04-20 15:38:48 +03:00
Nikita Mikhaylov
f55eacee7d
Merge pull request #22988 from excitoon-favorites/s3connectionresetretries
Retries on HTTP connection drops during reads from S3
2021-04-20 14:59:21 +03:00
kssenii
f4d663bc56 Add test 2021-04-20 08:38:14 +00:00
kssenii
7d357baa40 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-20 08:08:50 +00:00
Kseniia Sumarokova
b43656bf89
Merge pull request #22697 from TCeason/feature/add_MaterializeMySQL_sync_bytes_judgment
Add MySQL read history data bytes judgment
2021-04-20 10:26:42 +03:00
kssenii
bb767b66d5 Add integration test 2021-04-19 20:39:22 +00:00
alexey-milovidov
f1706223be
Merge pull request #23275 from ClickHouse/fix-tests-hedged-requests
Fix integration tests for Hedged requests
2021-04-19 21:10:23 +03:00
kssenii
ce16f4bb3f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-19 08:49:58 +00:00
Pavel Kruglov
8f1b507386 Fix test_secure_socket and remove redundant settings in hedged tests 2021-04-19 11:46:42 +03:00
Vladimir
e4e2b04c53
Merge pull request #23112 from Jokser/disk-s3-restore-to-detached 2021-04-19 10:29:00 +03:00
TCeason
63403c709c modify settings name to external_xxx and rewrite Storage MySQL max_block_size 2021-04-19 10:51:50 +08:00
TCeason
472c131420 Add MySQL read history data bytes judgment 2021-04-19 10:51:50 +08:00
Alexey Milovidov
3030db9043 Fix integration tests for Hedged requests 2021-04-19 01:28:03 +03:00
Maksim Kita
ca93987ae9
Merge pull request #23182 from kitaisreal/system-query-reload-model
Added system query reload model
2021-04-19 00:39:31 +03:00
Maksim Kita
aa42150ebd Added integration test 2021-04-18 13:38:36 +03:00
alexey-milovidov
212f68e279
Merge branch 'master' into fix-odbc 2021-04-17 21:29:03 +03:00
Kseniia Sumarokova
b0f6f214a2
Merge pull request #23216 from kssenii/test-odbc
Add test for fixed issue #9363
2021-04-17 21:27:50 +03:00
kssenii
82b1f1304f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-17 17:27:14 +00:00
kssenii
5258cccdf7 Add test 2021-04-17 09:55:36 +00:00
kssenii
5dc2dfa437 Fix 2021-04-17 09:00:58 +00:00
Alexander Tokmakov
3b4bd18809 fix prewhere in materialize mysql 2021-04-16 18:51:27 +03:00
Pavel Kovalenko
760a2ccedf DiskS3 restore file format change and minor improvements. 2021-04-16 17:43:16 +03:00
Anton Ivashkin
dc442b90d0 Fix flapping tests test_s3_zero_copy_replication, test_s3_zero_copy_on_hybrid_storage 2021-04-16 13:23:38 +03:00
Anton Ivashkin
09379b2b8a Fix Zero-Copy replication with several S3 volumes (issue 22679) 2021-04-16 12:34:48 +03:00
tavplubix
b5cbbce314
Merge pull request #22706 from songenjie/fetch_part
[clickhouse][server][ddl]support fetch part
2021-04-16 12:26:51 +03:00
Pavel Kovalenko
a73288972a Retrigger CI. 2021-04-15 23:00:44 +03:00
alexey-milovidov
0c097417a7
Merge pull request #22942 from ianton-ru/fix_flapping_test
Fix flapping test_merge_tree_s3 test
2021-04-15 14:38:36 +03:00
Pavel Kovalenko
06fc69a9bc Increase CH start/stop timeouts in integration tests. 2021-04-15 12:44:45 +03:00
Pavel Kovalenko
e53fc635f6 Disk S3 restore test improvements. 2021-04-15 11:26:44 +03:00
Vladimir Chebotarev
edd3931d4e Fixed tests. 2021-04-15 09:41:49 +03:00
Vladimir Chebotarev
5b8a3831e6 Better tests. 2021-04-15 09:41:49 +03:00
Vladimir Chebotarev
a63db53576 Improved tests. 2021-04-15 09:41:49 +03:00
Vladimir Chebotarev
ce6cf1630b Added tests. 2021-04-15 09:41:49 +03:00
Pavel Kovalenko
cad81e3742 Disk S3 possibility to restore parts to 'detached' directory. 2021-04-15 00:55:48 +03:00
Anton Ivashkin
68541ef315 Fix flapping test_merge_tree_s3 test 2021-04-14 19:07:22 +03:00
Maksim Kita
d885921100 CI runner intergation tests logs update to tar.gz 2021-04-14 18:15:35 +03:00
songenjie
ffd3b3d445 fix some docs 2021-04-14 21:15:53 +08:00
songenjie
382f702f59 test add param date 2021-04-14 20:04:59 +08:00
Christian
969b63d1ac
Excludes views from syncing in MaterializeMySQL (#22760)
* Excludes views from syncing in MaterializeMySQL

* Adds integration test for ignoring MySQL views on initial replication

* Fixes bug in initial integration test for excluding views from replicating to ClickHouse on initial replication

* Fixes bug in initial integration test for excluding views from replicating to ClickHouse on initial replication

* Replace assert with check_query

Co-authored-by: Christian Frøystad <christian@securepractice.no>
Co-authored-by: Ivan <5627721+abyss7@users.noreply.github.com>
2021-04-14 14:19:07 +03:00
songenjie
2534ed84d5 test_fetch_partition_from_auxiliary_zookeeper 2021-04-14 18:40:15 +08:00
Nikita Mikhaylov
a15757a9c9 better renaming 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
507cb8514a review fixes 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
4465a0627f better 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
36a8419f60 style 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
5f48e4769f fix test 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
3ab17233cf cleanup 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
b05b720935 update test 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
b3094412b1 better 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
17acfefbcd add integration test 2021-04-13 22:39:41 +03:00
alesapin
6d8efe5d5b
Merge pull request #22992 from ClickHouse/ssl_keeper
Add SSL to keeper (both client and internal)
2021-04-13 19:15:07 +03:00
alexey-milovidov
1945d01719
Merge pull request #21972 from kssenii/nanodbc
Switch to nanodbc
2021-04-13 12:23:57 +03:00
alesapin
cbd8a57fda Merge branch 'master' into ssl_keeper 2021-04-13 10:34:23 +03:00
songenjie
520f4f39ec [test][integration] fetch part 2021-04-13 15:17:03 +08:00
songenjie
564136ec46 [clickhouse][server][dll][alter]support fetch part 2021-04-13 12:40:33 +08:00
alexey-milovidov
7e867a26d7
Merge pull request #22647 from azat/integration-tests-pull-retries
Add retires for docker-compose pull in integration tests
2021-04-13 01:29:46 +03:00
alexey-milovidov
e2edecc8e2
Merge pull request #22434 from Avogar/catboost-reload
Update paths to the catboost model configs in config reloading
2021-04-13 01:21:04 +03:00
alesapin
56f0e290de
Merge pull request #22945 from ClickHouse/increase-fetches-pool-size
More conservative value of `background_fetches_pool_size` setting
2021-04-12 22:41:04 +03:00
alesapin
338ff1615c Simplier config 2021-04-12 15:40:01 +03:00
alesapin
ef34c95c7e Add SSL to keeper (both client and internal) 2021-04-12 15:25:52 +03:00
alesapin
abab3ba09f Fix lost comment 2021-04-12 11:07:28 +03:00
alesapin
5310c0c41d Proper config spec 2021-04-12 11:06:36 +03:00
kssenii
ab06ca3144 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-12 07:07:48 +00:00
kssenii
7a287e6fe9 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-11 21:36:08 +00:00
Azat Khuzhin
fad42f8ac5 tests/integration: stop containers at start only if destroy_dirs is not set
Fixes tests with multiple clusters - test_zookeeper_config
2021-04-11 14:49:59 +03:00
Azat Khuzhin
3fa047bb0f tests/integration: run docker-compose commands after copying of compose files 2021-04-11 14:27:15 +03:00
Azat Khuzhin
d4bb4c5dd7 tests/integration: add docker-compose pull retries 2021-04-11 14:27:15 +03:00
Azat Khuzhin
c7bef49b37 tests/integration: drop --force-recreate since we have down/pull separately 2021-04-11 14:27:14 +03:00
Azat Khuzhin
dfcc9bdcb1 tests/integration: pull images in a separate step with --ignore-pull-failures 2021-04-11 14:27:14 +03:00
Azat Khuzhin
df2637e523 tests/integration: stops orphan contains too 2021-04-11 14:27:14 +03:00
alexey-milovidov
d21ffd83a7
Merge branch 'master' into catboost-reload 2021-04-11 13:29:36 +03:00
alexey-milovidov
9d08695ce1
Merge pull request #22441 from nikitamikhaylov/copier-copy-to-source
Add test for copier
2021-04-10 23:34:59 +03:00
alexey-milovidov
1c780b6673
Update test.py 2021-04-10 23:16:27 +03:00
alexey-milovidov
3016376818
Update test.py 2021-04-10 17:32:52 +03:00
alexey-milovidov
777fcc871f
Update test.py 2021-04-10 15:05:36 +03:00
Alexey Milovidov
68b6b3352c Adjust test 2021-04-10 15:03:45 +03:00
Alexander Kuzmenkov
e44b3822e3
Merge pull request #21850 from fastio/handle_errors_for_kafka_engine
Handle errors for Kafka engine
2021-04-09 22:59:40 +03:00
kssenii
2cff4f9409 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-09 11:14:44 +00:00
kssenii
72d89bc933 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-09 11:13:01 +00:00
Anton Popov
30f2d839c3
Merge pull request #22868 from CurtizJ/prettify-logs
Prettify logs of integration tests
2021-04-09 13:10:00 +03:00
Anton Popov
00172f97da
Update ci-runner.py 2021-04-09 03:58:22 +03:00
Anton Popov
add4497502 prettify logs of integration tests 2021-04-09 00:08:49 +03:00
kssenii
7108ece268 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-08 19:14:07 +00:00
alesapin
1533f9b9aa
Merge pull request #14113 from johnskopis/dynamic-interserver-creds-v20
Support interserver credential rotation
2021-04-08 11:01:40 +03:00
alexey-milovidov
0d519d78ab
Merge pull request #22746 from Avogar/fix-flacky
Fix flacky hedged tests
2021-04-08 10:23:54 +03:00
Peng Jian
f73faf1578 fix test case 2021-04-08 14:26:32 +08:00
Peng Jian
16e971ee52 fix test case 2021-04-08 07:19:57 +08:00
alesapin
2987bbc948 Small improvements 2021-04-07 16:52:11 +03:00
Peng Jian
604ba9db60 add test case 2021-04-07 20:15:15 +08:00
Pavel Kruglov
19b147c7ac Allow more replica change events in hedged tests due to high server load during testing 2021-04-07 13:30:47 +03:00
kssenii
7a89948801 Fix 2021-04-07 07:16:50 +00:00
kssenii
0b39480d51 Better 2021-04-06 20:01:23 +00:00
kssenii
5a143a4d12 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-06 16:50:13 +00:00
alesapin
1c8e33414f Merge branch 'master' into johnskopis/dynamic-interserver-creds-v20 2021-04-06 16:28:46 +03:00