Commit Graph

2176 Commits

Author SHA1 Message Date
Amos Bird
dfa5629071
Remove projection type ast 2021-05-11 18:12:29 +08:00
Alexey Milovidov
b2ca5cd98b Merge branch 'master' into normalize-bigint 2021-05-11 02:05:40 +03:00
Alexey Milovidov
2fcdc85dc7 Fix integration test 2021-05-11 01:54:52 +03:00
alexey-milovidov
0400070924
Merge pull request #23822 from excitoon-favorites/equalsignins3path
Better handling of URI's in `PocoHTTPClient`
2021-05-10 20:25:18 +03:00
Alexey Milovidov
db4447d819 Fix integration test 2021-05-10 17:45:37 +03:00
Maksim Kita
742434a0cd
Merge pull request #23903 from azat/fix-flaky-tests-21.6
Fix test_insert_into_distributed flaps
2021-05-10 00:44:46 +03:00
Alexey Milovidov
49e4a43300 Fix double whitespace in integration tests 2021-05-09 23:16:57 +03:00
kssenii
d6582f5fe5 Table schema for dict 2021-05-09 15:42:54 +00:00
tavplubix
f8c7725ef5
Merge pull request #23742 from ClickHouse/update_metadata_on_replica_recovery
Update metadata on replica recovery
2021-05-08 16:34:03 +03:00
Kseniia Sumarokova
e6ac136c32
Merge pull request #23909 from kssenii/postgres-fixes
Fix postgres connections issue
2021-05-08 00:07:21 +03:00
Vladimir Chebotarev
a39314949e
Added solution for host network mode in Ubuntu 20.10+. 2021-05-07 23:36:15 +03:00
kssenii
8662078b35 Review fixes 2021-05-07 09:55:18 +00:00
Maksim Kita
a979a86930
Merge pull request #23824 from kitaisreal/hashed-dictionary-complex-key-update-field-initial-load-fix
HashedDictionary complex key update field initial load fix
2021-05-06 17:12:04 +03:00
Vladimir Chebotarev
524113f497 Fixed bug with S3 URLs containing + symbol, data with such keys could not be read previously. 2021-05-06 11:28:55 +03:00
Chao Ma
ec8ca5bf5e Fix kafka storage does not work with parquet format messages 2021-05-06 11:32:58 +08:00
kssenii
8900e93bd8 New impl 2021-05-06 00:52:59 +00:00
Maksim Kita
ae47a7ccce Integration test increase wait before dictionary update 2021-05-05 23:39:40 +03:00
Azat Khuzhin
a958f4178b Fix test_insert_into_distributed flaps
In [1] the order of the tests was different:

    Running pytest container as: 'docker run --net=host  --rm --name clickhouse_integration_tests --privileged         --volume=/place/sandbox-data/tasks/7/4/962738347/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/place/sandbox-data/tasks/7/4/962738347/clickhouse:/clickhouse         --volume=/place/sandbox-data/tasks/7/4/962738347/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/place/sandbox-data/tasks/7/4/962738347/clickhouse:/clickhouse         --volume=/place/sandbox-data/tasks/7/4/962738347/ClickHouse/programs/server:/clickhouse-config --volume=/place/sandbox-data/tasks/7/4/962738347/ClickHouse/tests/integration:/ClickHouse/tests/integration         --volume=/place/sandbox-data/tasks/7/4/962738347/ClickHouse/src/Server/grpc_protos:/ClickHouse/src/Server/grpc_protos         --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=latest -e DOCKER_MYSQL_JAVA_CLIENT_TAG=latest -e DOCKER_MYSQL_JS_CLIENT_TAG=latest -e DOCKER_MYSQL_PHP_CLIENT_TAG=latest -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=latest -e DOCKER_BASE_TAG=latest -e DOCKER_KERBEROS_KDC_TAG=latest -e PYTEST_OPTS='-ss test_insert_into_distributed/test.py::test_inserts_batching test_insert_into_distributed/test.py::test_inserts_local test_insert_into_distributed/test.py::test_inserts_low_cardinality test_insert_into_distributed/test.py::test_inserts_single_replica_internal_replication test_insert_into_distributed/test.py::test_inserts_single_replica_local_internal_replication test_insert_into_distributed/test.py::test_inserts_single_replica_no_internal_replication test_insert_into_distributed/test.py::test_prefer_localhost_replica test_insert_into_distributed/test.py::test_reconnect test_insert_into_distributed/test.py::test_table_function -rfEp --color=no --durations=0 ' yandex/clickhouse-integration-tests-runner:latest '.

  [1]: https://clickhouse-test-reports.s3.yandex.net/23874/80065b08f8182936ac57408bd84492d95f2322c1/integration_tests_(asan).html#fail1

So the table should be TRUNCATEd to avoid failures in this case.
2021-05-05 21:18:43 +03:00
alexey-milovidov
542c940941
Merge pull request #23874 from filimonov/librdkafka161
Update librdkafka 1.6.0-RC3 to 1.6.1
2021-05-05 13:48:14 +03:00
kssenii
0b6fb7660b Fix checks 2021-05-05 09:15:56 +00:00
kssenii
973ee4e9c4 Remove strange code, some fixes 2021-05-04 20:24:57 +00:00
kssenii
2112521304 Allow all RabbitMQ setup to be done only by user 2021-05-04 19:54:16 +00:00
kssenii
a3feaa48f4 Allow user to define specific queue settings 2021-05-04 18:57:49 +00:00
Alexey Milovidov
af41344cf5 @CurtizJ convinced me that this test has to be deleted 2021-05-04 20:59:42 +03:00
kssenii
13ba5287e3 Add cleanup in case of drop table 2021-05-04 16:26:47 +00:00
Mikhail Filimonov
80065b08f8
Revert "avoid race in librdkafka"
This reverts commit bd8c3eb117.
2021-05-04 10:06:33 +02:00
Vladimir
3b7c68196b
Merge pull request #23429 from Jokser/disk-s3-restart-possibility 2021-05-01 15:28:14 +03:00
Maksim Kita
a399ee88e1 Fixed test 2021-05-01 13:58:24 +03:00
Maksim Kita
3deb8cd410 HashedDictionary complex key update field initial load fix 2021-05-01 01:01:41 +03:00
Yatsishin Ilya
d12e78609f py2 runner 2021-04-30 17:34:21 +03:00
Yatsishin Ilya
fddc72fb49 fixes 2021-04-30 15:22:37 +03:00
Yatsishin Ilya
744fb93945 Merge remote-tracking branch 'origin' into integration-2 2021-04-30 12:18:24 +03:00
Yatsishin Ilya
28fe11158a rabbitmq 2021-04-30 12:18:12 +03:00
Pavel Kovalenko
0050dbb75b Apply disk settings on config reload. 2021-04-29 23:32:19 +03:00
Yatsishin Ilya
764ac307d1 fix 2021-04-29 19:01:28 +03:00
Yatsishin Ilya
a6c7e03aba merge remote-tracking branch 'origin' into integration-2 2021-04-29 17:30:54 +03:00
Yatsishin Ilya
dd192bb0ab better 2021-04-29 17:26:41 +03:00
Yatsishin Ilya
cb101e46bb finally 2021-04-29 14:57:48 +03:00
Azat Khuzhin
c4a1aa175c Improve test_insert_into_distributed 2021-04-29 10:35:09 +03:00
Maksim Kita
1f1a443798
Merge pull request #23152 from amosbird/distributedwriteha
Skip unavaiable replicas when writing to distributed tables
2021-04-28 22:46:50 +03:00
Maksim Kita
4090c66e1c
Merge pull request #23722 from vdimir/odbc_test_disable_msan
Disable test_odbc_interaction for MSan build
2021-04-28 22:45:40 +03:00
Alexander Tokmakov
bbf3bbc76d update metadata on replica recovery 2021-04-28 20:49:27 +03:00
Yatsishin Ilya
a87fe5e1bc Merge remote-tracking branch 'origin' into integration-2 2021-04-28 17:23:33 +03:00
Alexander Kuzmenkov
526f519c1f
Merge pull request #23446 from kssenii/globs-for-url
Support globs and failover for URL table function
2021-04-28 13:51:49 +03:00
Maksim Kita
b544037f03
Merge pull request #23436 from kitaisreal/storage-dictionary-updated
Refactored StorageDictionary
2021-04-28 13:11:48 +03:00
vdimir
b8acfa8312
Fix typo in tests/integration/README.md 2021-04-28 11:40:24 +03:00
vdimir
67efca21dd
Disable test_odbc_interaction for MSan build 2021-04-28 11:39:55 +03:00
alexey-milovidov
d3f4fb404a
Merge pull request #23650 from arenadata/ADQM-284
Kerberized HDFS test is fluky - retries and extra output if failure
2021-04-28 07:38:47 +03:00
Amos Bird
fd3aef0feb
Update tests/integration/test_insert_into_distributed/test.py
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2021-04-28 12:16:27 +08:00
Yatsishin Ilya
30b05fec42 fix 2021-04-27 20:20:13 +03:00
Yatsishin Ilya
b80d4f8e96 fix 2021-04-27 20:18:09 +03:00
Yatsishin Ilya
c59a11f798 Merge remote-tracking branch 'origin' into integration-2 2021-04-27 18:34:33 +03:00
Nicolae Vartolomei
1d47dcbe7f Cleanup env before running tests 2021-04-27 14:22:26 +01:00
Nicolae Vartolomei
1fa5871ff7 Fix bad rebase and introduce part_moves_between_shards_enable setting 2021-04-27 14:20:13 +01:00
Nicolae Vartolomei
53d57ffb52 Part movement between shards
Integrate query deduplication from #17348
2021-04-27 14:20:12 +01:00
Ilya Golshtein
6ae4cc6ca7 hdfs_api.py last minute format improvement went wrong .. fixed 2021-04-27 13:37:54 +03:00
Amos Bird
3d125e64a0
Try fix test 2021-04-27 18:33:37 +08:00
Yatsishin Ilya
73c593f030 better 2021-04-27 12:07:21 +03:00
Yatsishin Ilya
edabf8f5c3 wip 2021-04-27 12:07:04 +03:00
Alexey Milovidov
893d0052dd Skip integration test for library bridge under MSan 2021-04-27 07:02:59 +03:00
kssenii
4cf8f5370a Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into globs-for-url 2021-04-27 01:07:51 +00:00
Maksim Kita
71bccfdea1 Fixed integration test 2021-04-26 23:35:56 +03:00
Ilya Golshtein
95dad032a0 Kerberized HDFS test - retries and extra output if failure 2021-04-26 18:27:41 +03:00
Maksim Kita
c93666e0de Fixed code review issues 2021-04-26 13:52:41 +03:00
Maksim Kita
375b77dbcb Fixed integration tests 2021-04-26 13:52:41 +03:00
Alexey Milovidov
1629762fd4 Remove integration test for LIVE VIEW (experimental feature) - flaky, @vzakaznikov 2021-04-26 00:34:10 +03:00
alexey-milovidov
657a76d81c
Update cluster.py 2021-04-25 06:09:42 +03:00
Alexey Milovidov
5558a224b0 Skip CatBoost tests under MSan 2021-04-25 05:25:46 +03:00
alexey-milovidov
877d245d8f
Merge pull request #23462 from zhang2014/fix/ISSUE-23310
ISSUES-23310 Try fix MySQL 8.0 address already in use
2021-04-24 04:17:21 +03:00
kssenii
b37479ce29 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into globs-for-url 2021-04-22 11:42:47 +00:00
kssenii
afc77f277e Better test 2021-04-22 08:43:06 +00:00
kssenii
7d1e5e6a08 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-22 07:41:55 +00:00
mergify[bot]
29b605b4ea
Merge branch 'master' into rabbitmq-allow-multiple-hosts 2021-04-22 07:32:43 +00:00
zhang2014
81496b2e63 Try fix MySQL 8.0 address already in use 2021-04-22 11:04:30 +08:00
kssenii
bb6bc61f22 Fix checks 2021-04-21 19:53:38 +00:00
kssenii
2e6c753add Allow separate vhost for each table 2021-04-21 15:51:05 +00:00
kssenii
c1151cea23 Add failover 2021-04-21 14:39:51 +00:00
kssenii
4c4f765aba Globs for url table function 2021-04-21 12:32:57 +00:00
Chao Ma
713eb9486c Fix kafka storage does not work with arrow and arrowstream format messages 2021-04-21 19:44:09 +08:00
Pavel Kovalenko
64950d0b50 Speedup test_merge_tree_s3_restore using 'SYSTEM RESTART DISK s3' 2021-04-21 14:31:09 +03:00
Pavel Kovalenko
2ab8013455 DiskRestartProxy improvements and tests. 2021-04-21 12:53:46 +03:00
Amos Bird
a3b8681a5f
add test 2021-04-21 11:25:59 +08:00
kssenii
87b4843134 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-20 21:40:01 +00:00
kssenii
8689a24ca0 Slightly better, add integration test with hdfs disk as default 2021-04-20 20:51:00 +00:00
Kseniia Sumarokova
f9291d7624
Merge branch 'master' into fix-hdfs-virtual-columns 2021-04-20 22:01:32 +03:00
alexey-milovidov
4c1022ac03
Merge pull request #23318 from kssenii/fix-hdfs-with-spaces
Fix hdfs reading from files with spaces
2021-04-20 21:48:41 +03:00
kssenii
d5fb7ba094 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-20 13:38:29 +00:00
tavplubix
bef0ab182e
Merge branch 'master' into fix_prewhere_in_materialize_mysql 2021-04-20 15:38:48 +03:00
Nikita Mikhaylov
f55eacee7d
Merge pull request #22988 from excitoon-favorites/s3connectionresetretries
Retries on HTTP connection drops during reads from S3
2021-04-20 14:59:21 +03:00
kssenii
f4d663bc56 Add test 2021-04-20 08:38:14 +00:00
kssenii
7d357baa40 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-20 08:08:50 +00:00
Kseniia Sumarokova
b43656bf89
Merge pull request #22697 from TCeason/feature/add_MaterializeMySQL_sync_bytes_judgment
Add MySQL read history data bytes judgment
2021-04-20 10:26:42 +03:00
kssenii
bb767b66d5 Add integration test 2021-04-19 20:39:22 +00:00
alexey-milovidov
f1706223be
Merge pull request #23275 from ClickHouse/fix-tests-hedged-requests
Fix integration tests for Hedged requests
2021-04-19 21:10:23 +03:00
kssenii
ce16f4bb3f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-19 08:49:58 +00:00
Pavel Kruglov
8f1b507386 Fix test_secure_socket and remove redundant settings in hedged tests 2021-04-19 11:46:42 +03:00
Vladimir
e4e2b04c53
Merge pull request #23112 from Jokser/disk-s3-restore-to-detached 2021-04-19 10:29:00 +03:00
TCeason
63403c709c modify settings name to external_xxx and rewrite Storage MySQL max_block_size 2021-04-19 10:51:50 +08:00
TCeason
472c131420 Add MySQL read history data bytes judgment 2021-04-19 10:51:50 +08:00
Alexey Milovidov
3030db9043 Fix integration tests for Hedged requests 2021-04-19 01:28:03 +03:00
Maksim Kita
ca93987ae9
Merge pull request #23182 from kitaisreal/system-query-reload-model
Added system query reload model
2021-04-19 00:39:31 +03:00
Maksim Kita
aa42150ebd Added integration test 2021-04-18 13:38:36 +03:00
alexey-milovidov
212f68e279
Merge branch 'master' into fix-odbc 2021-04-17 21:29:03 +03:00
Kseniia Sumarokova
b0f6f214a2
Merge pull request #23216 from kssenii/test-odbc
Add test for fixed issue #9363
2021-04-17 21:27:50 +03:00
kssenii
82b1f1304f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-17 17:27:14 +00:00
kssenii
5258cccdf7 Add test 2021-04-17 09:55:36 +00:00
kssenii
5dc2dfa437 Fix 2021-04-17 09:00:58 +00:00
Alexander Tokmakov
3b4bd18809 fix prewhere in materialize mysql 2021-04-16 18:51:27 +03:00
Pavel Kovalenko
760a2ccedf DiskS3 restore file format change and minor improvements. 2021-04-16 17:43:16 +03:00
Anton Ivashkin
dc442b90d0 Fix flapping tests test_s3_zero_copy_replication, test_s3_zero_copy_on_hybrid_storage 2021-04-16 13:23:38 +03:00
Anton Ivashkin
09379b2b8a Fix Zero-Copy replication with several S3 volumes (issue 22679) 2021-04-16 12:34:48 +03:00
tavplubix
b5cbbce314
Merge pull request #22706 from songenjie/fetch_part
[clickhouse][server][ddl]support fetch part
2021-04-16 12:26:51 +03:00
Pavel Kovalenko
a73288972a Retrigger CI. 2021-04-15 23:00:44 +03:00
Yatsishin Ilya
4347f6ae43 Merge remote-tracking branch 'origin' into integration-2 2021-04-15 16:49:31 +03:00
alexey-milovidov
0c097417a7
Merge pull request #22942 from ianton-ru/fix_flapping_test
Fix flapping test_merge_tree_s3 test
2021-04-15 14:38:36 +03:00
Pavel Kovalenko
06fc69a9bc Increase CH start/stop timeouts in integration tests. 2021-04-15 12:44:45 +03:00
Pavel Kovalenko
e53fc635f6 Disk S3 restore test improvements. 2021-04-15 11:26:44 +03:00
Vladimir Chebotarev
edd3931d4e Fixed tests. 2021-04-15 09:41:49 +03:00
Vladimir Chebotarev
5b8a3831e6 Better tests. 2021-04-15 09:41:49 +03:00
Vladimir Chebotarev
a63db53576 Improved tests. 2021-04-15 09:41:49 +03:00
Vladimir Chebotarev
ce6cf1630b Added tests. 2021-04-15 09:41:49 +03:00
Yatsishin Ilya
a27f269e6b catch 2021-04-15 07:15:11 +03:00
Yatsishin Ilya
bb1f223e21 Merge remote-tracking branch 'origin' into integration-2 2021-04-15 06:56:27 +03:00
Pavel Kovalenko
cad81e3742 Disk S3 possibility to restore parts to 'detached' directory. 2021-04-15 00:55:48 +03:00
Yatsishin Ilya
fe406c27db Merge remote-tracking branch 'origin' into integration-2 2021-04-14 20:33:20 +03:00
Anton Ivashkin
68541ef315 Fix flapping test_merge_tree_s3 test 2021-04-14 19:07:22 +03:00
Yatsishin Ilya
f6d455732e better 2021-04-14 19:04:17 +03:00
Maksim Kita
d885921100 CI runner intergation tests logs update to tar.gz 2021-04-14 18:15:35 +03:00
songenjie
ffd3b3d445 fix some docs 2021-04-14 21:15:53 +08:00
songenjie
382f702f59 test add param date 2021-04-14 20:04:59 +08:00
Yatsishin Ilya
10b7037d9c Merge remote-tracking branch 'origin' into integration-2 2021-04-14 14:21:40 +03:00
Christian
969b63d1ac
Excludes views from syncing in MaterializeMySQL (#22760)
* Excludes views from syncing in MaterializeMySQL

* Adds integration test for ignoring MySQL views on initial replication

* Fixes bug in initial integration test for excluding views from replicating to ClickHouse on initial replication

* Fixes bug in initial integration test for excluding views from replicating to ClickHouse on initial replication

* Replace assert with check_query

Co-authored-by: Christian Frøystad <christian@securepractice.no>
Co-authored-by: Ivan <5627721+abyss7@users.noreply.github.com>
2021-04-14 14:19:07 +03:00
songenjie
2534ed84d5 test_fetch_partition_from_auxiliary_zookeeper 2021-04-14 18:40:15 +08:00
Nikita Mikhaylov
a15757a9c9 better renaming 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
507cb8514a review fixes 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
4465a0627f better 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
36a8419f60 style 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
5f48e4769f fix test 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
3ab17233cf cleanup 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
b05b720935 update test 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
b3094412b1 better 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
17acfefbcd add integration test 2021-04-13 22:39:41 +03:00
Yatsishin Ilya
70d65c0092 longer timeout 2021-04-13 19:22:10 +03:00
alesapin
6d8efe5d5b
Merge pull request #22992 from ClickHouse/ssl_keeper
Add SSL to keeper (both client and internal)
2021-04-13 19:15:07 +03:00
Yatsishin Ilya
b635f17b1b fix 2021-04-13 19:08:29 +03:00
Yatsishin Ilya
c2707a8154 better 2021-04-13 17:55:31 +03:00
Yatsishin Ilya
fb1e2c9006 fix 2021-04-13 14:27:52 +03:00
Yatsishin Ilya
e4d1ea846c more 2021-04-13 13:52:22 +03:00
alexey-milovidov
1945d01719
Merge pull request #21972 from kssenii/nanodbc
Switch to nanodbc
2021-04-13 12:23:57 +03:00
alesapin
cbd8a57fda Merge branch 'master' into ssl_keeper 2021-04-13 10:34:23 +03:00