Commit Graph

641 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
f76e6ea24b
Adjust integration tests to docker compose v2 2024-10-01 11:48:04 +02:00
Mikhail f. Shiryaev
985bd796d3
Simplify retry decorator, use it in tests 2024-10-01 11:48:00 +02:00
robot-clickhouse
7c6ce8611c Automatic style fix 2024-09-27 10:19:49 +00:00
vdimir
4cae201026
fix test_dictionaries_all_layouts_separate_sources/test_mongo.py 2024-09-23 14:59:39 +00:00
vdimir
4c9c9015f8
Revert "Revert "Merge pull request #63279 from allmazz/mongodb_refactoring""
This reverts commit 2ae9c9ac16.
2024-09-23 07:06:58 +00:00
Alexey Milovidov
2ae9c9ac16 Revert "Merge pull request #63279 from allmazz/mongodb_refactoring"
This reverts commit 14cb02a18c, reversing
changes made to a940a9ebbc.
2024-09-22 22:28:24 +02:00
Alexey Milovidov
14cb02a18c
Merge pull request #63279 from allmazz/mongodb_refactoring
MongoDB integration refactoring
2024-09-21 18:18:44 +00:00
Raúl Marín
993888e7d0
Merge pull request #68355 from zvonand/tryfix-65762-again
Some fixes for LDAP
2024-09-20 08:44:04 +00:00
Kirill Nikiforov
2c360e86be
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-09-18 16:14:02 +04:00
Antonio Andelic
452fde78c7
Merge pull request #69582 from ClickHouse/keeper-better-ssl-support
Support more advanced SSL options for Keeper internal communication
2024-09-17 13:32:18 +00:00
Andrey Zvonov
80b28e33bb wait for ldap on cluster sturtup
re-run CI

proper cleanup in test
2024-09-16 15:49:10 +00:00
Antonio Andelic
8cdcc431fe Fix 2024-09-16 13:30:17 +02:00
vdimir
1963e971f3
fix 2024-09-16 09:57:20 +00:00
vdimir
cf9200f1d0
Randomize integration tests settings 2024-09-16 09:14:44 +00:00
Konstantin Bogdanov
1f5eb2cd2c
Set IPv6 instance to the node object 2024-09-06 00:22:54 +02:00
Kirill Nikiforov
40462bc716
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-08-23 22:10:06 +04:00
János Benjamin Antal
d18b6c63d4 Change name of default azurite container to avoid clashing with azure blob storage tests 2024-08-15 09:41:03 +00:00
robot-clickhouse
537f3bcd76 Automatic style fix 2024-08-14 16:13:25 +00:00
János Benjamin Antal
fc9929dc3d Make tests with azurite repeatable 2024-08-14 14:15:05 +00:00
Kirill Nikiforov
ea58b8062e
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-08-08 22:44:32 +03:00
Nikita Mikhaylov
80d2686013 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-06 13:12:03 +02:00
Kirill Nikiforov
a28a82d344
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-08-05 20:57:15 +03:00
Nikita Mikhaylov
6f025090eb Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-05 17:46:14 +02:00
Nikita Mikhaylov
4e9c3baa25 Move analyzer to Beta stage 2024-08-05 15:29:14 +00:00
Alexey Milovidov
6f9d78d873
Merge pull request #67743 from azat/tests/test_storage_rabbitmq
Try to fix RabbitMQ test failures
2024-08-04 19:26:23 +02:00
Azat Khuzhin
dc527b6fd1 tests: detailed errors for RabbitMQ startup
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 09:07:05 +02:00
Azat Khuzhin
264be9c598 tests: increase timeout for RabbitMQ startup
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 09:06:50 +02:00
Vitaly Baranov
bd22140fa4 Add test. 2024-08-03 16:20:23 +02:00
divanik
fb2f15c3b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/fix_retry_integration_tests_decorator 2024-08-03 13:59:48 +00:00
Alexey Milovidov
94f8855f6e
Merge pull request #67597 from ClickHouse/kssenii-patch-12
Update check_rabbitmq_is_available
2024-08-03 00:30:31 +00:00
Nikita Fomichev
7d1e958097 Integration tests: fix ports clashing problem 2024-08-02 13:32:59 +02:00
Kirill Nikiforov
49befa714f
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-08-01 22:38:28 +03:00
Alex Katsman
0913f0189b Don't count a search query as a search pattern match 2024-08-01 14:08:50 +00:00
Kseniia Sumarokova
2c018d6f4d
Update cluster.py 2024-08-01 13:38:41 +02:00
divanik
67f4792b77 Style check 2024-07-31 14:16:40 +00:00
divanik
d5f8540fbb Fix 2024-07-31 12:00:09 +00:00
vdimir
175f0696d5
fix 2024-07-31 09:36:56 +00:00
vdimir
9f9c5b8d6f
fix stylecheck 2024-07-31 08:56:25 +00:00
vdimir
e644598b8d
restore old mongo integration tests 2024-07-31 08:41:03 +00:00
Pablo Marcos
ba63bd1de7 Merge branch 'master' into fix-flaky-test_storage_s3_queue-test_max_set_age 2024-07-29 11:15:31 +00:00
Kirill Nikiforov
c23e3d8663
Merge branch 'master' into mongodb_refactoring 2024-07-27 15:33:46 +03:00
Pablo Marcos
5bf89a4331 Set a different instance dir when using pytest-xdist
This allows executing in integration tests in parallel
without directory clashes.
2024-07-26 08:42:54 +00:00
divanik
f21a9e5d08 Fix bug 2024-07-24 11:00:49 +00:00
divanik
1b95a68dc0 Fix typo 2024-07-24 10:48:18 +00:00
divanik
8c19d502f8 Add decorator and retries for azurite 2024-07-24 10:44:06 +00:00
Max K
1050217445 add support for new release branch
Automatic style fix
2024-07-13 16:21:22 +02:00
Nikita Mikhaylov
fe6a875c74 Make the setting back IMPORTANT + fix build 2024-07-04 11:12:27 +00:00
Nikita Mikhaylov
d57375181d Better 2024-07-04 11:12:27 +00:00
Nikita Mikhaylov
6f89c4b932 Bump the minimal version to keep compatibility 2024-07-04 11:12:26 +00:00
Andrey Zvonov
089bb6e0c9 make black even more happy 2024-06-29 17:00:33 +00:00
Andrey Zvonov
bf1cc136db make a better healthcheck 2024-06-27 19:30:45 +00:00
Kirill Nikiforov
4f5fdb4db2
Merge branch 'master' into HEAD 2024-06-02 03:28:26 +03:00
Kirill Nikiforov
baa329b8db
new test cases, some fixes 2024-05-26 20:47:53 +03:00
Antonio Andelic
b80d878b4c Add test 2024-05-21 13:28:12 +02:00
Alexander Sapin
01e50f3ca1 Fix integration tests for arm64 on linux 2024-05-14 18:53:59 +02:00
Azat Khuzhin
98df6b88a0 tests: forbid allow_experimental_analyzer if tag was specified
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-27 15:49:09 +02:00
Azat Khuzhin
52091916dc Fix leftovers of enabling new analyzer
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-27 11:19:03 +02:00
Azat Khuzhin
03d52e7e49 Better handling of old analyzer check in intergraion tests runner
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-27 10:32:27 +02:00
Azat Khuzhin
85ea46de77 Fix integration tests with old analyzer
This reverts commit 67d39a22ac.
2024-04-27 10:29:13 +02:00
Nikita Fomichev
a63f4783bf
Merge pull request #61869 from fm4v/fix-flaky-tests2
Fix flaky tests 2 (stateless, integration)
2024-03-28 10:57:19 +01:00
Nikita Fomichev
012431c043 integration tests: ClickHouseCluster.get_docker_handle() wait docker frequently and less time 2024-03-26 17:55:37 +01:00
Dmitry Novik
64301191b1 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-24 21:07:26 +00:00
Dmitry Novik
67d39a22ac Fix cluster.py 2024-03-24 21:06:13 +00:00
Nikita Fomichev
789772caa1 Integration tests: rich exception message raised from ClickHouseInstance.query_with_retry() 2024-03-23 19:44:38 +01:00
Nikita Fomichev
39732174e9 Integration tests: set host user for mysql docker containers
When run pytest locally, tests fail because of `Permission denied: 'logs'`
2024-03-23 16:58:58 +01:00
Dmitry Novik
df88eb26a5
Merge branch 'master' into enable-analyzer 2024-03-22 15:56:32 +01:00
Dmitry Novik
d43a1a1984 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-22 14:15:57 +01:00
Max Kainov
4f273c60c3 CI: disable some kerberos and hdfs integration tests for arm
#ci_set_arm
 #batch_2
 #no_merge_commit
2024-03-20 17:24:55 +00:00
Max Kainov
da28eaf454 CI: remove compose files from integration test docker
#ci_set_integration
2024-03-20 14:11:47 +00:00
Dmitry Novik
b74a0359e5 Update integration tests 2024-03-20 13:43:18 +01:00
Dmitry Novik
f0e7b78f8b Inverse analyzer in tests 2024-03-20 13:35:30 +01:00
Han Fei
c7c64636d0 add a test 2024-03-12 23:31:33 +01:00
Azat Khuzhin
7dfe45e8d5 Do not retry queries if container is down in integration tests (resubmit)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 20:38:34 +01:00
Raúl Marín
98e68ccfb8 Remove old tags from integration tests 2024-02-26 13:45:20 +01:00
Nikolai Kochetov
83841c23d3
Merge pull request #60230 from ClickHouse/fix-analyzer-secrets
Fix analyzer - hide arguments for secret functions
2024-02-23 15:26:49 +01:00
robot-clickhouse
7e94a163bc Automatic style fix 2024-02-21 16:16:34 +00:00
Yakov Olkhovskiy
9c4967e788 prevent test from unrelated fails 2024-02-21 16:03:57 +00:00
Max Kainov
9f51e840db CI: integration tests to mysql80
#ci_set_integration
 #no_merge_commit
2024-02-21 11:05:47 +00:00
Antonio Andelic
199da94176
Revert "Do not retry queries if container is down in integration tests" 2024-02-21 11:13:41 +01:00
Azat Khuzhin
0496d0f45f Do not retry queries if container is down in integration tests
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-19 11:27:41 +01:00
robot-clickhouse
41e6dd7a9d Automatic style fix 2024-01-24 12:15:19 +00:00
serxa
0badcffdc1 test: table metadata load failure should shutdowns the server properly 2024-01-24 12:01:32 +00:00
Han Fei
fc0f080cb4 fix black 2023-12-01 20:39:38 +01:00
Han Fei
e4da317f05 fix test 2023-12-01 18:07:45 +01:00
vdimir
3b4f70a811
Minor changes in test_check_table 2023-11-23 16:24:11 +00:00
Igor Nikonov
4d16c096a1 Use ports from cluster 2023-11-16 13:03:20 +00:00
Julian Maicher
c3dc106980 Reformat with black 2023-11-10 04:28:21 +01:00
Julian Maicher
4e1965167e Fix flaky LDAP integration tests
Use LDAP hostname with regular DNS lookup to check if LDAP is online.
Before that, we used the IP address that was extracted via the docker
client (not via DNS lookup) and it could happen that LDAP was reachable
via the IP, thus passing the online check, but not via DNS lookup, which
led to test failures (e.g. LDAP not reachable from ClickHouse instance).
2023-11-09 21:24:52 +01:00
Azat Khuzhin
b87ebb2a83 Fix test_format_schema_on_server flakiness
Sometimes the requests library detect the encoding incorrectly, and
because this test compares binary data it fails.

Here is an example of successfull attempt:

    2023-10-30 07:32:37 [ 654 ] DEBUG : http://172.16.1.2:8123 "GET /?query=SELECT+%2A+FROM+test.simple+FORMAT+Protobuf+SETTINGS+format_schema%3D%27simple%3AKeyValuePair%27 HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
    2023-10-30 07:32:37 [ 654 ] DEBUG : Encoding detection: utf_8 will be used as a fallback match (api.py:480, from_bytes)
    2023-10-30 07:32:37 [ 654 ] DEBUG : Encoding detection: Found utf_8 as plausible (best-candidate) for content. With 0 alternatives. (api.py:487, from_bytes)

And here is failed [1]:

    2023-10-29 18:12:56 [ 525 ] DEBUG : http://172.16.9.2:8123 "GET /?query=SELECT+%2A+FROM+test.simple+FORMAT+Protobuf+SETTINGS+format_schema%3D%27message_tmp%3AMessageTmp%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request)
    2023-10-29 18:12:56 [ 525 ] DEBUG : Encoding detection: Found utf_16_be as plausible (best-candidate) for content. With 1 alternatives. (api.py:487, from_bytes)
    E       AssertionError: assert '܈Ē͡扣܈Ȓͤ敦' == '\x07\x08\x01\x12\x03abc\x07\x08\x02\x12\x03def'
    E         - abcdef
    E         + ܈Ē͡扣܈Ȓͤ敦

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/56030/c7f392500e93863638c9ca9bd56c93b3193091f3/integration_tests__release__[3_4].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-30 08:45:47 +01:00
robot-clickhouse
35d8fa212d Automatic style fix 2023-10-23 12:28:02 +00:00
Smita Kulkarni
ad09c4a37a Updated to use f-strings 2023-10-23 14:13:14 +02:00
robot-clickhouse
a2d4372ee8 Automatic style fix 2023-10-18 20:39:41 +00:00
Smita Kulkarni
9d6cd0e9a2 Upadted to get free port for azurite 2023-10-18 22:20:39 +02:00
kssenii
34d804686a Fix black check 2023-10-16 13:03:12 +02:00
Kseniia Sumarokova
2015a0fc17
Merge branch 'master' into fix-iceberg-metadata-parsing 2023-10-15 18:03:53 +02:00
kssenii
f3056b1643 Add a test 2023-10-15 18:02:34 +02:00
Alexey Milovidov
68ce6b9b00
Merge pull request #55424 from ClickHouse/update-rabbitq
Updated RabbitMQ image and fixed log retrieval in failed tests.
2023-10-10 03:32:21 +02:00
Alexey Milovidov
04ed4ece7a
Merge pull request #55208 from arthurpassos/add_option_to_set_env_variables_for_a_single_node_integration_tests
Add option to set env variables for a single node in integration tests
2023-10-09 22:37:04 +02:00
robot-clickhouse
1a67e61729 Automatic style fix 2023-10-09 19:10:41 +00:00
Yatsishin Ilya
686c3b458d Updated RabbitMQ image and fixed log retrieval in failed tests. 2023-10-09 18:39:39 +00:00