Commit Graph

673 Commits

Author SHA1 Message Date
Stig Bakken
ff46e8bb51 Drop support for DatabaseOrdinary in MaterializedMySQL
1. Dropped support for DatabaseOrdinary for MaterializeMySQL. It
   is marked as experimental, and dropping support makes the code
   more maintaible, and speeds up integration tests by 50%.

2. Get rid of thread name logic for StorageMaterializeMySQL wrapping,
   use setInternalQuery instead (similar to MaterializedPostgreSQL).
2021-11-18 11:46:51 +01:00
lgbo-ustc
9902ccefc5 Add integration tests for hive query 2021-11-18 16:17:49 +08:00
alexey-milovidov
0ea843949e
Merge pull request #29806 from qoega/integration--7
Integration test improvements
2021-11-17 10:23:53 +03:00
Yatsishin Ilya
9345b93486 fix killall. better test_different_user 2021-11-11 16:28:29 +03:00
Yatsishin Ilya
ad2376c03b wip 2021-11-11 11:12:54 +03:00
Yatsishin Ilya
14c14dcd00 Merge remote-tracking branch 'origin' into integration--7 2021-11-11 10:41:50 +03:00
Yatsishin Ilya
b7c6a7bf8e wip 2021-11-11 10:41:48 +03:00
kssenii
62c70ce5cf Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http 2021-11-10 21:16:11 +00:00
Vitaly Baranov
508fb6f54f Use external dirs in the integration test to make test not flaky. 2021-11-10 11:03:09 +03:00
Alexander Tokmakov
4f542ab019 add test 2021-11-09 23:11:02 +03:00
Yatsishin Ilya
ce205fb10a Merge remote-tracking branch 'origin' into integration--7 2021-11-01 11:17:33 +03:00
mergify[bot]
65df198e9b
Merge branch 'master' into conf-clickhouse 2021-10-28 22:19:42 +00:00
Yatsishin Ilya
e4061ef6d9 Merge remote-tracking branch 'origin' into integration--7 2021-10-28 10:33:14 +03:00
Yatsishin Ilya
11b5aba6e3 increase 2021-10-28 10:27:27 +03:00
Yatsishin Ilya
c24b80b326 More changes 2021-10-26 17:17:51 +03:00
alesapin
b7ed729c81 typo 2021-10-26 11:29:22 +03:00
alesapin
c8f9bab93b Better wait for server start in integration tests 2021-10-26 11:28:28 +03:00
Azat Khuzhin
e3b8557dd6 tests/integration/cluster: switch <yandex> to <clickhouse> 2021-10-26 09:02:27 +03:00
Azat Khuzhin
81436089dc tests: switch <yandex> to <clickhouse> 2021-10-26 09:02:13 +03:00
Yatsishin Ilya
0967c2e309 better 2021-10-19 20:39:44 +03:00
Yatsishin Ilya
b807465dd4 Merge remote-tracking branch 'origin' into integration--7 2021-10-19 13:19:46 +03:00
Yatsishin Ilya
2fdaebc9e4 better search for fatal messages 2021-10-19 13:19:43 +03:00
alesapin
90ff7f05fd Start keeper asynchronously if has connection to other nodes 2021-10-14 13:21:41 +03:00
Yatsishin Ilya
bf08427e58 faster force kill if docker ps is slow, print traces on timeout 2021-10-13 14:55:58 +03:00
Yatsishin Ilya
5f7c53923d Merge remote-tracking branch 'origin' into integration--7 2021-10-12 09:35:48 +03:00
tavplubix
1aeb5d55dd
Grep server log even if it contains binary data (#29903)
* grep server log even if it contains binary data

* Update cluster.py

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-10-10 12:55:37 +03:00
Yatsishin Ilya
7b6b5de7d5 Merge remote-tracking branch 'qoega/integration--7' into integration--7 2021-10-08 13:21:17 +03:00
Yatsishin Ilya
8b1efe1aa1 improve test_match_process_uid_against_data_owner 2021-10-08 12:16:23 +03:00
alexey-milovidov
fecfb097a0
Update cluster.py 2021-10-08 00:42:12 +03:00
Alexander Tokmakov
90cc63aecd fix tests 2021-10-07 22:05:51 +03:00
Yatsishin Ilya
b0a5a8532f improve test_storage_kafka test 2021-10-06 16:08:25 +03:00
Alexander Tokmakov
c0ee6d46f7 resolve dependency of StorageDictionary 2021-10-06 15:39:14 +03:00
Nikolai Kochetov
754f7aafeb
Merge pull request #29608 from ClickHouse/fix-many-signals-in-integration-tests
Do not send many signals at server restart (integration tests).
2021-10-01 21:09:00 +03:00
Vitaly Baranov
27f6d5864d
Merge pull request #29060 from azat/inter-server-secret-auth-fix
Do not allow to reuse previous credentials in case of inter-server secret
2021-10-01 20:44:48 +03:00
Nikolai Kochetov
291a8332b9 Do not send many signals at server restart (integration tests). 2021-10-01 12:52:24 +03:00
Azat Khuzhin
2822f71eec tests/integration/helpers: add query_id for query() 2021-10-01 01:13:08 +03:00
alexey-milovidov
1e6f9ac635
Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-28 20:26:44 +03:00
Ilya Yatsishin
e66e081119
Merge pull request #28522 from qoega/improve-integration-1
Improve integration tests: work with iptables and services listing
2021-09-28 16:35:38 +03:00
Alexey Milovidov
c7b7c8339f Compatibility 2021-09-28 05:00:06 +03:00
alexey-milovidov
995913e89c
Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-28 02:27:36 +03:00
Yatsishin Ilya
650de10dea Merge remote-tracking branch 'origin/master' into improve-integration-1 2021-09-27 09:47:49 +03:00
Alexey Milovidov
4c0feaf343 Fix compatibility 2021-09-27 02:11:10 +03:00
Nikolai Kochetov
3c9e6a04bf A little bit better 2021-09-26 18:06:32 +03:00
Alexey Milovidov
ddd96f0106 Fix compatibility 2021-09-26 03:19:50 +03:00
Alexey Milovidov
cba6e39fe5 Replace yandex to clickhouse in configs 2021-09-25 07:08:34 +03:00
Alexey Milovidov
82d57c6e47 Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-25 01:38:39 +03:00
Nikolai Kochetov
48bdabbc26 Less sleeps in integration tests. 2021-09-24 18:25:19 +03:00
alesapin
3614fb9e37
Merge pull request #29223 from ClickHouse/compressed_logs
Compressed logs for keeper
2021-09-24 16:03:26 +03:00
Yatsishin Ilya
e3610dec92 do not lose docker.log if dependencies failed to start before clickhouse up called 2021-09-24 13:46:55 +03:00
alexey-milovidov
b8083929a6
Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-23 20:49:40 +03:00
Yatsishin Ilya
bbac70693e Merge remote-tracking branch 'origin' into improve-integration-1 2021-09-23 17:35:06 +03:00
Yatsishin Ilya
ad4f7498ad add comment 2021-09-23 17:35:04 +03:00
alesapin
3bea8d5201 Fix config root name 2021-09-22 18:00:08 +03:00
Alexey Milovidov
04962e61ee Fix integration tests 2021-09-22 02:08:09 +03:00
Yatsishin Ilya
c1f24cdd5e ro 2021-09-21 18:31:32 +03:00
alesapin
ac7579f187 Compressed logs for keeper 2021-09-21 17:29:05 +03:00
Yatsishin Ilya
cfa513c490 Merge remote-tracking branch 'origin' into improve-integration-1 2021-09-20 10:29:31 +03:00
Alexey Milovidov
e513a5db32 Change <yandex> to <clickhouse> in configs 2021-09-20 01:38:53 +03:00
alesapin
3f11cbd31b Rename more images 2021-09-08 13:03:54 +03:00
Yatsishin Ilya
1ea2dd4564 Improve work with iptables and services listing. 2021-09-02 15:43:15 +03:00
alesapin
68f6ecec62
Merge pull request #28184 from ClickHouse/trying_to_fix_fetches_test
Better detection of the default interface in replicated fetches tests
2021-09-01 12:21:50 +03:00
alexey-milovidov
307ae344db
Merge pull request #27934 from azat/integration-tests-improve-check
Improve server logs checking in integration tests
2021-08-31 23:08:51 +03:00
alesapin
621dcfe84e Remove garbage 2021-08-31 14:36:24 +03:00
alesapin
cd389f12f6
Update network.py 2021-08-27 20:39:05 +03:00
alesapin
de96bd1be9
Update network.py 2021-08-27 10:25:28 +03:00
alesapin
1ff81b6678
Update network.py 2021-08-26 19:04:08 +03:00
alesapin
a6b4c28314
Update network.py 2021-08-26 18:27:14 +03:00
alesapin
b34c0c5bd4 Better detection of the default interface 2021-08-26 13:42:04 +03:00
kssenii
b536653851 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-24 07:29:50 +00:00
Azat Khuzhin
2785aca25d Improve server logs checking in integration tests
Since some dtors will be called only after SIGTERM, check after server
is exited.

Also Fatal messages does not fails tests before.
2021-08-21 23:34:36 +03:00
kssenii
945e2c4ce5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-20 18:01:23 +00:00
Yatsishin Ilya
d9e782d379 Merge remote-tracking branch 'origin' into mute-integration-debug-fails 2021-08-20 18:59:16 +03:00
Yatsishin Ilya
58c1b57259 improve tests from test_backward_compatibility 2021-08-20 18:58:43 +03:00
Yatsishin Ilya
9c22d07dea Mute current failures 2021-08-19 14:32:32 +03:00
alesapin
c819880aa7 Add test for clickhouse-keeper start after conversion 2021-08-18 16:34:57 +03:00
kssenii
073d7fdd5e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-06 19:42:29 +00:00
OmarBazaraa
6b9e0f5a6f Fix 2021-07-28 09:38:34 +00:00
OmarBazaraa
8acc290bc5 Add integration tests 2021-07-28 09:38:34 +00:00
mergify[bot]
242efdd0f1
Merge branch 'master' into jdbc-bridge-test 2021-07-27 14:28:27 +00:00
Kseniia Sumarokova
f2e599d8d1
Merge pull request #26826 from kssenii/rabbit-fix-tests
Try fix rabbitmq tests
2021-07-27 17:07:37 +03:00
Yatsishin Ilya
f8c7058bcf Better 2021-07-27 10:33:49 +03:00
Vitaly Baranov
72ab7f598c Fix killing unstopped containers in integration tests. 2021-07-27 09:31:04 +03:00
kssenii
1d50e9a3b9 Add retries 2021-07-27 06:16:40 +00:00
Yatsishin Ilya
d11ec777c9 Merge remote-tracking branch 'origin' into integration-6 2021-07-16 16:28:02 +03:00
Yatsishin Ilya
e6b724ad3f postgres rework 2021-07-16 16:26:35 +03:00
Zhichang Yu
5047c758f4 fix per review 2021-07-13 07:20:20 +00:00
Anton Popov
313cd0077d
Fix output of TSV in integration tests 2021-07-12 20:23:19 +03:00
Yatsishin Ilya
a4a960328e Merge remote-tracking branch 'origin' into integration-6 2021-07-12 11:34:23 +03:00
Yatsishin Ilya
143368d8d6 wip 2021-07-12 11:32:20 +03:00
Vitaly Baranov
e7b1e9a2fb
Merge pull request #25986 from vitlibar/fix-flaky-test_dictionaries_all_layouts_separate_sources-test_https
Fix parallel execution of integration tests
2021-07-06 09:22:06 +03:00
Vitaly Baranov
cdcc735d83
Merge pull request #25899 from vitlibar/improve-logging-in-integration-tests
Improve logging in integration tests.
2021-07-06 08:22:21 +03:00
Vitaly Baranov
87f59ba670 Fix parallel execution of integration tests. 2021-07-05 23:50:04 +03:00
kssenii
32b7d7b750 More correct startup on create query 2021-07-04 19:53:05 +00:00
Vitaly Baranov
618a77fafa Improve logging in integration tests. 2021-07-04 22:24:54 +03:00
Ilya Yatsishin
523155a020
Merge pull request #25908 from arenadata/ADQM-320 2021-07-02 13:25:22 +03:00
Ilya Golshtein
63c71a7b4b kerberized HDFS test fix if run in parallel 2021-07-02 02:12:31 +03:00
alexey-milovidov
919cc10a3c
Merge pull request #25823 from azat/integration-tests-fixes
tests/integration: use iptables --wait
2021-07-02 00:58:33 +03:00
Vitaly Baranov
92ace627d2 Correct messages in integration tests. 2021-06-30 14:16:37 +03:00
Azat Khuzhin
283ec54cbe tests/integration: use iptables --wait
Since integration tests runs in parallel, this should fix:

  test_keeper_persistent_log_multinode/test.py::test_restart_multinode Another app is currently holding the xtables lock. Perhaps you want to use the -w option?

And similar errors.
2021-06-29 21:07:39 +03:00
Vitaly Baranov
3a3cbeb7aa Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
alesapin
66b7df1d03
Merge pull request #25525 from ClickHouse/fix_some_tests
Fix some bugs in integration tests
2021-06-22 10:52:07 +03:00
Ilya Yatsishin
d6bdde54d9
Merge pull request #25212 from qoega/integration-6
More integration tests improvements
2021-06-22 10:19:22 +03:00
alesapin
426710f8e3 Followup fix 2021-06-21 18:53:47 +03:00
Yatsishin Ilya
e04957ce82 more 2021-06-21 18:42:40 +03:00
alesapin
8cf5f8e748 Followup fix 2021-06-21 13:30:39 +03:00
alesapin
a63da94ae4 Revert "Merge pull request #25526 from ClickHouse/revert-25459-add_run_id_option"
This reverts commit 7c7e96f26c, reversing
changes made to a54cbef5b7.
2021-06-21 11:14:26 +03:00
alesapin
da0a3997f4 Merge branch 'master' into fix_some_tests 2021-06-21 11:14:22 +03:00
alesapin
feecf398fb
Revert "Add run-id option to integration tests" 2021-06-21 11:10:44 +03:00
alesapin
c7781e24d5 Fix some flaky tests 2021-06-21 11:02:27 +03:00
alesapin
65ce3929b8
Merge pull request #25459 from ClickHouse/add_run_id_option
Add run-id option to integration tests
2021-06-21 10:21:24 +03:00
alesapin
49cd16e74f Better 2021-06-18 22:08:12 +03:00
kssenii
f33387837e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-06-18 14:27:48 +00:00
alesapin
8a5bc2e7bc Add run-id option to integration tests 2021-06-18 12:23:22 +03:00
Yatsishin Ilya
f4d587a17a hardening 2021-06-16 15:31:19 +03:00
Nikolai Kochetov
ca66f655c8 Use signal 15 2021-06-16 14:15:08 +03:00
kssenii
2cfcc9980c Better 2021-06-13 19:38:31 +00:00
kssenii
603c06d02e Add test 2021-06-13 19:38:17 +00:00
alexey-milovidov
30f0124e77
Merge branch 'master' into always-detach-parts-with-wrong-partition-id 2021-06-12 02:55:55 +03:00
alexey-milovidov
f96b512ffb
Merge pull request #24728 from qoega/remove-enable-dictionaries
Remove explicit enable_dictionaries files in integration tests
2021-06-12 02:45:25 +03:00
alexey-milovidov
cad5cfacf1
Merge pull request #25047 from zhicwu/jdbc-bridge-sit
Add integration test for jdbc bridge
2021-06-11 23:07:43 +03:00
Yatsishin Ilya
cbbeb4001b more changes 2021-06-11 15:00:40 +03:00
Yatsishin Ilya
d7fca4a6f2 wait hdfs longer 2021-06-11 12:30:09 +03:00
Zhichun Wu
7f2b444d6f Add integration test for jdbc bridge 2021-06-11 17:10:51 +08:00
Yatsishin Ilya
65074edba4 Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-11 11:50:56 +03:00
alesapin
54f9db670f
Merge pull request #25079 from ClickHouse/debug_network_interfaces
Trying to debug fetches bandwith test failures
2021-06-11 10:30:14 +03:00
Nikolai Kochetov
3bfefa50e2 Add user arg to exec_in_container with cli 2021-06-10 15:15:07 +03:00
Yatsishin Ilya
dd3fd87e26 Fix kerberized hdfs and cleanup 2021-06-09 16:53:16 +03:00
mergify[bot]
bc012b9c1a
Merge branch 'master' into recreate_kafka_table_case 2021-06-09 10:30:32 +00:00
Yatsishin Ilya
aba39d58f9 wip 2021-06-09 12:23:02 +03:00
Nikita Mikhaylov
82b8d45cd7
Merge pull request #23518 from nikitamikhaylov/copier-stuck
Bugfixes and improvements of `clickhouse-copier`
2021-06-09 11:36:42 +03:00
alesapin
fc805a1ece Trying to debug fetches bandwith test failures 2021-06-08 15:13:45 +03:00
alexey-milovidov
344fc39e41
Merge branch 'master' into cleanup-iptables-on-session-start 2021-06-07 02:56:32 +03:00
mergify[bot]
1172807442
Merge branch 'master' into recreate_kafka_table_case 2021-06-06 12:15:55 +00:00
Ilya Yatsishin
f2eed22ebd
Merge pull request #24954 from ClickHouse/fix_integration_test 2021-06-05 20:18:33 +03:00
Yatsishin Ilya
df6e163976 fix 2021-06-04 18:46:11 +03:00
Yatsishin Ilya
05232e7c40 Make tests great again 2021-06-04 17:33:22 +03:00
Yatsishin Ilya
e075130112 Remove subprocess_call from cluster.py 2021-06-04 13:14:32 +03:00
alesapin
4d7170b557 Followup fixes for integration tests 2021-06-04 10:51:45 +03:00
Mikhail Filimonov
e11f7db28b
Add test #23430 2021-06-03 20:41:01 +02:00
Nikita Mikhaylov
6c583b0e36 Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-stuck 2021-06-03 15:05:23 +00:00
alesapin
f0f5aba3b1
Merge pull request #20393 from qoega/integration-2
Grand integration tests refactoring: Allow parallel run
2021-06-03 15:20:03 +03:00
alesapin
4a1bf51ad1
Merge branch 'master' into limited_fetches 2021-06-02 23:01:47 +03:00
Yatsishin Ilya
ddddb761db more 2021-06-02 18:08:16 +03:00
Nikita Mikhaylov
312bb96eeb Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-stuck 2021-06-02 01:04:47 +03:00
Yatsishin Ilya
d51a6a2c1f Merge remote-tracking branch 'origin' into integration-2 2021-06-01 17:23:01 +03:00
Yatsishin Ilya
ff7f7f6200 try 2021-06-01 17:18:35 +03:00
Yatsishin Ilya
2983a9ba61 use cli for exec 2021-06-01 12:53:36 +03:00
Yatsishin Ilya
739ff5fee7 increase docker client timeout 2021-06-01 11:43:44 +03:00
Nikita Mikhaylov
5bd6183e67 save 2021-05-31 17:37:10 +03:00
Nikita Mikhaylov
095f06c8a3 raise timeout for test_host_ip_change/test.py::test_user_access_ip_change 2021-05-28 17:37:05 +03:00
alesapin
2985def91d Add tests 2021-05-27 15:54:47 +03:00
Yatsishin Ilya
ae60a3dd3a new tests from master 2021-05-27 07:24:16 +03:00
Yatsishin Ilya
d17b46d69f fix mongo logging 2021-05-26 15:06:13 +03:00
Yatsishin Ilya
a667a1c032 better 2021-05-25 18:32:24 +03:00
Yatsishin Ilya
8939daf7e7 more 2021-05-24 11:23:04 +03:00
Yatsishin Ilya
c32cea4dd2 Merge remote-tracking branch 'origin' into integration-2 2021-05-24 09:59:16 +03:00
BoloniniD
33755f1f3d Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
Yatsishin Ilya
d73d92ed7e revert some changes 2021-05-21 18:48:14 +03:00
Yatsishin Ilya
daf0b5ad2b rewrite zookeeper test 2021-05-21 16:29:43 +03:00
Yatsishin Ilya
1f8d43235f better 2021-05-20 21:19:45 +03:00
Yatsishin Ilya
1d35da6882 Merge remote-tracking branch 'origin' into integration-2 2021-05-20 19:12:04 +03:00
alesapin
cf94bc9b8c
Merge pull request #24059 from ClickHouse/standalone_keeper
Standalone keeper server
2021-05-20 10:10:51 +03:00
Yatsishin Ilya
8932f794aa Merge remote-tracking branch 'origin' into integration-2 2021-05-19 14:15:52 +03:00
Yatsishin Ilya
7a5895815b remove tmpfs for now 2021-05-19 13:23:51 +03:00
Yatsishin Ilya
3ec8e779ba one more timeout 2021-05-19 08:54:48 +03:00
alesapin
974f362e1c
Update cluster.py 2021-05-18 17:25:46 +03:00
Nikolai Kochetov
e71387f509 Increase timeout for server restart in integration tests. 2021-05-18 10:38:32 +03:00
Nikolai Kochetov
e5aff8fe23 Increase timeout for server restart in integration tests. 2021-05-18 10:16:51 +03:00
Nikolai Kochetov
118ebf0463 Increase timeout for server restart in integration tests. 2021-05-17 20:04:43 +03:00
Yatsishin Ilya
40e63646ca more 2021-05-17 14:16:16 +03:00
alesapin
62004cf0d9 Merge branch 'master' into standalone_keeper 2021-05-17 10:14:58 +03:00
Yatsishin Ilya
e1176acc04 Merge remote-tracking branch 'origin' into integration-2 2021-05-17 09:53:00 +03:00
alesapin
5116f79441 Better configs and fix test 2021-05-16 17:18:21 +03:00
alesapin
852608c937 Don't abort on Auth request 2021-05-15 18:01:00 +03:00
alesapin
33e9f1bcf1 Better tests 2021-05-15 15:33:01 +03:00
alesapin
de75d9c887 Revert accident changes 2021-05-14 16:44:32 +03:00
alesapin
123715300a Use keeper in integration tests 2021-05-14 15:30:49 +03:00
Yatsishin Ilya
d0a1dcd6cc better name 2021-05-11 17:27:38 +03:00
Yatsishin Ilya
6aa7c0fafc fixes 2021-05-11 16:13:26 +03:00
Yatsishin Ilya
fddc72fb49 fixes 2021-04-30 15:22:37 +03:00
Yatsishin Ilya
28fe11158a rabbitmq 2021-04-30 12:18:12 +03:00
Yatsishin Ilya
cb101e46bb finally 2021-04-29 14:57:48 +03:00
Yatsishin Ilya
a87fe5e1bc Merge remote-tracking branch 'origin' into integration-2 2021-04-28 17:23:33 +03:00
Yatsishin Ilya
c59a11f798 Merge remote-tracking branch 'origin' into integration-2 2021-04-27 18:34:33 +03:00
Ilya Golshtein
6ae4cc6ca7 hdfs_api.py last minute format improvement went wrong .. fixed 2021-04-27 13:37:54 +03:00
Yatsishin Ilya
73c593f030 better 2021-04-27 12:07:21 +03:00
Ilya Golshtein
95dad032a0 Kerberized HDFS test - retries and extra output if failure 2021-04-26 18:27:41 +03:00
alexey-milovidov
657a76d81c
Update cluster.py 2021-04-25 06:09:42 +03:00
Alexey Milovidov
5558a224b0 Skip CatBoost tests under MSan 2021-04-25 05:25:46 +03:00
Pavel Kovalenko
06fc69a9bc Increase CH start/stop timeouts in integration tests. 2021-04-15 12:44:45 +03:00
Pavel Kovalenko
e53fc635f6 Disk S3 restore test improvements. 2021-04-15 11:26:44 +03:00
Yatsishin Ilya
10b7037d9c Merge remote-tracking branch 'origin' into integration-2 2021-04-14 14:21:40 +03:00
Yatsishin Ilya
70d65c0092 longer timeout 2021-04-13 19:22:10 +03:00
Yatsishin Ilya
b635f17b1b fix 2021-04-13 19:08:29 +03:00
Yatsishin Ilya
c2707a8154 better 2021-04-13 17:55:31 +03:00
Yatsishin Ilya
fb1e2c9006 fix 2021-04-13 14:27:52 +03:00
Yatsishin Ilya
e4d1ea846c more 2021-04-13 13:52:22 +03:00
Azat Khuzhin
fad42f8ac5 tests/integration: stop containers at start only if destroy_dirs is not set
Fixes tests with multiple clusters - test_zookeeper_config
2021-04-11 14:49:59 +03:00
Azat Khuzhin
3fa047bb0f tests/integration: run docker-compose commands after copying of compose files 2021-04-11 14:27:15 +03:00
Azat Khuzhin
d4bb4c5dd7 tests/integration: add docker-compose pull retries 2021-04-11 14:27:15 +03:00
Azat Khuzhin
c7bef49b37 tests/integration: drop --force-recreate since we have down/pull separately 2021-04-11 14:27:14 +03:00
Azat Khuzhin
dfcc9bdcb1 tests/integration: pull images in a separate step with --ignore-pull-failures 2021-04-11 14:27:14 +03:00
Azat Khuzhin
df2637e523 tests/integration: stops orphan contains too 2021-04-11 14:27:14 +03:00
Yatsishin Ilya
2cc9d314be fix 2021-04-08 17:43:57 +03:00
Yatsishin Ilya
5311278c29 Merge remote-tracking branch 'origin' into integration-2 2021-04-08 12:30:24 +03:00
Yatsishin Ilya
9115fd8cec wip 2021-04-07 15:22:53 +03:00
alesapin
86a843bb51
Merge pull request #21509 from kssenii/library-bridge
clickhouse-library-bridge for library dictionary source
2021-04-06 12:26:08 +03:00
kssenii
9dba529494 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-04-05 13:14:51 +00:00
Yatsishin Ilya
b395838415 Merge remote-tracking branch 'origin' into integration-2 2021-04-05 09:49:11 +03:00
kssenii
13d1f17d3e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-03 08:00:09 +00:00
Mike Kot
c947280dfc Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-04-01 21:38:51 +03:00
kssenii
88df6afc84 More tests 2021-03-31 23:48:54 +00:00
kssenii
03ce320926 Add a separate docker-compose with multiple servers for postgres and mysql 2021-03-31 17:04:57 +00:00
Yatsishin Ilya
fb3078a863 Merge remote-tracking branch 'origin' into integration-2 2021-03-26 13:08:39 +03:00
Yatsishin Ilya
3f9b81b0a7 tune 2021-03-26 13:08:24 +03:00
Maksim Kita
bbe1960eea
Merge pull request #21573 from kitaisreal/updated-cache-dictionary-storage
Added specialized CacheDictionaryStorage
2021-03-25 21:29:01 +03:00
Mike Kot
285af08949 Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-03-24 22:34:20 +03:00
kssenii
d9326cc229 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-24 18:28:55 +00:00
Yatsishin Ilya
21b0f2bf02 Merge remote-tracking branch 'origin' into integration-2 2021-03-24 13:37:56 +03:00
Mike Kot
5789507e8b Investigating, why the checksums may match when they shouldn't. 2021-03-22 17:23:43 +03:00
kssenii
3b32c8fe9a Block on empty connection pool 2021-03-19 21:00:45 +00:00
Yatsishin Ilya
f14d4be88e change postgres 2021-03-19 19:44:08 +03:00
kssenii
50743b19c4 Add one more test 2021-03-19 16:12:33 +00:00
Yatsishin Ilya
5ae47bd2b4 Merge remote-tracking branch 'origin/master' into integration-2 2021-03-19 15:33:14 +03:00
Yatsishin Ilya
a67f066f0a fixes 2021-03-19 14:44:03 +03:00
Maksim Kita
18ed9c5c67 SSDCacheDictionary remove max_stored_keys option 2021-03-18 12:55:17 +03:00
Yatsishin Ilya
06bb4e2c71 wip 2021-03-16 13:00:49 +03:00
kssenii
5602b82faa Fix test 2021-03-12 14:07:20 +00:00
kssenii
5ff95e615d Add tests 2021-03-11 18:05:08 +00:00
Yatsishin Ilya
e6f90298bb wip 2021-03-09 10:32:10 +03:00
Yatsishin Ilya
534500ef84 wip 2021-03-05 16:39:51 +03:00
Yatsishin Ilya
8b6a64e8b8 typo 2021-03-04 12:07:59 +03:00
Yatsishin Ilya
babea212c7 Merge remote-tracking branch 'origin' into integration-2 2021-03-03 11:56:15 +03:00
Yatsishin Ilya
ec3d63bfe4 add check for fatal 2021-03-03 11:09:44 +03:00
Mike Kot
4e1ac185b5 Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-03-01 20:58:07 +03:00
Mike Kot
f088dd445d Extended the test to check both the ALTER PARTITION and PART
Added some notes about the SYSTEM SYNC REPLICA and ALTER ... DROP /
ATTACH.
2021-03-01 20:41:31 +03:00
Mike Kot
5281314ac0 Finished the test draft for ATTACH PARTITION,
Extracted the part data corruption function into the helper.
2021-03-01 16:42:31 +03:00
Mikhail Filimonov
2bcfff257c
Remove most of sleeps in tests 2021-02-25 17:02:59 +01:00
Mikhail Filimonov
6c6eaf2a60
Fixes 2021-02-25 17:02:57 +01:00
Mikhail Filimonov
a4c9e62d6d
Integration tests: introduce wait_for_log_line.
It uses tail -f executed in container, this way i don't need to pull
the file many times, rememeber positions etc.
2021-02-25 17:02:56 +01:00
Mikhail Filimonov
32fa3dbc99
Integration tests: add IPC_LOCK and SYS_NICE caps
It is needed to make integration tests work with a installed binary (/usr/bin/clickhouse) mounted in.
Otherwise the binary mounted in have the capability, while the container is not allowing that
and you get cryptic message:
standard_init_linux.go:211: exec user process caused "operation not permitted"
2021-02-25 17:02:54 +01:00
Yatsishin Ilya
f8f475e83f fix 2021-02-24 21:24:16 +03:00
Yatsishin Ilya
7c61f6c957 Merge remote-tracking branch 'origin' into integration-2 2021-02-24 15:42:20 +03:00
Yatsishin Ilya
905cc7a2bd fixes 2021-02-24 14:46:58 +03:00
Azat Khuzhin
80f448a466 tests/integration: preserve mysql docker logs in test_materialize_mysql_database 2021-02-20 22:09:01 +03:00
Yatsishin Ilya
775f31f65e fix 2021-02-20 18:23:09 +03:00
Yatsishin Ilya
fc89b4fd35 better 2021-02-20 17:59:39 +03:00
Yatsishin Ilya
65a55b1010 Merge remote-tracking branch 'origin' into integration-2 2021-02-19 20:07:16 +03:00
Yatsishin Ilya
b5f59446b7 fix kerberos 2021-02-19 18:39:27 +03:00
Yatsishin Ilya
ecf928737b fix 2021-02-19 18:08:38 +03:00
Yatsishin Ilya
d45cab4228 wip 2021-02-19 17:42:43 +03:00
Yatsishin Ilya
ee955038c1 wip 2021-02-19 15:58:11 +03:00
Yatsishin Ilya
2df4317aba wip 2021-02-19 00:21:50 +03:00
Alexander Tokmakov
8097532cb7 Merge branch 'master' into database_replicated 2021-02-18 17:42:06 +03:00
Yatsishin Ilya
609c9b272f fix 2021-02-18 16:42:31 +03:00
Yatsishin Ilya
872e36c207 wip 2021-02-18 15:57:45 +03:00
Vitaly Baranov
c704a8cc45 Log stdout and stderr when failed to start docker in integration tests. 2021-02-17 20:07:03 +03:00
Yatsishin Ilya
677528326f postgres 2021-02-17 18:40:01 +03:00
Yatsishin Ilya
8603855f5f fix 2021-02-16 17:16:15 +03:00
Yatsishin Ilya
0b62ef4aa9 more fixes 2021-02-16 10:10:01 +03:00
Yatsishin Ilya
06e1188d9e wip 2021-02-15 12:35:45 +03:00
Yatsishin Ilya
20864076ed wip 2021-02-12 18:51:21 +03:00
Alexander Tokmakov
5e0cbfe972 Merge branch 'master' into database_replicated 2021-02-08 23:01:12 +03:00
Alexander Tokmakov
d010f97db0 Merge branch 'master' into database_replicated 2021-02-03 20:13:25 +03:00
Pavel Kovalenko
b7151aa754 Merge remote-tracking branch 'origin/master' into disk-s3-backup-restore-metadata
# Conflicts:
#	src/Disks/DiskDecorator.h
#	src/Disks/IDisk.h
#	src/Disks/S3/DiskS3.cpp
2021-02-03 14:22:18 +03:00
Yatsishin Ilya
19d6e867c6 HDFS test had a clash with 9000 ClickHouse port. 2021-02-02 12:08:47 +03:00
Yatsishin Ilya
01c9b90144 fix project name for clickhouse instance 2021-01-29 19:16:10 +03:00
Yatsishin Ilya
5f6a4ad60d Remove --project-directory for docker-compose. Fix logs formatting from docker container. 2021-01-29 19:16:10 +03:00
alesapin
bcc3c4193e
Merge pull request #19697 from qoega/easier-macro-xml-generate
No more dicttoxml with excessive logs in integration tests
2021-01-29 12:00:20 +03:00
alesapin
4a6aef5421 Merge branch 'debug/test_concurrent_ttl_merges' of https://github.com/qoega/ClickHouse into fix_flaky_test_multiple_ttl 2021-01-27 14:51:55 +03:00
Yatsishin Ilya
d21d838604 No more dicttoxml with excessive logs 2021-01-27 12:50:11 +03:00
vdimir
fc8b8d23b2
Merge pull request #18812 from excitoon-favorites/betters3endpoints
Added prefix-based S3 endpoint settings
2021-01-26 20:47:57 +03:00
Yatsishin Ilya
403e74d941 Add more debuginfo for test_concurrent_ttl_merges test 2021-01-26 18:12:08 +03:00
Alexander Tokmakov
3bd4d97353 Merge branch 'master' into database_replicated 2021-01-25 14:19:04 +03:00
Vladimir Chebotarev
8ba8e8efd5 Added prefix-based S3 endpoint settings. 2021-01-25 06:40:57 +03:00
Alexander Tokmakov
14e842c197 print stderr of failed subprocess 2021-01-22 17:27:23 +03:00
Alexander Tokmakov
7f97a11c84 Merge branch 'master' into database_replicated 2021-01-18 17:09:39 +03:00
Pavel Kovalenko
1e3a059f64 Merge remote-tracking branch 'origin/master' into disk-s3-backup-restore-metadata
# Conflicts:
#	src/Disks/DiskCacheWrapper.cpp
#	src/Disks/S3/DiskS3.cpp
2021-01-18 13:39:49 +03:00
Pavel Kovalenko
53389f79c0 Ability to backup-restore metadata files for DiskS3 (minor fixes) 2021-01-13 15:05:32 +03:00
Pavel Kovalenko
b09862b7b9 Ability to backup-restore metadata files for DiskS3 (fixes and tests) 2021-01-12 20:18:40 +03:00
Pavel Kovalenko
0164965bc0 Fix get_process_pid 2021-01-11 20:40:11 +03:00
Pavel Kovalenko
0856b2c514 Ability to backup-restore metadata files for DiskS3 (fixes and tests) 2021-01-11 20:37:08 +03:00
alesapin
303c4f98cc Add ability to collect coverage from integration tests 2020-12-24 18:51:53 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d9166a0645 HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities 2020-12-16 14:48:33 +03:00
Ilya Golshtein
eb10948ca2 kerberized_hdfs cluster started 2020-12-16 14:48:33 +03:00
Ilya Golshtein
185ac744b1 kerberized hdfs compiled 2020-12-16 14:48:33 +03:00
alesapin
710550f8e5 Kill container with retries 2020-12-07 12:25:27 +03:00
alesapin
51f49e3d47 Check output of cluster start cmd 2020-12-01 23:23:32 +03:00
Alexander Tokmakov
19c8399eb0 Merge branch 'master' into database_replicated 2020-12-01 17:33:07 +03:00
Alexander Tokmakov
9e3fd3c170 Merge branch 'master' into database_replicated 2020-11-27 17:08:34 +03:00
alesapin
17fa29f44f Less pulls of network image 2020-11-27 14:38:04 +03:00
Vitaly Baranov
4b3488934c Disable running test test_odbc_interaction.test_bridge_dies_with_parent with asan. 2020-11-24 17:55:02 +03:00
nikitamikhaylov
9c6b896928 style + flaky test fix 2020-11-17 17:36:04 +03:00
Alexander Tokmakov
0731bfb7be Merge branch 'master' into database_replicated 2020-11-12 21:04:18 +03:00
alesapin
dca35b1913 Add awesome test for fetch 2020-10-27 15:24:10 +03:00
Alexander Tokmakov
cd14f095ab fix tests 2020-10-26 18:12:16 +03:00
Mikhail Filimonov
5fb549ca24
fix flap in no_holes_when_write_suffix_failed 2020-10-09 17:06:36 +02:00
alesapin
3ac7b5aba8 Fetch helper image before run 2020-10-09 17:39:32 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
Alexander Tokmakov
a7d3a024c7 Revert "Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka""
This reverts commit c298c633a7.
2020-09-29 11:56:37 +03:00
alesapin
9bf27fb42a
Merge pull request #15110 from nikitamikhaylov/split-huge-dictionary-test
Splitting test_dictionaries_all_layouts_and_sources
2020-09-25 10:16:28 +03:00
nikitamikhaylov
2d4bdcfec0 file and executables 2020-09-23 22:31:47 +03:00
nikitamikhaylov
c9cfdffcd7 mongo uri 2020-09-22 16:52:56 +03:00
Vitaly Baranov
33efb36714 Use previous users.xml if failed to reload. 2020-09-19 16:21:12 +03:00
sundy-li
544b2cb20d add configChanged method for zookeeper
fix logic error && skip reload testkeeper
2020-09-17 13:33:45 +08:00
bharatnc
b75963d370 Format and optimize imports in integration test files
This PR formats all the `*.py` files found under the `tests/integration`
folder. It also reorders the imports and cleans up a bunch of unused
imports.

The formatting also takes care of other things like wrapping lines and
fixing spaces and indents such that the tests look more readable.
2020-09-15 23:10:54 -07:00
alesapin
58f4e5f967
Merge pull request #14755 from vitlibar/fix-permission-denied-in-integration-tests
Fix access denied on opening file /var/lib/clickhouse/status in integration tests.
2020-09-14 22:08:21 +03:00
alesapin
0c04f4d008
Update cluster.py 2020-09-14 10:01:20 +03:00
Vitaly Baranov
421eeeccef Add the section user_directories to the default config. 2020-09-12 23:04:28 +03:00
Vitaly Baranov
1e849f2975 Fix permission denied on opening file /var/lib/clickhouse/status in integration tests. 2020-09-12 03:18:18 +03:00
alesapin
150d8d4e79 Better recursive copy in integration tests 2020-09-09 14:11:59 +03:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
Alexey Milovidov
829049de2f Handle host/network is unreachable in integration tests 2020-09-07 19:43:35 +03:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
alesapin
9703494f32 Less debug prints 2020-09-07 11:25:14 +03:00
Ilya Yatsishin
5ada30df96
Merge branch 'master' into integration-explicit-configs 2020-09-03 20:43:01 +03:00
alesapin
4519b4308c Fix default tag for base image 2020-09-03 16:03:26 +03:00
Yatsishin Ilya
a4f0267709 pass katest if no DOCKER_BASE_TAG in env 2020-09-03 13:20:15 +03:00
Yatsishin Ilya
8f50a6769d Fix bad merge 2020-09-02 15:28:47 +03:00
Yatsishin Ilya
5ab9f249e5 Merge branch 'try-dns-fix' into integration-explicit-configs 2020-09-02 12:53:10 +03:00
Yatsishin Ilya
45e54f81c7 better resolv.conf, add DNSCacheUpdater logs 2020-09-02 11:07:46 +03:00
Yatsishin Ilya
6cb893f073 Draft. 2020-09-01 09:38:23 +03:00
Yatsishin Ilya
fac881a6f0 finally remove config_dir 2020-08-14 18:51:28 +03:00
Yatsishin Ilya
ad740fc7da copy dictionaries 2020-08-12 12:26:01 +03:00
Yatsishin Ilya
160776f183 Add explicit main_configs, user_configs and dictionaries in integration tests. 2020-08-12 11:55:04 +03:00
Vitaly Baranov
1a4a8a219c
Merge pull request #13305 from vitlibar/correct-error-message-if-setting-not-found-in-users_xml
Correct error message if setting not found in users.xml
2020-08-07 23:31:23 +03:00
Vitaly Baranov
5ef4b19471 Add test for custom settings in users.xml 2020-08-04 01:48:29 +03:00
alesapin
8ad6a68fad Add ability to execute commands in integration tests containers without exceptions. Supress exception during kill 2020-08-03 17:40:02 +03:00
Yatsishin Ilya
4bd6261dc1 Use prebuilt helper_container for integration tests 2020-07-27 20:00:14 +03:00
Pavel Kovalenko
f43428a4d5 S3 HTTPS integration test. 2020-07-10 22:42:18 +03:00
alesapin
84f8bf1e14
Merge pull request #10697 from CurtizJ/polymorphic-parts
Polymorphic parts (in-memory format)
2020-07-08 13:25:45 +03:00
alesapin
3f90f65678 Merge remote-tracking branch 'origin' into CurtizJ-polymorphic-parts 2020-07-06 21:34:17 +03:00
Yatsishin Ilya
0c7a261bc6 Place common docker compose files to integration docker container 2020-07-06 16:45:54 +03:00
alesapin
64583ceb22 Merge branch 'master' into add-storage-rabbitmq-read-only 2020-07-02 16:08:29 +03:00
alesapin
e9c47dc89c Merge branch 'master' into CurtizJ-polymorphic-parts 2020-06-26 14:27:19 +03:00
alesapin
3fc65b3269 Merge branch 'master' into kssenii-rabbit-mq 2020-06-24 20:14:28 +03:00
Vitaly Baranov
29a9d4187f Fix using current database while checking access rights. 2020-06-24 17:31:05 +03:00
alesapin
588568f39c Disable MySQL tests under tsan 2020-06-22 16:10:25 +03:00
Anton Popov
b19d48a11c Merge remote-tracking branch 'upstream/master' into HEAD 2020-06-16 06:37:55 +03:00
kssenii
18820814f5 Merge 2020-06-10 23:25:33 +00:00
Alexander Tokmakov
e67837bc4a cleenup 2020-06-04 00:11:17 +03:00
Anton Popov
1ce09e1faa Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-06-03 16:27:54 +03:00
Alexander Tokmakov
905bce4aeb fix 2020-05-27 23:53:35 +03:00
Alexander Tokmakov
f099ce19a7 fix 2020-05-27 16:54:39 +03:00
Alexander Tokmakov
940132adc4 Merge branch 'master' into merging_external_source_cassandra 2020-05-27 00:13:57 +03:00
Alexander Tokmakov
310d522528 minimal implementation 2020-05-26 22:21:18 +03:00
kssenii
ad1c0de8db Merge 2020-05-26 17:45:39 +00:00
Pavel Kovalenko
89b9fb6d41 Create 'root' S3 bucket before CH is started. 2020-05-22 14:48:08 +03:00
Alexander Tokmakov
f40fadc3d6 fix segfault 2020-05-21 18:29:18 +03:00