thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-27 10:02:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
94,677 Commits 9,196 Branches 1,782 Tags 2.1 GiB
5488a392ab
Commit Graph

502 Commits

Author SHA1 Message Date
Anton Ivashkin
0c0bf66334 Merge master 2021-12-21 17:27:54 +03:00
Haavard Kvaalen
9a2b0680a1 Fix weird permission on log directories 
Several log directories for integration tests were created with full
permissions for "others" but no permission for the owner of the
directory.  This caused issues when trying to run integration tests
again without manually wiping files from previous runs.  The test would
fail with "PermissionError: [Errno 13] Permission denied: 'logs'".

The intention may have been to do the equivalent of 'chmod o+rwx logs',
but it instead did the equivalent of 'chmod 007 logs'.
 2021-12-21 11:50:54 +01:00
taiyang-li
d033fc4c24 merge master and fix conflict 2021-12-17 15:11:21 +08:00
alexey-milovidov
4adf3b0285
Merge pull request #32740 from azat/integration-tests-fix-mysql-wait 
tests/integration: fix waiting of mysql client container
 2021-12-14 23:23:50 +03:00
lgbo-ustc
248e933fc4 Add test for local cache 2021-12-14 16:06:30 +08:00
Azat Khuzhin
ae122e430a tests/integration: fix waiting of mysql client container 
healthy means that everything is OK and no need to wait.

And before it works only because mysql container was too slow to start
and wait_mysql_client_to_start() returns only when the status was
unhealthy/starting, which was obviously wrong.

Fixes: #20393 (cc @qoega)
 2021-12-14 10:04:30 +03:00
Azat Khuzhin
1a134f5fc0 tests/integration: fix printing all available services in wait_mysql_client_to_start() 
There is no docker-compose.yml in that place, since mysql client has
different name:

    2021-12-14 04:03:02 [ 862 ] DEBUG : Command:['docker-compose', 'ps', '--services', '--all'] (cluster.py:63, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr: (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        Can't find a suitable configuration file in this directory or any (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        parent. Are you in the right directory? (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr: (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        Supported filenames: docker-compose.yml, docker-compose.yaml (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:         (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Exitcode:1 (cluster.py:73, run_and_check)
 2021-12-14 10:00:20 +03:00
Azat Khuzhin
01a57af774 tests/integration: fix wait_start()/start_clickhouse() 
Execute query at least once, otherwise it may incorrectly detect that
the server is "alive".

Fixes: test_keeper_incorrect_config/test.py::test_duplicate_endpoint
CI: https://s3.amazonaws.com/clickhouse-test-reports/32536/559b01a2e43d09571195fb1cc08d83133f559203/integration_tests__asan__actions__[1/3].html
 2021-12-14 09:45:46 +03:00
taiyang-li
f1535c7226 fix conflict 2021-12-14 10:41:51 +08:00
taiyang-li
8234d1176f merge master 2021-12-14 10:39:21 +08:00
Kseniia Sumarokova
78ed383f15
Merge pull request #31505 from ContentSquare/azure_blob_storage_dependency 
Azure Blob Storage Disks
 2021-12-13 18:28:48 +03:00
李扬
8675086104
Merge branch 'master' into hive_table 2021-12-12 09:01:46 -06:00
Jakub Kuklis
7351325f13 Simple check for files in cloud 2021-12-10 22:04:38 +01:00
Jakub Kuklis
312e5b8c45 Abstracting utility functions from main integration tests for remote disks 2021-12-10 22:04:38 +01:00
Jakub Kuklis
e58f74d8dc Connecting to Azurite and invoking simple INSERTs works in the integration test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
8afe69ff93 Comming back to StorageSharedKeyCredential for the integration test, get 400 Bad requests from Azurite when trying to create a container now 2021-12-10 22:04:38 +01:00
Jakub Kuklis
abd685e14c Installing azure-storage-blob in the integration tests docker, raising exception when not connected to Azurite, changing ports in the Azurite docker 2021-12-10 22:04:38 +01:00
Jakub Kuklis
639d8a2b38 Running Azurite docker in the integration test for Blob Storage support 2021-12-10 22:04:37 +01:00
kssenii
f5a77fca39 Done 2021-12-09 14:44:25 +00:00
Mikhail f. Shiryaev
03927f5fc6
Revert "graphite: split tagged/plain rollup rules (for merges perfomance)" 
This reverts commit 303552f515.
 2021-12-08 15:49:21 +01:00
msaf1980
303552f515
graphite: split tagged/plain rollup rules (for merges perfomance) 2021-12-06 16:49:08 +01:00
Anton Ivashkin
e0a16a483e Merge master 2021-12-01 19:03:31 +03:00
Anton Ivashkin
d409ab0605 Fix wait for freeze in tests 2021-11-29 19:17:26 +03:00
lgbo
996d7125c0
Merge branch 'master' into hive_table 2021-11-23 10:19:02 +08:00
alesapin
ef6079633d
Merge pull request #31605 from vitlibar/fix-cleanup-in-integration-tests 
Fix cleanup in integration tests
 2021-11-22 17:58:47 +03:00
Vitaly Baranov
6f5f72738b Fix cleanup in integration tests. 2021-11-22 12:05:52 +03:00
taiyang-li
e8644807fe merge master and solve conflict 2021-11-19 15:01:58 +08:00
lgbo-ustc
858f615463 fixed bugs in integration tests about hive query 2021-11-19 09:58:34 +08:00
Anton Ivashkin
827fa511e8 Add test for freeze/unfreeze with S3 zero-copy 2021-11-18 21:14:46 +03:00
Stig Bakken
ff46e8bb51 Drop support for DatabaseOrdinary in MaterializedMySQL 
1. Dropped support for DatabaseOrdinary for MaterializeMySQL. It
   is marked as experimental, and dropping support makes the code
   more maintaible, and speeds up integration tests by 50%.

2. Get rid of thread name logic for StorageMaterializeMySQL wrapping,
   use setInternalQuery instead (similar to MaterializedPostgreSQL).
 2021-11-18 11:46:51 +01:00
lgbo-ustc
9902ccefc5 Add integration tests for hive query 2021-11-18 16:17:49 +08:00
alexey-milovidov
0ea843949e
Merge pull request #29806 from qoega/integration--7 
Integration test improvements
 2021-11-17 10:23:53 +03:00
Yatsishin Ilya
9345b93486 fix killall. better test_different_user 2021-11-11 16:28:29 +03:00
Yatsishin Ilya
ad2376c03b wip 2021-11-11 11:12:54 +03:00
Yatsishin Ilya
14c14dcd00 Merge remote-tracking branch 'origin' into integration--7 2021-11-11 10:41:50 +03:00
Yatsishin Ilya
b7c6a7bf8e wip 2021-11-11 10:41:48 +03:00
kssenii
62c70ce5cf Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http 2021-11-10 21:16:11 +00:00
Vitaly Baranov
508fb6f54f Use external dirs in the integration test to make test not flaky. 2021-11-10 11:03:09 +03:00
Alexander Tokmakov
4f542ab019 add test 2021-11-09 23:11:02 +03:00
Yatsishin Ilya
ce205fb10a Merge remote-tracking branch 'origin' into integration--7 2021-11-01 11:17:33 +03:00
mergify[bot]
65df198e9b
Merge branch 'master' into conf-clickhouse 2021-10-28 22:19:42 +00:00
Yatsishin Ilya
e4061ef6d9 Merge remote-tracking branch 'origin' into integration--7 2021-10-28 10:33:14 +03:00
Yatsishin Ilya
11b5aba6e3 increase 2021-10-28 10:27:27 +03:00
Yatsishin Ilya
c24b80b326 More changes 2021-10-26 17:17:51 +03:00
alesapin
b7ed729c81 typo 2021-10-26 11:29:22 +03:00
alesapin
c8f9bab93b Better wait for server start in integration tests 2021-10-26 11:28:28 +03:00
Azat Khuzhin
e3b8557dd6 tests/integration/cluster: switch <yandex> to <clickhouse> 2021-10-26 09:02:27 +03:00
Azat Khuzhin
81436089dc tests: switch <yandex> to <clickhouse> 2021-10-26 09:02:13 +03:00
Yatsishin Ilya
0967c2e309 better 2021-10-19 20:39:44 +03:00
Yatsishin Ilya
b807465dd4 Merge remote-tracking branch 'origin' into integration--7 2021-10-19 13:19:46 +03:00
Yatsishin Ilya
2fdaebc9e4 better search for fatal messages 2021-10-19 13:19:43 +03:00
alesapin
90ff7f05fd Start keeper asynchronously if has connection to other nodes 2021-10-14 13:21:41 +03:00
Yatsishin Ilya
bf08427e58 faster force kill if docker ps is slow, print traces on timeout 2021-10-13 14:55:58 +03:00
Yatsishin Ilya
5f7c53923d Merge remote-tracking branch 'origin' into integration--7 2021-10-12 09:35:48 +03:00
tavplubix
1aeb5d55dd
Grep server log even if it contains binary data (#29903) 
* grep server log even if it contains binary data

* Update cluster.py

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2021-10-10 12:55:37 +03:00
Yatsishin Ilya
7b6b5de7d5 Merge remote-tracking branch 'qoega/integration--7' into integration--7 2021-10-08 13:21:17 +03:00
Yatsishin Ilya
8b1efe1aa1 improve test_match_process_uid_against_data_owner 2021-10-08 12:16:23 +03:00
alexey-milovidov
fecfb097a0
Update cluster.py 2021-10-08 00:42:12 +03:00
Alexander Tokmakov
90cc63aecd fix tests 2021-10-07 22:05:51 +03:00
Yatsishin Ilya
b0a5a8532f improve test_storage_kafka test 2021-10-06 16:08:25 +03:00
Alexander Tokmakov
c0ee6d46f7 resolve dependency of StorageDictionary 2021-10-06 15:39:14 +03:00
Nikolai Kochetov
754f7aafeb
Merge pull request #29608 from ClickHouse/fix-many-signals-in-integration-tests 
Do not send many signals at server restart (integration tests).
 2021-10-01 21:09:00 +03:00
Vitaly Baranov
27f6d5864d
Merge pull request #29060 from azat/inter-server-secret-auth-fix 
Do not allow to reuse previous credentials in case of inter-server secret
 2021-10-01 20:44:48 +03:00
Nikolai Kochetov
291a8332b9 Do not send many signals at server restart (integration tests). 2021-10-01 12:52:24 +03:00
Azat Khuzhin
2822f71eec tests/integration/helpers: add query_id for query() 2021-10-01 01:13:08 +03:00
alexey-milovidov
1e6f9ac635
Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-28 20:26:44 +03:00
Ilya Yatsishin
e66e081119
Merge pull request #28522 from qoega/improve-integration-1 
Improve integration tests: work with iptables and services listing
 2021-09-28 16:35:38 +03:00
Alexey Milovidov
c7b7c8339f Compatibility 2021-09-28 05:00:06 +03:00
alexey-milovidov
995913e89c
Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-28 02:27:36 +03:00
Yatsishin Ilya
650de10dea Merge remote-tracking branch 'origin/master' into improve-integration-1 2021-09-27 09:47:49 +03:00
Alexey Milovidov
4c0feaf343 Fix compatibility 2021-09-27 02:11:10 +03:00
Nikolai Kochetov
3c9e6a04bf A little bit better 2021-09-26 18:06:32 +03:00
Alexey Milovidov
ddd96f0106 Fix compatibility 2021-09-26 03:19:50 +03:00
Alexey Milovidov
cba6e39fe5 Replace yandex to clickhouse in configs 2021-09-25 07:08:34 +03:00
Alexey Milovidov
82d57c6e47 Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-25 01:38:39 +03:00
Nikolai Kochetov
48bdabbc26 Less sleeps in integration tests. 2021-09-24 18:25:19 +03:00
alesapin
3614fb9e37
Merge pull request #29223 from ClickHouse/compressed_logs 
Compressed logs for keeper
 2021-09-24 16:03:26 +03:00
Yatsishin Ilya
e3610dec92 do not lose docker.log if dependencies failed to start before clickhouse up called 2021-09-24 13:46:55 +03:00
alexey-milovidov
b8083929a6
Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-23 20:49:40 +03:00
Yatsishin Ilya
bbac70693e Merge remote-tracking branch 'origin' into improve-integration-1 2021-09-23 17:35:06 +03:00
Yatsishin Ilya
ad4f7498ad add comment 2021-09-23 17:35:04 +03:00
alesapin
3bea8d5201 Fix config root name 2021-09-22 18:00:08 +03:00
Alexey Milovidov
04962e61ee Fix integration tests 2021-09-22 02:08:09 +03:00
Yatsishin Ilya
c1f24cdd5e ro 2021-09-21 18:31:32 +03:00
alesapin
ac7579f187 Compressed logs for keeper 2021-09-21 17:29:05 +03:00
Yatsishin Ilya
cfa513c490 Merge remote-tracking branch 'origin' into improve-integration-1 2021-09-20 10:29:31 +03:00
Alexey Milovidov
e513a5db32 Change <yandex> to <clickhouse> in configs 2021-09-20 01:38:53 +03:00
alesapin
3f11cbd31b Rename more images 2021-09-08 13:03:54 +03:00
Yatsishin Ilya
1ea2dd4564 Improve work with iptables and services listing. 2021-09-02 15:43:15 +03:00
alesapin
68f6ecec62
Merge pull request #28184 from ClickHouse/trying_to_fix_fetches_test 
Better detection of the default interface in replicated fetches tests
 2021-09-01 12:21:50 +03:00
alexey-milovidov
307ae344db
Merge pull request #27934 from azat/integration-tests-improve-check 
Improve server logs checking in integration tests
 2021-08-31 23:08:51 +03:00
alesapin
621dcfe84e Remove garbage 2021-08-31 14:36:24 +03:00
alesapin
cd389f12f6
Update network.py 2021-08-27 20:39:05 +03:00
alesapin
de96bd1be9
Update network.py 2021-08-27 10:25:28 +03:00
alesapin
1ff81b6678
Update network.py 2021-08-26 19:04:08 +03:00
alesapin
a6b4c28314
Update network.py 2021-08-26 18:27:14 +03:00
alesapin
b34c0c5bd4 Better detection of the default interface 2021-08-26 13:42:04 +03:00
kssenii
b536653851 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-24 07:29:50 +00:00
Azat Khuzhin
2785aca25d Improve server logs checking in integration tests 
Since some dtors will be called only after SIGTERM, check after server
is exited.

Also Fatal messages does not fails tests before.
 2021-08-21 23:34:36 +03:00
kssenii
945e2c4ce5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-20 18:01:23 +00:00
Yatsishin Ilya
d9e782d379 Merge remote-tracking branch 'origin' into mute-integration-debug-fails 2021-08-20 18:59:16 +03:00
Yatsishin Ilya
58c1b57259 improve tests from test_backward_compatibility 2021-08-20 18:58:43 +03:00
Yatsishin Ilya
9c22d07dea Mute current failures 2021-08-19 14:32:32 +03:00
alesapin
c819880aa7 Add test for clickhouse-keeper start after conversion 2021-08-18 16:34:57 +03:00
kssenii
073d7fdd5e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-06 19:42:29 +00:00
OmarBazaraa
6b9e0f5a6f Fix 2021-07-28 09:38:34 +00:00
OmarBazaraa
8acc290bc5 Add integration tests 2021-07-28 09:38:34 +00:00
mergify[bot]
242efdd0f1
Merge branch 'master' into jdbc-bridge-test 2021-07-27 14:28:27 +00:00
Kseniia Sumarokova
f2e599d8d1
Merge pull request #26826 from kssenii/rabbit-fix-tests 
Try fix rabbitmq tests
 2021-07-27 17:07:37 +03:00
Yatsishin Ilya
f8c7058bcf Better 2021-07-27 10:33:49 +03:00
Vitaly Baranov
72ab7f598c Fix killing unstopped containers in integration tests. 2021-07-27 09:31:04 +03:00
kssenii
1d50e9a3b9 Add retries 2021-07-27 06:16:40 +00:00
Yatsishin Ilya
d11ec777c9 Merge remote-tracking branch 'origin' into integration-6 2021-07-16 16:28:02 +03:00
Yatsishin Ilya
e6b724ad3f postgres rework 2021-07-16 16:26:35 +03:00
Zhichang Yu
5047c758f4 fix per review 2021-07-13 07:20:20 +00:00
Anton Popov
313cd0077d
Fix output of TSV in integration tests 2021-07-12 20:23:19 +03:00
Yatsishin Ilya
a4a960328e Merge remote-tracking branch 'origin' into integration-6 2021-07-12 11:34:23 +03:00
Yatsishin Ilya
143368d8d6 wip 2021-07-12 11:32:20 +03:00
Vitaly Baranov
e7b1e9a2fb
Merge pull request #25986 from vitlibar/fix-flaky-test_dictionaries_all_layouts_separate_sources-test_https 
Fix parallel execution of integration tests
 2021-07-06 09:22:06 +03:00
Vitaly Baranov
cdcc735d83
Merge pull request #25899 from vitlibar/improve-logging-in-integration-tests 
Improve logging in integration tests.
 2021-07-06 08:22:21 +03:00
Vitaly Baranov
87f59ba670 Fix parallel execution of integration tests. 2021-07-05 23:50:04 +03:00
kssenii
32b7d7b750 More correct startup on create query 2021-07-04 19:53:05 +00:00
Vitaly Baranov
618a77fafa Improve logging in integration tests. 2021-07-04 22:24:54 +03:00
Ilya Yatsishin
523155a020
Merge pull request #25908 from arenadata/ADQM-320 2021-07-02 13:25:22 +03:00
Ilya Golshtein
63c71a7b4b kerberized HDFS test fix if run in parallel 2021-07-02 02:12:31 +03:00
alexey-milovidov
919cc10a3c
Merge pull request #25823 from azat/integration-tests-fixes 
tests/integration: use iptables --wait
 2021-07-02 00:58:33 +03:00
Vitaly Baranov
92ace627d2 Correct messages in integration tests. 2021-06-30 14:16:37 +03:00
Azat Khuzhin
283ec54cbe tests/integration: use iptables --wait 
Since integration tests runs in parallel, this should fix:

  test_keeper_persistent_log_multinode/test.py::test_restart_multinode Another app is currently holding the xtables lock. Perhaps you want to use the -w option?

And similar errors.
 2021-06-29 21:07:39 +03:00
Vitaly Baranov
3a3cbeb7aa Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
alesapin
66b7df1d03
Merge pull request #25525 from ClickHouse/fix_some_tests 
Fix some bugs in integration tests
 2021-06-22 10:52:07 +03:00
Ilya Yatsishin
d6bdde54d9
Merge pull request #25212 from qoega/integration-6 
More integration tests improvements
 2021-06-22 10:19:22 +03:00
alesapin
426710f8e3 Followup fix 2021-06-21 18:53:47 +03:00
Yatsishin Ilya
e04957ce82 more 2021-06-21 18:42:40 +03:00
alesapin
8cf5f8e748 Followup fix 2021-06-21 13:30:39 +03:00
alesapin
a63da94ae4 Revert "Merge pull request #25526 from ClickHouse/revert-25459-add_run_id_option" 
This reverts commit 7c7e96f26c, reversing
changes made to a54cbef5b7.
 2021-06-21 11:14:26 +03:00
alesapin
da0a3997f4 Merge branch 'master' into fix_some_tests 2021-06-21 11:14:22 +03:00
alesapin
feecf398fb
Revert "Add run-id option to integration tests" 2021-06-21 11:10:44 +03:00
alesapin
c7781e24d5 Fix some flaky tests 2021-06-21 11:02:27 +03:00
alesapin
65ce3929b8
Merge pull request #25459 from ClickHouse/add_run_id_option 
Add run-id option to integration tests
 2021-06-21 10:21:24 +03:00
alesapin
49cd16e74f Better 2021-06-18 22:08:12 +03:00
kssenii
f33387837e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-06-18 14:27:48 +00:00
alesapin
8a5bc2e7bc Add run-id option to integration tests 2021-06-18 12:23:22 +03:00
Yatsishin Ilya
f4d587a17a hardening 2021-06-16 15:31:19 +03:00
Nikolai Kochetov
ca66f655c8 Use signal 15 2021-06-16 14:15:08 +03:00
kssenii
2cfcc9980c Better 2021-06-13 19:38:31 +00:00
kssenii
603c06d02e Add test 2021-06-13 19:38:17 +00:00
alexey-milovidov
30f0124e77
Merge branch 'master' into always-detach-parts-with-wrong-partition-id 2021-06-12 02:55:55 +03:00
alexey-milovidov
f96b512ffb
Merge pull request #24728 from qoega/remove-enable-dictionaries 
Remove explicit enable_dictionaries files in integration tests
 2021-06-12 02:45:25 +03:00
alexey-milovidov
cad5cfacf1
Merge pull request #25047 from zhicwu/jdbc-bridge-sit 
Add integration test for jdbc bridge
 2021-06-11 23:07:43 +03:00
Yatsishin Ilya
cbbeb4001b more changes 2021-06-11 15:00:40 +03:00