Commit Graph

317 Commits

Author SHA1 Message Date
Alexander Tokmakov
94d32c6b80 Merge branch 'master' into merging_30325 2022-03-23 11:58:57 +01:00
Mikhail f. Shiryaev
e6f5a3f98b
Apply black formatter to all *.py files in the repo 2022-03-22 17:39:58 +01:00
Alexander Tokmakov
bc5a689899 add debug logging 2022-03-22 15:34:20 +01:00
Alexander Tokmakov
d0217a0025 make tests more compact 2022-03-21 14:22:15 +01:00
Alexey Milovidov
0ce4696c49
Revert "[WIP] New row policies" 2022-03-21 08:41:33 +03:00
Vitaly Baranov
afe6a1003a Add new row policy kind: simple 2022-03-20 17:34:59 +01:00
mergify[bot]
4ffc3bb589
Merge branch 'master' into fix-mongo2-compose 2022-01-14 18:36:37 +00:00
Yatsishin Ilya
2fe8f6c60b Fix ports allocated for mongo2 that is w/o creds 2022-01-14 13:00:38 +00:00
taiyang-li
66813a3aa9 merge master 2022-01-12 16:56:29 +08:00
alesapin
7a3c874651 Merge branch 'master' into ianton-ru-MDB-15474 2021-12-29 19:01:43 +03:00
taiyang-li
aa97634d9b merge master 2021-12-28 18:38:50 +08:00
alesapin
90db762c87
Merge pull request #33215 from ClickHouse/fix_flaky_integration_tests
Fix some flaky integration tests
2021-12-28 11:27:46 +03:00
Vitaly Baranov
f80a3e3247
Merge pull request #30549 from aiven/kmichel-server-reload
Start/stop servers when `listen_host`/`*_port` changes
2021-12-27 14:51:00 +03:00
alesapin
593dc6cf90 Fix some flaky integration tests 2021-12-27 12:24:19 +03:00
taiyang-li
9036b18c2f merge master 2021-12-27 15:12:48 +08:00
Kevin Michel
ffc1fca296
Start/stop servers when listen_host/*_port changes
This allows starting and stopping separately each protocol server
without restarting ClickHouse.

This also allows adding or removing `listen_host` entries, which
start and stops servers for all enabled ports.

When stopping a server, the listening socket is immediately closed
(and available for another server).

Protocols with persistent connections try to wait for any currently
running query to finish before closing the connection, but idle
connection are closed quickly (depending on how often the protocol
is polled).

An extra ProfileEvent is added, `MainConfigLoads`, it is
incremented every time the configuration is reloaded. This helps
when trying to assess whether the new configuration was applied.
2021-12-24 08:26:02 +01:00
ianton-ru
e6fd4bfb50
Merge branch 'master' into MDB-15474 2021-12-21 17:38:36 +03:00
Anton Ivashkin
0c0bf66334 Merge master 2021-12-21 17:27:54 +03:00
Haavard Kvaalen
9a2b0680a1 Fix weird permission on log directories
Several log directories for integration tests were created with full
permissions for "others" but no permission for the owner of the
directory.  This caused issues when trying to run integration tests
again without manually wiping files from previous runs.  The test would
fail with "PermissionError: [Errno 13] Permission denied: 'logs'".

The intention may have been to do the equivalent of 'chmod o+rwx logs',
but it instead did the equivalent of 'chmod 007 logs'.
2021-12-21 11:50:54 +01:00
taiyang-li
d033fc4c24 merge master and fix conflict 2021-12-17 15:11:21 +08:00
alexey-milovidov
4adf3b0285
Merge pull request #32740 from azat/integration-tests-fix-mysql-wait
tests/integration: fix waiting of mysql client container
2021-12-14 23:23:50 +03:00
lgbo-ustc
248e933fc4 Add test for local cache 2021-12-14 16:06:30 +08:00
Azat Khuzhin
ae122e430a tests/integration: fix waiting of mysql client container
healthy means that everything is OK and no need to wait.

And before it works only because mysql container was too slow to start
and wait_mysql_client_to_start() returns only when the status was
unhealthy/starting, which was obviously wrong.

Fixes: #20393 (cc @qoega)
2021-12-14 10:04:30 +03:00
Azat Khuzhin
1a134f5fc0 tests/integration: fix printing all available services in wait_mysql_client_to_start()
There is no docker-compose.yml in that place, since mysql client has
different name:

    2021-12-14 04:03:02 [ 862 ] DEBUG : Command:['docker-compose', 'ps', '--services', '--all'] (cluster.py:63, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr: (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        Can't find a suitable configuration file in this directory or any (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        parent. Are you in the right directory? (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr: (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        Supported filenames: docker-compose.yml, docker-compose.yaml (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:         (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Exitcode:1 (cluster.py:73, run_and_check)
2021-12-14 10:00:20 +03:00
Azat Khuzhin
01a57af774 tests/integration: fix wait_start()/start_clickhouse()
Execute query at least once, otherwise it may incorrectly detect that
the server is "alive".

Fixes: test_keeper_incorrect_config/test.py::test_duplicate_endpoint
CI: https://s3.amazonaws.com/clickhouse-test-reports/32536/559b01a2e43d09571195fb1cc08d83133f559203/integration_tests__asan__actions__[1/3].html
2021-12-14 09:45:46 +03:00
taiyang-li
f1535c7226 fix conflict 2021-12-14 10:41:51 +08:00
taiyang-li
8234d1176f merge master 2021-12-14 10:39:21 +08:00
Kseniia Sumarokova
78ed383f15
Merge pull request #31505 from ContentSquare/azure_blob_storage_dependency
Azure Blob Storage Disks
2021-12-13 18:28:48 +03:00
李扬
8675086104
Merge branch 'master' into hive_table 2021-12-12 09:01:46 -06:00
Jakub Kuklis
7351325f13 Simple check for files in cloud 2021-12-10 22:04:38 +01:00
Jakub Kuklis
e58f74d8dc Connecting to Azurite and invoking simple INSERTs works in the integration test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
8afe69ff93 Comming back to StorageSharedKeyCredential for the integration test, get 400 Bad requests from Azurite when trying to create a container now 2021-12-10 22:04:38 +01:00
Jakub Kuklis
abd685e14c Installing azure-storage-blob in the integration tests docker, raising exception when not connected to Azurite, changing ports in the Azurite docker 2021-12-10 22:04:38 +01:00
Jakub Kuklis
639d8a2b38 Running Azurite docker in the integration test for Blob Storage support 2021-12-10 22:04:37 +01:00
kssenii
f5a77fca39 Done 2021-12-09 14:44:25 +00:00
Anton Ivashkin
e0a16a483e Merge master 2021-12-01 19:03:31 +03:00
Anton Ivashkin
d409ab0605 Fix wait for freeze in tests 2021-11-29 19:17:26 +03:00
lgbo
996d7125c0
Merge branch 'master' into hive_table 2021-11-23 10:19:02 +08:00
alesapin
ef6079633d
Merge pull request #31605 from vitlibar/fix-cleanup-in-integration-tests
Fix cleanup in integration tests
2021-11-22 17:58:47 +03:00
Vitaly Baranov
6f5f72738b Fix cleanup in integration tests. 2021-11-22 12:05:52 +03:00
taiyang-li
e8644807fe merge master and solve conflict 2021-11-19 15:01:58 +08:00
lgbo-ustc
858f615463 fixed bugs in integration tests about hive query 2021-11-19 09:58:34 +08:00
Anton Ivashkin
827fa511e8 Add test for freeze/unfreeze with S3 zero-copy 2021-11-18 21:14:46 +03:00
Stig Bakken
ff46e8bb51 Drop support for DatabaseOrdinary in MaterializedMySQL
1. Dropped support for DatabaseOrdinary for MaterializeMySQL. It
   is marked as experimental, and dropping support makes the code
   more maintaible, and speeds up integration tests by 50%.

2. Get rid of thread name logic for StorageMaterializeMySQL wrapping,
   use setInternalQuery instead (similar to MaterializedPostgreSQL).
2021-11-18 11:46:51 +01:00
lgbo-ustc
9902ccefc5 Add integration tests for hive query 2021-11-18 16:17:49 +08:00
Yatsishin Ilya
9345b93486 fix killall. better test_different_user 2021-11-11 16:28:29 +03:00
Yatsishin Ilya
14c14dcd00 Merge remote-tracking branch 'origin' into integration--7 2021-11-11 10:41:50 +03:00
Yatsishin Ilya
b7c6a7bf8e wip 2021-11-11 10:41:48 +03:00
Vitaly Baranov
508fb6f54f Use external dirs in the integration test to make test not flaky. 2021-11-10 11:03:09 +03:00
Yatsishin Ilya
ce205fb10a Merge remote-tracking branch 'origin' into integration--7 2021-11-01 11:17:33 +03:00