Commit Graph

3427 Commits

Author SHA1 Message Date
mergify[bot]
3a7179756f
Merge branch 'master' into fix-32668 2021-12-15 08:31:10 +00:00
alexey-milovidov
4adf3b0285
Merge pull request #32740 from azat/integration-tests-fix-mysql-wait
tests/integration: fix waiting of mysql client container
2021-12-14 23:23:50 +03:00
tavplubix
2cf5456423
Merge pull request #32511 from ClickHouse/fix_attaching_gdb2
Try to fix attaching gdb 2
2021-12-14 21:10:00 +03:00
kssenii
47f549166d Table Override for PostgreSQL 2021-12-14 20:36:43 +03:00
Anton Popov
16312e7e4a Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-14 18:58:17 +03:00
Nikolai Kochetov
d394f0e753 Allpy some more optimizations to NO_QUERY ast. 2021-12-14 17:19:18 +03:00
alesapin
0d7bbc399b
Merge pull request #32739 from azat/integration-tests-fix-ch-wait
tests/integration: fix wait_start()/start_clickhouse()
2021-12-14 13:49:15 +03:00
alesapin
a02da27c6f
Merge pull request #32694 from ClickHouse/add-test_s3_zero_copy_concurrent_merge
Add test_s3_zero_copy_concurrent_merge
2021-12-14 12:49:21 +03:00
Azat Khuzhin
ae122e430a tests/integration: fix waiting of mysql client container
healthy means that everything is OK and no need to wait.

And before it works only because mysql container was too slow to start
and wait_mysql_client_to_start() returns only when the status was
unhealthy/starting, which was obviously wrong.

Fixes: #20393 (cc @qoega)
2021-12-14 10:04:30 +03:00
Azat Khuzhin
1a134f5fc0 tests/integration: fix printing all available services in wait_mysql_client_to_start()
There is no docker-compose.yml in that place, since mysql client has
different name:

    2021-12-14 04:03:02 [ 862 ] DEBUG : Command:['docker-compose', 'ps', '--services', '--all'] (cluster.py:63, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr: (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        Can't find a suitable configuration file in this directory or any (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        parent. Are you in the right directory? (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr: (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        Supported filenames: docker-compose.yml, docker-compose.yaml (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:         (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Exitcode:1 (cluster.py:73, run_and_check)
2021-12-14 10:00:20 +03:00
Azat Khuzhin
01a57af774 tests/integration: fix wait_start()/start_clickhouse()
Execute query at least once, otherwise it may incorrectly detect that
the server is "alive".

Fixes: test_keeper_incorrect_config/test.py::test_duplicate_endpoint
CI: https://s3.amazonaws.com/clickhouse-test-reports/32536/559b01a2e43d09571195fb1cc08d83133f559203/integration_tests__asan__actions__[1/3].html
2021-12-14 09:45:46 +03:00
mergify[bot]
2b181d7107
Merge branch 'master' into mongo-extend-auth-2 2021-12-13 22:21:10 +00:00
Kseniia Sumarokova
a9ca84ff7d
Merge pull request #32325 from stigsb/table-overrides
Add TABLE OVERRIDE feature for MaterializedMySQL databases
2021-12-13 20:39:42 +03:00
kssenii
ddbeadd104 Done 2021-12-13 16:09:18 +00:00
Kseniia Sumarokova
78ed383f15
Merge pull request #31505 from ContentSquare/azure_blob_storage_dependency
Azure Blob Storage Disks
2021-12-13 18:28:48 +03:00
Nikolai Kochetov
31f8ff4e9c Add test_s3_zero_copy_concurrent_merge 2021-12-13 16:34:04 +03:00
Jakub Kuklis
77f339caaf Cache test as the first test in the file 2021-12-13 13:41:17 +01:00
Jakub Kuklis
38e35a0ef5 Removing any extra work and correcting the cache path in the cache test 2021-12-13 10:52:02 +01:00
kssenii
a8484ec06d Add test 2021-12-12 00:47:21 +03:00
mergify[bot]
1e28f7340e
Merge branch 'master' into kafka_protobuf_issue26643 2021-12-11 08:05:20 +00:00
Kseniia Sumarokova
7e0bc290da
Merge pull request #32460 from kssenii/mongo-extend-auth
Allow empty credentials for mongo engine
2021-12-11 10:42:15 +03:00
Jakub Kuklis
60e06ca34c Changing order of tests to check if that affects failing tests in the CI/CD 2021-12-10 22:04:38 +01:00
Jakub Kuklis
578aec97e9 Removing TODO and NOTE marks used mainly as hooks for review in the PR 2021-12-10 22:04:38 +01:00
Jakub Kuklis
69900ba417 Zero replication support test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
b5db3a307f Cache test, removing spurious imports 2021-12-10 22:04:38 +01:00
Jakub Kuklis
7351325f13 Simple check for files in cloud 2021-12-10 22:04:38 +01:00
Jakub Kuklis
312e5b8c45 Abstracting utility functions from main integration tests for remote disks 2021-12-10 22:04:38 +01:00
Jakub Kuklis
1d5c69b366 Minor tweaks to the test, disabling another slow one 2021-12-10 22:04:38 +01:00
Jakub Kuklis
312ea92989 More integration tests, all pass, at least usually 2021-12-10 22:04:38 +01:00
Jakub Kuklis
afc64c14ce Merging test works correctly 2021-12-10 22:04:38 +01:00
Jakub Kuklis
6dca10e1c5 First integration tests, the one for merging fails for the moment 2021-12-10 22:04:38 +01:00
Jakub Kuklis
e58f74d8dc Connecting to Azurite and invoking simple INSERTs works in the integration test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
8afe69ff93 Comming back to StorageSharedKeyCredential for the integration test, get 400 Bad requests from Azurite when trying to create a container now 2021-12-10 22:04:38 +01:00
Jakub Kuklis
f180a7ba5f Solved Invalid storage account error with connection strings 2021-12-10 22:04:38 +01:00
Jakub Kuklis
abd685e14c Installing azure-storage-blob in the integration tests docker, raising exception when not connected to Azurite, changing ports in the Azurite docker 2021-12-10 22:04:38 +01:00
Jakub Kuklis
008141de36 Enable authentication via StorageSharedKeyCredential 2021-12-10 22:04:38 +01:00
Jakub Kuklis
d51f979c7a Adding endpoint validation 2021-12-10 22:04:38 +01:00
Jakub Kuklis
910db6ca57 Code cleanup addressing PR remarks 2021-12-10 22:04:38 +01:00
Jakub Kuklis
639d8a2b38 Running Azurite docker in the integration test for Blob Storage support 2021-12-10 22:04:37 +01:00
Jakub Kuklis
5ed511f9da Working skeleton for Blob Storage integration test 2021-12-10 22:04:37 +01:00
Jakub Kuklis
24bafe4740 Starting an integration test for Blob Storage 2021-12-10 22:04:37 +01:00
Vitaly Baranov
b5b195f4e2
Merge branch 'master' into kafka_protobuf_issue26643 2021-12-10 23:22:35 +03:00
Alexander Tokmakov
dfa31a6577 fix 2021-12-10 22:38:34 +03:00
alesapin
a6e55b00e3
Revert "Revert "Split long tests into multiple checks"" 2021-12-10 18:39:02 +03:00
alesapin
dcbba460c1
Revert "Split long tests into multiple checks" 2021-12-10 18:38:42 +03:00
alesapin
a2aa0bc6cc
Merge pull request #32496 from ClickHouse/smaller_checks
Split long tests into multiple checks
2021-12-10 17:42:14 +03:00
vdimir
a0488d21d2
Fix test_prometheus_endpoint 2021-12-10 14:58:46 +03:00
alesapin
2c7bb56a2c Split integration tests into parts 2021-12-10 13:22:29 +03:00
kssenii
f5a77fca39 Done 2021-12-09 14:44:25 +00:00
Anton Popov
d8367334a3 Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-08 18:26:19 +03:00
Mikhail f. Shiryaev
03927f5fc6
Revert "graphite: split tagged/plain rollup rules (for merges perfomance)"
This reverts commit 303552f515.
2021-12-08 15:49:21 +01:00
tavplubix
4f46ac6b30
Remove LeaderElection (#32140)
* remove LeaderElection

* try fix tests

* Update test.py

* Update test.py
2021-12-07 19:55:55 +03:00
Mikhail f. Shiryaev
5fc20b3e6a
Merge pull request #25122 from msaf1980/rollup_rules_type
GraphiteMergeTree Rollup rules type
2021-12-07 10:18:08 +01:00
Stig Bakken
bb521cd363 Add TABLE OVERRIDE feature for MaterializedMySQL databases 2021-12-07 09:45:02 +01:00
Kseniia Sumarokova
7e261245d3
Merge pull request #32256 from taiyang-li/default_for_hdfs
Support default expression for storage hdfs and optimize fetching when source is column oriented
2021-12-06 23:32:01 +03:00
msaf1980
303552f515
graphite: split tagged/plain rollup rules (for merges perfomance) 2021-12-06 16:49:08 +01:00
Alexander Tokmakov
7797a72907 fix false-positive ciclyc dependency with XML dict 2021-12-06 16:35:43 +03:00
mergify[bot]
52904a4973
Merge branch 'master' into default_for_hdfs 2021-12-06 13:19:49 +00:00
Vladimir C
c502454088
Merge pull request #32185 from kitaisreal/range-hashed-dictionary-added-update-field-support 2021-12-06 10:57:47 +03:00
Maksim Kita
b9718b8450
Merge pull request #32118 from kitaisreal/fix-test-executable-storage-input
Fix flacky test test_executable_storage_input
2021-12-06 10:39:30 +03:00
taiyang-li
9d1e63be0f 1. support default expression for storage hdfs; 2. optimize storage hdfs when format is column oriented 2021-12-06 11:54:45 +08:00
Maksim Kita
4bbb02bbae RangeHashedDictionary added update_field support 2021-12-03 14:06:58 +03:00
Kruglov Pavel
17d6f539b3
Merge pull request #32019 from azat/dist-desc
Fix excessive DESC TABLE for remote() over identifier
2021-12-03 12:15:05 +03:00
mergify[bot]
51b8148cc0
Merge branch 'master' into fix-test-executable-storage-input 2021-12-03 09:11:05 +00:00
Kseniia Sumarokova
a8dcbc988a
Merge pull request #32129 from kssenii/fix-postgres-tests
fixing postgres tests
2021-12-03 09:15:20 +03:00
Anton Popov
f6be3d16fd
Merge pull request #24820 from kssenii/versioning
Versioning of aggregate function states
2021-12-03 01:41:44 +03:00
kssenii
06312a2df9 Fix 2021-12-02 22:48:21 +03:00
alesapin
45021bd35c
Merge pull request #32121 from ClickHouse/add_assertion_in_keeper
Add check for duplicate hostnames and IDs in KeeperConfig
2021-12-02 22:24:46 +03:00
tavplubix
4d96d6ab77
Merge pull request #32052 from stigsb/fix-flaky-create-table-like-test
Fix flaky integration test for MaterializedMySQL CREATE TABLE LIKE
2021-12-02 21:28:00 +03:00
kssenii
64fcbe347e Update 2021-12-02 16:08:11 +03:00
alesapin
b8bffcb14c
Merge pull request #32115 from ClickHouse/fix_flaky_keeper_tests
Fix flaky keeper whitelist test
2021-12-02 15:41:17 +03:00
alesapin
437591f2fa Add check for duplicate hostnames and IDs in KeeperConfig 2021-12-02 14:46:33 +03:00
tavplubix
5400c5899d
Merge pull request #32063 from ClickHouse/fix_detach_dir_exists
Fix 'directory exists' error when detaching part
2021-12-02 14:04:21 +03:00
alesapin
ff6cc14df3 Fix one more test 2021-12-02 13:41:04 +03:00
Maksim Kita
492f9c3936 Fix flacky test test_executable_storage_input 2021-12-02 13:11:21 +03:00
alesapin
e704140d07 Fix flaky whitelist test 2021-12-02 12:37:08 +03:00
kssenii
8edf146687 Merge branch 'master' of github.com:ClickHouse/ClickHouse into versioning 2021-12-02 07:57:14 +00:00
Azat Khuzhin
b6290ae002 Update test_distributed_respect_user_timeouts after superfluous DESC had been removed 2021-12-01 22:52:20 +03:00
Kseniia Sumarokova
87574e8bf6
Merge pull request #31053 from kssenii/rabbit-kafka-select-commit
rabbitmq/kafka allow to commit on select only under setting
2021-12-01 18:23:08 +03:00
mergify[bot]
959fb1f4dd
Merge branch 'master' into fix-flaky-create-table-like-test 2021-12-01 15:17:28 +00:00
Alexander Tokmakov
57e4f3698c fix 'directory exists' error when detaching part 2021-12-01 17:24:26 +03:00
Anton Popov
54f51444c0 Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-01 15:49:02 +03:00
Stig Bakken
f7578e7b9d Fix flaky test for MaterializedMySQL CREATE TABLE LIKE 2021-12-01 13:40:22 +01:00
tavplubix
b623a387af
Merge pull request #31887 from ClickHouse/fix_cannot_create_empty_part
Parse partition key value from `partition_id` when need to create part in empty partition
2021-12-01 15:38:46 +03:00
alexey-milovidov
6020188cc0
Merge pull request #31781 from havardk/tabletable
MaterializedMySQL: Fix issue with table named 'table'
2021-12-01 10:34:59 +03:00
kssenii
71bfc72e37 Fix 2021-11-30 14:42:37 +00:00
kssenii
28be1b12ad Avoid tests failing with oom 2021-11-30 15:26:57 +03:00
Alexander Tokmakov
231b906fe4 fix test 2021-11-30 13:22:37 +03:00
kssenii
69aa2da23e Update test 2021-11-30 09:56:10 +00:00
kssenii
0e24eebc80 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql-fix 2021-11-30 12:26:10 +03:00
alesapin
438fa60902
Merge pull request #21326 from excitoon-favorites/flexiblemutations2
Skip mutations of unrelated partitions in `StorageMergeTree`
2021-11-30 12:15:29 +03:00
alesapin
ad4e6a1ebd
Merge pull request #31950 from ClickHouse/fix_integration_tests
Kill container in integration tests if it's already running
2021-11-30 10:17:19 +03:00
Kseniia Sumarokova
edf1ec776a
Merge pull request #31824 from azat/system-log-tables-recreate-different-engine
Recreate system.*_log tables in case of different engine/partition_by
2021-11-29 22:56:36 +03:00
kssenii
2ea4e7c4e7 Better 2021-11-29 15:05:02 +00:00
alesapin
0ac088367a Kill container in integration tests if it's already running 2021-11-29 16:38:12 +03:00
alesapin
525011db81
Merge pull request #31799 from ClickHouse/fix_default_keeper_port
Fix default keeper port
2021-11-29 16:31:36 +03:00
kssenii
2f0fe4a21f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbit-kafka-select-commit 2021-11-29 10:08:14 +00:00
kssenii
be3b4ca8fe Merge branch 'master' of github.com:ClickHouse/ClickHouse into versioning 2021-11-27 09:44:31 +00:00
kssenii
515261f5dd Better 2021-11-27 09:40:46 +00:00
Azat Khuzhin
5fafeea763 Recreate system.*_log tables in case of different engine/partition_by.
- Mark getCreateTableQuery() non virtual to call it from ctor
- Make check for CREATE TABLE simpler (by caching result)
- Extend error message.

v2: at SystemLog tables has not been initialized yet, so SHOW CREATE
cannot be obtained for the existing table, move the check to the
prepareTable() call.
v3: reset UUID and SETTINGS of MergeTree in CREATE TABLE query
v4: fix re-creating table with the same UUID
2021-11-26 10:05:20 +03:00