Commit Graph

4617 Commits

Author SHA1 Message Date
Vladimir Chebotarev
30bdc7e98f Better style. 2022-07-11 10:41:19 +03:00
Vladimir Chebotarev
9ca8c035f2 Added test for missing DeleteObjects request. 2022-07-11 10:22:06 +03:00
Vitaly Baranov
6fce17584c
Merge pull request #39046 from vitlibar/restore-on-cluster-async-on-replicas
BACKUP/RESTORE ON CLUSTER use async mode on replicas now.
2022-07-10 15:54:51 +02:00
Vladimir Chebotaryov
9e94346e07
More stable test_s3_zero_copy_ttl, weakened requirement to move data to S3 in 0-5 seconds. 2022-07-09 20:51:05 +03:00
Vitaly Baranov
847cda87f9 BACKUP/RESTORE ON CLUSTER use async mode on replicas now. 2022-07-08 22:26:01 +02:00
Alexander Tokmakov
dbc638a49d
Update test.py 2022-07-08 14:23:33 +03:00
Kseniia Sumarokova
48220f64d6
Merge pull request #38214 from bigo-sg/storagehive_alter
support alter on `StorageHive` table
2022-07-07 17:06:43 +02:00
Vitaly Baranov
ed27987646
Merge pull request #38861 from vitlibar/backup-improvements-9
Backup Improvements 9
2022-07-07 02:24:47 +02:00
Kseniia Sumarokova
a26643a7a6
Merge pull request #38363 from kssenii/pg-add-auto-close
Support `auto_close` option for postgres engine connection
2022-07-06 01:10:05 +02:00
Kseniia Sumarokova
3e803006a2
Merge pull request #37171 from tchepavel/nats-integration
Nats Integration
2022-07-05 17:47:02 +02:00
Yakov Olkhovskiy
356786f0c6
Merge pull request #38837 from bharatnc/ncb/fix-docs
update integration tests doc
2022-07-05 09:27:09 -04:00
Vitaly Baranov
43d35eec1b Write unfinished mutations to backup. 2022-07-05 14:51:09 +02:00
kssenii
e56ffd665f Fix test 2022-07-05 12:01:19 +02:00
Kseniia Sumarokova
b3fd8e3bd6
Merge pull request #38802 from kssenii/fix-s3-seekable-with-parallel
Fix s3 seekable reads with parallel read buffer
2022-07-05 11:23:16 +02:00
Bharat Nallan Chakravarthy
51923e4399 update integration tests doc 2022-07-05 09:27:08 +05:30
Kseniia Sumarokova
6c3d648f49
Merge branch 'master' into nats-integration 2022-07-04 21:06:07 +02:00
Kseniia Sumarokova
b8ab20bcb3
Update test.py 2022-07-04 20:56:34 +02:00
Kseniia Sumarokova
0cd228cab3
Merge pull request #38365 from kssenii/better-rabbit-adddress-setting
Fix RabbitMQ configuration via connection string setting
2022-07-04 20:53:43 +02:00
Kseniia Sumarokova
707142e939
Update test.py 2022-07-04 16:08:10 +02:00
kssenii
f5bf744028 Fix 2022-07-04 16:05:08 +02:00
kssenii
2c4c907e10 Merge 2022-07-04 14:15:31 +02:00
kssenii
cfff7c4c28 Merge master 2022-07-04 14:13:26 +02:00
kssenii
6b37ce2f8e Drop tables in test 2022-07-04 14:06:20 +02:00
Ilya Yatsishin
703c3f1938
Merge pull request #38582 from qoega/integration-postgres-better 2022-07-04 13:00:54 +02:00
Ilya Yatsishin
0e4c65a378
Update tests/integration/test_postgresql_database_engine/test.py
Co-authored-by: alesapin <alesapin@gmail.com>
2022-07-04 12:57:55 +02:00
alesapin
be9015852a
Merge pull request #38656 from ClickHouse/some_changes_in_keeper
Add test for keeper `mntr` command
2022-07-04 11:00:18 +02:00
lgbo-ustc
932e596689 Merge remote-tracking branch 'ck/master' into storagehive_alter 2022-07-04 09:56:00 +08:00
mergify[bot]
dfac2ca2fc
Merge branch 'master' into fix-crash-when-grant-all-on-cluster 2022-07-02 17:38:45 +00:00
alesapin
b2db49dbf1
Merge branch 'master' into better_data_part_storage_builder 2022-07-02 15:39:44 +02:00
Alexey Milovidov
c2486f3637
Merge pull request #38355 from ClibMouse/add-tlsv1_3-test
Adding TLS V13 Test
2022-07-02 01:32:51 +03:00
kssenii
6a464c0a24 Merge 2022-07-01 19:12:44 +02:00
kssenii
831d2253ce Merge master 2022-07-01 18:53:20 +02:00
alesapin
7c53c8bd2c Black 2022-07-01 16:10:06 +02:00
alesapin
919baf331e Review fixes 2022-07-01 15:57:24 +02:00
Vitaly Baranov
ae2f586170 Fix crash when granting ALL on cluster. 2022-07-01 12:19:56 +02:00
Vitaly Baranov
cadb496894
Merge pull request #38537 from vitlibar/backup-improvements-8
Backup Improvements 8
2022-07-01 11:20:46 +02:00
alesapin
0888d6bdb5 Black 2022-07-01 00:43:30 +02:00
alesapin
66705eacb0 Add test for keeper mntr command 2022-07-01 00:07:22 +02:00
alesapin
eb5046ab26 Simplify everything 2022-06-30 22:51:27 +02:00
Mikhail f. Shiryaev
5c5f05dd4b
Clean out randomized integration volumes each run 2022-06-30 17:38:10 +02:00
Vitaly Baranov
e367d96964 Fix style. 2022-06-30 15:10:33 +02:00
alesapin
be213c0be7
Merge pull request #38590 from ClickHouse/proper_fix
Proper fix for ipv4/ipv6 conversion error
2022-06-30 11:15:01 +02:00
Antonio Andelic
de264117fd
Merge pull request #38118 from bigo-sg/storagehive_struct_type
Add struct type support in `StorageHive`
2022-06-30 09:11:13 +02:00
Vitaly Baranov
031ca28fdc Add test for partition clause. More checks for data compatibility on restore. 2022-06-30 08:37:18 +02:00
Vitaly Baranov
11b51d2878 Implement storing UDF in backups. 2022-06-30 08:37:17 +02:00
Vitaly Baranov
efbee5e723 Improve gathering metadata for backup - part 7. 2022-06-30 08:37:17 +02:00
Vitaly Baranov
7689e0c36f Improve gathering metadata for backup - part 6. 2022-06-30 08:37:17 +02:00
Vitaly Baranov
64b51a3772 Improve gathering metadata for backup. 2022-06-30 08:37:17 +02:00
Vitaly Baranov
47ac47350b Store projections in backups. 2022-06-30 08:37:17 +02:00
alesapin
8f5582f95e Review and style fixes 2022-06-29 20:29:50 +02:00
alesapin
9b387a57ed Test ipv6 as well 2022-06-29 17:56:59 +02:00
Yatsishin Ilya
1ef92b4c27 fix black again 2022-06-29 15:56:29 +00:00
alesapin
62e7a89f26 Proper fix for ipv4/ipv6 conversion error 2022-06-29 17:53:08 +02:00
Yatsishin Ilya
f4691b0b00 fix black 2022-06-29 15:08:24 +00:00
Yatsishin Ilya
6f6e814542 Fix test_dictionaries_postgresql 2022-06-29 14:18:12 +00:00
Yatsishin Ilya
c86c6cc2d9 Improve postgres tests. Fix flaky test_postgresql_database_engine 2022-06-29 12:54:45 +00:00
Alexander Tokmakov
8246e55002
Merge pull request #38486 from azat/fix-parts-removal
Fix parts removal after incorrect server shutdown
2022-06-29 14:17:59 +03:00
Kruglov Pavel
b9813bcdea
Merge pull request #38356 from kssenii/fix-rabbitmq-with-peekable
Fix RabbitMQ with formats based on PeekableReadBuffer
2022-06-29 13:06:10 +02:00
Kseniia Sumarokova
71e9363baf
Fix black 2022-06-29 07:32:27 +02:00
lgbo-ustc
ee30c4a3f7 update test scripts 2022-06-29 10:23:00 +08:00
lgbo-ustc
7274169c33 update test scripts 2022-06-29 10:03:10 +08:00
mergify[bot]
4a1fefb42d
Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:49:52 +00:00
Alexander Tokmakov
e23f1fa774
Merge pull request #38269 from excitoon-favorites/integrationtestsfixes
Don't try to kill empty list of containers in `integration/runner` II
2022-06-28 17:35:48 +03:00
Alexander Tokmakov
428628238f Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:40:33 +02:00
Alexander Tokmakov
2f45a6ebaa
Update test.py 2022-06-28 15:18:30 +03:00
Alexander Tokmakov
07cecd4e66
Merge pull request #38516 from ClickHouse/fix_flaky_store_cleanup
Try to fix flaky test
2022-06-28 14:56:54 +03:00
kssenii
4c99f608b3 Fix 2022-06-28 13:18:21 +02:00
Alexander Tokmakov
0c51bd9c23 fix flaky test 2022-06-28 12:38:36 +02:00
larryluogit
3e48c1d765
Merge branch 'ClickHouse:master' into add-tlsv1_3-test 2022-06-27 22:40:43 -04:00
Alexander Tokmakov
851534c9f7 Merge branch 'master' into deprecate_ordinary_database 2022-06-27 23:47:49 +02:00
Azat Khuzhin
e70cff2cea Fix parts removal after incorrect server shutdown
Before this patch, and after transaction support had been added #24258,
if the server had not removed old parts on shutdown, then they will left
forever.

Fixes: #24258 (cc @tavplubix)
v2: use Tx::PrehistoricTID over removePartsFromWorkingSet() from ctor
v3: apply black to new test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-27 23:56:25 +03:00
Vladimir Chebotarev
89dc2844db Fix for integration tests fix. 2022-06-27 23:13:40 +03:00
Yakov Olkhovskiy
d5f65ece9b
Merge pull request #38105 from arenadata/ADQM-419
Add kerberosInit function as a replacement for kinit executable calls in Kafka and HDFS
2022-06-27 14:19:24 -04:00
Alexander Tokmakov
fe1b1aa77b fix my favorite check 2022-06-27 16:16:06 +02:00
Alexander Tokmakov
88dbbcb15d fix tests 2022-06-27 16:10:00 +02:00
Kseniia Sumarokova
d1243c1e01
Update test.py 2022-06-27 15:35:35 +02:00
Alexander Tokmakov
7c37079a96 Merge branch 'master' into deprecate_ordinary_database 2022-06-27 14:46:59 +02:00
Alexander Tokmakov
c4d815c60b
Update test.py 2022-06-27 15:44:20 +03:00
kssenii
2c5aeaaa1a Add auto close for postgres connection 2022-06-27 13:46:52 +02:00
lgbo-ustc
44b68dd651 update test case 2022-06-27 16:23:04 +08:00
Vladimir Chebotarev
2b19e69930 Don't try to kill empty list of containers in integration/runner. 2022-06-27 06:12:10 +03:00
lgbo-ustc
a3cb066eff update test case 2022-06-27 09:38:12 +08:00
larryluogit
b32cf5da4a
Merge branch 'ClickHouse:master' into add-tlsv1_3-test 2022-06-26 10:21:21 -04:00
Larry Luo
8dd6f09cf1 fix style check error 2022-06-26 07:19:22 -07:00
mergify[bot]
f63c959679
Merge branch 'master' into cleanup_garbage_in_store_dir 2022-06-26 13:35:10 +00:00
Mikhail f. Shiryaev
1d661d0bad
Merge pull request #38343 from ClickHouse/integration-tests-proxy
Upload logs for getting all tests command
2022-06-25 14:08:45 +02:00
Kseniia Sumarokova
901e8cfc6c
Update test.py 2022-06-25 11:24:11 +02:00
Kseniia Sumarokova
0d626982ee
Merge pull request #38369 from kssenii/fix-pg-compatibility
Fix postgres database engine possible incompatibility on upgrade
2022-06-25 11:18:46 +02:00
Kseniia Sumarokova
3c70e07fe9
Merge pull request #38366 from kssenii/fix-pg-ndim-with-schema
Fix postgres engine not using pg schema when retrieving array dimension size
2022-06-25 11:14:01 +02:00
larryluogit
a21e4117da
Merge branch 'ClickHouse:master' into add-tlsv1_3-test 2022-06-24 22:58:43 -04:00
Kseniia Sumarokova
a003d01295
Update test.py 2022-06-24 19:35:23 +02:00
Alexander Tokmakov
94dd80e900 fix tests 2022-06-24 19:10:33 +02:00
Alexander Tokmakov
31dcc7634e Merge branch 'master' into deprecate_ordinary_database 2022-06-24 18:16:07 +02:00
Alexander Tokmakov
b75828768b Merge branch 'master' into cleanup_garbage_in_store_dir 2022-06-24 15:32:42 +02:00
Alexander Gololobov
addfe5f209 Added test for list --recursive 2022-06-24 03:51:39 +02:00
kssenii
6cb1d60883 Fix 2022-06-24 03:24:54 +02:00
kssenii
a3823c67ee Fix 2022-06-24 02:44:22 +02:00
Kseniia Sumarokova
867982a9fd
Update test.py 2022-06-24 01:49:47 +02:00
Alexander Tokmakov
74f38710a8 Merge branch 'master' into cleanup_garbage_in_store_dir 2022-06-23 21:43:28 +02:00
Alexander Tokmakov
09f09bd96d apply trash-formatter 2022-06-23 21:40:05 +02:00
Alexander Tokmakov
dbf2763788 automatically convert system database to Atomic 2022-06-23 21:38:43 +02:00
Alexander Tokmakov
0d304f7b8c fix tests 2022-06-23 21:19:07 +02:00
Larry Luo
1239ee4b31 update ssl config 2022-06-23 12:11:18 -07:00
Larry Luo
191936a806 clean up comments 2022-06-23 11:50:06 -07:00
kssenii
e362e4fff1 Fix 2022-06-23 20:48:32 +02:00
Larry Luo
2339906e2a Adding TLS V13 Test 2022-06-23 11:30:00 -07:00
Mikhail f. Shiryaev
dfae6a5634
Upload logs for getting all tests command 2022-06-23 18:14:42 +02:00
Anton Popov
7efbae7728
Merge pull request #38069 from CurtizJ/better-support-gcp
Better support of GCP storage
2022-06-23 13:19:14 +02:00
Vitaly Baranov
18b4413df8
Merge pull request #38299 from vitlibar/backup-improvements-7
Backup improvements 7
2022-06-23 11:37:03 +02:00
Alexander Tokmakov
f00e6b5a7a deprecate old MergeTree syntax 2022-06-23 11:24:54 +02:00
Kseniia Sumarokova
b844c36a9d
Merge pull request #38150 from kssenii/clickhouse-disks-fixes
Some fixes for clickhouse-disks
2022-06-23 10:21:44 +02:00
Alexander Tokmakov
2c5a88faba deprecate Ordinary database 2022-06-23 10:20:14 +02:00
lgbo-ustc
c1770c22b9 Merge remote-tracking branch 'ck/master' into storagehive_struct_type 2022-06-23 15:54:20 +08:00
lgbo-ustc
0fba75b21d Merge remote-tracking branch 'ck/master' into storagehive_alter 2022-06-23 09:38:06 +08:00
Alexander Tokmakov
1595ff5620
Merge pull request #38260 from bigo-sg/hive_test
Improve the stability for hive storage integration test
2022-06-22 21:08:23 +03:00
Vitaly Baranov
5ae8fce1ef Attach threads to thread groups better. 2022-06-22 18:51:41 +02:00
Nikita Taranov
41ba0118b5
Bring back #36396 (#38110)
* Revert "Revert "More parallel execution for queries with `FINAL` (#36396)""

This reverts commit 5bfb15262c.

* fix tests

* fix review suggestions

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-06-22 15:05:07 +02:00
alesapin
0f8eed98c4
Merge branch 'master' into better-support-gcp 2022-06-22 12:46:01 +02:00
lgbo-ustc
123d57484f fix a path error 2022-06-22 17:15:47 +08:00
lgbo-ustc
0917a60323 Merge remote-tracking branch 'origin/hive_test' into hive_test 2022-06-22 09:42:33 +08:00
lgbo-ustc
63937682da fixed code style 2022-06-22 09:39:05 +08:00
Mikhail f. Shiryaev
57eb887006
Apply black to runner script 2022-06-21 20:53:13 +02:00
Mikhail f. Shiryaev
81e1ef3053
Fix dynamic volume name for integration tests 2022-06-21 20:52:32 +02:00
kssenii
47a118beab More fixes 2022-06-21 16:40:22 +02:00
Alexander Tokmakov
ba0fcec993 add background cleanup of store/ subdirs 2022-06-21 12:35:47 +02:00
lgbo-ustc
cdd7a54995 improve stability for hive intergration test 2022-06-21 15:59:54 +08:00
lgbo-ustc
633c3c8287 update hive test 2022-06-21 15:10:48 +08:00
Vitaly Baranov
06c4082a7c
Merge pull request #37358 from vitlibar/backup-improvements-6
Backup Improvements 6
2022-06-20 14:13:30 +02:00
Kseniia Sumarokova
a756b4be27
Merge pull request #37391 from azat/insert-profile-events-fix
Send profile events for INSERT queries (previously only SELECT was supported)
2022-06-20 12:16:29 +02:00
lgbo-ustc
b78adb4492 fixed code style 2022-06-20 15:07:08 +08:00
lgbo-ustc
efec6f9ac5 support alter on storagehive 2022-06-20 14:57:33 +08:00
lgbo-ustc
c13bf03fe0 fixed code style 2022-06-20 09:56:21 +08:00
Vitaly Baranov
2c8788266c Fix tests. 2022-06-20 03:44:49 +02:00
Vitaly Baranov
8a7c970ce0 Fix style. 2022-06-19 15:58:26 +02:00
Vitaly Baranov
b0d19328b8 Add test for ReplicatedAccessStorage. 2022-06-19 14:14:41 +02:00
Vitaly Baranov
115be82440 DiskAccessStorage is now allowed to backup by default. 2022-06-19 13:16:36 +02:00
Vitaly Baranov
9f197defda Add support for setting 'allow_backup' to skip access entities from putting to backup. 2022-06-19 12:49:50 +02:00
Vitaly Baranov
01aaaf7395 More accurate access checking for RESTORE. 2022-06-19 11:26:41 +02:00
Vitaly Baranov
de9a07d18d Fix RESTORE ALL for tables without database in backup. 2022-06-18 14:07:01 +02:00
Vitaly Baranov
36475c5b98 Fix handling empty files in backups. 2022-06-18 12:28:32 +02:00
Vitaly Baranov
a0c558a17e Implement backup/restore for ACL system tables (system.users, system.roles, etc.) 2022-06-17 18:14:31 +02:00
mergify[bot]
23e0b16058
Merge branch 'master' into fix-possible-crash-after-removing-replica-in-distributed 2022-06-17 11:50:44 +00:00
mergify[bot]
296905771f
Merge branch 'master' into better-support-gcp 2022-06-17 01:19:11 +00:00
Azat Khuzhin
68b4f3fbb3 Add backward compatiblity test for INSERT w/ and w/o ProfileEvents
v2: apply black formatting (sigh)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-16 11:59:01 +03:00
Azat Khuzhin
20f0602c20 tests/integration: add ability to query specific host
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-16 11:59:01 +03:00
lgbo-ustc
35d534c213 nested struct in struct 2022-06-16 16:45:05 +08:00
lgbo-ustc
4f13521aa6 struct type support for storage hive 2022-06-16 09:35:34 +08:00
mergify[bot]
7f24574609
Merge branch 'master' into better-support-gcp 2022-06-15 23:18:20 +00:00
Alexander Tokmakov
2297708032 use random container name 2022-06-15 23:08:42 +02:00
Vitaly Baranov
c2c35fad82 Refactoring of the code getting create table queries for backup. 2022-06-15 20:32:35 +02:00