Commit Graph

4560 Commits

Author SHA1 Message Date
Vitaly Baranov
11b51d2878 Implement storing UDF in backups. 2022-06-30 08:37:17 +02:00
Vitaly Baranov
efbee5e723 Improve gathering metadata for backup - part 7. 2022-06-30 08:37:17 +02:00
Vitaly Baranov
7689e0c36f Improve gathering metadata for backup - part 6. 2022-06-30 08:37:17 +02:00
Vitaly Baranov
64b51a3772 Improve gathering metadata for backup. 2022-06-30 08:37:17 +02:00
Vitaly Baranov
47ac47350b Store projections in backups. 2022-06-30 08:37:17 +02:00
alesapin
8f5582f95e Review and style fixes 2022-06-29 20:29:50 +02:00
alesapin
9b387a57ed Test ipv6 as well 2022-06-29 17:56:59 +02:00
Yatsishin Ilya
1ef92b4c27 fix black again 2022-06-29 15:56:29 +00:00
alesapin
62e7a89f26 Proper fix for ipv4/ipv6 conversion error 2022-06-29 17:53:08 +02:00
Yatsishin Ilya
f4691b0b00 fix black 2022-06-29 15:08:24 +00:00
Yatsishin Ilya
6f6e814542 Fix test_dictionaries_postgresql 2022-06-29 14:18:12 +00:00
Yatsishin Ilya
c86c6cc2d9 Improve postgres tests. Fix flaky test_postgresql_database_engine 2022-06-29 12:54:45 +00:00
Alexander Tokmakov
8246e55002
Merge pull request #38486 from azat/fix-parts-removal
Fix parts removal after incorrect server shutdown
2022-06-29 14:17:59 +03:00
Kruglov Pavel
b9813bcdea
Merge pull request #38356 from kssenii/fix-rabbitmq-with-peekable
Fix RabbitMQ with formats based on PeekableReadBuffer
2022-06-29 13:06:10 +02:00
Kseniia Sumarokova
71e9363baf
Fix black 2022-06-29 07:32:27 +02:00
lgbo-ustc
ee30c4a3f7 update test scripts 2022-06-29 10:23:00 +08:00
lgbo-ustc
7274169c33 update test scripts 2022-06-29 10:03:10 +08:00
mergify[bot]
4a1fefb42d
Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:49:52 +00:00
Alexander Tokmakov
e23f1fa774
Merge pull request #38269 from excitoon-favorites/integrationtestsfixes
Don't try to kill empty list of containers in `integration/runner` II
2022-06-28 17:35:48 +03:00
Alexander Tokmakov
428628238f Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:40:33 +02:00
Alexander Tokmakov
2f45a6ebaa
Update test.py 2022-06-28 15:18:30 +03:00
Alexander Tokmakov
07cecd4e66
Merge pull request #38516 from ClickHouse/fix_flaky_store_cleanup
Try to fix flaky test
2022-06-28 14:56:54 +03:00
kssenii
4c99f608b3 Fix 2022-06-28 13:18:21 +02:00
Alexander Tokmakov
0c51bd9c23 fix flaky test 2022-06-28 12:38:36 +02:00
larryluogit
3e48c1d765
Merge branch 'ClickHouse:master' into add-tlsv1_3-test 2022-06-27 22:40:43 -04:00
Alexander Tokmakov
851534c9f7 Merge branch 'master' into deprecate_ordinary_database 2022-06-27 23:47:49 +02:00
Azat Khuzhin
e70cff2cea Fix parts removal after incorrect server shutdown
Before this patch, and after transaction support had been added #24258,
if the server had not removed old parts on shutdown, then they will left
forever.

Fixes: #24258 (cc @tavplubix)
v2: use Tx::PrehistoricTID over removePartsFromWorkingSet() from ctor
v3: apply black to new test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-27 23:56:25 +03:00
Vladimir Chebotarev
89dc2844db Fix for integration tests fix. 2022-06-27 23:13:40 +03:00
Yakov Olkhovskiy
d5f65ece9b
Merge pull request #38105 from arenadata/ADQM-419
Add kerberosInit function as a replacement for kinit executable calls in Kafka and HDFS
2022-06-27 14:19:24 -04:00
Alexander Tokmakov
fe1b1aa77b fix my favorite check 2022-06-27 16:16:06 +02:00
Alexander Tokmakov
88dbbcb15d fix tests 2022-06-27 16:10:00 +02:00
Kseniia Sumarokova
d1243c1e01
Update test.py 2022-06-27 15:35:35 +02:00
Alexander Tokmakov
7c37079a96 Merge branch 'master' into deprecate_ordinary_database 2022-06-27 14:46:59 +02:00
Alexander Tokmakov
c4d815c60b
Update test.py 2022-06-27 15:44:20 +03:00
kssenii
2c5aeaaa1a Add auto close for postgres connection 2022-06-27 13:46:52 +02:00
lgbo-ustc
44b68dd651 update test case 2022-06-27 16:23:04 +08:00
Vladimir Chebotarev
2b19e69930 Don't try to kill empty list of containers in integration/runner. 2022-06-27 06:12:10 +03:00
lgbo-ustc
a3cb066eff update test case 2022-06-27 09:38:12 +08:00
larryluogit
b32cf5da4a
Merge branch 'ClickHouse:master' into add-tlsv1_3-test 2022-06-26 10:21:21 -04:00
Larry Luo
8dd6f09cf1 fix style check error 2022-06-26 07:19:22 -07:00
mergify[bot]
f63c959679
Merge branch 'master' into cleanup_garbage_in_store_dir 2022-06-26 13:35:10 +00:00
Mikhail f. Shiryaev
1d661d0bad
Merge pull request #38343 from ClickHouse/integration-tests-proxy
Upload logs for getting all tests command
2022-06-25 14:08:45 +02:00
Kseniia Sumarokova
901e8cfc6c
Update test.py 2022-06-25 11:24:11 +02:00
Kseniia Sumarokova
0d626982ee
Merge pull request #38369 from kssenii/fix-pg-compatibility
Fix postgres database engine possible incompatibility on upgrade
2022-06-25 11:18:46 +02:00
Kseniia Sumarokova
3c70e07fe9
Merge pull request #38366 from kssenii/fix-pg-ndim-with-schema
Fix postgres engine not using pg schema when retrieving array dimension size
2022-06-25 11:14:01 +02:00
larryluogit
a21e4117da
Merge branch 'ClickHouse:master' into add-tlsv1_3-test 2022-06-24 22:58:43 -04:00
Kseniia Sumarokova
a003d01295
Update test.py 2022-06-24 19:35:23 +02:00
Alexander Tokmakov
94dd80e900 fix tests 2022-06-24 19:10:33 +02:00
Alexander Tokmakov
31dcc7634e Merge branch 'master' into deprecate_ordinary_database 2022-06-24 18:16:07 +02:00
Alexander Tokmakov
b75828768b Merge branch 'master' into cleanup_garbage_in_store_dir 2022-06-24 15:32:42 +02:00
Alexander Gololobov
addfe5f209 Added test for list --recursive 2022-06-24 03:51:39 +02:00
kssenii
6cb1d60883 Fix 2022-06-24 03:24:54 +02:00
kssenii
a3823c67ee Fix 2022-06-24 02:44:22 +02:00
Kseniia Sumarokova
867982a9fd
Update test.py 2022-06-24 01:49:47 +02:00
Alexander Tokmakov
74f38710a8 Merge branch 'master' into cleanup_garbage_in_store_dir 2022-06-23 21:43:28 +02:00
Alexander Tokmakov
09f09bd96d apply trash-formatter 2022-06-23 21:40:05 +02:00
Alexander Tokmakov
dbf2763788 automatically convert system database to Atomic 2022-06-23 21:38:43 +02:00
Alexander Tokmakov
0d304f7b8c fix tests 2022-06-23 21:19:07 +02:00
Larry Luo
1239ee4b31 update ssl config 2022-06-23 12:11:18 -07:00
Larry Luo
191936a806 clean up comments 2022-06-23 11:50:06 -07:00
kssenii
e362e4fff1 Fix 2022-06-23 20:48:32 +02:00
Larry Luo
2339906e2a Adding TLS V13 Test 2022-06-23 11:30:00 -07:00
Mikhail f. Shiryaev
dfae6a5634
Upload logs for getting all tests command 2022-06-23 18:14:42 +02:00
Anton Popov
7efbae7728
Merge pull request #38069 from CurtizJ/better-support-gcp
Better support of GCP storage
2022-06-23 13:19:14 +02:00
Vitaly Baranov
18b4413df8
Merge pull request #38299 from vitlibar/backup-improvements-7
Backup improvements 7
2022-06-23 11:37:03 +02:00
Alexander Tokmakov
f00e6b5a7a deprecate old MergeTree syntax 2022-06-23 11:24:54 +02:00
Kseniia Sumarokova
b844c36a9d
Merge pull request #38150 from kssenii/clickhouse-disks-fixes
Some fixes for clickhouse-disks
2022-06-23 10:21:44 +02:00
Alexander Tokmakov
2c5a88faba deprecate Ordinary database 2022-06-23 10:20:14 +02:00
lgbo-ustc
c1770c22b9 Merge remote-tracking branch 'ck/master' into storagehive_struct_type 2022-06-23 15:54:20 +08:00
lgbo-ustc
0fba75b21d Merge remote-tracking branch 'ck/master' into storagehive_alter 2022-06-23 09:38:06 +08:00
Alexander Tokmakov
1595ff5620
Merge pull request #38260 from bigo-sg/hive_test
Improve the stability for hive storage integration test
2022-06-22 21:08:23 +03:00
Vitaly Baranov
5ae8fce1ef Attach threads to thread groups better. 2022-06-22 18:51:41 +02:00
Nikita Taranov
41ba0118b5
Bring back #36396 (#38110)
* Revert "Revert "More parallel execution for queries with `FINAL` (#36396)""

This reverts commit 5bfb15262c.

* fix tests

* fix review suggestions

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-06-22 15:05:07 +02:00
alesapin
0f8eed98c4
Merge branch 'master' into better-support-gcp 2022-06-22 12:46:01 +02:00
lgbo-ustc
123d57484f fix a path error 2022-06-22 17:15:47 +08:00
lgbo-ustc
0917a60323 Merge remote-tracking branch 'origin/hive_test' into hive_test 2022-06-22 09:42:33 +08:00
lgbo-ustc
63937682da fixed code style 2022-06-22 09:39:05 +08:00
Mikhail f. Shiryaev
57eb887006
Apply black to runner script 2022-06-21 20:53:13 +02:00
Mikhail f. Shiryaev
81e1ef3053
Fix dynamic volume name for integration tests 2022-06-21 20:52:32 +02:00
kssenii
47a118beab More fixes 2022-06-21 16:40:22 +02:00
Alexander Tokmakov
ba0fcec993 add background cleanup of store/ subdirs 2022-06-21 12:35:47 +02:00
lgbo-ustc
cdd7a54995 improve stability for hive intergration test 2022-06-21 15:59:54 +08:00
lgbo-ustc
633c3c8287 update hive test 2022-06-21 15:10:48 +08:00
Vitaly Baranov
06c4082a7c
Merge pull request #37358 from vitlibar/backup-improvements-6
Backup Improvements 6
2022-06-20 14:13:30 +02:00
Kseniia Sumarokova
a756b4be27
Merge pull request #37391 from azat/insert-profile-events-fix
Send profile events for INSERT queries (previously only SELECT was supported)
2022-06-20 12:16:29 +02:00
lgbo-ustc
b78adb4492 fixed code style 2022-06-20 15:07:08 +08:00
lgbo-ustc
efec6f9ac5 support alter on storagehive 2022-06-20 14:57:33 +08:00
lgbo-ustc
c13bf03fe0 fixed code style 2022-06-20 09:56:21 +08:00
Vitaly Baranov
2c8788266c Fix tests. 2022-06-20 03:44:49 +02:00
Vitaly Baranov
8a7c970ce0 Fix style. 2022-06-19 15:58:26 +02:00
Vitaly Baranov
b0d19328b8 Add test for ReplicatedAccessStorage. 2022-06-19 14:14:41 +02:00
Vitaly Baranov
115be82440 DiskAccessStorage is now allowed to backup by default. 2022-06-19 13:16:36 +02:00
Vitaly Baranov
9f197defda Add support for setting 'allow_backup' to skip access entities from putting to backup. 2022-06-19 12:49:50 +02:00
Vitaly Baranov
01aaaf7395 More accurate access checking for RESTORE. 2022-06-19 11:26:41 +02:00
Vitaly Baranov
de9a07d18d Fix RESTORE ALL for tables without database in backup. 2022-06-18 14:07:01 +02:00
Vitaly Baranov
36475c5b98 Fix handling empty files in backups. 2022-06-18 12:28:32 +02:00
Vitaly Baranov
a0c558a17e Implement backup/restore for ACL system tables (system.users, system.roles, etc.) 2022-06-17 18:14:31 +02:00
mergify[bot]
23e0b16058
Merge branch 'master' into fix-possible-crash-after-removing-replica-in-distributed 2022-06-17 11:50:44 +00:00
mergify[bot]
296905771f
Merge branch 'master' into better-support-gcp 2022-06-17 01:19:11 +00:00
Azat Khuzhin
68b4f3fbb3 Add backward compatiblity test for INSERT w/ and w/o ProfileEvents
v2: apply black formatting (sigh)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-16 11:59:01 +03:00
Azat Khuzhin
20f0602c20 tests/integration: add ability to query specific host
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-16 11:59:01 +03:00
lgbo-ustc
35d534c213 nested struct in struct 2022-06-16 16:45:05 +08:00
lgbo-ustc
4f13521aa6 struct type support for storage hive 2022-06-16 09:35:34 +08:00
mergify[bot]
7f24574609
Merge branch 'master' into better-support-gcp 2022-06-15 23:18:20 +00:00
Alexander Tokmakov
2297708032 use random container name 2022-06-15 23:08:42 +02:00
Vitaly Baranov
c2c35fad82 Refactoring of the code getting create table queries for backup. 2022-06-15 20:32:35 +02:00
Vitaly Baranov
1198e86295 Fix storing temporary tables and skipping system tables while making a backup. 2022-06-15 20:32:34 +02:00
Vitaly Baranov
b2323991d6 BACKUP DATABASE now stores inner tables of matviews only if the corresponding matviews are stored. 2022-06-15 20:32:34 +02:00
Vitaly Baranov
6877b8f864 Fix renaming visitor. 2022-06-15 20:32:34 +02:00
Vitaly Baranov
d78a2cda72 Restore tables regarding their dependencies. 2022-06-15 20:32:34 +02:00
Vitaly Baranov
ce1836f0d2 Lock tables for share before backup and restore. 2022-06-15 20:28:43 +02:00
Vitaly Baranov
131382e025 Fix async tests. 2022-06-15 20:28:42 +02:00
Anton Popov
eea7e4eced fix test 2022-06-15 15:02:02 +00:00
alesapin
af1cd745e1
Merge pull request #37975 from kssenii/clean-up-broken-detached
Clean up broken detached parts after timeout
2022-06-14 20:53:31 +02:00
alesapin
8d45d1e71b
Fix setting name in test 2022-06-14 11:52:44 +02:00
Antonio Andelic
dded528d13
Merge pull request #36424 from PolyProgrammist/r1unfreeze
SYSTEM UNFREEZE query that deletes the whole backup
2022-06-14 08:44:45 +02:00
kssenii
74cffaf186 Merge master 2022-06-14 00:45:19 +02:00
kssenii
66ec0e41fa Fix test 2022-06-14 00:17:00 +02:00
Vitaly Baranov
241b51c7d4
Add implicit grants with grant option too. (#38017) 2022-06-14 00:09:51 +02:00
kssenii
11c624914a Fix black 2022-06-13 21:46:57 +02:00
Nikolai Kochetov
43dff9d34c Black 2022-06-13 19:44:12 +00:00
kssenii
34e63b20fb Review fixes 2022-06-13 21:27:54 +02:00
Nikolai Kochetov
695d586604 Fix possible crash in Distributed async insert in case of removing a replica from config. 2022-06-13 15:21:43 +00:00
Antonio Andelic
b9cf6fe367 Merge branch 'master' into pp-system-unfreeze 2022-06-13 14:46:30 +00:00
kssenii
debe467ee7 Review fixes 2022-06-13 14:25:42 +02:00
kssenii
4859e11c27 Review fixes 2022-06-12 01:15:10 +02:00
Alexander Tokmakov
72fe5144ca
Revert "Don't try to kill empty list of containers in integration/runner" 2022-06-11 22:55:31 +03:00
Alexey Milovidov
384cef7242
Merge pull request #37854 from excitoon-favorites/integrationtestsfixes
Don't try to kill empty list of containers in `integration/runner`
2022-06-11 03:01:41 +03:00
Alexander Tokmakov
2319ef7647 fix test 2022-06-10 17:48:14 +02:00
kssenii
fd6c84b831 Review fixes 2022-06-10 14:23:13 +02:00
kssenii
498f389c21 Merge master 2022-06-10 12:49:10 +02:00
kssenii
7a2676c7ab Clean up broken detached parts with timeout 2022-06-10 12:27:57 +02:00
alesapin
36924cb47d
Merge pull request #37957 from ClickHouse/tavplubix-patch-1
Fix flaky `test_parts_delete_zookeeper`
2022-06-10 11:47:55 +02:00
Roman Vasin
4c560584c7 Code cleanup in KerberosInit and kafka integration tests 2022-06-10 12:38:39 +03:00
Alexander Tokmakov
780f7c87c7
Merge pull request #36113 from ClickHouse/remove-useless-code-2
Remove useless code in ReplicatedMergeTreeRestartingThread
2022-06-09 17:56:28 +03:00
Alexander Tokmakov
68a0950086
Update test.py 2022-06-09 17:53:52 +03:00
Maksim Kita
aa5293da5d
Merge pull request #37947 from kitaisreal/dictionaries-update-field-condition-fix
Dictionaries custom query with update field fix
2022-06-09 16:31:07 +02:00
Maksim Kita
a9d568c63c Dictionaries custom query with update field fix 2022-06-09 11:51:07 +02:00
Alexander Tokmakov
0186143792
Update test.py 2022-06-08 15:49:37 +03:00
Vladimir Chebotarev
7626854ef3 Typos. 2022-06-08 15:47:20 +03:00
Vladimir Chebotarev
eb9117804e Better. 2022-06-08 15:47:20 +03:00
Vladimir Chebotarev
7f5e9a2a90 Better. 2022-06-08 15:47:20 +03:00
Vladimir Chebotarev
6749ba14de Don't try to kill empty list of containers in integration/runner. 2022-06-08 15:47:20 +03:00
Vadim Volodin
637d293fbd Add SYSTEM UNFREEZE query 2022-06-08 15:21:14 +03:00
Alexander Tokmakov
627af2a56b
Update test.py 2022-06-08 14:29:35 +03:00
Alexander Tokmakov
e3cc4afdf7
Update test.py 2022-06-08 14:13:57 +03:00
alesapin
9fdc783eac
Merge pull request #37906 from ClickHouse/remove_tmp_directories_on_replicated
Remove temporary `delete_tmp_` on clickhouse server start
2022-06-08 12:35:51 +02:00
Roman Vasin
2b76d0c6a9 Add new integration test for kerberized Kafka; remove old kinit code from HDFSCommon 2022-06-08 12:26:35 +03:00
Kseniia Sumarokova
6211a1c390
Merge pull request #37801 from azat/s3-fix-empty-read
Fix reading of empty S3 files
2022-06-07 23:36:14 +02:00
alesapin
8b26953e3f
Merge pull request #37908 from ClickHouse/tavplubix-patch-1
Try fix `test_grpc_protocol/test.py::test_progress`
2022-06-07 21:48:00 +02:00