Commit Graph

6214 Commits

Author SHA1 Message Date
Alexander Tokmakov
c5b6ed410d
Merge pull request #48130 from ClickHouse/support_undrop_table
Merging "Support undrop table"
2023-03-29 16:49:58 +03:00
Vitaly Baranov
481a7a76ac
Simplify backup coordination for file infos (#48095)
* Remove obsolete code for archive suffixes.

* Simplify backup coordination, stop using it for restoring.

* Build all file infos before writing to backup. Decrease number of znodes.

* Split long values before writing to ZooKeeper.

* Use separate mutexes for unrelated activities.

* Make test test_disallow_concurrency less flaky.

* Add comments and test for backup_keeper_value_max_size.
2023-03-29 15:19:40 +02:00
Antonio Andelic
4ea9f96b1b Lower number of processes in KeeperMap test 2023-03-29 12:46:49 +00:00
kssenii
fcc8e4223c Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-29 14:13:27 +02:00
Antonio Andelic
44e95aa65f Merge branch 'master' into nosign-keyword-for-s3 2023-03-29 11:10:03 +00:00
Antonio Andelic
7b1ad221b2 Address PR comments 2023-03-29 11:08:44 +00:00
Kseniia Sumarokova
9e8bbe4bfe
Merge pull request #47987 from kssenii/try-fix-rabbitmq-test
Try fix rabbitmq test
2023-03-29 12:20:05 +02:00
Alexander Tokmakov
a1076005c7 Merge branch 'master' into support_undrop_table 2023-03-28 22:03:31 +02:00
kssenii
82b642c9c6 Fix style check 2023-03-28 21:57:14 +02:00
kssenii
1573790fe7 Better 2023-03-28 20:51:25 +02:00
kssenii
13f29a7242 Better 2023-03-28 18:57:24 +02:00
kssenii
04b28bf822 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-28 15:39:24 +02:00
Igor Nikonov
259df04415 Merge remote-tracking branch 'origin/master' into decimal256-various 2023-03-28 13:36:53 +00:00
Kruglov Pavel
292539b90e
Merge pull request #47981 from kssenii/better-delegate-disks-handle-mutual-path
Fix case when (optional) path is not added to encrypted disk configuration
2023-03-28 13:52:50 +02:00
kssenii
57226fcb25 Review fixes 2023-03-28 11:43:15 +02:00
Raúl Marín
920bb62ae1 Fix integration tests 2023-03-28 10:46:22 +02:00
robot-clickhouse
6bf48796a9 Automatic style fix 2023-03-28 07:29:36 +00:00
Antonio Andelic
160aa186bb Add support for NOSIGN keyword and no_sign_request config 2023-03-28 07:05:35 +00:00
kssenii
f8b45a00ec Fix 2023-03-27 19:20:48 +02:00
kssenii
314ee12442 Fix checks 2023-03-27 19:20:11 +02:00
Raúl Marín
d2cb4eb9fb Add integration test 2023-03-27 16:40:15 +02:00
xiedeyantu
5a18e0d5a5 support undrop table 2023-03-27 22:16:36 +08:00
Antonio Andelic
93f5920e02
Merge branch 'master' into alternative-keeper-configs 2023-03-27 10:00:21 +02:00
robot-ch-test-poll3
b18c051943
Merge pull request #47970 from ClickHouse/rs/fix-catboost
Fix "Field value too long" in catboostEvaluate()
2023-03-26 04:16:42 +02:00
robot-clickhouse
e46ec88ccb Automatic style fix 2023-03-25 18:26:36 +00:00
Robert Schulze
b46ea5572d
Fix expected results 2023-03-25 18:06:03 +00:00
kssenii
36cc6fee51 Rewrite data lakes (part 1) 2023-03-24 22:35:12 +01:00
Alexander Gololobov
a1e4f70c18
Merge branch 'master' into keeper_batch_bytes_size_limit 2023-03-24 22:08:05 +01:00
kssenii
5a4525742d Drop table after test 2023-03-24 18:53:00 +01:00
kssenii
08054b79a8 Try fix 2023-03-24 18:45:27 +01:00
Maksim Kita
5cb2d30563
Merge pull request #47316 from ClickHouse/vdimir/transform_external_query_analyzer
Support transformQueryForExternalDatabase for analyzer
2023-03-24 17:53:00 +01:00
kssenii
16ebfcc3f8 Better delegate disks handle mutual path 2023-03-24 16:21:19 +01:00
SmitaRKulkarni
17cff78393
Removed SYSTEM SYNC from test test_concurrent_backups_on_same_node. (#47944) 2023-03-24 14:56:48 +01:00
Alexander Gololobov
afe3af230f Limit keeper request batching by size in bytes 2023-03-24 14:41:09 +01:00
Mikhail f. Shiryaev
290ee6bbf1
Merge pull request #47790 from CurtizJ/apply-black-to-all-files
Apply black formatter to all python scripts
2023-03-24 14:20:50 +03:00
Robert Schulze
3628d11405
Fix "Field value too long" in catboostEvaluate()
Fixes #47616
2023-03-24 11:02:55 +00:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository 2023-03-24 11:54:38 +01:00
Antonio Andelic
52541e5e23
Merge pull request #47885 from ClickHouse/more-s3-events
Add more S3 write profile events
2023-03-24 09:48:34 +01:00
Alexander Tokmakov
4c9b63ccc0
Merge pull request #47916 from ClickHouse/fix_logical_error_in_distributed
Fix logical error in DistributedSink
2023-03-24 04:43:45 +03:00
Alexander Tokmakov
cd7d1fb990
Revert "Revert "Revert "Backup_Restore_concurrency_check_node""" 2023-03-24 04:35:50 +03:00
Antonio Andelic
3ae09c6ce8
Merge branch 'master' into more-s3-events 2023-03-23 18:23:53 +01:00
Anton Popov
0ee8dfad53 apply black formatter 2023-03-23 15:33:23 +00:00
Antonio Andelic
d6cbc5d05b Fix tests 2023-03-23 15:01:51 +00:00
Vitaly Baranov
f49cab91c0
Merge pull request #47002 from ilejn/orphaned_role
Tests for orphaned role fix
2023-03-23 14:09:34 +01:00
Vitaly Baranov
1d9bfca68d
Merge pull request #47919 from vitlibar/improve-replicated-used-defined-functions
Improve replicated user defined functions
2023-03-23 14:07:08 +01:00
Alexander Tokmakov
eeb5a4c241 fix an unrelated flaky test 2023-03-23 13:48:02 +01:00
Antonio Andelic
9ea8dc4e98 Merge branch 'master' into alternative-keeper-configs 2023-03-23 09:22:46 +00:00
Antonio Andelic
b57e82ded6 Add S3 write profile events 2023-03-23 09:05:41 +00:00
SmitaRKulkarni
04822a63e1
Merge pull request #47586 from ClickHouse/revert-47581-revert-47216-Backup_Restore_concurrency_check_node
Revert "Revert "Backup_Restore_concurrency_check_node""
2023-03-23 10:02:00 +01:00
Vitaly Baranov
14cae25bd3 Allow start without ZooKeeper. 2023-03-23 02:47:50 +01:00
Alexander Tokmakov
a6a2a3fba1
Merge pull request #47871 from ClickHouse/non_parallel_test_server_reload
Make test_server_reload non-parallel
2023-03-22 18:27:34 +03:00
Antonio Andelic
65b99ec6a7 Merge branch 'master' into alternative-keeper-configs 2023-03-22 12:22:57 +00:00
vdimir
6919db3d46 Fix test_mysql_protocol 2023-03-22 08:59:04 +01:00
vdimir
c2f0583dc6 Adjust test_mysql_protocol and others for analyzer 2023-03-22 08:59:04 +01:00
Alexander Tokmakov
0a7e7637aa make test_server_reload non-parallel 2023-03-22 00:50:47 +01:00
kssenii
716bbe1a97 Fix style check, black check 2023-03-21 22:19:05 +01:00
Vitaly Baranov
a70b627897
Merge pull request #47851 from vitlibar/fix-test_replicated_merge_tree_encryption_codec
Fix test test_replicated_merge_tree_encryption_codec
2023-03-21 21:25:50 +01:00
kssenii
19819f12f3 Better 2023-03-21 20:19:30 +01:00
robot-clickhouse
2d2183f54f Automatic style fix 2023-03-21 18:54:56 +00:00
Smita Kulkarni
9c822c70c5 Updated retry_count and sleep_time for checking BACKUP_CREATED query as it might take longer to create backup due to increase in data size 2023-03-21 19:34:19 +01:00
kssenii
d9053b8a7c Fix 2023-03-21 17:42:50 +01:00
kssenii
6486c4421e Fix hudi test 2023-03-21 17:20:26 +01:00
Vitaly Baranov
840e825282 Fix test test_replicated_merge_tree_encryption_codec. 2023-03-21 14:29:00 +01:00
kssenii
eceb54b001 Hudi tests 2023-03-21 12:51:14 +01:00
Kseniia Sumarokova
3c550b4314
Merge pull request #46647 from kssenii/named-collections-finish
Named collections: finish replacing old code for storages
2023-03-21 12:36:46 +01:00
Ilya Golshtein
5091b4e224 orphaned role - expiration_time => expiration_time_seconds 2023-03-21 08:44:08 +01:00
Ilya Golshtein
c3ce0aa3ba orphaned role - cache expiration time and timeout in tests decreased 2023-03-20 23:21:25 +01:00
Ilya Golshtein
4166b3bb09 orphaned role - xml indentation fix 2023-03-20 23:21:25 +01:00
Ilya Golshtein
c9691b943d orphaned role - make stylecheck happy 2023-03-20 23:21:25 +01:00
Ilya Golshtein
e1d1ead941 orphaned role - tests only 2023-03-20 23:21:25 +01:00
kssenii
34b247900f Better test 2023-03-20 16:53:54 +01:00
kssenii
75624c52f7 Merge remote-tracking branch 'upstream/master' into named-collections-granular-access 2023-03-20 16:38:14 +01:00
Vitaly Baranov
198409e12a
Merge pull request #46085 from aalexfvk/alexfvk/store_udf_in_zookeeper
Replication of user-defined SQL functions using ZooKeeper
2023-03-20 13:41:29 +01:00
kssenii
cae3b335d6 Merge remote-tracking branch 'upstream/master' into named-collections-finish 2023-03-20 11:23:22 +01:00
robot-clickhouse
826dd397b1 Automatic style fix 2023-03-20 09:58:42 +00:00
Smita Kulkarni
722404ca64 Disallow concurrency for backup restore test, added another insert block to data and setting mutations_sync 2023-03-20 10:34:55 +01:00
Alexey Milovidov
698fcba525
Merge branch 'master' into fix-mysql-leak 2023-03-20 07:37:01 +03:00
Alexey Milovidov
4a44dafdee Merge branch 'master' into decimal256-various 2023-03-20 03:30:14 +01:00
kssenii
ea375ef989 Fix memory leak 2023-03-20 00:40:06 +01:00
Alexander Tokmakov
f1df91cd09
Merge pull request #47659 from ClickHouse/fix_993
Fixes for 993 and friends
2023-03-18 14:46:43 +03:00
Antonio Andelic
593ac89cb9
Merge pull request #47687 from ClickHouse/fix-mntr-data-size-test
Try making `test_keeper_mntr_data_size` less flaky
2023-03-18 10:09:25 +01:00
Alexey Milovidov
26d17fe560 Merge branch 'master' of github.com:ClickHouse/ClickHouse into decimal256-various 2023-03-17 22:15:16 +01:00
Nikolay Degterinsky
7fb171f84d
Merge pull request #47596 from evillique/native-client-ssl
Add SSL User Certificate authentication to the native protocol
2023-03-17 21:27:58 +01:00
kssenii
f776f4ff46 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-17 19:45:28 +01:00
kssenii
e48d8d12e7 Fixes for hudi 2023-03-17 19:44:30 +01:00
Alexander Tokmakov
d11aee2b0c
Merge branch 'master' into fix_993 2023-03-17 21:28:23 +03:00
Antonio Andelic
86a409e7a9 Assert znode count 2023-03-17 16:07:12 +00:00
Alexander Tokmakov
dfd8b2670a fix tests, update docs 2023-03-17 14:15:03 +01:00
robot-clickhouse
2198ea2d89 Automatic style fix 2023-03-17 12:19:16 +00:00
kssenii
bb0beb7449 Merge remote-tracking branch 'upstream/master' into named-collections-finish 2023-03-17 13:02:36 +01:00
alesapin
e44fca8bb9 Add test 2023-03-17 12:56:31 +01:00
Aleksei Filatov
886b530963 [rev: 1] Fix review remarks 2023-03-17 13:56:05 +03:00
Aleksei Filatov
cf6ca10c83 Tests for replicated system.functions 2023-03-17 13:56:05 +03:00
Aleksei Filatov
1321f87eee Tests for replication UDF to ZooKeeper 2023-03-17 13:56:04 +03:00
alesapin
efa0622a84
Merge pull request #47631 from ClickHouse/fix_wait_for_zero_copy_lock
Fix wait for zero copy lock during move
2023-03-17 11:15:55 +01:00
Alexander Tokmakov
8b8215f91a fix some other tests, add logs for further debugging 2023-03-16 16:40:08 +01:00
pufit
f4d9b4a888
Merge pull request #47086 from pkit/pkit/insert_http_body
use http request body in predefined http handlers
2023-03-15 17:41:05 -04:00
alesapin
586b8a4733 Add test 2023-03-15 22:38:42 +01:00
Alexander Tokmakov
6a653060ff
Merge pull request #47213 from azat/interserver-mode-v2
Reimplement interserver mode to avoid replay attacks
2023-03-15 16:26:50 +03:00
Vitaly Baranov
00c05f7f8b
Merge pull request #47546 from vitlibar/use-server-side-copy-for-restore
Use server-side copy for restore from S3 to S3.
2023-03-15 11:28:29 +01:00
Robert Schulze
145eed9455
Merge pull request #46485 from ClibMouse/KRB_CVE_Fix
Update krb5 to 1.20.1-final to mitigate CVE-2022-42898
2023-03-15 11:00:06 +01:00
Azat Khuzhin
bcf381c5ae Reimplement interserver mode to avoid replay attacks
Prevous implementation (DBMS_MIN_REVISION_WITH_INTERSERVER_SECRET)
accepts the salt from the client, which make it useless.

Reimplement the protocol to send the salt by the server and use it in
the client instead.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-15 08:28:43 +01:00
Alexey Milovidov
f859b3258a Add support for Decimal256 in MySQL tables 2023-03-15 04:45:26 +01:00
Vitaly Baranov
25356786ea Simplify the implementation, create new utility function copyS3FileToDisk(). 2023-03-14 23:34:44 +01:00
Nikolay Degterinsky
eddda2eb73 Add SSL authentication to the native protocol 2023-03-14 22:10:08 +00:00
Smita Kulkarni
8cd36d2a36 Removed generated file cluster_for_concurrency_test.xml 2023-03-14 20:30:44 +01:00
Smita Kulkarni
e863e49a49 Renamed cluster configuration xml to cluster_for_disallow_concurrency_test.xml for disallow_concurreny of backup and restore test 2023-03-14 20:26:19 +01:00
SmitaRKulkarni
8db4964ebc
Revert "Revert "Backup_Restore_concurrency_check_node"" 2023-03-14 20:23:43 +01:00
Alexander Tokmakov
773cd5a686
Revert "Backup_Restore_concurrency_check_node" 2023-03-14 18:55:08 +03:00
Vitaly Baranov
859082c4b7
Merge pull request #47216 from ClickHouse/Backup_Restore_concurrency_check_node
Backup_Restore_concurrency_check_node
2023-03-14 13:36:43 +01:00
Alexander Tokmakov
5a1ee881f8
Merge pull request #47547 from ClickHouse/filter_too_frequent_logs
Hide too noisy log messages, fix some tests
2023-03-14 13:53:21 +03:00
Alexander Tokmakov
ba6c6255a3 hide too noisy log messages, fix some tests 2023-03-14 00:23:36 +01:00
Vitaly Baranov
1cf1ce07fe Use server-side copy during restore from S3 to S3. 2023-03-13 23:50:13 +01:00
Alexey Milovidov
a411ae10b5
Merge pull request #47486 from ClickHouse/revert_25674
Remove "asynchronous connection drain"
2023-03-13 21:40:39 +03:00
Alexander Tokmakov
ee6c18cbc6
Better error after failed Ordinary-to-Atomic conversion (#47487)
* better error on failed Ordinary-to-Atomic conversion

* fix test

* Update loadMetadata.cpp
2023-03-13 19:13:49 +03:00
MeenaRenganathan22
dc1e125b31 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-13 06:54:47 -07:00
alesapin
8db0d26519
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-13 14:48:20 +01:00
Smita Kulkarni
f76b97cb51 Set num of nodes to 4 for backup restore disallow concurrency test 2023-03-13 10:42:43 +01:00
SmitaRKulkarni
9a35a434f8
Merge branch 'master' into Backup_Restore_concurrency_check_node 2023-03-13 10:04:32 +01:00
Alexander Tokmakov
7b1b238d0b Revert "Merge pull request #25674 from amosbird/distributedreturnconnection"
This reverts commit 5ffd99dfd4, reversing
changes made to 2796aa333f.
2023-03-11 19:09:47 +01:00
Alexander Tokmakov
0359b3e336 Revert "Merge pull request #46622 from ClickHouse/async-insert-memory-fix"
This reverts commit 67469ad46b, reversing
changes made to 678e4250cd.
2023-03-11 17:01:10 +01:00
Dmitry Novik
4f24a7bd11 Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-03-10 18:57:45 +00:00
MeenaRenganathan22
f4f7336fd0 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-10 09:08:02 -08:00
alesapin
588cc0f159
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-09 14:54:10 +01:00
kssenii
0240ad4c68 Add spark to tests, rewrite tests, fix bug 2023-03-08 15:45:35 +01:00
MeenaRenganathan22
ed5b19f5f8 Fixed the integration test failures related with HDFS and KAFKA 2023-03-08 06:11:17 -08:00
alesapin
4423be8332
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-08 12:59:07 +01:00
Antonio Andelic
816a9c1099
Merge branch 'master' into custom-key-parallel-replicas 2023-03-08 11:06:30 +01:00
Igor Nikonov
cc5b97b624
Merge pull request #46997 from AndyBys/log-level-change
Change level log in executeQuery
2023-03-08 10:36:21 +01:00
Alexey Milovidov
e2aff59a2d
Merge pull request #47106 from kssenii/allow-nested-disks-in-custom-disks
Allow nested custom disks
2023-03-08 03:00:55 +03:00
Alexander Tokmakov
ffd55d951d
Merge branch 'master' into followup_46681 2023-03-07 23:38:06 +03:00
Robert Schulze
5b91631722
Merge pull request #47138 from AVMusorin/disallow-default-columns-kafka-engine
Prohibit DEFAULT/EPHEMERAL/ALIAS/MATERIALIZED columns in KafkaEngine
2023-03-07 20:36:46 +01:00
Alexander Tokmakov
7ce20f5cd2 fix tests 2023-03-07 14:25:28 +01:00
Antonio Andelic
35c15e6ef8 Merge branch 'master' into custom-key-parallel-replicas 2023-03-07 09:37:38 +00:00
Alexey Milovidov
7d48eae0f6
Merge pull request #47256 from ClickHouse/keeper-4lw-clean-resources
Add Keeper 4LW for cleaning resources
2023-03-07 04:23:15 +03:00
Igor Nikonov
838ff88abe
Merge branch 'master' into log-level-change 2023-03-06 18:00:49 +01:00
Antonio Andelic
9e3794f7d7 Skip for sanitizer builds 2023-03-06 14:36:53 +00:00
kssenii
cb3dd3c200 Fix flaky test 2023-03-06 13:06:31 +01:00
Han Fei
b7eef62458
Merge pull request #45491 from azat/dist/async-send-refactoring
[RFC] Rewrite distributed sends to avoid using filesystem as a queue, use in-memory queue instead
2023-03-06 12:32:33 +01:00
Antonio Andelic
3a184880c6 Add test for clrs 2023-03-05 17:18:53 +00:00
kssenii
b8d33f4d38 Fix test 2023-03-05 13:46:23 +01:00
kssenii
d9e75e5c0a Fix test 2023-03-05 13:13:32 +01:00
kssenii
8f2d75cef8 Fix tests 2023-03-05 12:56:00 +01:00
Alexey Milovidov
41c79b0c42
Merge pull request #46086 from ClickHouse/fix-data-size
Fix data size calculation in Keeper
2023-03-05 14:11:36 +03:00
Sema Checherinda
85178c9609
Merge pull request #47102 from CheSema/merge-mutate-do-thread-group
do flushUntrackedMemory when context switches
2023-03-03 20:23:25 +01:00
robot-clickhouse
cebe323bef Automatic style fix 2023-03-03 15:56:11 +00:00
Smita Kulkarni
d2dbd5f293 Updated to use tryGet instead of get for checking stage of backups/restores in concurrency check and updated tests by increasing data size to have a longer backup/restore to ensure the overlap and increased timeout correspondingly. 2023-03-03 16:48:14 +01:00
AVMusorin
0f2ae72141
prohibit DEFAULT/EPHEMERAL/ALIAS in KafkaEngine 2023-03-03 16:25:42 +01:00
robot-clickhouse
46667d43d8 Automatic style fix 2023-03-03 15:25:25 +00:00
Antonio Andelic
737cf8e149 Better 2023-03-03 15:14:49 +00:00