thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 02:41:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
107,650 Commits 9,328 Branches 1,783 Tags 2.1 GiB
7ee7afe750
Commit Graph

5739 Commits

Author SHA1 Message Date
Vitaly Baranov
c22b0076ce Fix cleanup in tests test_replicated_merge_tree_s3_restore. 2023-01-24 18:05:44 +01:00
SmitaRKulkarni
d387835774
Merge branch 'master' into 45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores 2023-01-24 13:49:32 +01:00
Smita Kulkarni
642f9ca549 Merge branch 'master' into 45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores 2023-01-24 09:37:28 +01:00
Alexander Tokmakov
0e0e2f0f67
Update test.py 2023-01-23 19:01:06 +03:00
Aleksandr
2caeed901b
Merge branch 'master' into fix_backup_restore_num_files 2023-01-23 13:43:20 +01:00
Smita Kulkarni
383af7f3a6 Moved settings inside backups section - Updated backup/restore status when concurrent backups & restores are not allowed 2023-01-23 08:59:44 +01:00
Anton Popov
f181254fb0 fix race in destructor of ParallelParsingInputFormat 2023-01-23 01:18:58 +00:00
Smita Kulkarni
310ae62d90 Updated backup/restore status when concurrent backups & restores are not allowed 
Implementation:
* Moved concurrent backup/restore check inside try-catch block which sets the status so that other nodes in cluster are aware of failures.
* Renamed backup_uuid to restore_uuid in RestoreSettings.
Testing:
* Updated test test_backup_and_restore_on_cluster/test_disallow_concurrency to check for specific backup/restore id.
 2023-01-22 19:01:09 +01:00
Vitaly Baranov
5ceb64accc Use new copy s3 functions in S3ObjectStorage. 2023-01-21 15:47:58 +01:00
Vitaly Baranov
f0fda580d0
Merge pull request #45188 from vitlibar/backup-to-s3-memory-optimization 
Optimize memory consumption during backup to S3
 2023-01-21 12:37:35 +01:00
Sema Checherinda
962894afc8
Merge pull request #44909 from CheSema/intersect-prev-part 
Do not merge over a gap with outdated undeleted parts
 2023-01-21 11:51:21 +01:00
Anton Popov
41a199e175
Fix crash when ListObjects request fails (#45371) 2023-01-20 20:10:23 +01:00
Maksim Kita
23e26032ca
Merge pull request #45399 from aalexfvk/alexfvk/mdb-21326_fix_system_dictionaries_when_dictionary_with_bad_structure 
Fix select from system.dictionaries when there is dictionary with bad structure
 2023-01-20 13:36:32 +03:00
Antonio Andelic
0ad37ad286
Merge pull request #45320 from stigsb/system_tables_volume_config 
Add <storage_policy> config parameter for system logs
 2023-01-20 10:27:57 +01:00
Aleksandr Musorin
838acb22b7
added num_processed_files and processed_files_size 2023-01-20 10:20:41 +01:00
SmitaRKulkarni
6aa63414db
Merge pull request #45072 from ClickHouse/43891_Disallow_concurrent_backups_and_restores 
Added settings to disallow concurrent backups and restores
 2023-01-20 09:17:20 +01:00
Aleksei Filatov
42549e89f2 [rev 2] Fix review notes 2023-01-20 09:37:49 +03:00
Kseniia Sumarokova
1452d2588c
Update test.py 2023-01-19 18:06:43 +01:00
Kseniia Sumarokova
f80246644c
Update test.py 2023-01-19 18:04:09 +01:00
Kseniia Sumarokova
db49368f5e
Merge branch 'master' into storage-rabbitmq-fix-flush 2023-01-19 18:03:42 +01:00
Aleksei Filatov
afada0ecb3 Fix review notes 2023-01-19 17:02:57 +03:00
alesapin
ccd41e6d14
Merge pull request #45403 from ClickHouse/fix_test_system_merges 
Reduce an amount of trash in `tests_system_merges`
 2023-01-19 12:00:54 +01:00
SmitaRKulkarni
67e2bf31f5
Merge branch 'master' into 43891_Disallow_concurrent_backups_and_restores 2023-01-19 11:21:37 +01:00
Ilya Yatsishin
f16328aa8b
Merge pull request #45402 from qoega/simpler-test_replicated_merge_tree_s3_restore 2023-01-19 10:27:42 +01:00
Stig Bakken
420c179b55 Add <storage_policy> config parameter for system logs 2023-01-19 10:25:28 +01:00
SmitaRKulkarni
db03dd1bb9
Merge branch 'master' into 43891_Disallow_concurrent_backups_and_restores 2023-01-19 09:32:50 +01:00
robot-clickhouse
33a4222155 Automatic style fix 2023-01-18 15:52:38 +00:00
Alexander Tokmakov
6f8c1424df reduce an amount of trash in tests_system_merges 2023-01-18 16:45:47 +01:00
Yatsishin Ilya
1603e734f9 Make test simpler to see errors not in teardown 2023-01-18 15:36:24 +00:00
Aleksei Filatov
5e9340f682 Add integration test 2023-01-18 17:50:38 +03:00
Vitaly Baranov
7cdb2c4c7f
Merge pull request #45351 from vitlibar/fix-backup-with-killed-mutations 
Fix backup with killed mutations
 2023-01-18 13:14:27 +01:00
Ilya Yatsishin
9b5e7c00d5
Merge pull request #45369 from qoega/improve-failed-kafka-logging 
Improve failed kafka startup logging
 2023-01-18 13:09:48 +01:00
alesapin
a4ff9027ce
Merge branch 'master' into fix_flaky_test_ttl_modify 2023-01-18 12:19:37 +01:00
Antonio Andelic
f57ee043ae
Merge pull request #45319 from ClickHouse/disable-prewhere-in-merge-different-types 
Disable PREWHERE in storage Merge if types don't match
 2023-01-18 10:02:06 +01:00
Ilya Yatsishin
a50c6c0abe
Merge branch 'master' into improve-failed-kafka-logging 2023-01-18 02:39:32 +01:00
robot-clickhouse
237bb15a9f Automatic style fix 2023-01-17 21:34:16 +00:00
Smita Kulkarni
6e06af1b25 Updated strategy for handling internal backups & restores to avoid concurrent internal backups & restores - Added settings to disallow concurrent backups and restores 2023-01-17 22:27:13 +01:00
Yatsishin Ilya
5ae72fe711 Improve failed kafka startup logging 2023-01-17 16:25:05 +00:00
alesapin
261dc06be9 Fix flaky ttl test 2023-01-17 17:08:32 +01:00
Antonio Andelic
ba363c141a Fix integration test 2023-01-17 13:12:52 +00:00
Vitaly Baranov
8c5c423d67 Add test. 2023-01-17 13:11:24 +01:00
Sema Checherinda
2cd55bc398 fix/adjust tests in integration/test_partition 2023-01-17 12:02:18 +01:00
Vitaly Baranov
14a7ee8e26 Copy files to S3 during backup directly without using WriteBufferFromS3 to decrease memory consumption. 2023-01-17 09:35:41 +01:00
Anton Popov
6863cd152f
Merge pull request #42181 from CurtizJ/optimize-loading-parts 
Do not load inactive parts at startup
 2023-01-16 14:38:50 +01:00
Kseniia Sumarokova
75318e4cee
Merge pull request #45180 from kssenii/fix-flacky-test-multiple-disks 
Fix flaky test test_multiple_disks/test.py::test_rename
 2023-01-13 19:05:03 +01:00
Alexander Tokmakov
db91c4a749
Merge pull request #45168 from ClickHouse/tavplubix-patch-1 
Try to fix flaky test_ttl_move_memory_usage
 2023-01-13 15:01:42 +03:00
kssenii
0110b63a95 Better fix 2023-01-13 12:12:27 +01:00
Ilya Yatsishin
94e8c57d0d
Merge pull request #45094 from ClickHouse/try-fix-keeper-map 
Try fixing KeeperMap tests
 2023-01-13 00:46:43 +01:00
Yakov Olkhovskiy
842a34666c
Merge pull request #44594 from arenadata/ADQM-634 
Add keytab parameter in kerberos section of config.xml
 2023-01-12 15:07:45 -05:00
Nikolai Kochetov
e21fe952c6
Update test_ttl_move_memory_usage.py 2023-01-12 18:45:19 +01:00
Nikolai Kochetov
1911c25a7b
Merge branch 'master' into tavplubix-patch-1 2023-01-12 18:44:39 +01:00
Antonio Andelic
1f2ec534f4 Add EXISTS clauses 2023-01-12 15:39:04 +00:00
Antonio Andelic
dc4262f338 Merge branch 'master' into try-fix-keeper-map 2023-01-12 15:19:51 +00:00
Antonio Andelic
fb23a399b5
Merge pull request #45213 from ClickHouse/fix-flaky-keeper-test 
Fix flaky `test_keeper_three_nodes_two_alive`
 2023-01-12 14:57:40 +01:00
Yakov Olkhovskiy
344fa16184
Merge pull request #42991 from ClickHouse/tests-connection-error 
add retries on ConnectionError
 2023-01-12 08:32:03 -05:00
Ilya Yatsishin
23c80d77a0
Merge pull request #45206 from ClickHouse/try-fix-overcommit-test 
Disable check to make test_overcommit_tracker not flaky
 2023-01-12 14:16:11 +01:00
alesapin
df8ceeefdc
Merge pull request #45134 from ClickHouse/fix_flaky_azure_test 
Fix flaky azure test
 2023-01-12 13:02:34 +01:00
Nikita Mikhaylov
62d544e742
Fix integration test test_replicated_users::test_rename_replicated (#45192) 
* Done

* Update tests/integration/test_replicated_users/test.py

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
 2023-01-12 12:36:36 +01:00
robot-clickhouse
d61e202416 Automatic style fix 2023-01-12 11:35:03 +00:00
Antonio Andelic
feaad2bd43 try avoiding bad file descriptor 2023-01-12 11:28:41 +00:00
Antonio Andelic
97266ccabc Merge branch 'master' into try-fix-keeper-map 2023-01-12 11:16:35 +00:00
Kseniia Sumarokova
56f8899df8
Update tests/integration/test_multiple_disks/test.py 
Co-authored-by: Ilya Yatsishin <2159081+qoega@users.noreply.github.com>
 2023-01-12 12:06:31 +01:00
Antonio Andelic
0fc279e2bb Don't allow third node to become leader 2023-01-12 08:44:55 +00:00
Dmitry Novik
bed39f3762 Disable check to make test on flaky 2023-01-11 23:52:13 +00:00
kssenii
e3a1af6542 Fix flacky test 2023-01-11 23:51:03 +01:00
Ilya Yatsishin
bca117b26d
Merge pull request #45099 from ClickHouse/qoega-patch-4 
Try to fix flaky test_create_user_and_login/test.py::test_login_as_dropped_user_xml
 2023-01-11 23:37:03 +01:00
Nikolai Kochetov
653d18cb8c
Merge pull request #45162 from ClickHouse/disable-test_move_and_s3_memory_usage 
Disable test_ttl_move_memory_usage as too flaky.
 2023-01-11 20:30:28 +01:00
Ilya Yatsishin
cc352804df
Merge pull request #45156 from qoega/green-ci-5 
Fix flaky test_tcp_handler_interserver_listen_host
 2023-01-11 19:09:22 +01:00
Antonio Andelic
2c33c9e62c
Merge branch 'master' into try-fix-keeper-map 2023-01-11 15:05:04 +01:00
Alexander Tokmakov
764abb6410
try to fix flaky test_ttl_move_memory_usage 2023-01-11 15:55:18 +03:00
Nikolai Kochetov
07a3967d6b Disable test_ttl_move_memory_usage as too flaky. 2023-01-11 11:20:02 +00:00
Alexander Tokmakov
b156209ed6
Update test.py 2023-01-11 14:17:44 +03:00
Yatsishin Ilya
77f0724629 Fix flaky test_tcp_handler_interserver_listen_host 2023-01-11 10:28:30 +00:00
robot-clickhouse
6d6e803cfb Automatic style fix 2023-01-11 10:09:43 +01:00
Ilya Yatsishin
f871949d85 Try to fix flaky test_create_user_and_login/test.py::test_login_as_dropped_user_xml 2023-01-11 10:09:43 +01:00
Anton Popov
6c4f53bdca Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-11 01:00:57 +00:00
alesapin
6d86b8dd47 Fix flaky azure test 2023-01-10 19:05:02 +01:00
Antonio Andelic
7d948c9c77
Merge branch 'master' into try-fix-keeper-map 2023-01-10 15:44:28 +01:00
Antonio Andelic
134cc3e273
Change table name 2023-01-10 14:16:28 +01:00
Maksim Kita
d4a2dd43ce
Merge pull request #44891 from azat/tests/rewrite-update_field-test 
Convert integration test_dictionaries_update_field to a stateless
 2023-01-10 15:14:53 +03:00
Antonio Andelic
d7ca0c04fa
remove drop if exists 2023-01-10 11:35:02 +01:00
Antonio Andelic
7aef7d95de Small fixes for keeper_map tests 2023-01-10 09:15:07 +00:00
robot-clickhouse
46b21629ed Automatic style fix 2023-01-09 17:23:02 +00:00
Smita Kulkarni
93530e8d34 Added settings to disallow concurrent backups and restores 
Implementation:
* Added server level settings to disallow concurrent backups and restores, which are read and set when BackupWorker is created in Context.
* Settings are set to true by default.
* Before starting backup or restores, added a check to see if any other backups/restores are running (except internal ones).
Testing:
* Added a test test_backup_and_restore_on_cluster/test_disallow_concurrency.
 2023-01-09 18:14:39 +01:00
Nikita Mikhaylov
857799fbca
Parallel distributed insert select with s3Cluster [3] (#44955) 
* Revert "Revert "Resurrect parallel distributed insert select with s3Cluster (#41535)""

This reverts commit b8d9066004.

* Fix build

* Better

* Fix test

* Automatic style fix

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-01-09 13:30:32 +01:00
Kseniia Sumarokova
9ae5ad202a
Merge pull request #44707 from xiedeyantu/s3-add-config 
S3 support upload object using storage class INTELLIGENT_TIERING
 2023-01-09 13:28:53 +01:00
Roman Vasin
2995c6d866 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-634 2023-01-09 08:26:45 +00:00
Alexey Milovidov
851e4ae59f Fix typos 2023-01-08 07:08:20 +01:00
Antonio Andelic
c8d9368009 Retry on invalid snapshot 2023-01-07 17:08:25 +00:00
Anton Popov
1f32ffedf8
Merge pull request #43221 from ClickHouse/refactoring-ip-types 
Replace domain IP types (IPv4, IPv6) with native
 2023-01-07 12:01:21 +01:00
Alexey Milovidov
590ad41cbf
Merge pull request #44978 from azat/tests/fix-test_replicated_users 
tests: fix test_replicated_users flakiness
 2023-01-07 03:51:31 +03:00
Alexey Milovidov
d122d72ea8
Merge pull request #44996 from vitlibar/fix-test_grpc_protocol_progress 
Fix test test_grpc_protocol/test.py::test_progress
 2023-01-07 03:48:30 +03:00
Vitaly Baranov
e8355971bb Fix test test_grpc_protocol/test.py::test_progress 2023-01-06 19:58:20 +01:00
kssenii
dd6a2c2d37 Fix style check 2023-01-06 16:53:24 +01:00
kssenii
2a030c1dc0 Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2023-01-06 15:58:27 +01:00
Vitaly Baranov
92be50bd68 Add test for IMDS session token. 2023-01-06 15:55:26 +01:00
Vitaly Baranov
0d12d90fb5 Move common code to helpers/mock_servers.py 2023-01-06 15:55:21 +01:00
kssenii
c980e16345 Merge remote-tracking branch 'upstream/master' into storage-rabbitmq-fix-flush 2023-01-06 15:51:25 +01:00
Anton Popov
b25f875674
Merge pull request #44875 from ClickHouse/fix-another-one-cannot-read-all-data-for-lc-dict-error 
Fix right offset for reading LowCardinality dictionary from remote fs
 2023-01-06 15:24:36 +01:00
Kseniia Sumarokova
573d3283b0
Merge pull request #44327 from kssenii/use-new-named-collections-code-2 
Replace old named collections code with new (from #43147) part 2
 2023-01-06 13:06:26 +01:00
Nikolai Kochetov
12192ef099
Merge pull request #44938 from ClickHouse/try-fix-test_multiple_disks-test_freeze 
Stop merges to avoid a race between merge and freeze.
 2023-01-06 12:45:10 +01:00
Azat Khuzhin
7859346e40 tests: fix test_replicated_users flakiness 
Alter for users/quotas/... does not wait until all replicas will be up
to date, so use *_with_retries() helperx.

CI: https://s3.amazonaws.com/clickhouse-test-reports/44922/bd885be9229cf47752c5c98392f09129261550f9/integration_tests__tsan__[6/6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-06 12:45:03 +01:00
Azat Khuzhin
c03510cf6b tests/integration: add query_and_get_error_with_retry() helper 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-06 12:45:03 +01:00
Alexey Milovidov
08ebdc9b82
Merge pull request #44903 from ClickHouse/less-flaky-test-concurrent-queries 
Fix flaky `test_concurrent_queries_restriction_by_query_kind`
 2023-01-06 03:18:28 +03:00
robot-clickhouse
62a9b33bbb Automatic style fix 2023-01-05 16:29:58 +00:00
Ilya Yatsishin
a28d6fb490
Merge pull request #44848 from qoega/green-ci-2 
Pre-pulling images for integration tests to detect broken infrastructure earlier
 2023-01-05 17:29:39 +01:00
Nikolai Kochetov
90f3f5789f Speedup a bit. 2023-01-05 16:23:49 +00:00
Nikolai Kochetov
dc5009d401 Stop merges to aviod a race between merge and freeze. 2023-01-05 15:28:56 +00:00
Anton Popov
ed00399eb6 Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-05 14:12:02 +00:00
Yatsishin Ilya
1b03a60e43 Do not report status if we failed to pull images. 2023-01-05 13:53:45 +00:00
Ilya Yatsishin
c5f01a653c
Merge pull request #44880 from qoega/green-ci-4 
Rewrite test_postgres_protocol test
 2023-01-05 12:34:33 +01:00
Antonio Andelic
7dd8ac717a
Merge branch 'master' into less-flaky-test-concurrent-queries 2023-01-05 12:23:30 +01:00
Ilya Yatsishin
5d0f3e7819
Merge pull request #44921 from ClickHouse/fix-flaky-test-5 
Fix flaky test `test_lost_part`
 2023-01-05 10:28:07 +01:00
xiedeyantu
dfaa16b7a0 fix 2023-01-05 09:09:42 +08:00
xiedeyantu
110f95bae6 fix 2023-01-05 09:00:53 +08:00
Nikita Mikhaylov
e3ca9fb3e9 Blakc 2023-01-04 20:30:52 +00:00
Nikita Mikhaylov
ea7c338a7b Done 2023-01-04 20:28:03 +00:00
Yatsishin Ilya
ccb6226d22 install CH before test 2023-01-04 20:07:52 +00:00
Yakov Olkhovskiy
dadd96ba6f
Merge pull request #44135 from ClickHouse/feature-protocol-proxy 
Improve support for PROXYv1 protocol.
 2023-01-04 14:06:17 -05:00
Yatsishin Ilya
daf2ccab81 Merge remote-tracking branch 'origin/master' into green-ci-2 2023-01-04 18:27:19 +00:00
xiedeyantu
2f59b1d002 better 2023-01-05 00:27:07 +08:00
Yakov Olkhovskiy
7a5a36cbed
Merge branch 'master' into refactoring-ip-types 2023-01-04 11:11:06 -05:00
Antonio Andelic
8ee589c5c1
Merge pull request #44898 from ClickHouse/try-fix-test-storage-kafka 
Try to fix flaky `test_storage_kafka::test_kafka_produce_key_timestamp`
 2023-01-04 16:54:47 +01:00
Yatsishin Ilya
03582f4b87 move logic to runner 2023-01-04 15:52:34 +00:00
Yatsishin Ilya
9cf599e58b Merge remote-tracking branch 'origin/master' into green-ci-2 2023-01-04 15:49:22 +00:00
Yatsishin Ilya
d8d012523d add pre-pull to runner 2023-01-04 15:47:50 +00:00
alesapin
92255e5d4b
Merge pull request #43020 from vitlibar/update-aws-c-submodules 
Update aws-c* submodules
 2023-01-04 16:25:22 +01:00
Antonio Andelic
1a1afc6a74 Make test_concurrent_queries_restriction_by_query_kind less flaky 2023-01-04 14:18:35 +00:00
Nikita Mikhaylov
e9c7555365
Use TablesDependencyGraph in DatabaseReplicated recovery process (#44697) 2023-01-04 14:49:39 +01:00
Yatsishin Ilya
4d5131ed7d debug quotes 2023-01-04 13:16:31 +00:00
Antonio Andelic
890f094829 Set retention policy for Kafka topic 2023-01-04 12:04:00 +00:00
Yatsishin Ilya
08fbf6e5b2 again 2023-01-04 11:48:28 +00:00
alesapin
c09f83654d
Merge pull request #44533 from ClickHouse/40951_Allow_macro_substitution_in_endpoint 
Allow macro substitution in endpoint of disks
 2023-01-04 12:29:57 +01:00
Azat Khuzhin
0ab0f76737 Convert integration test_dictionaries_update_field to a stateless 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-04 11:05:00 +01:00
Antonio Andelic
9b58c97563 Store ZK generated data in archive 2023-01-04 09:10:16 +00:00
Alexey Milovidov
66e6f53698
Merge pull request #44839 from ClickHouse/move-odbc-test 
Move `test_dies_with_parent` to another module
 2023-01-04 05:17:19 +03:00
Alexey Milovidov
3a027d285f
Merge pull request #44828 from ClickHouse/remove-two-lines-of-code 
What if I will remove two lines of code?
 2023-01-04 04:50:52 +03:00
Ilya Yatsishin
49155d9614
Merge pull request #44711 from qoega/green-ci-1 
Improve some integration tests and add pytest-random
 2023-01-03 22:39:54 +01:00
Yatsishin Ilya
bb288c1f14 how many more? 2023-01-03 21:38:59 +00:00
Yatsishin Ilya
bbc02c0762 black 2023-01-03 21:28:54 +00:00
Yatsishin Ilya
14274d650b Rewrite test_postgres_protocol test 2023-01-03 19:30:14 +00:00
Yatsishin Ilya
683df2dea5 fix 2023-01-03 18:56:24 +00:00
Robert Schulze
27f5aad49e
What happens if I remove 156 lines of code? 2023-01-03 18:51:16 +00:00
robot-clickhouse
d6c090b530 Automatic style fix 2023-01-03 18:29:09 +00:00
Nikolai Kochetov
da26f62a9b Fix right offset for reading LowCardinality dictionary from remote fs in case if right mark was in the middle of compressed block. 2023-01-03 18:19:51 +00:00
Alexey Milovidov
a06d03e097
Merge pull request #44851 from qoega/green-ci-3 
No more retries in integration tests
 2023-01-03 19:40:34 +03:00
Yatsishin Ilya
3deada0c29 fix 2023-01-03 16:05:20 +00:00
kssenii
67509aa2d5 Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2 2023-01-03 16:41:30 +01:00
Antonio Andelic
a88171b594 Add timeout for ZK stop 2023-01-03 09:59:06 +00:00
Antonio Andelic
4ccd828a44 Wait for ZK process to stop 2023-01-03 09:39:14 +00:00