Commit Graph

5805 Commits

Author SHA1 Message Date
kssenii
cb4757fc43 Fix tests 2023-02-04 22:54:49 +01:00
Azat Khuzhin
0a598c79f4 Remove misleading information that sanitizer errors are in the docker.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-04 11:23:26 +01:00
Azat Khuzhin
88dc85e13e Dump sanitizer errors in the integration tests logs
Previously you need to download the artifacts (0.5G+-), or reproduce the
problem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-04 11:23:26 +01:00
Antonio Andelic
8929838fcc Merge branch 'master' into add-support-for-settings-alias 2023-02-03 17:47:00 +00:00
Vitaly Baranov
45d2d678ab
Merge pull request #45800 from vitlibar/rename-new-columns-in-system-backups
Rename new columns in system.backups
2023-02-03 14:00:16 +01:00
kssenii
486c10bde1 Fix named collections access 2023-02-03 13:18:54 +01:00
Kseniia Sumarokova
ef7acb9b66
Merge pull request #44404 from kssenii/storage-rabbitmq-fix-flush
RabbitMQ - fix writing many small blocks by flushing data only exactly by flush_interval_ms or by max_block_size
2023-02-03 11:50:12 +01:00
Alexey Milovidov
108d1c3442
Merge pull request #45872 from ClickHouse/fix-trash-query-kind
Remove trash, add a feature and fix a bug
2023-02-03 09:58:43 +03:00
kssenii
a391de18a1 Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2023-02-02 20:49:41 +01:00
kssenii
b72810a608 Fix tests 2023-02-02 20:16:53 +01:00
Arthur Passos
108071f052 fix style 2023-02-02 13:42:17 -03:00
Arthur Passos
6e466e3a19 fix style 2023-02-02 13:28:50 -03:00
Kseniia Sumarokova
6705fafef9
Merge branch 'master' into storage-rabbitmq-fix-flush 2023-02-02 16:06:51 +01:00
Arthur Passos
eda8ab78c2 fix integ tests 2023-02-02 11:30:16 -03:00
Antonio Andelic
f613bfd8d2 Merge branch 'master' into add-support-for-settings-alias 2023-02-02 11:15:39 +00:00
kssenii
d85ad3c219 Fix tests 2023-02-02 12:15:29 +01:00
Vitaly Baranov
b8078acce2
Merge pull request #45774 from vitlibar/wiping-sensitive-info-in-named-collection-overrides
Mask sensitive info in named collection's overrides
2023-02-02 10:06:59 +01:00
Alexey Milovidov
11e89d9aa0 Add a test 2023-02-02 04:40:45 +01:00
kssenii
bbf060bf89 Fix test 2023-02-01 18:22:05 +01:00
Arthur Passos
3d9b464758 add missing comma :) 2023-02-01 09:52:06 -03:00
Arthur Passos
e4545e1267 rename reverse_dns_config file 2023-02-01 09:37:39 -03:00
Arthur Passos
70f700941a add missing allow_reverse_dns_function 2023-02-01 08:48:46 -03:00
Alexander Gololobov
e705f11ad1
Merge pull request #45786 from ClickHouse/delete_on_cluster
Support DELETE ON CLUSTER
2023-02-01 10:52:01 +01:00
Antonio Andelic
ec04cf6876 Merge branch 'master' into add-support-for-settings-alias 2023-02-01 09:01:01 +00:00
Vitaly Baranov
96b140cc95 Rename columns in system.backups: num_files, num_processed_files, processed_files_size
num_processed_files -> num_files (BACKUP) / files_read (RESTORE)
processed_files_size -> total_size (BACKUP) / bytes_read (RESTORE)
2023-01-31 22:45:41 +01:00
kssenii
2f5842a749 Update tests 2023-01-31 20:25:08 +01:00
kssenii
4a1bdcf24c Merge remote-tracking branch 'upstream/master' into storage-rabbitmq-fix-flush 2023-01-31 18:11:26 +01:00
robot-clickhouse
a32818a32e Automatic style fix 2023-01-31 14:35:08 +00:00
Alexander Gololobov
51fdcb7ffd Test DELETE FROM on replicated database 2023-01-31 15:20:21 +01:00
Arthur Passos
58e4e35f0d remove unnecessary file mapping 2023-01-31 09:10:45 -03:00
Kseniia Sumarokova
7d53f8bbf6
Merge pull request #45591 from bharatnc/ncb/odbc-connection-pool-fixes
fixes to use the odbc_bridge_use_connection_pooling setting correctly
2023-01-31 11:31:59 +01:00
flynn
ffddc0dcce fix conflict 2023-01-31 10:28:58 +00:00
Alexander Gololobov
f9133f3d85
Merge pull request #45791 from ClickHouse/fix_drop_hung
Fix bug in tables drop which can lead to potential query hung
2023-01-31 10:11:11 +01:00
Bharat Nallan
f1d6e3b908
Merge branch 'master' into ncb/odbc-connection-pool-fixes 2023-01-30 15:49:04 -08:00
Vitaly Baranov
48023a297f Add missed test config. 2023-01-30 21:47:30 +01:00
alesapin
0908ce8e14 Add timeout 2023-01-30 17:02:58 +01:00
alesapin
be58d5d1af Fix bug in tables drop which can lead to potential query hung 2023-01-30 17:00:28 +01:00
Arthur Passos
7b1ceaa2c5
Merge branch 'master' into fix_cares_crash 2023-01-30 12:05:56 -03:00
Arthur Passos
513f430334 Add setting to enable/disable reverseDNSQuery function 2023-01-30 12:04:37 -03:00
Pradeep Chhetri
deaa70fb14
Merge branch 'master' into pchhetri/fix-45690 2023-01-30 21:35:16 +08:00
Vitaly Baranov
6ee9971931 Mask sensitive info in named collection's overrides. 2023-01-30 11:33:21 +01:00
Vitaly Baranov
38910412c4
Merge pull request #42244 from AVMusorin/fix_backup_restore_num_files
Added num_processed_files and processed_files_size for backup and restore processes
2023-01-30 09:24:49 +01:00
Arthur Passos
0e7b35c9f4 fix black 2023-01-29 13:19:03 -03:00
Arthur Passos
2a63b86796 fix black 2023-01-29 11:35:04 -03:00
Arthur Passos
6c3a5871ba added integ test 2023-01-29 11:24:47 -03:00
flynn
9b517cdc76 fix conflict 2023-01-29 08:34:56 +00:00
Pradeep Chhetri
9919fb0be9
Merge branch 'master' into pchhetri/fix-45690 2023-01-29 11:35:26 +08:00
Pradeep Chhetri
d52c841d7d Fix test 2023-01-29 11:35:00 +08:00
Pradeep Chhetri
18cf0fd2c1 Fix test 2023-01-29 10:29:10 +08:00
Pradeep Chhetri
65301cf55a Format fixes 2023-01-29 09:03:51 +08:00
Pradeep Chhetri
0e02f82665 Add test for zip archive with bad settings 2023-01-29 08:40:24 +08:00
Azat Khuzhin
3903b442fb tests: fix broken disk emulation in test_jbod_ha
The problem with chmod 000 is that it is simply ignored for the owner of
the namespace (verified with kprobe for security_capable [1]),
previously it worked only cause there was a check for uid explicitly in
FS::canRead/canWrite.

  [1]: cat-10561   [001]  1340776.172944: security_capable_retprobe: (capable_wrt_inode_uidgid+0x40/0x70 <- security_capable) arg1=0xffffffff

0xffffffff is -1 and it is EPERM

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:11:10 +01:00
Azat Khuzhin
e6695196aa tests/integration: add SYS_ADMIN capability for mount/remount
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:11:10 +01:00
Azat Khuzhin
1e3f33ad4b tests/integration: fix --privileged passthrough
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:11:10 +01:00
kssenii
68cab4bc49 Merge remote-tracking branch 'origin/storage-rabbitmq-fix-flush' into storage-rabbitmq-fix-flush 2023-01-27 17:23:05 +01:00
kssenii
f39cd0b392 Update tests 2023-01-27 17:22:24 +01:00
kssenii
9c4a97bbd1 Merge remote-tracking branch 'upstream/master' into storage-rabbitmq-fix-flush 2023-01-27 17:17:09 +01:00
robot-clickhouse
9cdc8d7b9d Automatic style fix 2023-01-27 09:46:51 +00:00
Antonio Andelic
defc9108f0 Extend support for aliases to constraints and profiles 2023-01-27 09:39:10 +00:00
Bharat Nallan Chakravarthy
70a3ffa0e6 fix test 2023-01-25 06:47:04 -08:00
Vitaly Baranov
9014023625 Fix wiping sensitive info in INSERT INTO FUNCTION. 2023-01-25 14:50:49 +01:00
Vitaly Baranov
32efe92199
Merge pull request #45487 from vitlibar/use-new-copy-s3-functions-in-s3-obj-storage
Use new copy s3 functions in S3ObjectStorage
2023-01-25 13:22:04 +01:00
Bharat Nallan
2ef8fcb318
Merge branch 'master' into ncb/odbc-connection-pool-fixes 2023-01-24 21:27:20 -08:00
Bharat Nallan Chakravarthy
fc4eba3b7b add a test 2023-01-24 16:56:56 -08:00
Vitaly Baranov
c22b0076ce Fix cleanup in tests test_replicated_merge_tree_s3_restore. 2023-01-24 18:05:44 +01:00
SmitaRKulkarni
d387835774
Merge branch 'master' into 45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores 2023-01-24 13:49:32 +01:00
Smita Kulkarni
642f9ca549 Merge branch 'master' into 45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores 2023-01-24 09:37:28 +01:00
Alexander Tokmakov
0e0e2f0f67
Update test.py 2023-01-23 19:01:06 +03:00
Aleksandr
2caeed901b
Merge branch 'master' into fix_backup_restore_num_files 2023-01-23 13:43:20 +01:00
Smita Kulkarni
383af7f3a6 Moved settings inside backups section - Updated backup/restore status when concurrent backups & restores are not allowed 2023-01-23 08:59:44 +01:00
Anton Popov
f181254fb0 fix race in destructor of ParallelParsingInputFormat 2023-01-23 01:18:58 +00:00
Smita Kulkarni
310ae62d90 Updated backup/restore status when concurrent backups & restores are not allowed
Implementation:
* Moved concurrent backup/restore check inside try-catch block which sets the status so that other nodes in cluster are aware of failures.
* Renamed backup_uuid to restore_uuid in RestoreSettings.
Testing:
* Updated test test_backup_and_restore_on_cluster/test_disallow_concurrency to check for specific backup/restore id.
2023-01-22 19:01:09 +01:00
Vitaly Baranov
5ceb64accc Use new copy s3 functions in S3ObjectStorage. 2023-01-21 15:47:58 +01:00
Vitaly Baranov
f0fda580d0
Merge pull request #45188 from vitlibar/backup-to-s3-memory-optimization
Optimize memory consumption during backup to S3
2023-01-21 12:37:35 +01:00
Sema Checherinda
962894afc8
Merge pull request #44909 from CheSema/intersect-prev-part
Do not merge over a gap with outdated undeleted parts
2023-01-21 11:51:21 +01:00
Anton Popov
41a199e175
Fix crash when ListObjects request fails (#45371) 2023-01-20 20:10:23 +01:00
Maksim Kita
23e26032ca
Merge pull request #45399 from aalexfvk/alexfvk/mdb-21326_fix_system_dictionaries_when_dictionary_with_bad_structure
Fix select from system.dictionaries when there is dictionary with bad structure
2023-01-20 13:36:32 +03:00
Antonio Andelic
0ad37ad286
Merge pull request #45320 from stigsb/system_tables_volume_config
Add <storage_policy> config parameter for system logs
2023-01-20 10:27:57 +01:00
Aleksandr Musorin
838acb22b7
added num_processed_files and processed_files_size 2023-01-20 10:20:41 +01:00
SmitaRKulkarni
6aa63414db
Merge pull request #45072 from ClickHouse/43891_Disallow_concurrent_backups_and_restores
Added settings to disallow concurrent backups and restores
2023-01-20 09:17:20 +01:00
Aleksei Filatov
42549e89f2 [rev 2] Fix review notes 2023-01-20 09:37:49 +03:00
Kseniia Sumarokova
1452d2588c
Update test.py 2023-01-19 18:06:43 +01:00
Kseniia Sumarokova
f80246644c
Update test.py 2023-01-19 18:04:09 +01:00
Kseniia Sumarokova
db49368f5e
Merge branch 'master' into storage-rabbitmq-fix-flush 2023-01-19 18:03:42 +01:00
Aleksei Filatov
afada0ecb3 Fix review notes 2023-01-19 17:02:57 +03:00
alesapin
ccd41e6d14
Merge pull request #45403 from ClickHouse/fix_test_system_merges
Reduce an amount of trash in `tests_system_merges`
2023-01-19 12:00:54 +01:00
SmitaRKulkarni
67e2bf31f5
Merge branch 'master' into 43891_Disallow_concurrent_backups_and_restores 2023-01-19 11:21:37 +01:00
Ilya Yatsishin
f16328aa8b
Merge pull request #45402 from qoega/simpler-test_replicated_merge_tree_s3_restore 2023-01-19 10:27:42 +01:00
Stig Bakken
420c179b55 Add <storage_policy> config parameter for system logs 2023-01-19 10:25:28 +01:00
SmitaRKulkarni
db03dd1bb9
Merge branch 'master' into 43891_Disallow_concurrent_backups_and_restores 2023-01-19 09:32:50 +01:00
robot-clickhouse
33a4222155 Automatic style fix 2023-01-18 15:52:38 +00:00
Alexander Tokmakov
6f8c1424df reduce an amount of trash in tests_system_merges 2023-01-18 16:45:47 +01:00
Yatsishin Ilya
1603e734f9 Make test simpler to see errors not in teardown 2023-01-18 15:36:24 +00:00
Aleksei Filatov
5e9340f682 Add integration test 2023-01-18 17:50:38 +03:00
Vitaly Baranov
7cdb2c4c7f
Merge pull request #45351 from vitlibar/fix-backup-with-killed-mutations
Fix backup with killed mutations
2023-01-18 13:14:27 +01:00
Ilya Yatsishin
9b5e7c00d5
Merge pull request #45369 from qoega/improve-failed-kafka-logging
Improve failed kafka startup logging
2023-01-18 13:09:48 +01:00
flynn
01ae8f584b fix test 2023-01-18 11:34:52 +00:00
alesapin
a4ff9027ce
Merge branch 'master' into fix_flaky_test_ttl_modify 2023-01-18 12:19:37 +01:00
Antonio Andelic
f57ee043ae
Merge pull request #45319 from ClickHouse/disable-prewhere-in-merge-different-types
Disable PREWHERE in storage Merge if types don't match
2023-01-18 10:02:06 +01:00
flynn
2fb32dc56c fix and add test 2023-01-18 08:33:55 +00:00
Ilya Yatsishin
a50c6c0abe
Merge branch 'master' into improve-failed-kafka-logging 2023-01-18 02:39:32 +01:00
robot-clickhouse
237bb15a9f Automatic style fix 2023-01-17 21:34:16 +00:00
Smita Kulkarni
6e06af1b25 Updated strategy for handling internal backups & restores to avoid concurrent internal backups & restores - Added settings to disallow concurrent backups and restores 2023-01-17 22:27:13 +01:00
Yatsishin Ilya
5ae72fe711 Improve failed kafka startup logging 2023-01-17 16:25:05 +00:00
alesapin
261dc06be9 Fix flaky ttl test 2023-01-17 17:08:32 +01:00
Antonio Andelic
ba363c141a Fix integration test 2023-01-17 13:12:52 +00:00
Vitaly Baranov
8c5c423d67 Add test. 2023-01-17 13:11:24 +01:00
Sema Checherinda
2cd55bc398 fix/adjust tests in integration/test_partition 2023-01-17 12:02:18 +01:00
Vitaly Baranov
14a7ee8e26 Copy files to S3 during backup directly without using WriteBufferFromS3 to decrease memory consumption. 2023-01-17 09:35:41 +01:00
Anton Popov
6863cd152f
Merge pull request #42181 from CurtizJ/optimize-loading-parts
Do not load inactive parts at startup
2023-01-16 14:38:50 +01:00
Kseniia Sumarokova
75318e4cee
Merge pull request #45180 from kssenii/fix-flacky-test-multiple-disks
Fix flaky test test_multiple_disks/test.py::test_rename
2023-01-13 19:05:03 +01:00
Alexander Tokmakov
db91c4a749
Merge pull request #45168 from ClickHouse/tavplubix-patch-1
Try to fix flaky test_ttl_move_memory_usage
2023-01-13 15:01:42 +03:00
kssenii
0110b63a95 Better fix 2023-01-13 12:12:27 +01:00
Ilya Yatsishin
94e8c57d0d
Merge pull request #45094 from ClickHouse/try-fix-keeper-map
Try fixing KeeperMap tests
2023-01-13 00:46:43 +01:00
Yakov Olkhovskiy
842a34666c
Merge pull request #44594 from arenadata/ADQM-634
Add keytab parameter in kerberos section of config.xml
2023-01-12 15:07:45 -05:00
Nikolai Kochetov
e21fe952c6
Update test_ttl_move_memory_usage.py 2023-01-12 18:45:19 +01:00
Nikolai Kochetov
1911c25a7b
Merge branch 'master' into tavplubix-patch-1 2023-01-12 18:44:39 +01:00
Antonio Andelic
1f2ec534f4 Add EXISTS clauses 2023-01-12 15:39:04 +00:00
Antonio Andelic
dc4262f338 Merge branch 'master' into try-fix-keeper-map 2023-01-12 15:19:51 +00:00
Antonio Andelic
fb23a399b5
Merge pull request #45213 from ClickHouse/fix-flaky-keeper-test
Fix flaky `test_keeper_three_nodes_two_alive`
2023-01-12 14:57:40 +01:00
Yakov Olkhovskiy
344fa16184
Merge pull request #42991 from ClickHouse/tests-connection-error
add retries on ConnectionError
2023-01-12 08:32:03 -05:00
Ilya Yatsishin
23c80d77a0
Merge pull request #45206 from ClickHouse/try-fix-overcommit-test
Disable check to make test_overcommit_tracker not flaky
2023-01-12 14:16:11 +01:00
alesapin
df8ceeefdc
Merge pull request #45134 from ClickHouse/fix_flaky_azure_test
Fix flaky azure test
2023-01-12 13:02:34 +01:00
Nikita Mikhaylov
62d544e742
Fix integration test test_replicated_users::test_rename_replicated (#45192)
* Done

* Update tests/integration/test_replicated_users/test.py

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
2023-01-12 12:36:36 +01:00
robot-clickhouse
d61e202416 Automatic style fix 2023-01-12 11:35:03 +00:00
Antonio Andelic
feaad2bd43 try avoiding bad file descriptor 2023-01-12 11:28:41 +00:00
Antonio Andelic
97266ccabc Merge branch 'master' into try-fix-keeper-map 2023-01-12 11:16:35 +00:00
Kseniia Sumarokova
56f8899df8
Update tests/integration/test_multiple_disks/test.py
Co-authored-by: Ilya Yatsishin <2159081+qoega@users.noreply.github.com>
2023-01-12 12:06:31 +01:00
Antonio Andelic
0fc279e2bb Don't allow third node to become leader 2023-01-12 08:44:55 +00:00
Dmitry Novik
bed39f3762 Disable check to make test on flaky 2023-01-11 23:52:13 +00:00
kssenii
e3a1af6542 Fix flacky test 2023-01-11 23:51:03 +01:00
Ilya Yatsishin
bca117b26d
Merge pull request #45099 from ClickHouse/qoega-patch-4
Try to fix flaky test_create_user_and_login/test.py::test_login_as_dropped_user_xml
2023-01-11 23:37:03 +01:00
Nikolai Kochetov
653d18cb8c
Merge pull request #45162 from ClickHouse/disable-test_move_and_s3_memory_usage
Disable test_ttl_move_memory_usage as too flaky.
2023-01-11 20:30:28 +01:00
Ilya Yatsishin
cc352804df
Merge pull request #45156 from qoega/green-ci-5
Fix flaky test_tcp_handler_interserver_listen_host
2023-01-11 19:09:22 +01:00
Antonio Andelic
2c33c9e62c
Merge branch 'master' into try-fix-keeper-map 2023-01-11 15:05:04 +01:00
Alexander Tokmakov
764abb6410
try to fix flaky test_ttl_move_memory_usage 2023-01-11 15:55:18 +03:00
Nikolai Kochetov
07a3967d6b Disable test_ttl_move_memory_usage as too flaky. 2023-01-11 11:20:02 +00:00
Alexander Tokmakov
b156209ed6
Update test.py 2023-01-11 14:17:44 +03:00
Yatsishin Ilya
77f0724629 Fix flaky test_tcp_handler_interserver_listen_host 2023-01-11 10:28:30 +00:00
robot-clickhouse
6d6e803cfb Automatic style fix 2023-01-11 10:09:43 +01:00
Ilya Yatsishin
f871949d85 Try to fix flaky test_create_user_and_login/test.py::test_login_as_dropped_user_xml 2023-01-11 10:09:43 +01:00
Anton Popov
6c4f53bdca Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-11 01:00:57 +00:00
alesapin
6d86b8dd47 Fix flaky azure test 2023-01-10 19:05:02 +01:00
Antonio Andelic
7d948c9c77
Merge branch 'master' into try-fix-keeper-map 2023-01-10 15:44:28 +01:00
Antonio Andelic
134cc3e273
Change table name 2023-01-10 14:16:28 +01:00
Maksim Kita
d4a2dd43ce
Merge pull request #44891 from azat/tests/rewrite-update_field-test
Convert integration test_dictionaries_update_field to a stateless
2023-01-10 15:14:53 +03:00
Antonio Andelic
d7ca0c04fa
remove drop if exists 2023-01-10 11:35:02 +01:00
Antonio Andelic
7aef7d95de Small fixes for keeper_map tests 2023-01-10 09:15:07 +00:00
robot-clickhouse
46b21629ed Automatic style fix 2023-01-09 17:23:02 +00:00
Smita Kulkarni
93530e8d34 Added settings to disallow concurrent backups and restores
Implementation:
* Added server level settings to disallow concurrent backups and restores, which are read and set when BackupWorker is created in Context.
* Settings are set to true by default.
* Before starting backup or restores, added a check to see if any other backups/restores are running (except internal ones).
Testing:
* Added a test test_backup_and_restore_on_cluster/test_disallow_concurrency.
2023-01-09 18:14:39 +01:00