Commit Graph

5804 Commits

Author SHA1 Message Date
Alexey Milovidov
732a030036
Merge pull request #46288 from azat/tests/simplify-attach-from-s3
Simplify ATTACH MergeTree table FROM S3 in tests
2023-02-12 05:31:24 +03:00
Kseniia Sumarokova
ed6f623f3a
Merge pull request #46168 from kssenii/resubmit-prefetches
Allow to increase prefetching of data for reads
2023-02-11 16:22:47 +01:00
Kruglov Pavel
e84baa9106
Merge pull request #43179 from tonickkozlov/tonickkozlov/add-interserver-dns-retries
CLICKHOUSE-2375 Add interserver DNS retries
2023-02-11 14:35:40 +01:00
kssenii
3067c1d723 Merge remote-tracking branch 'upstream/master' into resubmit-prefetches 2023-02-11 11:36:23 +01:00
Azat Khuzhin
67b47fe871 Simplify ATTACH MergeTree table FROM S3 in tests
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-11 08:46:05 +01:00
Kruglov Pavel
cf14282d79
Fix style 2023-02-11 01:45:28 +01:00
Kruglov Pavel
825a5dd806
Try prevent flaky test 2023-02-10 23:12:32 +01:00
Kseniia Sumarokova
3be36c7979
Merge pull request #41976 from kssenii/allow-single-disk-instead-of-storage-policy
Allow configuring storage as `SETTINGS disk='<disk_name>'` (instead of `storage_policy`) and explicit disk creation `SETTINGS disk=disk(<disk_configuration>)`
2023-02-10 21:38:50 +01:00
Anton Popov
1205932a19 add setting to disable vertical merges from compact parts 2023-02-10 16:33:46 +00:00
Antonio Andelic
9e11f06e79
Merge pull request #46191 from ClickHouse/s3-reorder-creds
Prefer explicitly defined credentials for S3
2023-02-10 16:35:54 +01:00
Sema Checherinda
4827c70b5e
Merge pull request #46233 from ClickHouse/CheSema-patch-1
increase a time gap between insert and ttl move
2023-02-10 15:36:56 +01:00
DanRoscigno
043c1b7d8d docs for logger stream_compression 2023-02-10 09:02:54 -05:00
robot-clickhouse
fa424ae8eb Automatic style fix 2023-02-10 14:01:19 +00:00
Nikolai Kochetov
367136697d Added tests. 2023-02-10 13:51:02 +00:00
flynn
37a850bd36 Merge branch 'master' of github.com:ClickHouse/ClickHouse into iceberg 2023-02-10 08:47:14 +00:00
flynn
db15634a01 fix conflict 2023-02-10 08:41:04 +00:00
Alexander Tokmakov
e5f8a44b87
Merge pull request #46243 from ClickHouse/tavplubix-patch-7
Fix test_distributed_ddl_parallel
2023-02-09 22:15:08 +03:00
Alexander Tokmakov
f7c7c9be31
Update test.py 2023-02-09 20:37:47 +03:00
Alexander Tokmakov
e2be729aea
Update test.py 2023-02-09 20:27:24 +03:00
Antonio Andelic
f96d480563
Merge branch 'master' into add-support-for-settings-alias 2023-02-09 16:07:45 +01:00
Sema Checherinda
ffc97908ef
increase a time gap between insert and ttl move 2023-02-09 15:12:21 +01:00
Vitaly Baranov
39bacfb9dc
Merge branch 'master' into allow-single-disk-instead-of-storage-policy 2023-02-09 13:16:55 +01:00
robot-clickhouse
2f9ad860bd Automatic style fix 2023-02-09 08:26:36 +00:00
Antonio Andelic
ae731b739a Prefer explicitly defined creds for S3 2023-02-09 08:13:16 +00:00
pufit
7cf71d1f82
Merge pull request #46144 from ClickHouse/46131-fix-config-attributes-merge
Fix config merge for XML attributes.
2023-02-08 23:28:13 -05:00
Alexander Tokmakov
4fd4058259
Merge pull request #45629 from arthurpassos/fix_cares_crash
Cancel c-ares failed requests and retry on system interrupts to prevent callbacks with dangling references and premature resolution failures
2023-02-09 02:29:29 +03:00
Alexander Tokmakov
65cbb0fcfc
Merge pull request #46138 from vitlibar/fix-dependency-checks
Fix dependency checks
2023-02-09 00:54:40 +03:00
kssenii
b0b865c32e Resubmit prefetches 2023-02-08 21:26:24 +01:00
Kseniia Sumarokova
f6ebe11350
Merge pull request #46108 from azat/azure-fix
Fix test_merge_tree_azure_blob_storage::test_zero_copy_replication test
2023-02-08 12:04:46 +01:00
Alexey Milovidov
5145beb033
Merge branch 'master' into 46131-fix-config-attributes-merge 2023-02-08 10:42:54 +03:00
Alexey Milovidov
da22a770a0
Merge pull request #46107 from kssenii/rabbit-test-overloaded-insert-fix
Fix flaky rabbitmq test
2023-02-08 04:14:03 +03:00
robot-clickhouse
6fda4902d8 Automatic style fix 2023-02-07 23:57:14 +00:00
pufit
982f588f71 \n before EOF 2023-02-07 23:50:57 +00:00
pufit
c066c0dfdb Fix config merge for an attributes 2023-02-07 23:46:13 +00:00
Vitaly Baranov
3db9d58fcf Added test. 2023-02-07 23:46:48 +01:00
Kseniia Sumarokova
a5d3b00699
Merge pull request #46010 from kssenii/named-collections-fix-access
Fix named collections access
2023-02-07 23:20:22 +01:00
kssenii
022d4308ce Address review comments 2023-02-07 13:01:55 +01:00
Azat Khuzhin
bca85c6852 Fix test_merge_tree_azure_blob_storage::test_zero_copy_replication test
Here is an example of an error [1]:

    2023.02.06 21:59:09.076849 [ 200 ] {} <Information> DiskObjectStorage(DiskAzureBlobStorage): Starting up disk blob_storage_disk
    2023.02.06 21:59:09.076897 [ 200 ] {} <Information> DiskObjectStorage(DiskAzureBlobStorage): Disk blob_storage_disk started up
    2023.02.06 21:59:09.077263 [ 200 ] {} <Trace> StoragePolicy (blob_storage_policy): Storage policy blob_storage_policy created, total volumes 1
    2023.02.06 21:59:09.077318 [ 200 ] {} <Information> StoragePolicySelector: Storage policy `blob_storage_policy` loaded
    ...
    2023.02.06 21:59:09.227326 [ 1 ] {} <Error> Application: std::exception. Code: 1001, type: Azure::Storage::StorageException, e.what() = 409 The specified container already exists.
    The specified container already exists.
    RequestId:73d54dcf-0c66-489c-b9b8-2b5398df9384
    Time:2023-02-06T21:59:08.225Z
    Request ID: 73d54dcf-0c66-489c-b9b8-2b5398df9384, Stack trace (when copying this message, always include the lines below):

    0. ./build_docker/../contrib/llvm-project/libcxx/include/exception:134: std::runtime_error::runtime_error() @ 0x44297b8d in /usr/bin/clickhouse
    ...
    5. ./build_docker/../contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::getAzureBlobContainerClient() @ 0x2f5b225f in /usr/bin/clickhouse
    6. ./build_docker/../src/Disks/ObjectStorages/AzureBlobStorage/registerDiskAzureBlobStorage.cpp:0:
    10. ./build_docker/../src/Interpreters/Context.cpp:0: DB::Context::getDisksMap() const @ 0x2f95af47 in /usr/bin/clickhouse
    ...
    13. ./build_docker/../contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::AsynchronousMetrics::start() @ 0x1f4d6161 in /usr/bin/clickhouse
    14. ./build_docker/../programs/server/Server.cpp:0: DB::Server::main() @ 0x1f3a5bfb in /usr/bin/clickhouse
    15. ./build_docker/../contrib/poco/Util/src/Application.cpp:0: Poco::Util::Application::run() @ 0x3c7546bf in /usr/bin/clickhouse
    16. ./build_docker/../programs/server/Server.cpp:476: DB::Server::run() @ 0x1f381f7b in /usr/bin/clickhouse
    17. ./build_docker/../contrib/poco/Util/src/ServerApplication.cpp:612: Poco::Util::ServerApplication::run(int, char**) @ 0x3c797ee0 in /usr/bin/clickhouse
    18. ./build_docker/../programs/server/Server.cpp:0: mainEntryClickHouseServer(int, char**) @ 0x1f37a262 in /usr/bin/clickhouse
    19. ./build_docker/../programs/main.cpp:0: main @ 0xe9d21ae in /usr/bin/clickhouse
    20. __libc_start_main @ 0x7f58271a1083 in ?
    21. _start @ 0xe90ef6e in /usr/bin/clickhouse
     (version 23.2.1.1)
    2023.02.06 21:59:09.227971 [ 1 ] {} <Error> Application: 409 The specified container already exists.
    The specified container already exists.
    RequestId:73d54dcf-0c66-489c-b9b8-2b5398df9384
    Time:2023-02-06T21:59:08.225Z
    Request ID: 73d54dcf-0c66-489c-b9b8-2b5398df9384

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/46045/bd4170e03c6af583a51d12d2c39fa775dcb9997b/integration_tests__asan__[6/6].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-07 12:52:36 +01:00
kssenii
427f2d0257 Try fix rabbit test 2023-02-07 12:36:25 +01:00
robot-clickhouse
7aeacabe2f Automatic style fix 2023-02-06 13:20:15 +00:00
Kseniia Sumarokova
d52420c548
Update test.py 2023-02-06 14:10:33 +01:00
kssenii
631c460c96 Add forgitten config file 2023-02-06 11:35:30 +01:00
Antonio Andelic
61ddae6c2f
Merge pull request #46041 from azat/ci/improve-integration-sanitizer-report
Dump sanitizer errors in the integration tests logs
2023-02-06 09:42:26 +01:00
flynn
0dd8a61a8e fix conflict 2023-02-06 03:25:12 +00:00
kssenii
9937e73fa9 Fix integration test 2023-02-05 22:38:07 +01:00
kssenii
3042e9ee6e Fix integration test 2023-02-05 13:39:13 +01:00
robot-clickhouse
fb288ad5f7 Automatic style fix 2023-02-05 11:58:51 +00:00
Kseniia Sumarokova
7a11b37dae
Update test.py 2023-02-05 12:54:03 +01:00
kssenii
84ea48b555 Merge remote-tracking branch 'origin/named-collections-fix-access' into named-collections-fix-access 2023-02-04 23:32:56 +01:00
kssenii
cb4757fc43 Fix tests 2023-02-04 22:54:49 +01:00
Azat Khuzhin
0a598c79f4 Remove misleading information that sanitizer errors are in the docker.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-04 11:23:26 +01:00
Azat Khuzhin
88dc85e13e Dump sanitizer errors in the integration tests logs
Previously you need to download the artifacts (0.5G+-), or reproduce the
problem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-04 11:23:26 +01:00
Antonio Andelic
8929838fcc Merge branch 'master' into add-support-for-settings-alias 2023-02-03 17:47:00 +00:00
Vitaly Baranov
45d2d678ab
Merge pull request #45800 from vitlibar/rename-new-columns-in-system-backups
Rename new columns in system.backups
2023-02-03 14:00:16 +01:00
kssenii
486c10bde1 Fix named collections access 2023-02-03 13:18:54 +01:00
Kseniia Sumarokova
ef7acb9b66
Merge pull request #44404 from kssenii/storage-rabbitmq-fix-flush
RabbitMQ - fix writing many small blocks by flushing data only exactly by flush_interval_ms or by max_block_size
2023-02-03 11:50:12 +01:00
Alexey Milovidov
108d1c3442
Merge pull request #45872 from ClickHouse/fix-trash-query-kind
Remove trash, add a feature and fix a bug
2023-02-03 09:58:43 +03:00
kssenii
a391de18a1 Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2023-02-02 20:49:41 +01:00
kssenii
b72810a608 Fix tests 2023-02-02 20:16:53 +01:00
Arthur Passos
108071f052 fix style 2023-02-02 13:42:17 -03:00
Arthur Passos
6e466e3a19 fix style 2023-02-02 13:28:50 -03:00
Kseniia Sumarokova
6705fafef9
Merge branch 'master' into storage-rabbitmq-fix-flush 2023-02-02 16:06:51 +01:00
Arthur Passos
eda8ab78c2 fix integ tests 2023-02-02 11:30:16 -03:00
Antonio Andelic
f613bfd8d2 Merge branch 'master' into add-support-for-settings-alias 2023-02-02 11:15:39 +00:00
kssenii
d85ad3c219 Fix tests 2023-02-02 12:15:29 +01:00
Vitaly Baranov
b8078acce2
Merge pull request #45774 from vitlibar/wiping-sensitive-info-in-named-collection-overrides
Mask sensitive info in named collection's overrides
2023-02-02 10:06:59 +01:00
Alexey Milovidov
11e89d9aa0 Add a test 2023-02-02 04:40:45 +01:00
kssenii
bbf060bf89 Fix test 2023-02-01 18:22:05 +01:00
Arthur Passos
3d9b464758 add missing comma :) 2023-02-01 09:52:06 -03:00
Arthur Passos
e4545e1267 rename reverse_dns_config file 2023-02-01 09:37:39 -03:00
Arthur Passos
70f700941a add missing allow_reverse_dns_function 2023-02-01 08:48:46 -03:00
Alexander Gololobov
e705f11ad1
Merge pull request #45786 from ClickHouse/delete_on_cluster
Support DELETE ON CLUSTER
2023-02-01 10:52:01 +01:00
Antonio Andelic
ec04cf6876 Merge branch 'master' into add-support-for-settings-alias 2023-02-01 09:01:01 +00:00
Vitaly Baranov
96b140cc95 Rename columns in system.backups: num_files, num_processed_files, processed_files_size
num_processed_files -> num_files (BACKUP) / files_read (RESTORE)
processed_files_size -> total_size (BACKUP) / bytes_read (RESTORE)
2023-01-31 22:45:41 +01:00
kssenii
2f5842a749 Update tests 2023-01-31 20:25:08 +01:00
kssenii
4a1bdcf24c Merge remote-tracking branch 'upstream/master' into storage-rabbitmq-fix-flush 2023-01-31 18:11:26 +01:00
robot-clickhouse
a32818a32e Automatic style fix 2023-01-31 14:35:08 +00:00
Alexander Gololobov
51fdcb7ffd Test DELETE FROM on replicated database 2023-01-31 15:20:21 +01:00
Arthur Passos
58e4e35f0d remove unnecessary file mapping 2023-01-31 09:10:45 -03:00
Kseniia Sumarokova
7d53f8bbf6
Merge pull request #45591 from bharatnc/ncb/odbc-connection-pool-fixes
fixes to use the odbc_bridge_use_connection_pooling setting correctly
2023-01-31 11:31:59 +01:00
flynn
ffddc0dcce fix conflict 2023-01-31 10:28:58 +00:00
Alexander Gololobov
f9133f3d85
Merge pull request #45791 from ClickHouse/fix_drop_hung
Fix bug in tables drop which can lead to potential query hung
2023-01-31 10:11:11 +01:00
Bharat Nallan
f1d6e3b908
Merge branch 'master' into ncb/odbc-connection-pool-fixes 2023-01-30 15:49:04 -08:00
Vitaly Baranov
48023a297f Add missed test config. 2023-01-30 21:47:30 +01:00
alesapin
0908ce8e14 Add timeout 2023-01-30 17:02:58 +01:00
alesapin
be58d5d1af Fix bug in tables drop which can lead to potential query hung 2023-01-30 17:00:28 +01:00
Arthur Passos
7b1ceaa2c5
Merge branch 'master' into fix_cares_crash 2023-01-30 12:05:56 -03:00
Arthur Passos
513f430334 Add setting to enable/disable reverseDNSQuery function 2023-01-30 12:04:37 -03:00
Pradeep Chhetri
deaa70fb14
Merge branch 'master' into pchhetri/fix-45690 2023-01-30 21:35:16 +08:00
Vitaly Baranov
6ee9971931 Mask sensitive info in named collection's overrides. 2023-01-30 11:33:21 +01:00
Vitaly Baranov
38910412c4
Merge pull request #42244 from AVMusorin/fix_backup_restore_num_files
Added num_processed_files and processed_files_size for backup and restore processes
2023-01-30 09:24:49 +01:00
Arthur Passos
0e7b35c9f4 fix black 2023-01-29 13:19:03 -03:00
Arthur Passos
2a63b86796 fix black 2023-01-29 11:35:04 -03:00
Arthur Passos
6c3a5871ba added integ test 2023-01-29 11:24:47 -03:00
flynn
9b517cdc76 fix conflict 2023-01-29 08:34:56 +00:00
Pradeep Chhetri
9919fb0be9
Merge branch 'master' into pchhetri/fix-45690 2023-01-29 11:35:26 +08:00
Pradeep Chhetri
d52c841d7d Fix test 2023-01-29 11:35:00 +08:00
Pradeep Chhetri
18cf0fd2c1 Fix test 2023-01-29 10:29:10 +08:00
Pradeep Chhetri
65301cf55a Format fixes 2023-01-29 09:03:51 +08:00
Pradeep Chhetri
0e02f82665 Add test for zip archive with bad settings 2023-01-29 08:40:24 +08:00