Alexey Milovidov
3938d7156a
Merge branch 'master' into fix-for-local-object-storage
2024-03-02 19:44:12 +01:00
Alexander Gololobov
2dd83a09e3
No need to capture this
2024-03-01 13:40:09 +01:00
Nikita Mikhaylov
590c30a23a
Update DiskObjectStorageTransaction.cpp
2024-03-01 13:40:09 +01:00
Alexander Gololobov
b45ff56e4d
Do not check to and from files existence in metadata_storage because it does not see uncommitted changes
2024-03-01 13:40:09 +01:00
Robert Schulze
3a5c9b627b
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-src
2024-03-01 10:31:55 +00:00
Smita Kulkarni
0f2d47e5a4
Renamed WriteBufferFromS3TaskTracker to ThreadPoolTaskTracker
2024-03-01 10:52:44 +01:00
Kseniia Sumarokova
5ac53c9578
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges
2024-03-01 11:05:47 +08:00
Robert Schulze
4ee1aa8c7c
Fixing more headers
2024-02-29 15:40:30 +00:00
Nikita Taranov
f9d1c5769e
Merge branch 'master' into express_support
2024-02-29 16:26:43 +01:00
Aleksei Filatov
8b1a1d42da
Traverse shadow directory for system.remote_data_paths
2024-02-29 18:07:00 +03:00
Smita Kulkarni
3c00d19261
Merge branch 'master' into Azure_write_buffer
2024-02-29 13:39:31 +01:00
Michael Kolupaev
42437a2ae1
Userspace page cache ( #53770 )
...
* Userspace page cache
* Maybe it'll build this time, who knows.
* 'auto' went out of fashion, I guess
* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary
* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.
* Fix
* Another fix
* Fix restricted seek, fix ppc64le build
* Don't allow page cache with file cache
* Adjust tests a little
* Fix clang-tidy
* Conflicts
* Comments
* Maybe unbroke AsynchronousBoundedReadBuffer
* SettingsChangesHistory.h
* Fix warning in test
2024-02-29 12:28:32 +00:00
Alexander Tokmakov
15e1191f74
Revert "Userspace page cache ( #53770 )"
...
This reverts commit 7b55c61551
2024-02-29 13:20:17 +01:00
Michael Kolupaev
7b55c61551
Userspace page cache ( #53770 )
...
* Userspace page cache
* Maybe it'll build this time, who knows.
* 'auto' went out of fashion, I guess
* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary
* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.
* Fix
* Another fix
* Fix restricted seek, fix ppc64le build
* Don't allow page cache with file cache
* Adjust tests a little
* Fix clang-tidy
* Conflicts
* Comments
* Maybe unbroke AsynchronousBoundedReadBuffer
* SettingsChangesHistory.h
* Fix warning in test
2024-02-29 11:27:32 +00:00
Smita Kulkarni
a168a84624
Merge branch 'master' into Fix_endpoint_for_azureblobstorage
2024-02-29 10:55:31 +01:00
Smita Kulkarni
5d68c9f046
Updated default value of endpoint_contains_account_name to true
2024-02-29 09:38:13 +01:00
Kseniia Sumarokova
0d4648b535
Fix clang-tidy
2024-02-29 10:30:17 +08:00
Nikita Taranov
974ba7364f
better
2024-02-29 00:55:17 +01:00
Robert Schulze
a1c164a758
Fix a bunch of clang-tidy warnings in headers
2024-02-28 23:43:12 +00:00
Smita Kulkarni
a46d7c9191
Updated docs and addressed comments
2024-02-28 11:25:35 +01:00
kssenii
cb8390e9c8
Fix build
2024-02-28 13:32:43 +08:00
Smita Kulkarni
ca05557659
Fix typo
2024-02-27 19:16:36 +01:00
Smita Kulkarni
414c8da128
Fix build
2024-02-27 18:09:21 +01:00
kssenii
4243ac160f
Merge remote-tracking branch 'origin/master' into fix-usage-of-plain-metadata
2024-02-27 23:28:48 +08:00
kssenii
98b27fd45f
Fix style check
2024-02-27 23:00:27 +08:00
Smita Kulkarni
ae309e6ea9
Updated to set proper prefix for azure blob storage disk
2024-02-27 11:12:19 +01:00
kssenii
978fe9fa1a
Add comments
2024-02-27 17:43:34 +08:00
kssenii
fb38bd139c
Remove debug logging
2024-02-27 17:38:02 +08:00
kssenii
f53f43b78d
Fixes for LocalObjectStorage and plain metadata
2024-02-27 17:33:47 +08:00
kssenii
277e8d9655
Fix usage plain metadata type with new configuration option
2024-02-26 17:27:45 +08:00
Nikita Taranov
835b47519a
impl
2024-02-25 00:33:50 +01:00
kssenii
f1e95fb78b
Add a way to force read-through cache for merges
2024-02-22 15:40:00 +01:00
Smita Kulkarni
3eb1f24770
Merge branch 'master' into Azure_write_buffer
2024-02-22 11:31:47 +01:00
Smita Kulkarni
0eefab131d
Updated pos check
2024-02-22 11:05:33 +01:00
Smita Kulkarni
f1d5892d50
Fix style check
2024-02-22 10:06:33 +01:00
Smita Kulkarni
29b7bf64d4
Fix issues with endpoint and prefix
2024-02-21 20:04:12 +01:00
Kseniia Sumarokova
2a30d6b9d4
Update ObjectStorageFactory.cpp
2024-02-20 10:57:32 +01:00
kssenii
a2fa67c280
Allow local type for local_blob_storage
2024-02-20 10:54:33 +01:00
zvonand
e06d1fea26
use insert return value to check uniqueness
2024-02-20 10:19:52 +01:00
zvonand
622f3ebbe1
update behavior to be more intuitive
2024-02-20 10:19:52 +01:00
zvonand
e0d8a77792
fix typos and docs
2024-02-20 10:19:51 +01:00
zvonand
811027aa00
sort -> stable_sort
2024-02-20 10:19:51 +01:00
zvonand
1701183ced
add volume_priority description in docs
2024-02-20 10:19:51 +01:00
zvonand
fbe5d61b3b
added 'volume_priority' tag to volumes in storage policies
2024-02-20 10:19:51 +01:00
Vitaly Baranov
3323d5ce81
Move threadPoolCallbackRunner to the "Common" folder.
2024-02-17 21:59:51 +01:00
Smita Kulkarni
62dfa4c65d
Merge branch 'master' into Azure_write_buffer
2024-02-16 11:19:44 +01:00
Smita Kulkarni
7bf42fd86e
Fix upgrade check
2024-02-16 11:16:14 +01:00
Kseniia Sumarokova
0f9cf00740
Merge pull request #59630 from vitlibar/fix-read-beyond-last-offset
...
Fix error "Read beyond last offset" for AsynchronousBoundedReadBuffer
2024-02-16 11:11:17 +01:00
Alexey Milovidov
46fb01c4f6
Fix trash
2024-02-15 02:31:46 +01:00
Vitaly Baranov
d842c497e6
Change code to pass test 02963_remote_read_small_buffer_size_bug.
2024-02-14 20:47:34 +01:00
Smita Kulkarni
26fd3d0d85
Removed offset check
2024-02-14 16:13:53 +01:00
Vitaly Baranov
8919e3b011
Add test.
2024-02-14 13:41:23 +01:00
Vitaly Baranov
eb3836ac5a
Fix error "Read beyond last offset" for AsynchronousBoundedReadBuffer.
2024-02-14 13:41:18 +01:00
Alexey Milovidov
98f7602ea1
Less conflicts
2024-02-14 03:01:03 +01:00
Smita Kulkarni
d12ecdc5f0
Asynchronous WriteBuffer for AzureBlobStorage
2024-02-13 12:35:17 +01:00
Nikita Mikhaylov
4b85f6b39a
Revert "Less error prone interface of read buffers" ( #59911 )
2024-02-13 12:02:46 +01:00
Maksim Kita
dc52def9eb
Revert "Revert "Poco Logger small refactoring""
2024-02-09 21:39:35 +03:00
Smita Kulkarni
e594608c42
Merge branch 'master' into Azure_backup
2024-02-07 13:48:46 +01:00
Smita Kulkarni
b0994c5fa7
Addressed comments, added test for named collection
2024-02-04 11:28:20 +01:00
Raúl Marín
87d493533c
Revert "Poco Logger small refactoring"
2024-02-02 12:10:05 +01:00
Maksim Kita
88f1381739
Poco Logger small refactoring
2024-02-01 12:51:50 +03:00
Alexey Milovidov
2a1cbc2db4
Merge pull request #59354 from CurtizJ/better-memory-usage-async-read
...
Slightly better memory usage in `AsynchronousBoundedReadBuffer`
2024-01-30 03:55:42 +01:00
Anton Popov
182d1c08b8
slightly better memory usage in AsynchronousBoundedReadBuffer
2024-01-29 21:21:52 +00:00
Smita Kulkarni
6bfa910d9e
Fix merge
2024-01-29 16:47:02 +01:00
Maksim Kita
5affd6af2e
IVolume constructor improve exception message
2024-01-29 15:32:22 +03:00
Smita Kulkarni
3183026521
Merge branch 'master' into Azure_backup
2024-01-29 11:08:13 +01:00
Smita Kulkarni
99a1b269d7
Removed unwanted setting
2024-01-29 11:00:59 +01:00
Smita Kulkarni
a22b68f46f
Added setting azure_max_single_part_copy_size
2024-01-29 10:49:36 +01:00
Kseniia Sumarokova
6903957414
Merge pull request #59001 from ClickHouse/Add_configurable_write_retry_azure
...
Add settings max_unexpected_write_error_retries for Azure Blob Storage
2024-01-29 10:48:17 +01:00
Smita Kulkarni
d264a5a148
Update client & settings to std::shared_ptr<const>
2024-01-28 12:06:52 +01:00
Azat Khuzhin
d79c1f7e1c
Fix MetadataStorageFromPlainObjectStorage::iterateDirectory() (add prefix)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:47:35 +01:00
Azat Khuzhin
9ce18bbf43
Implement MetadataStorageFromPlainObjectStorageTransaction::removeDirectory (for DROP TABLE)
...
This is required to remove format_version.txt for MergeTree after DROP
(lldb) bt
* thread 192, name = 'BgSchPool', stop reason = breakpoint 1.1
frame 0: 0x0000000016c7f452 clickhouse`__cxa_throw(thrown_object=0x00007ffd7a53c480, tinfo=0x00000000011602a0, dest=(clickhouse`DB::Exception::~Exception() at Exception.h:40)) + 18 at cxa_exception.cpp:258
frame 1: 0x00000000109bf709 clickhouse`DB::IMetadataTransaction::throwNotImplemented() + 137 at IMetadataStorage.h:151
frame 2: 0x00000000109bf126 clickhouse`DB::IMetadataTransaction::removeDirectory(this=<unavailable>, (null)=<unavailable>) + 6 at IMetadataStorage.h:96
frame 3: 0x0000000010968978 clickhouse`DB::(anonymous namespace)::RemoveRecursiveObjectStorageOperation::removeMetadataRecursive(this=0x00007ffd7a7327a0, tx=std::__1::shared_ptr<DB::IMetadataTransaction>::element_type @ 0x00007ffd7a6f6018 strong=4 weak=1, path_to_remove="tmp_insert_all_2_2_0") + 376 at DiskObjectStorageTransaction.cpp:364
frame 4: 0x000000001096893d clickhouse`DB::(anonymous namespace)::RemoveRecursiveObjectStorageOperation::removeMetadataRecursive(this=0x00007ffd7a7327a0, tx=std::__1::shared_ptr<DB::IMetadataTransaction>::element_type @ 0x00007ffd7a6f6018 strong=4 weak=1, path_to_remove="store/27f/27f6f9d2-ab2e-4817-b771-0e706e485b15/") + 317 at DiskObjectStorageTransaction.cpp:362
frame 5: 0x0000000010965a7f clickhouse`DB::(anonymous namespace)::RemoveRecursiveObjectStorageOperation::execute(this=0x00007ffd7a7327a0, tx=std::__1::shared_ptr<DB::IMetadataTransaction>::element_type @ 0x00007ffd7a6f6018 strong=4 weak=1) + 95 at DiskObjectStorageTransaction.cpp:372
frame 6: 0x0000000010963a2f clickhouse`DB::DiskObjectStorageTransaction::commit(this=0x00007ffea22b6168) + 79 at DiskObjectStorageTransaction.cpp:903
frame 7: 0x00000000109577e5 clickhouse`DB::DiskObjectStorage::removeSharedRecursive(this=<unavailable>, path="store/27f/27f6f9d2-ab2e-4817-b771-0e706e485b15/", keep_all_batch_data=false, file_names_remove_metadata_only=size=0) + 133 at DiskObjectStorage.cpp:426
frame 8: 0x000000001095af79 clickhouse`DB::DiskObjectStorage::removeRecursive(this=<unavailable>, path=<unavailable>) + 57 at DiskObjectStorage.h:79
* frame 9: 0x0000000010b5c3d5 clickhouse`DB::DatabaseCatalog::dropTableFinally(this=0x00007ffff7096800, table=0x00007ffe853e1bd0) + 1365 at DatabaseCatalog.cpp:1317
frame 10: 0x0000000010b5b7e7 clickhouse`DB::DatabaseCatalog::dropTableDataTask(this=0x00007ffff7096800) + 2375 at DatabaseCatalog.cpp:1270
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:47:35 +01:00
Azat Khuzhin
41ebaefeda
Add a note for MetadataStorageFromPlainObjectStorage to support transactions
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:47:35 +01:00
Kseniia Sumarokova
70514e3d14
Merge pull request #57615 from ClickHouse/filecache-small-optimization
...
fs cache: small optimization
2024-01-25 15:50:09 +01:00
Maksim Kita
2a327107b6
Updated implementation
2024-01-25 14:31:49 +03:00
Kseniia Sumarokova
b13be4fd55
Merge pull request #59175 from ClickHouse/filecache-minor
...
Move some headers
2024-01-25 11:33:57 +01:00
Smita Kulkarni
09f1e2840c
Simplified calculatePartSize and upload task
2024-01-25 10:06:05 +01:00
kssenii
9038f0710a
Minor
2024-01-24 18:44:13 +01:00
kssenii
ed607fbd2c
Merge remote-tracking branch 'origin/master' into filecache-small-optimization
2024-01-24 11:58:44 +01:00
Antonio Andelic
62a3847888
Update src/Disks/ObjectStorages/ObjectStorageFactory.cpp
2024-01-24 11:15:52 +01:00
Smita Kulkarni
4d92eba316
Merge branch 'master' into Azure_backup
2024-01-24 11:13:57 +01:00
Antonio Andelic
e112288c0b
Capability check for s3_plain
2024-01-24 09:27:27 +00:00
Anton Popov
4292ee7d51
Merge pull request #58886 from CurtizJ/better-read-buffers
...
Less error prone interface of read buffers
2024-01-23 14:59:27 +01:00
Smita Kulkarni
992d859e72
Fix style check
2024-01-23 14:16:14 +01:00
Alexander Gololobov
9a0e5d0aac
Merge pull request #58914 from ClickHouse/ot_spans_in_insert
...
Opentelemetry spans to analyze CPU and S3 bottlenecks on inserts
2024-01-23 13:53:13 +01:00
Smita Kulkarni
2e7ce5b0e2
Updated settings ptr and fetching of client from Disk & ObjectStorage
2024-01-22 16:24:43 +01:00
Anton Popov
e1e7a9cd45
Merge branch 'master' into better-read-buffers
2024-01-22 15:50:48 +01:00
Sema Checherinda
9adab57771
Correct initialization of ConnectionTimeouts ( #59000 )
2024-01-22 12:03:36 +01:00
robot-clickhouse
273a06856a
Merge pull request #59025 from ClickHouse/cpu-scheduler
...
Split resource scheduler off `IO/` into `Common/Scheduler/`
2024-01-20 15:43:50 +01:00
Kseniia Sumarokova
5d67e26fc4
Merge pull request #58869 from ClickHouse/force-check-for-cached-custom-disk
...
Fix for custom cached disk creation
2024-01-20 14:47:36 +01:00
Kseniia Sumarokova
689e617c12
Merge pull request #58963 from ClickHouse/follow-up-disk-configuration
...
Follow up to #58357
2024-01-20 14:41:34 +01:00
serxa
172d68ceca
Merge branch 'master' into cpu-scheduler
2024-01-20 12:21:21 +00:00
serxa
824deab761
split resource scheduler off IO/ into Common/Scheduler/
2024-01-20 12:06:26 +00:00
kssenii
f9fc4c9fe1
Fix style check
2024-01-19 17:59:44 +01:00
kssenii
226026e2aa
Fix
2024-01-19 17:55:03 +01:00
Smita Kulkarni
d22fc3a224
Updated to fetch default from settings
2024-01-19 16:13:58 +01:00
Smita Kulkarni
c51d1f04f6
Add settings max_unexpected_write_error_retries for Azure Blob Storage
2024-01-19 15:57:20 +01:00
kssenii
f055d668af
Merge remote-tracking branch 'origin/follow-up-disk-configuration' into follow-up-disk-configuration
2024-01-19 12:31:44 +01:00
kssenii
9dea75b1e7
Fix
2024-01-19 12:30:49 +01:00
Kseniia Sumarokova
7beb288b27
Update RegisterDiskObjectStorage.cpp
2024-01-19 12:09:58 +01:00
Kseniia Sumarokova
b6094ac233
Merge branch 'master' into filecache-small-optimization
2024-01-19 11:59:04 +01:00
kssenii
2f34ef6ff8
Follow up
2024-01-19 11:19:59 +01:00
Kseniia Sumarokova
1c74e7fa08
Merge pull request #58902 from ClickHouse/fs-cache-refactorings
...
fs cache: minor refactoring
2024-01-19 10:25:45 +01:00
Alexey Milovidov
8a288055c9
Merge pull request #58949 from MikhailBurdukov/fix_s3_copy
...
Using the destination object for paths generation in S3copy.
2024-01-19 09:28:13 +01:00
Alexey Milovidov
bcff1bac47
Merge pull request #58874 from ClickHouse/disk-minor-improvement
...
DiskWeb minor improvement in loading
2024-01-19 03:52:05 +01:00
Alexander Gololobov
e9919f47c1
Move paramaters from span name to attributes
2024-01-18 14:26:19 +01:00
MikhailBurdukov
7518241be4
Use dest object storage to native copy for path generation.
2024-01-18 11:46:16 +00:00
kssenii
9b674e640d
Fxi
2024-01-18 12:20:40 +01:00
Smita Kulkarni
e71977b724
Merge branch 'master' into Azure_backup
2024-01-18 08:29:01 +01:00
kssenii
ef48b90bca
Fix and test
2024-01-17 18:44:09 +01:00
kssenii
dd9e56f08f
Better
2024-01-17 14:58:42 +01:00
Anton Popov
245e1cbd5c
Merge remote-tracking branch 'upstream/master' into better-read-buffers
2024-01-17 13:46:48 +00:00
kssenii
d5198c1b47
Better
2024-01-17 14:44:53 +01:00
kssenii
a572fda873
Fix
2024-01-17 14:22:34 +01:00
Nikita Taranov
bb124b544c
Merge pull request #58077 from nickitat/revert_rest
...
Remove unneeded parameter `use_external_buffer` from `AsynchronousReadBuffer*`
2024-01-17 13:45:07 +01:00
kssenii
c905937ef6
Refactoring
2024-01-17 13:22:59 +01:00
Anton Popov
299293c088
better interface in read buffers
2024-01-16 23:26:20 +00:00
kssenii
e5d8b9b190
More lazy loading
2024-01-16 16:12:14 +01:00
Kseniia Sumarokova
f2a31db9d2
Merge branch 'master' into filecache-small-optimization
2024-01-16 15:04:02 +01:00
kssenii
8decf5039a
Fix for custom cached disk
2024-01-16 14:41:12 +01:00
Kseniia Sumarokova
ae884760db
Merge pull request #58357 from ClickHouse/better-disks-configuration
...
Flexible configuration for disks
2024-01-15 21:34:36 +01:00
kssenii
abd800dfa6
Fix keeper build
2024-01-15 13:25:10 +01:00
Alexey Milovidov
c132e0141c
Merge pull request #58791 from ClickHouse/better-stateful-tests
...
Simplify stateful tests
2024-01-14 21:39:13 +01:00
Nikita Taranov
7a3ceeb54c
Fix usage of small buffers for remote reading ( #58768 )
...
* impl
* add test
* fix test
2024-01-14 16:06:51 +01:00
Alexey Milovidov
fe70165921
Whitespace
2024-01-14 08:08:32 +01:00
Alexey Milovidov
bbbf455146
Better error message
2024-01-14 00:05:15 +01:00
kssenii
341a9b3b70
Fix keeper build
2024-01-13 12:56:27 +01:00
Alexey Milovidov
d112492c56
Remove some code
2024-01-13 03:48:04 +01:00
kssenii
dc61f68f65
Rename one more method
2024-01-12 17:55:57 +01:00
kssenii
7c92d69820
Rename a method
2024-01-12 17:27:45 +01:00
kssenii
caf267c6ed
Merge remote-tracking branch 'origin' into filecache-small-optimization
2024-01-12 13:23:45 +01:00
kssenii
7b674c31c5
Fix for issue 58697
2024-01-12 10:55:27 +01:00
kssenii
df1d4458b4
Fix build without s3
2024-01-11 12:04:54 +01:00
kssenii
0527d18f3f
Fix build without s3
2024-01-10 18:28:11 +01:00
Robert Schulze
52d75ab68f
Merge pull request #58458 from rschu1ze/replace-std_regexp-by-re2
...
Replace `std::regex` by re2
2024-01-10 17:46:54 +01:00
kssenii
23659bec8f
Fix style check
2024-01-10 17:02:51 +01:00
Vitaly Baranov
dbb19e72b3
Merge pull request #58629 from vitlibar/remove-finalize-from-destructor-of-write-buffer-from-encrypted-file
...
Remove finalize() from ~WriteBufferFromEncryptedFile
2024-01-10 16:36:11 +01:00
kssenii
383d40ea03
Finish changes
2024-01-10 14:18:04 +01:00
kssenii
eb294075a6
Merge remote-tracking branch 'origin' into better-disks-configuration
2024-01-10 13:10:44 +01:00
Robert Schulze
499227b9cf
Merge remote-tracking branch 'rschu1ze/master' into replace-std_regexp-by-re2
2024-01-10 10:02:53 +00:00
Vitaly Baranov
01dfe282ea
Remove finalize() from ~WriteBufferFromEncryptedFile.
2024-01-09 17:22:17 +01:00
Robert Schulze
8e804487f3
Some fixups
2024-01-07 22:28:08 +00:00
Sema Checherinda
8ab4aa3423
enable randomization setting
2024-01-05 13:42:30 +00:00
Sema Checherinda
53f36f8b21
object storage key template
2024-01-05 13:42:30 +00:00
Smita Kulkarni
2ee6893312
Updated to return container for getObjectsNamespace
2024-01-05 10:58:04 +01:00
Smita Kulkarni
c14605caa7
Added flag use_native_copy and updated to use StartCopyFromUri for native copy with large files
2024-01-04 18:27:54 +01:00
Smita Kulkarni
91bad5bc39
Updated to use MultiVersion for BlobContainerClient in Backups and updated to get client from disk
2024-01-04 16:06:36 +01:00
Smita Kulkarni
4122de9721
Updated tests and added settings
2024-01-02 20:19:01 +01:00
kssenii
653d48a552
Flexible disks configuration
2023-12-29 19:57:58 +01:00
Azat Khuzhin
8c54380d80
Avoid sending ComposeObject requests after upload to GCS
...
This should not be required anymore, but leave it as an option, since
likely this is required for old files.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-29 11:53:49 +01:00
Azat Khuzhin
f4a7789cd4
Convert various S3::Client settings into separate ClientSettings struct
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-29 11:53:49 +01:00
kssenii
d5b138eee4
Log exception
2023-12-28 13:41:07 +01:00
Alexey Milovidov
30f6d03b37
Merge pull request #57977 from bianpengyuan/add-s3-read-only-setting
...
Add a setting to specify s3 disk is read only.
2023-12-28 01:24:50 +01:00
Alexey Milovidov
8d984df135
Merge pull request #58237 from azat/build/fwd-decl-exception
...
Some code refactoring (was an attempt to improve build time, but failed)
2023-12-28 00:21:09 +01:00
Azat Khuzhin
b9233f6d4f
Move Allocator code into module part
...
This should reduce amount of code that should be recompiled on
Exception.h changes (and everything else that had been included there).
This will actually not help a lot, because it is also included into
PODArray.h and ThreadPool.h at least... Sigh.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-27 15:42:08 +01:00
Dani Pozo
2be2486e94
Remove retryStrategy assignments overwritten in ClientFactory::create()
2023-12-22 17:28:43 +01:00
Alexey Milovidov
ee199877d6
Update diskSettings.cpp
2023-12-22 07:27:48 +03:00
Raúl Marín
ced9407cef
Improve error messages
2023-12-21 10:29:05 +01:00
Nikita Taranov
354b689800
impl
2023-12-20 16:07:00 +01:00
vinay92-ch
462aeadb6e
Style check
2023-12-18 23:07:29 +00:00
vinay92-ch
f3037b502d
Merge branch 'master' into add_azure_workload_identity_support_blob
2023-12-18 22:37:09 +00:00
Nikita Mikhaylov
6360b76792
Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint
2023-12-18 21:49:31 +00:00
Raúl Marín
2639d0715f
Merge remote-tracking branch 'blessed/master' into log_message_string
2023-12-18 10:40:18 +01:00
Pengyuan Bian
32816d7e7e
Add a setting to specify s3 disk is read only.
2023-12-18 04:07:54 +00:00
Alexey Milovidov
dbd509417e
Merge pull request #57970 from ClickHouse/nickitat-patch-17
...
Always use `pread` for reading cache segments
2023-12-17 20:53:05 +01:00
Nikita Taranov
9c2ef4eae5
Add profile event for cache lookup in ThreadPoolRemoteFSReader ( #57437 )
2023-12-17 19:03:49 +01:00
Nikita Taranov
587f829eb8
Always use pread for reading cache segments
2023-12-17 18:37:07 +01:00
vinay92-ch
2ff364cb73
Merge branch 'master' into add_azure_workload_identity_support_blob
2023-12-16 00:33:30 +00:00
Raúl Marín
b269f87f4c
Better text_log with ErrnoException
2023-12-15 19:27:56 +01:00
Sema Checherinda
0dfe530a7f
Merge pull request #56744 from MikhailBurdukov/native_copy_for_s3_disks
...
Enabled s3 `copyObject` for copy between s3 disks.
2023-12-15 16:05:16 +01:00
Vinay Suryadevara
d347bec531
[WIP] Add support for Workload identity credentials in AzureBlobStorage
2023-12-14 16:09:14 -08:00
Kseniia Sumarokova
79db3c66df
Merge branch 'master' into allow-to-change-some-cache-settings-without-restart
2023-12-13 23:33:59 +01:00
Nikita Mikhaylov
8372c70958
Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint
2023-12-13 18:29:56 +00:00
Alexey Milovidov
62b6d1ef5e
iMerge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci
2023-12-13 01:41:27 +01:00
Kseniia Sumarokova
91d36ad224
Merge pull request #57076 from ClickHouse/slru-for-filesystem-cache
...
Implement SLRU cache policy for filesystem cache
2023-12-12 10:20:58 +01:00
Alexey Milovidov
9789c2caa2
Review fixes
2023-12-12 05:48:09 +01:00
MikhailBurdukov
119e451967
Merge branch 'master' into native_copy_for_s3_disks
2023-12-11 07:25:20 +00:00
Azat Khuzhin
6ccbc2ea75
Move io_uring reader into the Context from static to make it's thread joinable
...
v2: fix for standalone keeper build
CI: https://s3.amazonaws.com/clickhouse-test-reports/52717/72b1052f7c2d453308262924e767ab8dc2206933/stateless_tests__debug__[4_5].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-09 22:50:48 +01:00
Nikita Mikhaylov
c979124cfe
Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint
2023-12-08 16:25:02 +00:00
MikhailBurdukov
d10217af16
style
2023-12-08 13:14:47 +00:00
kssenii
725571461d
Merge remote-tracking branch 'origin/master' into slru-for-filesystem-cache
2023-12-07 19:49:03 +01:00
kssenii
8be3c9d218
Merge remote-tracking branch 'origin/master' into allow-to-change-some-cache-settings-without-restart
2023-12-07 12:14:24 +01:00
kssenii
614da21144
Better
2023-12-07 12:12:10 +01:00
kssenii
f44f7c8c28
Allow to change some cache settings without server restart
2023-12-06 19:29:18 +01:00
jsc0218
cdd5280272
Merge pull request #57387 from evillique/better-disks
...
Initialize only required disks in clickhouse-disks
2023-12-05 13:59:04 -05:00
Nikita Mikhaylov
04d167c6d9
Better
2023-12-05 13:34:37 +01:00
Alexey Milovidov
10d65a1ade
Merge pull request #55559 from azat/s3-fix-excessive-reads
...
Add ability to disable checksums for S3 to avoid excessive input file read
2023-12-05 06:34:21 +01:00
kssenii
4a28f10c3d
Minor cache changes
2023-12-04 19:02:37 +01:00
vdimir
a4ae90de0d
Merge pull request #57275 from ClickHouse/vdimir/merge_task_tmp_data
...
Background merges correctly use temporary data storage in the cache
2023-12-04 14:52:20 +01:00
robot-ch-test-poll
1b49463bd2
Merge pull request #55841 from nickitat/optimize_reading3
...
Optimize reading from cache
2023-12-01 17:36:57 +01:00
Nikolay Degterinsky
e8203f8a76
Initialize only required disks
2023-11-30 03:09:55 +00:00
vdimir
b5babe1692
MergeTask uses temporary data storage
2023-11-29 16:18:32 +00:00
Kseniia Sumarokova
a89bb04e9c
Update comment
2023-11-29 13:30:55 +01:00
kssenii
28d54f0027
Better exception code
2023-11-29 10:57:35 +01:00
Nikita Taranov
a81453cafc
fix test
2023-11-28 23:48:52 +01:00
Nikita Taranov
03450d5077
merge fixes
2023-11-28 18:24:05 +01:00
kssenii
4d64cd5d11
Fix
2023-11-28 17:13:08 +01:00
Nikita Taranov
52f644c0df
Merge branch 'master' into optimize_reading3
2023-11-28 16:36:38 +01:00
Nikita Taranov
bdab4d5944
handle case with multiple blobs in ReadBufferFromRemoteFSGather
2023-11-28 15:40:35 +01:00
Nikita Taranov
0ad796aa99
add profile event
...
add profile event for set&seek
fix
fix
fix
2023-11-28 15:40:34 +01:00
