Commit Graph

2297 Commits

Author SHA1 Message Date
MikhailBurdukov
7518241be4 Use dest object storage to native copy for path generation. 2024-01-18 11:46:16 +00:00
Nikita Taranov
bb124b544c
Merge pull request #58077 from nickitat/revert_rest
Remove unneeded parameter `use_external_buffer` from `AsynchronousReadBuffer*`
2024-01-17 13:45:07 +01:00
Kseniia Sumarokova
ae884760db
Merge pull request #58357 from ClickHouse/better-disks-configuration
Flexible configuration for disks
2024-01-15 21:34:36 +01:00
kssenii
abd800dfa6 Fix keeper build 2024-01-15 13:25:10 +01:00
Alexey Milovidov
c132e0141c
Merge pull request #58791 from ClickHouse/better-stateful-tests
Simplify stateful tests
2024-01-14 21:39:13 +01:00
Nikita Taranov
7a3ceeb54c
Fix usage of small buffers for remote reading (#58768)
* impl

* add test

* fix test
2024-01-14 16:06:51 +01:00
Alexey Milovidov
fe70165921 Whitespace 2024-01-14 08:08:32 +01:00
Alexey Milovidov
bbbf455146 Better error message 2024-01-14 00:05:15 +01:00
kssenii
341a9b3b70 Fix keeper build 2024-01-13 12:56:27 +01:00
Alexey Milovidov
d112492c56 Remove some code 2024-01-13 03:48:04 +01:00
kssenii
dc61f68f65 Rename one more method 2024-01-12 17:55:57 +01:00
kssenii
7c92d69820 Rename a method 2024-01-12 17:27:45 +01:00
kssenii
7b674c31c5 Fix for issue 58697 2024-01-12 10:55:27 +01:00
kssenii
df1d4458b4 Fix build without s3 2024-01-11 12:04:54 +01:00
kssenii
0527d18f3f Fix build without s3 2024-01-10 18:28:11 +01:00
Robert Schulze
52d75ab68f
Merge pull request #58458 from rschu1ze/replace-std_regexp-by-re2
Replace `std::regex` by re2
2024-01-10 17:46:54 +01:00
kssenii
23659bec8f Fix style check 2024-01-10 17:02:51 +01:00
Vitaly Baranov
dbb19e72b3
Merge pull request #58629 from vitlibar/remove-finalize-from-destructor-of-write-buffer-from-encrypted-file
Remove finalize() from ~WriteBufferFromEncryptedFile
2024-01-10 16:36:11 +01:00
kssenii
383d40ea03 Finish changes 2024-01-10 14:18:04 +01:00
kssenii
eb294075a6 Merge remote-tracking branch 'origin' into better-disks-configuration 2024-01-10 13:10:44 +01:00
Robert Schulze
499227b9cf
Merge remote-tracking branch 'rschu1ze/master' into replace-std_regexp-by-re2 2024-01-10 10:02:53 +00:00
Vitaly Baranov
01dfe282ea Remove finalize() from ~WriteBufferFromEncryptedFile. 2024-01-09 17:22:17 +01:00
Robert Schulze
8e804487f3
Some fixups 2024-01-07 22:28:08 +00:00
Sema Checherinda
8ab4aa3423 enable randomization setting 2024-01-05 13:42:30 +00:00
Sema Checherinda
53f36f8b21 object storage key template 2024-01-05 13:42:30 +00:00
kssenii
653d48a552 Flexible disks configuration 2023-12-29 19:57:58 +01:00
Azat Khuzhin
8c54380d80 Avoid sending ComposeObject requests after upload to GCS
This should not be required anymore, but leave it as an option, since
likely this is required for old files.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-29 11:53:49 +01:00
Azat Khuzhin
f4a7789cd4 Convert various S3::Client settings into separate ClientSettings struct
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-29 11:53:49 +01:00
Alexey Milovidov
30f6d03b37
Merge pull request #57977 from bianpengyuan/add-s3-read-only-setting
Add a setting to specify s3 disk is read only.
2023-12-28 01:24:50 +01:00
Alexey Milovidov
8d984df135
Merge pull request #58237 from azat/build/fwd-decl-exception
Some code refactoring (was an attempt to improve build time, but failed)
2023-12-28 00:21:09 +01:00
Azat Khuzhin
b9233f6d4f Move Allocator code into module part
This should reduce amount of code that should be recompiled on
Exception.h changes (and everything else that had been included there).

This will actually not help a lot, because it is also included into
PODArray.h and ThreadPool.h at least... Sigh.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-27 15:42:08 +01:00
Dani Pozo
2be2486e94 Remove retryStrategy assignments overwritten in ClientFactory::create() 2023-12-22 17:28:43 +01:00
Alexey Milovidov
ee199877d6
Update diskSettings.cpp 2023-12-22 07:27:48 +03:00
Raúl Marín
ced9407cef Improve error messages 2023-12-21 10:29:05 +01:00
Nikita Taranov
354b689800 impl 2023-12-20 16:07:00 +01:00
Nikita Mikhaylov
6360b76792 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint 2023-12-18 21:49:31 +00:00
Raúl Marín
2639d0715f Merge remote-tracking branch 'blessed/master' into log_message_string 2023-12-18 10:40:18 +01:00
Pengyuan Bian
32816d7e7e Add a setting to specify s3 disk is read only. 2023-12-18 04:07:54 +00:00
Alexey Milovidov
dbd509417e
Merge pull request #57970 from ClickHouse/nickitat-patch-17
Always use `pread` for reading cache segments
2023-12-17 20:53:05 +01:00
Nikita Taranov
9c2ef4eae5
Add profile event for cache lookup in ThreadPoolRemoteFSReader (#57437) 2023-12-17 19:03:49 +01:00
Nikita Taranov
587f829eb8
Always use pread for reading cache segments 2023-12-17 18:37:07 +01:00
Raúl Marín
b269f87f4c Better text_log with ErrnoException 2023-12-15 19:27:56 +01:00
Sema Checherinda
0dfe530a7f
Merge pull request #56744 from MikhailBurdukov/native_copy_for_s3_disks
Enabled s3 `copyObject` for copy between s3 disks.
2023-12-15 16:05:16 +01:00
Kseniia Sumarokova
79db3c66df
Merge branch 'master' into allow-to-change-some-cache-settings-without-restart 2023-12-13 23:33:59 +01:00
Nikita Mikhaylov
8372c70958 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint 2023-12-13 18:29:56 +00:00
Alexey Milovidov
62b6d1ef5e iMerge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-13 01:41:27 +01:00
Kseniia Sumarokova
91d36ad224
Merge pull request #57076 from ClickHouse/slru-for-filesystem-cache
Implement SLRU cache policy for filesystem cache
2023-12-12 10:20:58 +01:00
Alexey Milovidov
9789c2caa2 Review fixes 2023-12-12 05:48:09 +01:00
MikhailBurdukov
119e451967 Merge branch 'master' into native_copy_for_s3_disks 2023-12-11 07:25:20 +00:00
Azat Khuzhin
6ccbc2ea75 Move io_uring reader into the Context from static to make it's thread joinable
v2: fix for standalone keeper build
CI: https://s3.amazonaws.com/clickhouse-test-reports/52717/72b1052f7c2d453308262924e767ab8dc2206933/stateless_tests__debug__[4_5].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-09 22:50:48 +01:00