Igor Nikonov
a8ee493b67
Merge remote-tracking branch 'origin/master' into cleanup-random-progress-bar
2024-02-29 13:09:20 +00:00
Robert Schulze
ed655815fe
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-src
2024-02-29 12:58:53 +00:00
Michael Kolupaev
42437a2ae1
Userspace page cache ( #53770 )
...
* Userspace page cache
* Maybe it'll build this time, who knows.
* 'auto' went out of fashion, I guess
* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary
* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.
* Fix
* Another fix
* Fix restricted seek, fix ppc64le build
* Don't allow page cache with file cache
* Adjust tests a little
* Fix clang-tidy
* Conflicts
* Comments
* Maybe unbroke AsynchronousBoundedReadBuffer
* SettingsChangesHistory.h
* Fix warning in test
2024-02-29 12:28:32 +00:00
Alexander Tokmakov
15e1191f74
Revert "Userspace page cache ( #53770 )"
...
This reverts commit 7b55c61551
2024-02-29 13:20:17 +01:00
Igor Nikonov
59c3bb768f
Remove header
2024-02-29 12:19:27 +00:00
Michael Kolupaev
7b55c61551
Userspace page cache ( #53770 )
...
* Userspace page cache
* Maybe it'll build this time, who knows.
* 'auto' went out of fashion, I guess
* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary
* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.
* Fix
* Another fix
* Fix restricted seek, fix ppc64le build
* Don't allow page cache with file cache
* Adjust tests a little
* Fix clang-tidy
* Conflicts
* Comments
* Maybe unbroke AsynchronousBoundedReadBuffer
* SettingsChangesHistory.h
* Fix warning in test
2024-02-29 11:27:32 +00:00
Robert Schulze
a1c164a758
Fix a bunch of clang-tidy warnings in headers
2024-02-28 23:43:12 +00:00
Alexey Milovidov
e1e66dc2b8
Merge pull request #60095 from ClickHouse/fix-inconsistent-formatting
...
Fix inconsistent formatting of queries
2024-02-29 00:41:40 +03:00
Raúl Marín
b12245fdc5
Decrease logging level for http retriable errors to Info
2024-02-28 19:47:42 +01:00
Alexey Milovidov
8cf619bc03
Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting
2024-02-28 00:30:44 +01:00
Robert Schulze
e185805c1c
Minor: Replace boost::algorithm::ends_with() by std::string::ends_with()
2024-02-27 15:28:02 +00:00
Robert Schulze
466cf93ee2
Merge pull request #60450 from rschu1ze/starts_with
...
Minor: Replace `boost::algorithm::starts_with()` by `std::string::starts_with()`
2024-02-27 16:21:02 +01:00
Robert Schulze
62c12cbfca
Replace boost::algorithm::starts_with() by std::string::starts_with()
2024-02-27 10:42:47 +00:00
Alexey Milovidov
a3f1411679
Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting
2024-02-26 19:01:11 +01:00
Antonio Andelic
ffe1872e23
Merge pull request #60203 from ClickHouse/limit_libarchive_format
...
Limit libarchive format to what we use
2024-02-26 09:25:19 +01:00
Alexey Milovidov
bf75d2878b
Merge branch 'master' into fix-inconsistent-formatting
2024-02-26 00:09:02 +01:00
Alexey Milovidov
9e32d0f5b2
Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting
2024-02-23 15:05:46 +01:00
Nikita Taranov
b44e4c6d78
Merge branch 'master' into fix_head_bucket_after_update
2024-02-22 14:32:00 +01:00
kssenii
f23ddec69f
Fix unit tests build
2024-02-22 11:50:36 +01:00
Maksim Kita
25bfcdd21f
Fixed code review issues
2024-02-21 11:41:25 +03:00
Maksim Kita
c0e1f50168
Copy S3 file GCP fallback to buffer copy
2024-02-21 11:41:25 +03:00
Alexey Milovidov
71c267e0b0
Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting
2024-02-21 07:56:51 +01:00
santrancisco
be33d52016
Fix styling
2024-02-21 17:26:56 +11:00
Nikita Taranov
8401cd8c41
impl
2024-02-21 00:47:54 +01:00
kssenii
bdd5eeb2eb
Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1
2024-02-20 16:59:33 +01:00
Antonio Andelic
34e8e673e9
Merge pull request #60144 from ClickHouse/per-user-s3-settings
...
Support specifying users for S3 settings
2024-02-20 13:20:07 +01:00
Alexey Milovidov
ead2e7bc41
Revert "Restriction for the access key id for s3."
2024-02-20 12:32:25 +01:00
Alexey Milovidov
209acaa8b2
Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting
2024-02-20 09:49:05 +01:00
santrancisco
c8a3a0bb11
Replacing libarchive filter_all and format_all code with specific compression method we want to support
2024-02-20 16:48:53 +11:00
kssenii
e23b929e18
Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1
2024-02-19 19:55:47 +01:00
kssenii
0552f44f70
Fixes after merge with master, move some part of code to object storage
2024-02-19 16:43:49 +01:00
Antonio Andelic
175a1db787
Support specifying users for s3 settings
2024-02-19 16:43:27 +01:00
Vitaly Baranov
f10a8868e1
Merge pull request #60097 from vitlibar/move-thread-pool-callback-runner-to-common
...
Move threadPoolCallbackRunner to the "Common" folder
2024-02-19 14:10:36 +01:00
Kruglov Pavel
5fd2582e83
Merge pull request #59500 from Avogar/exponent-floats-inference
...
Don't infer floats in exponential notation by default
2024-02-19 13:51:07 +01:00
Vitaly Baranov
3323d5ce81
Move threadPoolCallbackRunner to the "Common" folder.
2024-02-17 21:59:51 +01:00
Alexey Milovidov
69dfd721ce
Fix inconsistent formatting of INSERT queries
2024-02-17 10:11:59 +01:00
Alexey Milovidov
2f315e0eb5
Style check for abbreviations
2024-02-17 02:14:15 +01:00
kssenii
1cccb3ccdf
Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1
2024-02-16 15:21:10 +01:00
Kruglov Pavel
4d6f167e0c
Merge pull request #59092 from Avogar/auto-format-detection
...
Try to detect file format automatically during schema inference if it's unknown
2024-02-16 14:32:18 +01:00
Alexey Milovidov
bbd7acd7f9
Merge branch 'master' into exponent-floats-inference
2024-02-15 01:46:51 +01:00
Dmitry Novik
433d835df6
Merge pull request #59920 from azat/http-retries-logs
...
Decrease logging level for http retriable errors to Warning (and fix 00157_cache_dictionary flakiness)
2024-02-14 17:11:28 +01:00
Kruglov Pavel
1dbfeafb42
Merge branch 'master' into auto-format-detection
2024-02-13 19:08:33 +01:00
Kruglov Pavel
61983a7ec8
Merge branch 'master' into exponent-floats-inference
2024-02-13 19:04:07 +01:00
Nikita Mikhaylov
4b85f6b39a
Revert "Less error prone interface of read buffers" ( #59911 )
2024-02-13 12:02:46 +01:00
Azat Khuzhin
4228eaf44a
Decrease logging level for http retriable errors to Warning
...
Messages like this:
2024-02-12 21:25:24 [5c66f008cd40] 2024.02.12 14:25:01.596769 [ 2530 ] {e71fcb6d-356d-4962-95bd-ef8b8c504e11} <Error> ReadWriteBufferFromHTTP: HTTP request to `https://clickhouse-datasets-web.s3.us-east-1.amazonaws.com/store/78e/78ebf6a1-d987-4579-b3ec-00c1a087b1f3/201403_1_1_2/UserAgent.bin ` failed at try 1/10 with bytes read: 311149/378695. Error: DB::HTTPException: Received error from remote server /store/78e/78ebf6a1-d987-4579-b3ec-00c1a087b1f3/201403_1_1_2/UserAgent.bin. HTTP status code: 500 Internal Server Error, body: <?xml version="1.0" encoding="UTF-8"?>
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-13 08:31:28 +01:00
Alexey Milovidov
a7c30098b6
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-02-09 22:52:49 +01:00
kssenii
3cca841038
Unite s3/hdfs/azure storage implementations into a single class on top of IObjectStorage
2024-02-09 21:32:04 +01:00
Vitaly Baranov
09e727d48b
Merge pull request #56988 from ClickHouse/Azure_backup
...
Backup & Restore support for AzureBlobStorage
2024-02-09 14:45:35 +01:00
Smita Kulkarni
e594608c42
Merge branch 'master' into Azure_backup
2024-02-07 13:48:46 +01:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build
2024-02-07 04:58:21 +01:00
Smita Kulkarni
fd2fdcdb4b
Fixed unwanted dereferencing
2024-02-05 11:23:37 +01:00
Smita Kulkarni
f036948f91
Fix clang tidy build
2024-02-05 10:09:48 +01:00
Smita Kulkarni
23b9f43d4f
Fix style
2024-02-04 16:18:17 +01:00
Smita Kulkarni
b0994c5fa7
Addressed comments, added test for named collection
2024-02-04 11:28:20 +01:00
avogar
ff21aa9a19
Don't infer floats in exponential notation by default
2024-02-01 19:47:05 +00:00
Konstantin Bogdanov
5969668503
Concurrent table creation in DatabaseReplicated
2024-02-01 09:51:52 +01:00
Dmitry Novik
5b630ed745
Merge pull request #59399 from azat/build/format-fwd-decl
...
Forward declaration for PeekableReadBuffer
2024-02-01 09:15:07 +01:00
Kruglov Pavel
4987708583
Merge pull request #59298 from Avogar/fix-getting-filename-from-read-buffers
...
Fix getting filename from read buffer wrappers
2024-01-31 14:34:07 +01:00
Azat Khuzhin
010f1c6cb7
Forward declaration for PeekableReadBuffer
...
ReadHelpers.h is very common header and is the root cause of "recompile
everything".
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-30 19:24:19 +01:00
avogar
377937d415
Merge branch 'master' of github.com:ClickHouse/ClickHouse into auto-format-detection
2024-01-29 15:45:18 +00:00
Alexey Milovidov
cb69a1b25d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-01-29 15:35:04 +01:00
Smita Kulkarni
3183026521
Merge branch 'master' into Azure_backup
2024-01-29 11:08:13 +01:00
Smita Kulkarni
a22b68f46f
Added setting azure_max_single_part_copy_size
2024-01-29 10:49:36 +01:00
Alexey Milovidov
4a94ae5a1b
Merge branch 'master' into enable-coverage-for-debug-build
2024-01-28 22:24:26 +01:00
Smita Kulkarni
d264a5a148
Update client & settings to std::shared_ptr<const>
2024-01-28 12:06:52 +01:00
avogar
00c140b7bb
Fix getting filename from read buffer wrappers
2024-01-27 21:13:08 +00:00
avogar
5833641fa5
Merge branch 'master' of github.com:ClickHouse/ClickHouse into variant-data-type
2024-01-26 16:54:02 +00:00
Kruglov Pavel
46a6b84a5a
Merge branch 'master' into auto-format-detection
2024-01-25 22:11:07 +01:00
Maksim Kita
2a327107b6
Updated implementation
2024-01-25 14:31:49 +03:00
Smita Kulkarni
09f1e2840c
Simplified calculatePartSize and upload task
2024-01-25 10:06:05 +01:00
Smita Kulkarni
f551081dd4
Addressed review comments
2024-01-24 21:10:50 +01:00
Kruglov Pavel
6c0615d493
Merge pull request #59099 from skyoct/fix/fix_mult_redirect
...
Disable "Too many redirects" error retry
2024-01-24 12:22:01 +01:00
Kruglov Pavel
718064bb43
Minor change to restart CI
2024-01-24 12:19:10 +01:00
Smita Kulkarni
4d92eba316
Merge branch 'master' into Azure_backup
2024-01-24 11:13:57 +01:00
skyoct
95829e074e
Opt code
2024-01-24 03:49:21 +00:00
avogar
617cc514b7
Try to detect file format automatically during schema inference if it's unknown
2024-01-23 18:59:39 +00:00
Anton Popov
4292ee7d51
Merge pull request #58886 from CurtizJ/better-read-buffers
...
Less error prone interface of read buffers
2024-01-23 14:59:27 +01:00
Alexander Gololobov
9a0e5d0aac
Merge pull request #58914 from ClickHouse/ot_spans_in_insert
...
Opentelemetry spans to analyze CPU and S3 bottlenecks on inserts
2024-01-23 13:53:13 +01:00
Smita Kulkarni
2e7ce5b0e2
Updated settings ptr and fetching of client from Disk & ObjectStorage
2024-01-22 16:24:43 +01:00
Anton Popov
e1e7a9cd45
Merge branch 'master' into better-read-buffers
2024-01-22 15:50:48 +01:00
Nikita Taranov
4d6ef8ed86
Merge pull request #56961 from nickitat/some_questionable_code
...
Bypass `Poco::BasicBufferedStreamBuf` in `ReadBufferFromIStream`
2024-01-22 14:08:09 +01:00
Sema Checherinda
9adab57771
Correct initialization of ConnectionTimeouts ( #59000 )
2024-01-22 12:03:36 +01:00
skyoct
fdf8008804
Fix redirect retry
2024-01-22 10:27:35 +00:00
Vitaly Baranov
9377f4276b
Merge pull request #58962 from vitlibar/fix-memory-dealloc-in-copy-data-to-s3
...
Fix memory management in copyDataToS3File
2024-01-20 23:35:42 +01:00
Alexey Milovidov
dc1dac3ba4
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-01-20 21:41:07 +01:00
Alexey Milovidov
735708e9bb
Merge branch 'master' into enable-coverage-for-debug-build
2024-01-20 21:40:53 +01:00
Sema Checherinda
1bbb5f7f51
Merge pull request #59015 from ClickHouse/chesema-adaptive-timeouts-gcp
...
preserve 'amz-sdk-invocation-id' and 'amz-sdk-request' headers with gcp
2024-01-20 17:48:20 +01:00
serxa
172d68ceca
Merge branch 'master' into cpu-scheduler
2024-01-20 12:21:21 +00:00
serxa
824deab761
split resource scheduler off IO/ into Common/Scheduler/
2024-01-20 12:06:26 +00:00
Alexey Milovidov
8acc981e8c
Merge pull request #59008 from ClickHouse/fix-log-level-for-http
...
Update log level for http buffer
2024-01-20 04:02:42 +01:00
Kruglov Pavel
20379d34d5
Merge branch 'master' into variant-data-type
2024-01-19 23:17:42 +01:00
Sema Checherinda
539451bbe3
preserve 'amz-sdk-invocation-id' and 'amz-sdk-request' headers with gcp
2024-01-19 21:07:47 +01:00
kssenii
4c8ced6af8
Fix log level
2024-01-19 18:04:58 +01:00
Alexey Milovidov
6a75641048
Merge pull request #58966 from ClickHouse/arseek
...
Fix seek in ReadBufferFromZipArchive
2024-01-19 18:04:03 +01:00
Vitaly Baranov
19bc0b744f
Add comments and const after review.
2024-01-19 12:54:55 +01:00
Alexey Milovidov
dcdbaf9150
Merge pull request #58900 from MikhailBurdukov/restriction_for_s3_access_key_id
...
Restriction for the access key id for s3.
2024-01-19 04:13:17 +01:00
Alexey Milovidov
370815803e
Update Client.cpp
2024-01-19 06:12:44 +03:00
Alexey Milovidov
7c0b167e2d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-01-19 03:59:27 +01:00
Michael Kolupaev
3a19ea6e6c
Fix seek in ReadBufferFromZipArchive
2024-01-19 01:46:07 +00:00
Vitaly Baranov
24ca8fbbec
Improve logs.
2024-01-18 21:15:39 +01:00
