thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-14 18:32:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
132,858 Commits 9,328 Branches 1,783 Tags 2.1 GiB
7518241be4
Commit Graph

2297 Commits

Author SHA1 Message Date
Azat Khuzhin
c706101891 Fix throttling of BACKUPs from/to S3 (in case native copy was not used) 
In some cases native copy is not possible, and such requests should be
throttled.

v0: copyS3FileNativeWithFallback
v2: revert v0 and pass write_settings
v3: pass read_settings to copyFile()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-09-20 18:28:43 +02:00
Sema Checherinda
e7550523c8
Merge pull request #54651 from CheSema/limit_backoff_timeout 
limit the delay before next try in S3
 2023-09-18 19:41:26 +02:00
Robert Schulze
f5e8028bb1
Merge pull request #54642 from rschu1ze/broken-re2st 
Remove broken lockless variant of re2
 2023-09-17 15:30:57 +02:00
Kseniia Sumarokova
79697d4102
Update WebObjectStorage.cpp 2023-09-15 20:18:36 +02:00
Sema Checherinda
d9e15c00c9 limit the delay before next try in S3 2023-09-14 19:45:07 +02:00
Robert Schulze
7b378dbad3
Remove broken lockless variant of re2 2023-09-14 16:40:42 +00:00
Sema Checherinda
0ea0799118
Merge pull request #54430 from CheSema/remove-recursive-with-projection 
reproduce and fix the bug in removeSharedRecursive
 2023-09-12 00:18:55 +02:00
Sema Checherinda
d5268f3fb0 rename a member 2023-09-11 19:57:16 +02:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
serxa
d326554caa fix keeper build 2023-09-10 14:55:40 +00:00
Sema Checherinda
1298dba0c6 fix the bug, add useful logs 2023-09-09 15:54:28 +02:00
SmitaRKulkarni
f0146c0ff0
Increase retries for test_merge_tree_azure_blob_storage (#54069) 
* Increase max_single_download_retries & max_single_read_retries for test_merge_tree_azure_blob_storage

* Updated logs to log exception leading to detaching part

* Updated to catch RequestFailedException azure exception as its the base exception

* Updated isRetryableExcepion to take std::exception_ptr as input

* Fixed style check fails

* Fix build issue & moved NetException & TimeoutException to retryable exceptions

* Fixed style check with catch
 2023-09-06 19:57:59 +02:00
Yakov Olkhovskiy
0dd6928a13
Merge pull request #53068 from nickitat/unify_keep_alive_setting 
Unify setting http keep-alive timeout, increase default to 30s
 2023-09-05 22:05:23 -04:00
Sergei Trifonov
258da91b5f
Merge branch 'master' into disks-and-io-sheduler 2023-09-04 15:14:28 +02:00
Kseniia Sumarokova
b3319f7908
Minor changes (#54171) 2023-09-03 15:47:52 +02:00
Michael Kolupaev
8505b3c940
Merge pull request #54134 from kssenii/refactor-reading-from-remote-fs 
Small refactoring for read from object storage
 2023-09-02 11:13:03 -07:00
kssenii
82948ac843 Review fixes 2023-09-02 14:00:07 +02:00
Sergei Trifonov
cf5ea46713
Merge pull request #53338 from azat/throttling-fixes 
Fix IO throttling during copying whole directories
 2023-09-01 18:29:15 +02:00
serxa
ef4dcf909f fix build 2023-09-01 16:23:15 +00:00
kssenii
9eb1dfcd12 Refactor buffers reading from object storage 2023-09-01 14:03:07 +02:00
kssenii
3f20d1f578 Rename 2023-09-01 12:55:58 +02:00
serxa
9c92d413b3 Merge branch 'master' into disks-and-io-sheduler 2023-08-30 11:18:49 +00:00
Azat Khuzhin
51e8b16916 Fix IO throttling during copying whole directories 
v2: pass local context during ALTER TABLE MOVE PARTITION TO VOLUME/DISK as well
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-08-29 23:13:46 +02:00
xuelei
ebc7dbb628 The configuration of S3 append '/' automatically if needed 2023-08-28 09:39:22 -03:00
xuelei
636e7ddae7 deal with conflict 2023-08-28 06:05:21 -03:00
xiaolei565
853551bd3e
Update registerDiskS3.cpp 2023-08-28 12:38:33 +08:00
xiaolei565
ef6e1fd2d6
Update diskSettings.cpp 2023-08-28 12:38:08 +08:00
xiaolei565
58a1160095
Update diskSettings.cpp 2023-08-28 12:37:54 +08:00
xiaolei565
8d2c03ea26
Update registerDiskS3.cpp 2023-08-28 11:41:53 +08:00
xiaolei565
b9e872ddf7
Update diskSettings.cpp 2023-08-28 11:28:31 +08:00
xiaolei565
3c457c47c2
Update diskSettings.cpp 2023-08-28 11:05:30 +08:00
xuelei
643dd499b8 deal with conflict 2023-08-27 23:46:53 -03:00
xuelei
bb12f7decc deal with conflict 2023-08-27 23:41:23 -03:00
alesapin
0e601b856f
Merge pull request #53751 from Algunenano/clang18 
Support clang-18 (Wmissing-field-initializers)
 2023-08-25 23:27:06 +02:00
Kseniia Sumarokova
34ac113af6
Merge pull request #53121 from kssenii/fix-cache-logical-error 
Fix possible error from cache "Read unexpected size"
 2023-08-25 12:16:24 +02:00
Raúl Marín
6490213207 Merge remote-tracking branch 'blessed/master' into clang18 2023-08-24 17:35:26 +02:00
Kruglov Pavel
44db5fa992
Merge branch 'master' into cache-count 2023-08-24 17:21:18 +02:00
Arthur Passos
2bade7db08
Add global proxy setting (#51749) 
* initial impl

* fix env ut

* move ut directory

* make sure no null proxy resolver is returned by ProxyConfigurationResolverProvider

* minor adjustment

* add a few tests, still incomplete

* add proxy support for url table function

* use proxy for select from url as well

* remove optional from return type, just returns empty config

* fix style

* style

* black

* ohg boy

* rm in progress file

* god pls don't let me kill anyone

* ...

* add use_aws guards

* remove hard coded s3 proxy resolver

* add concurrency-mt-unsafe

* aa

* black

* add logging back

* revert change

* imrpove code a bit

* helper functions and separate tests

* for some reason, this env test is not working..

* formatting

* :)

* clangtidy

* lint

* revert some stupid things

* small test adjusmtments

* simplify tests

* rename test

* remove extra line

* freaking style change

* simplify a bit

* fix segfault & remove an extra call

* tightly couple proxy provider with context..

* remove useless include

* rename config prefix parameter

* simplify provider a bit

* organize provider a bit

* add a few comments

* comment out proxy env tests

* fix nullptr in unit tests

* make sure old storage proxy config is properly covered without global context instance

* move a few functions from class to anonymous namespace

* fix no fallback for specific storage conf

* change API to accept http method instead of bool

* implement http/https distinction in listresolver, any still not implemented

* implement http/https distinction in remote resolver

* progress on code, improve tests and add url function working test

* use protcol instead of method for http and https

* small fix

* few more adjustments

* fix style

* black

* move enum to proxyconfiguration

* wip

* fix build

* fix ut

* delete atomicroundrobin class

* remove stale include

* add some tests.. need to spend some more time on the design..

* change design a bit

* progress

* use existing context for tests

* rename aux function and fix ut

* ..

* rename test

* try to simplify tests a bit

* simplify tests a bit more

* attempt to fix tests, accept more than one remote resolver

* use proper log id

* try waiting for resolver

* proper wait logic

* black

* empty

* address a few comments

* refactor tests

* remove old tests

* baclk

* use RAII to set/unset env

* black

* clang tidy

* fix env proxy not respecting any

* use log trace

* fix wrong logic in getRemoteREsolver

* fix wrong logic in getRemoteREsolver

* fix test

* remove unwanted code

* remove ClientConfigurationperRequest and auxilary classes

* remove unwanted code

* remove adapter test

* few adjustments and add test for s3 storage conf  with new proxy settings

* black

* use chassert for context

* Add getenv comment
 2023-08-24 16:07:26 +03:00
Kseniia Sumarokova
a4f39fe134
Merge branch 'master' into fix-cache-logical-error 2023-08-24 12:00:18 +02:00
Raúl Marín
93dac0c880 Support clang-18 (Wmissing-field-initializers) 2023-08-23 15:53:45 +02:00
Kruglov Pavel
592fa77987
Merge branch 'master' into cache-count 2023-08-23 15:18:02 +02:00
kssenii
57b5ad854d Fxi 2023-08-23 13:43:05 +02:00
Sema Checherinda
60103c577d
Merge pull request #53651 from CheSema/read_beyon_last_offset 
fix Logical Error in AsynchronousBoundedReadBuffer
 2023-08-23 11:21:47 +02:00
avogar
cd228754c8 Apply suggestions 2023-08-22 17:32:35 +00:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Sema Checherinda
81577e041b fix Logical Error in AsynchronousBoundedReadBuffer 2023-08-21 19:30:04 +02:00
Kseniia Sumarokova
404fb0588a
Merge branch 'master' into fix-cache-logical-error 2023-08-20 16:28:13 +02:00
kssenii
5382442da0 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-19 08:44:36 +04:00
Yakov Olkhovskiy
c73037a602 Merge remote-tracking branch 'ch/master' into unify_keep_alive_setting 2023-08-17 20:40:18 +00:00
Michael Kolupaev
557bfea4d8 Use long timeout for S3 copy requests 2023-08-17 19:36:45 +00:00
Kseniia Sumarokova
99f7a83385
Merge branch 'master' into allowed-caches-dir-for-dynamic-disks 2023-08-10 22:26:33 +02:00
Alexey Milovidov
bb57caa83e
Merge pull request #53180 from ClickHouse/ditch-tons-of-garbage 
Ditch tons of garbage
 2023-08-10 16:59:51 +03:00
Kseniia Sumarokova
e79f1ad724
Merge branch 'master' into allowed-caches-dir-for-dynamic-disks 2023-08-10 11:02:11 +02:00
Kseniia Sumarokova
c4c76f60a7
Merge branch 'master' into fix-cache-logical-error 2023-08-10 10:55:22 +02:00
Alexey Milovidov
a807ccec6c Merge remote-tracking branch 'origin/Retry_for_TransportException_Azure' into remove-gargabe-tests 2023-08-10 02:21:25 +02:00
Smita Kulkarni
901901a762 Fixed typo 2023-08-09 16:50:40 +02:00
Smita Kulkarni
9953050b62 Fixed logs for download 2023-08-09 14:57:17 +02:00
Smita Kulkarni
dc4be33895 Updated logs to include retries 2023-08-09 14:55:44 +02:00
Kseniia Sumarokova
944e85d4e5
Merge branch 'master' into fix-cache-logical-error 2023-08-09 12:08:53 +02:00
kssenii
2cfb4c0264 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-09 11:09:34 +02:00
Alexey Milovidov
aa757490bd Ditch tons of garbage 2023-08-09 02:19:02 +02:00
Kseniia Sumarokova
f4553c2aa7
Update registerDiskCache.cpp 2023-08-08 17:06:41 +02:00
Smita Kulkarni
473fb60e6f Added retry for TransportException for azure read & download 2023-08-07 18:56:18 +02:00
kssenii
0c174a7ec1 Allow to restrict fs caches paths 2023-08-07 18:00:26 +02:00
Vitaly Baranov
7082cbf5c6 Use more unique name for TemporaryFileOnDisk. 2023-08-07 17:56:30 +02:00
kssenii
9cdd886fde Fix 2023-08-07 16:46:42 +02:00
Nikita Taranov
37d382aba4 impl 2023-08-05 20:30:49 +02:00
Kseniia Sumarokova
eabca22909
Merge branch 'master' into revert-revert-drop-cache 2023-08-01 23:19:38 +02:00
Vitaly Baranov
65bd8f5e81
Merge branch 'master' into backups-fix-tmp-files 2023-08-01 16:37:06 +02:00
Alexey Milovidov
c284696e0d
Merge branch 'master' into fix-dynamic-disk-conf 2023-08-01 08:22:52 +03:00
Nikolai Kochetov
c4a00b8c68 Throw S3Exception whenever possible. 2023-07-31 15:39:20 +00:00
kssenii
b683477b20 Better dynamic disk configuration 2023-07-31 14:15:22 +02:00
Alexander Gololobov
24bfd41680
Merge branch 'master' into read_empty_file 2023-07-31 09:41:37 +02:00
kssenii
6ae6268ad0 Revert "Merge pull request #51917 from ClickHouse/revert-system-drop-filesystem-cache-by-key" 
This reverts commit 520195f7ef, reversing
changes made to e36a638014.
 2023-07-30 13:39:54 +02:00
Alexey Milovidov
caa4590361 Merge branch 'master' into check-for-hiding-cyrillic-characters 2023-07-30 02:16:56 +02:00
Alexander Gololobov
84ab423842 Allow reading empty file with no blobs 2023-07-29 19:30:23 +02:00
robot-clickhouse-ci-1
66dd0faec8
Merge pull request #52733 from ClickHouse/zero 
Allow reading zero objects in CachedObjectStorage::readObjects()
 2023-07-29 17:52:32 +02:00
Nikita Mikhaylov
cecc636449
Update CachedObjectStorage.cpp 2023-07-28 19:35:22 +02:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988 
Added possibility to save logs on crash and options to configure logs buffer
 2023-07-28 16:55:00 +03:00
Alexander Gololobov
bf9504d95d
Move UnlinkMetadataFileOperationOutcome to common header (#52710) 2023-07-28 15:49:55 +02:00
Michael Kolupaev
ff9e85529a Allow reading zero objects in CachedObjectStorage::readObjects() 2023-07-28 13:43:15 +00:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
Azat Khuzhin
d40dbdee62 Fix usage of temporary directories during RESTORE 
Previously during RESTORE you may get the following warning in logs:

    <Warning> TemporaryFileOnDisk: Temporary path 'tmp/21672kaaaaa' does not exist in './disks/s3_common_disk/'

The reason is that it uses not disks/s3_common_disk/tmp but instead
disks/s3_common_disk/disks/s3_common_disk/tmp path.

Fix this by adding TemporaryFileOnDisk::getRelativePath() and use it
when appropriate.

And now - `find disks`, does not shows any more temporary leftovers.

v2: rename getPath to getAbsolutePath
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-27 19:24:54 +02:00
Alexander Tokmakov
f3dc6dd061
Revert "Added field refcount to system.remote_data_paths table" 2023-07-27 15:23:57 +03:00
Alexey Milovidov
6aab4cc835 Check for unexpected cyrillic 2023-07-27 05:25:40 +02:00
Anton Popov
568afbbec3 added field with refcount to system.remote_data_paths table 2023-07-25 12:33:15 +00:00
Kseniia Sumarokova
a1782ea70e
Merge pull request #52211 from kssenii/fix-race-in-disk-web 
Fix race in Web disk
 2023-07-23 18:07:25 +02:00
Alexey Milovidov
2467eaf32d
Merge pull request #52392 from azat/netlink-provider 
Rename TaskStatsInfoGetter into NetlinkMetricsProvider
 2023-07-22 19:14:15 +03:00
Alexey Milovidov
a092c17313
Merge branch 'master' into fix-race-in-disk-web 2023-07-22 16:53:27 +03:00
robot-clickhouse-ci-2
0db9c79886
Merge pull request #52332 from rschu1ze/better-formatsettings 
Minor: Less awkward IAST::FormatSettings
 2023-07-21 14:49:58 +02:00
Azat Khuzhin
f0e277f94a Rename TaskStatsInfoGetter into NetlinkMetricsProvider 
There is ProcfsMetricsProvider, so by analogy to it.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-21 06:48:18 +02:00
Alexander Tokmakov
a39ba00ec3
Merge pull request #52116 from aalexfvk/http_failover 
Handle multiple resolved IPs for HTTP/HTTPS session connection
 2023-07-20 18:25:45 +03:00
Robert Schulze
bd761c365a
Make serializeAST() more regular 2023-07-20 10:39:26 +00:00
vdimir
b9009f0e44
Merge pull request #52275 from ClickHouse/vdimir/tmp_data_add_test 2023-07-20 11:34:13 +02:00
Antonio Andelic
0c86df519f Fix unspported disks in Keeper 2023-07-19 12:41:25 +00:00
vdimir
25eee81746
Fix temp data deletion on startup, add test 2023-07-18 16:29:21 +00:00
Kseniia Sumarokova
d11ded952e
Update WebObjectStorage.cpp 2023-07-17 16:09:11 +02:00
kssenii
13b493a353 Add comment 2023-07-17 15:53:47 +02:00
kssenii
988b46e3f0 Fix 2023-07-17 15:45:26 +02:00
Aleksei Filatov
08defa36b2 Add code 2023-07-15 08:18:35 +03:00
robot-ch-test-poll4
139f59f51f
Merge pull request #52038 from azat/s3-plain-send_metadata 
Prohibit send_metadata for s3_plain disks
 2023-07-12 00:37:50 +02:00
Azat Khuzhin
326d51c3fb Prohibit send_metadata for s3_plain disks 
send_metadata changes the filenames (includes revision), while
s3_plain do not care about this, and expect that the file name
will not be changed.

So during initialization s3_plain will do some basic checks and will
write file clickhouse_access_check_e0f72fcc-d6f8-44fe-8997-96cb87767515, but instead
r0000000000000000000000000000000000000000000000000000000000000001-file-clickhouse_access_check_e0f72fcc-d6f8-44fe-8997-96cb87767515
will be written, later read will not find the file and it will fail:

    Application: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4.: While checking access for disk s3_plain: Cannot attach table `system`.`crash_log` ...

And besides, send_metadata does not make sense for s3_plain.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-11 18:34:23 +02:00
Nikolai Kochetov
ab6356f9bc
Merge branch 'master' into vdimir/fix_race_in_remove_objects 2023-07-11 11:22:04 +02:00
vdimir
bd5f393515
Always remove blobs in MetadataStorageFromPlainObjectStorageTransaction::unlinkMetadata 2023-07-11 05:14:39 +00:00
Alexey Milovidov
3d4800995f
Merge pull request #49732 from nickitat/impr_prefetch 
Improve reading with prefetch
 2023-07-09 06:10:58 +03:00
Alexey Milovidov
b1d1918607
Merge branch 'master' into retry 2023-07-08 03:08:48 +03:00
Alexey Milovidov
03d2606eb9
Merge pull request #49342 from ClickHouse/disks-space-improvement 
Slight improvement in Disks interface
 2023-07-08 02:24:57 +03:00
Alexey Milovidov
520195f7ef
Merge pull request #51917 from ClickHouse/revert-system-drop-filesystem-cache-by-key 
Revert system drop filesystem cache by key
 2023-07-07 19:44:28 +03:00
vdimir
88911e1378
Check refcount in finalize for other RemoveObjectStorageOperations 2023-07-07 16:42:03 +00:00
vdimir
227e415d6d
Check refcount in RemoveManyObjectStorageOperation::finalize instead of execute 2023-07-07 15:08:21 +00:00
Alexey Milovidov
4a6a6fc4f2
Merge branch 'master' into disks-space-improvement 2023-07-07 13:43:04 +03:00
xiaolei565
5f523e8376
Merge branch 'master' into xuelei_dev 2023-07-07 10:21:19 +08:00
Alexey Milovidov
7cece62d26 Revert "Merge pull request #51547 from kssenii/more-flexible-drop-cache" 
This reverts commit 2ce7bcaa3d, reversing
changes made to e897207cd5.
 2023-07-07 04:07:19 +02:00
Nikolay Degterinsky
8da8b79cc4
Merge pull request #51854 from fky2015/master 
fix: correct exception messages on policies comparison
 2023-07-07 03:58:06 +02:00
xiaolei565
dd87269fc2
Merge branch 'master' into xuelei_dev 2023-07-07 09:49:34 +08:00
Alexander Tokmakov
fdbd59ec6c
Merge pull request #51135 from ClickHouse/fix_trash_in_disks 
Try to fix some trash in Disks and part moves
 2023-07-07 02:02:17 +03:00
xiaolei565
0e4192f590
Merge branch 'master' into xuelei_dev 2023-07-06 10:35:22 +08:00
Alexey Milovidov
2e454ef89e
Merge branch 'master' into disks-space-improvement 2023-07-06 03:58:45 +03:00
Feng Kaiyu
f7640ff573
fix: correct exception message on policies comparison 2023-07-06 01:27:20 +08:00
Kseniia Sumarokova
f2d942fbb5
Merge branch 'master' into more-flexible-drop-cache 2023-07-05 11:43:57 +02:00
xiaolei565
2c5fc5ee13
Merge branch 'master' into xuelei_dev 2023-07-05 16:33:42 +08:00
Alexey Milovidov
c76cf53391 Address review comments 2023-07-04 22:14:37 +02:00
Alexey Milovidov
4e8405cbda Merge branch 'master' into disks-space-improvement 2023-07-04 22:00:40 +02:00
Alexey Milovidov
5a32995726
Update src/Disks/IVolume.cpp 
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
 2023-07-04 22:57:39 +03:00
Alexey Milovidov
6345879cdf
Update src/Disks/VolumeJBOD.cpp 
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
 2023-07-04 22:56:58 +03:00
kssenii
c4fb532f93 Better 2023-07-03 13:02:10 +02:00
kssenii
b82061ed2d Merge remote-tracking branch 'origin/more-flexible-drop-cache' into more-flexible-drop-cache 2023-07-03 12:38:55 +02:00
kssenii
c575dc37b3 Remove redundant change 2023-07-03 12:38:12 +02:00
Antonio Andelic
eba60dd81e
Merge branch 'master' into keeper-with-disks 2023-07-01 20:59:16 +02:00
Kseniia Sumarokova
b4aa0b3e6e
Merge branch 'master' into more-flexible-drop-cache 2023-07-01 12:59:43 +02:00
Kseniia Sumarokova
c616634972
Merge pull request #51552 from kssenii/allow-adding-disk-name-for-custom-disk 
Allow to add disk name for custom disks
 2023-07-01 12:52:14 +02:00
kssenii
87d2447570 Merge remote-tracking branch 'upstream/master' into more-flexible-drop-cache 2023-06-30 18:22:45 +02:00
Antonio Andelic
2058b1346e Merge branch 'master' into keeper-with-disks 2023-06-30 13:22:33 +00:00
Kseniia Sumarokova
f6742f61cb
Merge branch 'master' into fix-logical-error-read-unexpected-size 2023-06-30 13:02:49 +02:00
Kseniia Sumarokova
65ecf79a0f
Update getOrCreateDiskFromAST.cpp 2023-06-29 17:52:59 +02:00
Kseniia Sumarokova
4b9fa5bab3
Merge branch 'master' into minor-fix-cache 2023-06-29 17:06:08 +02:00
kssenii
b56d1602e8 Invalidate opened file cache when removing file 2023-06-29 14:25:13 +02:00
Kseniia Sumarokova
f73d878632
Update src/Disks/getOrCreateDiskFromAST.cpp 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2023-06-29 13:31:41 +02:00
kssenii
4ba334c983 Review fix 2023-06-29 13:01:31 +02:00
kssenii
39f8b92e24 Allow to add disk name for custom disk 2023-06-28 19:05:35 +02:00
kssenii
1d78bafa82 Flexible drop cache 2023-06-28 18:44:47 +02:00
Alexey Milovidov
a399431977
Update StoragePolicy.cpp 2023-06-28 16:40:57 +03:00
Kseniia Sumarokova
5a1bbe5a8d
Update CachedOnDiskReadBufferFromFile.cpp 2023-06-28 14:05:14 +02:00
xuelei
112310e98f fix storage policy prompt display error 2023-06-28 19:17:53 +08:00
xuelei
68ac4d8cc9 fix storage policy prompt display error 2023-06-28 16:31:57 +08:00
Kseniia Sumarokova
817a62b7cf
Merge branch 'master' into minor-changes-cached-buffer 2023-06-27 13:02:37 +02:00
SmitaRKulkarni
dcf581a985
Merge pull request #50936 from ClickHouse/Fix_race_azure_blob_storage_iterator 
Fix race azure blob storage iterator
 2023-06-27 09:27:45 +02:00
kssenii
a1eb27ce30 Update log message 2023-06-26 18:12:41 +02:00
kssenii
1f60a6ed4e Fix 2023-06-26 12:34:11 +02:00
Alexey Milovidov
cca3f9937c
Merge branch 'master' into retry 2023-06-24 22:29:17 +03:00
robot-clickhouse-ci-1
c66ff09627
Merge pull request #51253 from kssenii/delete-non-evictable-feature 
Delete feature do_not_evict_index_and_mark_files in fs cache
 2023-06-24 02:37:52 +02:00
Alexey Milovidov
7407330130
Merge branch 'master' into retry 2023-06-23 08:18:18 +03:00
Smita Kulkarni
5229544b55 Added function getCurrrentBatchAndScheduleNext to IObjectStorageIteratorAsync 2023-06-21 22:17:39 +02:00
Alexander Tokmakov
b7dd334d55
Merge branch 'master' into fix_trash_in_disks 2023-06-21 22:23:14 +03:00
Sema Checherinda
01de36f1fa
Merge pull request #50395 from CheSema/better-log 
require `finalize()` call before d-tor for all writes buffers
 2023-06-21 21:12:02 +02:00
kssenii
9aa4647f4f Delete feature 2023-06-21 20:48:12 +02:00
Alexander Tokmakov
9157314b2a fix 2023-06-21 20:29:32 +02:00
Michael Kolupaev
4a570a05c9 Decrease default timeouts for S3 and HTTP requests 2023-06-21 18:08:50 +00:00
Alexander Tokmakov
318ac807c7 Merge branch 'master' into fix_trash_in_disks 2023-06-21 14:04:01 +02:00
Alexander Tokmakov
51a5ef33e1 fix 2023-06-20 23:20:37 +02:00
Sema Checherinda
9b0c3359cf
Merge branch 'master' into better-log 2023-06-20 20:37:36 +02:00
Alexander Tokmakov
60a0843f58 fix 2023-06-20 17:47:25 +02:00
kssenii
fcb793dc02 Update exception 2023-06-20 14:26:09 +02:00
Alexander Tokmakov
4949dd0546 fix 2023-06-19 20:21:33 +02:00
Alexander Tokmakov
a2833b2060 remove AsyncTrashPoolExecutor 2023-06-19 19:58:23 +02:00
kssenii
7f9cd56f61 One more 2023-06-19 19:22:45 +02:00
kssenii
ec86028fd8 Change to microseconds 2023-06-19 17:48:56 +02:00
kssenii
0ca2916163 More metrics in cache 2023-06-19 17:22:41 +02:00
Sema Checherinda
e3f892f84a fix gtest with MemoryWriteBuffer, do not mute exception in ReplicatedMergeMutateTaskBase 2023-06-19 00:10:42 +02:00
Sema Checherinda
ce7cd67981 finalize CascadeWriteBuffer 2023-06-18 17:35:12 +02:00
Alexander Tokmakov
76faacd23c try to fix some trash in Disks 2023-06-18 14:59:10 +02:00
Nikita Taranov
b546d8e665 review fixes + test 2023-06-16 15:30:56 +02:00
Nikita Taranov
1dddcc9472 use connection pool 2023-06-14 12:51:02 +02:00
Nikita Taranov
1d33043fe6 changes around buffer sizes 2023-06-14 12:51:02 +02:00
Nikita Taranov
e88fc39895 cosmetics 2023-06-14 12:50:59 +02:00
Kseniia Sumarokova
e2d8299b23
Merge pull request #50952 from nickitat/fix_remote_read_perf_degr 
Fix logic in `AsynchronousBoundedReadBuffer::seek`
 2023-06-14 11:25:26 +02:00
Antonio Andelic
4825286b0c
Merge branch 'master' into keeper-with-disks 2023-06-14 10:48:53 +02:00
Nikita Taranov
1bc5598aa7 impl 2023-06-13 20:02:50 +02:00
Michael Kolupaev
72f2832129
Slightly more information in error message about cached disk (#50897) 2023-06-13 11:07:05 +02:00
Antonio Andelic
cb3ac81110
Merge branch 'master' into keeper-with-disks 2023-06-12 15:14:24 +02:00
Kseniia Sumarokova
ee829061f4
Merge branch 'master' into fix-data-race-in-read-buffer 2023-06-12 10:32:54 +02:00
Alexey Milovidov
ed9c7c9841
Merge pull request #50711 from kssenii/get-rid-of-uneeded-code 
Refactor reading from object storages
 2023-06-10 19:10:25 +03:00
alesapin
96d9b88a20 Fix build 2023-06-09 10:48:13 +02:00
kssenii
ea9d0f6c3c Fix 2023-06-08 18:18:12 +02:00
alesapin
79edd06ee7 Merge remote-tracking branch 'origin/master' into azure_table_function 2023-06-08 17:05:19 +02:00
kssenii
1cbcd2f2ef Refactor reading from object storages 2023-06-08 14:33:59 +02:00
Kseniia Sumarokova
9a7852c908
Merge branch 'master' into fix-cache-slow-with-insert 2023-06-08 10:49:46 +02:00
kssenii
129473ae74 Fix 2023-06-07 20:48:03 +02:00
Alexander Sapin
cf65ac499c Fix iterator 2023-06-07 17:34:26 +02:00
Alexander Sapin
a67dd6e479 Readuntilend 2023-06-07 17:25:48 +02:00
Alexander Sapin
71ae54f089 Fix args 2023-06-07 13:34:01 +02:00
Alexander Sapin
5d52c41689 Merge branch 'master' into azure_table_function 2023-06-07 12:33:26 +02:00
Kseniia Sumarokova
d25ea9b0cf
Merge pull request #50470 from kssenii/add-some-assertions-2 
Add some assertions
 2023-06-07 12:28:28 +02:00
Antonio Andelic
42798e446b Merge branch 'master' into keeper-with-disks 2023-06-06 14:55:47 +00:00
alesapin
a1f3bd9e23 Fix reads 2023-06-06 14:55:17 +02:00
alesapin
36d298ceef
Fix commit for DiskObjectStorage (#50599) 2023-06-06 14:45:58 +02:00
alesapin
d497562a07 Copy and paste 2023-06-06 13:01:21 +02:00
Michael Kolupaev
9f80900d6f Changes related to an internal feature 2023-06-05 18:20:38 -07:00
alesapin
b22e664e25 Implement blob-read 2023-06-06 01:28:04 +02:00