thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-14 18:32:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
131,518 Commits 9,328 Branches 1,783 Tags 2.1 GiB
8d984df135
Commit Graph

2265 Commits

Author SHA1 Message Date
xuelei
bb12f7decc deal with conflict 2023-08-27 23:41:23 -03:00
alesapin
0e601b856f
Merge pull request #53751 from Algunenano/clang18 
Support clang-18 (Wmissing-field-initializers)
 2023-08-25 23:27:06 +02:00
Kseniia Sumarokova
34ac113af6
Merge pull request #53121 from kssenii/fix-cache-logical-error 
Fix possible error from cache "Read unexpected size"
 2023-08-25 12:16:24 +02:00
Raúl Marín
6490213207 Merge remote-tracking branch 'blessed/master' into clang18 2023-08-24 17:35:26 +02:00
Kruglov Pavel
44db5fa992
Merge branch 'master' into cache-count 2023-08-24 17:21:18 +02:00
Arthur Passos
2bade7db08
Add global proxy setting (#51749) 
* initial impl

* fix env ut

* move ut directory

* make sure no null proxy resolver is returned by ProxyConfigurationResolverProvider

* minor adjustment

* add a few tests, still incomplete

* add proxy support for url table function

* use proxy for select from url as well

* remove optional from return type, just returns empty config

* fix style

* style

* black

* ohg boy

* rm in progress file

* god pls don't let me kill anyone

* ...

* add use_aws guards

* remove hard coded s3 proxy resolver

* add concurrency-mt-unsafe

* aa

* black

* add logging back

* revert change

* imrpove code a bit

* helper functions and separate tests

* for some reason, this env test is not working..

* formatting

* :)

* clangtidy

* lint

* revert some stupid things

* small test adjusmtments

* simplify tests

* rename test

* remove extra line

* freaking style change

* simplify a bit

* fix segfault & remove an extra call

* tightly couple proxy provider with context..

* remove useless include

* rename config prefix parameter

* simplify provider a bit

* organize provider a bit

* add a few comments

* comment out proxy env tests

* fix nullptr in unit tests

* make sure old storage proxy config is properly covered without global context instance

* move a few functions from class to anonymous namespace

* fix no fallback for specific storage conf

* change API to accept http method instead of bool

* implement http/https distinction in listresolver, any still not implemented

* implement http/https distinction in remote resolver

* progress on code, improve tests and add url function working test

* use protcol instead of method for http and https

* small fix

* few more adjustments

* fix style

* black

* move enum to proxyconfiguration

* wip

* fix build

* fix ut

* delete atomicroundrobin class

* remove stale include

* add some tests.. need to spend some more time on the design..

* change design a bit

* progress

* use existing context for tests

* rename aux function and fix ut

* ..

* rename test

* try to simplify tests a bit

* simplify tests a bit more

* attempt to fix tests, accept more than one remote resolver

* use proper log id

* try waiting for resolver

* proper wait logic

* black

* empty

* address a few comments

* refactor tests

* remove old tests

* baclk

* use RAII to set/unset env

* black

* clang tidy

* fix env proxy not respecting any

* use log trace

* fix wrong logic in getRemoteREsolver

* fix wrong logic in getRemoteREsolver

* fix test

* remove unwanted code

* remove ClientConfigurationperRequest and auxilary classes

* remove unwanted code

* remove adapter test

* few adjustments and add test for s3 storage conf  with new proxy settings

* black

* use chassert for context

* Add getenv comment
 2023-08-24 16:07:26 +03:00
Kseniia Sumarokova
a4f39fe134
Merge branch 'master' into fix-cache-logical-error 2023-08-24 12:00:18 +02:00
Raúl Marín
93dac0c880 Support clang-18 (Wmissing-field-initializers) 2023-08-23 15:53:45 +02:00
Kruglov Pavel
592fa77987
Merge branch 'master' into cache-count 2023-08-23 15:18:02 +02:00
kssenii
57b5ad854d Fxi 2023-08-23 13:43:05 +02:00
Sema Checherinda
60103c577d
Merge pull request #53651 from CheSema/read_beyon_last_offset 
fix Logical Error in AsynchronousBoundedReadBuffer
 2023-08-23 11:21:47 +02:00
avogar
cd228754c8 Apply suggestions 2023-08-22 17:32:35 +00:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Sema Checherinda
81577e041b fix Logical Error in AsynchronousBoundedReadBuffer 2023-08-21 19:30:04 +02:00
Kseniia Sumarokova
404fb0588a
Merge branch 'master' into fix-cache-logical-error 2023-08-20 16:28:13 +02:00
kssenii
5382442da0 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-19 08:44:36 +04:00
Yakov Olkhovskiy
c73037a602 Merge remote-tracking branch 'ch/master' into unify_keep_alive_setting 2023-08-17 20:40:18 +00:00
Michael Kolupaev
557bfea4d8 Use long timeout for S3 copy requests 2023-08-17 19:36:45 +00:00
Kseniia Sumarokova
99f7a83385
Merge branch 'master' into allowed-caches-dir-for-dynamic-disks 2023-08-10 22:26:33 +02:00
Alexey Milovidov
bb57caa83e
Merge pull request #53180 from ClickHouse/ditch-tons-of-garbage 
Ditch tons of garbage
 2023-08-10 16:59:51 +03:00
Kseniia Sumarokova
e79f1ad724
Merge branch 'master' into allowed-caches-dir-for-dynamic-disks 2023-08-10 11:02:11 +02:00
Kseniia Sumarokova
c4c76f60a7
Merge branch 'master' into fix-cache-logical-error 2023-08-10 10:55:22 +02:00
Alexey Milovidov
a807ccec6c Merge remote-tracking branch 'origin/Retry_for_TransportException_Azure' into remove-gargabe-tests 2023-08-10 02:21:25 +02:00
Smita Kulkarni
901901a762 Fixed typo 2023-08-09 16:50:40 +02:00
Smita Kulkarni
9953050b62 Fixed logs for download 2023-08-09 14:57:17 +02:00
Smita Kulkarni
dc4be33895 Updated logs to include retries 2023-08-09 14:55:44 +02:00
Kseniia Sumarokova
944e85d4e5
Merge branch 'master' into fix-cache-logical-error 2023-08-09 12:08:53 +02:00
kssenii
2cfb4c0264 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-09 11:09:34 +02:00
Alexey Milovidov
aa757490bd Ditch tons of garbage 2023-08-09 02:19:02 +02:00
Kseniia Sumarokova
f4553c2aa7
Update registerDiskCache.cpp 2023-08-08 17:06:41 +02:00
Smita Kulkarni
473fb60e6f Added retry for TransportException for azure read & download 2023-08-07 18:56:18 +02:00
kssenii
0c174a7ec1 Allow to restrict fs caches paths 2023-08-07 18:00:26 +02:00
Vitaly Baranov
7082cbf5c6 Use more unique name for TemporaryFileOnDisk. 2023-08-07 17:56:30 +02:00
kssenii
9cdd886fde Fix 2023-08-07 16:46:42 +02:00
Nikita Taranov
37d382aba4 impl 2023-08-05 20:30:49 +02:00
Kseniia Sumarokova
eabca22909
Merge branch 'master' into revert-revert-drop-cache 2023-08-01 23:19:38 +02:00
Vitaly Baranov
65bd8f5e81
Merge branch 'master' into backups-fix-tmp-files 2023-08-01 16:37:06 +02:00
Alexey Milovidov
c284696e0d
Merge branch 'master' into fix-dynamic-disk-conf 2023-08-01 08:22:52 +03:00
Nikolai Kochetov
c4a00b8c68 Throw S3Exception whenever possible. 2023-07-31 15:39:20 +00:00
kssenii
b683477b20 Better dynamic disk configuration 2023-07-31 14:15:22 +02:00
Alexander Gololobov
24bfd41680
Merge branch 'master' into read_empty_file 2023-07-31 09:41:37 +02:00
kssenii
6ae6268ad0 Revert "Merge pull request #51917 from ClickHouse/revert-system-drop-filesystem-cache-by-key" 
This reverts commit 520195f7ef, reversing
changes made to e36a638014.
 2023-07-30 13:39:54 +02:00
Alexey Milovidov
caa4590361 Merge branch 'master' into check-for-hiding-cyrillic-characters 2023-07-30 02:16:56 +02:00
Alexander Gololobov
84ab423842 Allow reading empty file with no blobs 2023-07-29 19:30:23 +02:00
robot-clickhouse-ci-1
66dd0faec8
Merge pull request #52733 from ClickHouse/zero 
Allow reading zero objects in CachedObjectStorage::readObjects()
 2023-07-29 17:52:32 +02:00
Nikita Mikhaylov
cecc636449
Update CachedObjectStorage.cpp 2023-07-28 19:35:22 +02:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988 
Added possibility to save logs on crash and options to configure logs buffer
 2023-07-28 16:55:00 +03:00
Alexander Gololobov
bf9504d95d
Move UnlinkMetadataFileOperationOutcome to common header (#52710) 2023-07-28 15:49:55 +02:00
Michael Kolupaev
ff9e85529a Allow reading zero objects in CachedObjectStorage::readObjects() 2023-07-28 13:43:15 +00:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
Azat Khuzhin
d40dbdee62 Fix usage of temporary directories during RESTORE 
Previously during RESTORE you may get the following warning in logs:

    <Warning> TemporaryFileOnDisk: Temporary path 'tmp/21672kaaaaa' does not exist in './disks/s3_common_disk/'

The reason is that it uses not disks/s3_common_disk/tmp but instead
disks/s3_common_disk/disks/s3_common_disk/tmp path.

Fix this by adding TemporaryFileOnDisk::getRelativePath() and use it
when appropriate.

And now - `find disks`, does not shows any more temporary leftovers.

v2: rename getPath to getAbsolutePath
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-27 19:24:54 +02:00
Alexander Tokmakov
f3dc6dd061
Revert "Added field refcount to system.remote_data_paths table" 2023-07-27 15:23:57 +03:00
Alexey Milovidov
6aab4cc835 Check for unexpected cyrillic 2023-07-27 05:25:40 +02:00
Anton Popov
568afbbec3 added field with refcount to system.remote_data_paths table 2023-07-25 12:33:15 +00:00
Kseniia Sumarokova
a1782ea70e
Merge pull request #52211 from kssenii/fix-race-in-disk-web 
Fix race in Web disk
 2023-07-23 18:07:25 +02:00
Alexey Milovidov
2467eaf32d
Merge pull request #52392 from azat/netlink-provider 
Rename TaskStatsInfoGetter into NetlinkMetricsProvider
 2023-07-22 19:14:15 +03:00
Alexey Milovidov
a092c17313
Merge branch 'master' into fix-race-in-disk-web 2023-07-22 16:53:27 +03:00
robot-clickhouse-ci-2
0db9c79886
Merge pull request #52332 from rschu1ze/better-formatsettings 
Minor: Less awkward IAST::FormatSettings
 2023-07-21 14:49:58 +02:00
Azat Khuzhin
f0e277f94a Rename TaskStatsInfoGetter into NetlinkMetricsProvider 
There is ProcfsMetricsProvider, so by analogy to it.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-21 06:48:18 +02:00
Alexander Tokmakov
a39ba00ec3
Merge pull request #52116 from aalexfvk/http_failover 
Handle multiple resolved IPs for HTTP/HTTPS session connection
 2023-07-20 18:25:45 +03:00
Robert Schulze
bd761c365a
Make serializeAST() more regular 2023-07-20 10:39:26 +00:00
vdimir
b9009f0e44
Merge pull request #52275 from ClickHouse/vdimir/tmp_data_add_test 2023-07-20 11:34:13 +02:00
Antonio Andelic
0c86df519f Fix unspported disks in Keeper 2023-07-19 12:41:25 +00:00
vdimir
25eee81746
Fix temp data deletion on startup, add test 2023-07-18 16:29:21 +00:00
Kseniia Sumarokova
d11ded952e
Update WebObjectStorage.cpp 2023-07-17 16:09:11 +02:00
kssenii
13b493a353 Add comment 2023-07-17 15:53:47 +02:00
kssenii
988b46e3f0 Fix 2023-07-17 15:45:26 +02:00
Aleksei Filatov
08defa36b2 Add code 2023-07-15 08:18:35 +03:00
robot-ch-test-poll4
139f59f51f
Merge pull request #52038 from azat/s3-plain-send_metadata 
Prohibit send_metadata for s3_plain disks
 2023-07-12 00:37:50 +02:00
Azat Khuzhin
326d51c3fb Prohibit send_metadata for s3_plain disks 
send_metadata changes the filenames (includes revision), while
s3_plain do not care about this, and expect that the file name
will not be changed.

So during initialization s3_plain will do some basic checks and will
write file clickhouse_access_check_e0f72fcc-d6f8-44fe-8997-96cb87767515, but instead
r0000000000000000000000000000000000000000000000000000000000000001-file-clickhouse_access_check_e0f72fcc-d6f8-44fe-8997-96cb87767515
will be written, later read will not find the file and it will fail:

    Application: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4.: While checking access for disk s3_plain: Cannot attach table `system`.`crash_log` ...

And besides, send_metadata does not make sense for s3_plain.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-11 18:34:23 +02:00
Nikolai Kochetov
ab6356f9bc
Merge branch 'master' into vdimir/fix_race_in_remove_objects 2023-07-11 11:22:04 +02:00
vdimir
bd5f393515
Always remove blobs in MetadataStorageFromPlainObjectStorageTransaction::unlinkMetadata 2023-07-11 05:14:39 +00:00
Alexey Milovidov
3d4800995f
Merge pull request #49732 from nickitat/impr_prefetch 
Improve reading with prefetch
 2023-07-09 06:10:58 +03:00
Alexey Milovidov
b1d1918607
Merge branch 'master' into retry 2023-07-08 03:08:48 +03:00
Alexey Milovidov
03d2606eb9
Merge pull request #49342 from ClickHouse/disks-space-improvement 
Slight improvement in Disks interface
 2023-07-08 02:24:57 +03:00
Alexey Milovidov
520195f7ef
Merge pull request #51917 from ClickHouse/revert-system-drop-filesystem-cache-by-key 
Revert system drop filesystem cache by key
 2023-07-07 19:44:28 +03:00
vdimir
88911e1378
Check refcount in finalize for other RemoveObjectStorageOperations 2023-07-07 16:42:03 +00:00
vdimir
227e415d6d
Check refcount in RemoveManyObjectStorageOperation::finalize instead of execute 2023-07-07 15:08:21 +00:00
Alexey Milovidov
4a6a6fc4f2
Merge branch 'master' into disks-space-improvement 2023-07-07 13:43:04 +03:00
xiaolei565
5f523e8376
Merge branch 'master' into xuelei_dev 2023-07-07 10:21:19 +08:00
Alexey Milovidov
7cece62d26 Revert "Merge pull request #51547 from kssenii/more-flexible-drop-cache" 
This reverts commit 2ce7bcaa3d, reversing
changes made to e897207cd5.
 2023-07-07 04:07:19 +02:00
Nikolay Degterinsky
8da8b79cc4
Merge pull request #51854 from fky2015/master 
fix: correct exception messages on policies comparison
 2023-07-07 03:58:06 +02:00
xiaolei565
dd87269fc2
Merge branch 'master' into xuelei_dev 2023-07-07 09:49:34 +08:00
Alexander Tokmakov
fdbd59ec6c
Merge pull request #51135 from ClickHouse/fix_trash_in_disks 
Try to fix some trash in Disks and part moves
 2023-07-07 02:02:17 +03:00
xiaolei565
0e4192f590
Merge branch 'master' into xuelei_dev 2023-07-06 10:35:22 +08:00
Alexey Milovidov
2e454ef89e
Merge branch 'master' into disks-space-improvement 2023-07-06 03:58:45 +03:00
Feng Kaiyu
f7640ff573
fix: correct exception message on policies comparison 2023-07-06 01:27:20 +08:00
Kseniia Sumarokova
f2d942fbb5
Merge branch 'master' into more-flexible-drop-cache 2023-07-05 11:43:57 +02:00
xiaolei565
2c5fc5ee13
Merge branch 'master' into xuelei_dev 2023-07-05 16:33:42 +08:00
Alexey Milovidov
c76cf53391 Address review comments 2023-07-04 22:14:37 +02:00
Alexey Milovidov
4e8405cbda Merge branch 'master' into disks-space-improvement 2023-07-04 22:00:40 +02:00
Alexey Milovidov
5a32995726
Update src/Disks/IVolume.cpp 
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
 2023-07-04 22:57:39 +03:00
Alexey Milovidov
6345879cdf
Update src/Disks/VolumeJBOD.cpp 
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
 2023-07-04 22:56:58 +03:00
kssenii
c4fb532f93 Better 2023-07-03 13:02:10 +02:00
kssenii
b82061ed2d Merge remote-tracking branch 'origin/more-flexible-drop-cache' into more-flexible-drop-cache 2023-07-03 12:38:55 +02:00
kssenii
c575dc37b3 Remove redundant change 2023-07-03 12:38:12 +02:00
Antonio Andelic
eba60dd81e
Merge branch 'master' into keeper-with-disks 2023-07-01 20:59:16 +02:00
Kseniia Sumarokova
b4aa0b3e6e
Merge branch 'master' into more-flexible-drop-cache 2023-07-01 12:59:43 +02:00
Kseniia Sumarokova
c616634972
Merge pull request #51552 from kssenii/allow-adding-disk-name-for-custom-disk 
Allow to add disk name for custom disks
 2023-07-01 12:52:14 +02:00
kssenii
87d2447570 Merge remote-tracking branch 'upstream/master' into more-flexible-drop-cache 2023-06-30 18:22:45 +02:00
Antonio Andelic
2058b1346e Merge branch 'master' into keeper-with-disks 2023-06-30 13:22:33 +00:00
Kseniia Sumarokova
f6742f61cb
Merge branch 'master' into fix-logical-error-read-unexpected-size 2023-06-30 13:02:49 +02:00
Kseniia Sumarokova
65ecf79a0f
Update getOrCreateDiskFromAST.cpp 2023-06-29 17:52:59 +02:00
Kseniia Sumarokova
4b9fa5bab3
Merge branch 'master' into minor-fix-cache 2023-06-29 17:06:08 +02:00
kssenii
b56d1602e8 Invalidate opened file cache when removing file 2023-06-29 14:25:13 +02:00
Kseniia Sumarokova
f73d878632
Update src/Disks/getOrCreateDiskFromAST.cpp 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2023-06-29 13:31:41 +02:00
kssenii
4ba334c983 Review fix 2023-06-29 13:01:31 +02:00
kssenii
39f8b92e24 Allow to add disk name for custom disk 2023-06-28 19:05:35 +02:00
kssenii
1d78bafa82 Flexible drop cache 2023-06-28 18:44:47 +02:00
Alexey Milovidov
a399431977
Update StoragePolicy.cpp 2023-06-28 16:40:57 +03:00
Kseniia Sumarokova
5a1bbe5a8d
Update CachedOnDiskReadBufferFromFile.cpp 2023-06-28 14:05:14 +02:00
xuelei
112310e98f fix storage policy prompt display error 2023-06-28 19:17:53 +08:00
xuelei
68ac4d8cc9 fix storage policy prompt display error 2023-06-28 16:31:57 +08:00
Kseniia Sumarokova
817a62b7cf
Merge branch 'master' into minor-changes-cached-buffer 2023-06-27 13:02:37 +02:00
SmitaRKulkarni
dcf581a985
Merge pull request #50936 from ClickHouse/Fix_race_azure_blob_storage_iterator 
Fix race azure blob storage iterator
 2023-06-27 09:27:45 +02:00
kssenii
a1eb27ce30 Update log message 2023-06-26 18:12:41 +02:00
kssenii
1f60a6ed4e Fix 2023-06-26 12:34:11 +02:00
Alexey Milovidov
cca3f9937c
Merge branch 'master' into retry 2023-06-24 22:29:17 +03:00
robot-clickhouse-ci-1
c66ff09627
Merge pull request #51253 from kssenii/delete-non-evictable-feature 
Delete feature do_not_evict_index_and_mark_files in fs cache
 2023-06-24 02:37:52 +02:00
Alexey Milovidov
7407330130
Merge branch 'master' into retry 2023-06-23 08:18:18 +03:00
Smita Kulkarni
5229544b55 Added function getCurrrentBatchAndScheduleNext to IObjectStorageIteratorAsync 2023-06-21 22:17:39 +02:00
Alexander Tokmakov
b7dd334d55
Merge branch 'master' into fix_trash_in_disks 2023-06-21 22:23:14 +03:00
Sema Checherinda
01de36f1fa
Merge pull request #50395 from CheSema/better-log 
require `finalize()` call before d-tor for all writes buffers
 2023-06-21 21:12:02 +02:00
kssenii
9aa4647f4f Delete feature 2023-06-21 20:48:12 +02:00
Alexander Tokmakov
9157314b2a fix 2023-06-21 20:29:32 +02:00
Michael Kolupaev
4a570a05c9 Decrease default timeouts for S3 and HTTP requests 2023-06-21 18:08:50 +00:00
Alexander Tokmakov
318ac807c7 Merge branch 'master' into fix_trash_in_disks 2023-06-21 14:04:01 +02:00
Alexander Tokmakov
51a5ef33e1 fix 2023-06-20 23:20:37 +02:00
Sema Checherinda
9b0c3359cf
Merge branch 'master' into better-log 2023-06-20 20:37:36 +02:00
Alexander Tokmakov
60a0843f58 fix 2023-06-20 17:47:25 +02:00
kssenii
fcb793dc02 Update exception 2023-06-20 14:26:09 +02:00
Alexander Tokmakov
4949dd0546 fix 2023-06-19 20:21:33 +02:00
Alexander Tokmakov
a2833b2060 remove AsyncTrashPoolExecutor 2023-06-19 19:58:23 +02:00
kssenii
7f9cd56f61 One more 2023-06-19 19:22:45 +02:00
kssenii
ec86028fd8 Change to microseconds 2023-06-19 17:48:56 +02:00
kssenii
0ca2916163 More metrics in cache 2023-06-19 17:22:41 +02:00
Sema Checherinda
e3f892f84a fix gtest with MemoryWriteBuffer, do not mute exception in ReplicatedMergeMutateTaskBase 2023-06-19 00:10:42 +02:00
Sema Checherinda
ce7cd67981 finalize CascadeWriteBuffer 2023-06-18 17:35:12 +02:00
Alexander Tokmakov
76faacd23c try to fix some trash in Disks 2023-06-18 14:59:10 +02:00
Nikita Taranov
b546d8e665 review fixes + test 2023-06-16 15:30:56 +02:00
Nikita Taranov
1dddcc9472 use connection pool 2023-06-14 12:51:02 +02:00
Nikita Taranov
1d33043fe6 changes around buffer sizes 2023-06-14 12:51:02 +02:00
Nikita Taranov
e88fc39895 cosmetics 2023-06-14 12:50:59 +02:00
Kseniia Sumarokova
e2d8299b23
Merge pull request #50952 from nickitat/fix_remote_read_perf_degr 
Fix logic in `AsynchronousBoundedReadBuffer::seek`
 2023-06-14 11:25:26 +02:00
Antonio Andelic
4825286b0c
Merge branch 'master' into keeper-with-disks 2023-06-14 10:48:53 +02:00
Nikita Taranov
1bc5598aa7 impl 2023-06-13 20:02:50 +02:00
Michael Kolupaev
72f2832129
Slightly more information in error message about cached disk (#50897) 2023-06-13 11:07:05 +02:00
Antonio Andelic
cb3ac81110
Merge branch 'master' into keeper-with-disks 2023-06-12 15:14:24 +02:00
Kseniia Sumarokova
ee829061f4
Merge branch 'master' into fix-data-race-in-read-buffer 2023-06-12 10:32:54 +02:00
Alexey Milovidov
ed9c7c9841
Merge pull request #50711 from kssenii/get-rid-of-uneeded-code 
Refactor reading from object storages
 2023-06-10 19:10:25 +03:00
alesapin
96d9b88a20 Fix build 2023-06-09 10:48:13 +02:00
kssenii
ea9d0f6c3c Fix 2023-06-08 18:18:12 +02:00
alesapin
79edd06ee7 Merge remote-tracking branch 'origin/master' into azure_table_function 2023-06-08 17:05:19 +02:00
kssenii
1cbcd2f2ef Refactor reading from object storages 2023-06-08 14:33:59 +02:00
Kseniia Sumarokova
9a7852c908
Merge branch 'master' into fix-cache-slow-with-insert 2023-06-08 10:49:46 +02:00
kssenii
129473ae74 Fix 2023-06-07 20:48:03 +02:00
Alexander Sapin
cf65ac499c Fix iterator 2023-06-07 17:34:26 +02:00
Alexander Sapin
a67dd6e479 Readuntilend 2023-06-07 17:25:48 +02:00
Alexander Sapin
71ae54f089 Fix args 2023-06-07 13:34:01 +02:00
Alexander Sapin
5d52c41689 Merge branch 'master' into azure_table_function 2023-06-07 12:33:26 +02:00
Kseniia Sumarokova
d25ea9b0cf
Merge pull request #50470 from kssenii/add-some-assertions-2 
Add some assertions
 2023-06-07 12:28:28 +02:00
Antonio Andelic
42798e446b Merge branch 'master' into keeper-with-disks 2023-06-06 14:55:47 +00:00
alesapin
a1f3bd9e23 Fix reads 2023-06-06 14:55:17 +02:00
alesapin
36d298ceef
Fix commit for DiskObjectStorage (#50599) 2023-06-06 14:45:58 +02:00
alesapin
d497562a07 Copy and paste 2023-06-06 13:01:21 +02:00
Michael Kolupaev
9f80900d6f Changes related to an internal feature 2023-06-05 18:20:38 -07:00
alesapin
b22e664e25 Implement blob-read 2023-06-06 01:28:04 +02:00
alesapin
934237091d Merge remote-tracking branch 'origin/azure_table_function' into azure 2023-06-06 00:40:05 +02:00
Smita Kulkarni
93e9752a3f Merge branch 'azure' into azure_table_function 2023-06-05 19:01:35 +02:00
Alexander Sapin
3bd23f1692 Merge branch 'master' into azure 2023-06-05 12:33:30 +02:00
Antonio Andelic
c4873027c3 Merge branch 'master' into keeper-with-disks 2023-06-05 07:08:33 +00:00
alesapin
02923138a3 Merge branch 'master' into azure 2023-06-04 16:43:28 +02:00
alesapin
0f4dd26ceb Add async iteration to object storage 2023-06-04 16:03:44 +02:00
kssenii
411cf84db2 Merge remote-tracking branch 'upstream/master' into add-some-assertions-2 2023-06-04 13:32:57 +02:00
alesapin
4fd674a3b2
Merge pull request #50521 from ClickHouse/get_rid_of_strange_object_storage 
Remove strange object storage methods
 2023-06-04 12:09:09 +02:00
alesapin
57070227a8 Fxi 2023-06-03 23:44:19 +02:00
alesapin
a0df856605 Able to insert 2023-06-03 23:11:03 +02:00
kssenii
05fbebbdac Merge remote-tracking branch 'upstream/master' into add-some-assertions-2 2023-06-03 20:19:14 +02:00
alesapin
894457d6e1 Style fxi 2023-06-03 14:36:52 +02:00
alesapin
c73c836f9d Better 2023-06-02 23:33:04 +02:00
alesapin
b091d85bb1 Remove strange object storage methods 2023-06-02 23:30:47 +02:00
Alexey Milovidov
9e938d7eec
Merge pull request #49287 from nickitat/optimize_reading2 
Optimise hot reading from remote tables
 2023-06-02 23:51:57 +03:00
alesapin
8e4a2a42fb Some code 2023-06-02 16:51:09 +02:00
Antonio Andelic
5f625dcdd9 Merge branch 'master' into keeper-with-disks 2023-06-02 13:35:18 +00:00
kssenii
21e9877098 Add assertion 2023-06-02 15:08:04 +02:00
Kseniia Sumarokova
0c15a2ddc6
Merge pull request #50025 from kssenii/add-some-assertions 
Add some assertions
 2023-06-01 20:20:19 +02:00
Antonio Andelic
514beb783b Merge branch 'master' into keeper-with-disks 2023-06-01 12:19:43 +00:00
Alexey Milovidov
75de3ffba8
Merge branch 'master' into fix-async-buffer 2023-06-01 03:40:28 +03:00
kssenii
dbae50b6db Better logging 2023-05-31 14:50:59 +02:00
kssenii
a59effcc88 Minor improvements 2023-05-31 14:40:13 +02:00
kssenii
7d077f6130 Add one more assertion 2023-05-31 14:30:27 +02:00
kssenii
74dc37cf61 Fix assertion 2023-05-31 14:15:28 +02:00
Vitaly Baranov
6d45d0c374
Use fingerprints instead of key IDs in encrypted disks (#49882) 
* Use fingerprints instead of key IDs to find keys in encrypted disks.
Always use little endian in the headers of encryption files.

* Add tests.

* Fix copying binary files to test containers.

* Fix ownership for copied files in test containers.

* Add comments after review.

---------

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-05-31 13:11:10 +02:00
kssenii
322d9b68f6 Merge remote-tracking branch 'upstream/master' into add-some-assertions 2023-05-31 12:04:44 +02:00
kssenii
7fcafaabd5 Fix 2023-05-30 20:56:48 +02:00
Sema Checherinda
0b4ea3e2e1 remove reminder comments 2023-05-30 12:26:20 +02:00
Sema Checherinda
d95e5b51af mark all finalize calls in buffers d-tors with issue id 2023-05-30 12:26:20 +02:00
Sema Checherinda
0e019c8e83 turn off some d-tor finalize 2023-05-30 12:26:20 +02:00
Antonio Andelic
67746bfff2 Merge branch 'master' into keeper-with-disks 2023-05-30 09:50:12 +00:00