Raúl Marín
|
bfc122df64
|
Fix some typos in Storage classes
|
2021-06-28 19:03:56 +02:00 |
|
kssenii
|
ac0f86cdbf
|
Truncate for s3
|
2021-06-21 15:44:36 +00:00 |
|
Nikita Mikhaylov
|
0055a924f6
|
better
|
2021-06-01 14:23:46 +00:00 |
|
Nikita Mikhaylov
|
3f18bde246
|
Merge branch 'master' of github.com:ClickHouse/ClickHouse into merging-s3-backoff
|
2021-06-01 13:39:09 +00:00 |
|
Nikita Mikhaylov
|
f33b70c54a
|
better
|
2021-05-20 00:42:25 +03:00 |
|
kssenii
|
9b8df78fdd
|
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
|
2021-05-17 17:42:05 +03:00 |
|
Vladimir Chebotarev
|
bdf03387ab
|
Better S3 read retries. Renamed s3_max_single_read_retries -> s3_single_read_retry_attempts, added sleeps before next attempts.
|
2021-05-17 10:38:32 +03:00 |
|
feng lv
|
9035e3a643
|
fix test and conflict
|
2021-05-11 16:22:24 +00:00 |
|
kssenii
|
393b026f2e
|
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
|
2021-05-11 16:49:23 +03:00 |
|
Vladimir
|
d02d14fa00
|
Merge pull request #23846 from excitoon-favorites/s3regions
|
2021-05-10 12:14:08 +03:00 |
|
kssenii
|
266567e04c
|
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
|
2021-05-08 17:49:05 +03:00 |
|
kssenii
|
02288359c5
|
Less manual concatenation of paths
|
2021-05-08 13:59:55 +03:00 |
|
Azat Khuzhin
|
e398635cb3
|
Make StorageS3.cpp self compilable (missing AbstractConfiguration.h)
|
2021-05-07 10:07:44 +03:00 |
|
feng lv
|
39f68bf5ff
|
fix conflict
|
2021-05-02 16:33:45 +00:00 |
|
Vladimir Chebotarev
|
a6ab040b07
|
Added region parameter for S3 storage and disk.
|
2021-05-01 20:45:35 +03:00 |
|
Azat Khuzhin
|
a4036a8199
|
Correctly stop ParallelFormattingOutputFormat from StorageS3BlockOutputStream
|
2021-04-25 12:49:57 +03:00 |
|
feng lv
|
0f5c05854c
|
fix conflict
|
2021-04-23 12:22:51 +00:00 |
|
feng lv
|
4ffe199d39
|
Implement table comments
|
2021-04-23 12:18:23 +00:00 |
|
Nikita Mikhaylov
|
f55eacee7d
|
Merge pull request #22988 from excitoon-favorites/s3connectionresetretries
Retries on HTTP connection drops during reads from S3
|
2021-04-20 14:59:21 +03:00 |
|
Vladimir Chebotarev
|
9d4295f261
|
Removed infinite retries.
|
2021-04-19 11:02:36 +03:00 |
|
Vladimir Chebotarev
|
f59d35efd8
|
Rebase fix.
|
2021-04-15 10:53:00 +03:00 |
|
Vladimir Chebotarev
|
c0ea3ce08a
|
Removed STS client.
|
2021-04-15 10:01:43 +03:00 |
|
Vladimir Chebotarev
|
3a467ffc50
|
Attempt to make credentials provider which uses internal credentials provider chain.
|
2021-04-15 10:01:13 +03:00 |
|
Vladimir Chebotarev
|
037a4de854
|
Added STS GetCallerIdentity credentials provider.
|
2021-04-15 10:00:18 +03:00 |
|
Vladimir Chebotarev
|
10bf56e540
|
Attempt to add retries to S3 reads.
|
2021-04-15 09:47:19 +03:00 |
|
Nikita Mikhaylov
|
2a86d76ccd
|
style
|
2021-04-13 23:19:04 +03:00 |
|
Nikita Mikhaylov
|
ec35a878d3
|
simplify storages3cluster
|
2021-04-13 23:17:25 +03:00 |
|
Nikita Mikhaylov
|
024374a2ec
|
review fixes
|
2021-04-13 22:39:43 +03:00 |
|
Nikita Mikhaylov
|
a743442a17
|
build fixes
|
2021-04-13 22:39:43 +03:00 |
|
Nikita Mikhaylov
|
507cb8514a
|
review fixes
|
2021-04-13 22:39:43 +03:00 |
|
Nikita Mikhaylov
|
7a68820342
|
style
|
2021-04-13 22:39:42 +03:00 |
|
Nikita Mikhaylov
|
7b95ff579d
|
fix S3 test
|
2021-04-13 22:39:42 +03:00 |
|
Nikita Mikhaylov
|
4465a0627f
|
better
|
2021-04-13 22:39:42 +03:00 |
|
Nikita Mikhaylov
|
c333c3dedb
|
review fixes
|
2021-04-13 22:39:42 +03:00 |
|
Nikita Mikhaylov
|
36a8419f60
|
style
|
2021-04-13 22:39:42 +03:00 |
|
Nikita Mikhaylov
|
7276b40556
|
better
|
2021-04-13 22:39:42 +03:00 |
|
Nikita Mikhaylov
|
587fbdd10d
|
better
|
2021-04-13 22:39:42 +03:00 |
|
Nikita Mikhaylov
|
3ab17233cf
|
cleanup
|
2021-04-13 22:39:42 +03:00 |
|
Nikita Mikhaylov
|
b3094412b1
|
better
|
2021-04-13 22:39:42 +03:00 |
|
Nikita Mikhaylov
|
64b4cd0e63
|
save
|
2021-04-13 22:39:41 +03:00 |
|
Nikita Mikhaylov
|
44ca65a9a4
|
save
|
2021-04-13 22:39:41 +03:00 |
|
Ivan
|
495c6e03aa
|
Replace all Context references with std::weak_ptr (#22297)
* Replace all Context references with std::weak_ptr
* Fix shared context captured by value
* Fix build
* Fix Context with named sessions
* Fix copy context
* Fix gcc build
* Merge with master and fix build
* Fix gcc-9 build
|
2021-04-11 02:33:54 +03:00 |
|
Nikita Mikhaylov
|
7d7a2bc724
|
Merge pull request #21630 from nikitamikhaylov/pf-local
Parallel formatting for clickhouse-local
|
2021-03-16 14:37:40 +03:00 |
|
Nikita Mikhaylov
|
1f92c8ce58
|
parallel formatting everywhere
|
2021-03-15 14:51:24 +03:00 |
|
vdimir
|
1194d50e48
|
Try to fix test_storage_s3: crash in WriteBufferFromS3
|
2021-03-11 15:21:13 +03:00 |
|
Pervakov Grigorii
|
eb87afc4d4
|
recreate S3 client if credentials changed
|
2021-03-10 13:36:57 +03:00 |
|
alexey-milovidov
|
a299790522
|
Merge pull request #19748 from excitoon-favorites/s3ssec
Added Server Side Encryption Customer Keys support in S3 client
|
2021-02-15 15:23:14 +03:00 |
|
Vladimir Chebotarev
|
d729aacb09
|
Fixed table function S3 auto compression mode.
|
2021-01-29 07:54:52 +03:00 |
|
Vladimir Chebotarev
|
579f8da573
|
Added SSE-C support in S3 client.
|
2021-01-28 09:32:41 +03:00 |
|
alexey-milovidov
|
7c240d0ca7
|
Merge pull request #17870 from excitoon-favorites/s3testiostream
Update of AWS C++ SDK
|
2021-01-28 07:12:52 +03:00 |
|
Vladimir Chebotarev
|
afdea5eff0
|
Changed handling of PocoHTTPClientConfiguration in order to ensure AWS SDK is initialized.
|
2021-01-27 09:38:35 +03:00 |
|
Vladimir Chebotarev
|
8ba8e8efd5
|
Added prefix-based S3 endpoint settings.
|
2021-01-25 06:40:57 +03:00 |
|
Vladimir Chebotarev
|
5cbc25c647
|
Added global setting s3_max_connections.
|
2021-01-05 13:34:55 +03:00 |
|
Nikita Mikhailov
|
c5f92e5096
|
better formatfactory
|
2020-12-30 06:07:30 +03:00 |
|
Nikita Mikhailov
|
d293ae5e8e
|
style
|
2020-12-28 20:18:53 +03:00 |
|
Nikita Mikhaylov
|
e0addac6fc
|
save changes
|
2020-12-15 00:56:46 +03:00 |
|
Pavel Kovalenko
|
59a5e63417
|
Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload
# Conflicts:
# src/Disks/S3/DiskS3.cpp
# src/Disks/S3/DiskS3.h
# src/Disks/S3/registerDiskS3.cpp
# src/IO/WriteBufferFromS3.cpp
# src/IO/WriteBufferFromS3.h
|
2020-12-11 18:28:41 +03:00 |
|
Vladimir Chebotarev
|
39d867e56d
|
Added proper authentication for S3 client (#16856)
|
2020-12-10 12:19:42 +03:00 |
|
Pavel Kovalenko
|
db7a87089b
|
Adaptive choose of single/multi part upload in WriteBufferFromS3.
|
2020-12-09 17:09:04 +03:00 |
|
alesapin
|
45f09fe293
|
Merge pull request #17220 from ianton-ru/s3_max_redirects
S3 max redirects
|
2020-11-24 12:13:10 +03:00 |
|
Anton Ivashkin
|
aa208a9d9f
|
Use only 's3_max_redirect' in params instead of all settings
|
2020-11-23 14:02:17 +03:00 |
|
Amos Bird
|
1d9d586e20
|
Make global_context consistent.
|
2020-11-20 18:23:14 +08:00 |
|
Anton Ivashkin
|
15b5d3a55a
|
Merge master
|
2020-11-13 19:32:35 +03:00 |
|
Anton Ivashkin
|
026f7e0a27
|
Add 's3_max_redirects' setting
|
2020-11-13 19:31:51 +03:00 |
|
Alexander Tokmakov
|
b94cc5c4e5
|
remove more stringstreams
|
2020-11-10 21:22:26 +03:00 |
|
Alexander Tokmakov
|
5cdfcfb307
|
remove other stringstreams
|
2020-11-09 22:12:44 +03:00 |
|
alexey-milovidov
|
f4ba5f1f9a
|
Merge pull request #16772 from ClickHouse/fix-stringstream
Fix "server failed to start" error
|
2020-11-08 14:27:08 +03:00 |
|
Alexey Milovidov
|
5314185e25
|
Merge branch 'master' into azat-optimize_skip_unused_shards-optimization
|
2020-11-08 00:17:59 +03:00 |
|
Alexey Milovidov
|
fd84d16387
|
Fix "server failed to start" error
|
2020-11-07 03:14:53 +03:00 |
|
Amos Bird
|
47fcd8bffb
|
Fix some problems introduced by refactoring.
|
2020-10-12 17:58:09 +08:00 |
|
Amos Bird
|
d2dcfc3f0d
|
Refactor processors.
|
2020-10-12 17:30:05 +08:00 |
|
Azat Khuzhin
|
b838214a35
|
Pass non-const SelectQueryInfo (and drop mutable qualifiers)
|
2020-10-02 22:42:35 +03:00 |
|
alesapin
|
17b86dec96
|
Recursive defaults
|
2020-10-02 15:38:50 +03:00 |
|
Vladimir Chebotarev
|
a38c7ff2a8
|
Somehow uncompressed PUT works and gzipped PUT doesn't, in S3 storage.
|
2020-09-30 15:04:42 +03:00 |
|
Vladimir Chebotarev
|
698768add0
|
Fixed format argument in S3 storage when compression method is selected.
|
2020-09-30 13:55:44 +03:00 |
|
alexey-milovidov
|
eeefcd6493
|
Merge pull request #13337 from ClickHouse/refactor-pipes-3
Refactor Pipe
|
2020-08-14 04:12:22 +03:00 |
|
Vladimir Chebotarev
|
7371cf6bd1
|
Proper remote host checking in S3 redirects (#13404)
* Proper remote host checking in S3 redirects.
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
|
2020-08-11 09:09:08 +03:00 |
|
Nikolai Kochetov
|
2cca4d5fcf
|
Refactor Pipe [part 2].
|
2020-08-03 16:54:14 +03:00 |
|
Peng Jian
|
7579d65ebc
|
Registering StorageS3 and TableFunctionS3 under two different names (S3 and COSN).
|
2020-07-13 22:13:30 +08:00 |
|
Peng Jian
|
958bb1f3aa
|
COS (Tencent Cloud Object Storage) integration
To allow import and export to COS.
|
2020-07-10 15:26:55 +08:00 |
|
Vladimir Chebotarev
|
faf6be6576
|
Implemented single part uploads for DiskS3 (#12026)
* Implemented single part uploads for DiskS3.
* Added `min_multi_part_upload_size` to disk configuration.
|
2020-07-09 17:09:17 +03:00 |
|
alesapin
|
c9fa5d2ec3
|
Better naming
|
2020-06-19 18:39:41 +03:00 |
|
alesapin
|
71f99a274d
|
Compileable getSampleBlockWithColumns in StorageInMemoryMetadata
|
2020-06-16 17:25:08 +03:00 |
|
alesapin
|
36ba0192df
|
Metadata in read and write methods of IStorage
|
2020-06-15 22:08:58 +03:00 |
|
alesapin
|
af2fe2ba55
|
Compilable setColumns, setConstraints, setIndices
|
2020-06-15 19:55:33 +03:00 |
|
alexey-milovidov
|
e3c528e661
|
Merge pull request #11174 from excitoon-favorites/s3tests
Added tests for improved S3 URL parsing
|
2020-06-07 02:44:40 +03:00 |
|
Vladimir Chebotarev
|
d62e85f875
|
Improved logging of globs in S3.
|
2020-06-04 16:12:08 +03:00 |
|
Pervakov Grigorii
|
bc9381406f
|
Add default credentials and custom headers for s3 table functions.
|
2020-06-02 20:48:49 +03:00 |
|
alexey-milovidov
|
256f84ddc2
|
Merge pull request #11230 from Jokser/s3-poco-http-client
S3 Poco Http Client
|
2020-06-01 01:20:21 +03:00 |
|
Pavel Kovalenko
|
677cb56a06
|
S3 Poco HTTP Client WIP.
|
2020-05-27 22:41:49 +03:00 |
|
Vladimir Chebotarev
|
7f9a257c31
|
Fixed S3 globbing which could fail in case of more than 1000 keys and some backends.
|
2020-05-25 15:57:32 +03:00 |
|
Vladimir Chebotarev
|
98f31374d5
|
Added improved S3 URL parsing to DiskS3.
|
2020-05-22 11:18:34 +03:00 |
|
Vladimir Chebotarev
|
02cb08ea2f
|
Fixed parsing of S3 URL.
|
2020-05-22 11:17:10 +03:00 |
|
alesapin
|
f981649213
|
Fix pushing to views stream and refactor virtuals
|
2020-04-28 13:38:57 +03:00 |
|
alesapin
|
4badd0fd28
|
Better code
|
2020-04-27 20:46:51 +03:00 |
|
alesapin
|
18c550df15
|
Better virtuals logic
|
2020-04-27 16:55:30 +03:00 |
|
Vitaly Baranov
|
e573549945
|
Rework access rights for table functions.
|
2020-04-07 23:31:59 +03:00 |
|
Ivan Lezhankin
|
06446b4f08
|
dbms/ → src/
|
2020-04-03 18:14:31 +03:00 |
|