Vladimir Chebotarev
0479edd47e
Improved validation of S3 buckets and keys.
2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
21d4d26f20
Final fix ReadBufferFromS3
.
2021-08-23 05:05:49 +00:00
listar
b4a33ce001
1. fix oveflow bug
2021-08-21 19:08:34 +00:00
bharatnc
5de6d19da8
Merge remote-tracking branch 'upstream/master' into ncb/import-export-lz4
2021-08-20 17:19:36 -07:00
kssenii
945e2c4ce5
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-20 18:01:23 +00:00
Nikolay Degterinsky
f2852d1a08
Fix algorithm
2021-08-20 19:40:18 +03:00
Nikolay Degterinsky
ecb985c4b5
Refactor WriteBuffer
2021-08-19 13:34:23 +03:00
Nikolay Degterinsky
24046d6ecc
Refactor ReadBuffer
2021-08-19 13:29:58 +03:00
Nikolay Degterinsky
7a5c5b4208
Fix encoding/decoding
2021-08-19 11:10:56 +03:00
Vitaly Baranov
fabd7193bd
Code cleanups and improvements.
2021-08-18 14:24:52 +03:00
Nikolay Degterinsky
c245af5243
Merge branch 'master' into ncb/import-export-lz4
2021-08-18 10:20:23 +03:00
kssenii
77c350cedc
Catch and reformat error with invalid url
2021-08-16 14:30:06 +00:00
Alexey Milovidov
8adaef7c8e
Make text format for Decimal tuneable
2021-08-16 11:03:23 +03:00
Alexey Milovidov
bdab932f97
Fix some tests
2021-08-16 08:56:42 +03:00
Alexey Milovidov
28027c7323
Fix some tests
2021-08-16 05:00:39 +03:00
Alexey Milovidov
d184b79bba
Progress on async reads.
2021-08-16 03:00:32 +03:00
Alexey Milovidov
020beb885d
Merge branch 'master' into async-reads
2021-08-15 12:08:19 +03:00
Alexey Milovidov
60dccce818
Remove trailing zeros from Decimal serialization #15794
2021-08-15 08:29:31 +03:00
kssenii
daac6323fa
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-14 13:15:04 +00:00
Nikolai Kochetov
5e5a6ff654
Merge branch 'master' into qoega-fix-access-gtest-in-arcadia
2021-08-12 12:02:15 +03:00
Mikhail Filimonov
af6249c8ec
Less include <Common/Stopwatch.h>
2021-08-11 16:20:59 +02:00
Nikolai Kochetov
d03c867ad9
Add Y_IGNORE
2021-08-10 11:44:44 +03:00
kssenii
d767f6704f
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-09 12:14:23 +00:00
Alexey Milovidov
8b9da6fe26
Merge branch 'master' into async-reads
2021-08-09 03:33:32 +03:00
Nikolay Degterinsky
0febbd4a1d
Fix build
2021-08-07 08:42:54 +00:00
Nikolay Degterinsky
9a45458faf
Add bzip2 file compression
2021-08-07 00:25:52 +00:00
kssenii
0f6696922a
Fix asserion !hasPengingData()
2021-08-06 19:43:12 +00:00
kssenii
073d7fdd5e
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-06 19:42:29 +00:00
Vladimir C
9de16c5017
Merge pull request #27216 from ianton-ru/MDB-13990
2021-08-06 18:12:00 +03:00
Anton Popov
3a0d4807a5
Merge branch 'async-insert' of git://github.com/abyss7/ClickHouse into merging-20557
2021-08-06 16:20:02 +03:00
Vladimir C
b280e1418a
Check if error_report is initialized in PocoHTTPClient.cpp
2021-08-06 11:37:07 +03:00
Alexey Milovidov
42cf8f3676
Remove debug output
2021-08-06 00:04:54 +03:00
Alexey Milovidov
3b421acae2
Fix style
2021-08-06 00:03:39 +03:00
Alexey Milovidov
78ed0e7348
Remove experimental file
2021-08-06 00:03:29 +03:00
Alexey Milovidov
e38540972d
Fix Mac OS build
2021-08-06 00:01:13 +03:00
Alexey Milovidov
cea9690327
Merge branch 'master' into async-reads
2021-08-05 23:58:57 +03:00
Anton Ivashkin
0e040ca40c
Add 10 seconds cache for S3 proxy resolver
2021-08-05 18:52:04 +03:00
Nikita Mikhaylov
a61c1bcb63
Merge pull request #27224 from georgthegreat/fix-include
...
ADDINCL proper fast_float directory
2021-08-05 16:58:46 +03:00
Yuriy Chernyshov
3432743b31
ADDINCL proper fast_float directory
2021-08-05 16:53:36 +03:00
Maksim Kita
2ca6b2cfc0
Merge pull request #27155 from kitaisreal/parse-int-unsafe-updated
...
Updated readIntTextUnsafe
2021-08-05 11:37:22 +03:00
Vladimir Chebotarev
c2410920d3
Safer ReadBufferFromS3
for merges and backports.
2021-08-04 09:14:20 +03:00
Alexey Milovidov
91173b8934
Improve performance
2021-08-04 03:07:04 +03:00
Alexey Milovidov
425bf5d301
Better check for supported feature
2021-08-03 23:19:41 +03:00
alexey-milovidov
dfa597f11d
Update ReadHelpers.h
2021-08-03 22:31:13 +03:00
Maksim Kita
edeeb801c0
Updated readIntTextUnsafe
2021-08-03 21:46:25 +03:00
Alexey Milovidov
462c89e6f8
Experiment with checking if data is in page cache
2021-08-01 10:44:23 +03:00
Alexey Milovidov
7861ca6ed6
Experiments
2021-07-29 01:30:12 +03:00
Alexey Milovidov
37c4ac6cdd
Fix build
2021-07-28 12:16:08 +03:00
Alexey Milovidov
2ed9c12ba6
Fix build
2021-07-28 11:41:25 +03:00
Alexey Milovidov
d52a0cfcec
Fix build
2021-07-28 11:12:11 +03:00
Alexey Milovidov
ae853b837b
Fix build
2021-07-28 10:05:22 +03:00
Alexey Milovidov
00e20c7e3c
Remove useless code
2021-07-28 09:08:29 +03:00
Alexey Milovidov
e841996486
Fix style
2021-07-28 08:28:30 +03:00
Alexey Milovidov
1974ed9d5c
Fix build
2021-07-28 02:59:56 +03:00
Alexey Milovidov
10752dd1cf
Fix build
2021-07-28 02:57:05 +03:00
Alexey Milovidov
46723a2c3c
Fix error
2021-07-28 02:47:28 +03:00
Alexey Milovidov
fd5c1561e2
Merge branch 'master' into async-reads
2021-07-27 23:58:32 +03:00
Nikolai Kochetov
61d8f880cd
Rename some files.
2021-07-26 19:48:25 +03:00
Vitaly Baranov
4862e9f80d
Merge pull request #26733 from vitlibar/support-multiple-keys
...
Support multiple keys for encrypted disk
2021-07-26 10:19:50 +03:00
Alexey Milovidov
663dc91c99
Minor change
2021-07-26 04:51:12 +03:00
Alexey Milovidov
5c3f5cb35a
Experiment with asynchronous readers
2021-07-26 03:34:36 +03:00
Vitaly Baranov
51f882d8cc
Support multiple keys for encrypted disk. Display error message if the key is probably wrong.
2021-07-24 23:45:12 +03:00
bharatnc
2b795ae193
LZ4 - fix write compress
2021-07-24 11:29:35 -05:00
alexey-milovidov
70ca77b342
Merge pull request #26768 from ClickHouse/opened-file-cache
...
Experiment with sharing file descriptors
2021-07-24 13:08:03 +03:00
Alexey Milovidov
0a4e26e682
Experiment with sharing file descriptors
2021-07-24 01:50:14 +03:00
Vladimir Chebotarev
eb2defb098
Fixed wrong error message in S3Common
.
2021-07-23 15:36:19 +03:00
Nikita Mikhaylov
4d3f828beb
Merge pull request #26314 from kssenii/fix-hdfs-crash
...
Fix hdfs crash
2021-07-20 15:01:56 +03:00
Vitaly Baranov
1fc822b19d
Merge pull request #26465 from vitlibar/explicit-encryption-mode
...
Set encryption algorithm explicitly.
2021-07-19 09:38:02 +03:00
Kseniia Sumarokova
b0ddc4fb30
Merge pull request #26364 from kssenii/fixing-date32
...
Continuation of #25774
2021-07-18 21:44:45 +03:00
Vitaly Baranov
81ea8521b1
Set encryption algorithm explicitly.
2021-07-18 10:29:42 +03:00
kssenii
9cb10aae3c
Some fixes
2021-07-18 03:43:08 +00:00
alexey-milovidov
18f1197d9d
Update Progress.h
2021-07-17 23:15:16 +03:00
Alexey Milovidov
261a220227
Remove some code
2021-07-17 21:06:46 +03:00
Kseniia Sumarokova
e844cec16f
Merge branch 'master' into fix-hdfs-crash
2021-07-16 22:21:30 +03:00
Vitaly Baranov
958494b98e
Merge pull request #26377 from vitlibar/encrypted-disk-comments-and-improvements
...
Add comments for encrypted disks; some improvements in code.
2021-07-16 21:24:51 +03:00
Vitaly Baranov
9cc258327e
Add comments for encrypted disks; some improvements in code.
2021-07-16 12:04:25 +03:00
Kseniia Sumarokova
3303fe2fd3
Update ZstdInflatingReadBuffer.cpp
2021-07-15 17:58:58 +03:00
kssenii
3ba2d114d5
Revert "Merge pull request #26352 from ClickHouse/revert-25774-datatype-date32"
...
This reverts commit 94a210650f
, reversing
changes made to 0893b9ff8e
.
2021-07-15 11:41:52 +00:00
alexey-milovidov
9ba4064c86
Revert "Datatype Date32, support range 1925 to 2283"
2021-07-15 10:53:35 +03:00
Evgeniy Gatov
5a884da13c
METR-41529
2021-07-15 00:57:18 +03:00
kssenii
f9a2c39701
More approprate fix
2021-07-14 20:15:05 +03:00
kssenii
1993d8e0f4
Fix hdfs crash
2021-07-14 15:13:18 +03:00
Ivan Lezhankin
ab26aed6f9
Merge remote-tracking branch 'upstream/master' into async-insert
2021-07-13 13:54:09 +03:00
Vitaly Baranov
bc5080d701
Rename ReadEncryptedBuffer -> ReadBufferFromEncryptedFile,
...
WriteEncryptedBuffer -> WriteBufferFromEncryptedFile,
move file FileEncryption.h to the IO folder,
rename functions accroding to our code style,
add cpp files.
2021-07-13 11:31:03 +03:00
Vitaly Baranov
e2424db810
Fix ReadBufferFromS3
2021-07-13 11:30:29 +03:00
Vitaly Baranov
0f9ace257f
Fix conversion to/from big endian.
2021-07-13 11:30:08 +03:00
Vitaly Baranov
81f3876506
Fix finalize() and sync() in WriteEncryptedBuffer.
2021-07-13 11:30:00 +03:00
Vitaly Baranov
e086e5e384
Merge branch 'master' into alexelex-encryption-1
2021-07-13 11:28:41 +03:00
Vitaly Baranov
f4507dba7b
Fix typo
2021-07-13 00:07:33 +03:00
Kseniia Sumarokova
4a6b4d6c26
Merge pull request #25774 from liuneng1994/datatype-date32
...
Datatype Date32, support range 1925 to 2283
2021-07-12 20:33:39 +03:00
mergify[bot]
b7ae4e4ced
Merge branch 'master' into async-insert
2021-07-12 09:21:37 +00:00
Alexey Milovidov
822cc0fec3
Lowered amount of syscalls in AsynchronousMetrics
2021-07-12 04:12:34 +03:00
Alexey Milovidov
e0effad4d1
Fix tiny issue
2021-07-12 03:33:13 +03:00
Alexey Milovidov
7e932c2504
Fix Arcadia
2021-07-11 22:07:46 +03:00
Alexey Milovidov
d3cdae1211
Fix build
2021-07-11 22:07:17 +03:00
neng.liu
4669839fbb
add comment and update ya.make
2021-07-11 04:55:42 -07:00
Alexey Milovidov
2d02a3a45d
Fix errors
2021-07-11 05:43:54 +03:00
Alexey Milovidov
29624436ff
Return back O_DIRECT
2021-07-11 03:35:43 +03:00
Alexey Milovidov
30826c7d7d
Return O_DIRECT
2021-07-11 03:33:14 +03:00
Alexey Milovidov
81646f8389
Merge branch 'master' into ditch-aio
2021-07-11 03:06:45 +03:00
alexey-milovidov
9c2aad6c17
Merge pull request #25962 from ClickHouse/network-instrumentation
...
More instrumentation for network interaction: add counters for recv/send bytes; add gauges for recvs/sends.
2021-07-08 17:20:16 +03:00
neng.liu
e47aadfdef
Merge branch 'datatype-date32' of https://github.com/liuneng1994/ClickHouse into datatype-date32
2021-07-08 00:09:48 -07:00
neng.liu
100d30a5ba
fix pr comment
2021-07-08 00:06:36 -07:00
bharatnc
e6f627bbc6
LZ4 - decompress read initial implementation
2021-07-06 16:56:33 -07:00
Alexey Milovidov
2e41419e3b
Fix build
2021-07-06 03:34:27 +03:00
Alexey Milovidov
9875adc00b
Make it even worse
2021-07-06 01:09:39 +03:00
Alexey Milovidov
6d3d724cd4
Fix error
2021-07-05 23:20:25 +03:00
Alexey Milovidov
8fae774e85
Fix error
2021-07-05 23:18:13 +03:00
Alexey Milovidov
f29eb11e6c
Fix error
2021-07-05 23:17:53 +03:00
Alexey Milovidov
21fb6ddea5
Remove AIO for sequential reads
2021-07-05 23:02:24 +03:00
bharatnc
c79f885e41
LZ4 - compress write initial implementation
2021-07-04 23:19:27 -07:00
bharatnc
7620c28c14
LZ4 - fix cmake to include lz4
2021-07-04 23:19:27 -07:00
bharatnc
afad00b7d4
LZ4 - initial commit
2021-07-04 23:19:27 -07:00
NengLiu
8b88988618
Merge branch 'master' into datatype-date32
...
# Conflicts:
# src/DataStreams/PostgreSQLBlockInputStream.cpp
2021-07-05 10:18:38 +08:00
NengLiu
dc0c65ef4f
Merge remote-tracking branch 'origin/master' into datatype-date32
2021-07-05 10:15:08 +08:00
Alexey Milovidov
935e0327a5
Development
2021-07-04 06:03:49 +03:00
Alexey Milovidov
c762e2247d
More instrumentation for network interaction: add counters for recv/send bytes; add gauges for recvs/sends.
2021-07-04 00:00:50 +03:00
Maksim Kita
f16e8c3a4b
Merge pull request #25909 from ClickHouse/invalid-date
...
Correctly throw exception on attempt to parse invalid Date
2021-07-02 20:54:50 +03:00
Alexey Milovidov
b33d91412d
Correctly throw exception on invalid dates
2021-07-02 03:07:23 +03:00
Ivan Lezhankin
d7126682b0
Fix shared build
2021-06-29 15:05:46 +03:00
Ivan Lezhankin
1bb41593d1
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-28 22:55:56 +03:00
neng.liu
ec7604b013
add parquet test and fix add interval error when type is date32
2021-06-28 16:36:54 +08:00
Alexey Milovidov
b11f9223de
Merge branch 'master' into fix-receive-time-metric
2021-06-27 19:00:39 +03:00
Ivan
14e43cfafa
Add CI check for darwin-aarch64 ( #25560 )
...
* Add support for darwin-aarch64
* Fix PVS warnings
* Add build configuration
* Fix packager args
2021-06-25 18:21:56 +03:00
tavplubix
b1263c18ee
Fix pcg deserialization ( #24538 )
...
* fix pcg deserialization
* Update 01156_pcg_deserialization.sh
* Update 01156_pcg_deserialization.sh
* Update 01156_pcg_deserialization.sh
* fix another bug
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2021-06-24 10:40:00 +03:00
Alexey Milovidov
99e08b7406
Make network receive time metric to correctly include the time spent waiting for data from the client to INSERT #9958
2021-06-22 23:22:13 +03:00
Neng Liu
7ed1728a37
Merge branch 'master' into datatype-date32
...
# Conflicts:
# src/DataTypes/IDataType.h
# src/Functions/CustomWeekTransforms.h
2021-06-22 10:00:18 +08:00
kssenii
babb11a887
Some fixes
2021-06-19 19:18:13 +00:00
kssenii
7f356a5fbc
Fix readbuffer
2021-06-18 17:06:17 +00:00
Kseniia Sumarokova
5974f96f0c
Merge pull request #23656 from kssenii/progress-bar
...
Progress indication for File table engine in clickhouse-local and insert from file in clickhouse-client
2021-06-18 17:46:54 +03:00
kssenii
f33387837e
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-06-18 14:27:48 +00:00
Vladimir
4de0d1a593
Merge pull request #24885 from Jokser/disk-s3-read-error-fix
2021-06-18 13:38:59 +03:00
kssenii
bdc8fe1ca0
Merge branch 'master' of github.com:ClickHouse/ClickHouse into progress-bar
2021-06-18 09:33:29 +03:00
Latysheva Alexandra
48d3419160
Merge branch 'master' into alexelex-encryption-1
2021-06-18 11:28:08 +06:00
Alexey Milovidov
3e71181451
Whitespaces
2021-06-18 01:42:33 +03:00
Pavel Kovalenko
ce8e2f7f28
Avoid double initializing ReadBufferFromS3
2021-06-17 22:31:50 +03:00
Ivan Lezhankin
37365589ed
Merge branch 'master' into async-insert
2021-06-17 16:57:45 +03:00
Maksim Kita
ac2f9dd15a
Updated function dateName before merge
2021-06-16 21:19:05 +03:00
kssenii
cd885ee750
Fix build, ya make
2021-06-14 11:52:20 +00:00
kssenii
a1f11f5178
Fixes
2021-06-14 09:37:33 +00:00
kssenii
11faddb39f
Better
2021-06-13 22:30:37 +00:00
kssenii
2cfcc9980c
Better
2021-06-13 19:38:31 +00:00
kssenii
c80eac0dc3
First version
2021-06-13 19:36:56 +00:00
Pavel Kovalenko
47252e07f3
Remove trailing whitespaces
2021-06-12 15:57:14 +03:00
Pavel Kovalenko
0c82d45dea
Missed initialize in ReadBufferFromS3
2021-06-12 14:35:34 +03:00
mergify[bot]
9cfedd9c64
Merge branch 'master' into progress-bar
2021-06-12 01:15:23 +00:00
alexey-milovidov
05d1af153c
Merge branch 'master' into rename-const-context-ptr
2021-06-12 03:25:09 +03:00
alexey-milovidov
99f108d704
Merge pull request #25162 from kitaisreal/rewrite-function-to-subcolumn-visitor-add-into-ya-make
...
RewriteFunctionToSubcolumnVisitor add into ya.make
2021-06-12 02:58:53 +03:00
alexey-milovidov
971c79611b
Merge branch 'master' into patch-5
2021-06-12 02:36:13 +03:00
Ivan Lezhankin
2c7cb41a69
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-11 20:04:26 +03:00
mergify[bot]
60c094e785
Merge branch 'master' into disk-s3-read-error-fix
2021-06-11 15:00:43 +00:00
Maksim Kita
30c78c0a23
Fix arcadia
2021-06-11 14:26:33 +03:00
Vladimir
ba198c48ea
Merge pull request #24898 from excitoon/patch-8
2021-06-10 18:34:17 +03:00
Yuriy Chernyshov
c0cb5387f4
Use zstd/include in ya.make
2021-06-09 23:02:39 +03:00
mergify[bot]
3a47feedb0
Merge branch 'master' into progress-bar
2021-06-09 08:04:48 +00:00
mergify[bot]
bfbc787b08
Merge branch 'master' into disk-s3-read-error-fix
2021-06-09 06:56:19 +00:00
Neng Liu
88a0d0be62
add datetype32 part2
2021-06-08 20:31:41 +08:00
Ivan Lezhankin
973cea73b7
Merge branch 'master' into async-insert
2021-06-08 15:10:30 +03:00
Vladimir
fb987cf2c7
Fix space in ReadBufferFromFileDecorator.cpp
2021-06-08 15:00:28 +03:00
Latysheva Alexandra
1a2cbe9275
Merge branch 'master' into alexelex-encryption-1
2021-06-07 21:18:54 +06:00
neng.liu
120da1fd73
date32 initial code
2021-06-07 06:41:58 -07:00
Pavel Kovalenko
6ba40c475a
Code cleanup + comments.
2021-06-07 13:49:34 +03:00
Vladimir Chebotarev
ad816fde7b
Fix.
2021-06-07 09:56:15 +03:00
Vladimir Chebotarev
e21f76b137
Fixed unit tests accoording to the fix.
2021-06-07 09:54:05 +03:00
Vladimir Chebotarev
8c33e53e80
Review fixes.
2021-06-07 09:41:49 +03:00
mergify[bot]
d68d5e0ef1
Merge branch 'master' into rename-const-context-ptr
2021-06-04 14:41:41 +00:00
Nikita Mikhaylov
8076848d62
Update ReadBufferFromS3.cpp
2021-06-04 02:46:21 +03:00
mergify[bot]
9e2c454db2
Merge branch 'master' into merging-s3-backoff
2021-06-03 18:58:24 +00:00
Vladimir Chebotarev
1012a768b1
Allowed S3 key to be empty.
2021-06-03 09:09:09 +03:00
Vladimir Chebotarev
89664a3452
Fixed problems with double spaces in logs for S3Common
.
2021-06-03 09:05:24 +03:00
alesapin
4a1bf51ad1
Merge branch 'master' into limited_fetches
2021-06-02 23:01:47 +03:00
Ivan Lezhankin
791cbcf0b1
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-02 18:50:37 +03:00
Ivan Lezhankin
84c23dc060
Merge branch 'master' into async-insert
2021-06-02 18:06:21 +03:00
Pavel Kovalenko
2bd12a7612
Fix DiskS3 read error due to broken getPosition() method in ReadBufferFromS3.cpp
2021-06-02 18:03:25 +03:00
Nikita Mikhaylov
3f18bde246
Merge branch 'master' of github.com:ClickHouse/ClickHouse into merging-s3-backoff
2021-06-01 13:39:09 +00:00
Nikolai Kochetov
dbaa6ffc62
Rename ContextConstPtr to ContextPtr.
2021-06-01 15:20:52 +03:00
alesapin
c3321bef30
Merge branch 'master' into limited_fetches
2021-06-01 13:09:02 +03:00
kssenii
de277f8ac4
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar
2021-06-01 07:58:19 +00:00
tavplubix
e9ff0b6d70
Merge pull request #23657 from kssenii/poco-file-to-std-fs
...
Poco::File to std::filesystem
2021-05-31 23:17:02 +03:00
mergify[bot]
08eca33d81
Merge branch 'master' into progress-bar
2021-05-31 19:54:20 +00:00
Nikita Mikhaylov
0d8ede15a9
Merge branch 'master' into merging-s3-backoff
2021-05-31 21:07:00 +03:00
kssenii
db9f4762eb
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-29 01:15:43 +03:00
Alexander Kuzmenkov
92660aaf35
Merge remote-tracking branch 'origin/master' into HEAD
2021-05-28 19:45:53 +03:00
Alexander Kuzmenkov
3f57fc085b
remove mutable context references from functions interface
...
Also remove it from some visitors.
2021-05-28 19:45:37 +03:00
Kruglov Pavel
e584b028e7
Merge pull request #24475 from amosbird/readint
...
Pedantic readInt
2021-05-28 15:44:23 +03:00
Nikita Mikhaylov
c127c433c2
better
2021-05-27 23:43:00 +03:00
Amos Bird
6f12781bf1
Safer readInt
2021-05-27 22:56:51 +08:00
alesapin
2985def91d
Add tests
2021-05-27 15:54:47 +03:00
alesapin
42b2383e01
Basic throttler implementation
2021-05-26 23:37:44 +03:00
kssenii
3dee003f9b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-20 19:20:09 +03:00
Alexandra
11e40ad000
style fixes
2021-05-19 22:06:25 +00:00
mergify[bot]
e762039db7
Merge branch 'master' into merging-s3-backoff
2021-05-19 21:57:10 +00:00
Nikita Mikhaylov
f33b70c54a
better
2021-05-20 00:42:25 +03:00
Alexandra
f71e97511b
set use_ssl flag
2021-05-18 20:48:16 +00:00
Alexandra
b7a0f2db57
refactoring
2021-05-18 20:20:51 +00:00
Alexandra
af420569f8
remove debug information, fix seek issue and encryption issue
2021-05-17 16:15:21 +00:00
kssenii
9b8df78fdd
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-17 17:42:05 +03:00
Raúl Marín
439f161764
Fix GCC 11 build
...
../src/IO/HashingWriteBuffer.h:20:34: error: expected ‘)’ before ‘block_size_’
20 | IHashingBuffer<Buffer>(size_t block_size_ = DBMS_DEFAULT_HASHING_BLOCK_SIZE)
2021-05-17 14:04:08 +02:00
Vladimir Chebotarev
fa7308d2cb
Minor fix.
2021-05-17 10:38:34 +03:00
Vladimir Chebotarev
bdf03387ab
Better S3 read retries. Renamed s3_max_single_read_retries
-> s3_single_read_retry_attempts
, added sleeps before next attempts.
2021-05-17 10:38:32 +03:00
Alexandra
10a5b734ee
encryption initialization (without any flags like use_ssl for now)
2021-05-16 22:35:20 +00:00
kssenii
e9c3bc1836
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar
2021-05-16 20:48:35 +00:00
Raúl Marín
e358a0963c
Clearer code based on review
2021-05-15 03:03:38 +02:00
Raúl Marín
0ddfc3df84
TestReadAfterAIO: Use the local path instead of /tmp for temporal files
...
/tmp might be mounted as tmpfs (default in ArchLinux) which is incompatible with
O_DIRECT (https://lore.kernel.org/lkml/459D290B.1040703@tmr.com/t/ ), making the
test fail:
```
[ RUN ] ReadBufferAIOTest.TestReadAfterAIO
unknown file: Failure
C++ exception with description "Cannot open file /tmp/filei6ZsCa/foo, errno: 22, strerror: Invalid argument" thrown in the test body.
[ FAILED ] ReadBufferAIOTest.TestReadAfterAIO (0 ms)
```
Instead create the tmp folder in the local path and delete it at the end
2021-05-15 02:13:51 +02:00
Alexandra
67f9b86515
implement read and write buffers (with debug=warning logs)
2021-05-14 21:54:03 +00:00
kssenii
c25be65ebf
Refactor progress bar, adjust progress indication for reading from file
2021-05-14 06:16:31 +00:00
kssenii
f33a517d33
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-14 02:58:26 +03:00
kssenii
e82d717233
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar
2021-05-13 10:20:02 +00:00
Vladimir Chebotarev
a3f7992442
Fixed typo.
2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
b738e25f5b
Better handling of HTTP errors in PocoHTTPClient
.
2021-05-13 08:46:16 +03:00
kssenii
393b026f2e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-11 16:49:23 +03:00
Alexey Milovidov
b2ca5cd98b
Merge branch 'master' into normalize-bigint
2021-05-11 02:05:40 +03:00
Alexey Milovidov
b9b3e4b60a
Fix style and wording in #23946
2021-05-10 23:32:30 +03:00
Maksim Kita
4a22924ed5
Merge pull request #23946 from FArthur-cmd/8912-fix-dict-http-source
...
Add support for HTTP compression in dictionary source.
2021-05-10 22:52:07 +03:00
Alexey Milovidov
94592f0d54
Whitespaces
2021-05-10 21:16:06 +03:00
alexey-milovidov
0400070924
Merge pull request #23822 from excitoon-favorites/equalsignins3path
...
Better handling of URI's in `PocoHTTPClient`
2021-05-10 20:25:18 +03:00
alexey-milovidov
5397b1d0c3
Update PocoHTTPClient.cpp
2021-05-10 20:22:09 +03:00
alexey-milovidov
5685738d08
Update PocoHTTPClient.cpp
2021-05-10 20:20:05 +03:00
Vladimir
d02d14fa00
Merge pull request #23846 from excitoon-favorites/s3regions
2021-05-10 12:14:08 +03:00
FArthur-cmd
6363a5dd96
use path to define compression type
2021-05-09 21:58:08 +03:00
FArthur-cmd
bd519075b7
adding checking url in HTTPSource
2021-05-09 14:27:11 +03:00
Alexey Milovidov
3025f9e141
More fixes for PVS-Studio
2021-05-08 19:12:49 +03:00
Alexey Milovidov
bdc372cb9a
Fix bad code (found by PVS-Studio)
2021-05-08 19:11:40 +03:00
Alexey Milovidov
45dea86395
More fixes for PVS-Studio
2021-05-08 18:35:09 +03:00
Alexey Milovidov
aa727e941d
Fix bad code (found by PVS-Studio)
2021-05-08 17:21:36 +03:00
Alexey Milovidov
e9c7aa5ab5
Remove some code
2021-05-08 17:12:26 +03:00
FArthur-cmd
acb09f01d4
fixing details in code style and moving tests
2021-05-08 12:46:50 +03:00
FArthur-cmd
13a6e03849
solving style-check problems
2021-05-08 10:15:14 +03:00
FArthur-cmd
4ea9851e99
fixing dictionary http source by adding wrapper
2021-05-08 02:20:30 +03:00
Alexey Milovidov
18ba924c80
Fix style
2021-05-08 01:11:09 +03:00
Alexey Milovidov
7dfb7664f7
Messing with the code (removed trash)
2021-05-07 21:16:27 +03:00
Alexey Milovidov
160aaec112
Fix error
2021-05-07 04:19:18 +03:00
Vladimir Chebotarev
524113f497
Fixed bug with S3 URLs containing +
symbol, data with such keys could not be read previously.
2021-05-06 11:28:55 +03:00
Alexey Milovidov
fd4f214e43
Fix error
2021-05-05 23:04:15 +03:00
kssenii
2dabdd0f73
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-05 18:42:40 +03:00
Alexey Milovidov
35aba776e5
Merge branch 'master' into normalize-bigint
2021-05-05 15:01:23 +03:00
kssenii
5ef3ee50fe
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar
2021-05-05 09:26:12 +00:00
Alexey Milovidov
bf463ff0d9
Remove trash
2021-05-04 23:05:51 +03:00
Alexey Milovidov
59ab0db672
Fix build
2021-05-04 20:30:32 +03:00
Alexey Milovidov
962a7113f6
Remove code that I do not like (crazy templates)
2021-05-04 20:26:09 +03:00
Alexey Milovidov
ebe0d849b5
Fix error in serialization of UInt256
2021-05-04 18:18:51 +03:00
vdimir
657eda9288
Add Read/WriteBufferFromFileDecorator.cpp to ya.make
2021-05-04 16:07:56 +03:00
Alexey Milovidov
02ce9cc725
Untangle UUID
2021-05-04 01:46:51 +03:00
Alexey Milovidov
b0bd9fd3b0
Add UInt128 where it is needed
2021-05-03 19:12:28 +03:00
Alexey Milovidov
39bcf9d860
Fix style
2021-05-03 01:44:34 +03:00
Alexey Milovidov
fc8db048e1
Merge with master
2021-05-02 21:26:46 +03:00
Alexey Milovidov
1fda866881
Merge branch 'master' into normalize-bigint
2021-05-02 21:24:45 +03:00
Vladimir Chebotarev
a6ab040b07
Added region
parameter for S3 storage and disk.
2021-05-01 20:45:35 +03:00
kssenii
32b2917141
Update s3/*
2021-05-01 18:10:04 +03:00
Vladimir
3b7c68196b
Merge pull request #23429 from Jokser/disk-s3-restart-possibility
2021-05-01 15:28:14 +03:00