Commit Graph

1123 Commits

Author SHA1 Message Date
Alexey Milovidov
46732e781f Merge branch 'master' of github.com:yandex/ClickHouse into async-reads 2021-08-27 01:57:48 +03:00
Alexey Milovidov
8fd643e22a Fix build 2021-08-27 01:57:34 +03:00
Filatenkov Artur
eeeef3cc18
Update ZlibInflatingReadBuffer.cpp 2021-08-26 15:43:01 +03:00
Filatenkov Artur
a1240fd575
Update ZlibInflatingReadBuffer.cpp 2021-08-26 15:42:10 +03:00
Filatenkov Artur
1d97ae3f6a
Update ZlibInflatingReadBuffer.cpp 2021-08-26 12:15:10 +03:00
Filatenkov Artur
a7d982198c
Update src/IO/ZlibInflatingReadBuffer.cpp
Co-authored-by: Ilya Yatsishin <2159081+qoega@users.noreply.github.com>
2021-08-26 11:33:24 +03:00
Filatenkov Artur
f8eb02cb64
Update src/IO/ZlibInflatingReadBuffer.cpp
Co-authored-by: Ilya Yatsishin <2159081+qoega@users.noreply.github.com>
2021-08-26 11:33:10 +03:00
Anton Popov
6d3274c22c Merge remote-tracking branch 'upstream/master' into HEAD 2021-08-26 03:31:46 +03:00
mergify[bot]
69d2a6080b
Merge branch 'master' into fix_compression_26149 2021-08-25 19:01:08 +00:00
Artur
13c2de5fa8 add comments 2021-08-25 18:23:17 +00:00
Artur
239b198a12 fix eof 2021-08-25 16:56:19 +00:00
Mike Kot
407af64280 Merge remote-tracking branch 'upstream/master' into improvement/merge-tree-part-opt-parse 2021-08-25 18:24:43 +02:00
Nikolay Degterinsky
99a26b3a9a Small fix 2021-08-25 15:35:53 +03:00
Nikolay Degterinsky
f722132f23 Merge branch 'master' into ncb/import-export-lz4 2021-08-25 14:59:17 +03:00
Alexey Milovidov
c03dc92dd1 Fix excessive logging in ReadBufferFromS3 2021-08-25 03:28:15 +03:00
Alexey Milovidov
5243315227 Improve performance in case without prefetch by avoiding swapping of memory buffers 2021-08-25 03:13:05 +03:00
Alexey Milovidov
384b4304c0 Minor change 2021-08-25 02:56:14 +03:00
Alexey Milovidov
f7ca674b0c Progress on development 2021-08-25 01:07:06 +03:00
Alexey Milovidov
8f57216180 Progress on development 2021-08-25 00:45:58 +03:00
Alexey Milovidov
4d9ad3725d Merge branch 'master' into async-reads 2021-08-25 00:45:40 +03:00
Alexey Milovidov
a3ecc2b705 Remove unused include 2021-08-24 23:47:13 +03:00
Mike Kot
f85e2e027c Optional semantics for [Detached]MergeTreePartInfo 2021-08-24 19:43:09 +02:00
alexey-milovidov
739caf86d5
Merge pull request #27484 from excitoon/patch-10
Don't silently ignore errors and don't count delays in `ReadBufferFromS3`
2021-08-24 15:26:39 +03:00
Nikolay Degterinsky
d60f128a9a Merge branch 'master' into ncb/import-export-lz4 2021-08-24 11:47:10 +03:00
kssenii
b536653851 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-24 07:29:50 +00:00
Vladimir C
98acccbdcc
Merge branch 'master' into s3partitionedwrite 2021-08-24 10:03:57 +03:00
kssenii
5307d31924 Throw for alter and silence for drop 2021-08-23 23:48:53 +00:00
Vitaly Baranov
4c9d9aadd4 Add owning ConcatReadBuffer. 2021-08-23 23:41:45 +03:00
listar
a1b13b08b1 1. fix format 2021-08-23 08:28:52 +00:00
vdimir
6fe63a80bc Fix validateKey/Bucket for S3 2021-08-23 09:22:15 +03:00
vdimir
295c8d5686 Remove unused Error Code from IO/S3Common.cpp 2021-08-23 09:22:15 +03:00
vdimir
6ba6577978 Do not allow slashes in bucket formatted from PARTITION BY 2021-08-23 09:22:15 +03:00
vdimir
c4c42b61c4 Validate uft8 in partition key from PARTITION BY for s3 2021-08-23 09:22:15 +03:00
Vladimir Chebotarev
925c496b6c Rolled back changes in Functions. 2021-08-23 09:22:15 +03:00
Vladimir Chebotarev
3c2e090b6b Build and style fix. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
a2bbf98253 Update. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
0479edd47e Improved validation of S3 buckets and keys. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
21d4d26f20 Final fix ReadBufferFromS3. 2021-08-23 05:05:49 +00:00
listar
b4a33ce001 1. fix oveflow bug 2021-08-21 19:08:34 +00:00
bharatnc
5de6d19da8 Merge remote-tracking branch 'upstream/master' into ncb/import-export-lz4 2021-08-20 17:19:36 -07:00
kssenii
945e2c4ce5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-20 18:01:23 +00:00
Nikolay Degterinsky
f2852d1a08 Fix algorithm 2021-08-20 19:40:18 +03:00
Nikolay Degterinsky
ecb985c4b5 Refactor WriteBuffer 2021-08-19 13:34:23 +03:00
Nikolay Degterinsky
24046d6ecc Refactor ReadBuffer 2021-08-19 13:29:58 +03:00
Nikolay Degterinsky
7a5c5b4208 Fix encoding/decoding 2021-08-19 11:10:56 +03:00
Vitaly Baranov
fabd7193bd Code cleanups and improvements. 2021-08-18 14:24:52 +03:00
Nikolay Degterinsky
c245af5243 Merge branch 'master' into ncb/import-export-lz4 2021-08-18 10:20:23 +03:00
kssenii
77c350cedc Catch and reformat error with invalid url 2021-08-16 14:30:06 +00:00
Alexey Milovidov
8adaef7c8e Make text format for Decimal tuneable 2021-08-16 11:03:23 +03:00
Alexey Milovidov
bdab932f97 Fix some tests 2021-08-16 08:56:42 +03:00
Alexey Milovidov
28027c7323 Fix some tests 2021-08-16 05:00:39 +03:00
Alexey Milovidov
d184b79bba Progress on async reads. 2021-08-16 03:00:32 +03:00
Alexey Milovidov
020beb885d Merge branch 'master' into async-reads 2021-08-15 12:08:19 +03:00
Alexey Milovidov
60dccce818 Remove trailing zeros from Decimal serialization #15794 2021-08-15 08:29:31 +03:00
kssenii
daac6323fa Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-14 13:15:04 +00:00
Nikolai Kochetov
5e5a6ff654 Merge branch 'master' into qoega-fix-access-gtest-in-arcadia 2021-08-12 12:02:15 +03:00
Mikhail Filimonov
af6249c8ec
Less include <Common/Stopwatch.h> 2021-08-11 16:20:59 +02:00
Nikolai Kochetov
d03c867ad9 Add Y_IGNORE 2021-08-10 11:44:44 +03:00
kssenii
d767f6704f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-09 12:14:23 +00:00
Alexey Milovidov
8b9da6fe26 Merge branch 'master' into async-reads 2021-08-09 03:33:32 +03:00
Nikolay Degterinsky
0febbd4a1d Fix build 2021-08-07 08:42:54 +00:00
Nikolay Degterinsky
9a45458faf Add bzip2 file compression 2021-08-07 00:25:52 +00:00
kssenii
0f6696922a Fix asserion !hasPengingData() 2021-08-06 19:43:12 +00:00
kssenii
073d7fdd5e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-06 19:42:29 +00:00
Vladimir C
9de16c5017
Merge pull request #27216 from ianton-ru/MDB-13990 2021-08-06 18:12:00 +03:00
Anton Popov
3a0d4807a5 Merge branch 'async-insert' of git://github.com/abyss7/ClickHouse into merging-20557 2021-08-06 16:20:02 +03:00
Vladimir C
b280e1418a
Check if error_report is initialized in PocoHTTPClient.cpp 2021-08-06 11:37:07 +03:00
Alexey Milovidov
42cf8f3676 Remove debug output 2021-08-06 00:04:54 +03:00
Alexey Milovidov
3b421acae2 Fix style 2021-08-06 00:03:39 +03:00
Alexey Milovidov
78ed0e7348 Remove experimental file 2021-08-06 00:03:29 +03:00
Alexey Milovidov
e38540972d Fix Mac OS build 2021-08-06 00:01:13 +03:00
Alexey Milovidov
cea9690327 Merge branch 'master' into async-reads 2021-08-05 23:58:57 +03:00
Anton Ivashkin
0e040ca40c Add 10 seconds cache for S3 proxy resolver 2021-08-05 18:52:04 +03:00
Nikita Mikhaylov
a61c1bcb63
Merge pull request #27224 from georgthegreat/fix-include
ADDINCL proper fast_float directory
2021-08-05 16:58:46 +03:00
Yuriy Chernyshov
3432743b31 ADDINCL proper fast_float directory 2021-08-05 16:53:36 +03:00
Maksim Kita
2ca6b2cfc0
Merge pull request #27155 from kitaisreal/parse-int-unsafe-updated
Updated readIntTextUnsafe
2021-08-05 11:37:22 +03:00
Vladimir Chebotarev
c2410920d3 Safer ReadBufferFromS3 for merges and backports. 2021-08-04 09:14:20 +03:00
Alexey Milovidov
91173b8934 Improve performance 2021-08-04 03:07:04 +03:00
Alexey Milovidov
425bf5d301 Better check for supported feature 2021-08-03 23:19:41 +03:00
alexey-milovidov
dfa597f11d
Update ReadHelpers.h 2021-08-03 22:31:13 +03:00
Maksim Kita
edeeb801c0 Updated readIntTextUnsafe 2021-08-03 21:46:25 +03:00
Alexey Milovidov
462c89e6f8 Experiment with checking if data is in page cache 2021-08-01 10:44:23 +03:00
Alexey Milovidov
7861ca6ed6 Experiments 2021-07-29 01:30:12 +03:00
Alexey Milovidov
37c4ac6cdd Fix build 2021-07-28 12:16:08 +03:00
Alexey Milovidov
2ed9c12ba6 Fix build 2021-07-28 11:41:25 +03:00
Alexey Milovidov
d52a0cfcec Fix build 2021-07-28 11:12:11 +03:00
Alexey Milovidov
ae853b837b Fix build 2021-07-28 10:05:22 +03:00
Alexey Milovidov
00e20c7e3c Remove useless code 2021-07-28 09:08:29 +03:00
Alexey Milovidov
e841996486 Fix style 2021-07-28 08:28:30 +03:00
Alexey Milovidov
1974ed9d5c Fix build 2021-07-28 02:59:56 +03:00
Alexey Milovidov
10752dd1cf Fix build 2021-07-28 02:57:05 +03:00
Alexey Milovidov
46723a2c3c Fix error 2021-07-28 02:47:28 +03:00
Alexey Milovidov
fd5c1561e2 Merge branch 'master' into async-reads 2021-07-27 23:58:32 +03:00
Nikolai Kochetov
61d8f880cd Rename some files. 2021-07-26 19:48:25 +03:00
Vitaly Baranov
4862e9f80d
Merge pull request #26733 from vitlibar/support-multiple-keys
Support multiple keys for encrypted disk
2021-07-26 10:19:50 +03:00
Alexey Milovidov
663dc91c99 Minor change 2021-07-26 04:51:12 +03:00
Alexey Milovidov
5c3f5cb35a Experiment with asynchronous readers 2021-07-26 03:34:36 +03:00
Vitaly Baranov
51f882d8cc Support multiple keys for encrypted disk. Display error message if the key is probably wrong. 2021-07-24 23:45:12 +03:00
bharatnc
2b795ae193 LZ4 - fix write compress 2021-07-24 11:29:35 -05:00
alexey-milovidov
70ca77b342
Merge pull request #26768 from ClickHouse/opened-file-cache
Experiment with sharing file descriptors
2021-07-24 13:08:03 +03:00
Alexey Milovidov
0a4e26e682 Experiment with sharing file descriptors 2021-07-24 01:50:14 +03:00
Vladimir Chebotarev
eb2defb098
Fixed wrong error message in S3Common. 2021-07-23 15:36:19 +03:00
Nikita Mikhaylov
4d3f828beb
Merge pull request #26314 from kssenii/fix-hdfs-crash
Fix hdfs crash
2021-07-20 15:01:56 +03:00
Vitaly Baranov
1fc822b19d
Merge pull request #26465 from vitlibar/explicit-encryption-mode
Set encryption algorithm explicitly.
2021-07-19 09:38:02 +03:00
Kseniia Sumarokova
b0ddc4fb30
Merge pull request #26364 from kssenii/fixing-date32
Continuation of #25774
2021-07-18 21:44:45 +03:00
Vitaly Baranov
81ea8521b1 Set encryption algorithm explicitly. 2021-07-18 10:29:42 +03:00
kssenii
9cb10aae3c Some fixes 2021-07-18 03:43:08 +00:00
alexey-milovidov
18f1197d9d
Update Progress.h 2021-07-17 23:15:16 +03:00
Alexey Milovidov
261a220227 Remove some code 2021-07-17 21:06:46 +03:00
Kseniia Sumarokova
e844cec16f
Merge branch 'master' into fix-hdfs-crash 2021-07-16 22:21:30 +03:00
Vitaly Baranov
958494b98e
Merge pull request #26377 from vitlibar/encrypted-disk-comments-and-improvements
Add comments for encrypted disks; some improvements in code.
2021-07-16 21:24:51 +03:00
Vitaly Baranov
9cc258327e Add comments for encrypted disks; some improvements in code. 2021-07-16 12:04:25 +03:00
Kseniia Sumarokova
3303fe2fd3
Update ZstdInflatingReadBuffer.cpp 2021-07-15 17:58:58 +03:00
kssenii
3ba2d114d5 Revert "Merge pull request #26352 from ClickHouse/revert-25774-datatype-date32"
This reverts commit 94a210650f, reversing
changes made to 0893b9ff8e.
2021-07-15 11:41:52 +00:00
alexey-milovidov
9ba4064c86
Revert "Datatype Date32, support range 1925 to 2283" 2021-07-15 10:53:35 +03:00
Evgeniy Gatov
5a884da13c METR-41529 2021-07-15 00:57:18 +03:00
kssenii
f9a2c39701 More approprate fix 2021-07-14 20:15:05 +03:00
kssenii
1993d8e0f4 Fix hdfs crash 2021-07-14 15:13:18 +03:00
Ivan Lezhankin
ab26aed6f9 Merge remote-tracking branch 'upstream/master' into async-insert 2021-07-13 13:54:09 +03:00
Vitaly Baranov
bc5080d701 Rename ReadEncryptedBuffer -> ReadBufferFromEncryptedFile,
WriteEncryptedBuffer -> WriteBufferFromEncryptedFile,
move file FileEncryption.h to the IO folder,
rename functions accroding to our code style,
add cpp files.
2021-07-13 11:31:03 +03:00
Vitaly Baranov
e2424db810 Fix ReadBufferFromS3 2021-07-13 11:30:29 +03:00
Vitaly Baranov
0f9ace257f Fix conversion to/from big endian. 2021-07-13 11:30:08 +03:00
Vitaly Baranov
81f3876506 Fix finalize() and sync() in WriteEncryptedBuffer. 2021-07-13 11:30:00 +03:00
Vitaly Baranov
e086e5e384
Merge branch 'master' into alexelex-encryption-1 2021-07-13 11:28:41 +03:00
Vitaly Baranov
f4507dba7b
Fix typo 2021-07-13 00:07:33 +03:00
Kseniia Sumarokova
4a6b4d6c26
Merge pull request #25774 from liuneng1994/datatype-date32
Datatype Date32, support range 1925 to 2283
2021-07-12 20:33:39 +03:00
mergify[bot]
b7ae4e4ced
Merge branch 'master' into async-insert 2021-07-12 09:21:37 +00:00
Alexey Milovidov
822cc0fec3 Lowered amount of syscalls in AsynchronousMetrics 2021-07-12 04:12:34 +03:00
Alexey Milovidov
e0effad4d1 Fix tiny issue 2021-07-12 03:33:13 +03:00
Alexey Milovidov
7e932c2504 Fix Arcadia 2021-07-11 22:07:46 +03:00
Alexey Milovidov
d3cdae1211 Fix build 2021-07-11 22:07:17 +03:00
neng.liu
4669839fbb add comment and update ya.make 2021-07-11 04:55:42 -07:00
Alexey Milovidov
2d02a3a45d Fix errors 2021-07-11 05:43:54 +03:00
Alexey Milovidov
29624436ff Return back O_DIRECT 2021-07-11 03:35:43 +03:00
Alexey Milovidov
30826c7d7d Return O_DIRECT 2021-07-11 03:33:14 +03:00
Alexey Milovidov
81646f8389 Merge branch 'master' into ditch-aio 2021-07-11 03:06:45 +03:00
alexey-milovidov
9c2aad6c17
Merge pull request #25962 from ClickHouse/network-instrumentation
More instrumentation for network interaction: add counters for recv/send bytes; add gauges for recvs/sends.
2021-07-08 17:20:16 +03:00
neng.liu
e47aadfdef Merge branch 'datatype-date32' of https://github.com/liuneng1994/ClickHouse into datatype-date32 2021-07-08 00:09:48 -07:00
neng.liu
100d30a5ba fix pr comment 2021-07-08 00:06:36 -07:00
bharatnc
e6f627bbc6 LZ4 - decompress read initial implementation 2021-07-06 16:56:33 -07:00
Alexey Milovidov
2e41419e3b Fix build 2021-07-06 03:34:27 +03:00
Alexey Milovidov
9875adc00b Make it even worse 2021-07-06 01:09:39 +03:00
Alexey Milovidov
6d3d724cd4 Fix error 2021-07-05 23:20:25 +03:00
Alexey Milovidov
8fae774e85 Fix error 2021-07-05 23:18:13 +03:00
Alexey Milovidov
f29eb11e6c Fix error 2021-07-05 23:17:53 +03:00
Alexey Milovidov
21fb6ddea5 Remove AIO for sequential reads 2021-07-05 23:02:24 +03:00
bharatnc
c79f885e41 LZ4 - compress write initial implementation 2021-07-04 23:19:27 -07:00
bharatnc
7620c28c14 LZ4 - fix cmake to include lz4 2021-07-04 23:19:27 -07:00
bharatnc
afad00b7d4 LZ4 - initial commit 2021-07-04 23:19:27 -07:00
NengLiu
8b88988618 Merge branch 'master' into datatype-date32
# Conflicts:
#	src/DataStreams/PostgreSQLBlockInputStream.cpp
2021-07-05 10:18:38 +08:00
NengLiu
dc0c65ef4f Merge remote-tracking branch 'origin/master' into datatype-date32 2021-07-05 10:15:08 +08:00
Alexey Milovidov
935e0327a5 Development 2021-07-04 06:03:49 +03:00
Alexey Milovidov
c762e2247d More instrumentation for network interaction: add counters for recv/send bytes; add gauges for recvs/sends. 2021-07-04 00:00:50 +03:00
Maksim Kita
f16e8c3a4b
Merge pull request #25909 from ClickHouse/invalid-date
Correctly throw exception on attempt to parse invalid Date
2021-07-02 20:54:50 +03:00
Alexey Milovidov
b33d91412d Correctly throw exception on invalid dates 2021-07-02 03:07:23 +03:00
Ivan Lezhankin
d7126682b0 Fix shared build 2021-06-29 15:05:46 +03:00
Ivan Lezhankin
1bb41593d1 Merge remote-tracking branch 'upstream/master' into async-insert 2021-06-28 22:55:56 +03:00
neng.liu
ec7604b013 add parquet test and fix add interval error when type is date32 2021-06-28 16:36:54 +08:00
Alexey Milovidov
b11f9223de Merge branch 'master' into fix-receive-time-metric 2021-06-27 19:00:39 +03:00
Ivan
14e43cfafa
Add CI check for darwin-aarch64 (#25560)
* Add support for darwin-aarch64

* Fix PVS warnings

* Add build configuration

* Fix packager args
2021-06-25 18:21:56 +03:00
tavplubix
b1263c18ee
Fix pcg deserialization (#24538)
* fix pcg deserialization

* Update 01156_pcg_deserialization.sh

* Update 01156_pcg_deserialization.sh

* Update 01156_pcg_deserialization.sh

* fix another bug

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2021-06-24 10:40:00 +03:00
Alexey Milovidov
99e08b7406 Make network receive time metric to correctly include the time spent waiting for data from the client to INSERT #9958 2021-06-22 23:22:13 +03:00
Neng Liu
7ed1728a37 Merge branch 'master' into datatype-date32
# Conflicts:
#	src/DataTypes/IDataType.h
#	src/Functions/CustomWeekTransforms.h
2021-06-22 10:00:18 +08:00
kssenii
babb11a887 Some fixes 2021-06-19 19:18:13 +00:00
kssenii
7f356a5fbc Fix readbuffer 2021-06-18 17:06:17 +00:00
Kseniia Sumarokova
5974f96f0c
Merge pull request #23656 from kssenii/progress-bar
Progress indication for File table engine in clickhouse-local and insert from file in clickhouse-client
2021-06-18 17:46:54 +03:00
kssenii
f33387837e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-06-18 14:27:48 +00:00
Vladimir
4de0d1a593
Merge pull request #24885 from Jokser/disk-s3-read-error-fix 2021-06-18 13:38:59 +03:00
kssenii
bdc8fe1ca0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into progress-bar 2021-06-18 09:33:29 +03:00
Latysheva Alexandra
48d3419160
Merge branch 'master' into alexelex-encryption-1 2021-06-18 11:28:08 +06:00
Alexey Milovidov
3e71181451 Whitespaces 2021-06-18 01:42:33 +03:00
Pavel Kovalenko
ce8e2f7f28 Avoid double initializing ReadBufferFromS3 2021-06-17 22:31:50 +03:00
Ivan Lezhankin
37365589ed Merge branch 'master' into async-insert 2021-06-17 16:57:45 +03:00
Maksim Kita
ac2f9dd15a Updated function dateName before merge 2021-06-16 21:19:05 +03:00
kssenii
cd885ee750 Fix build, ya make 2021-06-14 11:52:20 +00:00
kssenii
a1f11f5178 Fixes 2021-06-14 09:37:33 +00:00
kssenii
11faddb39f Better 2021-06-13 22:30:37 +00:00
kssenii
2cfcc9980c Better 2021-06-13 19:38:31 +00:00
kssenii
c80eac0dc3 First version 2021-06-13 19:36:56 +00:00
Pavel Kovalenko
47252e07f3 Remove trailing whitespaces 2021-06-12 15:57:14 +03:00
Pavel Kovalenko
0c82d45dea Missed initialize in ReadBufferFromS3 2021-06-12 14:35:34 +03:00
mergify[bot]
9cfedd9c64
Merge branch 'master' into progress-bar 2021-06-12 01:15:23 +00:00
alexey-milovidov
05d1af153c
Merge branch 'master' into rename-const-context-ptr 2021-06-12 03:25:09 +03:00
alexey-milovidov
99f108d704
Merge pull request #25162 from kitaisreal/rewrite-function-to-subcolumn-visitor-add-into-ya-make
RewriteFunctionToSubcolumnVisitor add into ya.make
2021-06-12 02:58:53 +03:00
alexey-milovidov
971c79611b
Merge branch 'master' into patch-5 2021-06-12 02:36:13 +03:00
Ivan Lezhankin
2c7cb41a69 Merge remote-tracking branch 'upstream/master' into async-insert 2021-06-11 20:04:26 +03:00
mergify[bot]
60c094e785
Merge branch 'master' into disk-s3-read-error-fix 2021-06-11 15:00:43 +00:00
Maksim Kita
30c78c0a23 Fix arcadia 2021-06-11 14:26:33 +03:00
Vladimir
ba198c48ea
Merge pull request #24898 from excitoon/patch-8 2021-06-10 18:34:17 +03:00
Yuriy Chernyshov
c0cb5387f4 Use zstd/include in ya.make 2021-06-09 23:02:39 +03:00
mergify[bot]
3a47feedb0
Merge branch 'master' into progress-bar 2021-06-09 08:04:48 +00:00
mergify[bot]
bfbc787b08
Merge branch 'master' into disk-s3-read-error-fix 2021-06-09 06:56:19 +00:00
Neng Liu
88a0d0be62 add datetype32 part2 2021-06-08 20:31:41 +08:00
Ivan Lezhankin
973cea73b7 Merge branch 'master' into async-insert 2021-06-08 15:10:30 +03:00
Vladimir
fb987cf2c7
Fix space in ReadBufferFromFileDecorator.cpp 2021-06-08 15:00:28 +03:00
Latysheva Alexandra
1a2cbe9275
Merge branch 'master' into alexelex-encryption-1 2021-06-07 21:18:54 +06:00
neng.liu
120da1fd73 date32 initial code 2021-06-07 06:41:58 -07:00
Pavel Kovalenko
6ba40c475a Code cleanup + comments. 2021-06-07 13:49:34 +03:00
Vladimir Chebotarev
ad816fde7b
Fix. 2021-06-07 09:56:15 +03:00
Vladimir Chebotarev
e21f76b137
Fixed unit tests accoording to the fix. 2021-06-07 09:54:05 +03:00
Vladimir Chebotarev
8c33e53e80
Review fixes. 2021-06-07 09:41:49 +03:00
mergify[bot]
d68d5e0ef1
Merge branch 'master' into rename-const-context-ptr 2021-06-04 14:41:41 +00:00
Nikita Mikhaylov
8076848d62
Update ReadBufferFromS3.cpp 2021-06-04 02:46:21 +03:00
mergify[bot]
9e2c454db2
Merge branch 'master' into merging-s3-backoff 2021-06-03 18:58:24 +00:00
Vladimir Chebotarev
1012a768b1
Allowed S3 key to be empty. 2021-06-03 09:09:09 +03:00
Vladimir Chebotarev
89664a3452
Fixed problems with double spaces in logs for S3Common. 2021-06-03 09:05:24 +03:00
alesapin
4a1bf51ad1
Merge branch 'master' into limited_fetches 2021-06-02 23:01:47 +03:00
Ivan Lezhankin
791cbcf0b1 Merge remote-tracking branch 'upstream/master' into async-insert 2021-06-02 18:50:37 +03:00
Ivan Lezhankin
84c23dc060 Merge branch 'master' into async-insert 2021-06-02 18:06:21 +03:00
Pavel Kovalenko
2bd12a7612 Fix DiskS3 read error due to broken getPosition() method in ReadBufferFromS3.cpp 2021-06-02 18:03:25 +03:00
Nikita Mikhaylov
3f18bde246 Merge branch 'master' of github.com:ClickHouse/ClickHouse into merging-s3-backoff 2021-06-01 13:39:09 +00:00
Nikolai Kochetov
dbaa6ffc62 Rename ContextConstPtr to ContextPtr. 2021-06-01 15:20:52 +03:00
alesapin
c3321bef30 Merge branch 'master' into limited_fetches 2021-06-01 13:09:02 +03:00
kssenii
de277f8ac4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar 2021-06-01 07:58:19 +00:00
tavplubix
e9ff0b6d70
Merge pull request #23657 from kssenii/poco-file-to-std-fs
Poco::File to std::filesystem
2021-05-31 23:17:02 +03:00
mergify[bot]
08eca33d81
Merge branch 'master' into progress-bar 2021-05-31 19:54:20 +00:00
Nikita Mikhaylov
0d8ede15a9
Merge branch 'master' into merging-s3-backoff 2021-05-31 21:07:00 +03:00
kssenii
db9f4762eb Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-29 01:15:43 +03:00
Alexander Kuzmenkov
92660aaf35 Merge remote-tracking branch 'origin/master' into HEAD 2021-05-28 19:45:53 +03:00
Alexander Kuzmenkov
3f57fc085b remove mutable context references from functions interface
Also remove it from some visitors.
2021-05-28 19:45:37 +03:00
Kruglov Pavel
e584b028e7
Merge pull request #24475 from amosbird/readint
Pedantic readInt
2021-05-28 15:44:23 +03:00
Nikita Mikhaylov
c127c433c2 better 2021-05-27 23:43:00 +03:00
Amos Bird
6f12781bf1
Safer readInt 2021-05-27 22:56:51 +08:00
alesapin
2985def91d Add tests 2021-05-27 15:54:47 +03:00
alesapin
42b2383e01 Basic throttler implementation 2021-05-26 23:37:44 +03:00
kssenii
3dee003f9b Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-20 19:20:09 +03:00
Alexandra
11e40ad000 style fixes 2021-05-19 22:06:25 +00:00
mergify[bot]
e762039db7
Merge branch 'master' into merging-s3-backoff 2021-05-19 21:57:10 +00:00
Nikita Mikhaylov
f33b70c54a better 2021-05-20 00:42:25 +03:00
Alexandra
f71e97511b set use_ssl flag 2021-05-18 20:48:16 +00:00
Alexandra
b7a0f2db57 refactoring 2021-05-18 20:20:51 +00:00
Alexandra
af420569f8 remove debug information, fix seek issue and encryption issue 2021-05-17 16:15:21 +00:00
kssenii
9b8df78fdd Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-17 17:42:05 +03:00
Raúl Marín
439f161764 Fix GCC 11 build
../src/IO/HashingWriteBuffer.h:20:34: error: expected ‘)’ before ‘block_size_’
   20 |     IHashingBuffer<Buffer>(size_t block_size_ = DBMS_DEFAULT_HASHING_BLOCK_SIZE)
2021-05-17 14:04:08 +02:00
Vladimir Chebotarev
fa7308d2cb Minor fix. 2021-05-17 10:38:34 +03:00
Vladimir Chebotarev
bdf03387ab Better S3 read retries. Renamed s3_max_single_read_retries -> s3_single_read_retry_attempts, added sleeps before next attempts. 2021-05-17 10:38:32 +03:00
Alexandra
10a5b734ee encryption initialization (without any flags like use_ssl for now) 2021-05-16 22:35:20 +00:00
kssenii
e9c3bc1836 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar 2021-05-16 20:48:35 +00:00
Raúl Marín
e358a0963c Clearer code based on review 2021-05-15 03:03:38 +02:00
Raúl Marín
0ddfc3df84 TestReadAfterAIO: Use the local path instead of /tmp for temporal files
/tmp might be mounted as tmpfs (default in ArchLinux) which is incompatible with
O_DIRECT (https://lore.kernel.org/lkml/459D290B.1040703@tmr.com/t/), making the
test fail:

```
[ RUN      ] ReadBufferAIOTest.TestReadAfterAIO
unknown file: Failure
C++ exception with description "Cannot open file /tmp/filei6ZsCa/foo, errno: 22, strerror: Invalid argument" thrown in the test body.
[  FAILED  ] ReadBufferAIOTest.TestReadAfterAIO (0 ms)
```

Instead create the tmp folder in the local path and delete it at the end
2021-05-15 02:13:51 +02:00
Alexandra
67f9b86515 implement read and write buffers (with debug=warning logs) 2021-05-14 21:54:03 +00:00
kssenii
c25be65ebf Refactor progress bar, adjust progress indication for reading from file 2021-05-14 06:16:31 +00:00
kssenii
f33a517d33 Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-14 02:58:26 +03:00
kssenii
e82d717233 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar 2021-05-13 10:20:02 +00:00
Vladimir Chebotarev
a3f7992442 Fixed typo. 2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
b738e25f5b Better handling of HTTP errors in PocoHTTPClient. 2021-05-13 08:46:16 +03:00
kssenii
393b026f2e Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-11 16:49:23 +03:00
Alexey Milovidov
b2ca5cd98b Merge branch 'master' into normalize-bigint 2021-05-11 02:05:40 +03:00
Alexey Milovidov
b9b3e4b60a Fix style and wording in #23946 2021-05-10 23:32:30 +03:00
Maksim Kita
4a22924ed5
Merge pull request #23946 from FArthur-cmd/8912-fix-dict-http-source
Add support for HTTP compression in dictionary source.
2021-05-10 22:52:07 +03:00