thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-17 20:02:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
76,699 Commits 9,330 Branches 1,783 Tags 2.1 GiB
af78116c3f
Commit Graph

1087 Commits

Author SHA1 Message Date
Alexey Milovidov
ae853b837b Fix build 2021-07-28 10:05:22 +03:00
Alexey Milovidov
00e20c7e3c Remove useless code 2021-07-28 09:08:29 +03:00
Alexey Milovidov
e841996486 Fix style 2021-07-28 08:28:30 +03:00
Alexey Milovidov
1974ed9d5c Fix build 2021-07-28 02:59:56 +03:00
Alexey Milovidov
10752dd1cf Fix build 2021-07-28 02:57:05 +03:00
Alexey Milovidov
46723a2c3c Fix error 2021-07-28 02:47:28 +03:00
Alexey Milovidov
fd5c1561e2 Merge branch 'master' into async-reads 2021-07-27 23:58:32 +03:00
Nikolai Kochetov
61d8f880cd Rename some files. 2021-07-26 19:48:25 +03:00
Vitaly Baranov
4862e9f80d
Merge pull request #26733 from vitlibar/support-multiple-keys 
Support multiple keys for encrypted disk
 2021-07-26 10:19:50 +03:00
Alexey Milovidov
663dc91c99 Minor change 2021-07-26 04:51:12 +03:00
Alexey Milovidov
5c3f5cb35a Experiment with asynchronous readers 2021-07-26 03:34:36 +03:00
Vitaly Baranov
51f882d8cc Support multiple keys for encrypted disk. Display error message if the key is probably wrong. 2021-07-24 23:45:12 +03:00
bharatnc
2b795ae193 LZ4 - fix write compress 2021-07-24 11:29:35 -05:00
alexey-milovidov
70ca77b342
Merge pull request #26768 from ClickHouse/opened-file-cache 
Experiment with sharing file descriptors
 2021-07-24 13:08:03 +03:00
Alexey Milovidov
0a4e26e682 Experiment with sharing file descriptors 2021-07-24 01:50:14 +03:00
Vladimir Chebotarev
eb2defb098
Fixed wrong error message in S3Common. 2021-07-23 15:36:19 +03:00
Nikita Mikhaylov
4d3f828beb
Merge pull request #26314 from kssenii/fix-hdfs-crash 
Fix hdfs crash
 2021-07-20 15:01:56 +03:00
Vitaly Baranov
1fc822b19d
Merge pull request #26465 from vitlibar/explicit-encryption-mode 
Set encryption algorithm explicitly.
 2021-07-19 09:38:02 +03:00
Kseniia Sumarokova
b0ddc4fb30
Merge pull request #26364 from kssenii/fixing-date32 
Continuation of #25774
 2021-07-18 21:44:45 +03:00
Vitaly Baranov
81ea8521b1 Set encryption algorithm explicitly. 2021-07-18 10:29:42 +03:00
kssenii
9cb10aae3c Some fixes 2021-07-18 03:43:08 +00:00
alexey-milovidov
18f1197d9d
Update Progress.h 2021-07-17 23:15:16 +03:00
Alexey Milovidov
261a220227 Remove some code 2021-07-17 21:06:46 +03:00
Kseniia Sumarokova
e844cec16f
Merge branch 'master' into fix-hdfs-crash 2021-07-16 22:21:30 +03:00
Vitaly Baranov
958494b98e
Merge pull request #26377 from vitlibar/encrypted-disk-comments-and-improvements 
Add comments for encrypted disks; some improvements in code.
 2021-07-16 21:24:51 +03:00
Vitaly Baranov
9cc258327e Add comments for encrypted disks; some improvements in code. 2021-07-16 12:04:25 +03:00
Kseniia Sumarokova
3303fe2fd3
Update ZstdInflatingReadBuffer.cpp 2021-07-15 17:58:58 +03:00
kssenii
3ba2d114d5 Revert "Merge pull request #26352 from ClickHouse/revert-25774-datatype-date32" 
This reverts commit 94a210650f, reversing
changes made to 0893b9ff8e.
 2021-07-15 11:41:52 +00:00
alexey-milovidov
9ba4064c86
Revert "Datatype Date32, support range 1925 to 2283" 2021-07-15 10:53:35 +03:00
Evgeniy Gatov
5a884da13c METR-41529 2021-07-15 00:57:18 +03:00
kssenii
f9a2c39701 More approprate fix 2021-07-14 20:15:05 +03:00
kssenii
1993d8e0f4 Fix hdfs crash 2021-07-14 15:13:18 +03:00
Ivan Lezhankin
ab26aed6f9 Merge remote-tracking branch 'upstream/master' into async-insert 2021-07-13 13:54:09 +03:00
Vitaly Baranov
bc5080d701 Rename ReadEncryptedBuffer -> ReadBufferFromEncryptedFile, 
WriteEncryptedBuffer -> WriteBufferFromEncryptedFile,
move file FileEncryption.h to the IO folder,
rename functions accroding to our code style,
add cpp files.
 2021-07-13 11:31:03 +03:00
Vitaly Baranov
e2424db810 Fix ReadBufferFromS3 2021-07-13 11:30:29 +03:00
Vitaly Baranov
0f9ace257f Fix conversion to/from big endian. 2021-07-13 11:30:08 +03:00
Vitaly Baranov
81f3876506 Fix finalize() and sync() in WriteEncryptedBuffer. 2021-07-13 11:30:00 +03:00
Vitaly Baranov
e086e5e384
Merge branch 'master' into alexelex-encryption-1 2021-07-13 11:28:41 +03:00
Vitaly Baranov
f4507dba7b
Fix typo 2021-07-13 00:07:33 +03:00
Kseniia Sumarokova
4a6b4d6c26
Merge pull request #25774 from liuneng1994/datatype-date32 
Datatype Date32, support range 1925 to 2283
 2021-07-12 20:33:39 +03:00
mergify[bot]
b7ae4e4ced
Merge branch 'master' into async-insert 2021-07-12 09:21:37 +00:00
Alexey Milovidov
822cc0fec3 Lowered amount of syscalls in AsynchronousMetrics 2021-07-12 04:12:34 +03:00
Alexey Milovidov
e0effad4d1 Fix tiny issue 2021-07-12 03:33:13 +03:00
Alexey Milovidov
7e932c2504 Fix Arcadia 2021-07-11 22:07:46 +03:00
Alexey Milovidov
d3cdae1211 Fix build 2021-07-11 22:07:17 +03:00
neng.liu
4669839fbb add comment and update ya.make 2021-07-11 04:55:42 -07:00
Alexey Milovidov
2d02a3a45d Fix errors 2021-07-11 05:43:54 +03:00
Alexey Milovidov
29624436ff Return back O_DIRECT 2021-07-11 03:35:43 +03:00
Alexey Milovidov
30826c7d7d Return O_DIRECT 2021-07-11 03:33:14 +03:00
Alexey Milovidov
81646f8389 Merge branch 'master' into ditch-aio 2021-07-11 03:06:45 +03:00
alexey-milovidov
9c2aad6c17
Merge pull request #25962 from ClickHouse/network-instrumentation 
More instrumentation for network interaction: add counters for recv/send bytes; add gauges for recvs/sends.
 2021-07-08 17:20:16 +03:00
neng.liu
e47aadfdef Merge branch 'datatype-date32' of https://github.com/liuneng1994/ClickHouse into datatype-date32 2021-07-08 00:09:48 -07:00
neng.liu
100d30a5ba fix pr comment 2021-07-08 00:06:36 -07:00
bharatnc
e6f627bbc6 LZ4 - decompress read initial implementation 2021-07-06 16:56:33 -07:00
Alexey Milovidov
2e41419e3b Fix build 2021-07-06 03:34:27 +03:00
Alexey Milovidov
9875adc00b Make it even worse 2021-07-06 01:09:39 +03:00
Alexey Milovidov
6d3d724cd4 Fix error 2021-07-05 23:20:25 +03:00
Alexey Milovidov
8fae774e85 Fix error 2021-07-05 23:18:13 +03:00
Alexey Milovidov
f29eb11e6c Fix error 2021-07-05 23:17:53 +03:00
Alexey Milovidov
21fb6ddea5 Remove AIO for sequential reads 2021-07-05 23:02:24 +03:00
bharatnc
c79f885e41 LZ4 - compress write initial implementation 2021-07-04 23:19:27 -07:00
bharatnc
7620c28c14 LZ4 - fix cmake to include lz4 2021-07-04 23:19:27 -07:00
bharatnc
afad00b7d4 LZ4 - initial commit 2021-07-04 23:19:27 -07:00
NengLiu
8b88988618 Merge branch 'master' into datatype-date32 
# Conflicts:
#	src/DataStreams/PostgreSQLBlockInputStream.cpp
 2021-07-05 10:18:38 +08:00
NengLiu
dc0c65ef4f Merge remote-tracking branch 'origin/master' into datatype-date32 2021-07-05 10:15:08 +08:00
Alexey Milovidov
935e0327a5 Development 2021-07-04 06:03:49 +03:00
Alexey Milovidov
c762e2247d More instrumentation for network interaction: add counters for recv/send bytes; add gauges for recvs/sends. 2021-07-04 00:00:50 +03:00
Maksim Kita
f16e8c3a4b
Merge pull request #25909 from ClickHouse/invalid-date 
Correctly throw exception on attempt to parse invalid Date
 2021-07-02 20:54:50 +03:00
Alexey Milovidov
b33d91412d Correctly throw exception on invalid dates 2021-07-02 03:07:23 +03:00
Ivan Lezhankin
d7126682b0 Fix shared build 2021-06-29 15:05:46 +03:00
Ivan Lezhankin
1bb41593d1 Merge remote-tracking branch 'upstream/master' into async-insert 2021-06-28 22:55:56 +03:00
neng.liu
ec7604b013 add parquet test and fix add interval error when type is date32 2021-06-28 16:36:54 +08:00
Alexey Milovidov
b11f9223de Merge branch 'master' into fix-receive-time-metric 2021-06-27 19:00:39 +03:00
Ivan
14e43cfafa
Add CI check for darwin-aarch64 (#25560) 
* Add support for darwin-aarch64

* Fix PVS warnings

* Add build configuration

* Fix packager args
 2021-06-25 18:21:56 +03:00
tavplubix
b1263c18ee
Fix pcg deserialization (#24538) 
* fix pcg deserialization

* Update 01156_pcg_deserialization.sh

* Update 01156_pcg_deserialization.sh

* Update 01156_pcg_deserialization.sh

* fix another bug

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
 2021-06-24 10:40:00 +03:00
Alexey Milovidov
99e08b7406 Make network receive time metric to correctly include the time spent waiting for data from the client to INSERT #9958 2021-06-22 23:22:13 +03:00
Neng Liu
7ed1728a37 Merge branch 'master' into datatype-date32 
# Conflicts:
#	src/DataTypes/IDataType.h
#	src/Functions/CustomWeekTransforms.h
 2021-06-22 10:00:18 +08:00
kssenii
babb11a887 Some fixes 2021-06-19 19:18:13 +00:00
kssenii
7f356a5fbc Fix readbuffer 2021-06-18 17:06:17 +00:00
Kseniia Sumarokova
5974f96f0c
Merge pull request #23656 from kssenii/progress-bar 
Progress indication for File table engine in clickhouse-local and insert from file in clickhouse-client
 2021-06-18 17:46:54 +03:00
kssenii
f33387837e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-06-18 14:27:48 +00:00
Vladimir
4de0d1a593
Merge pull request #24885 from Jokser/disk-s3-read-error-fix 2021-06-18 13:38:59 +03:00
kssenii
bdc8fe1ca0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into progress-bar 2021-06-18 09:33:29 +03:00
Latysheva Alexandra
48d3419160
Merge branch 'master' into alexelex-encryption-1 2021-06-18 11:28:08 +06:00
Alexey Milovidov
3e71181451 Whitespaces 2021-06-18 01:42:33 +03:00
Pavel Kovalenko
ce8e2f7f28 Avoid double initializing ReadBufferFromS3 2021-06-17 22:31:50 +03:00
Ivan Lezhankin
37365589ed Merge branch 'master' into async-insert 2021-06-17 16:57:45 +03:00
Maksim Kita
ac2f9dd15a Updated function dateName before merge 2021-06-16 21:19:05 +03:00
kssenii
cd885ee750 Fix build, ya make 2021-06-14 11:52:20 +00:00
kssenii
a1f11f5178 Fixes 2021-06-14 09:37:33 +00:00
kssenii
11faddb39f Better 2021-06-13 22:30:37 +00:00
kssenii
2cfcc9980c Better 2021-06-13 19:38:31 +00:00
kssenii
c80eac0dc3 First version 2021-06-13 19:36:56 +00:00
Pavel Kovalenko
47252e07f3 Remove trailing whitespaces 2021-06-12 15:57:14 +03:00
Pavel Kovalenko
0c82d45dea Missed initialize in ReadBufferFromS3 2021-06-12 14:35:34 +03:00
mergify[bot]
9cfedd9c64
Merge branch 'master' into progress-bar 2021-06-12 01:15:23 +00:00
alexey-milovidov
05d1af153c
Merge branch 'master' into rename-const-context-ptr 2021-06-12 03:25:09 +03:00
alexey-milovidov
99f108d704
Merge pull request #25162 from kitaisreal/rewrite-function-to-subcolumn-visitor-add-into-ya-make 
RewriteFunctionToSubcolumnVisitor add into ya.make
 2021-06-12 02:58:53 +03:00
alexey-milovidov
971c79611b
Merge branch 'master' into patch-5 2021-06-12 02:36:13 +03:00
Ivan Lezhankin
2c7cb41a69 Merge remote-tracking branch 'upstream/master' into async-insert 2021-06-11 20:04:26 +03:00
mergify[bot]
60c094e785
Merge branch 'master' into disk-s3-read-error-fix 2021-06-11 15:00:43 +00:00
Maksim Kita
30c78c0a23 Fix arcadia 2021-06-11 14:26:33 +03:00
Vladimir
ba198c48ea
Merge pull request #24898 from excitoon/patch-8 2021-06-10 18:34:17 +03:00
Yuriy Chernyshov
c0cb5387f4 Use zstd/include in ya.make 2021-06-09 23:02:39 +03:00
mergify[bot]
3a47feedb0
Merge branch 'master' into progress-bar 2021-06-09 08:04:48 +00:00
mergify[bot]
bfbc787b08
Merge branch 'master' into disk-s3-read-error-fix 2021-06-09 06:56:19 +00:00
Neng Liu
88a0d0be62 add datetype32 part2 2021-06-08 20:31:41 +08:00
Ivan Lezhankin
973cea73b7 Merge branch 'master' into async-insert 2021-06-08 15:10:30 +03:00
Vladimir
fb987cf2c7
Fix space in ReadBufferFromFileDecorator.cpp 2021-06-08 15:00:28 +03:00
Latysheva Alexandra
1a2cbe9275
Merge branch 'master' into alexelex-encryption-1 2021-06-07 21:18:54 +06:00
neng.liu
120da1fd73 date32 initial code 2021-06-07 06:41:58 -07:00
Pavel Kovalenko
6ba40c475a Code cleanup + comments. 2021-06-07 13:49:34 +03:00
Vladimir Chebotarev
ad816fde7b
Fix. 2021-06-07 09:56:15 +03:00
Vladimir Chebotarev
e21f76b137
Fixed unit tests accoording to the fix. 2021-06-07 09:54:05 +03:00
Vladimir Chebotarev
8c33e53e80
Review fixes. 2021-06-07 09:41:49 +03:00
mergify[bot]
d68d5e0ef1
Merge branch 'master' into rename-const-context-ptr 2021-06-04 14:41:41 +00:00
Nikita Mikhaylov
8076848d62
Update ReadBufferFromS3.cpp 2021-06-04 02:46:21 +03:00
mergify[bot]
9e2c454db2
Merge branch 'master' into merging-s3-backoff 2021-06-03 18:58:24 +00:00
Vladimir Chebotarev
1012a768b1
Allowed S3 key to be empty. 2021-06-03 09:09:09 +03:00
Vladimir Chebotarev
89664a3452
Fixed problems with double spaces in logs for S3Common. 2021-06-03 09:05:24 +03:00
alesapin
4a1bf51ad1
Merge branch 'master' into limited_fetches 2021-06-02 23:01:47 +03:00
Ivan Lezhankin
791cbcf0b1 Merge remote-tracking branch 'upstream/master' into async-insert 2021-06-02 18:50:37 +03:00
Ivan Lezhankin
84c23dc060 Merge branch 'master' into async-insert 2021-06-02 18:06:21 +03:00
Pavel Kovalenko
2bd12a7612 Fix DiskS3 read error due to broken getPosition() method in ReadBufferFromS3.cpp 2021-06-02 18:03:25 +03:00
Nikita Mikhaylov
3f18bde246 Merge branch 'master' of github.com:ClickHouse/ClickHouse into merging-s3-backoff 2021-06-01 13:39:09 +00:00
Nikolai Kochetov
dbaa6ffc62 Rename ContextConstPtr to ContextPtr. 2021-06-01 15:20:52 +03:00
alesapin
c3321bef30 Merge branch 'master' into limited_fetches 2021-06-01 13:09:02 +03:00
kssenii
de277f8ac4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar 2021-06-01 07:58:19 +00:00
tavplubix
e9ff0b6d70
Merge pull request #23657 from kssenii/poco-file-to-std-fs 
Poco::File to std::filesystem
 2021-05-31 23:17:02 +03:00
mergify[bot]
08eca33d81
Merge branch 'master' into progress-bar 2021-05-31 19:54:20 +00:00
Nikita Mikhaylov
0d8ede15a9
Merge branch 'master' into merging-s3-backoff 2021-05-31 21:07:00 +03:00
kssenii
db9f4762eb Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-29 01:15:43 +03:00
Alexander Kuzmenkov
92660aaf35 Merge remote-tracking branch 'origin/master' into HEAD 2021-05-28 19:45:53 +03:00
Alexander Kuzmenkov
3f57fc085b remove mutable context references from functions interface 
Also remove it from some visitors.
 2021-05-28 19:45:37 +03:00
Kruglov Pavel
e584b028e7
Merge pull request #24475 from amosbird/readint 
Pedantic readInt
 2021-05-28 15:44:23 +03:00
Nikita Mikhaylov
c127c433c2 better 2021-05-27 23:43:00 +03:00
Amos Bird
6f12781bf1
Safer readInt 2021-05-27 22:56:51 +08:00
alesapin
2985def91d Add tests 2021-05-27 15:54:47 +03:00
alesapin
42b2383e01 Basic throttler implementation 2021-05-26 23:37:44 +03:00
kssenii
3dee003f9b Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-20 19:20:09 +03:00
Alexandra
11e40ad000 style fixes 2021-05-19 22:06:25 +00:00
mergify[bot]
e762039db7
Merge branch 'master' into merging-s3-backoff 2021-05-19 21:57:10 +00:00
Nikita Mikhaylov
f33b70c54a better 2021-05-20 00:42:25 +03:00
Alexandra
f71e97511b set use_ssl flag 2021-05-18 20:48:16 +00:00
Alexandra
b7a0f2db57 refactoring 2021-05-18 20:20:51 +00:00
Alexandra
af420569f8 remove debug information, fix seek issue and encryption issue 2021-05-17 16:15:21 +00:00
kssenii
9b8df78fdd Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-17 17:42:05 +03:00
Raúl Marín
439f161764 Fix GCC 11 build 
../src/IO/HashingWriteBuffer.h:20:34: error: expected ‘)’ before ‘block_size_’
   20 |     IHashingBuffer<Buffer>(size_t block_size_ = DBMS_DEFAULT_HASHING_BLOCK_SIZE)
 2021-05-17 14:04:08 +02:00
Vladimir Chebotarev
fa7308d2cb Minor fix. 2021-05-17 10:38:34 +03:00
Vladimir Chebotarev
bdf03387ab Better S3 read retries. Renamed s3_max_single_read_retries -> s3_single_read_retry_attempts, added sleeps before next attempts. 2021-05-17 10:38:32 +03:00
Alexandra
10a5b734ee encryption initialization (without any flags like use_ssl for now) 2021-05-16 22:35:20 +00:00
kssenii
e9c3bc1836 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar 2021-05-16 20:48:35 +00:00
Raúl Marín
e358a0963c Clearer code based on review 2021-05-15 03:03:38 +02:00
Raúl Marín
0ddfc3df84 TestReadAfterAIO: Use the local path instead of /tmp for temporal files 
/tmp might be mounted as tmpfs (default in ArchLinux) which is incompatible with
O_DIRECT (https://lore.kernel.org/lkml/459D290B.1040703@tmr.com/t/), making the
test fail:

```
[ RUN      ] ReadBufferAIOTest.TestReadAfterAIO
unknown file: Failure
C++ exception with description "Cannot open file /tmp/filei6ZsCa/foo, errno: 22, strerror: Invalid argument" thrown in the test body.
[  FAILED  ] ReadBufferAIOTest.TestReadAfterAIO (0 ms)
```

Instead create the tmp folder in the local path and delete it at the end
 2021-05-15 02:13:51 +02:00
Alexandra
67f9b86515 implement read and write buffers (with debug=warning logs) 2021-05-14 21:54:03 +00:00
kssenii
c25be65ebf Refactor progress bar, adjust progress indication for reading from file 2021-05-14 06:16:31 +00:00
kssenii
f33a517d33 Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-14 02:58:26 +03:00
kssenii
e82d717233 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar 2021-05-13 10:20:02 +00:00
Vladimir Chebotarev
a3f7992442 Fixed typo. 2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
b738e25f5b Better handling of HTTP errors in PocoHTTPClient. 2021-05-13 08:46:16 +03:00
kssenii
393b026f2e Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-11 16:49:23 +03:00
Alexey Milovidov
b2ca5cd98b Merge branch 'master' into normalize-bigint 2021-05-11 02:05:40 +03:00
Alexey Milovidov
b9b3e4b60a Fix style and wording in #23946 2021-05-10 23:32:30 +03:00
Maksim Kita
4a22924ed5
Merge pull request #23946 from FArthur-cmd/8912-fix-dict-http-source 
Add support for HTTP compression in dictionary source.
 2021-05-10 22:52:07 +03:00
Alexey Milovidov
94592f0d54 Whitespaces 2021-05-10 21:16:06 +03:00
alexey-milovidov
0400070924
Merge pull request #23822 from excitoon-favorites/equalsignins3path 
Better handling of URI's in `PocoHTTPClient`
 2021-05-10 20:25:18 +03:00
alexey-milovidov
5397b1d0c3
Update PocoHTTPClient.cpp 2021-05-10 20:22:09 +03:00
alexey-milovidov
5685738d08
Update PocoHTTPClient.cpp 2021-05-10 20:20:05 +03:00
Vladimir
d02d14fa00
Merge pull request #23846 from excitoon-favorites/s3regions 2021-05-10 12:14:08 +03:00
FArthur-cmd
6363a5dd96 use path to define compression type 2021-05-09 21:58:08 +03:00
FArthur-cmd
bd519075b7 adding checking url in HTTPSource 2021-05-09 14:27:11 +03:00
Alexey Milovidov
3025f9e141 More fixes for PVS-Studio 2021-05-08 19:12:49 +03:00
Alexey Milovidov
bdc372cb9a Fix bad code (found by PVS-Studio) 2021-05-08 19:11:40 +03:00
Alexey Milovidov
45dea86395 More fixes for PVS-Studio 2021-05-08 18:35:09 +03:00
Alexey Milovidov
aa727e941d Fix bad code (found by PVS-Studio) 2021-05-08 17:21:36 +03:00
Alexey Milovidov
e9c7aa5ab5 Remove some code 2021-05-08 17:12:26 +03:00
FArthur-cmd
acb09f01d4 fixing details in code style and moving tests 2021-05-08 12:46:50 +03:00
FArthur-cmd
13a6e03849 solving style-check problems 2021-05-08 10:15:14 +03:00
FArthur-cmd
4ea9851e99 fixing dictionary http source by adding wrapper 2021-05-08 02:20:30 +03:00
Alexey Milovidov
18ba924c80 Fix style 2021-05-08 01:11:09 +03:00
Alexey Milovidov
7dfb7664f7 Messing with the code (removed trash) 2021-05-07 21:16:27 +03:00
Alexey Milovidov
160aaec112 Fix error 2021-05-07 04:19:18 +03:00
Vladimir Chebotarev
524113f497 Fixed bug with S3 URLs containing + symbol, data with such keys could not be read previously. 2021-05-06 11:28:55 +03:00
Alexey Milovidov
fd4f214e43 Fix error 2021-05-05 23:04:15 +03:00
kssenii
2dabdd0f73 Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-05 18:42:40 +03:00
Alexey Milovidov
35aba776e5 Merge branch 'master' into normalize-bigint 2021-05-05 15:01:23 +03:00
kssenii
5ef3ee50fe Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar 2021-05-05 09:26:12 +00:00
Alexey Milovidov
bf463ff0d9 Remove trash 2021-05-04 23:05:51 +03:00
Alexey Milovidov
59ab0db672 Fix build 2021-05-04 20:30:32 +03:00
Alexey Milovidov
962a7113f6 Remove code that I do not like (crazy templates) 2021-05-04 20:26:09 +03:00
Alexey Milovidov
ebe0d849b5 Fix error in serialization of UInt256 2021-05-04 18:18:51 +03:00
vdimir
657eda9288
Add Read/WriteBufferFromFileDecorator.cpp to ya.make 2021-05-04 16:07:56 +03:00
Alexey Milovidov
02ce9cc725 Untangle UUID 2021-05-04 01:46:51 +03:00
Alexey Milovidov
b0bd9fd3b0 Add UInt128 where it is needed 2021-05-03 19:12:28 +03:00
Alexey Milovidov
39bcf9d860 Fix style 2021-05-03 01:44:34 +03:00
Alexey Milovidov
fc8db048e1 Merge with master 2021-05-02 21:26:46 +03:00
Alexey Milovidov
1fda866881 Merge branch 'master' into normalize-bigint 2021-05-02 21:24:45 +03:00
Vladimir Chebotarev
a6ab040b07 Added region parameter for S3 storage and disk. 2021-05-01 20:45:35 +03:00
kssenii
32b2917141 Update s3/* 2021-05-01 18:10:04 +03:00
Vladimir
3b7c68196b
Merge pull request #23429 from Jokser/disk-s3-restart-possibility 2021-05-01 15:28:14 +03:00
Maksim Kita
9c808c4944
Merge pull request #23786 from kitaisreal/add-examples-folder-filter-to-ya-make-in 
Add examples folder filter to ya.make.in
 2021-04-30 15:27:54 +03:00
alexey-milovidov
dd31634ba4
Merge pull request #23746 from oxidecomputer/master 
Adds support for building on Solaris-derived systems
 2021-04-30 13:15:52 +03:00
Maksim Kita
318c4bb80d Add examples folder filter to ya.make.in 2021-04-30 11:25:52 +03:00
Maksim Kita
0d0a14a925 Poco::Timespan reference fix 2021-04-29 19:11:20 +03:00
Benjamin Naecker
57fd59b73b Adds support for building on Solaris-derived systems 
This commit adds a number of changes to platform-detection and
compile-time directives required to support building ClickHouse on
Solaris-derived systems, most notably illumos.
 2021-04-28 16:32:41 -07:00
kssenii
c33f358a9a Better way to track progress, display progress for ch-client 2021-04-28 19:12:28 +00:00
Nikolai Kochetov
c508868570
Merge pull request #23082 from ClickHouse/explain-output 
JSON output for EXPLAIN
 2021-04-28 15:39:06 +03:00
alexey-milovidov
07bf1f203a
Merge pull request #23709 from ClickHouse/minor-changes 
Minor changes in code #14254
 2021-04-28 14:33:56 +03:00
Alexey Milovidov
f0927cbb43 Minor changes in code #14254 2021-04-28 06:33:28 +03:00
Alexey Milovidov
c1d5713110 Minor changes in code #14254 2021-04-28 06:31:15 +03:00
kssenii
563f8a97c6 Fix build, typos check 2021-04-27 17:01:41 +00:00
Pavel Kovalenko
5cedd90bed WriteBufferFromFileDecorator destructor fixes. 2021-04-27 13:19:22 +03:00
Pavel Kovalenko
63e5f5d3ab DiskS3 and WriteBufferFromFileDecorator small refactoring. 2021-04-27 11:37:59 +03:00
Nikita Mikhaylov
9f55424250 move to examples everywhere 2021-04-27 01:51:42 +03:00
kssenii
ffcfe5f9a1 Progress bar for file table engine 2021-04-26 21:02:52 +00:00
Vladimir
3c48b88929
Merge pull request #22208 from azat/s3-writer 2021-04-26 10:31:45 +03:00
Azat Khuzhin
6ebe4e7dbb Do not silently catch errors for writing to S3 2021-04-25 12:47:30 +03:00
Alexey Milovidov
649550c5ab Attempt to normalize big integers 2021-04-25 12:30:43 +03:00
Alexey Milovidov
8f01af62d9 Merge branch 'master' into normalize-bigint 2021-04-25 06:57:44 +03:00
Alexey Milovidov
6f05c447ad Remove old trash 2021-04-24 22:54:44 +03:00
Ivan Lezhankin
d9626e73c3 Revert "CC" 
This reverts commit ee194928d2.
 2021-04-22 16:55:18 +03:00
mergify[bot]
71bca99bbf
Merge branch 'master' into explain-output 2021-04-22 07:02:47 +00:00
Ivan Lezhankin
afd6639e46 Reset IO after each dump 2021-04-21 19:56:06 +03:00
Ivan Lezhankin
484528ba2c Fix problem with use-after-free inside shared_ptr 2021-04-21 16:19:28 +03:00
Ivan Lezhankin
ee194928d2 CC 2021-04-21 16:19:28 +03:00
Pavel Kovalenko
2ab8013455 DiskRestartProxy improvements and tests. 2021-04-21 12:53:46 +03:00
Pavel Kovalenko
016a9c674b DiskRestartProxy refactoring. 2021-04-20 21:58:34 +03:00
Pavel Kovalenko
98f8cbbdb2 DiskRestartProxy refactoring. 2021-04-20 21:58:34 +03:00
Ivan
10c5ba3022
Merge branch 'master' into async-insert 2021-04-20 17:58:15 +03:00
Nikita Mikhaylov
f55eacee7d
Merge pull request #22988 from excitoon-favorites/s3connectionresetretries 
Retries on HTTP connection drops during reads from S3
 2021-04-20 14:59:21 +03:00
alexey-milovidov
4cef8c68f7
Merge pull request #23258 from azat/wundef 
Add -Wundef for gcc builds
 2021-04-19 22:45:22 +03:00
Ivan Lezhankin
a36596e303 Add settings 2021-04-19 22:16:34 +03:00
Ivan Lezhankin
567fb44b07 Works with trivial inserts 2021-04-19 20:49:02 +03:00
Ivan Lezhankin
7a88ca31cc Merge branch 'master' into async-insert 2021-04-19 18:33:43 +03:00
Ivan Lezhankin
6ed9e34750 [WIP] 2021-04-19 17:51:26 +03:00
Nikolai Kochetov
8c2d58333a Merge branch 'master' into explain-output 2021-04-19 17:40:27 +03:00
Nikita Mikhaylov
adc103e338
Merge pull request #21852 from excitoon-favorites/s3stscredentials 
Added insecure IMDS credentials provider for S3
 2021-04-19 14:47:44 +03:00
Vladimir Chebotarev
9d4295f261 Removed infinite retries. 2021-04-19 11:02:36 +03:00
alexey-milovidov
1d5a4cfa32
Revert "[RFC] Fix memory tracking with min_bytes_to_use_mmap_io" 2021-04-19 01:30:53 +03:00
Azat Khuzhin
2561a67fd8 Replace !__clang__ with !defined(__clang) to fix gcc builds 
$ gg 'if !__clang__' | cut -d: -f1 | sort -u | xargs sed -i 's/#if !__clang__/#if !defined(__clang__)/g'
 2021-04-18 23:37:50 +03:00
Azat Khuzhin
6064f3ef1d Fix memory tracking with min_bytes_to_use_mmap_io 
With min_bytes_to_use_mmap_io=1 memory regions for mmap() will not be
accounted. But this creates issues, since if you will run simple
"SELECT * FROM big_enough_table" it will mmap lot's of files and the
process RSS will grow at some point, and before the kernel will
understand that it needs to unmap physical pages the clickhouse-server
will sync total_memory_tracker with RSS of the process and the
allocations will fail by per-server memory limits.

Also note, that this does not address all the issues with mmap()
regions.

v2: move track/untrack into the MMapReadBufferFromFileWithCache to avoid
data-race [1]

  [1]: https://clickhouse-test-reports.s3.yandex.net/23211/6acf6cb9b22cee7db8d1aa523a6208f63e792f7a/functional_stateful_tests_(thread).html#fail1
 2021-04-17 10:37:38 +03:00
Maksim Kita
3f3f928c1f
Merge pull request #21639 from changvvb/support-apple-m1 
Support Apple m1
 2021-04-17 02:44:15 +03:00
Maksim Kita
d381e59791
Merge pull request #23114 from kitaisreal/fix-arcadia-build-s3 
Fix arcadia build S3
 2021-04-16 23:35:10 +03:00
Ivan Lezhankin
7f43dddf0b CC 2021-04-16 20:49:38 +03:00
Nikita Mikhaylov
0ddb396338 add Y_IGNORE 2021-04-16 15:52:48 +03:00
Maksim Kita
94b228acc9
Update PocoHTTPClient.h 2021-04-15 21:51:15 +03:00
changvvb
4eee2d0977 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1 2021-04-15 22:54:26 +08:00
alexey-milovidov
69eac517b6
Merge pull request #23086 from azat/memory-blocking 
Block all memory tracking limits in dtors/SCOPE_EXIT_*SAFE/tryLogCurrentException
 2021-04-15 14:36:10 +03:00
Nikita Mikhaylov
a6b43f6765
Merge pull request #22594 from excitoon-favorites/betters3timeouts 
Consistent AWS timeouts
 2021-04-15 14:29:21 +03:00
Maksim Kita
eceed68d62 Fix arcadia build S3 2021-04-15 12:31:09 +03:00
Vladimir Chebotarev
6e379fe778 Final style fix. 2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
71621eb676 Style fix. 2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
f85e521e47 Style fix. 2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
342d907b65 Review fixes. 2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
116423b30c Some refactoring. 2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
c0ea3ce08a Removed STS client. 2021-04-15 10:01:43 +03:00
Vladimir Chebotarev
c61cfd0d97 Minor build fixes. 2021-04-15 10:01:16 +03:00
Vladimir Chebotarev
aae8a1f9d9 Moved AWSSTSAssumeRoleCredentialsProvider to the top of the provider chain. 2021-04-15 10:01:16 +03:00
Vladimir Chebotarev
3a467ffc50 Attempt to make credentials provider which uses internal credentials provider chain. 2021-04-15 10:01:13 +03:00
Vladimir Chebotarev
037a4de854 Added STS GetCallerIdentity credentials provider. 2021-04-15 10:00:18 +03:00
Vladimir Chebotarev
817c5cec25 Correct S3 read retries. 2021-04-15 09:47:22 +03:00
Vladimir Chebotarev
cf903d526c Better logging. 2021-04-15 09:47:22 +03:00
Vladimir Chebotarev
10bf56e540 Attempt to add retries to S3 reads. 2021-04-15 09:47:19 +03:00
Ivan Lezhankin
e9227da774 Fix typo 2021-04-15 09:32:45 +03:00
Azat Khuzhin
9b9e0a9bbc Block all memory tracking limits in destructors 2021-04-14 23:38:42 +03:00
Ivan Lezhankin
9e5d274467 Merge remote-tracking branch 'upstream/master' into async-insert 2021-04-14 20:16:05 +03:00
Nikolai Kochetov
9b86c19836 Use JSONBuilder for explain json result. 2021-04-14 17:07:56 +03:00
Nikita Mikhaylov
b3094412b1 better 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
4e4b383214 added hash of itiator address 2021-04-13 22:39:41 +03:00
Nikita Mikhaylov
2549468c14 better 2021-04-13 22:39:41 +03:00
Nikita Mikhaylov
0be3fa178b save 2021-04-13 22:39:41 +03:00
Nikita Mikhaylov
44ca65a9a4 save 2021-04-13 22:39:41 +03:00
alexey-milovidov
ee9aaab4bc
Merge pull request #22937 from Enmk/formatDateTime_toDateTime64_fixes 
Fixes: formatDateTime and toDateTime64
 2021-04-13 01:40:25 +03:00
alexey-milovidov
9e88f5fbd3
Update ReadHelpers.h 2021-04-13 01:39:15 +03:00
alexey-milovidov
a780e8e7e1
Update ReadHelpers.h 2021-04-13 01:38:59 +03:00
Vasily Nemkov
0f7c83b5ac Fixed parsing DateTime64 as unix timestamp with subsecond precision scaled to integer. 
e.g. toDateTime64('1111111111222', 3)
 2021-04-11 17:28:58 +03:00
kreuzerkrieg
228a0a0647 Fix an error handling in Poco HTTP Client for AWS. 2021-04-11 17:22:19 +03:00
Ivan
495c6e03aa
Replace all Context references with std::weak_ptr (#22297) 
* Replace all Context references with std::weak_ptr

* Fix shared context captured by value

* Fix build

* Fix Context with named sessions

* Fix copy context

* Fix gcc build

* Merge with master and fix build

* Fix gcc-9 build
 2021-04-11 02:33:54 +03:00
Vasily Nemkov
c882d290bd Fixed parsing string to DateTime64 for large values. 
Before fix:
SELECT toDateTime64('2201-01-12 12:12:12', 3, 'UTC')
1970-03-26 09:10:48.237

After fix:
SELECT toDateTime64('2201-01-12 12:12:12', 3, 'UTC')
2201-01-12 12:12:12.000
 2021-04-09 19:39:54 +03:00
changvvb
b070090ca7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1 2021-04-08 18:11:16 +08:00
Ivan
aa47eb7d5e
Fix checkpoint position after putting it on buffer end (#22518) 2021-04-07 16:22:38 +03:00
changvvb
1f8bd034a3 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1 2021-04-06 15:55:03 +08:00
changvvb
3a9d063f12 Fix unit test 2021-04-06 15:54:35 +08:00
Vladimir Chebotarev
0eb051961c Consistent AWS timeouts. 2021-04-04 14:06:10 +03:00
Ivan Lezhankin
d9d143675a Merge remote-tracking branch 'upstream/master' into issue-21907 2021-04-01 16:29:26 +03:00
Pavel Kruglov
5f3cb525ee Remove setting same timeouts in secure socket 2021-03-30 10:51:44 +03:00
Ivan Lezhankin
de05803177 Merge branch 'master' into async-insert 2021-03-29 20:59:02 +03:00
Ivan Lezhankin
ae741c7411 Do not limit HTTP chunk size 2021-03-29 20:49:28 +03:00
alexey-milovidov
7ab2890c4d
Merge pull request #22206 from ClickHouse/mmap-cache 
Add cache for mmap IO
 2021-03-29 05:17:55 +03:00
Maksim Kita
459d00f999 Fixed tests 2021-03-28 22:42:34 +03:00
Alexey Milovidov
2a8ac01cdb Rename as suggested by Kita 2021-03-28 22:24:28 +03:00
Alexey Milovidov
15b41fd110 Review fix 2021-03-28 22:15:13 +03:00
Maksim Kita
608d37deed CachedCompressedReadBuffer fix cache usage 2021-03-28 21:32:38 +03:00
Alexey Milovidov
50f712e198 Integrate mmap cache to the infrastructure 2021-03-28 04:10:30 +03:00
Alexey Milovidov
bdb69b8f08 Slightly better 2021-03-28 02:11:46 +03:00
Alexey Milovidov
cbf5913109 Review fixes 2021-03-28 01:57:59 +03:00
Alexey Milovidov
bcdf3dce36 Add cache for mmapped files 2021-03-27 02:22:51 +03:00
Alexey Milovidov
1d9e23f925 Fix error 2021-03-27 01:28:57 +03:00
Alexey Milovidov
7aac5e1849 Preparation 2021-03-26 23:51:46 +03:00
Alexey Milovidov
ff891c5002 Preparation 2021-03-26 23:46:04 +03:00