Alexey Milovidov
0a4e26e682
Experiment with sharing file descriptors
2021-07-24 01:50:14 +03:00
Vladimir Chebotarev
eb2defb098
Fixed wrong error message in S3Common
.
2021-07-23 15:36:19 +03:00
Nikita Mikhaylov
4d3f828beb
Merge pull request #26314 from kssenii/fix-hdfs-crash
...
Fix hdfs crash
2021-07-20 15:01:56 +03:00
Vitaly Baranov
1fc822b19d
Merge pull request #26465 from vitlibar/explicit-encryption-mode
...
Set encryption algorithm explicitly.
2021-07-19 09:38:02 +03:00
Kseniia Sumarokova
b0ddc4fb30
Merge pull request #26364 from kssenii/fixing-date32
...
Continuation of #25774
2021-07-18 21:44:45 +03:00
Vitaly Baranov
81ea8521b1
Set encryption algorithm explicitly.
2021-07-18 10:29:42 +03:00
kssenii
9cb10aae3c
Some fixes
2021-07-18 03:43:08 +00:00
alexey-milovidov
18f1197d9d
Update Progress.h
2021-07-17 23:15:16 +03:00
Alexey Milovidov
261a220227
Remove some code
2021-07-17 21:06:46 +03:00
Kseniia Sumarokova
e844cec16f
Merge branch 'master' into fix-hdfs-crash
2021-07-16 22:21:30 +03:00
Vitaly Baranov
958494b98e
Merge pull request #26377 from vitlibar/encrypted-disk-comments-and-improvements
...
Add comments for encrypted disks; some improvements in code.
2021-07-16 21:24:51 +03:00
Vitaly Baranov
9cc258327e
Add comments for encrypted disks; some improvements in code.
2021-07-16 12:04:25 +03:00
Kseniia Sumarokova
3303fe2fd3
Update ZstdInflatingReadBuffer.cpp
2021-07-15 17:58:58 +03:00
kssenii
3ba2d114d5
Revert "Merge pull request #26352 from ClickHouse/revert-25774-datatype-date32"
...
This reverts commit 94a210650f
, reversing
changes made to 0893b9ff8e
.
2021-07-15 11:41:52 +00:00
alexey-milovidov
9ba4064c86
Revert "Datatype Date32, support range 1925 to 2283"
2021-07-15 10:53:35 +03:00
Evgeniy Gatov
5a884da13c
METR-41529
2021-07-15 00:57:18 +03:00
kssenii
f9a2c39701
More approprate fix
2021-07-14 20:15:05 +03:00
kssenii
1993d8e0f4
Fix hdfs crash
2021-07-14 15:13:18 +03:00
Ivan Lezhankin
ab26aed6f9
Merge remote-tracking branch 'upstream/master' into async-insert
2021-07-13 13:54:09 +03:00
Vitaly Baranov
bc5080d701
Rename ReadEncryptedBuffer -> ReadBufferFromEncryptedFile,
...
WriteEncryptedBuffer -> WriteBufferFromEncryptedFile,
move file FileEncryption.h to the IO folder,
rename functions accroding to our code style,
add cpp files.
2021-07-13 11:31:03 +03:00
Vitaly Baranov
e2424db810
Fix ReadBufferFromS3
2021-07-13 11:30:29 +03:00
Vitaly Baranov
0f9ace257f
Fix conversion to/from big endian.
2021-07-13 11:30:08 +03:00
Vitaly Baranov
81f3876506
Fix finalize() and sync() in WriteEncryptedBuffer.
2021-07-13 11:30:00 +03:00
Vitaly Baranov
e086e5e384
Merge branch 'master' into alexelex-encryption-1
2021-07-13 11:28:41 +03:00
Vitaly Baranov
f4507dba7b
Fix typo
2021-07-13 00:07:33 +03:00
Kseniia Sumarokova
4a6b4d6c26
Merge pull request #25774 from liuneng1994/datatype-date32
...
Datatype Date32, support range 1925 to 2283
2021-07-12 20:33:39 +03:00
mergify[bot]
b7ae4e4ced
Merge branch 'master' into async-insert
2021-07-12 09:21:37 +00:00
Alexey Milovidov
822cc0fec3
Lowered amount of syscalls in AsynchronousMetrics
2021-07-12 04:12:34 +03:00
Alexey Milovidov
e0effad4d1
Fix tiny issue
2021-07-12 03:33:13 +03:00
Alexey Milovidov
7e932c2504
Fix Arcadia
2021-07-11 22:07:46 +03:00
Alexey Milovidov
d3cdae1211
Fix build
2021-07-11 22:07:17 +03:00
neng.liu
4669839fbb
add comment and update ya.make
2021-07-11 04:55:42 -07:00
Alexey Milovidov
2d02a3a45d
Fix errors
2021-07-11 05:43:54 +03:00
Alexey Milovidov
29624436ff
Return back O_DIRECT
2021-07-11 03:35:43 +03:00
Alexey Milovidov
30826c7d7d
Return O_DIRECT
2021-07-11 03:33:14 +03:00
Alexey Milovidov
81646f8389
Merge branch 'master' into ditch-aio
2021-07-11 03:06:45 +03:00
alexey-milovidov
9c2aad6c17
Merge pull request #25962 from ClickHouse/network-instrumentation
...
More instrumentation for network interaction: add counters for recv/send bytes; add gauges for recvs/sends.
2021-07-08 17:20:16 +03:00
neng.liu
e47aadfdef
Merge branch 'datatype-date32' of https://github.com/liuneng1994/ClickHouse into datatype-date32
2021-07-08 00:09:48 -07:00
neng.liu
100d30a5ba
fix pr comment
2021-07-08 00:06:36 -07:00
bharatnc
e6f627bbc6
LZ4 - decompress read initial implementation
2021-07-06 16:56:33 -07:00
Alexey Milovidov
2e41419e3b
Fix build
2021-07-06 03:34:27 +03:00
Alexey Milovidov
9875adc00b
Make it even worse
2021-07-06 01:09:39 +03:00
Alexey Milovidov
6d3d724cd4
Fix error
2021-07-05 23:20:25 +03:00
Alexey Milovidov
8fae774e85
Fix error
2021-07-05 23:18:13 +03:00
Alexey Milovidov
f29eb11e6c
Fix error
2021-07-05 23:17:53 +03:00
Alexey Milovidov
21fb6ddea5
Remove AIO for sequential reads
2021-07-05 23:02:24 +03:00
bharatnc
c79f885e41
LZ4 - compress write initial implementation
2021-07-04 23:19:27 -07:00
bharatnc
7620c28c14
LZ4 - fix cmake to include lz4
2021-07-04 23:19:27 -07:00
bharatnc
afad00b7d4
LZ4 - initial commit
2021-07-04 23:19:27 -07:00
NengLiu
8b88988618
Merge branch 'master' into datatype-date32
...
# Conflicts:
# src/DataStreams/PostgreSQLBlockInputStream.cpp
2021-07-05 10:18:38 +08:00
NengLiu
dc0c65ef4f
Merge remote-tracking branch 'origin/master' into datatype-date32
2021-07-05 10:15:08 +08:00
Alexey Milovidov
935e0327a5
Development
2021-07-04 06:03:49 +03:00
Alexey Milovidov
c762e2247d
More instrumentation for network interaction: add counters for recv/send bytes; add gauges for recvs/sends.
2021-07-04 00:00:50 +03:00
Maksim Kita
f16e8c3a4b
Merge pull request #25909 from ClickHouse/invalid-date
...
Correctly throw exception on attempt to parse invalid Date
2021-07-02 20:54:50 +03:00
Alexey Milovidov
b33d91412d
Correctly throw exception on invalid dates
2021-07-02 03:07:23 +03:00
Ivan Lezhankin
d7126682b0
Fix shared build
2021-06-29 15:05:46 +03:00
Ivan Lezhankin
1bb41593d1
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-28 22:55:56 +03:00
neng.liu
ec7604b013
add parquet test and fix add interval error when type is date32
2021-06-28 16:36:54 +08:00
Alexey Milovidov
b11f9223de
Merge branch 'master' into fix-receive-time-metric
2021-06-27 19:00:39 +03:00
Ivan
14e43cfafa
Add CI check for darwin-aarch64 ( #25560 )
...
* Add support for darwin-aarch64
* Fix PVS warnings
* Add build configuration
* Fix packager args
2021-06-25 18:21:56 +03:00
tavplubix
b1263c18ee
Fix pcg deserialization ( #24538 )
...
* fix pcg deserialization
* Update 01156_pcg_deserialization.sh
* Update 01156_pcg_deserialization.sh
* Update 01156_pcg_deserialization.sh
* fix another bug
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2021-06-24 10:40:00 +03:00
Alexey Milovidov
99e08b7406
Make network receive time metric to correctly include the time spent waiting for data from the client to INSERT #9958
2021-06-22 23:22:13 +03:00
Neng Liu
7ed1728a37
Merge branch 'master' into datatype-date32
...
# Conflicts:
# src/DataTypes/IDataType.h
# src/Functions/CustomWeekTransforms.h
2021-06-22 10:00:18 +08:00
kssenii
babb11a887
Some fixes
2021-06-19 19:18:13 +00:00
kssenii
7f356a5fbc
Fix readbuffer
2021-06-18 17:06:17 +00:00
Kseniia Sumarokova
5974f96f0c
Merge pull request #23656 from kssenii/progress-bar
...
Progress indication for File table engine in clickhouse-local and insert from file in clickhouse-client
2021-06-18 17:46:54 +03:00
kssenii
f33387837e
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-06-18 14:27:48 +00:00
Vladimir
4de0d1a593
Merge pull request #24885 from Jokser/disk-s3-read-error-fix
2021-06-18 13:38:59 +03:00
kssenii
bdc8fe1ca0
Merge branch 'master' of github.com:ClickHouse/ClickHouse into progress-bar
2021-06-18 09:33:29 +03:00
Latysheva Alexandra
48d3419160
Merge branch 'master' into alexelex-encryption-1
2021-06-18 11:28:08 +06:00
Alexey Milovidov
3e71181451
Whitespaces
2021-06-18 01:42:33 +03:00
Pavel Kovalenko
ce8e2f7f28
Avoid double initializing ReadBufferFromS3
2021-06-17 22:31:50 +03:00
Ivan Lezhankin
37365589ed
Merge branch 'master' into async-insert
2021-06-17 16:57:45 +03:00
Maksim Kita
ac2f9dd15a
Updated function dateName before merge
2021-06-16 21:19:05 +03:00
kssenii
cd885ee750
Fix build, ya make
2021-06-14 11:52:20 +00:00
kssenii
a1f11f5178
Fixes
2021-06-14 09:37:33 +00:00
kssenii
11faddb39f
Better
2021-06-13 22:30:37 +00:00
kssenii
2cfcc9980c
Better
2021-06-13 19:38:31 +00:00
kssenii
c80eac0dc3
First version
2021-06-13 19:36:56 +00:00
Pavel Kovalenko
47252e07f3
Remove trailing whitespaces
2021-06-12 15:57:14 +03:00
Pavel Kovalenko
0c82d45dea
Missed initialize in ReadBufferFromS3
2021-06-12 14:35:34 +03:00
mergify[bot]
9cfedd9c64
Merge branch 'master' into progress-bar
2021-06-12 01:15:23 +00:00
alexey-milovidov
05d1af153c
Merge branch 'master' into rename-const-context-ptr
2021-06-12 03:25:09 +03:00
alexey-milovidov
99f108d704
Merge pull request #25162 from kitaisreal/rewrite-function-to-subcolumn-visitor-add-into-ya-make
...
RewriteFunctionToSubcolumnVisitor add into ya.make
2021-06-12 02:58:53 +03:00
alexey-milovidov
971c79611b
Merge branch 'master' into patch-5
2021-06-12 02:36:13 +03:00
Ivan Lezhankin
2c7cb41a69
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-11 20:04:26 +03:00
mergify[bot]
60c094e785
Merge branch 'master' into disk-s3-read-error-fix
2021-06-11 15:00:43 +00:00
Maksim Kita
30c78c0a23
Fix arcadia
2021-06-11 14:26:33 +03:00
Vladimir
ba198c48ea
Merge pull request #24898 from excitoon/patch-8
2021-06-10 18:34:17 +03:00
Yuriy Chernyshov
c0cb5387f4
Use zstd/include in ya.make
2021-06-09 23:02:39 +03:00
mergify[bot]
3a47feedb0
Merge branch 'master' into progress-bar
2021-06-09 08:04:48 +00:00
mergify[bot]
bfbc787b08
Merge branch 'master' into disk-s3-read-error-fix
2021-06-09 06:56:19 +00:00
Neng Liu
88a0d0be62
add datetype32 part2
2021-06-08 20:31:41 +08:00
Ivan Lezhankin
973cea73b7
Merge branch 'master' into async-insert
2021-06-08 15:10:30 +03:00
Vladimir
fb987cf2c7
Fix space in ReadBufferFromFileDecorator.cpp
2021-06-08 15:00:28 +03:00
Latysheva Alexandra
1a2cbe9275
Merge branch 'master' into alexelex-encryption-1
2021-06-07 21:18:54 +06:00
neng.liu
120da1fd73
date32 initial code
2021-06-07 06:41:58 -07:00
Pavel Kovalenko
6ba40c475a
Code cleanup + comments.
2021-06-07 13:49:34 +03:00
Vladimir Chebotarev
ad816fde7b
Fix.
2021-06-07 09:56:15 +03:00
Vladimir Chebotarev
e21f76b137
Fixed unit tests accoording to the fix.
2021-06-07 09:54:05 +03:00
Vladimir Chebotarev
8c33e53e80
Review fixes.
2021-06-07 09:41:49 +03:00
mergify[bot]
d68d5e0ef1
Merge branch 'master' into rename-const-context-ptr
2021-06-04 14:41:41 +00:00
Nikita Mikhaylov
8076848d62
Update ReadBufferFromS3.cpp
2021-06-04 02:46:21 +03:00
mergify[bot]
9e2c454db2
Merge branch 'master' into merging-s3-backoff
2021-06-03 18:58:24 +00:00
Vladimir Chebotarev
1012a768b1
Allowed S3 key to be empty.
2021-06-03 09:09:09 +03:00
Vladimir Chebotarev
89664a3452
Fixed problems with double spaces in logs for S3Common
.
2021-06-03 09:05:24 +03:00
alesapin
4a1bf51ad1
Merge branch 'master' into limited_fetches
2021-06-02 23:01:47 +03:00
Ivan Lezhankin
791cbcf0b1
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-02 18:50:37 +03:00
Ivan Lezhankin
84c23dc060
Merge branch 'master' into async-insert
2021-06-02 18:06:21 +03:00
Pavel Kovalenko
2bd12a7612
Fix DiskS3 read error due to broken getPosition() method in ReadBufferFromS3.cpp
2021-06-02 18:03:25 +03:00
Nikita Mikhaylov
3f18bde246
Merge branch 'master' of github.com:ClickHouse/ClickHouse into merging-s3-backoff
2021-06-01 13:39:09 +00:00
Nikolai Kochetov
dbaa6ffc62
Rename ContextConstPtr to ContextPtr.
2021-06-01 15:20:52 +03:00
alesapin
c3321bef30
Merge branch 'master' into limited_fetches
2021-06-01 13:09:02 +03:00
kssenii
de277f8ac4
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar
2021-06-01 07:58:19 +00:00
tavplubix
e9ff0b6d70
Merge pull request #23657 from kssenii/poco-file-to-std-fs
...
Poco::File to std::filesystem
2021-05-31 23:17:02 +03:00
mergify[bot]
08eca33d81
Merge branch 'master' into progress-bar
2021-05-31 19:54:20 +00:00
Nikita Mikhaylov
0d8ede15a9
Merge branch 'master' into merging-s3-backoff
2021-05-31 21:07:00 +03:00
kssenii
db9f4762eb
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-29 01:15:43 +03:00
Alexander Kuzmenkov
92660aaf35
Merge remote-tracking branch 'origin/master' into HEAD
2021-05-28 19:45:53 +03:00
Alexander Kuzmenkov
3f57fc085b
remove mutable context references from functions interface
...
Also remove it from some visitors.
2021-05-28 19:45:37 +03:00
Kruglov Pavel
e584b028e7
Merge pull request #24475 from amosbird/readint
...
Pedantic readInt
2021-05-28 15:44:23 +03:00
Nikita Mikhaylov
c127c433c2
better
2021-05-27 23:43:00 +03:00
Amos Bird
6f12781bf1
Safer readInt
2021-05-27 22:56:51 +08:00
alesapin
2985def91d
Add tests
2021-05-27 15:54:47 +03:00
alesapin
42b2383e01
Basic throttler implementation
2021-05-26 23:37:44 +03:00
kssenii
3dee003f9b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-20 19:20:09 +03:00
Alexandra
11e40ad000
style fixes
2021-05-19 22:06:25 +00:00
mergify[bot]
e762039db7
Merge branch 'master' into merging-s3-backoff
2021-05-19 21:57:10 +00:00
Nikita Mikhaylov
f33b70c54a
better
2021-05-20 00:42:25 +03:00
Alexandra
f71e97511b
set use_ssl flag
2021-05-18 20:48:16 +00:00
Alexandra
b7a0f2db57
refactoring
2021-05-18 20:20:51 +00:00
Alexandra
af420569f8
remove debug information, fix seek issue and encryption issue
2021-05-17 16:15:21 +00:00
kssenii
9b8df78fdd
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-17 17:42:05 +03:00
Raúl Marín
439f161764
Fix GCC 11 build
...
../src/IO/HashingWriteBuffer.h:20:34: error: expected ‘)’ before ‘block_size_’
20 | IHashingBuffer<Buffer>(size_t block_size_ = DBMS_DEFAULT_HASHING_BLOCK_SIZE)
2021-05-17 14:04:08 +02:00
Vladimir Chebotarev
fa7308d2cb
Minor fix.
2021-05-17 10:38:34 +03:00
Vladimir Chebotarev
bdf03387ab
Better S3 read retries. Renamed s3_max_single_read_retries
-> s3_single_read_retry_attempts
, added sleeps before next attempts.
2021-05-17 10:38:32 +03:00
Alexandra
10a5b734ee
encryption initialization (without any flags like use_ssl for now)
2021-05-16 22:35:20 +00:00
kssenii
e9c3bc1836
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar
2021-05-16 20:48:35 +00:00
Raúl Marín
e358a0963c
Clearer code based on review
2021-05-15 03:03:38 +02:00
Raúl Marín
0ddfc3df84
TestReadAfterAIO: Use the local path instead of /tmp for temporal files
...
/tmp might be mounted as tmpfs (default in ArchLinux) which is incompatible with
O_DIRECT (https://lore.kernel.org/lkml/459D290B.1040703@tmr.com/t/ ), making the
test fail:
```
[ RUN ] ReadBufferAIOTest.TestReadAfterAIO
unknown file: Failure
C++ exception with description "Cannot open file /tmp/filei6ZsCa/foo, errno: 22, strerror: Invalid argument" thrown in the test body.
[ FAILED ] ReadBufferAIOTest.TestReadAfterAIO (0 ms)
```
Instead create the tmp folder in the local path and delete it at the end
2021-05-15 02:13:51 +02:00
Alexandra
67f9b86515
implement read and write buffers (with debug=warning logs)
2021-05-14 21:54:03 +00:00
kssenii
c25be65ebf
Refactor progress bar, adjust progress indication for reading from file
2021-05-14 06:16:31 +00:00
kssenii
f33a517d33
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-14 02:58:26 +03:00
kssenii
e82d717233
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar
2021-05-13 10:20:02 +00:00
Vladimir Chebotarev
a3f7992442
Fixed typo.
2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
b738e25f5b
Better handling of HTTP errors in PocoHTTPClient
.
2021-05-13 08:46:16 +03:00
kssenii
393b026f2e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-11 16:49:23 +03:00
Alexey Milovidov
b2ca5cd98b
Merge branch 'master' into normalize-bigint
2021-05-11 02:05:40 +03:00
Alexey Milovidov
b9b3e4b60a
Fix style and wording in #23946
2021-05-10 23:32:30 +03:00
Maksim Kita
4a22924ed5
Merge pull request #23946 from FArthur-cmd/8912-fix-dict-http-source
...
Add support for HTTP compression in dictionary source.
2021-05-10 22:52:07 +03:00
Alexey Milovidov
94592f0d54
Whitespaces
2021-05-10 21:16:06 +03:00
alexey-milovidov
0400070924
Merge pull request #23822 from excitoon-favorites/equalsignins3path
...
Better handling of URI's in `PocoHTTPClient`
2021-05-10 20:25:18 +03:00
alexey-milovidov
5397b1d0c3
Update PocoHTTPClient.cpp
2021-05-10 20:22:09 +03:00
alexey-milovidov
5685738d08
Update PocoHTTPClient.cpp
2021-05-10 20:20:05 +03:00
Vladimir
d02d14fa00
Merge pull request #23846 from excitoon-favorites/s3regions
2021-05-10 12:14:08 +03:00
FArthur-cmd
6363a5dd96
use path to define compression type
2021-05-09 21:58:08 +03:00
FArthur-cmd
bd519075b7
adding checking url in HTTPSource
2021-05-09 14:27:11 +03:00
Alexey Milovidov
3025f9e141
More fixes for PVS-Studio
2021-05-08 19:12:49 +03:00
Alexey Milovidov
bdc372cb9a
Fix bad code (found by PVS-Studio)
2021-05-08 19:11:40 +03:00
Alexey Milovidov
45dea86395
More fixes for PVS-Studio
2021-05-08 18:35:09 +03:00
Alexey Milovidov
aa727e941d
Fix bad code (found by PVS-Studio)
2021-05-08 17:21:36 +03:00
Alexey Milovidov
e9c7aa5ab5
Remove some code
2021-05-08 17:12:26 +03:00
FArthur-cmd
acb09f01d4
fixing details in code style and moving tests
2021-05-08 12:46:50 +03:00
FArthur-cmd
13a6e03849
solving style-check problems
2021-05-08 10:15:14 +03:00
FArthur-cmd
4ea9851e99
fixing dictionary http source by adding wrapper
2021-05-08 02:20:30 +03:00
Alexey Milovidov
18ba924c80
Fix style
2021-05-08 01:11:09 +03:00
Alexey Milovidov
7dfb7664f7
Messing with the code (removed trash)
2021-05-07 21:16:27 +03:00
Alexey Milovidov
160aaec112
Fix error
2021-05-07 04:19:18 +03:00
Vladimir Chebotarev
524113f497
Fixed bug with S3 URLs containing +
symbol, data with such keys could not be read previously.
2021-05-06 11:28:55 +03:00
Alexey Milovidov
fd4f214e43
Fix error
2021-05-05 23:04:15 +03:00
kssenii
2dabdd0f73
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-05 18:42:40 +03:00
Alexey Milovidov
35aba776e5
Merge branch 'master' into normalize-bigint
2021-05-05 15:01:23 +03:00
kssenii
5ef3ee50fe
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar
2021-05-05 09:26:12 +00:00
Alexey Milovidov
bf463ff0d9
Remove trash
2021-05-04 23:05:51 +03:00
Alexey Milovidov
59ab0db672
Fix build
2021-05-04 20:30:32 +03:00
Alexey Milovidov
962a7113f6
Remove code that I do not like (crazy templates)
2021-05-04 20:26:09 +03:00
Alexey Milovidov
ebe0d849b5
Fix error in serialization of UInt256
2021-05-04 18:18:51 +03:00
vdimir
657eda9288
Add Read/WriteBufferFromFileDecorator.cpp to ya.make
2021-05-04 16:07:56 +03:00
Alexey Milovidov
02ce9cc725
Untangle UUID
2021-05-04 01:46:51 +03:00
Alexey Milovidov
b0bd9fd3b0
Add UInt128 where it is needed
2021-05-03 19:12:28 +03:00
Alexey Milovidov
39bcf9d860
Fix style
2021-05-03 01:44:34 +03:00
Alexey Milovidov
fc8db048e1
Merge with master
2021-05-02 21:26:46 +03:00
Alexey Milovidov
1fda866881
Merge branch 'master' into normalize-bigint
2021-05-02 21:24:45 +03:00
Vladimir Chebotarev
a6ab040b07
Added region
parameter for S3 storage and disk.
2021-05-01 20:45:35 +03:00
kssenii
32b2917141
Update s3/*
2021-05-01 18:10:04 +03:00
Vladimir
3b7c68196b
Merge pull request #23429 from Jokser/disk-s3-restart-possibility
2021-05-01 15:28:14 +03:00
Maksim Kita
9c808c4944
Merge pull request #23786 from kitaisreal/add-examples-folder-filter-to-ya-make-in
...
Add examples folder filter to ya.make.in
2021-04-30 15:27:54 +03:00
alexey-milovidov
dd31634ba4
Merge pull request #23746 from oxidecomputer/master
...
Adds support for building on Solaris-derived systems
2021-04-30 13:15:52 +03:00
Maksim Kita
318c4bb80d
Add examples folder filter to ya.make.in
2021-04-30 11:25:52 +03:00
Maksim Kita
0d0a14a925
Poco::Timespan reference fix
2021-04-29 19:11:20 +03:00
Benjamin Naecker
57fd59b73b
Adds support for building on Solaris-derived systems
...
This commit adds a number of changes to platform-detection and
compile-time directives required to support building ClickHouse on
Solaris-derived systems, most notably illumos.
2021-04-28 16:32:41 -07:00
kssenii
c33f358a9a
Better way to track progress, display progress for ch-client
2021-04-28 19:12:28 +00:00
Nikolai Kochetov
c508868570
Merge pull request #23082 from ClickHouse/explain-output
...
JSON output for EXPLAIN
2021-04-28 15:39:06 +03:00
alexey-milovidov
07bf1f203a
Merge pull request #23709 from ClickHouse/minor-changes
...
Minor changes in code #14254
2021-04-28 14:33:56 +03:00
Alexey Milovidov
f0927cbb43
Minor changes in code #14254
2021-04-28 06:33:28 +03:00
Alexey Milovidov
c1d5713110
Minor changes in code #14254
2021-04-28 06:31:15 +03:00
kssenii
563f8a97c6
Fix build, typos check
2021-04-27 17:01:41 +00:00
Pavel Kovalenko
5cedd90bed
WriteBufferFromFileDecorator destructor fixes.
2021-04-27 13:19:22 +03:00
Pavel Kovalenko
63e5f5d3ab
DiskS3 and WriteBufferFromFileDecorator small refactoring.
2021-04-27 11:37:59 +03:00
Nikita Mikhaylov
9f55424250
move to examples everywhere
2021-04-27 01:51:42 +03:00
kssenii
ffcfe5f9a1
Progress bar for file table engine
2021-04-26 21:02:52 +00:00
Vladimir
3c48b88929
Merge pull request #22208 from azat/s3-writer
2021-04-26 10:31:45 +03:00
Azat Khuzhin
6ebe4e7dbb
Do not silently catch errors for writing to S3
2021-04-25 12:47:30 +03:00
Alexey Milovidov
649550c5ab
Attempt to normalize big integers
2021-04-25 12:30:43 +03:00
Alexey Milovidov
8f01af62d9
Merge branch 'master' into normalize-bigint
2021-04-25 06:57:44 +03:00
Alexey Milovidov
6f05c447ad
Remove old trash
2021-04-24 22:54:44 +03:00
Ivan Lezhankin
d9626e73c3
Revert "CC"
...
This reverts commit ee194928d2
.
2021-04-22 16:55:18 +03:00
mergify[bot]
71bca99bbf
Merge branch 'master' into explain-output
2021-04-22 07:02:47 +00:00
Ivan Lezhankin
afd6639e46
Reset IO after each dump
2021-04-21 19:56:06 +03:00
Ivan Lezhankin
484528ba2c
Fix problem with use-after-free inside shared_ptr
2021-04-21 16:19:28 +03:00
Ivan Lezhankin
ee194928d2
CC
2021-04-21 16:19:28 +03:00
Pavel Kovalenko
2ab8013455
DiskRestartProxy improvements and tests.
2021-04-21 12:53:46 +03:00
Pavel Kovalenko
016a9c674b
DiskRestartProxy refactoring.
2021-04-20 21:58:34 +03:00
Pavel Kovalenko
98f8cbbdb2
DiskRestartProxy refactoring.
2021-04-20 21:58:34 +03:00
Ivan
10c5ba3022
Merge branch 'master' into async-insert
2021-04-20 17:58:15 +03:00
Nikita Mikhaylov
f55eacee7d
Merge pull request #22988 from excitoon-favorites/s3connectionresetretries
...
Retries on HTTP connection drops during reads from S3
2021-04-20 14:59:21 +03:00
alexey-milovidov
4cef8c68f7
Merge pull request #23258 from azat/wundef
...
Add -Wundef for gcc builds
2021-04-19 22:45:22 +03:00
Ivan Lezhankin
a36596e303
Add settings
2021-04-19 22:16:34 +03:00
Ivan Lezhankin
567fb44b07
Works with trivial inserts
2021-04-19 20:49:02 +03:00
Ivan Lezhankin
7a88ca31cc
Merge branch 'master' into async-insert
2021-04-19 18:33:43 +03:00
Ivan Lezhankin
6ed9e34750
[WIP]
2021-04-19 17:51:26 +03:00
Nikolai Kochetov
8c2d58333a
Merge branch 'master' into explain-output
2021-04-19 17:40:27 +03:00
Nikita Mikhaylov
adc103e338
Merge pull request #21852 from excitoon-favorites/s3stscredentials
...
Added insecure IMDS credentials provider for S3
2021-04-19 14:47:44 +03:00
Vladimir Chebotarev
9d4295f261
Removed infinite retries.
2021-04-19 11:02:36 +03:00
alexey-milovidov
1d5a4cfa32
Revert "[RFC] Fix memory tracking with min_bytes_to_use_mmap_io"
2021-04-19 01:30:53 +03:00
Azat Khuzhin
2561a67fd8
Replace !__clang__ with !defined(__clang) to fix gcc builds
...
$ gg 'if !__clang__' | cut -d: -f1 | sort -u | xargs sed -i 's/#if !__clang__/#if !defined(__clang__)/g'
2021-04-18 23:37:50 +03:00
Azat Khuzhin
6064f3ef1d
Fix memory tracking with min_bytes_to_use_mmap_io
...
With min_bytes_to_use_mmap_io=1 memory regions for mmap() will not be
accounted. But this creates issues, since if you will run simple
"SELECT * FROM big_enough_table" it will mmap lot's of files and the
process RSS will grow at some point, and before the kernel will
understand that it needs to unmap physical pages the clickhouse-server
will sync total_memory_tracker with RSS of the process and the
allocations will fail by per-server memory limits.
Also note, that this does not address all the issues with mmap()
regions.
v2: move track/untrack into the MMapReadBufferFromFileWithCache to avoid
data-race [1]
[1]: https://clickhouse-test-reports.s3.yandex.net/23211/6acf6cb9b22cee7db8d1aa523a6208f63e792f7a/functional_stateful_tests_(thread).html#fail1
2021-04-17 10:37:38 +03:00
Maksim Kita
3f3f928c1f
Merge pull request #21639 from changvvb/support-apple-m1
...
Support Apple m1
2021-04-17 02:44:15 +03:00
Maksim Kita
d381e59791
Merge pull request #23114 from kitaisreal/fix-arcadia-build-s3
...
Fix arcadia build S3
2021-04-16 23:35:10 +03:00
Ivan Lezhankin
7f43dddf0b
CC
2021-04-16 20:49:38 +03:00
Nikita Mikhaylov
0ddb396338
add Y_IGNORE
2021-04-16 15:52:48 +03:00
Maksim Kita
94b228acc9
Update PocoHTTPClient.h
2021-04-15 21:51:15 +03:00
changvvb
4eee2d0977
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1
2021-04-15 22:54:26 +08:00
alexey-milovidov
69eac517b6
Merge pull request #23086 from azat/memory-blocking
...
Block all memory tracking limits in dtors/SCOPE_EXIT_*SAFE/tryLogCurrentException
2021-04-15 14:36:10 +03:00
Nikita Mikhaylov
a6b43f6765
Merge pull request #22594 from excitoon-favorites/betters3timeouts
...
Consistent AWS timeouts
2021-04-15 14:29:21 +03:00
Maksim Kita
eceed68d62
Fix arcadia build S3
2021-04-15 12:31:09 +03:00
Vladimir Chebotarev
6e379fe778
Final style fix.
2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
71621eb676
Style fix.
2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
f85e521e47
Style fix.
2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
342d907b65
Review fixes.
2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
116423b30c
Some refactoring.
2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
c0ea3ce08a
Removed STS client.
2021-04-15 10:01:43 +03:00
Vladimir Chebotarev
c61cfd0d97
Minor build fixes.
2021-04-15 10:01:16 +03:00
Vladimir Chebotarev
aae8a1f9d9
Moved AWSSTSAssumeRoleCredentialsProvider
to the top of the provider chain.
2021-04-15 10:01:16 +03:00
Vladimir Chebotarev
3a467ffc50
Attempt to make credentials provider which uses internal credentials provider chain.
2021-04-15 10:01:13 +03:00
Vladimir Chebotarev
037a4de854
Added STS GetCallerIdentity credentials provider.
2021-04-15 10:00:18 +03:00
Vladimir Chebotarev
817c5cec25
Correct S3 read retries.
2021-04-15 09:47:22 +03:00
Vladimir Chebotarev
cf903d526c
Better logging.
2021-04-15 09:47:22 +03:00
Vladimir Chebotarev
10bf56e540
Attempt to add retries to S3 reads.
2021-04-15 09:47:19 +03:00
Ivan Lezhankin
e9227da774
Fix typo
2021-04-15 09:32:45 +03:00
Azat Khuzhin
9b9e0a9bbc
Block all memory tracking limits in destructors
2021-04-14 23:38:42 +03:00
Ivan Lezhankin
9e5d274467
Merge remote-tracking branch 'upstream/master' into async-insert
2021-04-14 20:16:05 +03:00
Nikolai Kochetov
9b86c19836
Use JSONBuilder for explain json result.
2021-04-14 17:07:56 +03:00
Nikita Mikhaylov
b3094412b1
better
2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
4e4b383214
added hash of itiator address
2021-04-13 22:39:41 +03:00
Nikita Mikhaylov
2549468c14
better
2021-04-13 22:39:41 +03:00
Nikita Mikhaylov
0be3fa178b
save
2021-04-13 22:39:41 +03:00
Nikita Mikhaylov
44ca65a9a4
save
2021-04-13 22:39:41 +03:00
alexey-milovidov
ee9aaab4bc
Merge pull request #22937 from Enmk/formatDateTime_toDateTime64_fixes
...
Fixes: formatDateTime and toDateTime64
2021-04-13 01:40:25 +03:00
alexey-milovidov
9e88f5fbd3
Update ReadHelpers.h
2021-04-13 01:39:15 +03:00
alexey-milovidov
a780e8e7e1
Update ReadHelpers.h
2021-04-13 01:38:59 +03:00
Vasily Nemkov
0f7c83b5ac
Fixed parsing DateTime64 as unix timestamp with subsecond precision scaled to integer.
...
e.g. toDateTime64('1111111111222', 3)
2021-04-11 17:28:58 +03:00
kreuzerkrieg
228a0a0647
Fix an error handling in Poco HTTP Client for AWS.
2021-04-11 17:22:19 +03:00
Ivan
495c6e03aa
Replace all Context references with std::weak_ptr ( #22297 )
...
* Replace all Context references with std::weak_ptr
* Fix shared context captured by value
* Fix build
* Fix Context with named sessions
* Fix copy context
* Fix gcc build
* Merge with master and fix build
* Fix gcc-9 build
2021-04-11 02:33:54 +03:00
Vasily Nemkov
c882d290bd
Fixed parsing string to DateTime64 for large values.
...
Before fix:
SELECT toDateTime64('2201-01-12 12:12:12', 3, 'UTC')
1970-03-26 09:10:48.237
After fix:
SELECT toDateTime64('2201-01-12 12:12:12', 3, 'UTC')
2201-01-12 12:12:12.000
2021-04-09 19:39:54 +03:00
changvvb
b070090ca7
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1
2021-04-08 18:11:16 +08:00
Ivan
aa47eb7d5e
Fix checkpoint position after putting it on buffer end ( #22518 )
2021-04-07 16:22:38 +03:00
changvvb
1f8bd034a3
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1
2021-04-06 15:55:03 +08:00
changvvb
3a9d063f12
Fix unit test
2021-04-06 15:54:35 +08:00
Vladimir Chebotarev
0eb051961c
Consistent AWS timeouts.
2021-04-04 14:06:10 +03:00
Ivan Lezhankin
d9d143675a
Merge remote-tracking branch 'upstream/master' into issue-21907
2021-04-01 16:29:26 +03:00
Pavel Kruglov
5f3cb525ee
Remove setting same timeouts in secure socket
2021-03-30 10:51:44 +03:00
Ivan Lezhankin
de05803177
Merge branch 'master' into async-insert
2021-03-29 20:59:02 +03:00
Ivan Lezhankin
ae741c7411
Do not limit HTTP chunk size
2021-03-29 20:49:28 +03:00
alexey-milovidov
7ab2890c4d
Merge pull request #22206 from ClickHouse/mmap-cache
...
Add cache for mmap IO
2021-03-29 05:17:55 +03:00
Maksim Kita
459d00f999
Fixed tests
2021-03-28 22:42:34 +03:00
Alexey Milovidov
2a8ac01cdb
Rename as suggested by Kita
2021-03-28 22:24:28 +03:00
Alexey Milovidov
15b41fd110
Review fix
2021-03-28 22:15:13 +03:00
Maksim Kita
608d37deed
CachedCompressedReadBuffer fix cache usage
2021-03-28 21:32:38 +03:00
Alexey Milovidov
50f712e198
Integrate mmap cache to the infrastructure
2021-03-28 04:10:30 +03:00
Alexey Milovidov
bdb69b8f08
Slightly better
2021-03-28 02:11:46 +03:00
Alexey Milovidov
cbf5913109
Review fixes
2021-03-28 01:57:59 +03:00
Alexey Milovidov
bcdf3dce36
Add cache for mmapped files
2021-03-27 02:22:51 +03:00
Alexey Milovidov
1d9e23f925
Fix error
2021-03-27 01:28:57 +03:00
Alexey Milovidov
7aac5e1849
Preparation
2021-03-26 23:51:46 +03:00
Alexey Milovidov
ff891c5002
Preparation
2021-03-26 23:46:04 +03:00
alexey-milovidov
607d36dd9d
Merge pull request #22147 from azat/writers-fixes
...
Use finalize() over next() for nested writers
2021-03-26 22:05:18 +03:00
alexey-milovidov
ac53d30e53
Merge pull request #22146 from azat/writers-uncaught-exceptions
...
Fix uncaught exception in InterserverIOHTTPHandler
2021-03-26 17:23:09 +03:00
tavplubix
d9ec4090d2
Merge pull request #21936 from abyss7/html-form-fix
...
Fix issues with HTMLForm::MultipartReadBuffer and PeekableReadBuffer
2021-03-26 15:35:34 +03:00
tavplubix
fa930d49c4
Update gtest_peekable_read_buffer.cpp
2021-03-26 10:29:58 +03:00
Azat Khuzhin
f1907acbcd
Use finalize() over next() for nested writers
...
Refs: https://github.com/ClickHouse/ClickHouse/pull/21325#discussion_r585348309
2021-03-25 23:42:58 +03:00
Azat Khuzhin
50003e496a
Use existing logger for logging from WriteBufferFromS3 dtor
2021-03-25 23:41:03 +03:00
Kruglov Pavel
66b8431e71
Merge pull request #21429 from Avogar/secure-socket
...
Fix receive and send timeouts and non-blocking read in secure socket
2021-03-25 17:30:17 +03:00
Ivan Lezhankin
be76defcfa
Remove check for absent checkpoint on rollback
2021-03-23 14:59:36 +03:00
Pavel Kovalenko
d55af1fa45
Merge branch 'write-buffer-s3-better-error-handling' of github.com:Jokser/ClickHouse into write-buffer-s3-better-error-handling
2021-03-23 13:02:57 +03:00
Pavel Kovalenko
393631a753
Merge remote-tracking branch 'origin/master' into write-buffer-s3-better-error-handling
...
# Conflicts:
# src/IO/WriteBufferFromS3.cpp
2021-03-23 13:00:09 +03:00
Kruglov Pavel
a215bf7812
Restart CI
2021-03-22 22:12:42 +03:00
Ivan Lezhankin
6d4d669f96
Move checkpoint to sub-buffer only from internal memory
2021-03-22 20:20:42 +03:00
feng lv
d40ffa96e2
Fix misleading log in WriteBufferFromS3
2021-03-22 05:49:41 +00:00
Ivan Lezhankin
4f1fad97ab
Merge remote-tracking branch 'upstream/master' into async-insert
2021-03-19 23:41:01 +03:00
Ivan Lezhankin
957c053f7e
Fix segfault
2021-03-19 23:29:01 +03:00
Kruglov Pavel
0cb88fb20e
Restart tests
2021-03-19 15:00:21 +03:00
Pavel Kruglov
d380454044
Change read_data_timeout from sec to ms, add profile event for hedged requests and better process receiving packets
2021-03-18 20:16:17 +03:00
Pavel Kovalenko
71b36a7029
Better error handling and logging in WriteBufferFromS3
2021-03-17 17:20:55 +03:00
Ivan Lezhankin
346818266a
[WIP]
2021-03-17 17:11:47 +03:00
alexey-milovidov
d02726bcac
Merge pull request #9404 from Enmk/DateTime64_extended_range
...
Date time64 extended range
2021-03-17 11:06:03 +03:00
Nikita Mikhaylov
1d15ed34ce
Merge pull request #21737 from excitoon-favorites/reverts3connectionpools
...
Reverted S3 connection pools
2021-03-16 14:40:54 +03:00
Nikita Mikhaylov
7d7a2bc724
Merge pull request #21630 from nikitamikhaylov/pf-local
...
Parallel formatting for clickhouse-local
2021-03-16 14:37:40 +03:00
alexey-milovidov
f52e29cfec
Merge pull request #21624 from vdimir/storage-s3-fail
...
Try to fix test_storage_s3: crash in WriteBufferFromS3
2021-03-16 13:38:48 +03:00
Alexey Milovidov
671395e8c8
Most likely improve performance
2021-03-15 22:23:27 +03:00
Vladimir Chebotarev
35e0d0f672
Reverted S3 connection pools.
2021-03-15 14:17:16 +03:00
alexey-milovidov
53e21443eb
Merge branch 'master' into DateTime64_extended_range
2021-03-14 12:27:17 +03:00
Nikita Mikhaylov
38e1cb41cc
done
2021-03-11 17:04:59 +03:00
vdimir
1194d50e48
Try to fix test_storage_s3: crash in WriteBufferFromS3
2021-03-11 15:21:13 +03:00
Nikita Mikhailov
a6c8d50cc2
review fix
2021-03-11 15:08:19 +03:00
Nikita Mikhailov
6a51ad425e
add tests + improvements
2021-03-11 15:08:18 +03:00
Nikita Mikhailov
adfb2885c9
better
2021-03-11 15:08:18 +03:00
Nikita Mikhailov
41d006d493
try fix stress
2021-03-11 15:08:17 +03:00
Pavel Kruglov
c113af39f4
Merge branch 'master' of github.com:ClickHouse/ClickHouse into secure-socket
2021-03-05 16:18:45 +03:00
Alexey Milovidov
3e77c9b1c5
Merge branch 'master' into DateTime64_extended_range
2021-03-05 03:07:19 +03:00
Kseniia Sumarokova
08cb02c872
Merge pull request #21416 from excitoon-favorites/caseinsensitivecompression
...
Case-insensitive compression methods for table functions
2021-03-04 17:37:28 +03:00
Ivan Lezhankin
74214865eb
Merge remote-tracking branch 'upstream/master' into async-insert
2021-03-04 14:14:28 +03:00
Ivan Lezhankin
b726845be2
[WIP]
2021-03-04 14:10:21 +03:00
Alexey Milovidov
1096fc328a
Make some tests automated
2021-03-04 02:11:27 +03:00
Alexey Milovidov
4e8239e098
Merge branch 'master' into DateTime64_extended_range
2021-03-03 23:43:20 +03:00
Pavel Kruglov
1c7f16e0ff
Add test and move TimeoutSetter in IO/
2021-03-03 20:47:27 +03:00
Pavel Kruglov
eef7d8c0bc
Fix blocking mode and timeouts in SecureStreamSocket
2021-03-03 16:10:15 +03:00
Vladimir Chebotarev
4022418ff3
Case-insensitive compression methods.
2021-03-03 14:51:09 +03:00
Pavel Kruglov
153bfbfc28
Merge branch 'master' of github.com:ClickHouse/ClickHouse into hedged-requests
2021-03-02 11:59:32 +03:00
alexey-milovidov
81be2d1ed9
Merge pull request #21305 from azat/terminate-nested-writers
...
Fix abnormal server termination for nested writers
2021-02-28 21:54:13 +03:00
Azat Khuzhin
eb0387c5a9
Fix abnormal server termination for nested writers
...
Writers with nested writer can call next() from the dtor for nested
writer and this will cause exception again, so the buffer position
should be updated on exceptions.
Found by stress test (thread) here [1] and here [2]:
2021.02.27 19:27:53.498977 [ 302 ] {} <Fatal> BaseDaemon: (version 21.3.1.6130, build id: 2DAEC5DEBF03C5A1C3BF66B7779C886F16239345) (from thread 1614) Terminate called for uncaught exception:
Code: 24, e.displayText() = DB::Exception: Cannot write to ostream at offset 2097498, Stack trace (when copying this message, always include the lines below):
0. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/exception:0: Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0x15bef2ab in /usr/bin/clickhouse
1. ./obj-x86_64-linux-gnu/../src/Common/Exception.cpp:56: DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, bool) @ 0x8aea92e in /usr/bin/clickhouse
2. ./obj-x86_64-linux-gnu/../src/IO/WriteBufferFromOStream.cpp:0: DB::WriteBufferFromOStream::nextImpl() @ 0x8bbbc45 in /usr/bin/clickhouse
3. ./obj-x86_64-linux-gnu/../src/IO/BufferBase.h:39: DB::WriteBufferFromOStream::~WriteBufferFromOStream() @ 0x8bbc077 in /usr/bin/clickhouse
4. ./obj-x86_64-linux-gnu/../src/IO/WriteBufferFromOStream.cpp:44: DB::WriteBufferFromOStream::~WriteBufferFromOStream() @ 0x8bbc18a in /usr/bin/clickhouse
5. ./obj-x86_64-linux-gnu/../src/IO/BufferWithOwnMemory.h:137: DB::ZstdDeflatingWriteBuffer::~ZstdDeflatingWriteBuffer() @ 0x118bdc29 in /usr/bin/clickhouse
6. ./obj-x86_64-linux-gnu/../src/IO/ZstdDeflatingWriteBuffer.cpp:32: DB::ZstdDeflatingWriteBuffer::~ZstdDeflatingWriteBuffer() @ 0x118be3ea in /usr/bin/clickhouse
7. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:0: DB::WriteBufferFromHTTPServerResponse::finalize() @ 0x12f1dceb in /usr/bin/clickhouse
8. ./obj-x86_64-linux-gnu/../src/Server/HTTPHandler.cpp:703: DB::HTTPHandler::trySendExceptionToClient(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x12e9fecc in /usr/bin/clickhouse
9. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/string:1444: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x12ea0d60 in /usr/bin/clickhouse
10. ./obj-x86_64-linux-gnu/../src/Server/HTTP/HTTPServerConnection.cpp:0: DB::HTTPServerConnection::run() @ 0x12f16db1 in /usr/bin/clickhouse
11. ./obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x15b184f3 in /usr/bin/clickhouse
12. ./obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:0: Poco::Net::TCPServerDispatcher::run() @ 0x15b18c1f in /usr/bin/clickhouse
13. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/include/Poco/ScopedLock.h:36: Poco::PooledThread::run() @ 0x15c7fdb2 in /usr/bin/clickhouse
14. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread.cpp:56: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x15c7e350 in /usr/bin/clickhouse
15. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/include/Poco/SharedPtr.h:277: Poco::ThreadImpl::runnableEntry(void*) @ 0x15c7cb58 in /usr/bin/clickhouse
16. __tsan_thread_start_func @ 0x8a04ced in /usr/bin/clickhouse
17. start_thread @ 0x9609 in /usr/lib/x86_64-linux-gnu/libpthread-2.31.so
18. __clone @ 0x122293 in /usr/lib/x86_64-linux-gnu/libc-2.31.so
(version 21.3.1.6130)
[1]: https://clickhouse-test-reports.s3.yandex.net/21279/4f61ef3099f42f17b496a0b0424773978d9a32dc/stress_test_(thread).html#fail1
[2]: https://clickhouse-test-reports.s3.yandex.net/21292/ae9fea1d0af118a8f87b224d194d61da1567188b/stress_test_(thread).html#fail1
v2: https://clickhouse-test-reports.s3.yandex.net/21305/e969daa6e86c5e09cfef08cfde19712982b64e59/stress_test_(thread).html#fail1
2021-02-28 15:13:42 +03:00
Azat Khuzhin
568a49dad5
Remove unused AsynchronousWriteBuffer
2021-02-28 11:19:56 +03:00
Azat Khuzhin
8b58dba094
Drop unused HexWriteBuffer
2021-02-28 10:52:09 +03:00
Pavel Kruglov
197058dc12
Merge branch 'master' of github.com:ClickHouse/ClickHouse into hedged-requests
2021-02-27 00:36:33 +03:00
kssenii
991718d459
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into brotli
2021-02-26 14:31:24 +00:00
Vasily Nemkov
2d03d330bc
Extended range of DateTime64 to years 1925 - 2238
...
The Year 1925 is a starting point because most of the timezones
switched to saner (mostly 15-minutes based) offsets somewhere
during 1924 or before. And that significantly simplifies implementation.
2238 is to simplify arithmetics for sanitizing LUT index access;
there are less than 0x1ffff days from 1925.
* Extended DateLUTImpl internal LUT to 0x1ffff items, some of which
represent negative (pre-1970) time values.
As a collateral benefit, Date now correctly supports dates up to 2149
(instead of 2106).
* Added a new strong typedef ExtendedDayNum, which represents dates
pre-1970 and post 2149.
* Functions that used to return DayNum now return ExtendedDayNum.
* Refactored DateLUTImpl to untie DayNum from the dual role of being
a value and an index (due to negative time). Index is now a different
type LUTIndex with explicit conversion functions from DatNum, time_t,
and ExtendedDayNum.
* Updated DateLUTImpl to properly support values close to epoch start
(1970-01-01 00:00), including negative ones.
* Reduced resolution of DateLUTImpl::Values::time_at_offset_change
to multiple of 15-minutes to allow storing 64-bits of time_t in
DateLUTImpl::Value while keeping same size.
* Minor performance updates to DateLUTImpl when building month LUT
by skipping non-start-of-month days.
* Fixed extractTimeZoneFromFunctionArguments to work correctly
with DateTime64.
* New unit-tests and stateless integration tests for both DateTime
and DateTime64.
2021-02-24 17:08:35 +02:00
Pavel Kruglov
10f54f1714
remove include
2021-02-21 17:18:50 +03:00
Pavel Kruglov
abb5993bd5
return const
2021-02-21 17:13:33 +03:00
Pavel Kruglov
7c76b4a98a
Remove debug logging
2021-02-21 17:12:26 +03:00
Kruglov Pavel
815b4ff0d9
Merge branch 'master' into hedged-requests
2021-02-21 17:10:24 +03:00
Pavel Kruglov
dd5185c779
Refactor 4.0
2021-02-21 17:03:24 +03:00
Alexey Milovidov
af2f4ceb0e
Add disambiguation while parsing already scaled DateTime64 #13194
2021-02-21 15:34:04 +03:00
Alexey Milovidov
b736f4fdee
Suppression for PVS-Studio (looks like a false positive)
2021-02-21 10:21:59 +03:00
Alexey Milovidov
64e76a4a8d
Minor changes in Decimal
2021-02-20 21:13:36 +03:00
kssenii
21ee685ef0
Fix brotly
2021-02-19 22:18:14 +00:00
Ivan
414f470c79
Make Poco HTTP Server zero-copy again ( #19516 )
...
* Refactoring: part 1
* Refactoring: part 2
* Handle request using ReadBuffer interface
* Struggles with ReadBuffer's
* Fix URI parsing
* Implement parsing of multipart/form-data
* Check HTTP_LENGTH_REQUIRED before eof() or will hang
* Fix HTTPChunkedReadBuffer
* Fix build and style
* Fix test
* Resist double-eof
* Fix arcadian build
2021-02-19 15:51:26 +03:00
Kruglov Pavel
794c3449ca
Merge branch 'master' into hedged-requests
2021-02-17 20:36:36 +03:00
Pavel Kruglov
1b78de2142
Use fibers in HedgedRequests
2021-02-17 20:34:52 +03:00
Nikita Mikhailov
6ee98ead05
Merge branch 'master' of github.com:ClickHouse/ClickHouse into keen-wolf-filefuncwithreadbuf
2021-02-16 15:38:03 +03:00
Nikita Mikhailov
7c5d845866
refactor function
2021-02-16 15:37:49 +03:00