Commit Graph

3210 Commits

Author SHA1 Message Date
Sema Checherinda
31ea4052d0 cut the build dependency between commin_io and other libraries 2023-09-28 00:15:36 +02:00
Sema Checherinda
5fdca302e6 fix build, resolve process_list_elem race 2023-09-28 00:15:36 +02:00
Sema Checherinda
b9a2c82910 do not share http_client, make code simple 2023-09-28 00:15:26 +02:00
Sema Checherinda
e629a17218 add cancelation point to s3 retries 2023-09-28 00:15:06 +02:00
Robert Schulze
675819be6b
Minor fixes 2023-09-27 21:15:20 +00:00
Nikolay Degterinsky
c1f59eccd5 Add fraction part to the time argument, add docs, better test 2023-09-27 20:17:32 +00:00
Yarik Briukhovetskyi
9c337c7687
Update URI.cpp 2023-09-27 20:55:29 +02:00
yariks5s
adf1af63a5 added tests, moved domains to config 2023-09-27 18:53:05 +00:00
robot-clickhouse-ci-1
7a825c1417
Merge pull request #54427 from Avogar/json-object-as-tuple-inference
Add new features to schema inference for JSON formats
2023-09-27 20:12:45 +02:00
Robert Schulze
cde10fe7b5
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-reenable-checks 2023-09-26 18:59:41 +00:00
avogar
6b3dbc4403 Apply suggestions 2023-09-26 16:41:35 +00:00
Vitaly Baranov
fe008c23c4
Merge pull request #54900 from vitlibar/retry-backup-s3-operations-after-conection-reset
Retry backup S3 operations after connection reset failure
2023-09-26 18:36:10 +02:00
Antonio Andelic
535b9337f4
Merge pull request #55012 from ClickHouse/lower-s3-credential-logs
Lower log levels for `SSOCredentialsProvider`
2023-09-26 16:08:00 +02:00
yariks5s
4939e59cfe Merge branch 'master' into s3_style_url 2023-09-26 13:24:00 +00:00
Kruglov Pavel
bea80ab5b7
Merge branch 'master' into json-object-as-tuple-inference 2023-09-26 15:23:08 +02:00
Kruglov Pavel
69a17bbef6
Merge pull request #52853 from Avogar/http-valid-json-on-exception
Output valid JSON/XML on excetpion during HTTP query execution
2023-09-26 14:25:55 +02:00
Robert Schulze
9fff447716
Re-enable clang-tidy checks 2023-09-26 09:34:12 +00:00
Antonio Andelic
ef6c7fe45d Lower log levels for SSOCredentialsProvider 2023-09-26 08:30:34 +00:00
avogar
9e75825515 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-object-as-tuple-inference 2023-09-25 17:24:36 +00:00
avogar
42ca897f2d Better schema inference for JSON formats 2023-09-25 15:42:59 +00:00
serxa
44acb53ad3 Merge branch 'master' into io-scheduling-throttler 2023-09-23 10:51:18 +00:00
Vitaly Baranov
1e567d5008 Retry backup s3 operations after ConnectionResetException. 2023-09-23 01:56:28 +02:00
yariks5s
e1f40adfe2 fix typo 2023-09-22 16:21:08 +00:00
yariks5s
dce8908641 fixed url convers. 2023-09-22 16:13:29 +00:00
Robert Schulze
877e4f3aab
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-21 20:21:12 +00:00
Michael Kolupaev
9af9b4a085
Enable connection pooling for s3 table function (#54812)
Enable connection pooling for s3 table function
2023-09-21 09:27:20 -07:00
Robert Schulze
5209bd2d51
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-21 14:45:55 +00:00
Robert Schulze
f5137dd0b4
More clang-tidy fixes 2023-09-21 14:40:57 +00:00
Vitaly Baranov
bf4662aca7
Merge pull request #53336 from azat/backups/s3-throttling
Fix throttling of BACKUPs from/to S3 (in case native copy was not used) and in some other places as well
2023-09-21 10:42:28 +02:00
Azat Khuzhin
c706101891 Fix throttling of BACKUPs from/to S3 (in case native copy was not used)
In some cases native copy is not possible, and such requests should be
throttled.

v0: copyS3FileNativeWithFallback
v2: revert v0 and pass write_settings
v3: pass read_settings to copyFile()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-20 18:28:43 +02:00
Duc Canh Le
2a5b4ee29a Merge branch 'master' into fix_http_timeout
To trigger CI pipeline
2023-09-20 07:22:02 +00:00
Kruglov Pavel
e163670357
Merge branch 'master' into http-valid-json-on-exception 2023-09-19 13:42:53 +02:00
serxa
14569b0f7b fix start time in test 2023-09-19 10:13:05 +00:00
serxa
b154f71a57 Merge branch 'io-scheduling-throttler' of github.com:ClickHouse/ClickHouse into io-scheduling-throttler 2023-09-19 10:10:35 +00:00
serxa
311db94640 default max_burst equals to max_speed as in Throttler 2023-09-19 10:10:21 +00:00
serxa
d97b4f0685 better semantics for locking 2023-09-19 10:09:16 +00:00
serxa
71655cda8e add more tests 2023-09-19 10:08:09 +00:00
Sergei Trifonov
b2ed38742c
Update src/IO/ISchedulerNode.h
Co-authored-by: vdimir <vdimir@clickhouse.com>
2023-09-19 11:32:05 +02:00
serxa
c5f3170a82 update actual amount of tokens in bucket 2023-09-18 18:12:55 +00:00
Sema Checherinda
e7550523c8
Merge pull request #54651 from CheSema/limit_backoff_timeout
limit the delay before next try in S3
2023-09-18 19:41:26 +02:00
serxa
1787803157 fix scheduler node registration 2023-09-18 17:25:16 +00:00
serxa
c3f8ee589e fix uninitialized value 2023-09-18 17:24:58 +00:00
serxa
e94908ce2e add unit tests + fix bugs 2023-09-18 17:14:06 +00:00
Robert Schulze
f5e8028bb1
Merge pull request #54642 from rschu1ze/broken-re2st
Remove broken lockless variant of re2
2023-09-17 15:30:57 +02:00
Sema Checherinda
7ce3a587ca fix build 2023-09-15 20:52:21 +02:00
Kruglov Pavel
dbd24b240c
Merge branch 'master' into http-valid-json-on-exception 2023-09-15 14:55:31 +02:00
Sema Checherinda
0edfa22181 attempts count is retries plus 1 2023-09-15 13:13:14 +02:00
Sema Checherinda
d9e15c00c9 limit the delay before next try in S3 2023-09-14 19:45:07 +02:00
Robert Schulze
7b378dbad3
Remove broken lockless variant of re2 2023-09-14 16:40:42 +00:00
serxa
8b00e29ce9 fix style 2023-09-14 10:40:41 +00:00
serxa
2ab922777a fix typos 2023-09-14 09:21:23 +00:00
serxa
f3e6ba9bd1 fix style 2023-09-14 09:17:55 +00:00
serxa
09d4bf6930 add IO scheduling node for bandwidth throttling 2023-09-14 08:51:47 +00:00
Michael Kolupaev
df71dcd94d Fix data race in copyFromIStreamWithProgressCallback 2023-09-11 21:04:37 +00:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
robot-clickhouse-ci-2
47c0f8c99f
Merge pull request #54179 from joelynch/http-query-timing
Add elapsed_ns to HTTP headers X-ClickHouse-Progress and X-ClickHouse-Summary
2023-09-11 06:18:47 +02:00
serxa
1b3da7fc1e fix build 2023-09-09 09:26:18 +00:00
Duc Canh Le
52dfaa54bf pass http retry timeout as ms
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-09-08 08:02:30 +00:00
Nikolay Degterinsky
3b43667397
Merge pull request #54330 from HarryLeeIBM/hlee-s390x-read-float
Fix precise float parsing issue on s390x
2023-09-07 17:51:40 +02:00
serxa
a94ae9a7ab review fixes 2023-09-07 14:02:58 +00:00
Sergei Trifonov
958f102daa
Update src/IO/IResourceManager.h
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2023-09-07 15:58:31 +02:00
Sergei Trifonov
c9635ddacd
Update src/IO/ISchedulerNode.h
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2023-09-07 15:48:49 +02:00
Joe Lynch
a5b508d6c5
Fix json in header 2023-09-07 14:59:33 +02:00
serxa
77697211cd add docs for system.scheduler + small fix 2023-09-06 19:30:39 +00:00
Antonio Andelic
52e4f3c571 Fix style 2023-09-06 09:27:35 +00:00
Antonio Andelic
af43463bfb Better 2023-09-06 08:54:39 +00:00
Antonio Andelic
d0c70c0f8a Merge branch 'master' into add-sso-for-s3 2023-09-06 07:29:05 +00:00
HarryLeeIBM
d695417869 Fix precise float parsing issue on s390x 2023-09-05 13:38:02 -07:00
Joe Lynch
767f2472c2
Add elapsed_ns to HTTP headers X-ClickHouse-Progress and X-ClickHouse-Summary
The TCP interface progress has this field. This is not a super accurate
measure of server side query time, but trying to measure from the client
is even worse.
2023-09-05 21:03:13 +02:00
Antonio Andelic
e8034a2a52 Add SSO provider 2023-09-05 07:46:41 +00:00
irenjj
c9261bbf18 Merge remote-tracking branch 'upstream/master' into feat_markdown 2023-09-04 22:35:53 +08:00
serxa
aa8e9c3cbc fix style 2023-09-04 14:18:54 +00:00
Sergei Trifonov
258da91b5f
Merge branch 'master' into disks-and-io-sheduler 2023-09-04 15:14:28 +02:00
serxa
b5233efc20 fix system table and scheduler config reloading 2023-09-04 12:35:17 +00:00
serxa
8fdd118e0c fix build 2023-09-03 22:40:00 +00:00
serxa
adcab639a4 add system.scheduler table for introspection 2023-09-03 21:48:33 +00:00
Kseniia Sumarokova
b3319f7908
Minor changes (#54171) 2023-09-03 15:47:52 +02:00
kssenii
9eb1dfcd12 Refactor buffers reading from object storage 2023-09-01 14:03:07 +02:00
Robert Schulze
aefb543734
Merge remote-tracking branch 'rschu1ze/master' into feat_markdown 2023-08-31 11:32:44 +00:00
serxa
9c92d413b3 Merge branch 'master' into disks-and-io-sheduler 2023-08-30 11:18:49 +00:00
Antonio Andelic
ddb58217d4 Merge branch 'master' into archive-improvements-2 2023-08-30 07:43:25 +00:00
irenjj
473ba91c21 Refactor writeAnyMarkdownEscapedString and Add more info into doc. 2023-08-29 23:54:40 +08:00
Antonio Andelic
5a0c2ca108 Merge branch 'master' into archive-improvements-2 2023-08-28 08:34:42 +00:00
irenjj
51aa89eed8 Add a setting to automatically escape special characters in Markdown. 2023-08-28 00:10:33 +08:00
alesapin
0e601b856f
Merge pull request #53751 from Algunenano/clang18
Support clang-18 (Wmissing-field-initializers)
2023-08-25 23:27:06 +02:00
Raúl Marín
6490213207 Merge remote-tracking branch 'blessed/master' into clang18 2023-08-24 17:35:26 +02:00
Kruglov Pavel
44db5fa992
Merge branch 'master' into cache-count 2023-08-24 17:21:18 +02:00
Arthur Passos
2bade7db08
Add global proxy setting (#51749)
* initial impl

* fix env ut

* move ut directory

* make sure no null proxy resolver is returned by ProxyConfigurationResolverProvider

* minor adjustment

* add a few tests, still incomplete

* add proxy support for url table function

* use proxy for select from url as well

* remove optional from return type, just returns empty config

* fix style

* style

* black

* ohg boy

* rm in progress file

* god pls don't let me kill anyone

* ...

* add use_aws guards

* remove hard coded s3 proxy resolver

* add concurrency-mt-unsafe

* aa

* black

* add logging back

* revert change

* imrpove code a bit

* helper functions and separate tests

* for some reason, this env test is not working..

* formatting

* :)

* clangtidy

* lint

* revert some stupid things

* small test adjusmtments

* simplify tests

* rename test

* remove extra line

* freaking style change

* simplify a bit

* fix segfault & remove an extra call

* tightly couple proxy provider with context..

* remove useless include

* rename config prefix parameter

* simplify provider a bit

* organize provider a bit

* add a few comments

* comment out proxy env tests

* fix nullptr in unit tests

* make sure old storage proxy config is properly covered without global context instance

* move a few functions from class to anonymous namespace

* fix no fallback for specific storage conf

* change API to accept http method instead of bool

* implement http/https distinction in listresolver, any still not implemented

* implement http/https distinction in remote resolver

* progress on code, improve tests and add url function working test

* use protcol instead of method for http and https

* small fix

* few more adjustments

* fix style

* black

* move enum to proxyconfiguration

* wip

* fix build

* fix ut

* delete atomicroundrobin class

* remove stale include

* add some tests.. need to spend some more time on the design..

* change design a bit

* progress

* use existing context for tests

* rename aux function and fix ut

* ..

* rename test

* try to simplify tests a bit

* simplify tests a bit more

* attempt to fix tests, accept more than one remote resolver

* use proper log id

* try waiting for resolver

* proper wait logic

* black

* empty

* address a few comments

* refactor tests

* remove old tests

* baclk

* use RAII to set/unset env

* black

* clang tidy

* fix env proxy not respecting any

* use log trace

* fix wrong logic in getRemoteREsolver

* fix wrong logic in getRemoteREsolver

* fix test

* remove unwanted code

* remove ClientConfigurationperRequest and auxilary classes

* remove unwanted code

* remove adapter test

* few adjustments and add test for s3 storage conf  with new proxy settings

* black

* use chassert for context

* Add getenv comment
2023-08-24 16:07:26 +03:00
Antonio Andelic
8e1d38d377 Merge branch 'master' into archive-improvements-2 2023-08-24 13:03:36 +00:00
avogar
894513f6cd Fix tests 2023-08-23 18:43:08 +00:00
Raúl Marín
93dac0c880 Support clang-18 (Wmissing-field-initializers) 2023-08-23 15:53:45 +02:00
Kruglov Pavel
592fa77987
Merge branch 'master' into cache-count 2023-08-23 15:18:02 +02:00
Robert Schulze
bea651e828
Merge pull request #53657 from rschu1ze/cache-improvements
Expose more settings from caches
2023-08-23 14:58:45 +02:00
Sema Checherinda
60103c577d
Merge pull request #53651 from CheSema/read_beyon_last_offset
fix Logical Error in AsynchronousBoundedReadBuffer
2023-08-23 11:21:47 +02:00
Antonio Andelic
83d4b819f3 Better support for reading from archives 2023-08-23 08:10:30 +00:00
Robert Schulze
d5a7277a59
Better parameter name 2023-08-22 15:43:13 +00:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Sema Checherinda
7e4e6e31dc
NOLINT on sscanf in gtest 2023-08-22 13:32:21 +02:00
Robert Schulze
f2fb7365e6
Add settings for 1. size_ratio (all caches) and 2. policy (index caches)
1. is an expert-level setting, default is 0.5, applies only to SLRU.

Also, I noticed that we expose cache policy settings for the mark and
the uncompresed cache but not for the index mark and the index
uncompressed cache. Changed that as well, it simplifies the code a bit.
2023-08-22 11:04:29 +00:00
Robert Schulze
acaa2eee58
Merge pull request #53556 from ClibMouse/feature/big-endian-UUID-correction
Change Big Endian-UUID to work the same as Little Endian-UUID
2023-08-22 11:57:44 +02:00
Sema Checherinda
ae5f66da1e fix special build 2023-08-22 11:34:08 +02:00
Michael Kolupaev
6009e1b293
Merge pull request #53324 from bigo-sg/ch_gluten_2583
Implement native orc input format without arrow to improve performance
2023-08-21 13:44:57 -07:00
Alexey Milovidov
316664456f
Merge pull request #53588 from kitaisreal/aarch64-neon-memequal-wide
AARCH64 Neon memequal wide
2023-08-21 21:11:01 +03:00
Sema Checherinda
81577e041b fix Logical Error in AsynchronousBoundedReadBuffer 2023-08-21 19:30:04 +02:00
kothiga
52d47785cb
Fix deserialization for quantile deterministic. 2023-08-21 09:52:14 -07:00
Antonio Andelic
ed15babddd
Merge pull request #53198 from ClickHouse/improve-archive-reading
Improve reading from archives
2023-08-21 14:11:25 +02:00
Maksim Kita
f32effb627 AARCH64 Neon memequal wide 2023-08-20 12:45:18 +03:00
gyfis
efa53f873c
💄 [S3::URI] Fix comment typos around versionId 2023-08-20 09:08:57 +02:00
Alexey Milovidov
d133cafd9c Better documentation about redirects 2023-08-20 00:38:18 +02:00
Yakov Olkhovskiy
257380df03
Merge pull request #50267 from HarryLeeIBM/hlee-s390x-proto-endian
Fix endian issues in native protocol
2023-08-19 11:16:24 -04:00
kothiga
f33c585bc5
Addressing feedback. 2023-08-18 13:50:31 -07:00
Austin Kothig
6b42975d33
Change BE-UUID to work the same as LE-UUID. Included high and low getters to provide cleaner code when accessing undertype. 2023-08-18 08:19:46 -07:00
Harry Lee
1645439000
Merge branch 'master' into hlee-s390x-proto-endian 2023-08-17 18:09:04 -04:00
Michael Kolupaev
557bfea4d8 Use long timeout for S3 copy requests 2023-08-17 19:36:45 +00:00
Robert Schulze
ec7daed52f
Merge pull request #50276 from ClibMouse/feature/mergetree-checksum-big-endian-support
MergeTree & SipHash checksum big-endian support
2023-08-17 13:27:18 +02:00
taiyang-li
bfa9d361cc fix tests 2023-08-15 12:16:22 +08:00
ltrk2
2846ea49b4
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-14 13:02:30 -04:00
Alexey Milovidov
7911945a74 Make one exception message longer 2023-08-13 22:40:50 +02:00
robot-ch-test-poll
967067bbb8
Merge pull request #53250 from evillique/postgresql-single-quotes
Fix character escaping in the PostgreSQL engine
2023-08-12 13:15:49 +02:00
Alexey Milovidov
a3208f0a9a Merge branch 'master' into ditch-tons-of-garbage-2 2023-08-11 00:20:43 +02:00
Antonio Andelic
478a5006b1 Merge branch 'master' into improve-archive-reading 2023-08-10 15:52:30 +00:00
ltrk2
a2054c04dd
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-10 10:21:34 -04:00
Alexey Milovidov
bb57caa83e
Merge pull request #53180 from ClickHouse/ditch-tons-of-garbage
Ditch tons of garbage
2023-08-10 16:59:51 +03:00
Kruglov Pavel
6600f87f86
Merge branch 'master' into http-valid-json-on-exception 2023-08-10 13:53:32 +02:00
Antonio Andelic
aa258a0e61 Merge branch 'master' into improve-archive-reading 2023-08-10 06:59:04 +00:00
Nikolay Degterinsky
7321f5e543 Better 2023-08-10 06:34:10 +00:00
Alexey Milovidov
52c3704dc7
Merge pull request #52683 from rschu1ze/readBinary-specializations
Remove unneeded readBinary() specializations + update docs
2023-08-10 04:04:57 +03:00
ltrk2
139e9433a8
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-09 09:48:00 -04:00
Antonio Andelic
0e17d26b88 More formats supported, read single archive from 1 thread 2023-08-09 11:58:37 +00:00
Alexey Milovidov
1c9cff551e Continue on garbage removal 2023-08-09 02:58:12 +02:00
Alexey Milovidov
aa757490bd Ditch tons of garbage 2023-08-09 02:19:02 +02:00
Michael Kolupaev
e4b2b3f533
Merge pull request #52828 from ClickHouse/illogical
Don't report LOGICAL_ERROR if a file got truncated during read
2023-08-08 13:13:20 -07:00
Alexander Tokmakov
9d29b7cdbf
Merge pull request #53109 from ClickHouse/tavplubix-patch-8
Update PocoHTTPClient.cpp
2023-08-07 19:33:39 +03:00
Antonio Andelic
f5597b1f8e Revert changes from https://github.com/ClickHouse/ClickHouse/pull/53064 2023-08-07 12:21:50 +00:00
Alexander Tokmakov
d35dc46061
Update PocoHTTPClient.cpp 2023-08-07 14:39:58 +03:00
Kseniia Sumarokova
b1f0cb83ff
Merge pull request #52621 from valbok/readbuffer
MaterializedMySQL: Fix the infinite loop in ReadBuffer::read
2023-08-07 11:56:23 +02:00
Antonio Andelic
cafa5ef2f3 Merge branch 'master' into add-reading-from-archives 2023-08-06 10:21:47 +00:00
Antonio Andelic
1d793e69f2 Fix 2023-08-05 17:06:44 +00:00
Alexey Milovidov
70630a273a
Merge branch 'master' into readBinary-specializations 2023-08-05 03:16:29 +03:00
Michael Kolupaev
9a128fa554 Fix ZstdDeflatingWriteBuffer truncating the output sometimes 2023-08-04 20:47:45 +00:00
Antonio Andelic
49ae853ae6 Fix sanitizer warnings 2023-08-04 13:57:18 +00:00
Val Doroshchuk
3cea474ccf MaterializedMySQL: Fix the infinite loop in ReadBuffer::read
This fixes https://github.com/ClickHouse/ClickHouse/issues/33549

The infinite loop caused because sometimes the pos of ReadBuffer overflows the end.

It happens f.e. when `MySQLPacketPayloadReadBuffer::nextImpl` might return empty buffer,
because `in.nextIfAtEnd();` could not read more bytes and thus no bytes available (pos == end).
It might happen when a network error or the connection to MySQL was closed or killed.
This leads to empty `working_buffer` but successful returning from the func.
And check `if (in.eof())` from `MySQLBinlogEventReadBuffer::nextImpl()` fails and also causes empty its `working_buffer` and successul return.

At the end `payload.ignore(1)` and `payload.read(c)` produces the infinite loop since it is not eof() and ++pos overflows the end of the buffer.

Should be tested by `test_mysql_kill*` from test.py
2023-08-04 11:34:31 +02:00
Antonio Andelic
8e7eb7f3fa Fix tests 2023-08-04 08:59:55 +00:00
Antonio Andelic
27701ed24e Small fixes 2023-08-03 11:44:24 +00:00
Antonio Andelic
d9f136ce0c Add tests for globs 2023-08-03 10:42:47 +00:00
Antonio Andelic
96bad0537a Merge branch 'master' into add-reading-from-archives 2023-08-03 08:36:42 +00:00
ltrk2
27a2d4d1c7
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-02 11:36:43 -04:00
Antonio Andelic
9423976b7a Add support for file globs 2023-08-02 07:42:56 +00:00
Yakov Olkhovskiy
357fee99ff
Merge pull request #52791 from zvonand/zvonand-float-parsing
Add option to switch float parsing methods
2023-08-02 00:23:23 -04:00
avogar
d12e96177a Fix tests 2023-08-01 16:17:03 +00:00
Antonio Andelic
e366ca61f5 Merge branch 'master' into add-reading-from-archives 2023-08-01 15:33:20 +00:00
Kruglov Pavel
23aab71d7c
Merge branch 'master' into http-valid-json-on-exception 2023-08-01 16:47:31 +02:00
Antonio Andelic
c24dc8e64e Multithreaded read of files from archives: 2023-08-01 13:48:49 +00:00
avogar
a71cd56a90 Output valid JSON/XML on excetpion during HTTP query execution 2023-08-01 10:06:56 +00:00
Andrey Zvonov
99cd8f9ba9
Merge branch 'master' into zvonand-float-parsing 2023-07-31 23:43:24 +03:00
Nikolai Kochetov
c4a00b8c68 Throw S3Exception whenever possible. 2023-07-31 15:39:20 +00:00
Michael Kolupaev
8b0f52f411 Don't report LOGICAL_ERROR if a file got truncated during read 2023-07-31 15:04:30 +00:00
Antonio Andelic
86a251931b Fix style 2023-07-31 14:53:40 +00:00
zvonand
e50ffa1181 fix style 2023-07-31 16:44:46 +02:00
zvonand
2088f846ad update as per reviews 2023-07-31 16:26:18 +02:00
Antonio Andelic
6a1cf5c683 Extend tests 2023-07-31 13:27:06 +00:00
Antonio Andelic
7df5c83046 Merge branch 'master' into add-reading-from-archives 2023-07-31 09:27:01 +00:00
Antonio Andelic
df45602165 Refactoring 2023-07-31 08:50:09 +00:00
Alexey Milovidov
c825f15b74
Merge pull request #52441 from CheSema/reset-connection-s3
add tests with connection reset by peer error, and retry it inside client
2023-07-31 09:58:41 +03:00
zvonand
0ff0a4e41f diverge parsing methods 2023-07-30 19:42:10 +02:00
ltrk2
6c9a1b14ef
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-28 16:18:46 -04:00
Antonio Andelic
1fc1b6aae4 More fixes 2023-07-28 13:00:35 +00:00
Antonio Andelic
e83e0ec2cd Fix build 2023-07-28 12:26:56 +00:00
Sema Checherinda
115a085d0f
Merge branch 'master' into reset-connection-s3 2023-07-28 14:00:14 +04:00
Antonio Andelic
720d587e85 Merge branch 'master' into add-reading-from-archives 2023-07-28 08:49:00 +00:00
Robert Schulze
b98cb7fa14
Fix build 2023-07-27 17:50:39 +00:00
Robert Schulze
8c14c4b5e8
Remove unneeded readBinary() specializations + update docs
The default instantiation

    template <typename T>
    requires is_arithmetic_v<T>
    inline void readBinary(T & x, ReadBuffer & buf) { readPODBinary(x, buf); }

covers Int32, Int128, Int256, UInt32, UInt128 and UInt256 cases already.
2023-07-27 15:13:54 +00:00
Alexey Milovidov
6aab4cc835 Check for unexpected cyrillic 2023-07-27 05:25:40 +02:00
robot-ch-test-poll2
7bcef0a6c0
Merge pull request #52520 from zvonand/revert-52450-remove-to-decimal-string
Fix `toDecimalString` function
2023-07-27 00:18:36 +02:00
Sema Checherinda
7d430b8037 retry ConnectionResetException 2023-07-26 17:31:14 +04:00
Kruglov Pavel
15cc046883
Merge branch 'master' into better-progress-bar-2 2023-07-26 13:12:24 +02:00
Sema Checherinda
83d869860e
Merge pull request #51946 from arenadata/ADQM-940
Expose Peak memory usage in query statistics.
2023-07-25 22:17:58 +03:00
Sema Checherinda
c341df1949 draft with retry ConnectionResetException 2023-07-25 19:59:39 +04:00
Andrey Zvonov
15b3a637e9
Merge branch 'master' into revert-52450-remove-to-decimal-string 2023-07-25 13:21:00 +03:00
Alexey Milovidov
21382afa2b Check for punctuation 2023-07-25 06:10:04 +02:00
Alexey Milovidov
168b84a592
Merge pull request #52337 from Avogar/no-decode-url
Allow to disable decoding/encoding path in uri in URL engine
2023-07-25 05:43:06 +03:00
Dmitry Kardymon
d4d381de7e Merge remote-tracking branch 'origin/master' into ADQM-940 2023-07-24 20:04:10 +00:00
Kruglov Pavel
fec5675cd4
Merge branch 'master' into better-progress-bar-2 2023-07-24 19:59:38 +02:00
Nikita Taranov
c6e6fd7613
Shard OpenedFileCache to avoid lock contention (#51341)
* shard OpenedFileCache to avoid lock contention

* Update OpenedFileCache.h

* fix build

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-07-24 15:58:21 +02:00
Andrey Zvonov
21097209d2
Revert "Remove toDecimalString" 2023-07-24 15:41:21 +03:00
Dmitry Kardymon
62f9a953fe Merge remote-tracking branch 'origin/master' into ADQM-940 2023-07-24 04:52:12 +00:00
Alexey Milovidov
d7cdfb47d3 Fix merge 2023-07-24 01:56:04 +02:00
Alexey Milovidov
5c15e6021b Merge branch 'master' into remove-to-decimal-string 2023-07-24 01:51:43 +02:00
Alexey Milovidov
2467eaf32d
Merge pull request #52392 from azat/netlink-provider
Rename TaskStatsInfoGetter into NetlinkMetricsProvider
2023-07-22 19:14:15 +03:00
Kseniia Sumarokova
d34f2bed07
Merge pull request #51386 from bigo-sg/fix_hdfs_read_buffer_heap_overflow
Fix heap overflow in read buffer from hdfs when read_until_position is not zero
2023-07-22 15:00:58 +02:00
Alexey Milovidov
5f4756fb33 Remove toDecimalString 2023-07-22 04:54:58 +02:00
ltrk2
90a2c460c6
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-21 08:07:18 -04:00
Azat Khuzhin
f0e277f94a Rename TaskStatsInfoGetter into NetlinkMetricsProvider
There is ProcfsMetricsProvider, so by analogy to it.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-21 06:48:18 +02:00
Alexander Tokmakov
a39ba00ec3
Merge pull request #52116 from aalexfvk/http_failover
Handle multiple resolved IPs for HTTP/HTTPS session connection
2023-07-20 18:25:45 +03:00
Alexander Tokmakov
e467264588
Update src/IO/HTTPCommon.cpp 2023-07-20 17:56:30 +03:00
avogar
2b8e4ebd4c Allow to disable decoding/encoding path in uri in URL engine 2023-07-19 19:48:39 +00:00
ltrk2
ba4072f049 Adapt changes around SipHash 2023-07-19 10:01:58 -07:00
ltrk2
51e2c58a53 Implement endianness-independent SipHash and MergeTree checksum serialization 2023-07-19 10:01:55 -07:00
Dmitry Kardymon
68a501a14e Merge remote-tracking branch 'origin/master' into ADQM-940 2023-07-18 18:16:09 +00:00