Commit Graph

4003 Commits

Author SHA1 Message Date
Yakov Olkhovskiy
30a6b36395 Merge branch 'master' into ft-chunked-protocol 2024-06-09 21:39:48 +00:00
Yakov Olkhovskiy
90b5ad3613 fix tidy build 2024-06-09 19:31:20 +00:00
Yakov Olkhovskiy
740501b36e some potential bug fixes 2024-06-07 18:23:37 +00:00
Yakov Olkhovskiy
d2dd640beb fix style 2024-06-07 12:25:46 +00:00
Yakov Olkhovskiy
11d9f7d51b allow to set end-of-chunk marker on sent chunk, ignore duplicate finish chunk 2024-06-07 12:07:35 +00:00
Duc Canh Le
de5258128e update fmtlib version to 9.1.0
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-06-07 06:44:36 +00:00
Yakov Olkhovskiy
390a2a2488 fix style 2024-06-07 02:06:26 +00:00
Yakov Olkhovskiy
a562118d2a major refactoring of chunked write buffer - more buffering, some bugs fixed 2024-06-07 01:45:56 +00:00
Kseniia Sumarokova
1e75f8ea26
Merge branch 'master' into unite-storages3-and-disks3-settings 2024-06-06 18:30:11 +02:00
Ilya Golshtein
aefe7ffc31 time_virtual_col: slightly works 2024-06-06 09:48:32 +00:00
vdimir
5251febf03
Merge pull request #64393 from ClickHouse/vdimir/blob_storage_log_fix_recursion
Prevent recursive logging in blob_storage_log
2024-06-05 14:28:01 +00:00
kssenii
f0974f02ee Merge remote-tracking branch 'origin/master' into unite-storages3-and-disks3-settings 2024-06-05 13:11:20 +02:00
Sema Checherinda
dd6ae2f77c
Merge pull request #63427 from arthurpassos/fix_wrong_request_protocol_proxy
Several minor fixes to proxy support in ClickHouse
2024-06-04 16:35:03 +00:00
kssenii
00c352a31c Fix clang-tidy 2024-06-04 12:28:07 +02:00
vdimir
37fa4f5dd6
Revert "Fix build BlobStorageLogWriter with CLICKHOUSE_KEEPER_STANDALONE_BUILD"
This reverts commit dfcc36ee2d02c036126007dcdc1ffc1946a3e9f2.
2024-06-04 07:52:49 +00:00
vdimir
72e7a266e7
Revert "Move BlobStorageLogWriter to Interpreters"
This reverts commit ca3d80102365e76d931be016638b1ca506dffb86.
2024-06-04 07:52:49 +00:00
vdimir
6d9b2c8f5a
Move BlobStorageLogWriter to Interpreters 2024-06-04 07:52:48 +00:00
vdimir
5d1b33612c
Fix build BlobStorageLogWriter with CLICKHOUSE_KEEPER_STANDALONE_BUILD 2024-06-04 07:52:48 +00:00
vdimir
03fa9c32ee
Update BlobStorageLog and SystemLog to add settings for query 2024-06-04 07:52:47 +00:00
vdimir
55512d4a61
Prevent recursive logging in blob_storage_log 2024-06-04 07:52:44 +00:00
kssenii
642e2fdd72 Fix clang-tidy 2024-06-03 18:17:13 +02:00
kssenii
cd3d99a0eb Merge remote-tracking branch 'origin/master' into unite-storages3-and-disks3-settings 2024-06-03 17:37:33 +02:00
Yakov Olkhovskiy
1cda4596ad fix tidy build 2024-06-03 11:51:01 +00:00
kssenii
a035e4ed69 Fix tests 2024-06-03 11:59:48 +02:00
Yakov Olkhovskiy
66e3875626 fix tidy build 2024-06-03 09:55:51 +00:00
Yakov Olkhovskiy
e0be652f4d fix test, better log, fix defaults for client 2024-06-03 07:24:28 +00:00
Michael Kolupaev
1cb3961f9d Call GetResult() once 2024-06-01 18:12:30 +00:00
Azat Khuzhin
5246c56a2a Fix type inference for float (in case of small buffer)
In case of small buffer (i.e. --max_read_buffer_size 1) the pos() will
be always point to this one byte, so, comparing pos() will be always
evaluated to true.

And we cannot use count() as well, since in case of big buffer it will
be the same, plus, in case of reading extra byte for checking for '.'
the count() will be different, but it does not mean that the byte had
been interpreted (and allowing 1 byte of difference will not work almost
always, since it will read max_read_buffer_size bytes).

So instead, expose the has_fractional flag from the read helpers for
float, via two new methods:
- tryReadFloatTextExt
- tryReadFloatTextExtNoExponent

Where "ext" stands for "extended", which means expose extra information.

v2: consider number as float if it has '.' or 'e' (previously only if it
has some signs after those two it had been considered as float)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-06-01 16:34:55 +02:00
Michael Kolupaev
d21a5b2f0c Check for missing Upload ID in CreateMultipartUpload reply 2024-06-01 07:00:20 +00:00
kssenii
779eaa01ec Fix tests 2024-05-31 17:53:09 +02:00
Yakov Olkhovskiy
1dc381dbc1 fix 2024-05-31 05:07:40 +00:00
Yakov Olkhovskiy
d1bc58f232 fix 2024-05-31 05:05:18 +00:00
Yakov Olkhovskiy
4545f3af52 fix 2024-05-31 04:35:01 +00:00
Yakov Olkhovskiy
89205d78a6 major refactoring 2024-05-31 04:18:36 +00:00
Sema Checherinda
99ce2985d4 work with tests 2024-05-30 17:01:28 +02:00
kssenii
74c59fa92a Merge remote-tracking branch 'origin/master' into unite-storages3-and-disks3-settings 2024-05-30 16:55:22 +02:00
kssenii
dd34d316c5 Fix tests 2024-05-30 16:54:11 +02:00
Arthur Passos
dba8c98e5f minor changes 2024-05-30 09:33:59 -03:00
Sema Checherinda
2df9ab60a4 Merge branch 'master' into chesema-less-backoff-timeout 2024-05-30 13:16:12 +02:00
Arthur Passos
313db20b74 fix poco proxy configuration being resolved outside try-catch block 2024-05-29 14:46:45 -03:00
Sema Checherinda
ef3a2fef01 work with tests 2024-05-29 16:45:32 +02:00
Robert Schulze
18d432f44c
Reapply "Remove some unnecessary UNREACHABLEs"
This reverts commit 5a868304c0.
2024-05-29 13:37:47 +00:00
kssenii
f85030f481 Better 2024-05-29 12:35:37 +02:00
Arthur Passos
5d37777b2d wrap get region for bucket in try catch and retry any net exception instead of only connection reset 2024-05-28 15:59:11 -03:00
Sema Checherinda
6771737c23 rm d-tor CompressedWriteBuffer, adjust WriteBufferFromFile 2024-05-28 16:54:18 +02:00
Sema Checherinda
0fad110d9e fix typo 2024-05-28 15:20:45 +02:00
Antonio Andelic
9f242391b4
Merge pull request #64153 from ClickHouse/fix-backup-without-native-copy
Correctly fallback during backup copy
2024-05-28 13:11:06 +00:00
kssenii
9e1cd7e898 Unify part of the code 2024-05-28 14:03:51 +02:00
kssenii
9d961d1936 Better 2024-05-28 13:54:34 +02:00
kssenii
73e9719768 Fix build 2024-05-28 12:51:58 +02:00
Sema Checherinda
86089a3a10 make write buffers cancelable 2024-05-28 00:09:39 +02:00
kssenii
56c7301d46 Use BaseSettings for auth settings 2024-05-27 18:28:37 +02:00
kssenii
5abebeca63 Use BaseSettings 2024-05-27 16:08:55 +02:00
Antonio Andelic
8f775037bf Address PR review 2024-05-27 13:02:45 +00:00
kssenii
80f195d2b9 Refactor s3 settings 2024-05-27 12:11:04 +02:00
Alexander Tokmakov
5a868304c0
Revert "Remove some unnecessary UNREACHABLEs" 2024-05-27 11:38:22 +02:00
Antonio Andelic
4f165733a4 Merge branch 'master' into fix-backup-without-native-copy 2024-05-27 07:40:55 +00:00
Robert Schulze
7a552f5b06
Merge pull request #64035 from rschu1ze/unreachable-unreachable
Remove some unnecessary `UNREACHABLE`s
2024-05-26 20:37:17 +00:00
Robert Schulze
f182920c98
Merge remote-tracking branch 'ClickHouse/master' into redundant-inline 2024-05-26 14:21:47 +00:00
Arthur Passos
a814f2445f fix cache ttl 2024-05-24 17:46:05 -03:00
Yakov Olkhovskiy
147ad42df0 fix notchunked mode in ReadBufferFromPocoSocketChunked 2024-05-24 03:36:29 +00:00
Sema Checherinda
942dc971ce
Merge branch 'master' into chesema-less-backoff-timeout 2024-05-23 16:58:57 +02:00
kssenii
3004f0b63d Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-23 16:51:46 +02:00
Robert Schulze
f792a602da
Merge remote-tracking branch 'rschu1ze/master' into unreachable-unreachable 2024-05-22 21:08:27 +00:00
Robert Schulze
f584807359
Merge remote-tracking branch 'rschu1ze/master' into redundant-inline 2024-05-22 21:05:27 +00:00
Sema Checherinda
1d0b4eb976
Merge branch 'master' into chesema-less-backoff-timeout 2024-05-22 15:50:49 +02:00
Kruglov Pavel
fddedee9a9
Merge pull request #59747 from Blargian/56257_parse_crlf_with_TSV_files
Parse CRLF with TSV files
2024-05-22 13:45:07 +00:00
kssenii
1059b51177 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-22 14:13:27 +02:00
Kseniia Sumarokova
fda0b33061
Merge pull request #64117 from ClickHouse/fix-azure-multipart-upload-in-backup
Fix azure backup writing multipart blocks by 1mb (read buffer size) instead of `max_upload_part_size` (in non-native copy case)
2024-05-22 11:41:18 +00:00
Robert Schulze
0d3aeddc93
Merge remote-tracking branch 'rschu1ze/master' into unreachable-unreachable 2024-05-22 07:25:00 +00:00
Antonio Andelic
ef8faeffc0 Merge branch 'master' into fix-backup-without-native-copy 2024-05-22 09:00:07 +02:00
Yakov Olkhovskiy
9e747cd453 fix bug with profile stats in WriteBufferFromPocoSocket 2024-05-22 01:20:00 +00:00
Yakov Olkhovskiy
7ea6eb98b2 Merge branch 'master' into ft-chunked-protocol 2024-05-21 20:54:58 +00:00
avogar
06a131d751 Fix abort on uncaught exception in ~WriteBufferFromFileDescriptor in StatusFile 2024-05-21 18:46:21 +00:00
Sema Checherinda
103966534a Merge branch 'master' into chesema-less-backoff-timeout 2024-05-21 18:02:03 +02:00
kssenii
7b225ab59c Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-21 16:58:25 +02:00
alesapin
e3ac5f4d12
Merge pull request #64182 from ClickHouse/fix_azure_native_copy
One attempt to fix native copy for azure
2024-05-21 13:49:47 +00:00
Antonio Andelic
b80d878b4c Add test 2024-05-21 13:28:12 +02:00
alesapin
ef182b0356 Fix 2024-05-21 12:54:46 +02:00
alesapin
0b3102576e One attempt to fix native copy for azure 2024-05-21 11:43:16 +02:00
kssenii
c1fde88e6a Better error case handling 2024-05-21 11:06:24 +02:00
Antonio Andelic
d66f0d6420 Properly fallback when native copy fails 2024-05-21 10:36:19 +02:00
Robert Schulze
a14e58ab88
Merge remote-tracking branch 'rschu1ze/master' into redundant-inline 2024-05-21 05:15:35 +00:00
Yakov Olkhovskiy
6378184c7f fix, add some introspection functionality 2024-05-20 14:15:47 +00:00
Robert Schulze
70637b2ecf
Merge remote-tracking branch 'rschu1ze/master' into move-isallascii 2024-05-20 13:01:53 +00:00
Robert Schulze
7887ab3848
Merge remote-tracking branch 'rschu1ze/master' into unreachable-unreachable 2024-05-20 12:58:39 +00:00
Robert Schulze
2ceb8b9c8f
Merge remote-tracking branch 'rschu1ze/master' into redundant-inline 2024-05-20 12:56:38 +00:00
kssenii
ba325b6250 Merge remote-tracking branch 'origin/master' into fix-azure-multipart-upload-in-backup 2024-05-20 12:34:04 +02:00
alesapin
23e87ef80e Review fix 2024-05-20 11:56:44 +02:00
kssenii
357ec69677 Fix style check 2024-05-19 23:33:24 +02:00
kssenii
c2a613e94d Better 2024-05-19 22:08:36 +02:00
kssenii
93b11c57a0 Fix azure backup uploaded block size 2024-05-19 21:14:06 +02:00
alesapin
2765fd951c Properly support native copy for azure 2024-05-19 21:02:12 +02:00
Robert Schulze
113bb00005
Fix clang-tidy "-readability-redundant-inline-specifier" 2024-05-19 10:23:58 +00:00
Robert Schulze
2909e6451b
Move StringUtils.h/cpp back to Common/ 2024-05-19 09:39:36 +00:00
Robert Schulze
53e992af4f
Remove some unnecessary UNREACHABLEs 2024-05-17 11:46:07 +00:00
Sema Checherinda
af3e9c9295
Merge branch 'master' into chesema-less-backoff-timeout 2024-05-17 13:27:47 +02:00
kssenii
b53e9eec7b Support for archives (unfinished) 2024-05-17 11:09:59 +02:00
Han Fei
2e76275124
Merge pull request #63202 from hanfei1991/hanfei/fix-intersection
fix intersect parts when restart after drop range
2024-05-16 14:27:25 +00:00
kssenii
af6f124df0 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-16 16:02:35 +02:00
Sema Checherinda
6b8a1b5f80 Merge branch 'master' into chesema-less-backoff-timeout 2024-05-16 13:18:43 +02:00
Daniil Ivanik
9b09550176
Merge pull request #62259 from divanik/divanik/fix_archieve_support_in_s3
Add support of reading from archives in S3
2024-05-16 10:41:33 +00:00
Yakov Olkhovskiy
ee74d0de8c
Merge branch 'master' into ft-chunked-protocol 2024-05-15 16:56:10 -04:00
Yakov Olkhovskiy
ad204887a2 bugs fixed, switch chunk length to little endian 2024-05-15 20:47:54 +00:00
Sema Checherinda
ff01ca80b4 reduce retires time for queries, increase retries count for backups 2024-05-15 16:37:42 +02:00
Han Fei
171bf4f201 Merge branch 'master' into hanfei/fix-intersection 2024-05-15 13:59:52 +02:00
kssenii
5ede316ec5 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-15 12:52:25 +02:00
Antonio Andelic
9744feb95e Fix deadlock in parallel read buffer 2024-05-15 11:02:10 +02:00
Yakov Olkhovskiy
88a833335f fix 2024-05-14 20:25:26 +00:00
Yakov Olkhovskiy
dfdf31f1b6 host-net conversion 2024-05-14 18:09:11 +00:00
Yakov Olkhovskiy
daf8277e55 fix 2024-05-14 16:00:58 +00:00
Yakov Olkhovskiy
05e823a1e9 add chunked wrapper to native protocol 2024-05-14 15:37:20 +00:00
avogar
a7e87e22ad Merge branch 'master' of github.com:ClickHouse/ClickHouse into 56257_parse_crlf_with_TSV_files 2024-05-14 11:56:43 +00:00
kssenii
9ce465bb88 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-13 16:14:58 +02:00
Antonio Andelic
449aacb3d0
Correct 2024-05-13 15:08:52 +02:00
Antonio Andelic
2b38b8a97b
Correct byte count 2024-05-13 14:49:26 +02:00
Anton Popov
47d0eadb6f Merge remote-tracking branch 'upstream/master' into HEAD 2024-05-13 12:12:31 +00:00
divanik
faef8807d2 Resolve conflicts 2024-05-13 12:04:06 +00:00
divanik
d468a0a577 Add archives reading support to s3 2024-05-13 12:00:15 +00:00
Antonio Andelic
e65dd3d939 Cancel S3 reads properly when parallel reads are used 2024-05-13 12:36:29 +02:00
Alexey Milovidov
23cf6d0d8b Useless changes 2024-05-11 22:51:57 +02:00
Anton Popov
9ed3acce82 refactoring near azure blob storage 2024-05-10 18:22:23 +00:00
Alexey Milovidov
224e1940ae Useless changes 2024-05-09 03:58:34 +02:00
Alexey Milovidov
0d14a2c67e Useless changes 2024-05-09 03:11:02 +02:00
Alexey Milovidov
1d69518c4d Useless changes 2024-05-09 02:07:04 +02:00
Alexey Milovidov
95f12ef274 Useless changes 2024-05-09 01:08:33 +02:00
Han Fei
116055b532 refine load part logic 2024-05-08 15:04:16 +02:00
Han Fei
746e96eddd Merge branch 'master' into hanfei/fix-intersection 2024-05-07 23:54:54 +02:00
Han Fei
13b312092c rewrite load part logic 2024-05-07 23:54:49 +02:00
kssenii
cd093ca793 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-07 12:50:48 +02:00
Shaun Struwig
3316df88aa
Merge branch 'ClickHouse:master' into 59557_form_input_format 2024-05-05 05:30:40 +02:00
Shaun Struwig
2b4def9ebb
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-05-05 05:30:26 +02:00
kssenii
e9d9f2bc25 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-03 13:55:12 +02:00
Sema Checherinda
083bcfc1ce distinct message for s3 error 'no key' for cases disk and storage 2024-05-02 13:08:25 +02:00
Shaun Struwig
40f33b6236
Merge branch 'ClickHouse:master' into 59557_form_input_format 2024-04-29 10:25:47 +02:00
kssenii
7a416f2e76 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-28 12:19:32 +02:00
Azat Khuzhin
d278866d52 Add copy_data_failpoint failpoint
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-28 07:34:07 +02:00
Shaun Struwig
a69658b1dd
Merge branch 'ClickHouse:master' into 59557_form_input_format 2024-04-27 21:40:58 +02:00
kssenii
91014456b5 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-26 19:24:07 +02:00
kssenii
18e4c0f1da Fix remaining integration test 2024-04-26 13:35:18 +02:00
Kruglov Pavel
52e3c3aa4e
Merge branch 'master' into 56257_parse_crlf_with_TSV_files 2024-04-24 16:20:19 +01:00
Smita Kulkarni
065eceecbf Merge branch 'master' into Azure_write_buffer_parallel_upload 2024-04-19 17:37:15 +02:00
Robert Schulze
7dc05d092b
Merge remote-tracking branch 'rschu1ze/master' into be-less-boring-32 2024-04-15 16:35:10 +00:00
kssenii
27672e1dfc Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-15 11:28:14 +01:00
Alexander Tokmakov
d510c3ac55
Merge pull request #62266 from ClickHouse/cannot_allocate_thread
Add fault injection for "Cannot allocate thread"
2024-04-12 14:40:42 +00:00
Robert Schulze
dbc04c84dc
Merge pull request #62177 from rschu1ze/double-conversion
Bump `double-conversion` submodule
2024-04-12 13:28:33 +00:00
Smita Kulkarni
b8c77a4453 Support parallel write buffer for AzureBlobStorage 2024-04-11 10:13:41 +02:00
Alexander Tokmakov
87476b8b98 Merge branch 'master' into tavplubix-patch-10 2024-04-10 23:37:22 +02:00
Alexander Tokmakov
d8e97b51bf Merge branch 'master' into cannot_allocate_thread 2024-04-10 21:21:42 +02:00
Anton Popov
4a8c1bf6a3
Merge pull request #62306 from CurtizJ/azure-retryable-errors
Better handling of errors from azure storage
2024-04-10 13:38:33 +00:00
Nikita Taranov
a2147b8ded
Merge branch 'master' into keep_alive_max_reqs 2024-04-09 21:32:36 +02:00
Shaun Struwig
d5fe715b3b
Merge branch 'ClickHouse:master' into 59557_form_input_format 2024-04-09 18:11:06 +02:00
Robert Schulze
22e164c65d
Merge pull request #62375 from rschu1ze/static-instance2
Don't access static members through instance, pt. II
2024-04-09 14:37:24 +00:00
Nikita Taranov
d594cb2e41
Merge pull request #62208 from arthurpassos/s3_aws_private_link_style
Add support for S3 access through aws private link interface
2024-04-09 12:32:38 +00:00
Robert Schulze
4035334634
Merge remote-tracking branch 'rschu1ze/master' into static-instance2 2024-04-09 11:45:27 +00:00
Sema Checherinda
04ea8a85f2
Merge pull request #62249 from ClickHouse/chesema-keep-alive-send-and-receive
several fixes for client's keep alive connections
2024-04-09 10:27:28 +00:00
Alexander Gololobov
b3dd5f519d
Merge pull request #62348 from ClickHouse/http_log_levels
Reduce log levels for ReadWriteBufferFromHTTP retries
2024-04-09 07:02:31 +00:00
Shaun Struwig
971263c4e6
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-04-08 21:52:47 +02:00
Shaun Struwig
dde99cbe8c
Merge branch 'ClickHouse:master' into 59557_form_input_format 2024-04-08 21:51:57 +02:00
Robert Schulze
2418d673f1
Suppress false positives in leaksan 2024-04-08 11:03:43 +00:00
Robert Schulze
b8b74ff815
Suppress msan false positives 2024-04-08 11:03:35 +00:00
Robert Schulze
97281203b8
Don't access static members through instance, pt. II
clang-tidy rightfully complains
(-readability-static-accessed-through-instance) that static member
functions are accessed through non-static members
2024-04-07 11:09:35 +00:00
Robert Schulze
cd5a06892e
Merge remote-tracking branch 'rschu1ze/master' into double-conversion 2024-04-07 10:27:55 +00:00
Anton Popov
fa01f26def add test 2024-04-05 17:39:12 +00:00
Arthur Passos
14eb498477
Merge branch 'ClickHouse:master' into s3_aws_private_link_style 2024-04-05 12:34:23 -03:00
Arthur Passos
7d50bb8c4b fix ut once again 2024-04-05 12:33:43 -03:00
Alexander Gololobov
b2bcfaf344 Reduce log levels for ReadWriteBufferFromHTTP retries 2024-04-05 17:18:22 +02:00
Raúl Marín
7df11b1852
Merge pull request #62264 from Algunenano/nested_includes_Ñ
Remove more nested includes
2024-04-05 17:00:28 +02:00
kssenii
357e5e3ae6 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-05 16:15:56 +02:00
Sema Checherinda
dddb0d9f4a fix http_keep_alive_max_requests set up 2024-04-05 03:02:45 +02:00
Sema Checherinda
8b75b6ae77
Merge branch 'master' into chesema-keep-alive-send-and-receive 2024-04-05 01:04:22 +02:00
Sema Checherinda
ae3a199939 support max requests for keep alive 2024-04-05 00:37:29 +02:00
Sema Checherinda
dd852da339 add more debug logs 2024-04-05 00:30:03 +02:00
Alexander Tokmakov
5db9fbed52 cancel tasks on exception 2024-04-04 22:32:57 +02:00
Alexander Tokmakov
724f9b8a3e
Update ReadBufferFromPocoSocket.cpp 2024-04-04 20:14:33 +02:00
Robert Schulze
7ce2a47ba5
Merge pull request #62265 from rschu1ze/static-instance
Don't access static members through instance
2024-04-04 14:36:03 +02:00
Yarik Briukhovetskyi
edacb991e0
Merge pull request #62257 from yariks5s/fix_retention_docs
Fix s3-style link mapper for gcs
2024-04-04 14:30:33 +02:00
Shaun Struwig
05b2cfb563
Merge branch 'ClickHouse:master' into 59557_form_input_format 2024-04-04 14:26:42 +02:00
Arthur Passos
b7c0501ac2 fix ut 2024-04-04 09:26:37 -03:00
kssenii
be30806dbe Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-04 13:20:12 +02:00
Arthur Passos
c6aed8b793 add optional port to regex 2024-04-03 19:19:54 -03:00
Raúl Marín
2c2f2b9526 Missing include 2024-04-03 22:59:59 +02:00
Robert Schulze
de2a0be025
Don't access static members through instance
- clang-tidy rightfully complains (-readability-static-accessed-through-instance)
- not going to enable the warning for now to avoid breaking the build
2024-04-03 18:50:33 +00:00
Arthur Passos
be55c3533c default to path style 2024-04-03 15:48:30 -03:00
Raúl Marín
76b6c125ff Remove boost dep in wide integers when possible 2024-04-03 20:36:29 +02:00
yariks5s
ca27cf3fde fix mapper for gcs 2024-04-03 16:38:41 +00:00
Kruglov Pavel
05db73f518
Merge branch 'master' into 56257_parse_crlf_with_TSV_files 2024-04-03 17:17:44 +02:00
Arthur Passos
394a4f39ec remove unnecessary matching character 2024-04-03 10:37:39 -03:00
Sema Checherinda
8e6cbc8b31 several fixes for client's keep alive connections 2024-04-03 15:13:59 +02:00
Arthur Passos
f6a240b7be add some unit tests 2024-04-03 10:11:56 -03:00
Arthur Passos
15dd5ce5f6 use raw literal string 2024-04-03 08:39:16 -03:00
Sema Checherinda
19e85c58cf
Merge pull request #62068 from ClickHouse/chesema-fix-url-storage
ReadWriteBufferFromHTTP set right header host when redirected
2024-04-03 12:52:49 +02:00
Arthur Passos
c1fd9262a7 change exception placeholder 2024-04-02 18:42:57 -03:00
Arthur Passos
0ad3ed5ae3 Add support for S3 access through aws private link interface 2024-04-02 18:38:58 -03:00
Robert Schulze
7d87adc91a
Upgrade double-conversion to 3.3.0 2024-04-02 13:51:36 +00:00
Raúl Marín
c35a436435 Remove nested dependency on DateLutImpl 2024-04-02 14:45:48 +02:00
Raúl Marín
40a22ffa63 Remove a few nested include dependencies 2024-04-02 13:43:14 +02:00
Sema Checherinda
9a9f0161bb add test 2024-04-01 01:33:40 +02:00
Sema Checherinda
1ea058a702 ReadWriteBufferFromHTTP set right header host when redireced 2024-03-28 19:33:23 +01:00
Kruglov Pavel
9b5b44dd5f
Merge pull request #61889 from Avogar/allow-to-save-bad-json-escape-sequences
Add a setting to allow saving bad escape sequences in JSON input formats
2024-03-28 14:34:02 +01:00
kssenii
ca1c119115 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-27 22:32:44 +01:00
kssenii
e0c02bf3af Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-27 19:27:07 +01:00
Shaun Struwig
0e76731c6a
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-03-27 03:06:51 +01:00
Michael Kolupaev
899b856ad6 Add profile events for number of HTTP requests and bytes read 2024-03-26 09:14:55 +00:00
Michael Kolupaev
1fb902c5b7 Fix sending a new request every 2 MB 2024-03-26 09:14:55 +00:00
avogar
dc87c483dd Add a setting to allow saving bad escape sequences in JSON input formats 2024-03-25 21:58:53 +00:00
Alexey Milovidov
21a0d17637
Merge branch 'master' into geodistance-double-precision 2024-03-25 17:47:42 +03:00
kssenii
46941e7243 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-25 15:10:11 +01:00
Alexey Milovidov
65650809b4 Double precision of geoDistance if the arguments are Float64 2024-03-24 23:11:35 +01:00
Smita Kulkarni
0d54dbf460 Merge branch 'master' into Azure_write_buffer 2024-03-24 20:09:47 +01:00
Alexey Milovidov
8ddfe9a48b
Merge pull request #61665 from ClickHouse/build-improvements-magic-enum-template-instantiation
Build improvements by removing magic enum from header and apply some explicit template instantiation
2024-03-24 19:31:46 +03:00
alesapin
a41c005a6e
Merge branch 'master' into Azure_write_buffer 2024-03-24 15:04:18 +01:00
Alexey Milovidov
056c8ce021
Merge pull request #59965 from nickitat/express_support
S3Express support
2024-03-23 20:52:44 +03:00
Smita Kulkarni
19e7022a87 Merge branch 'master' into Azure_write_buffer 2024-03-23 11:48:10 +01:00
Alexey Milovidov
3200aa3bcb
Merge pull request #61622 from YenchangChan/copy_s3_file
Remove duplicate code in copyS3File.cpp
2024-03-22 23:24:50 +03:00
Nikita Taranov
146d760338 rm more 2024-03-22 17:38:06 +00:00
Nikita Taranov
d7b34a80bb stash 2024-03-22 16:09:14 +00:00
Smita Kulkarni
929173cce2 Fix S3 buffer allocation 2024-03-21 19:18:16 +01:00
Smita Kulkarni
71eee6a300 Merge branch 'master' into Azure_write_buffer 2024-03-21 16:22:28 +01:00
Alexey Milovidov
43b50c0df1
Merge pull request #61694 from evillique/fix-msan-issue-2
Fix use-of-uninitialized-value in parseDateTimeBestEffort
2024-03-21 18:16:11 +03:00
Smita Kulkarni
6c5e881da7 Merge branch 'master' into Azure_write_buffer 2024-03-21 11:12:19 +01:00
Smita Kulkarni
e0d14a1eaf Updated lambda and name of BufferAllocationPolicy 2024-03-21 11:10:54 +01:00
Nikolay Degterinsky
f162ea8341 Fix use-of-uninitialized-value in parseDateTimeBestEffort 2024-03-21 09:51:10 +00:00
János Benjamin Antal
0b54b34b5b Avoid instantiation of CacheBase's ctor in header file 2024-03-20 17:00:36 +00:00
János Benjamin Antal
9e8c731e1e Remove some inclusion of magic enum 2024-03-20 17:00:36 +00:00
Smita Kulkarni
2c0e266cfe Addressed review comments 2024-03-20 10:58:46 +01:00
YenchangChan
e7aa23d332 Remove duplicate code in copyS3File.cpp 2024-03-20 17:02:28 +08:00
kssenii
0122c3e883 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-19 19:31:02 +01:00
Raúl Marín
de855ca917 Reduce header dependencies 2024-03-19 17:04:29 +01:00
Smita Kulkarni
45e15d16e5 Merge branch 'master' into Azure_write_buffer 2024-03-19 09:31:11 +01:00
Smita Kulkarni
0530055842 Updated names in BufferAllocationPolicy 2024-03-18 15:59:05 +01:00
Robert Schulze
c17536c3b3
Enable clang-tidy in headers 2024-03-18 08:00:09 +00:00
avogar
feda83a7c8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into 56257_parse_crlf_with_TSV_files 2024-03-14 17:44:38 +00:00
Robert Schulze
06d917fcf0
Merge pull request #61150 from rschu1ze/clang-tidy-list
Some clang-tidy fixes
2024-03-14 14:54:41 +01:00
Robert Schulze
3486b4a6e3
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list 2024-03-14 10:44:20 +00:00
Kseniia Sumarokova
bc9dd7bb0b
Merge branch 'master' into revive-cache-contention-fix 2024-03-13 16:52:00 +01:00
kssenii
3931351ec4 Pass timeout through setting 2024-03-13 12:36:47 +01:00
kssenii
296f7a1da2 Fix 2024-03-12 19:02:58 +01:00
Kseniia Sumarokova
f7ac982a6b
Merge branch 'master' into use-iobject-storage-for-table-engines-1 2024-03-12 15:18:19 +01:00
Robert Schulze
1b1685e3f1
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list 2024-03-12 13:02:59 +00:00
Shaun Struwig
f251a6d262
Merge branch 'ClickHouse:master' into 59557_form_input_format 2024-03-11 18:52:28 +01:00
Kseniia Sumarokova
38ba6990bb
Merge branch 'master' into use-iobject-storage-for-table-engines-1 2024-03-11 18:47:56 +01:00
Kseniia Sumarokova
4b94bcd54e
Update ReadSettings.h 2024-03-11 18:41:17 +01:00
kssenii
bfc4f5e1d3 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-11 14:57:15 +01:00
Robert Schulze
e5e84419af
Fix clang-tidy-s 2024-03-11 10:58:54 +00:00
Kseniia Sumarokova
3832b0e126
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-11 11:30:03 +01:00
kssenii
70272d4174 Minor 2024-03-11 10:55:01 +01:00
Smita Kulkarni
c724d36220 Merge branch 'master' into Azure_write_buffer 2024-03-11 09:27:24 +01:00
Sema Checherinda
77c5de700f fix how web disk read empty directories 2024-03-10 10:00:18 +01:00
Sema Checherinda
5c41727725 http connections pools 2024-03-10 10:00:18 +01:00
Shaun Struwig
b8ff9b8aca
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-03-08 22:13:26 +01:00
Smita Kulkarni
10b5ce8ab3 Updated BufferAllocationPolicy 2024-03-07 10:26:50 +01:00
Michael Kolupaev
fb1a684d98
Fix race in PageCache (#60878)
* Fix race in PageCache

* Transportation security administration

* Fix test flakiness, remove accidentally left over debug logging
2024-03-06 08:46:15 -08:00
kssenii
0c293bce11 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-06 12:06:19 +08:00
Blargian
2ad8ab2a57 Fix linker errors 2024-03-05 19:13:20 +01:00
Shaun Struwig
beb0d08bdb
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-03-05 14:09:01 +01:00
Kseniia Sumarokova
dbbe6b9f69
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-05 11:13:32 +08:00
Sema Checherinda
71029373f2
Merge pull request #60748 from Beetelbrox/fjurado/dont-add-metadata-headers-to-unsupported-multipart-steps
Prevent setting custom metadata headers on unsupported multipart upload operations
2024-03-04 17:04:33 +01:00
Alexey Milovidov
de6c5d3a40
Merge pull request #60552 from ClickHouse/pc2
Userspace page cache again
2024-03-04 17:47:35 +03:00
beetelbrox
e8f4e4eb77 Fix formatting 2024-03-04 12:54:55 +01:00
beetelbrox
229945cdd2 Fix whitespace 2024-03-04 10:32:45 +01:00
beetelbrox
53e0d01d5e Do not send metadata headers on unsupported multipartoperations 2024-03-04 10:28:27 +01:00
Alexey Milovidov
da2481c5c8 Merge remote-tracking branch 'origin/master' into remove-old-code-5 2024-03-04 00:12:03 +01:00
Alexey Milovidov
cbf5443585 Remove old code 2024-03-04 00:11:55 +01:00
Alexey Milovidov
d15f7b2158 Fix questionable behavior in the parseDateTimeBestEffort function 2024-03-03 01:42:59 +01:00
Shaun Struwig
b54286bed4
Merge branch 'master' into 56257_parse_crlf_with_TSV_files 2024-03-01 18:21:05 +01:00
Igor Nikonov
a28385966c
Merge pull request #60513 from ClickHouse/cleanup-random-progress-bar
Simple cleanup while fixing progress bar
2024-03-01 16:51:46 +01:00
Robert Schulze
3a5c9b627b
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-src 2024-03-01 10:31:55 +00:00
Smita Kulkarni
0f2d47e5a4 Renamed WriteBufferFromS3TaskTracker to ThreadPoolTaskTracker 2024-03-01 10:52:44 +01:00
Kseniia Sumarokova
5ac53c9578
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-01 11:05:47 +08:00
Robert Schulze
4ee1aa8c7c
Fixing more headers 2024-02-29 15:40:30 +00:00
Nikita Taranov
f9d1c5769e
Merge branch 'master' into express_support 2024-02-29 16:26:43 +01:00
Smita Kulkarni
5641fd8ba9 Fix build after merge 2024-02-29 16:13:05 +01:00
Joshua Hildred
58a8658528 Use std::array and std::any_of 2024-02-29 05:20:53 -08:00
Joshua Hildred
fe67293533 Add support for lzma 2024-02-29 05:20:53 -08:00
Joshua Hildred
ca9a6f809f add support for .tar.zst and tar.xz 2024-02-29 05:20:53 -08:00
Joshua Hildred
e6134bbb7b Address review comments 2024-02-29 05:20:52 -08:00
josh-hildred
f34ef716f0 Update src/IO/Archives/LibArchiveWriter.cpp
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-02-29 05:20:52 -08:00
josh-hildred
1ce6256479 Update src/IO/Archives/LibArchiveWriter.cpp
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-02-29 05:20:52 -08:00
josh-hildred
0fe15f0a22 Update src/IO/Archives/LibArchiveWriter.cpp
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-02-29 05:20:52 -08:00
josh-hildred
5963b67dff Update src/IO/Archives/LibArchiveWriter.cpp
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-02-29 05:20:52 -08:00
josh-hildred
6b32271b88 Update src/IO/Archives/LibArchiveWriter.cpp
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-02-29 05:20:52 -08:00
josh-hildred
f145b494c0 Update src/IO/Archives/LibArchiveWriter.h
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-02-29 05:20:52 -08:00
josh-hildred
84a3a05eb4 Update src/IO/Archives/LibArchiveReader.cpp
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-02-29 05:20:52 -08:00
Joshua Hildred
f7ab6b9e37 Move tar compression extension definitions 2024-02-29 05:20:52 -08:00
Joshua Hildred
c02502b6f1 Removed unused error code 2024-02-29 05:20:52 -08:00
Joshua Hildred
92b446a552 Add support for tar archive compression 2024-02-29 05:20:52 -08:00
Joshua Hildred
c3118ca742 Address review comments 2024-02-29 05:20:52 -08:00
josh-hildred
714fdeb906 Update src/IO/Archives/LibArchiveWriter.cpp
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-02-29 05:20:52 -08:00
josh-hildred
84814f2a0c Update src/IO/Archives/LibArchiveWriter.cpp
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-02-29 05:20:52 -08:00
josh-hildred
f94b5e95b2 Update src/IO/Archives/LibArchiveReader.cpp
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-02-29 05:20:52 -08:00
josh-hildred
e085b0fcf0 Update src/IO/Archives/IArchiveWriter.h
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-02-29 05:20:52 -08:00
Joshua Hildred
5fdeebf785 Fix parameter naming 2024-02-29 05:20:51 -08:00
Joshua Hildred
2e2b89f9aa Fix whitespace 2024-02-29 05:20:51 -08:00
Joshua Hildred
ef7a66b542 Update error messages and error handling 2024-02-29 05:20:51 -08:00
Joshua Hildred
d0776e5d2a Fixes tidy issue and error formating for test 2024-02-29 05:20:51 -08:00
Joshua Hildred
dc74cebe4e Fix formating 2024-02-29 05:20:51 -08:00
Joshua Hildred
c53021f55e Fix formating 2024-02-29 05:20:51 -08:00
Joshua Hildred
48ad506fe3 Cleaned up the uses of the libarchive structs 2024-02-29 05:20:51 -08:00
josh-hildred
4c1ac01e25 Update src/IO/Archives/LibArchiveReader.cpp
Co-authored-by: ltrk2 <107155950+ltrk2@users.noreply.github.com>
2024-02-29 05:20:51 -08:00