Commit Graph

150 Commits

Author SHA1 Message Date
Sema Checherinda
d9e15c00c9 limit the delay before next try in S3 2023-09-14 19:45:07 +02:00
kssenii
9eb1dfcd12 Refactor buffers reading from object storage 2023-09-01 14:03:07 +02:00
Sema Checherinda
60103c577d
Merge pull request #53651 from CheSema/read_beyon_last_offset
fix Logical Error in AsynchronousBoundedReadBuffer
2023-08-23 11:21:47 +02:00
Sema Checherinda
7e4e6e31dc
NOLINT on sscanf in gtest 2023-08-22 13:32:21 +02:00
Sema Checherinda
ae5f66da1e fix special build 2023-08-22 11:34:08 +02:00
Sema Checherinda
81577e041b fix Logical Error in AsynchronousBoundedReadBuffer 2023-08-21 19:30:04 +02:00
Antonio Andelic
0e17d26b88 More formats supported, read single archive from 1 thread 2023-08-09 11:58:37 +00:00
Antonio Andelic
1fc1b6aae4 More fixes 2023-07-28 13:00:35 +00:00
Antonio Andelic
e83e0ec2cd Fix build 2023-07-28 12:26:56 +00:00
Antonio Andelic
720d587e85 Merge branch 'master' into add-reading-from-archives 2023-07-28 08:49:00 +00:00
Alexey Milovidov
59eadca95c
Merge branch 'master' into less-logs-2 2023-07-09 08:49:44 +03:00
Sema Checherinda
79a03432bf add test, add comment 2023-06-25 13:27:07 +02:00
Alexey Milovidov
7407330130
Merge branch 'master' into retry 2023-06-23 08:18:18 +03:00
Michael Kolupaev
4a570a05c9 Decrease default timeouts for S3 and HTTP requests 2023-06-21 18:08:50 +00:00
Sema Checherinda
1cb02e2710 do call finalize for all buffers 2023-06-16 16:38:18 +02:00
Sema Checherinda
aedd3afb8a
fix hung in unit tests (#50391)
* fix hung in unit tests

* Update gtest_writebuffer_s3.cpp

* Update gtest_writebuffer_s3.cpp

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-05-31 19:20:58 +03:00
Vitaly Baranov
6d45d0c374
Use fingerprints instead of key IDs in encrypted disks (#49882)
* Use fingerprints instead of key IDs to find keys in encrypted disks.
Always use little endian in the headers of encryption files.

* Add tests.

* Fix copying binary files to test containers.

* Fix ownership for copied files in test containers.

* Add comments after review.

---------

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-05-31 13:11:10 +02:00
nikitakeba
f604fb82b2
Merge branch 'master' into add-reading-from-archives-support 2023-05-29 23:34:19 +03:00
Nikita Keba
04450a2042 add CheckFileInfo Unit Tests 2023-05-29 20:28:15 +00:00
Nikita Keba
8cf79cdb6c add SevenZipArchiveReader unit tests 2023-05-29 19:55:46 +00:00
Nikita Keba
636d50caa0 fix cmake + add unit tests for TarArchiveReader 2023-05-29 19:35:24 +00:00
kssenii
8924c17575 Fix build 2023-05-20 13:31:27 +02:00
Sema Checherinda
22f7aa8d89 make special build pass 2023-05-12 12:00:15 +02:00
Sema Checherinda
7fbf87be17 rework WriteBufferFromS3, squashed 2023-05-10 18:31:47 +00:00
Alexey Milovidov
9d6c3d7a4c
Merge pull request #48920 from awfeequdng/bugfix/maskLowBits
A non significant change (does not affect anything): add support for signed integers in the maskBits function
2023-04-21 13:22:44 +03:00
pengxiangcai
c7d6b8b643 add maskLowBits test 2023-04-20 21:33:41 +08:00
vdimir
92d0d9d4ff Http temporary buffer integration with fs cache 2023-04-19 16:44:21 +02:00
Azat Khuzhin
9ea4a55ddf Add a test for stringstream with INT_MAX
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-17 10:46:39 +02:00
Robert Schulze
05606a8835
Clean up GCC warning pragmas 2023-04-11 18:21:08 +00:00
Raúl Marín
b4ea2268ca Adapt unit tests to the new exception 2023-04-03 10:54:47 +02:00
Robert Schulze
f72a337074
Remove cruft from build
No need to check compiler flags, clang >= 15 supports all of them.
2023-03-17 13:44:04 +00:00
Mike Kot
9920a52c51 use std::lerp, constexpr hex.h 2023-03-07 22:50:17 +00:00
avogar
3c5a81f9f9 Add unit test for recursive checkpoints 2023-01-24 01:20:13 +00:00
Joanna Hulboj
501cc390f6 Prevent duplicates in column name hints. Improve formatting. 2022-12-22 16:58:30 +00:00
xiedeyantu
c258d3ac8b fix s3 support question mark wildcard 2022-11-18 12:11:22 +08:00
Raúl Marín
d4a0b76abf Fix compilation 2022-11-11 12:08:43 +01:00
Nikita Taranov
49f6692a2e
Adapt internal data structures to 512-bit era (#42564)
* impl

* update tests

* fix tests
2022-10-25 13:56:28 +02:00
Robert Schulze
78fc36ca49
Generate config.h into ${CONFIG_INCLUDE_PATH}
This makes the target location consistent with other auto-generated
files like config_formats.h, config_core.h, and config_functions.h and
simplifies the build of clickhouse_common.
2022-09-28 12:48:26 +00:00
Alexey Milovidov
730655d4fd Fix 8/9 of trash 2022-09-19 08:53:20 +02:00
Kruglov Pavel
ae81341ab5
Fix hadoop unit test 2022-08-22 12:42:18 +02:00
Sema Checherinda
f8480c26e7 do not trigger allocator to return null under sanitizers 2022-08-19 11:22:34 +02:00
Sema Checherinda
128e1fec3d Memory don't do alignment by itself, Allocator does 2022-08-18 16:01:30 +02:00
Sema Checherinda
b101ebdf32 check integer overflow at Memory class 2022-08-18 14:30:52 +02:00
Vitaly Baranov
2f3b27d1ac Fix seeking while reading from encrypted disk. 2022-07-29 12:45:29 +02:00
Vitaly Baranov
3b6bacbf0b Add tests. 2022-07-28 22:38:50 +02:00
Kseniia Sumarokova
38c87ab9cd
Merge pull request #36493 from kssenii/fix-encrypted-buffer
Fix offset update ReadBufferFromEncryptedFile
2022-05-18 09:46:17 +02:00
kssenii
b53ca506e6 Add unit test 2022-05-17 14:55:42 +02:00
Robert Schulze
1b81bb49b4
Enable clang-tidy modernize-deprecated-headers & hicpp-deprecated-headers
Official docs:

  Some headers from C library were deprecated in C++ and are no longer
  welcome in C++ codebases. Some have no effect in C++. For more details
  refer to the C++ 14 Standard [depr.c.headers] section. This check
  replaces C standard library headers with their C++ alternatives and
  removes redundant ones.
2022-05-09 08:23:33 +02:00
Sergei Trifonov
75c1053ad7 Merge remote-tracking branch 'origin/master' into surahman-CH-31221-AWS-S3-object-version-id 2022-04-19 13:17:25 +02:00
Alexey Milovidov
33ffdcaa4f Return two changes 2022-04-16 02:18:22 +02:00