170 Commits

Author	SHA1	Message	Date
kssenii	8915f49b7d	Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes	2023-04-03 17:43:42 +02:00
Anton Popov	ff1cc5598f	fix clang-tidy	2023-04-02 22:21:10 +00:00
Anton Popov	38389d878c	fix one more race in StorageS3	2023-03-30 21:06:53 +00:00
Anton Popov	ed29c141fb	fix race in StorageS3	2023-03-29 22:13:45 +00:00
kssenii	13f29a7242	Better	2023-03-28 18:57:24 +02:00
kssenii	36cc6fee51	Rewrite data lakes (part 1)	2023-03-24 22:35:12 +01:00
kssenii	e48d8d12e7	Fixes for hudi	2023-03-17 19:44:30 +01:00
flynn	b3a9468661	fix	2023-02-17 12:42:24 +00:00
flynn	4b1d997b82	fix	2023-02-17 12:27:53 +00:00
flynn	1d5b7ebc73	fix	2023-02-17 09:01:13 +00:00
flynn	a39f6f419b	refactor	2023-02-17 08:27:52 +00:00
flynn	7f4c23ec8a	fix	2023-02-16 12:48:22 +00:00
flynn	2968cdc8f6	fix	2023-02-16 10:18:22 +00:00
flynn	ecc39978d7	fix conflict	2023-02-16 02:23:55 +00:00
Kruglov Pavel	4f380370a9	Fix s3Cluster schema inference in parallel distributed insert select (#46381) ... * Fix s3Cluster schema inference in parallel distributed insert select * Try fix flaky test * Try SYSTEM SYNC REPLICA to avoid test flakiness	2023-02-15 15:30:43 +01:00
flynn	289c5c60d3	fix	2023-02-15 11:24:06 +00:00
flynn	18cf72147e	remove more redundant header files	2023-02-15 07:02:44 +00:00
flynn	f31451822e	fix	2023-02-15 03:56:01 +00:00
flynn	c49a293a9f	refactor and get rid of s3	2023-02-13 12:39:54 +00:00
flynn	d3dd9421da	refactor and get rid of s3	2023-02-13 08:29:22 +00:00
flynn	db15634a01	fix conflict	2023-02-10 08:41:04 +00:00
kssenii	ab0dedf0c8	Simplify code around storage s3 configuration	2023-02-06 16:23:17 +01:00
flynn	0dd8a61a8e	fix conflict	2023-02-06 03:25:12 +00:00
Antonio Andelic	d5117f2aa6	Define S3 client with bucket and endpoint resolution (#45783) ... * Update aws * Define S3 client with bucket and endpoint resolution * Add defines for ErrorCodes * Use S3Client everywhere * Remove unused errorcode * Add DROP S3 CLIENT CACHE query * Add a comment * Fix style * Update aws * Update reference files * Add missing include * Fix unit test * Remove unneeded declarations * Correctly use RetryStrategy * Rename S3Client to Client * Fix retry count * fix clang-tidy warnings	2023-02-03 14:30:52 +01:00
flynn	fd1ee98183	fix style	2023-01-31 14:40:48 +00:00
flynn	ffddc0dcce	fix conflict	2023-01-31 10:28:58 +00:00
flynn	fc2ce9e8e2	refactor and unify storage data lake	2023-01-29 14:53:56 +00:00
flynn	9b517cdc76	fix conflict	2023-01-29 08:34:56 +00:00
Vitaly Baranov	aea9ccdb60	Pass request settings to S3::getObjectInfo().	2023-01-27 15:10:09 +01:00
Vitaly Baranov	a8304525ed	Move getObjectInfo() to a separate header.	2023-01-27 15:09:38 +01:00
Anton Popov	8a1ea62aec	fix race on cancelation of query in StorageS3	2023-01-24 01:12:01 +00:00
flynn	2fb32dc56c	fix and add test	2023-01-18 08:33:55 +00:00
Kruglov Pavel	04d95f4877	Fix	2023-01-16 16:47:04 +01:00
avogar	6cb7c4d175	Better commit, mark noexcept	2023-01-13 16:33:11 +00:00
avogar	76c89c6d20	Fix heap-use-after-free in reading from s3	2023-01-13 16:31:30 +00:00
Anton Popov	79e89cf69c	Merge pull request #44939 from ClickHouse/revert-44493-s3_optimize ... Revert "If user only need virtual columns, we don't need to initialize ReadBufferFromS3"	2023-01-10 10:42:18 +01:00
Anton Popov	4447afb14d	Revert "If user only need virtual columns, we don't need to initialize ReadBufferFromS3"	2023-01-05 16:38:20 +01:00
kssenii	67509aa2d5	Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2	2023-01-03 16:41:30 +01:00
xiedeyantu	d6a92fbd63	better	2022-12-28 10:11:33 +08:00
xiedeyantu	b5fd23358f	fixed	2022-12-23 19:11:51 +08:00
xiedeyantu	6a9ec7efb1	If user only need virtual columns, we don't need to initialize ReadBufferFromS3	2022-12-21 23:43:56 +08:00
kssenii	6bd4f8c029	Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2	2022-12-20 21:17:28 +01:00
kssenii	30547d2dcd	Replace old named collections code for url	2022-12-17 00:24:05 +01:00
Anton Popov	8b9b8b083c	Merge pull request #43726 from CurtizJ/optimize-storage-s3 ... Improve performance of storage `S3` with large number of small files	2022-12-16 14:38:10 +01:00
kssenii	9aa6d31bce	Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code	2022-12-13 22:25:10 +01:00
kssenii	fae817863c	Apply new code of named collections to s3	2022-12-13 22:19:09 +01:00
Anton Popov	6cd606ffeb	better saving of object info in iterator	2022-12-13 17:18:17 +00:00
Anton Popov	0c87031e80	Merge remote-tracking branch 'upstream/master' into HEAD	2022-12-13 16:33:21 +00:00
kssenii	c7429d19e7	Merge remote-tracking branch 'upstream/master' into fix-progress-from-s3	2022-12-05 18:32:47 +01:00
Anton Popov	fe5fff0347	Merge pull request #43329 from xiedeyantu/support_nested_column ... s3 table function can support select nested column using {column_name}.{subcolumn_name}	2022-11-29 22:27:19 +01:00