513 Commits

Author	SHA1	Message	Date
Robert Schulze	f5e8028bb1	Merge pull request #54642 from rschu1ze/broken-re2st ... Remove broken lockless variant of re2	2023-09-17 15:30:57 +02:00
Robert Schulze	7b378dbad3	Remove broken lockless variant of re2	2023-09-14 16:40:42 +00:00
Andrey Zvonov	ff16ddbbb3	Merge branch 'ClickHouse:master' into zvonand-globs-small-fix	2023-09-14 11:31:49 +03:00
avogar	2d8f33bfa2	Fix parsing error in WithNames formats while reading subset of columns with disabled input_format_with_names_use_header	2023-09-11 14:55:37 +00:00
Andrey Zvonov	ff4586e663	Merge branch 'ClickHouse:master' into zvonand-globs-small-fix	2023-09-08 18:17:06 +02:00
zvonand	c36a3fbd39	renamed setting	2023-09-07 12:00:25 +03:00
alesapin	095bb37bc4	Merge pull request #54244 from bigo-sg/hdfs-config ... Minor improvement, load from config	2023-09-05 12:36:38 +02:00
zhanglistar	a2fd3a4de8	remove unnecessary check for HDFS load config	2023-09-04 17:52:43 +08:00
kssenii	9eb1dfcd12	Refactor buffers reading from object storage	2023-09-01 14:03:07 +02:00
Andrey Zvonov	2447eb027c	Update StorageHDFS.cpp	2023-08-28 15:12:44 +03:00
Andrey Zvonov	911bf94fbd	Merge branch 'master' into zvonand-globs-small-fix	2023-08-25 23:50:07 +05:00
avogar	c4f8113a78	Fix tests	2023-08-24 15:05:45 +00:00
Kruglov Pavel	f7e1abd774	Merge branch 'master' into cache-count	2023-08-23 22:31:49 +02:00
avogar	894513f6cd	Fix tests	2023-08-23 18:43:08 +00:00
Kruglov Pavel	592fa77987	Merge branch 'master' into cache-count	2023-08-23 15:18:02 +02:00
Kruglov Pavel	7e362a2110	Merge branch 'master' into fast-count-from-files	2023-08-23 15:13:20 +02:00
robot-ch-test-poll1	c22ffa6195	Merge pull request #53529 from Avogar/filter-files-all-table-functions ... Use filter by file/path before reading in url/file/hdfs table functins	2023-08-23 14:21:23 +02:00
Kruglov Pavel	a83a868acd	Update src/Storages/HDFS/StorageHDFS.cpp ... Co-authored-by: Dmitry Novik <mrnovikd@gmail.com>	2023-08-22 19:08:04 +02:00
Kruglov Pavel	67c5c0203b	Merge branch 'master' into fast-count-from-files	2023-08-22 15:03:48 +02:00
avogar	7f9e81d504	Clean up	2023-08-22 12:55:00 +00:00
Kruglov Pavel	c0bdd0e00b	Merge branch 'master' into cache-count	2023-08-22 14:42:22 +02:00
avogar	b4145aeddc	Cache number of rows in files for count in file/s3/url/hdfs/azure functions	2023-08-22 11:59:59 +00:00
Michael Kolupaev	2f4d433e69	Parquet filter pushdown	2023-08-21 14:15:52 -07:00
avogar	47304bf7aa	Optimize count from files in most input formats	2023-08-21 12:30:52 +00:00
avogar	8e445b5461	Fixes	2023-08-18 17:49:40 +00:00
avogar	4c32097df3	Use filter by file/path before reading in url/file/hdfs table functions, reduce code duplication	2023-08-17 16:54:43 +00:00
zvonand	086bf6cb8c	added ignore_eacces_multidirectory_globs	2023-08-11 15:49:21 +03:00
zvonand	e4a1780bd7	update docs according to the PR + fix the same for HDFS	2023-08-10 15:29:27 +03:00
Kruglov Pavel	b1fe9ce8f7	Merge branch 'master' into formats-with-subcolumns	2023-08-04 13:01:12 +02:00
Kseniia Sumarokova	68b48a0bc0	Merge pull request #50063 from KevinyhZou/minor_improve_hdfs_read_buffer ... Minor improve HDFS ReadBuffer for read end of file	2023-08-03 17:55:48 +02:00
Anton Popov	ff137773e7	Merge branch 'master' into formats-with-subcolumns	2023-08-02 15:24:56 +02:00
Kseniia Sumarokova	ccf9fa9641	Update ReadBufferFromHDFS.cpp	2023-08-01 11:55:08 +02:00
Kseniia Sumarokova	5880a0a372	Update ReadBufferFromHDFS.cpp	2023-08-01 11:50:31 +02:00
Kseniia Sumarokova	74c0574d51	Update ReadBufferFromHDFS.cpp	2023-07-31 15:22:16 +02:00
Kseniia Sumarokova	dd85c3c114	Update ReadBufferFromHDFS.cpp	2023-07-30 22:40:11 +02:00
Kseniia Sumarokova	30b6cf0713	Merge branch 'master' into minor_improve_hdfs_read_buffer	2023-07-30 13:33:24 +02:00
Al Korgun	ebbd662071	Merge branch 'ClickHouse:master' into fix-named-collections-on-cluster-23.7	2023-07-27 23:31:35 +03:00
robot-ch-test-poll1	abc48a0b73	Merge pull request #52627 from ClickHouse/fix_build_with_clang15 ... Fix build with clang-15	2023-07-27 09:49:29 +02:00
Илья Коргун	5395d34fd7	Fix missing constructor call	2023-07-27 10:32:10 +03:00
Alexander Tokmakov	74f3e76b18	fix build with clang-15	2023-07-26 17:15:28 +02:00
Kruglov Pavel	0d34e97dbe	Merge branch 'master' into formats-with-subcolumns	2023-07-26 13:30:35 +02:00
Kruglov Pavel	fec5675cd4	Merge branch 'master' into better-progress-bar-2	2023-07-24 19:59:38 +02:00
Kseniia Sumarokova	d34f2bed07	Merge pull request #51386 from bigo-sg/fix_hdfs_read_buffer_heap_overflow ... Fix heap overflow in read buffer from hdfs when read_until_position is not zero	2023-07-22 15:00:58 +02:00
Kseniia Sumarokova	6ea96f0686	Merge branch 'master' into minor_improve_hdfs_read_buffer	2023-07-22 14:37:56 +02:00
avogar	3682254342	Fix hdfs tests	2023-07-18 13:49:23 +00:00
Kruglov Pavel	64e88cde21	Merge branch 'master' into better-progress-bar-2	2023-07-18 13:37:53 +02:00
Kruglov Pavel	1dd05319b5	Merge branch 'master' into formats-with-subcolumns	2023-07-17 19:13:42 +02:00
李扬	6aec25e681	Merge branch 'master' into fix_hdfs_read_buffer_heap_overflow	2023-07-11 10:03:09 +08:00
Andrey Zvonov	c030e9dbe4	Merge branch 'master' into zvonand-issue-49290	2023-07-10 11:01:26 +02:00
avogar	810d1ee069	Fix tests	2023-07-06 13:48:57 +00:00
avogar	d11cd0dc30	Fix tests	2023-07-05 17:56:03 +00:00
avogar	98aa6b317f	Support reading subcolumns from file/s3/hdfs/url/azureBlobStorage table functions	2023-07-04 21:17:26 +00:00
Kseniia Sumarokova	a8e2eb9686	Merge branch 'master' into minor_improve_hdfs_read_buffer	2023-07-01 13:19:21 +02:00
Kseniia Sumarokova	349083e673	Update ReadBufferFromHDFS.cpp	2023-06-30 13:54:57 +02:00
avogar	f88c1fdf44	Fixes	2023-06-29 11:59:09 +00:00
avogar	4eeb431003	Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-progress-bar-2	2023-06-28 18:53:08 +00:00
李扬	0e15266170	Merge branch 'master' into improve_geohash	2023-06-26 14:54:44 +08:00
taiyang-li	769169f820	fix heap overflow in read buffer from hdfs	2023-06-25 18:26:53 +08:00
Andrey Zvonov	0b6688ffe4	Merge branch 'master' into zvonand-issue-49290	2023-06-24 12:36:27 +02:00
avogar	938a9ee3c1	Better	2023-06-23 14:03:59 +00:00
avogar	c679dd400e	Make better	2023-06-23 13:43:40 +00:00
avogar	24fab7bfde	Remove old includes	2023-06-22 18:48:15 +00:00
avogar	cf082f2f9a	Use read_bytes/total_bytes_to_read for progress bar in s3/file/url/... table functions	2023-06-22 17:24:43 +00:00
Andrey Zvonov	18e7b029d5	Merge branch 'master' into zvonand-issue-49290	2023-06-22 17:20:24 +02:00
Sema Checherinda	d0bb985061	fix other classes based on SinkToStorage	2023-06-22 14:33:25 +02:00
Sema Checherinda	95349a405b	release buffers with exception context	2023-06-22 13:00:13 +02:00
Sema Checherinda	01de36f1fa	Merge pull request #50395 from CheSema/better-log ... require `finalize()` call before d-tor for all writes buffers	2023-06-21 21:12:02 +02:00
avogar	1d80072c21	Fix tests and builds	2023-06-20 13:01:47 +00:00
zvonand	4e61f93fde	upd	2023-06-19 23:44:59 +02:00
zvonand	b25555d445	update style	2023-06-17 13:49:15 +02:00
zvonand	1c10578f14	update to master	2023-06-16 21:30:47 +02:00
Sema Checherinda	e8d4dedbcc	fix build and tests	2023-06-16 19:52:52 +02:00
avogar	3209ebe34b	Improve progress bar for file/s3/hdfs/url table functions. Step 1	2023-06-16 15:51:18 +00:00
avogar	870f3d1270	Fix comments	2023-06-15 12:59:46 +00:00
Andrey Zvonov	2f572b7211	Merge branch 'master' into zvonand-issue-49290	2023-06-14 14:22:32 +02:00
zvonand	1d8013074d	fix style & black	2023-06-13 18:47:02 +02:00
avogar	2e1f56ae33	Address comments	2023-06-13 14:43:50 +00:00
Andrey Zvonov	cd1a3916a6	cleanup HDFS	2023-06-12 13:28:17 +02:00
zvonand	7d7bd5bb66	update comment describing workflow	2023-06-12 11:50:23 +02:00
zvonand	2c97a94892	fix hdfs + style update	2023-06-11 01:50:17 +02:00
Kruglov Pavel	bf28074d32	Merge branch 'master' into allow-skip-empty-files	2023-06-08 12:36:18 +02:00
Antonio Andelic	b11f744252	Correctly disable async insert with deduplication when it's not needed (#50663) ... * Correctly disable async insert when it's not used * Better * Add comment * Better * Fix tests --------- Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>	2023-06-07 20:33:08 +02:00
Kruglov Pavel	f99a7366da	Fix tests	2023-06-01 16:56:18 +02:00
Kruglov Pavel	0beca0336d	Merge pull request #49112 from ClickHouse/Avogar-patch-3 ... Fix possible terminate called for uncaught exception in some places	2023-05-31 16:55:43 +02:00
avogar	d4efbbfbd3	Allow to skip empty files in file/s3/url/hdfs table functions	2023-05-30 19:32:24 +00:00
Sergei Trifonov	0d1f2e297b	Unify priorities: lower value means higher priority (#50205)	2023-05-26 15:55:30 +02:00
kevinyhzou	15b847b410	init file_size as 0	2023-05-24 09:49:12 +08:00
Kruglov Pavel	b5cad024e0	Merge branch 'master' into urlCluster	2023-05-22 14:59:34 +02:00
taiyang-li	1f91a75b54	fix bugs of geoHashEncode	2023-05-22 15:52:58 +08:00
kevinyhzou	e6d6d41f22	minor improve read buffer of hdfs	2023-05-22 12:23:31 +08:00
kssenii	3e42ee7f2b	Get rid of finalize callback in object storages	2023-05-19 17:29:37 +02:00
avogar	334f062fa0	fix style	2023-05-15 16:39:26 +00:00
avogar	f9e0eb47d7	Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster	2023-05-15 16:35:24 +00:00
Alexey Milovidov	5a44dc26e7	Fixes for clang-17	2023-05-13 02:57:31 +02:00
avogar	70a8fd2c50	Fix schema inference with named collection, refactor Cluster table functions	2023-05-12 13:58:45 +00:00
avogar	3ee8de792c	Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster	2023-05-11 12:46:20 +00:00
kssenii	ecfbf1e304	Remove dependency from DB::Context in readers	2023-05-02 21:45:27 +02:00
avogar	c503f6532c	Add more finalize() to avoid terminate	2023-04-24 15:11:36 +00:00
avogar	2949ceced1	Fix adding structure to cluster table functions, make it better	2023-04-24 13:20:04 +00:00
Alexey Milovidov	31000978f4	Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards	2023-04-23 16:18:48 +03:00