37 Commits

Author	SHA1	Message	Date
kssenii	e51313b6b3	Get rid of static threadpools	2022-09-07 17:48:11 +02:00
kssenii	5dd1bb2fd8	improvements for getFileSize	2022-06-20 15:22:56 +02:00
Antonio Andelic	08c20be4d0	Cleaner exception handling in ParallelReadBuffer	2022-06-01 11:51:01 +00:00
Antonio Andelic	f49dd19e7a	Revert "Initialize ParallelReadBuffer after construction" ... This reverts commit 31e1e67836.	2022-06-01 11:43:58 +00:00
Antonio Andelic	31e1e67836	Initialize ParallelReadBuffer after construction	2022-06-01 06:25:32 +00:00
Antonio Andelic	29e0edd49f	Unlock mutex before destroying worker	2022-05-04 06:30:54 +00:00
Antonio Andelic	fd0ba2d10b	Protect background exception	2022-05-03 06:34:03 +00:00
Antonio Andelic	bfdb4566c6	Use mutex per worker	2022-05-03 06:18:39 +00:00
Amos Bird	4a5e4274f0	base should not depend on Common	2022-04-29 10:26:35 +08:00
Kseniia Sumarokova	4102502717	Merge pull request #36619 from ClickHouse/parallel-url-performance-issue ... ParallelReadBuffer small improvements	2022-04-29 02:55:30 +02:00
kssenii	9d364cdce2	Refactor	2022-04-26 15:33:53 +02:00
Antonio Andelic	3dd38f4917	Use vector for segments	2022-04-25 12:10:41 +00:00
Antonio Andelic	ef00ac12fa	Use Memory	2022-04-25 11:39:07 +00:00
Kruglov Pavel	b2905c5aed	Update src/IO/ParallelReadBuffer.cpp ... Co-authored-by: tavplubix <tavplubix@gmail.com>	2022-04-13 13:50:11 +02:00
avogar	a4d74f975e	Use atomic instead of mutex + condvar in ParallelReadBuffer	2022-04-13 10:20:29 +00:00
avogar	de9c9462e5	Fix crash in ParallelReadBuffer	2022-04-12 13:54:53 +00:00
Antonio Andelic	a3ad99be03	Create CallbackRunner in Storage	2022-03-30 11:24:50 +00:00
Antonio Andelic	de2c6684a3	Remove setup and cleanup	2022-03-30 09:00:06 +00:00
Antonio Andelic	1173eab15e	Use same IOThreadPool for URL and S3	2022-03-30 08:15:20 +00:00
Antonio Andelic	6785ad165a	Fix issue for mutliple download threads	2022-03-22 14:06:30 +00:00
Antonio Andelic	f2a7c6c6fe	Add support for canceling a single worker	2022-03-18 09:28:56 +00:00
Antonio Andelic	b789a41662	Fix ASAN problems	2022-03-17 15:18:20 +00:00
Antonio Andelic	44de5a581c	Fix split build	2022-03-17 10:09:16 +00:00
Antonio Andelic	0979155f2f	Address PR comments	2022-03-16 15:45:17 +00:00
Antonio Andelic	84f86bf3da	Limit number of bytes read per worker	2022-03-16 12:34:14 +00:00
Antonio Andelic	3465664871	Attach thread pool threads to counters	2022-03-16 09:26:01 +00:00
Antonio Andelic	5f8d9885b3	Ignore read bytes	2022-03-14 15:50:30 +00:00
Antonio Andelic	f5d3a8a31d	Polishing	2022-03-11 13:38:19 +00:00
Antonio Andelic	28e9508c4e	Improve shared pool and add settings	2022-03-11 08:33:34 +00:00
Antonio Andelic	cce318273b	Use a shared IO thread pool	2022-03-11 08:33:34 +00:00
Antonio Andelic	adaaaaf061	Unblock readers before stoping	2022-03-11 08:33:34 +00:00
Antonio Andelic	df0f5e20d0	Refactor	2022-03-11 08:33:34 +00:00
Antonio Andelic	7b526b25a8	Initial implementation with Arena	2022-03-11 08:33:34 +00:00
Antonio Andelic	16c20332cf	Fix deadlocks	2022-03-11 08:33:34 +00:00
Antonio Andelic	c6664bbbdf	Add seekable ParallelReadBuffer	2022-03-11 08:33:34 +00:00
Antonio Andelic	29c32ed831	Refactor code	2022-03-11 08:33:34 +00:00
Antonio Andelic	0a1a3a230e	Add support for parallel http range requests	2022-03-11 08:33:34 +00:00