thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-12 17:32:32 +00:00
Code Issues Packages Projects Releases Wiki Activity
121,774 Commits 9,328 Branches 1,783 Tags 2.1 GiB
b4145aeddc
Commit Graph

2911 Commits

Author SHA1 Message Date
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Alexander Tokmakov
9d29b7cdbf
Merge pull request #53109 from ClickHouse/tavplubix-patch-8 
Update PocoHTTPClient.cpp
 2023-08-07 19:33:39 +03:00
Antonio Andelic
f5597b1f8e Revert changes from https://github.com/ClickHouse/ClickHouse/pull/53064 2023-08-07 12:21:50 +00:00
Alexander Tokmakov
d35dc46061
Update PocoHTTPClient.cpp 2023-08-07 14:39:58 +03:00
Kseniia Sumarokova
b1f0cb83ff
Merge pull request #52621 from valbok/readbuffer 
MaterializedMySQL: Fix the infinite loop in ReadBuffer::read
 2023-08-07 11:56:23 +02:00
Antonio Andelic
cafa5ef2f3 Merge branch 'master' into add-reading-from-archives 2023-08-06 10:21:47 +00:00
Antonio Andelic
1d793e69f2 Fix 2023-08-05 17:06:44 +00:00
Michael Kolupaev
9a128fa554 Fix ZstdDeflatingWriteBuffer truncating the output sometimes 2023-08-04 20:47:45 +00:00
Antonio Andelic
49ae853ae6 Fix sanitizer warnings 2023-08-04 13:57:18 +00:00
Val Doroshchuk
3cea474ccf MaterializedMySQL: Fix the infinite loop in ReadBuffer::read 
This fixes https://github.com/ClickHouse/ClickHouse/issues/33549

The infinite loop caused because sometimes the pos of ReadBuffer overflows the end.

It happens f.e. when `MySQLPacketPayloadReadBuffer::nextImpl` might return empty buffer,
because `in.nextIfAtEnd();` could not read more bytes and thus no bytes available (pos == end).
It might happen when a network error or the connection to MySQL was closed or killed.
This leads to empty `working_buffer` but successful returning from the func.
And check `if (in.eof())` from `MySQLBinlogEventReadBuffer::nextImpl()` fails and also causes empty its `working_buffer` and successul return.

At the end `payload.ignore(1)` and `payload.read(c)` produces the infinite loop since it is not eof() and ++pos overflows the end of the buffer.

Should be tested by `test_mysql_kill*` from test.py
 2023-08-04 11:34:31 +02:00
Antonio Andelic
8e7eb7f3fa Fix tests 2023-08-04 08:59:55 +00:00
Antonio Andelic
27701ed24e Small fixes 2023-08-03 11:44:24 +00:00
Antonio Andelic
d9f136ce0c Add tests for globs 2023-08-03 10:42:47 +00:00
Antonio Andelic
96bad0537a Merge branch 'master' into add-reading-from-archives 2023-08-03 08:36:42 +00:00
Antonio Andelic
9423976b7a Add support for file globs 2023-08-02 07:42:56 +00:00
Yakov Olkhovskiy
357fee99ff
Merge pull request #52791 from zvonand/zvonand-float-parsing 
Add option to switch float parsing methods
 2023-08-02 00:23:23 -04:00
Antonio Andelic
e366ca61f5 Merge branch 'master' into add-reading-from-archives 2023-08-01 15:33:20 +00:00
Antonio Andelic
c24dc8e64e Multithreaded read of files from archives: 2023-08-01 13:48:49 +00:00
Andrey Zvonov
99cd8f9ba9
Merge branch 'master' into zvonand-float-parsing 2023-07-31 23:43:24 +03:00
Nikolai Kochetov
c4a00b8c68 Throw S3Exception whenever possible. 2023-07-31 15:39:20 +00:00
Antonio Andelic
86a251931b Fix style 2023-07-31 14:53:40 +00:00
zvonand
e50ffa1181 fix style 2023-07-31 16:44:46 +02:00
zvonand
2088f846ad update as per reviews 2023-07-31 16:26:18 +02:00
Antonio Andelic
6a1cf5c683 Extend tests 2023-07-31 13:27:06 +00:00
Antonio Andelic
7df5c83046 Merge branch 'master' into add-reading-from-archives 2023-07-31 09:27:01 +00:00
Antonio Andelic
df45602165 Refactoring 2023-07-31 08:50:09 +00:00
Alexey Milovidov
c825f15b74
Merge pull request #52441 from CheSema/reset-connection-s3 
add tests with connection reset by peer error, and retry it inside client
 2023-07-31 09:58:41 +03:00
zvonand
0ff0a4e41f diverge parsing methods 2023-07-30 19:42:10 +02:00
Antonio Andelic
1fc1b6aae4 More fixes 2023-07-28 13:00:35 +00:00
Antonio Andelic
e83e0ec2cd Fix build 2023-07-28 12:26:56 +00:00
Sema Checherinda
115a085d0f
Merge branch 'master' into reset-connection-s3 2023-07-28 14:00:14 +04:00
Antonio Andelic
720d587e85 Merge branch 'master' into add-reading-from-archives 2023-07-28 08:49:00 +00:00
Alexey Milovidov
6aab4cc835 Check for unexpected cyrillic 2023-07-27 05:25:40 +02:00
robot-ch-test-poll2
7bcef0a6c0
Merge pull request #52520 from zvonand/revert-52450-remove-to-decimal-string 
Fix `toDecimalString` function
 2023-07-27 00:18:36 +02:00
Sema Checherinda
7d430b8037 retry ConnectionResetException 2023-07-26 17:31:14 +04:00
Kruglov Pavel
15cc046883
Merge branch 'master' into better-progress-bar-2 2023-07-26 13:12:24 +02:00
Sema Checherinda
83d869860e
Merge pull request #51946 from arenadata/ADQM-940 
Expose Peak memory usage in query statistics.
 2023-07-25 22:17:58 +03:00
Sema Checherinda
c341df1949 draft with retry ConnectionResetException 2023-07-25 19:59:39 +04:00
Andrey Zvonov
15b3a637e9
Merge branch 'master' into revert-52450-remove-to-decimal-string 2023-07-25 13:21:00 +03:00
Alexey Milovidov
21382afa2b Check for punctuation 2023-07-25 06:10:04 +02:00
Alexey Milovidov
168b84a592
Merge pull request #52337 from Avogar/no-decode-url 
Allow to disable decoding/encoding path in uri in URL engine
 2023-07-25 05:43:06 +03:00
Dmitry Kardymon
d4d381de7e Merge remote-tracking branch 'origin/master' into ADQM-940 2023-07-24 20:04:10 +00:00
Kruglov Pavel
fec5675cd4
Merge branch 'master' into better-progress-bar-2 2023-07-24 19:59:38 +02:00
Nikita Taranov
c6e6fd7613
Shard OpenedFileCache to avoid lock contention (#51341) 
* shard OpenedFileCache to avoid lock contention

* Update OpenedFileCache.h

* fix build

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
 2023-07-24 15:58:21 +02:00
Andrey Zvonov
21097209d2
Revert "Remove toDecimalString" 2023-07-24 15:41:21 +03:00
Dmitry Kardymon
62f9a953fe Merge remote-tracking branch 'origin/master' into ADQM-940 2023-07-24 04:52:12 +00:00
Alexey Milovidov
d7cdfb47d3 Fix merge 2023-07-24 01:56:04 +02:00
Alexey Milovidov
5c15e6021b Merge branch 'master' into remove-to-decimal-string 2023-07-24 01:51:43 +02:00
Alexey Milovidov
2467eaf32d
Merge pull request #52392 from azat/netlink-provider 
Rename TaskStatsInfoGetter into NetlinkMetricsProvider
 2023-07-22 19:14:15 +03:00
Kseniia Sumarokova
d34f2bed07
Merge pull request #51386 from bigo-sg/fix_hdfs_read_buffer_heap_overflow 
Fix heap overflow in read buffer from hdfs when read_until_position is not zero
 2023-07-22 15:00:58 +02:00