Commit Graph

5847 Commits

Author SHA1 Message Date
Smita Kulkarni
dedb9067ce WIP : Azure Table Function, added read and StorageAzureSource 2023-06-05 20:36:17 +02:00
alesapin
5e8ecf8f22
Merge pull request #50548 from ClickHouse/move_async_iterator_to_object_storage
Add async iteration to object storage
2023-06-05 12:30:28 +02:00
Alexey Milovidov
d66962b864
Merge pull request #50252 from Avogar/fix-secure-async-read-write
Fix bugs in Poco sockets in non-blocking mode, use true non-blocking sockets
2023-06-05 06:44:22 +03:00
Alexey Milovidov
f118cba17e
Merge pull request #50238 from azat/dist-pending-bytes
Add new metrics BrokenDistributedBytesToInsert/DistributedBytesToInsert
2023-06-05 04:50:42 +03:00
alesapin
0f4dd26ceb Add async iteration to object storage 2023-06-04 16:03:44 +02:00
Sergey Kazmin
a3a1283467 remove try-catch from the impl of typeid_cast for refs 2023-06-04 16:22:58 +03:00
Sergey Kazmin
63eab2783e Make typeid_cast for pointers noexcept 2023-06-04 16:22:58 +03:00
Alexey Milovidov
07a6e49941
Merge pull request #50527 from ClickHouse/fix-bad-code-rocksdb
Fix low quality code around metadata in RocksDB (experimental feature never used in production)
2023-06-04 06:48:19 +03:00
Alexey Milovidov
8c1091dc58
Merge branch 'master' into fix-secure-async-read-write 2023-06-04 05:06:59 +03:00
kssenii
009fe3d25e Add profile events for eviction 2023-06-03 21:35:27 +02:00
Azat Khuzhin
69aec7af9b Add new metrics BrokenDistributedBytesToInsert/DistributedBytesToInsert
Useful to see at the server status overall.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-03 20:49:19 +02:00
Azat Khuzhin
0f37be5492 Fix description for BrokenDistributedFilesToInsert
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-03 20:49:19 +02:00
Sergei Trifonov
f1eba08eaf
Merge pull request #50379 from alekar/minor-cgroup-improvements
Minor improvements in CGroup awareness.
2023-06-03 12:36:39 +02:00
Alexey Milovidov
30be723a9a Fix bad code around metadata in RocksDB 2023-06-03 05:11:02 +02:00
Alexey Milovidov
9e938d7eec
Merge pull request #49287 from nickitat/optimize_reading2
Optimise hot reading from remote tables
2023-06-02 23:51:57 +03:00
Sergei Trifonov
9d0a63bd92
Update src/Common/AsynchronousMetrics.cpp 2023-06-02 18:15:20 +02:00
Sergei Trifonov
6243a16824
Merge branch 'master' into minor-cgroup-improvements 2023-06-02 18:14:24 +02:00
Sergei Trifonov
163b2f32da
Update src/Common/AsynchronousMetrics.cpp 2023-06-02 18:13:46 +02:00
Alexander Gololobov
8cadd89ebe
Update src/Common/TaskStatsInfoGetter.cpp 2023-06-02 12:34:22 +02:00
Sergei Trifonov
3027f34c1f
Merge branch 'master' into minor-cgroup-improvements 2023-06-02 11:19:25 +02:00
Sergei Trifonov
57a2bfd0ff
Update src/Common/AsynchronousMetrics.cpp 2023-06-02 11:19:11 +02:00
Sergei Trifonov
16be379fa5
Update src/Common/AsynchronousMetrics.cpp 2023-06-02 11:18:46 +02:00
Alexey Milovidov
c5165c2236 More thorough check for the availability of TaskStats 2023-06-02 03:25:12 +02:00
Kseniia Sumarokova
9ff4e6d6a3
Merge pull request #50334 from valbok/pool-mem-leak
Fix crash when Pool::Entry::disconnect() is called
2023-06-01 18:01:56 +02:00
Kruglov Pavel
e924aafdf6
Merge branch 'master' into fix-secure-async-read-write 2023-06-01 16:24:54 +02:00
Robert Schulze
45b1fcdeda
Merge pull request #50315 from arenadata/ADQM-810
Add new function toLastDayOfWeek()
2023-06-01 16:19:14 +02:00
Alexey Milovidov
956c399b2a Remove useless code 2023-06-01 03:04:29 +02:00
Manas Alekar
6334b6d569 Address case where cpu cgroup is set to max. 2023-05-31 17:55:20 -07:00
alekar
38db3313be
Merge branch 'master' into minor-cgroup-improvements 2023-05-31 10:01:06 -07:00
Kruglov Pavel
ec10415328
Merge branch 'master' into fix-secure-async-read-write 2023-05-31 13:16:52 +02:00
Sema Checherinda
ab027ca1ce
Merge pull request #50275 from CheSema/d-tor-free
buffers d-tor finalize free
2023-05-31 12:26:19 +02:00
alekar
64cc0a4a69
Merge branch 'master' into minor-cgroup-improvements 2023-05-31 01:52:38 -07:00
Manas Alekar
65586c50f5 Minor improvements in CGroup awareness.
1. Support CGroup2 in getMemoryAmountOrZero().
2. Report CFS period and quota in asynchronous metric log.
2023-05-31 01:52:02 -07:00
Kruglov Pavel
7966fa2da6
Merge pull request #50034 from Avogar/fiber-local-var-2
Fix assert in SpanHolder::finish() with fibers attempt 2
2023-05-30 17:50:31 +02:00
Kruglov Pavel
1c904ecc8e
Fix typo 2023-05-30 16:25:17 +02:00
Sema Checherinda
84d6bfe5f6
Merge pull request #50204 from azat/InsertSelectQueries-pe
Add new profile events for queries with subqueries
2023-05-30 15:19:04 +02:00
Kruglov Pavel
092b06f32e
Fix special build 2023-05-30 14:36:47 +02:00
Kruglov Pavel
fe82d2bbe2
Fix build 2023-05-30 12:58:37 +02:00
Sema Checherinda
99ad481505 fix sizes.log writes 2023-05-30 12:26:20 +02:00
Val Doroshchuk
ecea1ac090 Fix crash when Pool::Entry::disconnect() is called
Many Pool::Entry objects can keep the same pointer to Pool::Connection.
If Pool::Entry::disconnect() is called on one such object,
Pool::removeConnection() is called to remove Pool::Connection from the pool,
where connection->ref_count is cleared and connection->removed_from_pool is set.

Next Pool::Entry::~Entry() calls decrementRefCount() with

1. const auto ref_count = data->ref_count.fetch_sub(1);
   where data->ref_count will be negative, since it was cleared
2. checks removed_from_pool and deletes Pool::Connection
   but there might be multiple Entry objects still keep pointer to this Pool::Connection

Suggesting not to clear ref_count on disconnect()
and delete Pool::Connection only on the last Pool::Entry is being destroyed.

Fixes ea375ef989
2023-05-30 10:29:49 +02:00
Nikita Taranov
b2921df228
Merge branch 'master' into optimize_reading2 2023-05-29 18:35:53 +02:00
Nikita Taranov
87d6564b9b
Update gtest_async_loader.cpp 2023-05-29 15:50:06 +02:00
Nikita Taranov
a3652f1727 Merge branch 'master' into optimize_reading2 2023-05-29 15:26:18 +02:00
Sergei Trifonov
c26b3b36ae
Merge branch 'master' into fix-flaky-async-loader-test 2023-05-29 13:38:35 +02:00
Sergei Trifonov
355f917daa
Update src/Common/tests/gtest_async_loader.cpp 2023-05-29 13:38:14 +02:00
alesapin
6b7e2a0041
Merge pull request #49961 from CheSema/mem-consumption-s3-write
Introduce a limitation of async calls inside s3 write buffer, make a test that memory is bounded even when s3 is slow
2023-05-29 13:29:01 +02:00
serxa
bdb974ab3c Fix flaky AsyncLoader.StaticPriorities unit test 2023-05-29 11:21:44 +00:00
Victor Krasnov
0ad5b9f598 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-810-dev 2023-05-29 08:26:26 +00:00
Robert Schulze
47daaad172
Merge pull request #49778 from helifu/master2
Support custom 'order by' expression for system log tables
2023-05-29 10:05:14 +02:00
Nikita Taranov
42a9072888 Merge branch 'master' into optimize_reading2 2023-05-28 18:04:44 +02:00