Commit Graph

109733 Commits

Author SHA1 Message Date
Alexey Milovidov
36b2ddc30f
Merge pull request #47050 from ClickHouse/more-merge-tasks-in-queue
Increase `max_replicated_merges_in_queue`
2023-03-01 13:39:53 +03:00
artem-yadr
e1352adced
Update MongoDBDictionarySource.cpp 2023-03-01 12:50:03 +03:00
Robert Schulze
ac7caace8a
Update comments 2023-03-01 09:34:46 +00:00
Antonio Andelic
c797122dbe Better 2023-03-01 08:45:50 +00:00
Robert Schulze
05142af0c0
Merge pull request #47008 from ClickHouse/rs/fix-too-new-glibc-on-arm
Fix statx on ARM
2023-03-01 09:31:20 +01:00
Amos Bird
62d011d0c0
Provide more glibc compatibility symbols
These are needed by newer capnp. musl does the following:

 #define fallocate64 fallocate
 #define pwritev64 pwritev
2023-03-01 15:12:43 +08:00
Palash Goel
ec00b09007
Merge branch 'master' into patch-1 2023-03-01 11:50:19 +05:30
Yakov Olkhovskiy
e800557743
Merge pull request #46705 from canhld94/ch_fix_aggregate_arithmetic
Fix arithmetic operations in aggregate optimization
2023-03-01 00:49:34 -05:00
Palash Goel
3615c6f4fb
Fix typo in service definition 2023-03-01 10:37:21 +05:30
Alexey Milovidov
fe446afb7d Increase max_replicated_merges_in_queue 2023-03-01 06:02:59 +01:00
Alexey Milovidov
4c7ac6cd89
Merge pull request #47007 from ClickHouse/vdimir/tmp_path_template_fix
Fix tmp_path_template in HTTPHandler::processQuery
2023-03-01 07:46:12 +03:00
Amos Bird
c0fb4ddc3e
Make thread analyzer happy 2023-03-01 11:07:36 +08:00
Amos Bird
2d8060d843
Rewrite VersionNumber in ClickHouse way 2023-03-01 11:07:31 +08:00
Amos Bird
8162446496
The three-way comparison operator
Please refer to
https://www.open-std.org/jtc1/sc22/wg21/docs/papers/2022/p2468r2.html
for more information on why it is necessary to modify the code in this
way.
2023-03-01 11:06:34 +08:00
Anton Popov
2c41ddf609 support Bool in JSONType 2023-03-01 02:07:09 +00:00
robot-clickhouse-ci-2
c28ab44ce5
Merge pull request #47044 from ClickHouse/DanRoscigno-patch-4
add comment info to create table
2023-03-01 02:31:51 +01:00
Dmitry Novik
54680b1a0a Merge remote-tracking branch 'origin/master' into analyzer-group-by-use-nulls 2023-03-01 01:08:17 +00:00
Dan Roscigno
980680096e
Merge pull request #47043 from ClickHouse/DanRoscigno-patch-5
Add exaple of intDiv
2023-02-28 17:37:44 -05:00
Dan Roscigno
fa5b65a702
add comment info to create table
closes https://github.com/ClickHouse/ClickHouse/issues/37088
2023-02-28 17:35:52 -05:00
AVMusorin
99329d8682 Improve tests for Distributed INSERT
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 23:17:37 +01:00
Azat Khuzhin
d06a4b50d6 Latest review fixes (variable naming: s/monitor/queue)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:48:07 +01:00
Dan Roscigno
4c2efa8dde
Merge pull request #47039 from ClickHouse/DanRoscigno-patch-4
docs: sample settings profile and assign to a user
2023-02-28 16:40:55 -05:00
Dan Roscigno
97c8c21741
Add exaple of intDiv
closes https://github.com/ClickHouse/ClickHouse/issues/25703
2023-02-28 16:38:00 -05:00
Azat Khuzhin
591fca57f3 Fix function names for opentelemetry spans in StorageDistributed
Fixes: 02417_opentelemetry_insert_on_distributed_table
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
7063c20b3c Change noisy "Skipping send data over distributed table." message to test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
16bfef3c8a Fix processing current_batch.txt on init
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
752d27d663 Fix lossing files during distributed batch send
v2: do not suppress exceptions in case of errors
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
572dd76eae Extend ConcurrentBoundedQueue to deque
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
263c042c6a Fix opentelemetry for distributed batch sends
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
00115c6615 Rename readDistributedAsyncInsertHeader()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
a76d7b22c1 Use existing public methods of StorageDistributed in DistributedSink
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
e83699a8d3 Improve comment for DistributedAsyncInsertDirectoryQueue::initializeFilesFromDisk()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
e10fb142fd Fix race for distributed sends from disk
Before it was initialized from disk only on startup, but if some INSERT
can create the object before, then, it will lead to the situation when
it will not be initialized.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
b5434eac3b Rename StorageDistributedDirectoryMonitor to DistributedAsyncInsertDirectoryQueue
Since #44922 it is not a directory monitor anymore.

v2: Remove unused error codes
v3: Contains some header fixes due to conflicts with master
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
1c4659b8e7 Separate out Batch as DistributedAsyncInsertBatch (and also some helpers)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
33b13549ad Separate out DirectoryMonitorSource as DistributedAsyncInsertSource
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
325a7b2305 Separate out DistributedHeader as DistributedAsyncInsertHeader
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
22a39e29f7 Add a comment for StorageDistributedDirectoryMonitor::Batch::recovered
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
0c19a75a1c Add log message for batch restore
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
13a3e03f19 Introduce StorageDistributedDirectoryMonitor::Batch::{de,}serialize()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
f0a2efa630 Always manipulate with absolute file paths in DirectoryMonitor
Otherwise on batch restore we can get the difference in file paths.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
ef1e642e05 Add log message to StorageDistributedDirectoryMonitor::addAndSchedule()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
16646c0923 Rename DirectoryMonitor::current_batch_file to current_file
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
Azat Khuzhin
3f892e52ab Revert "Revert "Merge pull request #44922 from azat/dist/async-INSERT-metrics""
This is the revert of revert since there will be follow up patches to
address the issues.

This reverts commit a55798626a.
2023-02-28 22:33:36 +01:00
Dan Roscigno
7c6e7622d8
docs: sample settings profile and assign to a user
closes https://github.com/ClickHouse/ClickHouse/issues/12311
2023-02-28 15:38:31 -05:00
Antonio Andelic
6e28406751 Merge branch 'master' into fix-data-size 2023-02-28 20:09:29 +00:00
Kruglov Pavel
66634cfd7c
Merge pull request #46618 from kitaisreal/map-field-to-string-fix
Map field to string fix
2023-02-28 20:29:40 +01:00
Kruglov Pavel
75a9dc82d5
Merge pull request #47031 from ClickHouse/Avogar-patch-1
Add upgrade check to stateful dependent field
2023-02-28 20:26:27 +01:00
Mikhail f. Shiryaev
9a48539fbe
Rebuild stateful tests image 2023-02-28 20:20:04 +01:00
Dan Roscigno
357415f4f5
Merge pull request #47034 from ClickHouse/DanRoscigno-patch-6
Correct return vals
2023-02-28 14:10:52 -05:00