Commit Graph

126955 Commits

Author SHA1 Message Date
Alexander Gololobov
11a62bc751
Merge pull request #55621 from ClickHouse/merge-52352
Merging #52352
2023-10-17 13:58:53 +02:00
avogar
527e96db3f Fix 2023-10-17 11:43:51 +00:00
avogar
4892618aa9 Update with master, fix comments 2023-10-17 11:42:19 +00:00
avogar
bb46aa4d57 Clean uo 2023-10-17 11:07:41 +00:00
avogar
f87938735a Fixes and improvements for Iceberg storage 2023-10-17 11:07:37 +00:00
Robert Schulze
9a8734fa5e
Remove submodules 2023-10-17 10:22:30 +00:00
Duc Canh Le
f20d055e1e do not re-create serialization for each row
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-10-17 10:12:27 +00:00
kssenii
42ed249954 Fix build 2023-10-17 12:03:49 +02:00
Mikhail f. Shiryaev
9629e255e7
Merge pull request #55716 from ClickHouse/ci_scripts_tuning_2
Ci scripts tuning 2
2023-10-17 11:53:00 +02:00
Robert Schulze
96a82df75a
Merge pull request #55616 from HarryLeeIBM/hlee-fts-max-rows
Inverted index: Replace setting density with `max_rows_in_postings_list`
2023-10-17 11:36:46 +02:00
Raúl Marín
3eaf752284 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-17 11:36:39 +02:00
Kseniia Sumarokova
c220cc65d6
Update test.py 2023-10-17 11:35:15 +02:00
Kseniia Sumarokova
550a658236
Merge pull request #55144 from kssenii/fix-iceberg-metadata-parsing
Fix storage Iceberg files retrieval
2023-10-17 11:31:07 +02:00
Robert Schulze
912e3680fb
Merge remote-tracking branch 'rschu1ze/master' into grpc-1.34.1-try-2 2023-10-17 09:26:41 +00:00
kssenii
4464c86895 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-17 11:16:52 +02:00
kssenii
8744cd9c0d Fix 2023-10-17 11:15:53 +02:00
Aleksei Filatov
f56804e6e7 Use pool for proxified S3 http sessions 2023-10-17 12:15:43 +03:00
Raúl Marín
90cef604ba
Merge pull request #55193 from azat/clickhouse-client-pager-signals
Reset signals caught by clickhouse-client if a pager is in use
2023-10-17 10:48:54 +02:00
Max Kainov
ad38c433a1 fix commit labels for diff 2023-10-17 08:48:25 +00:00
Max Kainov
fc9a5a725c Revert "Revert "Integration check script fix ups""
This reverts commit 67b9407530.
2023-10-17 08:18:17 +00:00
Alexey Milovidov
914e6020c0
Merge pull request #55668 from Algunenano/test_query_is_lock_free_analyzer
Enable test_query_is_lock_free[detach table] for the analyzer
2023-10-17 04:54:48 +02:00
Alexey Milovidov
b242cdbb42 Merge remote-tracking branch 'origin/master' into dashboard-ipad 2023-10-17 04:51:59 +02:00
Alexey Milovidov
1e6be1ac86 Merge branch 'master' into dashboard-ipad 2023-10-17 04:50:38 +02:00
HarryLeeIBM
fb8cd298d1 Code refactoring according to code review 2023-10-16 17:52:39 -07:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450)
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
2023-10-16 17:00:07 -07:00
robot-clickhouse
89eed73fb9
Merge pull request #55519 from azat/zk-retry-fix
Avoid retrying keeper operations on INSERT after table shutdown
2023-10-16 23:32:13 +02:00
Azat Khuzhin
2fc858bfe1 Adjust output_format_pretty_max_rows if --pager is specified 2023-10-16 22:31:57 +02:00
Azat Khuzhin
4cb3de3110 Add pager property into ClientBase
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-16 22:31:55 +02:00
Azat Khuzhin
3257d5643d Move adjusting input_format_values_allow_data_after_semicolon into the client base
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-16 22:31:55 +02:00
Kseniia Sumarokova
96c518be5b
Merge branch 'master' into s3-queue-fixes 2023-10-16 22:19:13 +02:00
Kseniia Sumarokova
3e9a1cf69f
Merge branch 'master' into fix-iceberg-metadata-parsing 2023-10-16 22:18:52 +02:00
Kseniia Sumarokova
c31299d86c
Merge branch 'master' into materialized-pg-allow-unique-identifier 2023-10-16 22:18:23 +02:00
alesapin
5afabe7d59
Merge pull request #55694 from ClickHouse/revert-55476-ci_scripts_tuning
Revert "Integration  check script fix ups"
2023-10-16 22:07:50 +02:00
Azat Khuzhin
fc354d7fbf Reset signals that is catched by clickhouse-client if pager is in use
We need to reset signals that had been installed in the
setupSignalHandler() (SIGINT/SIGQUIT), like other such tools dies (i.e.
less and open file in editor) since terminal will send signals to both
processes and so signals will be delivered to the
clickhouse-client/local as well, which will be terminated when signal
will be delivered second time.

So a simple `clickhouse-client --pager less` will be terminated on a
second C-C press. And it is really annoying when you are using this way
to analyze logs.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-16 22:03:36 +02:00
alesapin
67b9407530
Revert "Integration check script fix ups" 2023-10-16 22:01:44 +02:00
robot-ch-test-poll1
aca98cf725
Merge pull request #53774 from helifu/master13
Display reloaded values of server settings
2023-10-16 21:17:17 +02:00
Robert Schulze
31ad4a98c8
Bump gRPC 1.34 2023-10-16 18:38:29 +00:00
alesapin
88ac44d595
Merge pull request #55590 from Algunenano/unused_protobuf
Remove unused protobuf includes
2023-10-16 18:43:24 +02:00
Jiebin Sun
df17cd467b
Release more num_streams if data is small (#53867)
* Release more num_streams if data is small

Besides the sum_marks and min_marks_for_concurrent_read, we could also involve the
system cores to get the num_streams if the data is small. Increasing the num_streams
and decreasing the min_marks_for_concurrent_read would improve the parallel performance
if the system has plentiful cores.

Test the patch on 2x80 vCPUs system. Q39 of clickbench has got 3.3x performance improvement.
Q36 has got 2.6x performance improvement. The overall geomean has got 9% gain.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Release more num_streams if data is small
Change the min marks from 4 to 8 as the profit is small and 8 granules
is the default block size.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

---------

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
2023-10-16 18:41:38 +02:00
Alexander Sapin
f85e82931d Make test less flaky 2023-10-16 18:36:45 +02:00
Raúl Marín
bfb5b8f441 Implement replica estimation on top of the analyzer 2023-10-16 18:34:58 +02:00
Kruglov Pavel
cbdb62d389
Merge pull request #55666 from ClickHouse/Avogar-patch-1
Fix progress bar for s3 and azure Cluster functions with url without globs
2023-10-16 18:25:00 +02:00
kssenii
0a6a4b3894 Review fixes 2023-10-16 18:15:17 +02:00
Vlad Seliverstov
d9ed5e2e94
Pretty op processors IDs in EXPLAIN PIPELINE graph = 1 output (#48852)
* Prettify IDs op processors

* bump

* don't use static map

---------

Co-authored-by: Vlad Seliverstov <behemot@clickhouse.com>
2023-10-16 18:11:01 +02:00
Alexey Milovidov
f6dee5fe3c
Merge pull request #55682 from ClickHouse/revert-35961-decimal-column-improve-get-permutation
Revert "Improve ColumnDecimal, ColumnVector getPermutation performance using pdqsort with RadixSort"
2023-10-16 18:07:46 +02:00
Alexey Milovidov
2da1ff4b0d
Revert "Improve ColumnDecimal, ColumnVector getPermutation performance using pdqsort with RadixSort" 2023-10-16 19:07:11 +03:00
kssenii
4bc32c6387 Fix uncaught exception in background tasj 2023-10-16 17:31:30 +02:00
Kseniia Sumarokova
b525f1c28a
Update test.py 2023-10-16 17:30:20 +02:00
Kseniia Sumarokova
8f3974d289
00002_log_and_exception_messages_formatting ... 2023-10-16 17:30:02 +02:00
vdimir
c9a2a4922d
Fix StorageMaterializedView::isRemote 2023-10-16 15:18:47 +00:00