Commit Graph

126572 Commits

Author SHA1 Message Date
Alexander Gololobov
11a62bc751
Merge pull request #55621 from ClickHouse/merge-52352
Merging #52352
2023-10-17 13:58:53 +02:00
Mikhail f. Shiryaev
9629e255e7
Merge pull request #55716 from ClickHouse/ci_scripts_tuning_2
Ci scripts tuning 2
2023-10-17 11:53:00 +02:00
Robert Schulze
96a82df75a
Merge pull request #55616 from HarryLeeIBM/hlee-fts-max-rows
Inverted index: Replace setting density with `max_rows_in_postings_list`
2023-10-17 11:36:46 +02:00
Kseniia Sumarokova
550a658236
Merge pull request #55144 from kssenii/fix-iceberg-metadata-parsing
Fix storage Iceberg files retrieval
2023-10-17 11:31:07 +02:00
Raúl Marín
90cef604ba
Merge pull request #55193 from azat/clickhouse-client-pager-signals
Reset signals caught by clickhouse-client if a pager is in use
2023-10-17 10:48:54 +02:00
Max Kainov
ad38c433a1 fix commit labels for diff 2023-10-17 08:48:25 +00:00
Max Kainov
fc9a5a725c Revert "Revert "Integration check script fix ups""
This reverts commit 67b9407530.
2023-10-17 08:18:17 +00:00
Alexey Milovidov
914e6020c0
Merge pull request #55668 from Algunenano/test_query_is_lock_free_analyzer
Enable test_query_is_lock_free[detach table] for the analyzer
2023-10-17 04:54:48 +02:00
HarryLeeIBM
fb8cd298d1 Code refactoring according to code review 2023-10-16 17:52:39 -07:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450)
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
2023-10-16 17:00:07 -07:00
robot-clickhouse
89eed73fb9
Merge pull request #55519 from azat/zk-retry-fix
Avoid retrying keeper operations on INSERT after table shutdown
2023-10-16 23:32:13 +02:00
Azat Khuzhin
2fc858bfe1 Adjust output_format_pretty_max_rows if --pager is specified 2023-10-16 22:31:57 +02:00
Azat Khuzhin
4cb3de3110 Add pager property into ClientBase
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-16 22:31:55 +02:00
Azat Khuzhin
3257d5643d Move adjusting input_format_values_allow_data_after_semicolon into the client base
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-16 22:31:55 +02:00
Kseniia Sumarokova
3e9a1cf69f
Merge branch 'master' into fix-iceberg-metadata-parsing 2023-10-16 22:18:52 +02:00
alesapin
5afabe7d59
Merge pull request #55694 from ClickHouse/revert-55476-ci_scripts_tuning
Revert "Integration  check script fix ups"
2023-10-16 22:07:50 +02:00
Azat Khuzhin
fc354d7fbf Reset signals that is catched by clickhouse-client if pager is in use
We need to reset signals that had been installed in the
setupSignalHandler() (SIGINT/SIGQUIT), like other such tools dies (i.e.
less and open file in editor) since terminal will send signals to both
processes and so signals will be delivered to the
clickhouse-client/local as well, which will be terminated when signal
will be delivered second time.

So a simple `clickhouse-client --pager less` will be terminated on a
second C-C press. And it is really annoying when you are using this way
to analyze logs.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-16 22:03:36 +02:00
alesapin
67b9407530
Revert "Integration check script fix ups" 2023-10-16 22:01:44 +02:00
robot-ch-test-poll1
aca98cf725
Merge pull request #53774 from helifu/master13
Display reloaded values of server settings
2023-10-16 21:17:17 +02:00
alesapin
88ac44d595
Merge pull request #55590 from Algunenano/unused_protobuf
Remove unused protobuf includes
2023-10-16 18:43:24 +02:00
Jiebin Sun
df17cd467b
Release more num_streams if data is small (#53867)
* Release more num_streams if data is small

Besides the sum_marks and min_marks_for_concurrent_read, we could also involve the
system cores to get the num_streams if the data is small. Increasing the num_streams
and decreasing the min_marks_for_concurrent_read would improve the parallel performance
if the system has plentiful cores.

Test the patch on 2x80 vCPUs system. Q39 of clickbench has got 3.3x performance improvement.
Q36 has got 2.6x performance improvement. The overall geomean has got 9% gain.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Release more num_streams if data is small
Change the min marks from 4 to 8 as the profit is small and 8 granules
is the default block size.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

---------

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
2023-10-16 18:41:38 +02:00
Kruglov Pavel
cbdb62d389
Merge pull request #55666 from ClickHouse/Avogar-patch-1
Fix progress bar for s3 and azure Cluster functions with url without globs
2023-10-16 18:25:00 +02:00
Vlad Seliverstov
d9ed5e2e94
Pretty op processors IDs in EXPLAIN PIPELINE graph = 1 output (#48852)
* Prettify IDs op processors

* bump

* don't use static map

---------

Co-authored-by: Vlad Seliverstov <behemot@clickhouse.com>
2023-10-16 18:11:01 +02:00
Alexey Milovidov
f6dee5fe3c
Merge pull request #55682 from ClickHouse/revert-35961-decimal-column-improve-get-permutation
Revert "Improve ColumnDecimal, ColumnVector getPermutation performance using pdqsort with RadixSort"
2023-10-16 18:07:46 +02:00
Alexey Milovidov
2da1ff4b0d
Revert "Improve ColumnDecimal, ColumnVector getPermutation performance using pdqsort with RadixSort" 2023-10-16 19:07:11 +03:00
Kseniia Sumarokova
b525f1c28a
Update test.py 2023-10-16 17:30:20 +02:00
Kseniia Sumarokova
8f3974d289
00002_log_and_exception_messages_formatting ... 2023-10-16 17:30:02 +02:00
Mikhail f. Shiryaev
f96bda1deb
Merge pull request #55476 from ClickHouse/ci_scripts_tuning
Integration  check script fix ups
2023-10-16 17:06:19 +02:00
Max Kainov
4d1edc2780 return back unidiff module 2023-10-16 15:00:13 +00:00
Igor Nikonov
6abd1a6462
Merge branch 'master' into zk-retry-fix 2023-10-16 16:56:07 +02:00
Raúl Marín
51837eff33 Enable test_query_is_lock_free[detach table] for the analyzer 2023-10-16 12:49:17 +00:00
János Benjamin Antal
eeff98f3a3
Merge pull request #55373 from lingtaolf/enhancement/rename_without_keyword
Support rename table without keyword TABLE
2023-10-16 14:06:23 +02:00
Raúl Marín
478f635d60
Merge pull request #53792 from ClickHouse/revert-53782-revert-52762-planner-prepare-filters-for-analysis
Revert "Revert "Planner prepare filters for analysis""
2023-10-16 13:21:54 +02:00
Mikhail f. Shiryaev
a4fb143413
Merge pull request #50724 from AlexNik/docker-initialization-once
Initialization of the database only once in Docker.
2023-10-16 13:12:17 +02:00
helifu
dc0f8ed793 Add a new column 'is_hot_reloadable' to indicate whether hot loading is supported 2023-10-16 19:10:35 +08:00
kssenii
34d804686a Fix black check 2023-10-16 13:03:12 +02:00
Kruglov Pavel
6dcc756948
Fix for azure 2023-10-16 12:38:55 +02:00
Kruglov Pavel
836e35b6c4
Fix progress bar for s3 and azure Cluster functions with url without globs 2023-10-16 12:38:10 +02:00
Max Kainov
683437c61c fix docs and script 2023-10-16 10:35:14 +00:00
Max Kainov
b0b6e7fd47 fix docs 2023-10-16 10:35:14 +00:00
Max Kainov
60ad1c79bd fix docs 2023-10-16 10:35:14 +00:00
robot-clickhouse
7c2fee3280 Automatic style fix 2023-10-16 10:35:14 +00:00
Max Kainov
3f3fcce7e5 gh api request func update 2023-10-16 10:35:14 +00:00
Mikhail f. Shiryaev
c5ebd6f072 Use requests.gte in get_gh_api 2023-10-16 10:35:14 +00:00
Mikhail f. Shiryaev
346e8a0162 Remove recursion in favor of reset retry loop 2023-10-16 10:35:14 +00:00
Max Kainov
f1c316b79b ci script to use git hub api urls, readme for test 2023-10-16 10:35:13 +00:00
alesapin
8449e4c7b7
Merge pull request #55577 from ClickHouse/fix_max_execution_time_and_break_mode
Fix max execution time and 'break' overflow mode
2023-10-16 12:24:15 +02:00
Raúl Marín
4b62ff4ceb Merge remote-tracking branch 'blessed/master' into unused_protobuf 2023-10-16 11:59:38 +02:00
Kseniia Sumarokova
a4bd6891e1
Merge pull request #55164 from ClickHouse/vdimir/fix_file_cache_tmp_write_buffer
Fix file cache temporary file segment range in FileSegment::reserve
2023-10-16 11:44:46 +02:00
Antonio Andelic
6c543c730b
Merge pull request #55657 from ClickHouse/revert-55418-fix-OR
Revert "Fix filtering by virtual columns with OR filter in query"
2023-10-16 10:51:06 +02:00