Commit Graph

117072 Commits

Author SHA1 Message Date
Michael Kolupaev
badde0fde2 Print git hash when crashing 2023-06-14 15:22:44 -07:00
Jiebin Sun
fcadb851c8
Maintain per-thread timer_id rather than create/delete frequently (#48778)
* Maintain per-thread timer_id rather than create/delete frequently

The QueryProfiler will frequently create/delete timer_id globally, which
will result in heavy kernel lock contention.
The idea is to maintain thread-local timer_id. Before create the
timer_id, it should check whether there is a timer_id already. And we
could stop the timer by timer_settime() rather than delete the timer_id
with timer_delete().

Apply the patch and run clickbench on latest 65d671b7c7 ClickHouse with
SPR 112 x 2 vCPUs. Query 4, 0, 5, 3, 15, 32 have 17.5%, 14.4%, 8.3%, 7.9%,
7.1%, 5.8% performance gain. The overall geomean has got 2.5%
performance gain.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Pack the timer and delete the timer_id when thread terminates

Pack the timer and related methods into the class. Delete the timer_id
when the thread terminates.

According to the issue (ClickHouse#49965),
all of the SSB queries benefit from this optimization, some have even got
improved by ~30% and the overall QPS could be significantly improved by ~18%.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Update src/Common/QueryProfiler.cpp

Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>

* Update src/Common/QueryProfiler.cpp

Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>

* Fix the review issue of QueryProfiler Timer from PR
https://github.com/ClickHouse/ClickHouse/pull/48778.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Update src/Common/QueryProfiler.cpp

Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>

* Add two separate CurrentMetrics for created and active timers
in QueryProfiler.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

---------

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
Co-authored-by: Nikita Taranov <nikita.taranov@clickhouse.com>
2023-06-14 21:22:09 +02:00
robot-ch-test-poll3
c96f0c9f2f
Merge pull request #50992 from ClickHouse/thomoco-patch-4
Update mysql.md
2023-06-14 19:30:37 +02:00
robot-ch-test-poll3
d36c6ae870
Merge pull request #50988 from ClickHouse/thomoco-patch-3
Update postgresql.md
2023-06-14 19:30:11 +02:00
Sergei Trifonov
170e17c9e8
Merge pull request #50935 from azat/tests/02703_max_local_write_bandwidth 2023-06-14 18:54:49 +02:00
Thom O'Connor
fb304c0b05
Update postgresql.md
Fix table definition by adding ORDER BY() statement
2023-06-14 10:39:55 -06:00
Thom O'Connor
8eb84e9a58
Merge branch 'master' into thomoco-patch-3 2023-06-14 10:36:52 -06:00
Kruglov Pavel
7fc58d0171
Merge pull request #50987 from ClickHouse/Avogar-patch-1
Change submodule capnproto to it's fork in ClickHouse
2023-06-14 18:27:22 +02:00
Alexander Tokmakov
ffde5affeb
Merge pull request #50929 from ClickHouse/fix_illegal_column_timezone
Fix 'Illegal column timezone' in stress tests
2023-06-14 17:56:57 +03:00
Thom O'Connor
37245783ab
Update mysql.md
Updating mysql table function with example for copying data from MySQL into a ClickHouse MergeTree table
2023-06-14 08:03:18 -06:00
Thom O'Connor
c49bde8961
Update postgresql.md
Updated PostgreSQL documentation to better show example of using PostgreSQL() table engine for SELECT and INSERT, vs. copying data via postgresql() table function for copying data into ClickHouse
2023-06-14 07:11:28 -06:00
Igor Nikonov
bdeabd848a
Merge pull request #50095 from ClickHouse/test-plan-optimization-analyzer
Test plan optimization analyzer
2023-06-14 14:56:35 +02:00
Kruglov Pavel
85db1eb6fc
Change submodule capnproto to it's fork in ClickHouse 2023-06-14 14:55:11 +02:00
Dmitry Novik
1d88b16830
Merge pull request #50584 from ClickHouse/analyzer-optimizations-on-shards
Analyzer: Do not apply Query Tree optimizations on shards
2023-06-14 14:31:46 +02:00
Nikolai Kochetov
5163927b7d
Merge pull request #50923 from ClickHouse/read-in-order-proj-bug
Do not apply projection if read-in-order was enabled.
2023-06-14 13:13:25 +02:00
Nikita Taranov
a00e42f75b
Fix erroneous sort_description propagation in CreatingSets (#50955) 2023-06-14 13:00:47 +02:00
Kseniia Sumarokova
e2d8299b23
Merge pull request #50952 from nickitat/fix_remote_read_perf_degr
Fix logic in `AsynchronousBoundedReadBuffer::seek`
2023-06-14 11:25:26 +02:00
Robert Schulze
2643fd2c25
Merge pull request #50689 from arenadata/ADQM-871
Added connection string to clickhouse-client
2023-06-14 10:39:32 +02:00
Nikolai Kochetov
ab6ac6beb1 Fixing a test. 2023-06-14 08:37:18 +00:00
Robert Schulze
b1eacab44a
Merge pull request #50972 from rschu1ze/docs-embedded-link
Docs: Fix embedded video link
2023-06-14 10:13:49 +02:00
Robert Schulze
f4cfb9e370
Fix line break 2023-06-14 07:50:26 +00:00
Robert Schulze
b1f0a91b78
Docs: Fix embedded video link 2023-06-14 07:48:08 +00:00
Robert Schulze
edd29492c3
Merge pull request #50893 from rschu1ze/snowflake-crash
Fix LOGICAL_ERROR in snowflakeToDateTime*()
2023-06-14 09:42:21 +02:00
Robert Schulze
853c224a78
Merge pull request #50954 from arenadata/Fix-convert_type_with_default
Uncomment flaky test (01746_convert_type_with_default)
2023-06-14 09:39:17 +02:00
Alexander Gololobov
f74c585426
Typos 2023-06-14 07:46:11 +02:00
Alexey Gerasimchuck
4db8fa39c7 Removed extra lines 2023-06-14 04:38:46 +00:00
Alexey Gerasimchuck
868c3bd45d minor change 2023-06-14 04:29:08 +00:00
pufit
91d794cf0a
Merge pull request #50150 from JackyWoo/support_redis
Add Redis table Engine/Function
2023-06-13 21:34:14 -04:00
Alexey Gerasimchuck
f1b5d47ce2 corrections after second review iteration 2023-06-14 01:26:39 +00:00
JackyWoo
49082bfe89 fix typos in redis.md 2023-06-14 09:00:50 +08:00
Rich Raposa
081376e3c8
Merge pull request #50960 from ClickHouse/rfraposa-patch-2
Update azureBlobStorage.md
2023-06-13 17:13:38 -06:00
Rich Raposa
86075dbae4
Update azureBlobStorage.md 2023-06-13 16:40:14 -06:00
Dmitry Kardymon
994228ab20 Uncomment flaky test 2023-06-13 20:54:02 +00:00
Igor Nikonov
fc46a787c7
Merge branch 'master' into test-plan-optimization-analyzer 2023-06-13 21:53:03 +02:00
Nikita Taranov
1bc5598aa7 impl 2023-06-13 20:02:50 +02:00
Sergei Trifonov
37f55ce253
Merge branch 'master' into tests/02703_max_local_write_bandwidth 2023-06-13 19:48:43 +02:00
Robert Schulze
22670aebf8
Merge pull request #50942 from ClickHouse/fix-ann-page
Fixes to ANN docs page
2023-06-13 17:57:00 +02:00
Mikhail f. Shiryaev
102c532c20
Merge pull request #50947 from ClickHouse/fix-stateless-image
Fix the statless tests image for old commits
2023-06-13 17:55:23 +02:00
Mikhail f. Shiryaev
0bc624dc02
Fix the statless tests image for old commits 2023-06-13 17:53:19 +02:00
Robert Schulze
76f69f2b44
Revert overengineering 2023-06-13 15:52:06 +00:00
Dan Roscigno
77a001d1b6
Merge pull request #50915 from ClickHouse/Fix_heading_sidebar_azureBlobStorage
Fix heading and sidebar for azureBlobStorage table function
2023-06-13 11:48:05 -04:00
Dan Roscigno
5d1ea9aa18
Merge branch 'master' into fix-ann-page 2023-06-13 11:32:58 -04:00
Robert Schulze
8dddec4c4c
Merge pull request #50937 from rschu1ze/disable-01746_convert_type_with_default
01746_convert_type_with_default: Temporarily disable flaky test
2023-06-13 17:30:38 +02:00
Dan Roscigno
ecedceea1e
Merge branch 'master' into Fix_heading_sidebar_azureBlobStorage 2023-06-13 11:27:47 -04:00
DanRoscigno
b850f1b999 fix broken line 2023-06-13 11:26:12 -04:00
Robert Schulze
92ad3bf30c
Merge pull request #50943 from ClickHouse/DanRoscigno-patch-5
Update annindexes.md
2023-06-13 17:26:07 +02:00
Dan Roscigno
20ea87e527
Update annindexes.md
Don't break code snippets across lines.
2023-06-13 11:17:33 -04:00
Rich Raposa
7115c069d3
Merge branch 'master' into fix-ann-page 2023-06-13 09:14:38 -06:00
rfraposa
57cdd3a25d Update annindexes.md 2023-06-13 09:13:13 -06:00
Robert Schulze
46fbe7fb26
01746_convert_type_with_default: Temporarily disable flaky test 2023-06-13 15:01:51 +00:00