Commit Graph

454 Commits

Author SHA1 Message Date
Alexey Milovidov
f636dea879
Merge pull request #54327 from den-crane/background_fetches_pool_size
increase background_fetches_pool_size to 16, background_schedule_pool_size to 512
2023-11-26 02:50:38 +01:00
Nikita Mikhaylov
1b623b0e48 Done 2023-11-24 20:03:02 +00:00
Vitaly Baranov
5f461ff780 Change the default for "wait_dictionaries_load_at_startup" to true,
and use this setting only if "dictionaries_lazy_load" is false.
2023-11-23 14:45:42 +01:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
zvonand
5153798aeb Introduced fileCluster table function
Added fileCluster function
Added test and docs
2023-11-22 15:06:04 +01:00
vdimir
15234474d7
Implement system table blob_storage_log 2023-11-21 09:18:25 +00:00
serxa
9023f61349 Merge branch 'master' into async-loader-integration 2023-11-19 13:05:58 +00:00
Vitaly Baranov
d62048031f Add documentation. 2023-11-15 13:57:28 +01:00
Alexey Milovidov
04630c3e5a Merge branch 'master' into better-settings 2023-11-11 09:26:59 +01:00
Antonio Andelic
e9542e4153
Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol
Support compression for keeper protocol
2023-11-09 10:00:19 +01:00
Alexey Milovidov
d34809bc7c Revert a wrong change in server settings 2023-11-09 00:32:43 +01:00
serxa
19aa1375fc Merge branch 'master' into async-loader-integration 2023-11-07 10:25:38 +00:00
Arthur Passos
b6e205dcdf
Add ClickHouse setting to disable tunneling for HTTPS requests over HTTP proxy (#55033)
* initial commit. integ tests passing, need to re-run unit & my own personal tests

* partial refactoring to remove Protocol::ANY

* improve naming

* remove all usages of ProxyConfiguration::Protocol::ANY

* fix ut

* blabla

* support url functions as well

* support for HTTPS requests over HTTP proxy with tunneling off

* remove gtestabc

* fix silly mistake

* ...

* remove usages of httpclientsession::proxyconfig in src/

* got you

* remove stale comment

* it seems like I need reasonable defaults

* fix ut

* add some comments

* remove no longer needed header

* matrix out

* add https over http proxy with no tunneling

* soem docs

* partial refactoring

* rename to use_tunneling_for_https_requests_over_http_proxy

* improve docs

* use shorter version

* remove useless test

* rename the setting

* update

* fix typo

* fix setting docs typo

* move ); up

* move ) up
2023-11-04 13:47:52 -04:00
Smita Kulkarni
3fdf0daf1b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-31 10:43:28 +01:00
Justin de Guzman
e33dc02c8c
Add note clarifying Prometheus support in ClickHouse Cloud (#56069) 2023-10-30 13:35:02 +01:00
Smita Kulkarni
960927a323 Updated name to use_compression 2023-10-27 14:53:54 +02:00
Sergei Trifonov
a5d7c2b6a2
Merge branch 'master' into async-loader-integration 2023-10-27 10:39:12 +02:00
Smita Kulkarni
d1d8f4b2e1 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-26 16:56:03 +02:00
Alexander Tokmakov
fa963d60d0
Merge pull request #55641 from evillique/resubmit-cluster-groups
Resubmit #54421
2023-10-26 15:53:53 +02:00
Nikolay Degterinsky
95f58777e9 Fix style 2023-10-25 19:04:30 +00:00
serxa
749cdb9954 Merge branch 'master' into async-loader-integration 2023-10-24 10:09:49 +00:00
Smita Kulkarni
ede91f42e6 Addressed review comments 2023-10-23 16:42:08 +02:00
Alexander Tokmakov
f899254e2c
Merge pull request #55430 from arthurpassos/properly_split_remote_proxy_http_https
Properly split remote proxy http https
2023-10-20 21:15:34 +02:00
Jordi Villar
01093d4698 Remove deprecated setting do_not_evict_index_and_mark_files 2023-10-20 09:27:46 +02:00
serxa
0e17da22eb Merge branch 'master' into async-loader-integration 2023-10-16 11:08:29 +00:00
Nikolay Degterinsky
c1fba94d67 Resubmit #54421
This reverts commit 3e60451ac7.
2023-10-14 19:04:01 +00:00
Smita Kulkarni
13ffebf559 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-14 20:08:49 +02:00
Alexander Tokmakov
3e60451ac7 Revert "Merge pull request #54421 from evillique/cluster-groups"
This reverts commit 211c80e1a0, reversing
changes made to b53a98217c.
2023-10-13 18:55:51 +02:00
Alexander Tokmakov
e40aa72883
Merge pull request #54826 from JackyWoo/lb_nearest_host_name
Add load balancing hostname_levenshtein_distance
2023-10-13 17:23:02 +02:00
robot-clickhouse-ci-1
211c80e1a0
Merge pull request #54421 from evillique/cluster-groups
Add replica groups to Replicated database engine
2023-10-12 18:14:42 +02:00
Nikolay Degterinsky
20e16be27b Fixes & improvements 2023-10-12 15:02:08 +00:00
Arthur Passos
d54186df30 tmp 2023-10-04 17:21:41 -03:00
Denny Crane
0eeee950d7 Merge branch 'master' into background_fetches_pool_size 2023-09-28 15:34:17 -03:00
JackyWoo
5da03e8ba5 Add load balancing test_hostname_levenshtein_distance 2023-09-27 10:46:39 +08:00
Smita Kulkarni
060724b75e Added docs 2023-09-24 12:02:48 +02:00
Robert Schulze
4ed5b903b4
Docs: remove anchor prefix 2023-09-18 18:35:59 +00:00
Denny Crane
e78d09cc8e Merge branch 'master' into background_fetches_pool_size 2023-09-17 20:01:39 -03:00
Sergei Trifonov
12c71be9ca
Merge branch 'master' into async-loader-integration 2023-09-14 15:29:07 +02:00
vdimir
10bcc028df
Add cluster discovery documentation 2023-09-14 11:16:09 +00:00
serxa
28e65883aa rename settings 2023-09-13 12:22:46 +00:00
serxa
a2f8f6bf29 working on review comments 2023-09-07 13:21:43 +00:00
Denny Crane
e1bc6cb0a7 increase background_fetches_pool_size to 16, background_schedule_pool_size to 512 2023-09-05 15:24:21 -03:00
Sergei Trifonov
c10e42ca05
Merge branch 'master' into async-loader-integration 2023-08-28 20:20:31 +02:00
Victor Krasnov
921f0c8b5d Merge branch 'master' into ADQM-987 2023-08-25 21:20:23 +03:00
Victor Krasnov
258f9927b4 Merge branch 'master' into ADQM-987 2023-08-22 16:49:32 +03:00
Robert Schulze
f2fb7365e6
Add settings for 1. size_ratio (all caches) and 2. policy (index caches)
1. is an expert-level setting, default is 0.5, applies only to SLRU.

Also, I noticed that we expose cache policy settings for the mark and
the uncompresed cache but not for the index mark and the index
uncompressed cache. Changed that as well, it simplifies the code a bit.
2023-08-22 11:04:29 +00:00
Robert Schulze
96c8b250ce
Allow to configure cache sizes at runtime 2023-08-21 13:51:10 +00:00
Victor Krasnov
8b005a9d02 Update the documentaion 2023-08-21 12:37:58 +03:00
Kenji Noguchi
17c4abce10 CVE-2016-2183: disable 3DES 2023-08-01 10:44:43 -07:00
Sergei Trifonov
e4ae2ece7c
Merge branch 'master' into async-loader-integration 2023-08-01 13:04:11 +02:00
Alexander Tokmakov
01f05e14eb
Merge pull request #50424 from tonickkozlov/tonickkozlov/zk-session-lifetime
Introduce fallback ZooKeeper sessions
2023-07-31 15:14:44 +03:00
Anton Kozlov
5dfc30528d Introduce fallback ZooKeeper sessions 2023-07-28 11:43:27 +00:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
Sergei Trifonov
850ab23991
Merge branch 'master' into async-loader-integration 2023-07-17 19:14:54 +02:00
robot-ch-test-poll4
036fb1fc9b
Merge pull request #52041 from ClickHouse/docs-organize-user-profiles
Docs organize user setting profiles
2023-07-17 12:03:06 +02:00
DanRoscigno
6086787957 add overview 2023-07-11 16:59:16 -04:00
Victor Krasnov
5b102ce7d4 Amend English version of settings.md 2023-07-07 17:21:47 +08:00
Victor Krasnov
7080d85d2d Amend the documentation 2023-07-07 10:54:36 +08:00
Sergei Trifonov
bbb5850dec
Merge branch 'master' into async-loader-integration 2023-07-03 20:21:26 +02:00
Denny Crane
37ad50bd63
Update settings.md 2023-06-28 19:40:40 -03:00
Sergei Trifonov
b9b007691c
Merge branch 'master' into async-loader-integration 2023-06-27 19:44:52 +02:00
Sergei Trifonov
e2798b5221
Merge branch 'master' into async-loader-integration 2023-06-26 19:18:23 +02:00
Alexey Milovidov
0e88aae9d7 Remove ConsoleCertificateHandler 2023-06-26 04:27:50 +02:00
Andrey Zvonov
d4316c7189
Merge branch 'master' into zvonand-implicit-tz 2023-06-22 17:23:20 +02:00
DanRoscigno
804466f129 fix server settings nav 2023-06-21 11:20:17 -04:00
Sergei Trifonov
02e0d7e204
Merge branch 'master' into async-loader-integration 2023-06-20 12:03:29 +02:00
zvonand
4155d13d69 merge master and resolve conflict 2023-06-16 02:20:32 +02:00
Alexander Tokmakov
6fc9479730
Update settings.md (#51007) 2023-06-15 13:51:42 +03:00
Jordi Villar
01873e9e6d Add async insert system tables documentation 2023-06-08 17:50:17 +02:00
Andrey Zvonov
d95be4162f
Merge branch 'master' into zvonand-implicit-tz 2023-06-08 18:34:45 +03:00
serxa
1dcf0977df fix style 2023-06-03 16:15:35 +00:00
Sergei Trifonov
3ee782a0ec
Merge branch 'master' into async-loader-integration 2023-06-02 18:27:19 +02:00
Dan Roscigno
fb11f7eb6f
Merge pull request #50478 from DanRoscigno/user-settings-docs
move from server to user settings
2023-06-02 10:56:28 -04:00
Robert Schulze
54872f9e7e
Typos: Follow-up to #50476 2023-06-02 13:28:09 +00:00
DanRoscigno
079008058a move from server to user settings 2023-06-02 08:49:26 -04:00
Andrey Zvonov
2e427ee028
Merge branch 'master' into zvonand-implicit-tz 2023-06-02 01:15:56 +03:00
serxa
e1045f76de rework async loader initialization and reconfiguration for bg/fg pools 2023-05-31 16:23:41 +00:00
Sergei Trifonov
9b64c6b9f3
Merge branch 'master' into async-loader-integration 2023-05-31 17:17:13 +02:00
Dan Roscigno
a01e8644c5
Settings update (#50350)
* sync system.server_settings with doc

* typos

* update DNS cache setting

* add server settings from system tbl

* catch up

* catch up

* Trigger Build

---------

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-05-31 03:09:56 +02:00
Andrey Zvonov
87fc780c14
Merge branch 'master' into zvonand-implicit-tz 2023-05-30 13:13:46 +03:00
helifu
6e8136e6f4 Add 'settings' expression for system log tables 2023-05-28 12:59:34 +08:00
helifu
59a815e4e6 Update according to review comments 2023-05-28 12:59:34 +08:00
helifu
57e5a4aa63 Add the 'order_by' description for system log tables 2023-05-28 12:59:34 +08:00
Denny Crane
b9ef5151ad
Update settings.md 2023-05-26 11:18:25 -03:00
Denny Crane
6b98e02857
Update settings.md 2023-05-25 19:21:32 -03:00
serxa
4d31051bb9 add async_load_databases server setting 2023-05-12 17:54:51 +00:00
zvonand
60b69601e9 update docs 2023-05-12 00:27:11 +02:00
Sergei Trifonov
b479637e2c
Merge branch 'master' into async-loader-integration 2023-05-09 13:04:36 +02:00
Alexey Milovidov
a8bdb20fc4
Merge pull request #48787 from ClickHouse/background-memory-tracker
Add MemoryTracker for the background tasks [Resubmit]
2023-05-09 07:58:36 +03:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
alesapin
89caf40840
Merge pull request #46528 from myrrc/feature/show-secrets-option
Show secrets in `SHOW` and `SELECT` queries
2023-05-04 11:21:30 +02:00
DanRoscigno
d21cdde371 add check 2023-05-01 09:02:32 -04:00
Dan Roscigno
d36f60bc4a
Update settings.md
add listen_host to prometheus section
2023-05-01 08:50:18 -04:00
Sergei Trifonov
8dab49f328
Merge branch 'master' into async-loader-integration 2023-05-01 14:04:39 +02:00
Mike Kot
2d20658885
Merge branch 'master' into feature/show-secrets-option 2023-04-28 20:19:35 +03:00
Mike Kot
f1d0ed367d separate name for format setting 2023-04-28 13:39:38 +00:00
Mike Kot
7bffa89e96 add all 3 settings 2023-04-28 13:22:36 +00:00
Mike Kot
e428af0b63 replace format settings with server setting 2023-04-27 21:27:18 +00:00
serxa
86122409e2 more work 2023-04-26 18:27:23 +00:00
Robert Schulze
7fe0562de5
Make the cfg parameter naming more consistent 2023-04-23 14:00:22 +00:00
Robert Schulze
e70190f5b5
Cleanup more function docs 2023-04-20 12:48:50 +00:00
Robert Schulze
cdf28f9b71
Minor fixups 2023-04-19 16:16:51 +00:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space 2023-04-19 15:56:55 +00:00
Dmitry Novik
cf5d9a175a Revert "Merge pull request #48760 from ClickHouse/revert-46089-background-memory-tracker"
This reverts commit a61ed33223, reversing
changes made to 5f01b8a2b5.
2023-04-14 16:34:19 +02:00
Alexander Tokmakov
af1bf08663
Revert "Add MemoryTracker for the background tasks" 2023-04-13 21:05:02 +03:00
Dmitry Novik
06e6794fc0 Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-04-11 15:29:35 +00:00
Rich Raposa
330508552e
Merge branch 'master' into docs/background_pool_size 2023-03-31 11:24:00 -06:00
kst-morozov
048ea93c09 upadte doc 2023-03-31 17:59:19 +02:00
filimonov
fbb22348ea
Refactor reading the pool setting & from server config. (#48055)
After #36425 there was a lot of confusions/problems with configuring pools - when the message was confusing, and settings need to be ajusted in several places.
See some examples in #44251, #43351, #47900, #46515.

The commit includes the following changes:
1) Introduced a unified mechanism for reading pool sizes from the configuration file(s). Previously, pool sizes were read from the Context.cpp with fallbacks to profiles, whereas main_config_reloader in Server.cpp read them directly without fallbacks.
2) Corrected the data type for background_merges_mutations_concurrency_ratio. It should be float instead of int.
3) Refactored the default values for settings. Previously, they were defined in multiple places throughout the codebase, but they are now defined in one place (or two, to be exact: Settings.h and ServerSettings.h).
4) Improved documentation, including the correct message in system.settings.

Additionally make the code more conform with #46550.
2023-03-30 16:44:11 +02:00
DanRoscigno
6d8a2bbd48 standardize admonitions 2023-03-27 14:54:05 -04:00
Alexey Milovidov
b6892f53fc
Merge pull request #47724 from ClickHouse/rs/qc-better-cfg-name
Rename cfg parameter query_cache.size to query_cache.max_size
2023-03-27 00:36:24 +03:00
rfraposa
70912b15bc Update settings.md 2023-03-25 15:56:04 -06:00
Robert Schulze
0712627c05
Query cache: Fix config naming ambiguity
Add 'max_' prefix to 'size' setting to make it more clear that the cache
consumes no space if not used.
2023-03-24 12:52:09 +00:00
rfraposa
ac5ed141d8 New nav - reverting the revert 2023-03-17 21:45:43 -05:00
Alexander Tokmakov
ec44c8293a
Revert "New navigation" 2023-03-17 21:21:11 +03:00
Rich Raposa
81cd962773
Merge branch 'master' into new-nav 2023-03-15 22:23:44 -06:00
Denny Crane
97a42dbada
Update settings.md 2023-03-14 15:13:46 -03:00
Dmitry Novik
4f24a7bd11 Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-03-10 18:57:45 +00:00
rfraposa
2bb08b083f Link fixes 2023-03-09 23:09:46 -07:00
Rich Raposa
5bf568b9c6
Merge branch 'master' into new-nav 2023-03-09 16:11:55 -07:00
Rich Raposa
7aee4eeb8c
Merge pull request #47413 from ClickHouse/revert-47407-standardize-adminitions
Revert "standardize admonitions"
2023-03-09 14:59:34 -07:00
robot-clickhouse-ci-2
80c3e387c1
Merge pull request #47389 from DerekChia/patch-1
Update Prometheus port to 9363
2023-03-09 22:39:28 +01:00
Rich Raposa
de68dade71
Revert "standardize admonitions" 2023-03-09 14:30:40 -07:00
DanRoscigno
95351bc2d3 standardize admonitions 2023-03-09 12:05:26 -05:00
Derek Chia
1728d6ed2c
Update settings.md
- Change Prometheus port to 9363 as listed in https://clickhouse.com/docs/en/guides/sre/network-ports/
2023-03-09 11:44:27 +08:00
Rich Raposa
f24fad9e26
Merge branch 'master' into new-nav 2023-03-08 14:31:10 -07:00
Sergei Trifonov
880b34fded
Update docs/en/operations/server-configuration-parameters/settings.md
Co-authored-by: pufit <pufit@clickhouse.com>
2023-03-08 10:51:34 +01:00
Sergei Trifonov
20c0476d2f
Update docs/en/operations/server-configuration-parameters/settings.md
Co-authored-by: pufit <pufit@clickhouse.com>
2023-03-08 10:51:16 +01:00
rfraposa
fa6f3dadba Link fixes 2023-03-07 22:52:43 -07:00
rfraposa
008845216d Fix broken links 2023-03-07 14:06:14 -07:00
Sergei Trifonov
3dcdf4cd4e
Docs for BackupsIOThreadPool 2/2 2023-03-07 12:12:29 +01:00
rfraposa
17a2d7ed45 Fixing broken links 2023-03-01 16:53:17 -07:00
Ilya Yatsishin
9fb24341e2
Update settings.md 2023-02-24 12:12:45 +01:00
vdimir
a4919ce3a2
Add doc for temporary_data_in_cache 2023-02-22 10:19:28 +00:00
Dmitry Novik
728434821a Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-02-16 12:35:07 +00:00
Dmitry Novik
e7a94a28ee
Merge branch 'master' into background-memory-tracker 2023-02-15 19:39:28 +01:00
Dmitry Novik
1a968b83d1 Add documentation 2023-02-15 18:34:51 +00:00
Sergei Trifonov
b7a4fa8bd9
Merge branch 'master' into round-robin-merge-scheduler 2023-02-14 20:39:02 +01:00
Dan Roscigno
e86b83fbd1
Update docs/en/operations/server-configuration-parameters/settings.md
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
2023-02-12 14:55:52 -05:00
serxa
c58b165b0f add config option to select scheduling policy 2023-02-11 16:18:42 +00:00
DanRoscigno
043c1b7d8d docs for logger stream_compression 2023-02-10 09:02:54 -05:00
Robert Schulze
216636f984
Make query cache global settings re-configurable 2023-02-01 10:35:19 +00:00
Robert Schulze
40491b4c85
Update docs/en/operations/server-configuration-parameters/settings.md
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
2023-01-31 12:43:58 +01:00
Robert Schulze
325c6bdf3d
Renaming: "Query Result Cache" --> "Query Cache"
Reasons:

- The cache will at some point store intermediate results as opposed to
  only query results. We should change the terminology now without
  having to worry about backward compat.

- Equivalent caches in MySQL (1) and Starrocks (2) are called "query
  cache".

- The new name is ca. 13.8% more catchy.

(1) https://dev.mysql.com/doc/refman/5.6/en/query-cache.html
(2) https://docs.starrocks.io/en-us/2.5/using_starrocks/query_cache
2023-01-31 09:54:34 +00:00
Robert Schulze
340f406553
Merge branch 'master' into query-result-cache 2023-01-22 13:21:36 +01:00
Stig Bakken
420c179b55 Add <storage_policy> config parameter for system logs 2023-01-19 10:25:28 +01:00
Robert Schulze
4f90824347
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-17 22:49:53 +00:00
Robert Schulze
15e11741cb
Cosmetics 2023-01-13 00:00:23 +00:00
Robert Schulze
475bb31f33
Make server configuratio hierarchical 2023-01-12 21:24:40 +00:00
serxa
2dae6a1ffe add docs for concurrency control logic 2023-01-11 19:19:51 +00:00