Commit Graph

286 Commits

Author SHA1 Message Date
Azat Khuzhin
c7f392500e Fix incorrect free space accounting for least_used JBOD policy
Before least_used fails to detect when the disk started to have more
space, it works only when the disk starts to have less space.

The reason for this is that it uses priority_queue, and once the disk
goes at the bottom of the queue, free space will not be updated for it
until it will be selected again.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-29 17:36:31 +01:00
Kruglov Pavel
14c97fb426
Update docs/en/engines/table-engines/mergetree-family/mergetree.md 2023-10-23 12:48:05 +02:00
Srikanth Chekuri
327386a348 Merge remote-tracking branch 'upstream/master' into issue-55023 2023-10-22 10:22:14 +05:30
Srikanth Chekuri
0f2e0ade99 Update merge tree doc 2023-10-21 21:51:10 +05:30
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
Han Fei
253b8efa58 do not modify column type when there is statistic 2023-10-11 16:57:40 +02:00
Han Fei
8d5eb26185 address comments 2023-10-09 23:06:23 +02:00
Han Fei
3894c75af1 change a docs example about creating table columns with ttl 2023-10-09 18:34:36 +02:00
Han Fei
76b9d43dc4 make code beautiful 2023-09-27 11:01:53 +02:00
Han Fei
4e7745f757 Merge branch 'master' into hanfei/statistic 2023-09-26 21:43:53 +02:00
SmitaRKulkarni
d8adf05de2
Added a new column _block_number (#47532)
Added a new virtual column _block_number which is persisted on merges when allow_experimental_block_number_column is enabled
2023-09-20 11:31:12 +02:00
Han Fei
17243b84ab Merge branch 'master' into hanfei/statistic 2023-09-19 17:09:17 +02:00
kssenii
10518a9c83 Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-09-18 13:00:26 +02:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
Han Fei
ddcb64f39f update docs and refine statements 2023-09-08 02:27:17 +02:00
Kseniia Sumarokova
bf3dc24471
Update mergetree.md 2023-09-07 11:23:42 +02:00
Nikolay Degterinsky
2db239d6ad Make docs better 2023-09-05 12:43:53 +00:00
serxa
14e2032d92 add documentation 2023-09-01 16:28:03 +00:00
Yatsishin Ilya
c7ccf23a24 Update CREATE TABLE docs 2023-07-06 10:44:06 +00:00
DanRoscigno
bf06e18c34 docs clickhouse-static-files-uploader and demo repo 2023-06-30 09:03:25 -04:00
DanRoscigno
4ee094cab1 review comments 2023-06-29 12:13:26 -04:00
DanRoscigno
dd3a744cef add HDFS example 2023-06-28 11:17:16 -04:00
DanRoscigno
b392127304 add example web config 2023-06-28 11:00:07 -04:00
DanRoscigno
bfcadabb92 add web disk type 2023-06-28 10:30:49 -04:00
DanRoscigno
c42bf37a14 list the disk types 2023-06-28 09:59:32 -04:00
Denny Crane
93e0e2c7cf
Update mergetree.md 2023-06-14 19:04:20 -03:00
Denny Crane
e6e8576864
Update mergetree.md 2023-06-12 17:04:33 -03:00
Robert Schulze
b8178088d0
Misc Annoy fixes 2023-06-08 15:06:17 +00:00
Robert Schulze
54872f9e7e
Typos: Follow-up to #50476 2023-06-02 13:28:09 +00:00
Robert Schulze
65cc92a78d
CI: Fix aspell on nested docs 2023-06-02 12:24:41 +00:00
Sema Checherinda
b0eff95388 update doc, add profile event WriteBufferFromS3WaitInflightLimitMicroseconds 2023-05-26 18:59:21 +02:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
johanngan
731823b873 Add support for SSE-KMS configuration with S3
https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingKMSEncryption.html

Similar to the server_side_encryption_customer_key_base64 option for
configuring SSE-C with S3, add the following settings to configure
SSE-KMS on a per-endpoint/disk basis:
  - server_side_encryption_kms_key_id
  - server_side_encryption_kms_encryption_context
  - server_side_encryption_kms_bucket_key_enabled
2023-05-03 21:35:38 -05:00
johanngan
1bc52977a7 Support "header" setting in S3 disk config
The S3 table engine supports specifying extra HTTP headers in S3
requests to certain endpoints, via the "headers" setting. This commit
adds the same setting to S3 disk config.
2023-05-03 21:32:58 -05:00
vdimir
d3c7054bcf
Merge pull request #49169 from lingtaolf/doc/bloomfilter_compute_functions 2023-05-03 12:43:45 +02:00
DanRoscigno
4ae2a467f7 add note about other disk types 2023-05-01 14:50:08 -04:00
Dan Roscigno
2b141a195a
Apply suggestions from code review
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2023-05-01 14:38:05 -04:00
DanRoscigno
fa4ab93f21 add dynamic and nested dynamic 2023-05-01 14:06:50 -04:00
DanRoscigno
30dd645b4f add docs for nested dynamic disks 2023-05-01 13:02:32 -04:00
凌涛
e4011aa9c5
Update mergetree.md 2023-04-26 19:41:13 +08:00
凌涛
935656c23a add docs for create bmEstimate functions 2023-04-26 17:55:40 +08:00
凌涛
58de2dae26 add docs for create bmEstimate functions 2023-04-26 17:51:39 +08:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space 2023-04-19 15:56:55 +00:00
Eric Thomas
8d5e72cc26
Fix docs for case insensitive searches with a token bloom filter 2023-04-13 14:04:55 -06:00
filimonov
fbb22348ea
Refactor reading the pool setting & from server config. (#48055)
After #36425 there was a lot of confusions/problems with configuring pools - when the message was confusing, and settings need to be ajusted in several places.
See some examples in #44251, #43351, #47900, #46515.

The commit includes the following changes:
1) Introduced a unified mechanism for reading pool sizes from the configuration file(s). Previously, pool sizes were read from the Context.cpp with fallbacks to profiles, whereas main_config_reloader in Server.cpp read them directly without fallbacks.
2) Corrected the data type for background_merges_mutations_concurrency_ratio. It should be float instead of int.
3) Refactored the default values for settings. Previously, they were defined in multiple places throughout the codebase, but they are now defined in one place (or two, to be exact: Settings.h and ServerSettings.h).
4) Improved documentation, including the correct message in system.settings.

Additionally make the code more conform with #46550.
2023-03-30 16:44:11 +02:00
Robert Schulze
44d0a8075d
Small follow-up to #46252 2023-03-28 21:06:58 +00:00
Robert Schulze
622d1dfadd
Merge pull request #46252 from ClibMouse/feature/hastokencaseinsensitive-index-utilization
Implement tokenbf_v1 index utilization for hasTokenCaseInsensitive
2023-03-28 22:38:21 +02:00
DanRoscigno
6d8a2bbd48 standardize admonitions 2023-03-27 14:54:05 -04:00
Robert Schulze
8cf031ee2e
Docs: Update secondary index example
Fixes: #47923
2023-03-23 22:36:38 +00:00
ltrk2
f46970671d Implement tokenbf_v1 index utilization for hasTokenCaseInsensitive 2023-03-23 12:24:13 -07:00
Robert Schulze
3953d77059
+ on 2023-03-23 10:51:25 +00:00
Robert Schulze
451df6db07
More fixup 2023-03-23 10:50:40 +00:00
Robert Schulze
b3260f2201
Docs: Fixup docs on Map-data-type support in data skipping indexes 2023-03-23 10:24:26 +00:00
Antonio Andelic
a0582a14b9
Merge pull request #47423 from ClickHouse/add-expiration-window-s3
Add expiration window for S3 credentials
2023-03-18 10:11:29 +01:00
rfraposa
ac5ed141d8 New nav - reverting the revert 2023-03-17 21:45:43 -05:00
Alexander Tokmakov
ec44c8293a
Revert "New navigation" 2023-03-17 21:21:11 +03:00
Antonio Andelic
55c07ea16e Update docs 2023-03-10 10:12:01 +00:00
Rich Raposa
de68dade71
Revert "standardize admonitions" 2023-03-09 14:30:40 -07:00
DanRoscigno
95351bc2d3 standardize admonitions 2023-03-09 12:05:26 -05:00
Rich Raposa
cb4f8c85ba
Merge branch 'master' into new-nav 2023-03-04 18:09:56 -07:00
Robert Schulze
11930ad685
Docs: Update index support of has(), hasAny(), hasAll() 2023-03-04 17:27:47 +00:00
rfraposa
5ede8cc69a Broken links 2023-03-04 09:03:04 -07:00
Anton Popov
ccf7b6f4c1
Merge pull request #45582 from mrcrypster/patch-4
DELETE + WHERE in TTL
2023-02-10 14:27:54 +01:00
DanRoscigno
a88c222f44 add missing heading 2023-01-27 08:56:25 -05:00
DanRoscigno
80b3b882c3 review from ksenii 2023-01-27 08:48:29 -05:00
DanRoscigno
15b4c712df updates related to s3 cache change 2023-01-26 16:32:39 -05:00
DanRoscigno
917e3d4244 add PARTITION BY to s3 and hdfs docs 2023-01-25 09:09:28 -05:00
Denys Golotiuk
c1de756d8a
DELETE + WHERE in TTL
ClickHouse actually supports only `DELETE` action with `WHERE` clause of a `TTL` statement
2023-01-24 17:50:29 +02:00
Kseniia Sumarokova
dd18dd2953
Merge pull request #45341 from ClibMouse/feature/non-throwing-hastoken
Introduce non-throwing variants of hasToken
2023-01-24 15:37:36 +01:00
ltrk2
9710b8643c Refine the solution 2023-01-23 14:27:48 -08:00
robot-ch-test-poll4
2066581d8f
Merge pull request #45451 from evillique/default_granularity
Add default GRANULARITY argument for secondary indexes
2023-01-20 17:46:21 +01:00
Nikolay Degterinsky
02142596fb Add docs 2023-01-20 15:22:13 +00:00
Robert Schulze
7e6d3163b1
Initial inverted index docs 2023-01-20 12:12:20 +00:00
Robert Schulze
099f50c0e3
Remove redundancy 2023-01-19 18:35:19 +00:00
Robert Schulze
c9988f4411
Mini fix 2023-01-19 17:04:17 +00:00
Robert Schulze
7355e3bc77
Docs: Beautify section on secondary index types 2023-01-19 17:00:31 +00:00
DanRoscigno
5d88a2b344 clarify autodetect 2023-01-18 15:51:31 -05:00
DanRoscigno
cd3ecb9091 add support_batch_delete to mergetree docs 2023-01-18 12:16:31 -05:00
Bo Lu
5d1886994f fix table ttl doc example 2022-12-28 15:45:05 +11:00
Sergei Trifonov
f2f0676bcc
Revert "Revert "S3 request per second rate throttling"" 2022-11-17 17:35:04 +01:00
Alexander Tokmakov
9011a18234
Revert "S3 request per second rate throttling" 2022-11-16 22:33:48 +03:00
Sergei Trifonov
159743edd6
Merge pull request #43014 from ClickHouse/disk-s3-throttler
S3 request per second rate throttling
2022-11-16 18:51:06 +01:00
Nikolay Degterinsky
81971acf35 Fix docs 2022-11-16 02:40:51 +00:00
Kseniia Sumarokova
59cf5def67
Merge branch 'master' into disk-s3-throttler 2022-11-15 12:13:37 +01:00
serxa
7448d1bb5d add docs 2022-11-09 14:58:41 +00:00
DanRoscigno
c822c8161f fix nav 2022-11-08 20:21:26 -05:00
DanRoscigno
45c9debeaf update links 2022-11-08 19:17:58 -05:00
Robert Schulze
42f680849c
Fix bad_cast in Annoy index
- Problem originally found by data type fuzzer
  https://s3.amazonaws.com/clickhouse-test-reports/42180/2f83d8790581dce0ffeec56c137b1d13160cfa7b/fuzzer_astfuzzermsan//report.html

- This commit restricts which data types are allowed for Annoy indexes
  (similar things are done for other index types).
2022-10-19 13:40:39 +00:00
FArthur-cmd
e7abc06c89 Revert "Revert "Add Annoy index""
This reverts commit 6fdfb964d0.
2022-08-30 15:26:56 +00:00
Alexander Tokmakov
6fdfb964d0
Revert "Add Annoy index" 2022-08-30 15:10:10 +03:00
Filatenkov Artur
d73f661732
Merge branch 'master' into annoy-2 2022-08-29 17:33:13 +03:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
FArthur-cmd
1e8910f048 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-21 08:45:03 +00:00
DanRoscigno
23b054617e update for setting change 2022-08-18 16:05:44 -04:00
DanRoscigno
364088d47b fix note 2022-08-12 14:40:09 -04:00
Denny Crane
3f4baa7658
Update mergetree.md 2022-08-04 23:49:19 -03:00
Filatenkov Artur
a218597546
Merge branch 'master' into annoy-2 2022-07-27 15:37:58 +03:00
Dan Roscigno
72efcc65c1
Update docs/en/engines/table-engines/mergetree-family/mergetree.md 2022-07-25 12:58:57 -04:00
Dan Roscigno
30a32371eb
Remove experimental status from projections 2022-07-22 11:50:59 -04:00
FArthur-cmd
fb5272971c small refactoring 2022-07-11 23:14:00 +03:00