Commit Graph

13177 Commits

Author SHA1 Message Date
Kruglov Pavel
96700abbe1
Merge pull request #45678 from azat/formats/json-parse-tupels
Add ability to ignore unknown keys in JSON object for named tuples
2023-01-27 21:11:05 +01:00
Kseniia Sumarokova
7d178e5ee6
Merge pull request #45680 from DanRoscigno/docs-mergetree-s3-cache
doc updates related to s3 cache change
2023-01-27 17:54:31 +01:00
DanRoscigno
a88c222f44 add missing heading 2023-01-27 08:56:25 -05:00
DanRoscigno
80b3b882c3 review from ksenii 2023-01-27 08:48:29 -05:00
Robert Schulze
4abd395153
Docs: Fix typo 2023-01-27 13:39:50 +00:00
Robert Schulze
5edf321927
Some docs fixes 2023-01-27 13:00:54 +01:00
Salvatore Mesoraca
464ecf50ef
doc: functions: hash: add sipHash{64,128}Keyed 2023-01-27 13:00:54 +01:00
Salvatore Mesoraca
dfd6dfc155
doc: functions: siphash: fix broken links 2023-01-27 13:00:53 +01:00
Salvatore Mesoraca
15b1f3f6a1
doc: functions: siphash: use correct value in example 2023-01-27 13:00:53 +01:00
Robert Schulze
e30c38cab3
Fix up some leftovers 2023-01-27 10:43:43 +00:00
Azat Khuzhin
1a8437f2c9 Add ability to ignore unknown keys in JSON object for named tuples
This can be useful in case your input JSON is complex, while you need
only few fields in it.

This behaviour is controlled by the
input_format_json_ignore_unknown_keys_in_named_tuple setting name, that
is turned OFF by default.

This will, almost, allow to parse gharchive dataset without jq. "almost"
because of two things:
- Tuple cannot be Nullable, so such keys with Tuple type in ClickHouse
  cannot be `null` in JSON
- You cannot use dot.dot notation to extract columns for file() engine,
  only tupleElement()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 10:01:08 +01:00
Jus
9ce4bf1baf
Update named-collections.md
small fix name host on the remote host
2023-01-27 12:42:53 +04:00
Jus
4f7b533bfd
update named-collections.md
Add connect to remote clickhouse with named collections
2023-01-27 12:41:21 +04:00
Alexey Milovidov
5b257ab806
Merge pull request #45233 from ClickHouse/improve_week_day
Revert "Revert "Improve week day""
2023-01-27 02:44:17 +03:00
DanRoscigno
15b4c712df updates related to s3 cache change 2023-01-26 16:32:39 -05:00
Robert Schulze
7d97fab2dc
Untangle query result cache settings
This PR modularizes the configuration options of the query result cache
(QRC).

1. Add a feature toggle "allow_experimental_query_result_cache = false"
   which controls whether the experimental QRC can be used at all. This
   configuration option will be removed once the QRC becomes
   non-experimental.

2. Modularize the existing two configuration settings
   "enable_experimental_query_result_cache" and
   "enable_experimental_query_result_cache_passive_usage" into three
   orthogonal settings:

   - "use_query_result_cache = false" controls whether a query (or all
     queries of the session) utilize the query result cache

   - settings "use_query_result_cache_passive_usage = true" and
     "use_query_result_cache_active_usage = true" control the way a
     query (or all queries of the session) utilize the query result
     cache: "passive" use is reading, "active" use is writing.
2023-01-26 21:17:48 +00:00
Dan Roscigno
76d6e2edf9
Merge pull request #45569 from AVMusorin/docs_optimize_skip_merged_partitions
docs: added optimize_skip_merged_partitions setting
2023-01-26 16:04:27 -05:00
Dan Roscigno
f8bd83a94f
Merge pull request #45595 from den-crane/patch-59
Doc. Update range_hashed description
2023-01-26 16:01:52 -05:00
Dan Roscigno
d1a81b2776
Update docs/en/engines/table-engines/mergetree-family/invertedindexes.md 2023-01-26 14:07:13 -05:00
Dan Roscigno
00b5354a93
Update invertedindexes.md 2023-01-26 14:05:26 -05:00
Dan Roscigno
f71b68bc46
Merge pull request #45651 from mrcrypster/patch-5
Added markdown format docs
2023-01-26 11:42:22 -05:00
Diego Nieto
836e14e52b
Update skipping-index.md
Deleted the confusing comment and added implemented as a mutation, like MATERIALIZE INDEX.
2023-01-26 17:23:39 +01:00
Dan Roscigno
777ddf80ab
Update docs/en/interfaces/formats.md 2023-01-26 11:18:18 -05:00
Diego Nieto
ec378fc4d6
Merge branch 'ClickHouse:master' into patch-1 2023-01-26 17:17:35 +01:00
Dan Roscigno
8549af4853
Update docs/en/engines/table-engines/mergetree-family/invertedindexes.md 2023-01-26 10:51:08 -05:00
DanRoscigno
710384e69a remove sidebar position 2023-01-26 10:13:06 -05:00
DanRoscigno
88076b6db0 add keywords 2023-01-26 10:06:06 -05:00
abidino
cba266c965
Update sum.md 2023-01-26 17:33:30 +03:00
DanRoscigno
c130050572 capitalize sidebar 2023-01-26 09:05:56 -05:00
Dan Roscigno
03c80d2794
Merge branch 'master' into docs-inverted-index-edits 2023-01-26 09:03:50 -05:00
DanRoscigno
310797d9f0 edits, add frontmatter 2023-01-26 08:58:10 -05:00
Dan Roscigno
efe94b727c
Merge pull request #45574 from FArthur-cmd/laion_doc
Add documentation for laion dataset
2023-01-26 08:43:28 -05:00
FArthur-cmd
71f7274f1f small fixes 2023-01-26 15:24:41 +03:00
Igor Nikonov
ed01f76c6a
Merge pull request #45592 from ClickHouse/update-insert-delay-doc-2
Update INSERT delay doc with example
2023-01-26 12:55:35 +01:00
Denys Golotiuk
0eadb7112d
Added markdown format docs 2023-01-26 13:33:14 +02:00
Dan Roscigno
b4ab361366
Merge branch 'master' into docs_optimize_skip_merged_partitions 2023-01-25 19:45:32 -05:00
Dan Roscigno
55c9b03c47
Update docs/en/sql-reference/statements/optimize.md 2023-01-25 19:45:25 -05:00
robot-clickhouse
976a3d26ec Update version_date.tsv and changelogs after v22.10.7.13-stable 2023-01-26 00:59:09 +01:00
robot-clickhouse
b9ee37f122 Update version_date.tsv and changelogs after v23.1.1.3077-stable 2023-01-25 23:05:49 +00:00
sichenzhao
243ac52259
Added two metrics about memory usage in cgroup to asynchronous metrics (#45301) 2023-01-25 20:32:17 +01:00
rfraposa
a1de808d11 Update mongodb.md 2023-01-25 11:44:13 -07:00
rfraposa
8d44f2aec1 Create mongodb.md 2023-01-25 11:31:07 -07:00
DanRoscigno
fe1d99a2d3 add PARTITION BY to file and url docs 2023-01-25 09:18:55 -05:00
DanRoscigno
917e3d4244 add PARTITION BY to s3 and hdfs docs 2023-01-25 09:09:28 -05:00
FArthur-cmd
304d1cc53e fix path in docs 2023-01-25 14:39:41 +03:00
Robert Schulze
d1eb9264ed
Merge remote-tracking branch 'origin/master' into docs-explain-plan 2023-01-25 11:05:46 +00:00
Robert Schulze
da7a657f1f
Docs: fix docs of EXPLAIN PLAN indexes=1 2023-01-25 11:02:50 +00:00
Robert Schulze
0148ad0e0e
Merge pull request #45598 from ClickHouse/typo-fix
Typo: "Granulesis" --> "Granules"
2023-01-25 11:52:11 +01:00
Robert Schulze
fd45295ff4
Typo: "Granulesis" --> "Granules" 2023-01-25 10:49:30 +00:00
Denny Crane
fda47bf4f8
Update external-dicts-dict-layout.md 2023-01-24 21:31:43 -04:00
Dan Roscigno
1cc3708092
Merge branch 'master' into update-settings-url 2023-01-24 19:51:39 -05:00
DanRoscigno
77ae27f26c update for split of format settings 2023-01-24 19:37:55 -05:00
Dan Roscigno
e520bd8052
Apply suggestions from code review 2023-01-24 19:10:30 -05:00
Igor Nikonov
29ef6b9574
Update INSERT delay doc properly 2023-01-25 00:26:32 +01:00
Dan Roscigno
dbb83dc9a4
Merge branch 'master' into docs-for-s3-settings 2023-01-24 17:55:31 -05:00
DanRoscigno
fe56967af7 fix note formatting 2023-01-24 17:44:10 -05:00
DanRoscigno
9775987ee9 add new settings for s3 and hdfs 2023-01-24 17:40:37 -05:00
DanRoscigno
f95bc55923 split Format settings out 2023-01-24 17:19:50 -05:00
Robert Schulze
d6ab376b02
Merge pull request #45586 from ClickHouse/document-datediff-week-start
Document start of week in function date_diff()
2023-01-24 21:38:00 +01:00
Robert Schulze
87ca5dcdf2
Document start of week in function date_diff() 2023-01-24 20:18:59 +00:00
Robert Schulze
5edea1b461
Docs: mini semicolon fix 2023-01-24 19:25:37 +00:00
robot-ch-test-poll1
0dab6f0208
Merge pull request #45573 from ClickHouse/update-docs-for-insert-delay
Update formula for INSERT delay
2023-01-24 17:07:46 +01:00
Igor Nikonov
e585a1228f
Update docs/en/operations/settings/merge-tree-settings.md
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-01-24 16:52:32 +01:00
FArthur-cmd
b1107eaff4 small improvement 2023-01-24 17:58:31 +03:00
FArthur-cmd
a7def60de8 resolve conflicts 2023-01-24 17:52:20 +03:00
FArthur-cmd
a8ed15650f add laion documentation 2023-01-24 17:47:04 +03:00
Igor Nikonov
21b009fdec
Update merge-tree-settings.md 2023-01-24 15:45:21 +01:00
Kseniia Sumarokova
dd18dd2953
Merge pull request #45341 from ClibMouse/feature/non-throwing-hastoken
Introduce non-throwing variants of hasToken
2023-01-24 15:37:36 +01:00
Kruglov Pavel
4bd3f0e5ef
Merge pull request #44953 from Avogar/tsv-csv-detect-header
Detect header in CSV/TSV/CustomSeparated files automatically
2023-01-24 15:13:52 +01:00
AVMusorin
5f8658b2d6
docs: added optimize_skip_merged_partitions setting 2023-01-24 14:56:39 +01:00
DanRoscigno
72b1a65984 WIP 2023-01-24 07:45:59 -05:00
Robert Schulze
574cab5d7e
Remove transitory parameter 2023-01-24 11:05:29 +00:00
Kseniia Sumarokova
ac1e7264fd
Merge pull request #45528 from ClickHouse/add-distinct-to-intersect
Add DISTINCT to INTERSECT and EXCEPT docs
2023-01-24 11:14:32 +01:00
Robert Schulze
aaf7653108
Merge remote-tracking branch 'origin/master' into block-non-float-gorilla-v2 2023-01-24 10:14:10 +00:00
rfraposa
33770303a0 Add DISTINCT to INTERSECT and EXCEPT 2023-01-23 17:10:30 -07:00
Rich Raposa
429e93965c
Update formats.md
Google has a new website for Protocol Buffers. The old link expires on Jan 31, 2023
2023-01-23 15:42:35 -07:00
ltrk2
9710b8643c Refine the solution 2023-01-23 14:27:48 -08:00
DanRoscigno
dedb4e4de2 add docs for PR 33302 2023-01-23 16:14:39 -05:00
Kruglov Pavel
478a552a0a
Merge branch 'master' into tsv-csv-detect-header 2023-01-23 21:47:17 +01:00
Diego Nieto
c4266588c6
Merge branch 'master' into patch-1 2023-01-23 20:50:37 +01:00
Dan Roscigno
ee31da9e1e
Merge pull request #45366 from gingerwizard/cross-link-docs
link docs to blogs
2023-01-23 14:04:59 -05:00
Robert Schulze
0ab7ae6c17
Merge pull request #43797 from ClickHouse/query-result-cache
Query result cache [experimental]
2023-01-23 19:54:35 +01:00
Dale Mcdiarmid
227b772dd6 remove JSON 2023-01-23 16:51:11 +00:00
Sergei Trifonov
e1b20e4314
Merge pull request #45503 from ClickHouse/serxa-patch-3
Provide more clear syntax for `fromUnixTimestamp64*` and `toUnixTimestamp64*` functions
2023-01-23 16:28:32 +01:00
Denny Crane
531ad1661e
Update column.md 2023-01-23 09:57:42 -04:00
Denny Crane
4d9be1ef4f
Update column.md 2023-01-23 09:57:04 -04:00
Denny Crane
2bf59fd48c
Update column.md 2023-01-23 09:55:30 -04:00
Sergei Trifonov
e0fa5b9bac
Update type-conversion-functions.md 2023-01-23 12:26:24 +01:00
Robert Schulze
96c2f43a4c
Merge pull request #45495 from ClickHouse/fix-weird-formatting
Docs: Fix weird formatting
2023-01-22 17:07:22 +01:00
Robert Schulze
a3153174db
Docs: Fix link to writing guide 2023-01-22 16:57:58 +01:00
Robert Schulze
ed84021aa5
Formatting fixup 2023-01-22 16:45:26 +01:00
Robert Schulze
0ffffdd442
Docs: Fix weird formatting 2023-01-22 15:38:11 +00:00
Robert Schulze
340f406553
Merge branch 'master' into query-result-cache 2023-01-22 13:21:36 +01:00
Robert Schulze
97d1bed114
Merge branch 'master' into improve_week_day 2023-01-21 20:40:33 +01:00
Robert Schulze
e6167d6b36
Deprecate Gorilla compression of non-float columns
Reasons:

1. The original Gorilla paper proposed a compression schema for pairs of
   time stamps and double-precision FP values. ClickHouse's Gorilla
   codec only implements compression of the latter and it does not
   impose any data type restrictions.
   - Data types != Float* or (U)Int* (e.g. Decimal, Point etc.) are
     definitely not supposed to be used with Gorilla.
   - (U)Int* types are debatable. The paper only considers
     integers-stored-as-FP-values, a practical use case for which
     Gorilla works well. Standalone integers are not considered which
     makes them at least suspicious.

2. Achieve consistency with FPC, another specialized floating-point
   timeseries codec, which rejects non-float data.

3. On practical datasets, ZSTD is often "good enough" (**) so it should
   be okay to disincentive non-ZSTD codecs a little bit. If needed,
   Delta and DoubleDelta codecs are viable alternative for slowly
   changing (time-series-like) integer sequences.

Since on-prem and hosted users may still have Gorilla-compressed
non-float data, this combination is only deprecated for now. No warning
or error will be emitted. Users are encouraged to migrate
Gorilla-compressed non-float data to an alternative codec. It is planned
to treat Gorilla-compressed non-float columns as "suspicious" six months
after this commit (i.e. in v23.6). Even then, it will still be possible
to set "allow_suspicious_codecs = true" and read and write
Gorilla-compressed non-float data.

(*) Sec. 4.1.2, "Gorilla restricts the value element in its tuple to a
    double floating point type.", https://doi.org/10.14778/2824032.2824078

(**) https://clickhouse.com/blog/optimize-clickhouse-codecs-compression-schema
2023-01-20 17:31:16 +00:00
Han Fei
4bbe90f6b4
Merge pull request #45473 from hanfei1991/hanfei/async-inserts-doc
update docs for async insert deduplication
2023-01-20 18:25:19 +01:00
Han Fei
18a397f8c9 address comments 2023-01-20 18:09:42 +01:00
Han Fei
449ace3373
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:07:19 +01:00
Han Fei
9d87bd10ee
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:07:08 +01:00
Han Fei
badfbcb3d8
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:06:58 +01:00