thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-13 09:52:38 +00:00
Code Issues Packages Projects Releases Wiki Activity
109,054 Commits 9,324 Branches 1,783 Tags 2.1 GiB
00dfb27eb9
Commit Graph

9205 Commits

Author SHA1 Message Date
ivan-klass
8a6c4bec13
More intuitive maxMap example 
Different types used to easier distinguish maxMap keys vs values
 2023-01-27 23:41:55 +01:00
Kruglov Pavel
96700abbe1
Merge pull request #45678 from azat/formats/json-parse-tupels 
Add ability to ignore unknown keys in JSON object for named tuples
 2023-01-27 21:11:05 +01:00
Kseniia Sumarokova
7d178e5ee6
Merge pull request #45680 from DanRoscigno/docs-mergetree-s3-cache 
doc updates related to s3 cache change
 2023-01-27 17:54:31 +01:00
DanRoscigno
a88c222f44 add missing heading 2023-01-27 08:56:25 -05:00
DanRoscigno
80b3b882c3 review from ksenii 2023-01-27 08:48:29 -05:00
Robert Schulze
4abd395153
Docs: Fix typo 2023-01-27 13:39:50 +00:00
Robert Schulze
5edf321927
Some docs fixes 2023-01-27 13:00:54 +01:00
Salvatore Mesoraca
464ecf50ef
doc: functions: hash: add sipHash{64,128}Keyed 2023-01-27 13:00:54 +01:00
Salvatore Mesoraca
dfd6dfc155
doc: functions: siphash: fix broken links 2023-01-27 13:00:53 +01:00
Salvatore Mesoraca
15b1f3f6a1
doc: functions: siphash: use correct value in example 2023-01-27 13:00:53 +01:00
Robert Schulze
e30c38cab3
Fix up some leftovers 2023-01-27 10:43:43 +00:00
Azat Khuzhin
1a8437f2c9 Add ability to ignore unknown keys in JSON object for named tuples 
This can be useful in case your input JSON is complex, while you need
only few fields in it.

This behaviour is controlled by the
input_format_json_ignore_unknown_keys_in_named_tuple setting name, that
is turned OFF by default.

This will, almost, allow to parse gharchive dataset without jq. "almost"
because of two things:
- Tuple cannot be Nullable, so such keys with Tuple type in ClickHouse
  cannot be `null` in JSON
- You cannot use dot.dot notation to extract columns for file() engine,
  only tupleElement()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-27 10:01:08 +01:00
Jus
9ce4bf1baf
Update named-collections.md 
small fix name host on the remote host
 2023-01-27 12:42:53 +04:00
Alexey Milovidov
5b257ab806
Merge pull request #45233 from ClickHouse/improve_week_day 
Revert "Revert "Improve week day""
 2023-01-27 02:44:17 +03:00
DanRoscigno
15b4c712df updates related to s3 cache change 2023-01-26 16:32:39 -05:00
Robert Schulze
7d97fab2dc
Untangle query result cache settings 
This PR modularizes the configuration options of the query result cache
(QRC).

1. Add a feature toggle "allow_experimental_query_result_cache = false"
   which controls whether the experimental QRC can be used at all. This
   configuration option will be removed once the QRC becomes
   non-experimental.

2. Modularize the existing two configuration settings
   "enable_experimental_query_result_cache" and
   "enable_experimental_query_result_cache_passive_usage" into three
   orthogonal settings:

   - "use_query_result_cache = false" controls whether a query (or all
     queries of the session) utilize the query result cache

   - settings "use_query_result_cache_passive_usage = true" and
     "use_query_result_cache_active_usage = true" control the way a
     query (or all queries of the session) utilize the query result
     cache: "passive" use is reading, "active" use is writing.
 2023-01-26 21:17:48 +00:00
Dan Roscigno
76d6e2edf9
Merge pull request #45569 from AVMusorin/docs_optimize_skip_merged_partitions 
docs: added optimize_skip_merged_partitions setting
 2023-01-26 16:04:27 -05:00
Dan Roscigno
f8bd83a94f
Merge pull request #45595 from den-crane/patch-59 
Doc. Update range_hashed description
 2023-01-26 16:01:52 -05:00
Dan Roscigno
d1a81b2776
Update docs/en/engines/table-engines/mergetree-family/invertedindexes.md 2023-01-26 14:07:13 -05:00
Dan Roscigno
00b5354a93
Update invertedindexes.md 2023-01-26 14:05:26 -05:00
Dan Roscigno
f71b68bc46
Merge pull request #45651 from mrcrypster/patch-5 
Added markdown format docs
 2023-01-26 11:42:22 -05:00
Diego Nieto
836e14e52b
Update skipping-index.md 
Deleted the confusing comment and added implemented as a mutation, like MATERIALIZE INDEX.
 2023-01-26 17:23:39 +01:00
Dan Roscigno
777ddf80ab
Update docs/en/interfaces/formats.md 2023-01-26 11:18:18 -05:00
Diego Nieto
ec378fc4d6
Merge branch 'ClickHouse:master' into patch-1 2023-01-26 17:17:35 +01:00
Dan Roscigno
8549af4853
Update docs/en/engines/table-engines/mergetree-family/invertedindexes.md 2023-01-26 10:51:08 -05:00
DanRoscigno
710384e69a remove sidebar position 2023-01-26 10:13:06 -05:00
DanRoscigno
88076b6db0 add keywords 2023-01-26 10:06:06 -05:00
abidino
cba266c965
Update sum.md 2023-01-26 17:33:30 +03:00
DanRoscigno
c130050572 capitalize sidebar 2023-01-26 09:05:56 -05:00
Dan Roscigno
03c80d2794
Merge branch 'master' into docs-inverted-index-edits 2023-01-26 09:03:50 -05:00
DanRoscigno
310797d9f0 edits, add frontmatter 2023-01-26 08:58:10 -05:00
Dan Roscigno
efe94b727c
Merge pull request #45574 from FArthur-cmd/laion_doc 
Add documentation for laion dataset
 2023-01-26 08:43:28 -05:00
FArthur-cmd
71f7274f1f small fixes 2023-01-26 15:24:41 +03:00
Igor Nikonov
ed01f76c6a
Merge pull request #45592 from ClickHouse/update-insert-delay-doc-2 
Update INSERT delay doc with example
 2023-01-26 12:55:35 +01:00
Denys Golotiuk
0eadb7112d
Added markdown format docs 2023-01-26 13:33:14 +02:00
Arthur Passos
433eda70fd add reverseDNSQuery docs 2023-01-26 07:57:43 -03:00
Dan Roscigno
b4ab361366
Merge branch 'master' into docs_optimize_skip_merged_partitions 2023-01-25 19:45:32 -05:00
Dan Roscigno
55c9b03c47
Update docs/en/sql-reference/statements/optimize.md 2023-01-25 19:45:25 -05:00
sichenzhao
243ac52259
Added two metrics about memory usage in cgroup to asynchronous metrics (#45301) 2023-01-25 20:32:17 +01:00
rfraposa
a1de808d11 Update mongodb.md 2023-01-25 11:44:13 -07:00
rfraposa
8d44f2aec1 Create mongodb.md 2023-01-25 11:31:07 -07:00
DanRoscigno
fe1d99a2d3 add PARTITION BY to file and url docs 2023-01-25 09:18:55 -05:00
DanRoscigno
917e3d4244 add PARTITION BY to s3 and hdfs docs 2023-01-25 09:09:28 -05:00
FArthur-cmd
304d1cc53e fix path in docs 2023-01-25 14:39:41 +03:00
Robert Schulze
d1eb9264ed
Merge remote-tracking branch 'origin/master' into docs-explain-plan 2023-01-25 11:05:46 +00:00
Robert Schulze
da7a657f1f
Docs: fix docs of EXPLAIN PLAN indexes=1 2023-01-25 11:02:50 +00:00
Robert Schulze
0148ad0e0e
Merge pull request #45598 from ClickHouse/typo-fix 
Typo: "Granulesis" --> "Granules"
 2023-01-25 11:52:11 +01:00
Robert Schulze
fd45295ff4
Typo: "Granulesis" --> "Granules" 2023-01-25 10:49:30 +00:00
Denny Crane
fda47bf4f8
Update external-dicts-dict-layout.md 2023-01-24 21:31:43 -04:00
Dan Roscigno
1cc3708092
Merge branch 'master' into update-settings-url 2023-01-24 19:51:39 -05:00
DanRoscigno
77ae27f26c update for split of format settings 2023-01-24 19:37:55 -05:00
Dan Roscigno
e520bd8052
Apply suggestions from code review 2023-01-24 19:10:30 -05:00
Igor Nikonov
29ef6b9574
Update INSERT delay doc properly 2023-01-25 00:26:32 +01:00
Dan Roscigno
dbb83dc9a4
Merge branch 'master' into docs-for-s3-settings 2023-01-24 17:55:31 -05:00
DanRoscigno
fe56967af7 fix note formatting 2023-01-24 17:44:10 -05:00
DanRoscigno
9775987ee9 add new settings for s3 and hdfs 2023-01-24 17:40:37 -05:00
DanRoscigno
f95bc55923 split Format settings out 2023-01-24 17:19:50 -05:00
rfraposa
6f7755ebcd Added optimize using constraints settings 2023-01-24 15:05:34 -07:00
Robert Schulze
d6ab376b02
Merge pull request #45586 from ClickHouse/document-datediff-week-start 
Document start of week in function date_diff()
 2023-01-24 21:38:00 +01:00
Robert Schulze
87ca5dcdf2
Document start of week in function date_diff() 2023-01-24 20:18:59 +00:00
Robert Schulze
5edea1b461
Docs: mini semicolon fix 2023-01-24 19:25:37 +00:00
robot-ch-test-poll1
0dab6f0208
Merge pull request #45573 from ClickHouse/update-docs-for-insert-delay 
Update formula for INSERT delay
 2023-01-24 17:07:46 +01:00
Igor Nikonov
e585a1228f
Update docs/en/operations/settings/merge-tree-settings.md 
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-01-24 16:52:32 +01:00
Kruglov Pavel
23c12ac8ee
Merge branch 'master' into parquet-fixed-binary 2023-01-24 16:51:05 +01:00
Denys Golotiuk
c1de756d8a
DELETE + WHERE in TTL 
ClickHouse actually supports only `DELETE` action with `WHERE` clause of a `TTL` statement
 2023-01-24 17:50:29 +02:00
FArthur-cmd
b1107eaff4 small improvement 2023-01-24 17:58:31 +03:00
FArthur-cmd
a7def60de8 resolve conflicts 2023-01-24 17:52:20 +03:00
FArthur-cmd
a8ed15650f add laion documentation 2023-01-24 17:47:04 +03:00
Igor Nikonov
21b009fdec
Update merge-tree-settings.md 2023-01-24 15:45:21 +01:00
Kseniia Sumarokova
dd18dd2953
Merge pull request #45341 from ClibMouse/feature/non-throwing-hastoken 
Introduce non-throwing variants of hasToken
 2023-01-24 15:37:36 +01:00
Kruglov Pavel
4bd3f0e5ef
Merge pull request #44953 from Avogar/tsv-csv-detect-header 
Detect header in CSV/TSV/CustomSeparated files automatically
 2023-01-24 15:13:52 +01:00
AVMusorin
5f8658b2d6
docs: added optimize_skip_merged_partitions setting 2023-01-24 14:56:39 +01:00
DanRoscigno
72b1a65984 WIP 2023-01-24 07:45:59 -05:00
Robert Schulze
574cab5d7e
Remove transitory parameter 2023-01-24 11:05:29 +00:00
Kseniia Sumarokova
ac1e7264fd
Merge pull request #45528 from ClickHouse/add-distinct-to-intersect 
Add DISTINCT to INTERSECT and EXCEPT docs
 2023-01-24 11:14:32 +01:00
Robert Schulze
aaf7653108
Merge remote-tracking branch 'origin/master' into block-non-float-gorilla-v2 2023-01-24 10:14:10 +00:00
rfraposa
33770303a0 Add DISTINCT to INTERSECT and EXCEPT 2023-01-23 17:10:30 -07:00
Rich Raposa
429e93965c
Update formats.md 
Google has a new website for Protocol Buffers. The old link expires on Jan 31, 2023
 2023-01-23 15:42:35 -07:00
ltrk2
9710b8643c Refine the solution 2023-01-23 14:27:48 -08:00
DanRoscigno
dedb4e4de2 add docs for PR 33302 2023-01-23 16:14:39 -05:00
Kruglov Pavel
478a552a0a
Merge branch 'master' into tsv-csv-detect-header 2023-01-23 21:47:17 +01:00
Diego Nieto
c4266588c6
Merge branch 'master' into patch-1 2023-01-23 20:50:37 +01:00
Dan Roscigno
ee31da9e1e
Merge pull request #45366 from gingerwizard/cross-link-docs 
link docs to blogs
 2023-01-23 14:04:59 -05:00
Robert Schulze
0ab7ae6c17
Merge pull request #43797 from ClickHouse/query-result-cache 
Query result cache [experimental]
 2023-01-23 19:54:35 +01:00
Dale Mcdiarmid
227b772dd6 remove JSON 2023-01-23 16:51:11 +00:00
Sergei Trifonov
e1b20e4314
Merge pull request #45503 from ClickHouse/serxa-patch-3 
Provide more clear syntax for `fromUnixTimestamp64*` and `toUnixTimestamp64*` functions
 2023-01-23 16:28:32 +01:00
Kruglov Pavel
01ddf326ac
Merge branch 'master' into parquet-fixed-binary 2023-01-23 15:31:45 +01:00
Denny Crane
531ad1661e
Update column.md 2023-01-23 09:57:42 -04:00
Denny Crane
4d9be1ef4f
Update column.md 2023-01-23 09:57:04 -04:00
Denny Crane
2bf59fd48c
Update column.md 2023-01-23 09:55:30 -04:00
Sergei Trifonov
e0fa5b9bac
Update type-conversion-functions.md 2023-01-23 12:26:24 +01:00
Robert Schulze
ed84021aa5
Formatting fixup 2023-01-22 16:45:26 +01:00
Robert Schulze
0ffffdd442
Docs: Fix weird formatting 2023-01-22 15:38:11 +00:00
Robert Schulze
340f406553
Merge branch 'master' into query-result-cache 2023-01-22 13:21:36 +01:00
Robert Schulze
97d1bed114
Merge branch 'master' into improve_week_day 2023-01-21 20:40:33 +01:00
Robert Schulze
e6167d6b36
Deprecate Gorilla compression of non-float columns 
Reasons:

1. The original Gorilla paper proposed a compression schema for pairs of
   time stamps and double-precision FP values. ClickHouse's Gorilla
   codec only implements compression of the latter and it does not
   impose any data type restrictions.
   - Data types != Float* or (U)Int* (e.g. Decimal, Point etc.) are
     definitely not supposed to be used with Gorilla.
   - (U)Int* types are debatable. The paper only considers
     integers-stored-as-FP-values, a practical use case for which
     Gorilla works well. Standalone integers are not considered which
     makes them at least suspicious.

2. Achieve consistency with FPC, another specialized floating-point
   timeseries codec, which rejects non-float data.

3. On practical datasets, ZSTD is often "good enough" (**) so it should
   be okay to disincentive non-ZSTD codecs a little bit. If needed,
   Delta and DoubleDelta codecs are viable alternative for slowly
   changing (time-series-like) integer sequences.

Since on-prem and hosted users may still have Gorilla-compressed
non-float data, this combination is only deprecated for now. No warning
or error will be emitted. Users are encouraged to migrate
Gorilla-compressed non-float data to an alternative codec. It is planned
to treat Gorilla-compressed non-float columns as "suspicious" six months
after this commit (i.e. in v23.6). Even then, it will still be possible
to set "allow_suspicious_codecs = true" and read and write
Gorilla-compressed non-float data.

(*) Sec. 4.1.2, "Gorilla restricts the value element in its tuple to a
    double floating point type.", https://doi.org/10.14778/2824032.2824078

(**) https://clickhouse.com/blog/optimize-clickhouse-codecs-compression-schema
 2023-01-20 17:31:16 +00:00
Han Fei
4bbe90f6b4
Merge pull request #45473 from hanfei1991/hanfei/async-inserts-doc 
update docs for async insert deduplication
 2023-01-20 18:25:19 +01:00
Han Fei
18a397f8c9 address comments 2023-01-20 18:09:42 +01:00
Han Fei
449ace3373
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:07:19 +01:00
Han Fei
9d87bd10ee
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:07:08 +01:00
Han Fei
badfbcb3d8
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:58 +01:00
Han Fei
e9c4cf46cd
Update docs/en/operations/settings/merge-tree-settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:46 +01:00
Han Fei
9d254f7d87
Update docs/en/operations/settings/merge-tree-settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:32 +01:00
robot-ch-test-poll4
2066581d8f
Merge pull request #45451 from evillique/default_granularity 
Add default GRANULARITY argument for secondary indexes
 2023-01-20 17:46:21 +01:00
Nikolay Degterinsky
02142596fb Add docs 2023-01-20 15:22:13 +00:00
Kruglov Pavel
28ddcc2432
Merge branch 'master' into tsv-csv-detect-header 2023-01-20 15:08:38 +01:00
Han Fei
5fc4998f10 update docs for async insert deduplication 2023-01-20 14:42:11 +01:00
Robert Schulze
4ac17d71fa
Merge pull request #45470 from ClickHouse/rs-doc-typos 
Fix typos
 2023-01-20 14:39:27 +01:00
Robert Schulze
3f2e4c8217
Fix typos 2023-01-20 13:20:25 +00:00
Robert Schulze
687f9c35a7
Merge pull request #45469 from ClickHouse/inv-idx-docs 
Docs for inverted index
 2023-01-20 14:17:58 +01:00
Robert Schulze
7e6d3163b1
Initial inverted index docs 2023-01-20 12:12:20 +00:00
Diego Nieto
a2b342bcbe
Update skipping-index.md 
ADD and DROP are not such lightweight command they generate mutations to deal with the changes and they will take time to complete depending on how much data the table has.
 2023-01-20 12:32:50 +01:00
Maksim Kita
758c8f2776
Merge branch 'master' into dict/remove-preallocate 2023-01-20 13:15:37 +03:00
Antonio Andelic
0ad37ad286
Merge pull request #45320 from stigsb/system_tables_volume_config 
Add <storage_policy> config parameter for system logs
 2023-01-20 10:27:57 +01:00
Robert Schulze
099f50c0e3
Remove redundancy 2023-01-19 18:35:19 +00:00
Robert Schulze
d8144ffafc
Merge branch 'master' into index-docs 2023-01-19 18:05:27 +01:00
Robert Schulze
c9988f4411
Mini fix 2023-01-19 17:04:17 +00:00
Robert Schulze
7355e3bc77
Docs: Beautify section on secondary index types 2023-01-19 17:00:31 +00:00
robot-clickhouse-ci-1
13d4d40568
Merge pull request #45325 from ClickHouse/download-builds 
Improve manual to get binaries from CI
 2023-01-19 17:49:52 +01:00
Robert Schulze
bfcb5e7915
Fix typos 2023-01-19 16:08:21 +00:00
Kruglov Pavel
9820beae68
Apply suggestions from code review 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2023-01-19 16:11:13 +01:00
Stig Bakken
420c179b55 Add <storage_policy> config parameter for system logs 2023-01-19 10:25:28 +01:00
DanRoscigno
5d88a2b344 clarify autodetect 2023-01-18 15:51:31 -05:00
Azat Khuzhin
4366f7fb3b Remove PREALLOCATE for HASHED/SPARSE_HASHED dictionaries 
It does not give significant benefit, but now, you hashed/sparse_hashed
dictionaries can be filled in parallel (#40003), using sharded
dictionaries, and this should be used instead of PREALLOCATE.

Note, that dictionaries, that had been created with PREALLOCATE will
work, but simply ignore this attribute.

Fixes: #41985 (cc @alexey-milovidov)
Reverts: #23979 (cc @kitaisreal)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-18 20:18:37 +01:00
DanRoscigno
cd3ecb9091 add support_batch_delete to mergetree docs 2023-01-18 12:16:31 -05:00
Maksim Kita
8225d2814c
Merge pull request #40003 from azat/dict-shards 
Add ability to load hashed dictionaries using multiple threads
 2023-01-18 13:37:10 +03:00
Robert Schulze
4f90824347
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-17 22:49:53 +00:00
Robert Schulze
fd7f5dad1c
Docs improvements 2023-01-17 22:03:48 +00:00
Sergei Trifonov
ca0fb785f4
Merge pull request #45193 from ClickHouse/concurrency-control-docs 
Add docs for concurrency control logic
 2023-01-17 21:10:17 +01:00
Dale Mcdiarmid
9c4d3e0ffb link docs to blogs 2023-01-17 15:38:10 +00:00
Kruglov Pavel
96bb99f864
Merge branch 'master' into tsv-csv-detect-header 2023-01-17 15:33:02 +01:00
avogar
5bf4704e7a Support FixedSizeBinary type in Parquet/Arrow 2023-01-16 21:01:31 +00:00
Vladimir C
b80ee8df50
Merge pull request #45256 from DanRoscigno/add-grace-hash-docs 2023-01-16 18:43:19 +01:00
Kruglov Pavel
e9d6590926
Merge branch 'master' into tsv-csv-detect-header 2023-01-16 17:50:24 +01:00
Kruglov Pavel
bdb3517512
Merge pull request #45231 from Avogar/json-tuples 
Insert default values in case of missing tuple elements in JSONEachRow
 2023-01-16 17:49:50 +01:00
avogar
1c0941d72a Add docs and examples 2023-01-16 16:46:41 +00:00
Mikhail f. Shiryaev
08c9d81c90
Apply suggestions from code review 
Co-authored-by: Igor Nikonov <954088+devcrafter@users.noreply.github.com>
 2023-01-16 16:55:24 +01:00
Mikhail f. Shiryaev
1bd7279d5f
Improve manual to get binaries from CI 2023-01-16 16:45:30 +01:00
Nikolay Degterinsky
70e79de69b
Merge pull request #38252 from bharatnc/ncb/weighted-quantile-approx 
add quantileInterpolatedWeighted function
 2023-01-16 13:41:13 +01:00
Sema Checherinda
d746a3c4ff
Merge pull request #44480 from wineternity/issue_43333_doc 
[DOC] Add support for signed arguments in range() #43333
 2023-01-16 10:26:49 +01:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-16 08:04:49 +00:00
Ilya Yatsishin
cf5052c77e
Merge pull request #45291 from den-crane/patch-57 2023-01-16 02:33:54 +01:00
Dan Roscigno
adca0b64d3
use markdown file instead of URL to enforce 404 checks 2023-01-15 19:31:58 -05:00
Peignon Melvyn
674a1d1877
Update json.md 2023-01-16 01:27:08 +01:00
Denny Crane
6cf603e05f
Update index.md 2023-01-15 18:40:59 -04:00
Dan Roscigno
f13fdfb431
Merge pull request #45280 from tbragin/patch-5 
Update postgresql.md
 2023-01-15 11:52:47 -05:00
Robert Schulze
27fe7ebd93
Cosmetics 2023-01-15 16:12:48 +00:00
Robert Schulze
bd41c74ddf
Various test, code and docs fixups 2023-01-15 13:47:34 +00:00
Alexey Milovidov
a5244f8d1d
Merge pull request #45279 from tbragin/patch-4 
Update postgresql.md
 2023-01-15 12:34:09 +03:00
Ilya Yatsishin
96987b7cd8
Merge pull request #45239 from Avogar/generate-random 2023-01-15 00:37:34 +01:00
Tanya Bragin
d825f50c84
Update postgresql.md 
Adding Postgres blog to Postgres DB engine page

cc @DanRoscigno @gingerwizard
 2023-01-14 14:39:41 -08:00
Tanya Bragin
b5773caeb2
Update postgresql.md 
Adding related Postgres blog here. 

cc @gingerwizard @DanRoscigno
 2023-01-14 14:34:33 -08:00
Tanya Bragin
36ec76f53d
Update clickhouse-local.md 
cc @DanRoscigno @gingerwizard Adding latest clickhouse-local blog to related content on this page.
 2023-01-14 07:50:10 -08:00
DanRoscigno
d0a55f6dc9 doc grace_hash algorithm for join 2023-01-13 13:17:03 -05:00
Rich Raposa
c7aad8e48b
Merge pull request #45207 from ClickHouse/add-maxintersections-to-docs 
Add maxIntersections to docs
 2023-01-13 10:27:59 -07:00
Robert Schulze
4ea836b87e
Revert "Revert "update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability"" 
This reverts commit e37f572c34.
 2023-01-13 14:00:16 +00:00
Azat Khuzhin
99063b152f Allow to configure queue backlog of the parallel hashed dictionary loader 
v2: Decrease default parallel_queue_backlog to 10000 (same speed)
v3: Rename parallel_queue_backlog to per_shard_load_backlog
v3: Rename per_shard_load_backlog to shard_load_queue_backlog
v4: Fix documentation
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-13 13:39:26 +01:00
Azat Khuzhin
345c422e28 Add ability to load hashed dictionaries using multiple threads 
Right now dictionaries (here I will talk about only
HASHED/SPARSE_HASHED/COMPLEX_KEY_HASHED/COMPLEX_KEY_SPARSE_HASHED)
can load data only in one thread, since it uses one hash table that
cannot be filled from multiple threads.

And in case you have very big dictionary (i.e. 10e9 elements), it can
take a awhile to load them, especially for SPARSE_HASHED variants (and
if you have such amount of elements there, you are likely use
SPARSE_HASHED, since it requires less memory), in my env it takes ~4
hours, which is enormous amount of time.

So this patch add support of shards for dictionaries, number of shards
determine how much hash tables will use this dictionary, also, and which
is more important, how much threads it can use to load the data.

And with 16 threads this works 2x faster, not perfect though, see the
follow up patches in this series.

v0: PARTITION BY
v1: SHARDS 1
v2: SHARDS(1)
v3: tried optimized mod - logical and, but it does not gain even 10%
v4: tried squashing more (max_block_size * shards), but it does not gain even 10% either
v5: move SHARDS into layout parameters (unknown simply ignored)
v6: tune params for perf tests (to avoid too long queries)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-13 13:39:25 +01:00
Robert Schulze
15e11741cb
Cosmetics 2023-01-13 00:00:23 +00:00
avogar
82ff1fd343 Add tests and docs 2023-01-12 22:29:23 +00:00
Robert Schulze
475bb31f33
Make server configuratio hierarchical 2023-01-12 21:24:40 +00:00
Yakov Olkhovskiy
842a34666c
Merge pull request #44594 from arenadata/ADQM-634 
Add keytab parameter in kerberos section of config.xml
 2023-01-12 15:07:45 -05:00
avogar
87b934c472 Insert default values in case of missing tuple elements in JSONEachRow 2023-01-12 16:36:44 +00:00
DanRoscigno
69cdb838c5 temporarily replace mermaid with PNG 2023-01-12 11:03:40 -05:00
Dan Roscigno
8c94ed9597
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 2023-01-12 11:01:03 -05:00
Rich Raposa
759a4c0940
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-12 08:53:22 -07:00
rfraposa
69a11574d2 Update maxintersections.md 2023-01-12 08:30:54 -07:00
Kseniia Sumarokova
db3e0219fc
Merge pull request #41687 from ClickHouse/40907_Parameterized_views_as_table_functions 
40907 Parameterized views as table functions
 2023-01-12 14:24:32 +01:00
Alexander Tokmakov
e37f572c34
Revert "update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability" 2023-01-12 15:01:36 +03:00
Sergei Trifonov
8c40c4d79f
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:25:03 +01:00
Sergei Trifonov
e784f65ee9
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:23:58 +01:00
Sergei Trifonov
78a63e795c
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:23:15 +01:00
Sergei Trifonov
d41dbdc4a6
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:22:59 +01:00
Dan Roscigno
7a651d749c
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 2023-01-11 19:20:37 -05:00
rfraposa
2e44ad9d0f Add maxIntersections to docs 2023-01-11 17:10:51 -07:00
Ilya Yatsishin
3a98f2bc12
Merge pull request #45190 from ClickHouse/add-query-params-to-docs 
Add query parameters to the docs
 2023-01-11 23:47:50 +01:00
Sergei Trifonov
1b94c839d5
Add docs for SYSTEM RELOAD USERS 2023-01-11 21:16:22 +01:00
serxa
b6e14f60d4 fix 2023-01-11 19:34:31 +00:00
serxa
2dae6a1ffe add docs for concurrency control logic 2023-01-11 19:19:51 +00:00
Rich Raposa
f8ac49bb86
Update syntax.md 2023-01-11 12:09:23 -07:00
Rich Raposa
a389180f42
Update syntax.md 2023-01-11 12:05:35 -07:00
rfraposa
8b9d99e2e2 Update syntax.md 2023-01-11 11:51:53 -07:00
Sergei Trifonov
ec9f10e934
Merge pull request #45174 from ClickHouse/make-queries-copyable-from-docs 
make more SQL queries copyable from docs in one click
 2023-01-11 16:59:52 +01:00
DanRoscigno
7168c217b0 switch text to response for query blocks 2023-01-11 10:08:11 -05:00
Dan Roscigno
bb3c4641a7
Merge pull request #45167 from ClickHouse/add-sparse-serialization-to-docs 
Add explanation of ratio_of_defaults_for_sparse_serialization setting to docs
 2023-01-11 08:57:10 -05:00
Sergei Trifonov
8b724c6d58
Merge pull request #45169 from ClickHouse/moves-table-docs 
Add docs for `system.moves` table
 2023-01-11 14:48:19 +01:00
serxa
8d099a4417 make more SQL queries copyable from docs in one click 2023-01-11 13:43:51 +00:00
DanRoscigno
4767147745 format query response 2023-01-11 08:23:44 -05:00
Dan Roscigno
0ad969171e
Merge pull request #45127 from DanRoscigno/add-deltalake-docs 
Add deltalake docs
 2023-01-11 08:07:42 -05:00
serxa
a79f6d19fa add docs for system.moves table 2023-01-11 13:04:05 +00:00
Robert Schulze
9bb1e31369
Merge pull request #44860 from bigo-sg/improve_week_day 
update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability
 2023-01-11 13:58:45 +01:00
Dan Roscigno
6e9669cfae
Apply suggestions from code review 2023-01-11 07:53:37 -05:00
Robert Schulze
12a29fec35
Hide secrets from system.query_result_cache 2023-01-11 12:50:45 +00:00
rfraposa
1ddc9c3bb6 Update merge-tree-settings.md 2023-01-11 05:44:51 -07:00
Dan Roscigno
02261b0e2a
Update docs/en/engines/table-engines/integrations/hudi.md 2023-01-11 07:42:15 -05:00
Dan Roscigno
d4c4f84161
Update docs/en/sql-reference/table-functions/hudi.md 2023-01-11 07:41:36 -05:00
Dan Roscigno
367d4fc4bf
Update docs/en/sql-reference/table-functions/hudi.md 2023-01-11 07:40:52 -05:00
Dan Roscigno
73ef2657dd
Update docs/en/engines/table-engines/integrations/hudi.md 2023-01-11 07:40:10 -05:00
Dan Roscigno
21573028ea
Update docs/en/engines/table-engines/integrations/deltalake.md 2023-01-11 07:38:41 -05:00
Bharat Nallan Chakravarthy
e18a95719d review fix 2023-01-10 21:16:16 -08:00
DanRoscigno
563e0e76f9 init 2023-01-10 16:59:34 -05:00
DanRoscigno
75c04945bd spelling 2023-01-10 16:18:50 -05:00
DanRoscigno
5cf1b1f61d feedback 2023-01-10 16:09:59 -05:00
rfraposa
57ab2a4110 Update nlp-functions.md 
Added the detectLanguage functions
 2023-01-10 12:26:51 -07:00
DanRoscigno
879ee05218 fix case of names 2023-01-10 11:18:33 -05:00
DanRoscigno
ee86afb125 add deltalake 2023-01-10 11:14:12 -05:00
Rich Raposa
f28b04fc59
Merge pull request #45124 from ClickHouse/rfraposa-patch-2 
Update theilsu.md
 2023-01-10 09:04:22 -07:00
Han Fei
91226abbfe
Merge pull request #43858 from hanfei1991/regexp-tree-dictionary 
Merge #40878: Add regexp tree dictionary
 2023-01-10 16:41:15 +01:00
Rich Raposa
df3cca6c35
Update theilsu.md 
Typo
 2023-01-10 08:40:48 -07:00
Ilya Yatsishin
4b3a9862cc
Merge pull request #45091 from ClickHouse/add-cramersv-agg-functions 
Add missing agg functions to docs
 2023-01-10 16:35:04 +01:00
Dan Roscigno
37da8e206b
Merge pull request #45119 from ClickHouse/add-default-table-engine-setting 
Added description of default_table_engine setting
 2023-01-10 09:59:09 -05:00
Dan Roscigno
707ff65b4f
Update docs/en/sql-reference/aggregate-functions/reference/contingency.md 2023-01-10 09:55:59 -05:00
Dan Roscigno
ee88814cac
formal to form 2023-01-10 09:42:04 -05:00
rfraposa
d61eae8554 Update settings.md 
Added description of default_table_engine
 2023-01-10 07:40:22 -07:00
Han Fei
6ed4570f73
Merge branch 'master' into regexp-tree-dictionary 2023-01-10 15:36:30 +01:00
Rich Raposa
b76d0d60db
Merge pull request #45089 from ClickHouse/add-cnf-docs 
Add convert_query_to_cnf to docs
 2023-01-10 07:11:57 -07:00
Han Fei
5f8296b719
Update docs/en/sql-reference/dictionaries/external-dictionaries/regexp-tree.md 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2023-01-10 14:41:06 +01:00
Robert Schulze
cbc18318ff
Merge pull request #45114 from ClickHouse/less-awkward-comment-about-debugging 
Docs: Rewrite awkwardly phrased sentence about flush interval
 2023-01-10 14:15:43 +01:00
Robert Schulze
6497ddd882
Docs: Rewrite awkwardly phrased sentence about flush interval 2023-01-10 13:13:35 +00:00
Robert Schulze
8dc3cbc822
Merge pull request #45109 from ClickHouse/consistent-schema-interference-cache-heading 
Docs: Make heading consistent with other headings in System Table docs
 2023-01-10 14:02:49 +01:00
Robert Schulze
96a722793c
Docs: Make heading consistent with other headings in System Table docs 2023-01-10 12:49:49 +00:00
Robert Schulze
923fa2c15a
Fix review comments, pt. II 2023-01-10 10:21:08 +00:00
Robert Schulze
0c3b034887
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-10 09:02:41 +00:00
rfraposa
c3dcbb2671 Add cramersV function 
And 3 similar functions t
 2023-01-09 23:42:39 -07:00
rfraposa
62b9e2f063 Update settings.md 
Add convert_query_to_cnf setting
 2023-01-09 21:30:24 -07:00
Rich Raposa
528acecc5c
Merge pull request #45076 from ClickHouse/new-mergetree-settings 
Add docs for 2 new MergeTree settings
 2023-01-09 16:48:26 -07:00
Dan Roscigno
99b1609fd3
Update docs/en/operations/settings/index.md 2023-01-09 18:17:29 -05:00
rfraposa
db7342769b Update merge-tree-settings.md 
Added two new settings
 2023-01-09 15:56:19 -07:00
rfraposa
eb96884ebf Add new DEFAULT value of settings 2023-01-09 15:02:35 -07:00
Robert Schulze
ad4884b394
Fix review comments, pt. I 2023-01-09 21:42:51 +00:00
Dan Roscigno
f8a5d5cb18
Merge branch 'ClickHouse:master' into add-deltalake-docs 2023-01-09 15:45:08 -05:00
Dan Roscigno
bfcb6eb0cf
Merge pull request #44995 from ClickHouse/qoega-patch-5 
Add documentation for xxh3
 2023-01-09 15:00:27 -05:00
DanRoscigno
438f34100d fix codeblock end 2023-01-09 14:42:24 -05:00
Dan Roscigno
f791d5439c
Merge pull request #45063 from ClickHouse/remove-original-article 
[docs] Remove "Original article" links
 2023-01-09 11:32:22 -05:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
Ivan Blinkov
b7e082d033 Remove "Original article links" 2023-01-09 15:13:36 +01:00
taiyang-li
20c7c0b1ef change as request 2023-01-09 18:21:31 +08:00
Roman Vasin
2995c6d866 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-634 2023-01-09 08:26:45 +00:00
Alexey Milovidov
03ae644ea3 Fix performance test 2023-01-09 01:58:42 +01:00
Dan Roscigno
dced847e9b
Merge branch 'master' into qoega-patch-5 2023-01-07 19:36:23 -05:00
DanRoscigno
8d002e6d43 full path to links 2023-01-07 19:19:49 -05:00
Alexey Milovidov
17552fdae2
Merge pull request #45021 from ClickHouse/no-testflows 
Remove the remainings of Testflows (2).
 2023-01-08 02:17:34 +03:00
Dan Roscigno
7741ce549f
Merge pull request #45004 from DanRoscigno/docs-for-set-join-persist 
move persistence setting docs
 2023-01-07 17:28:40 -05:00
Dan Roscigno
758c98e832
Merge pull request #45005 from DanRoscigno/date-subtraction-docs 
clarify date sub docs
 2023-01-07 17:28:08 -05:00
Alexey Milovidov
484af24d48 Remove the remainings of Testflows (2). 2023-01-07 21:40:13 +01:00
Alexey Milovidov
063bfb9be2
Merge pull request #45002 from den-crane/patch-56 
Update graphitemergetree.md
 2023-01-07 23:26:02 +03:00
Anton Popov
1f32ffedf8
Merge pull request #43221 from ClickHouse/refactoring-ip-types 
Replace domain IP types (IPv4, IPv6) with native
 2023-01-07 12:01:21 +01:00
DanRoscigno
eff349bab7 clarify date sub docs 2023-01-06 17:32:03 -05:00
DanRoscigno
e0b258b4a9 move persistence setting docs 2023-01-06 17:01:28 -05:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-06 20:42:48 +00:00
Denny Crane
1bf6139fab
Update graphitemergetree.md 2023-01-06 15:11:58 -04:00
Ilya Yatsishin
b6b9be7a3e
Add documentation for xxh3 2023-01-06 18:05:27 +01:00
Ilya Yatsishin
71cb4ecde1
Add docs for #43308 2023-01-06 15:30:57 +01:00
Robert Schulze
35511685e3
Merge pull request #44977 from ClickHouse/match-docs 
Docs: Mention non-standard DOTALL behavior of ClickHouse's match()
 2023-01-06 13:22:28 +01:00
Robert Schulze
1cc5bce1c5
Docs: Mention non-standard DOTALL behavior of ClickHouse's match() 
Cf. #34603
 2023-01-06 11:18:22 +00:00
DanRoscigno
5cde7762ad WIP 2023-01-05 15:54:44 -05:00
Dan Roscigno
adfc4d4a23
Merge pull request #44945 from DanRoscigno/tolastday 
add toLastDayOfMonth to docs
 2023-01-05 11:53:40 -05:00
Dan Roscigno
9444dae34e
Merge pull request #44941 from DanRoscigno/add-settings 
add additional table filters setting
 2023-01-05 11:52:59 -05:00
Dan Roscigno
5ba6851629
Merge pull request #44943 from DanRoscigno/pmod-docs 
updater positiveModulo  docs
 2023-01-05 11:51:21 -05:00
Han Fei
f2a9eea995 write docs and optimize regex compile 2023-01-05 17:38:01 +01:00
DanRoscigno
9e5c8acd92 add toLastDayOfMonth to docs 2023-01-05 11:37:05 -05:00
DanRoscigno
4cba7fc958 add aliases for positiveModulo to docs 2023-01-05 11:10:20 -05:00
DanRoscigno
273ad90d1d add additional table filters setting 2023-01-05 10:47:18 -05:00
Robert Schulze
1974e1bf8c
Merge pull request #44479 from ClickHouse/more-robust-astselectquery-formatimpl 
More robust ASTSelectQuery::formatImpl()
 2023-01-05 12:27:40 +01:00
Robert Schulze
4fcead15c3
Fix handling of exceptions during query runtime 2023-01-04 22:33:04 +00:00
Alexey Milovidov
7589c29902
Merge pull request #44906 from DanRoscigno/add-touuid-docs 
add toUUIDOrDefault docs
 2023-01-05 00:01:14 +03:00
Dan Roscigno
20a35efc42
Merge pull request #44665 from burmecia/fix-ttl-doc 
fix table ttl doc example
 2023-01-04 15:53:19 -05:00
Dan Roscigno
288488f8a2
Merge pull request #44919 from DanRoscigno/revert-h3-doc-deletions 
revert doc removal
 2023-01-04 15:51:37 -05:00
Dan Roscigno
3c64cb26b0
Merge pull request #44913 from DanRoscigno/add-INFILE-docs 
add example with file globbing
 2023-01-04 15:51:12 -05:00
DanRoscigno
2397318b1a add more about matching 2023-01-04 15:37:13 -05:00
Dan Roscigno
47a84eb2df
Merge pull request #44650 from DanRoscigno/update-replication-docs 
add note for Cloud users
 2023-01-04 15:21:48 -05:00
DanRoscigno
51f1d3ba1e revert doc removal 2023-01-04 14:53:02 -05:00
DanRoscigno
df603911ea add example with file globbing 2023-01-04 11:36:38 -05:00
Yakov Olkhovskiy
7a5a36cbed
Merge branch 'master' into refactoring-ip-types 2023-01-04 11:11:06 -05:00
DanRoscigno
530f0b36e9 add toUUIDOrDefault docs 2023-01-04 09:46:36 -05:00
DanRoscigno
bece361a79 add command summary 2023-01-04 07:32:52 -05:00
Alexey Milovidov
3a027d285f
Merge pull request #44828 from ClickHouse/remove-two-lines-of-code 
What if I will remove two lines of code?
 2023-01-04 04:50:52 +03:00
Nikolay Degterinsky
c6daf0a6eb Merge remote-tracking branch 'upstream/master' into ulid 2023-01-03 19:58:50 +00:00
Robert Schulze
cfb6feffde
What happens if I remove these 139 lines of code? 2023-01-03 18:35:31 +00:00
Smita Kulkarni
1f89db78a5 Added is_create_parameterized_view flag in ActionsVisitor, added functions for column manipulation for parameterized view in StorageView, updated tests to fix flaky test issues and addressed small review comments- 40907 Parameterized views as table functions 2023-01-03 11:00:39 +01:00
Robert Schulze
421473e974
Merge pull request #44421 from ClickHouse/revert-of-revert-of-age-function 
Revert revert of age function
 2023-01-03 10:02:18 +01:00
Alexey Milovidov
ca117d5b94
Merge branch 'master' into remove-two-lines-of-code 2023-01-02 22:15:36 +03:00
Dmitry Novik
c646048af9
Merge pull request #44461 from ClickHouse/parts-removal-limit 
Add part removal limit for one CleanupThread iteration
 2023-01-02 20:04:19 +01:00
Alexey Milovidov
e855d3519a
Merge branch 'master' into refactoring-ip-types 2023-01-02 21:58:53 +03:00
Kruglov Pavel
966f57ef68
Merge pull request #42777 from Avogar/improve-streaming-engines 
Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and data formats
 2023-01-02 15:59:06 +01:00
Azat Khuzhin
b9125bb351
Introduce groupArrayLast() (useful to store last X values) (#44521) 
* Cleanup DataTypeCustomSimpleAggregateFunction::checkSupportedFunctions()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Remove unused GroupArrayGeneralListImpl

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Introduce groupArrayLast() (useful to store last X values)

Also do some refactoring to make code cleaner:
- rename insert() to insertWithSampler() (since it is used only for
  groupArraySample())
- split merge methods into Last/RNG/...

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-02 15:20:21 +01:00
Robert Schulze
545576fe01
Merge pull request #43818 from bigo-sg/improve_from_unixtime 
Add new functions to format datetime in joda datetime style
 2023-01-02 13:41:50 +01:00
Robert Schulze
9ab910102f
Add note + test about exception handling 2023-01-02 10:24:01 +00:00
Robert Schulze
8381d8b467
query_result_cache_keep_seconds_alive --> query_result_cache_ttl 2023-01-02 09:38:40 +00:00
Robert Schulze
ba55fd3ad2
Cosmetics 2023-01-02 09:30:44 +00:00
Robert Schulze
e9e04166d9
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-02 08:20:27 +00:00
Alexey Milovidov
47ae8c5c79 Remove more lines 2023-01-02 02:06:11 +01:00
Kruglov Pavel
027b525820
Slightly better docs 2022-12-31 15:06:45 +01:00
Kruglov Pavel
791e8a90cf
Fix 2022-12-30 23:15:45 +01:00
Kruglov Pavel
7e14ee6eef
Fix incorrect docs 2022-12-30 23:14:14 +01:00
Dan Roscigno
7c03222800
Merge pull request #44740 from ClickHouse/alexey-milovidov-patch-5 
Update type-conversion-functions.md
 2022-12-30 11:38:41 -05:00
Dan Roscigno
bc456feb4b
Merge pull request #44708 from Avogar/schema-inference-docs 
Add detailed documentation about schema inference
 2022-12-30 11:19:09 -05:00
DanRoscigno
ec5314ff84 full path for links, split sql from response 2022-12-30 11:17:43 -05:00
DanRoscigno
f6c94d8645 remove table of contents 2022-12-30 10:19:09 -05:00
DanRoscigno
0df0fe2cf0 edits 2022-12-30 09:55:03 -05:00