rfraposa
4ad5ff377b
Create executable.md
2023-02-05 19:05:39 -07:00
Antonio Andelic
12569da984
Merge branch 'master' into add-support-for-settings-alias
2023-02-05 16:08:57 +00:00
DanRoscigno
8464357bca
fix heading level
2023-02-03 13:57:47 -05:00
Antonio Andelic
a58653820e
Update docs
2023-02-03 18:19:12 +00:00
vdimir
6e0d5e4150
Update doc for sparkbar function
2023-02-03 17:23:10 +00:00
DanRoscigno
c9244335ef
move title to frontmatter
2023-02-03 09:21:30 -05:00
DanRoscigno
7889b632d6
add metadata
2023-02-03 09:16:33 -05:00
DanRoscigno
26a6c5a25b
combine guide and reference for lightweight deletes
2023-02-03 09:13:48 -05:00
Alexander Tokmakov
cce6d1989e
Update system.md
2023-02-02 22:01:00 +03:00
DanRoscigno
8242c936e0
add notes for GCS
2023-02-02 10:56:39 -05:00
Dan Roscigno
6301904a1c
Merge pull request #45862 from eiriksfa/patch-1
...
Update s2.md, typo in reference docs
2023-02-01 11:55:49 -05:00
rfraposa
e52edd4e85
Update external-dicts-dict-layout.md
2023-02-01 09:06:21 -07:00
Robert Schulze
b512316586
Merge pull request #45682 from ClickHouse/rename-qrc-to-qc
...
Rename "Query Result Cache" to "Query Cache"
2023-02-01 11:23:29 +01:00
Alexander Gololobov
e705f11ad1
Merge pull request #45786 from ClickHouse/delete_on_cluster
...
Support DELETE ON CLUSTER
2023-02-01 10:52:01 +01:00
robot-ch-test-poll2
202fa9fa37
Merge pull request #45859 from FArthur-cmd/show_engines_support
...
Add support for SHOW ENGINES query
2023-02-01 07:32:56 +01:00
FArthur-cmd
63e8eef9de
add documentation and test
2023-02-01 02:50:53 +03:00
Dan Roscigno
2f64ba187f
Update docs/en/sql-reference/statements/alter/ttl.md
2023-01-31 14:55:13 -05:00
rfraposa
8d0908cb0f
Update ttl.md
2023-01-31 11:43:09 -07:00
Eirik
ab1f1144c9
typo in s2.md reference docs
...
Small typo in s2CapUnion
2023-01-31 17:15:29 +01:00
Dan Roscigno
9ada816d5a
Update table.md
2023-01-31 10:59:08 -05:00
Robert Schulze
44a5e9cb17
Minor doc follow-up to #45382
2023-01-31 10:31:01 +00:00
Robert Schulze
fdd6c77480
Merge pull request #45382 from bigo-sg/improve_position
...
Add fastpath for function position when needle is empty
2023-01-31 11:22:31 +01:00
Robert Schulze
325c6bdf3d
Renaming: "Query Result Cache" --> "Query Cache"
...
Reasons:
- The cache will at some point store intermediate results as opposed to
only query results. We should change the terminology now without
having to worry about backward compat.
- Equivalent caches in MySQL (1) and Starrocks (2) are called "query
cache".
- The new name is ca. 13.8% more catchy.
(1) https://dev.mysql.com/doc/refman/5.6/en/query-cache.html
(2) https://docs.starrocks.io/en-us/2.5/using_starrocks/query_cache
2023-01-31 09:54:34 +00:00
taiyang-li
4cf11d9a84
change as request
2023-01-31 10:48:02 +08:00
Ilya Yatsishin
8d6df7ed58
Merge pull request #45785 from Algunenano/generate_random_types
2023-01-30 23:03:12 +01:00
Alexander Gololobov
65d39a616d
Added ON CLUSTER
2023-01-30 17:02:29 +01:00
Arthur Passos
7b1ceaa2c5
Merge branch 'master' into fix_cares_crash
2023-01-30 12:05:56 -03:00
Raúl Marín
997fad4e8d
GenerateRandom: Add support for maps
2023-01-30 15:23:22 +01:00
Dan Roscigno
86acb61849
Merge branch 'master' into patch-1
2023-01-30 06:18:23 -05:00
Derek Chia
692b7ab211
Update dictionary.md
...
Remove "statement:" from a query
2023-01-30 17:56:17 +08:00
taiyang-li
d25740da83
change as request
2023-01-30 16:13:12 +08:00
Robert Schulze
15ae2d1de5
Merge branch 'master' into aiven-sal/siphash_pr
2023-01-29 21:06:52 +01:00
Robert Schulze
6195456d5b
Fix formatting
2023-01-29 19:58:59 +00:00
Alexey Milovidov
5f4726eb2a
Merge pull request #45717 from Performica/topKWeighted-better-example
...
improve explanatory of topKWeighted example
2023-01-29 06:24:32 +03:00
Alexey Milovidov
0f7f490302
Merge pull request #45716 from Performica/maxMap-intuitive-example
...
More intuitive maxMap example
2023-01-29 06:23:54 +03:00
freedomDR
876a92d4d1
add doc about system sync file cache.
2023-01-28 04:27:10 +00:00
robot-ch-test-poll
cb803a887a
Merge pull request #45660 from abidino/patch-2
...
Update sum.md
2023-01-28 01:52:06 +01:00
Alexey Milovidov
bc2f454522
Merge branch 'master' into block-non-float-gorilla-v2
2023-01-28 03:30:12 +03:00
Alexey Milovidov
0ffc8f048b
Merge pull request #45464 from lesandie/patch-1
...
Update skipping-index.md
2023-01-28 03:27:44 +03:00
ivan-klass
b83e60b1d7
improve explanatory of topKWeighted example
2023-01-28 00:20:15 +01:00
ivan-klass
8a6c4bec13
More intuitive maxMap example
...
Different types used to easier distinguish maxMap keys vs values
2023-01-27 23:41:55 +01:00
Robert Schulze
4abd395153
Docs: Fix typo
2023-01-27 13:39:50 +00:00
Robert Schulze
5edf321927
Some docs fixes
2023-01-27 13:00:54 +01:00
Salvatore Mesoraca
464ecf50ef
doc: functions: hash: add sipHash{64,128}Keyed
2023-01-27 13:00:54 +01:00
Salvatore Mesoraca
dfd6dfc155
doc: functions: siphash: fix broken links
2023-01-27 13:00:53 +01:00
Salvatore Mesoraca
15b1f3f6a1
doc: functions: siphash: use correct value in example
2023-01-27 13:00:53 +01:00
Alexey Milovidov
5b257ab806
Merge pull request #45233 from ClickHouse/improve_week_day
...
Revert "Revert "Improve week day""
2023-01-27 02:44:17 +03:00
Dan Roscigno
76d6e2edf9
Merge pull request #45569 from AVMusorin/docs_optimize_skip_merged_partitions
...
docs: added optimize_skip_merged_partitions setting
2023-01-26 16:04:27 -05:00
Dan Roscigno
f8bd83a94f
Merge pull request #45595 from den-crane/patch-59
...
Doc. Update range_hashed description
2023-01-26 16:01:52 -05:00
Diego Nieto
836e14e52b
Update skipping-index.md
...
Deleted the confusing comment and added implemented as a mutation, like MATERIALIZE INDEX.
2023-01-26 17:23:39 +01:00
Diego Nieto
ec378fc4d6
Merge branch 'ClickHouse:master' into patch-1
2023-01-26 17:17:35 +01:00
abidino
cba266c965
Update sum.md
2023-01-26 17:33:30 +03:00
Arthur Passos
433eda70fd
add reverseDNSQuery docs
2023-01-26 07:57:43 -03:00
Dan Roscigno
b4ab361366
Merge branch 'master' into docs_optimize_skip_merged_partitions
2023-01-25 19:45:32 -05:00
Dan Roscigno
55c9b03c47
Update docs/en/sql-reference/statements/optimize.md
2023-01-25 19:45:25 -05:00
rfraposa
a1de808d11
Update mongodb.md
2023-01-25 11:44:13 -07:00
rfraposa
8d44f2aec1
Create mongodb.md
2023-01-25 11:31:07 -07:00
Robert Schulze
d1eb9264ed
Merge remote-tracking branch 'origin/master' into docs-explain-plan
2023-01-25 11:05:46 +00:00
Robert Schulze
da7a657f1f
Docs: fix docs of EXPLAIN PLAN indexes=1
2023-01-25 11:02:50 +00:00
Robert Schulze
0148ad0e0e
Merge pull request #45598 from ClickHouse/typo-fix
...
Typo: "Granulesis" --> "Granules"
2023-01-25 11:52:11 +01:00
Robert Schulze
fd45295ff4
Typo: "Granulesis" --> "Granules"
2023-01-25 10:49:30 +00:00
Denny Crane
fda47bf4f8
Update external-dicts-dict-layout.md
2023-01-24 21:31:43 -04:00
Dan Roscigno
1cc3708092
Merge branch 'master' into update-settings-url
2023-01-24 19:51:39 -05:00
DanRoscigno
77ae27f26c
update for split of format settings
2023-01-24 19:37:55 -05:00
Robert Schulze
87ca5dcdf2
Document start of week in function date_diff()
2023-01-24 20:18:59 +00:00
AVMusorin
5f8658b2d6
docs: added optimize_skip_merged_partitions setting
2023-01-24 14:56:39 +01:00
Robert Schulze
574cab5d7e
Remove transitory parameter
2023-01-24 11:05:29 +00:00
Robert Schulze
aaf7653108
Merge remote-tracking branch 'origin/master' into block-non-float-gorilla-v2
2023-01-24 10:14:10 +00:00
rfraposa
33770303a0
Add DISTINCT to INTERSECT and EXCEPT
2023-01-23 17:10:30 -07:00
Diego Nieto
c4266588c6
Merge branch 'master' into patch-1
2023-01-23 20:50:37 +01:00
Dan Roscigno
ee31da9e1e
Merge pull request #45366 from gingerwizard/cross-link-docs
...
link docs to blogs
2023-01-23 14:04:59 -05:00
Robert Schulze
0ab7ae6c17
Merge pull request #43797 from ClickHouse/query-result-cache
...
Query result cache [experimental]
2023-01-23 19:54:35 +01:00
Sergei Trifonov
e1b20e4314
Merge pull request #45503 from ClickHouse/serxa-patch-3
...
Provide more clear syntax for `fromUnixTimestamp64*` and `toUnixTimestamp64*` functions
2023-01-23 16:28:32 +01:00
Denny Crane
531ad1661e
Update column.md
2023-01-23 09:57:42 -04:00
Denny Crane
4d9be1ef4f
Update column.md
2023-01-23 09:57:04 -04:00
Denny Crane
2bf59fd48c
Update column.md
2023-01-23 09:55:30 -04:00
Sergei Trifonov
e0fa5b9bac
Update type-conversion-functions.md
2023-01-23 12:26:24 +01:00
Robert Schulze
340f406553
Merge branch 'master' into query-result-cache
2023-01-22 13:21:36 +01:00
Robert Schulze
97d1bed114
Merge branch 'master' into improve_week_day
2023-01-21 20:40:33 +01:00
Robert Schulze
e6167d6b36
Deprecate Gorilla compression of non-float columns
...
Reasons:
1. The original Gorilla paper proposed a compression schema for pairs of
time stamps and double-precision FP values. ClickHouse's Gorilla
codec only implements compression of the latter and it does not
impose any data type restrictions.
- Data types != Float* or (U)Int* (e.g. Decimal, Point etc.) are
definitely not supposed to be used with Gorilla.
- (U)Int* types are debatable. The paper only considers
integers-stored-as-FP-values, a practical use case for which
Gorilla works well. Standalone integers are not considered which
makes them at least suspicious.
2. Achieve consistency with FPC, another specialized floating-point
timeseries codec, which rejects non-float data.
3. On practical datasets, ZSTD is often "good enough" (**) so it should
be okay to disincentive non-ZSTD codecs a little bit. If needed,
Delta and DoubleDelta codecs are viable alternative for slowly
changing (time-series-like) integer sequences.
Since on-prem and hosted users may still have Gorilla-compressed
non-float data, this combination is only deprecated for now. No warning
or error will be emitted. Users are encouraged to migrate
Gorilla-compressed non-float data to an alternative codec. It is planned
to treat Gorilla-compressed non-float columns as "suspicious" six months
after this commit (i.e. in v23.6). Even then, it will still be possible
to set "allow_suspicious_codecs = true" and read and write
Gorilla-compressed non-float data.
(*) Sec. 4.1.2, "Gorilla restricts the value element in its tuple to a
double floating point type.", https://doi.org/10.14778/2824032.2824078
(**) https://clickhouse.com/blog/optimize-clickhouse-codecs-compression-schema
2023-01-20 17:31:16 +00:00
Robert Schulze
4ac17d71fa
Merge pull request #45470 from ClickHouse/rs-doc-typos
...
Fix typos
2023-01-20 14:39:27 +01:00
Robert Schulze
3f2e4c8217
Fix typos
2023-01-20 13:20:25 +00:00
Diego Nieto
a2b342bcbe
Update skipping-index.md
...
ADD and DROP are not such lightweight command they generate mutations to deal with the changes and they will take time to complete depending on how much data the table has.
2023-01-20 12:32:50 +01:00
Azat Khuzhin
4366f7fb3b
Remove PREALLOCATE for HASHED/SPARSE_HASHED dictionaries
...
It does not give significant benefit, but now, you hashed/sparse_hashed
dictionaries can be filled in parallel (#40003 ), using sharded
dictionaries, and this should be used instead of PREALLOCATE.
Note, that dictionaries, that had been created with PREALLOCATE will
work, but simply ignore this attribute.
Fixes : #41985 (cc @alexey-milovidov)
Reverts: #23979 (cc @kitaisreal)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-18 20:18:37 +01:00
Maksim Kita
8225d2814c
Merge pull request #40003 from azat/dict-shards
...
Add ability to load hashed dictionaries using multiple threads
2023-01-18 13:37:10 +03:00
Robert Schulze
4f90824347
Merge remote-tracking branch 'origin/master' into query-result-cache
2023-01-17 22:49:53 +00:00
Dale Mcdiarmid
9c4d3e0ffb
link docs to blogs
2023-01-17 15:38:10 +00:00
Nikolay Degterinsky
70e79de69b
Merge pull request #38252 from bharatnc/ncb/weighted-quantile-approx
...
add quantileInterpolatedWeighted function
2023-01-16 13:41:13 +01:00
Sema Checherinda
d746a3c4ff
Merge pull request #44480 from wineternity/issue_43333_doc
...
[DOC] Add support for signed arguments in range() #43333
2023-01-16 10:26:49 +01:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache
2023-01-16 08:04:49 +00:00
Ilya Yatsishin
cf5052c77e
Merge pull request #45291 from den-crane/patch-57
2023-01-16 02:33:54 +01:00
Dan Roscigno
adca0b64d3
use markdown file instead of URL to enforce 404 checks
2023-01-15 19:31:58 -05:00
Peignon Melvyn
674a1d1877
Update json.md
2023-01-16 01:27:08 +01:00
Denny Crane
6cf603e05f
Update index.md
2023-01-15 18:40:59 -04:00
Robert Schulze
bd41c74ddf
Various test, code and docs fixups
2023-01-15 13:47:34 +00:00
Ilya Yatsishin
96987b7cd8
Merge pull request #45239 from Avogar/generate-random
2023-01-15 00:37:34 +01:00
Rich Raposa
c7aad8e48b
Merge pull request #45207 from ClickHouse/add-maxintersections-to-docs
...
Add maxIntersections to docs
2023-01-13 10:27:59 -07:00
Robert Schulze
4ea836b87e
Revert "Revert "update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability""
...
This reverts commit e37f572c34
.
2023-01-13 14:00:16 +00:00
Azat Khuzhin
99063b152f
Allow to configure queue backlog of the parallel hashed dictionary loader
...
v2: Decrease default parallel_queue_backlog to 10000 (same speed)
v3: Rename parallel_queue_backlog to per_shard_load_backlog
v3: Rename per_shard_load_backlog to shard_load_queue_backlog
v4: Fix documentation
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-13 13:39:26 +01:00
Azat Khuzhin
345c422e28
Add ability to load hashed dictionaries using multiple threads
...
Right now dictionaries (here I will talk about only
HASHED/SPARSE_HASHED/COMPLEX_KEY_HASHED/COMPLEX_KEY_SPARSE_HASHED)
can load data only in one thread, since it uses one hash table that
cannot be filled from multiple threads.
And in case you have very big dictionary (i.e. 10e9 elements), it can
take a awhile to load them, especially for SPARSE_HASHED variants (and
if you have such amount of elements there, you are likely use
SPARSE_HASHED, since it requires less memory), in my env it takes ~4
hours, which is enormous amount of time.
So this patch add support of shards for dictionaries, number of shards
determine how much hash tables will use this dictionary, also, and which
is more important, how much threads it can use to load the data.
And with 16 threads this works 2x faster, not perfect though, see the
follow up patches in this series.
v0: PARTITION BY
v1: SHARDS 1
v2: SHARDS(1)
v3: tried optimized mod - logical and, but it does not gain even 10%
v4: tried squashing more (max_block_size * shards), but it does not gain even 10% either
v5: move SHARDS into layout parameters (unknown simply ignored)
v6: tune params for perf tests (to avoid too long queries)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-13 13:39:25 +01:00