thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 13:42:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
106,485 Commits 9,138 Branches 1,774 Tags 2 GiB
e3a5318739
Commit Graph

3308 Commits

Author SHA1 Message Date
Dale Mcdiarmid
9c4d3e0ffb link docs to blogs 2023-01-17 15:38:10 +00:00
Nikolay Degterinsky
70e79de69b
Merge pull request #38252 from bharatnc/ncb/weighted-quantile-approx 
add quantileInterpolatedWeighted function
 2023-01-16 13:41:13 +01:00
Sema Checherinda
d746a3c4ff
Merge pull request #44480 from wineternity/issue_43333_doc 
[DOC] Add support for signed arguments in range() #43333
 2023-01-16 10:26:49 +01:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-16 08:04:49 +00:00
Ilya Yatsishin
cf5052c77e
Merge pull request #45291 from den-crane/patch-57 2023-01-16 02:33:54 +01:00
Dan Roscigno
adca0b64d3
use markdown file instead of URL to enforce 404 checks 2023-01-15 19:31:58 -05:00
Peignon Melvyn
674a1d1877
Update json.md 2023-01-16 01:27:08 +01:00
Denny Crane
6cf603e05f
Update index.md 2023-01-15 18:40:59 -04:00
Robert Schulze
bd41c74ddf
Various test, code and docs fixups 2023-01-15 13:47:34 +00:00
Ilya Yatsishin
96987b7cd8
Merge pull request #45239 from Avogar/generate-random 2023-01-15 00:37:34 +01:00
Rich Raposa
c7aad8e48b
Merge pull request #45207 from ClickHouse/add-maxintersections-to-docs 
Add maxIntersections to docs
 2023-01-13 10:27:59 -07:00
Robert Schulze
4ea836b87e
Revert "Revert "update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability"" 
This reverts commit e37f572c34.
 2023-01-13 14:00:16 +00:00
Azat Khuzhin
99063b152f Allow to configure queue backlog of the parallel hashed dictionary loader 
v2: Decrease default parallel_queue_backlog to 10000 (same speed)
v3: Rename parallel_queue_backlog to per_shard_load_backlog
v3: Rename per_shard_load_backlog to shard_load_queue_backlog
v4: Fix documentation
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-13 13:39:26 +01:00
Azat Khuzhin
345c422e28 Add ability to load hashed dictionaries using multiple threads 
Right now dictionaries (here I will talk about only
HASHED/SPARSE_HASHED/COMPLEX_KEY_HASHED/COMPLEX_KEY_SPARSE_HASHED)
can load data only in one thread, since it uses one hash table that
cannot be filled from multiple threads.

And in case you have very big dictionary (i.e. 10e9 elements), it can
take a awhile to load them, especially for SPARSE_HASHED variants (and
if you have such amount of elements there, you are likely use
SPARSE_HASHED, since it requires less memory), in my env it takes ~4
hours, which is enormous amount of time.

So this patch add support of shards for dictionaries, number of shards
determine how much hash tables will use this dictionary, also, and which
is more important, how much threads it can use to load the data.

And with 16 threads this works 2x faster, not perfect though, see the
follow up patches in this series.

v0: PARTITION BY
v1: SHARDS 1
v2: SHARDS(1)
v3: tried optimized mod - logical and, but it does not gain even 10%
v4: tried squashing more (max_block_size * shards), but it does not gain even 10% either
v5: move SHARDS into layout parameters (unknown simply ignored)
v6: tune params for perf tests (to avoid too long queries)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-13 13:39:25 +01:00
avogar
82ff1fd343 Add tests and docs 2023-01-12 22:29:23 +00:00
Dan Roscigno
8c94ed9597
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 2023-01-12 11:01:03 -05:00
Rich Raposa
759a4c0940
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-12 08:53:22 -07:00
rfraposa
69a11574d2 Update maxintersections.md 2023-01-12 08:30:54 -07:00
Kseniia Sumarokova
db3e0219fc
Merge pull request #41687 from ClickHouse/40907_Parameterized_views_as_table_functions 
40907 Parameterized views as table functions
 2023-01-12 14:24:32 +01:00
Alexander Tokmakov
e37f572c34
Revert "update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability" 2023-01-12 15:01:36 +03:00
Dan Roscigno
7a651d749c
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 2023-01-11 19:20:37 -05:00
rfraposa
2e44ad9d0f Add maxIntersections to docs 2023-01-11 17:10:51 -07:00
Ilya Yatsishin
3a98f2bc12
Merge pull request #45190 from ClickHouse/add-query-params-to-docs 
Add query parameters to the docs
 2023-01-11 23:47:50 +01:00
Sergei Trifonov
1b94c839d5
Add docs for SYSTEM RELOAD USERS 2023-01-11 21:16:22 +01:00
Rich Raposa
f8ac49bb86
Update syntax.md 2023-01-11 12:09:23 -07:00
Rich Raposa
a389180f42
Update syntax.md 2023-01-11 12:05:35 -07:00
rfraposa
8b9d99e2e2 Update syntax.md 2023-01-11 11:51:53 -07:00
Sergei Trifonov
ec9f10e934
Merge pull request #45174 from ClickHouse/make-queries-copyable-from-docs 
make more SQL queries copyable from docs in one click
 2023-01-11 16:59:52 +01:00
DanRoscigno
7168c217b0 switch text to response for query blocks 2023-01-11 10:08:11 -05:00
serxa
8d099a4417 make more SQL queries copyable from docs in one click 2023-01-11 13:43:51 +00:00
Dan Roscigno
0ad969171e
Merge pull request #45127 from DanRoscigno/add-deltalake-docs 
Add deltalake docs
 2023-01-11 08:07:42 -05:00
Robert Schulze
9bb1e31369
Merge pull request #44860 from bigo-sg/improve_week_day 
update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability
 2023-01-11 13:58:45 +01:00
Dan Roscigno
6e9669cfae
Apply suggestions from code review 2023-01-11 07:53:37 -05:00
Dan Roscigno
d4c4f84161
Update docs/en/sql-reference/table-functions/hudi.md 2023-01-11 07:41:36 -05:00
Dan Roscigno
367d4fc4bf
Update docs/en/sql-reference/table-functions/hudi.md 2023-01-11 07:40:52 -05:00
Bharat Nallan Chakravarthy
e18a95719d review fix 2023-01-10 21:16:16 -08:00
DanRoscigno
563e0e76f9 init 2023-01-10 16:59:34 -05:00
DanRoscigno
75c04945bd spelling 2023-01-10 16:18:50 -05:00
rfraposa
57ab2a4110 Update nlp-functions.md 
Added the detectLanguage functions
 2023-01-10 12:26:51 -07:00
DanRoscigno
879ee05218 fix case of names 2023-01-10 11:18:33 -05:00
DanRoscigno
ee86afb125 add deltalake 2023-01-10 11:14:12 -05:00
Rich Raposa
f28b04fc59
Merge pull request #45124 from ClickHouse/rfraposa-patch-2 
Update theilsu.md
 2023-01-10 09:04:22 -07:00
Han Fei
91226abbfe
Merge pull request #43858 from hanfei1991/regexp-tree-dictionary 
Merge #40878: Add regexp tree dictionary
 2023-01-10 16:41:15 +01:00
Rich Raposa
df3cca6c35
Update theilsu.md 
Typo
 2023-01-10 08:40:48 -07:00
Ilya Yatsishin
4b3a9862cc
Merge pull request #45091 from ClickHouse/add-cramersv-agg-functions 
Add missing agg functions to docs
 2023-01-10 16:35:04 +01:00
Dan Roscigno
707ff65b4f
Update docs/en/sql-reference/aggregate-functions/reference/contingency.md 2023-01-10 09:55:59 -05:00
Han Fei
6ed4570f73
Merge branch 'master' into regexp-tree-dictionary 2023-01-10 15:36:30 +01:00
Han Fei
5f8296b719
Update docs/en/sql-reference/dictionaries/external-dictionaries/regexp-tree.md 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2023-01-10 14:41:06 +01:00
Robert Schulze
cbc18318ff
Merge pull request #45114 from ClickHouse/less-awkward-comment-about-debugging 
Docs: Rewrite awkwardly phrased sentence about flush interval
 2023-01-10 14:15:43 +01:00
Robert Schulze
6497ddd882
Docs: Rewrite awkwardly phrased sentence about flush interval 2023-01-10 13:13:35 +00:00
Robert Schulze
0c3b034887
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-10 09:02:41 +00:00
rfraposa
c3dcbb2671 Add cramersV function 
And 3 similar functions t
 2023-01-09 23:42:39 -07:00
Dan Roscigno
f8a5d5cb18
Merge branch 'ClickHouse:master' into add-deltalake-docs 2023-01-09 15:45:08 -05:00
Dan Roscigno
bfcb6eb0cf
Merge pull request #44995 from ClickHouse/qoega-patch-5 
Add documentation for xxh3
 2023-01-09 15:00:27 -05:00
DanRoscigno
438f34100d fix codeblock end 2023-01-09 14:42:24 -05:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
Ivan Blinkov
b7e082d033 Remove "Original article links" 2023-01-09 15:13:36 +01:00
taiyang-li
20c7c0b1ef change as request 2023-01-09 18:21:31 +08:00
Dan Roscigno
dced847e9b
Merge branch 'master' into qoega-patch-5 2023-01-07 19:36:23 -05:00
DanRoscigno
8d002e6d43 full path to links 2023-01-07 19:19:49 -05:00
Dan Roscigno
758c98e832
Merge pull request #45005 from DanRoscigno/date-subtraction-docs 
clarify date sub docs
 2023-01-07 17:28:08 -05:00
Anton Popov
1f32ffedf8
Merge pull request #43221 from ClickHouse/refactoring-ip-types 
Replace domain IP types (IPv4, IPv6) with native
 2023-01-07 12:01:21 +01:00
DanRoscigno
eff349bab7 clarify date sub docs 2023-01-06 17:32:03 -05:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-06 20:42:48 +00:00
Ilya Yatsishin
b6b9be7a3e
Add documentation for xxh3 2023-01-06 18:05:27 +01:00
Robert Schulze
35511685e3
Merge pull request #44977 from ClickHouse/match-docs 
Docs: Mention non-standard DOTALL behavior of ClickHouse's match()
 2023-01-06 13:22:28 +01:00
Robert Schulze
1cc5bce1c5
Docs: Mention non-standard DOTALL behavior of ClickHouse's match() 
Cf. #34603
 2023-01-06 11:18:22 +00:00
DanRoscigno
5cde7762ad WIP 2023-01-05 15:54:44 -05:00
Dan Roscigno
adfc4d4a23
Merge pull request #44945 from DanRoscigno/tolastday 
add toLastDayOfMonth to docs
 2023-01-05 11:53:40 -05:00
Han Fei
f2a9eea995 write docs and optimize regex compile 2023-01-05 17:38:01 +01:00
DanRoscigno
9e5c8acd92 add toLastDayOfMonth to docs 2023-01-05 11:37:05 -05:00
DanRoscigno
4cba7fc958 add aliases for positiveModulo to docs 2023-01-05 11:10:20 -05:00
Alexey Milovidov
7589c29902
Merge pull request #44906 from DanRoscigno/add-touuid-docs 
add toUUIDOrDefault docs
 2023-01-05 00:01:14 +03:00
Dan Roscigno
288488f8a2
Merge pull request #44919 from DanRoscigno/revert-h3-doc-deletions 
revert doc removal
 2023-01-04 15:51:37 -05:00
DanRoscigno
2397318b1a add more about matching 2023-01-04 15:37:13 -05:00
DanRoscigno
51f1d3ba1e revert doc removal 2023-01-04 14:53:02 -05:00
DanRoscigno
df603911ea add example with file globbing 2023-01-04 11:36:38 -05:00
Yakov Olkhovskiy
7a5a36cbed
Merge branch 'master' into refactoring-ip-types 2023-01-04 11:11:06 -05:00
DanRoscigno
530f0b36e9 add toUUIDOrDefault docs 2023-01-04 09:46:36 -05:00
Smita Kulkarni
1f89db78a5 Added is_create_parameterized_view flag in ActionsVisitor, added functions for column manipulation for parameterized view in StorageView, updated tests to fix flaky test issues and addressed small review comments- 40907 Parameterized views as table functions 2023-01-03 11:00:39 +01:00
Robert Schulze
421473e974
Merge pull request #44421 from ClickHouse/revert-of-revert-of-age-function 
Revert revert of age function
 2023-01-03 10:02:18 +01:00
Alexey Milovidov
e855d3519a
Merge branch 'master' into refactoring-ip-types 2023-01-02 21:58:53 +03:00
Kruglov Pavel
966f57ef68
Merge pull request #42777 from Avogar/improve-streaming-engines 
Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and data formats
 2023-01-02 15:59:06 +01:00
Azat Khuzhin
b9125bb351
Introduce groupArrayLast() (useful to store last X values) (#44521) 
* Cleanup DataTypeCustomSimpleAggregateFunction::checkSupportedFunctions()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Remove unused GroupArrayGeneralListImpl

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Introduce groupArrayLast() (useful to store last X values)

Also do some refactoring to make code cleaner:
- rename insert() to insertWithSampler() (since it is used only for
  groupArraySample())
- split merge methods into Last/RNG/...

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-02 15:20:21 +01:00
Robert Schulze
545576fe01
Merge pull request #43818 from bigo-sg/improve_from_unixtime 
Add new functions to format datetime in joda datetime style
 2023-01-02 13:41:50 +01:00
Robert Schulze
e9e04166d9
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-02 08:20:27 +00:00
DanRoscigno
ec5314ff84 full path for links, split sql from response 2022-12-30 11:17:43 -05:00
Alexey Milovidov
5ca6b317b0
Update type-conversion-functions.md 2022-12-30 15:57:39 +03:00
Kruglov Pavel
894726bd8f
Merge branch 'master' into improve-streaming-engines 2022-12-29 22:59:45 +01:00
taiyang-li
3e44f6574c update doc 2022-12-28 14:58:18 +08:00
taiyang-li
5ae280611b merge master and solve conflict 2022-12-28 14:44:10 +08:00
SmitaRKulkarni
4d7459bd65
Merge branch 'master' into 40907_Parameterized_views_as_table_functions 2022-12-27 08:15:42 +01:00
Denny Crane
850f77f4d2
Update external-dicts-dict-sources.md 2022-12-26 16:21:36 -04:00
Denys Golotiuk
f364c28f4a
Added docs for randUniform 
Implemented in [22.10](https://clickhouse.com/docs/en/whats-new/changelog/#new-feature-2) and delivered in https://github.com/ClickHouse/ClickHouse/pull/42411
 2022-12-23 11:59:43 +02:00
Dan Roscigno
5c860133d6
Merge pull request #44514 from mrcrypster/patch-1 
Added docs for new rand* functions (distributions)
 2022-12-22 13:12:16 -05:00
Dan Roscigno
8da98001da
Merge pull request #44488 from DanRoscigno/from-final 
From final
 2022-12-22 11:30:10 -05:00
Dan Roscigno
37826d6301
Update docs/en/sql-reference/statements/select/from.md 2022-12-22 11:13:36 -05:00
Denys Golotiuk
83d2b4da52
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:14:59 +02:00
Denys Golotiuk
d33670d965
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:14:55 +02:00
Denys Golotiuk
859fa04dfb
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:14:48 +02:00