thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-18 04:12:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
107,658 Commits 9,324 Branches 1,783 Tags 2.2 GiB
f0011862a9
Commit Graph

3355 Commits

Author SHA1 Message Date
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-16 08:04:49 +00:00
Ilya Yatsishin
cf5052c77e
Merge pull request #45291 from den-crane/patch-57 2023-01-16 02:33:54 +01:00
Dan Roscigno
adca0b64d3
use markdown file instead of URL to enforce 404 checks 2023-01-15 19:31:58 -05:00
Peignon Melvyn
674a1d1877
Update json.md 2023-01-16 01:27:08 +01:00
Denny Crane
6cf603e05f
Update index.md 2023-01-15 18:40:59 -04:00
Robert Schulze
bd41c74ddf
Various test, code and docs fixups 2023-01-15 13:47:34 +00:00
Ilya Yatsishin
96987b7cd8
Merge pull request #45239 from Avogar/generate-random 2023-01-15 00:37:34 +01:00
Rich Raposa
c7aad8e48b
Merge pull request #45207 from ClickHouse/add-maxintersections-to-docs 
Add maxIntersections to docs
 2023-01-13 10:27:59 -07:00
Robert Schulze
4ea836b87e
Revert "Revert "update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability"" 
This reverts commit e37f572c34.
 2023-01-13 14:00:16 +00:00
Azat Khuzhin
99063b152f Allow to configure queue backlog of the parallel hashed dictionary loader 
v2: Decrease default parallel_queue_backlog to 10000 (same speed)
v3: Rename parallel_queue_backlog to per_shard_load_backlog
v3: Rename per_shard_load_backlog to shard_load_queue_backlog
v4: Fix documentation
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-13 13:39:26 +01:00
Azat Khuzhin
345c422e28 Add ability to load hashed dictionaries using multiple threads 
Right now dictionaries (here I will talk about only
HASHED/SPARSE_HASHED/COMPLEX_KEY_HASHED/COMPLEX_KEY_SPARSE_HASHED)
can load data only in one thread, since it uses one hash table that
cannot be filled from multiple threads.

And in case you have very big dictionary (i.e. 10e9 elements), it can
take a awhile to load them, especially for SPARSE_HASHED variants (and
if you have such amount of elements there, you are likely use
SPARSE_HASHED, since it requires less memory), in my env it takes ~4
hours, which is enormous amount of time.

So this patch add support of shards for dictionaries, number of shards
determine how much hash tables will use this dictionary, also, and which
is more important, how much threads it can use to load the data.

And with 16 threads this works 2x faster, not perfect though, see the
follow up patches in this series.

v0: PARTITION BY
v1: SHARDS 1
v2: SHARDS(1)
v3: tried optimized mod - logical and, but it does not gain even 10%
v4: tried squashing more (max_block_size * shards), but it does not gain even 10% either
v5: move SHARDS into layout parameters (unknown simply ignored)
v6: tune params for perf tests (to avoid too long queries)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-13 13:39:25 +01:00
avogar
82ff1fd343 Add tests and docs 2023-01-12 22:29:23 +00:00
Dan Roscigno
8c94ed9597
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 2023-01-12 11:01:03 -05:00
Rich Raposa
759a4c0940
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-12 08:53:22 -07:00
rfraposa
69a11574d2 Update maxintersections.md 2023-01-12 08:30:54 -07:00
Kseniia Sumarokova
db3e0219fc
Merge pull request #41687 from ClickHouse/40907_Parameterized_views_as_table_functions 
40907 Parameterized views as table functions
 2023-01-12 14:24:32 +01:00
Alexander Tokmakov
e37f572c34
Revert "update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability" 2023-01-12 15:01:36 +03:00
Dan Roscigno
7a651d749c
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 2023-01-11 19:20:37 -05:00
rfraposa
2e44ad9d0f Add maxIntersections to docs 2023-01-11 17:10:51 -07:00
Ilya Yatsishin
3a98f2bc12
Merge pull request #45190 from ClickHouse/add-query-params-to-docs 
Add query parameters to the docs
 2023-01-11 23:47:50 +01:00
Sergei Trifonov
1b94c839d5
Add docs for SYSTEM RELOAD USERS 2023-01-11 21:16:22 +01:00
Rich Raposa
f8ac49bb86
Update syntax.md 2023-01-11 12:09:23 -07:00
Rich Raposa
a389180f42
Update syntax.md 2023-01-11 12:05:35 -07:00
rfraposa
8b9d99e2e2 Update syntax.md 2023-01-11 11:51:53 -07:00
Sergei Trifonov
ec9f10e934
Merge pull request #45174 from ClickHouse/make-queries-copyable-from-docs 
make more SQL queries copyable from docs in one click
 2023-01-11 16:59:52 +01:00
DanRoscigno
7168c217b0 switch text to response for query blocks 2023-01-11 10:08:11 -05:00
serxa
8d099a4417 make more SQL queries copyable from docs in one click 2023-01-11 13:43:51 +00:00
Dan Roscigno
0ad969171e
Merge pull request #45127 from DanRoscigno/add-deltalake-docs 
Add deltalake docs
 2023-01-11 08:07:42 -05:00
Robert Schulze
9bb1e31369
Merge pull request #44860 from bigo-sg/improve_week_day 
update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability
 2023-01-11 13:58:45 +01:00
Dan Roscigno
6e9669cfae
Apply suggestions from code review 2023-01-11 07:53:37 -05:00
Dan Roscigno
d4c4f84161
Update docs/en/sql-reference/table-functions/hudi.md 2023-01-11 07:41:36 -05:00
Dan Roscigno
367d4fc4bf
Update docs/en/sql-reference/table-functions/hudi.md 2023-01-11 07:40:52 -05:00
Bharat Nallan Chakravarthy
e18a95719d review fix 2023-01-10 21:16:16 -08:00
DanRoscigno
563e0e76f9 init 2023-01-10 16:59:34 -05:00
DanRoscigno
75c04945bd spelling 2023-01-10 16:18:50 -05:00
rfraposa
57ab2a4110 Update nlp-functions.md 
Added the detectLanguage functions
 2023-01-10 12:26:51 -07:00
DanRoscigno
879ee05218 fix case of names 2023-01-10 11:18:33 -05:00
DanRoscigno
ee86afb125 add deltalake 2023-01-10 11:14:12 -05:00
Rich Raposa
f28b04fc59
Merge pull request #45124 from ClickHouse/rfraposa-patch-2 
Update theilsu.md
 2023-01-10 09:04:22 -07:00
Han Fei
91226abbfe
Merge pull request #43858 from hanfei1991/regexp-tree-dictionary 
Merge #40878: Add regexp tree dictionary
 2023-01-10 16:41:15 +01:00
Rich Raposa
df3cca6c35
Update theilsu.md 
Typo
 2023-01-10 08:40:48 -07:00
Ilya Yatsishin
4b3a9862cc
Merge pull request #45091 from ClickHouse/add-cramersv-agg-functions 
Add missing agg functions to docs
 2023-01-10 16:35:04 +01:00
Dan Roscigno
707ff65b4f
Update docs/en/sql-reference/aggregate-functions/reference/contingency.md 2023-01-10 09:55:59 -05:00
Han Fei
6ed4570f73
Merge branch 'master' into regexp-tree-dictionary 2023-01-10 15:36:30 +01:00
Han Fei
5f8296b719
Update docs/en/sql-reference/dictionaries/external-dictionaries/regexp-tree.md 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2023-01-10 14:41:06 +01:00
Robert Schulze
cbc18318ff
Merge pull request #45114 from ClickHouse/less-awkward-comment-about-debugging 
Docs: Rewrite awkwardly phrased sentence about flush interval
 2023-01-10 14:15:43 +01:00
Robert Schulze
6497ddd882
Docs: Rewrite awkwardly phrased sentence about flush interval 2023-01-10 13:13:35 +00:00
Robert Schulze
0c3b034887
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-10 09:02:41 +00:00
rfraposa
c3dcbb2671 Add cramersV function 
And 3 similar functions t
 2023-01-09 23:42:39 -07:00
Dan Roscigno
f8a5d5cb18
Merge branch 'ClickHouse:master' into add-deltalake-docs 2023-01-09 15:45:08 -05:00
Dan Roscigno
bfcb6eb0cf
Merge pull request #44995 from ClickHouse/qoega-patch-5 
Add documentation for xxh3
 2023-01-09 15:00:27 -05:00
DanRoscigno
438f34100d fix codeblock end 2023-01-09 14:42:24 -05:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
Ivan Blinkov
b7e082d033 Remove "Original article links" 2023-01-09 15:13:36 +01:00
taiyang-li
20c7c0b1ef change as request 2023-01-09 18:21:31 +08:00
Dan Roscigno
dced847e9b
Merge branch 'master' into qoega-patch-5 2023-01-07 19:36:23 -05:00
DanRoscigno
8d002e6d43 full path to links 2023-01-07 19:19:49 -05:00
Dan Roscigno
758c98e832
Merge pull request #45005 from DanRoscigno/date-subtraction-docs 
clarify date sub docs
 2023-01-07 17:28:08 -05:00
Anton Popov
1f32ffedf8
Merge pull request #43221 from ClickHouse/refactoring-ip-types 
Replace domain IP types (IPv4, IPv6) with native
 2023-01-07 12:01:21 +01:00
DanRoscigno
eff349bab7 clarify date sub docs 2023-01-06 17:32:03 -05:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-06 20:42:48 +00:00
Ilya Yatsishin
b6b9be7a3e
Add documentation for xxh3 2023-01-06 18:05:27 +01:00
Robert Schulze
35511685e3
Merge pull request #44977 from ClickHouse/match-docs 
Docs: Mention non-standard DOTALL behavior of ClickHouse's match()
 2023-01-06 13:22:28 +01:00
Robert Schulze
1cc5bce1c5
Docs: Mention non-standard DOTALL behavior of ClickHouse's match() 
Cf. #34603
 2023-01-06 11:18:22 +00:00
DanRoscigno
5cde7762ad WIP 2023-01-05 15:54:44 -05:00
Dan Roscigno
adfc4d4a23
Merge pull request #44945 from DanRoscigno/tolastday 
add toLastDayOfMonth to docs
 2023-01-05 11:53:40 -05:00
Han Fei
f2a9eea995 write docs and optimize regex compile 2023-01-05 17:38:01 +01:00
DanRoscigno
9e5c8acd92 add toLastDayOfMonth to docs 2023-01-05 11:37:05 -05:00
DanRoscigno
4cba7fc958 add aliases for positiveModulo to docs 2023-01-05 11:10:20 -05:00
Alexey Milovidov
7589c29902
Merge pull request #44906 from DanRoscigno/add-touuid-docs 
add toUUIDOrDefault docs
 2023-01-05 00:01:14 +03:00
Dan Roscigno
288488f8a2
Merge pull request #44919 from DanRoscigno/revert-h3-doc-deletions 
revert doc removal
 2023-01-04 15:51:37 -05:00
DanRoscigno
2397318b1a add more about matching 2023-01-04 15:37:13 -05:00
DanRoscigno
51f1d3ba1e revert doc removal 2023-01-04 14:53:02 -05:00
DanRoscigno
df603911ea add example with file globbing 2023-01-04 11:36:38 -05:00
Yakov Olkhovskiy
7a5a36cbed
Merge branch 'master' into refactoring-ip-types 2023-01-04 11:11:06 -05:00
DanRoscigno
530f0b36e9 add toUUIDOrDefault docs 2023-01-04 09:46:36 -05:00
Smita Kulkarni
1f89db78a5 Added is_create_parameterized_view flag in ActionsVisitor, added functions for column manipulation for parameterized view in StorageView, updated tests to fix flaky test issues and addressed small review comments- 40907 Parameterized views as table functions 2023-01-03 11:00:39 +01:00
Robert Schulze
421473e974
Merge pull request #44421 from ClickHouse/revert-of-revert-of-age-function 
Revert revert of age function
 2023-01-03 10:02:18 +01:00
Alexey Milovidov
e855d3519a
Merge branch 'master' into refactoring-ip-types 2023-01-02 21:58:53 +03:00
Kruglov Pavel
966f57ef68
Merge pull request #42777 from Avogar/improve-streaming-engines 
Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and data formats
 2023-01-02 15:59:06 +01:00
Azat Khuzhin
b9125bb351
Introduce groupArrayLast() (useful to store last X values) (#44521) 
* Cleanup DataTypeCustomSimpleAggregateFunction::checkSupportedFunctions()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Remove unused GroupArrayGeneralListImpl

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Introduce groupArrayLast() (useful to store last X values)

Also do some refactoring to make code cleaner:
- rename insert() to insertWithSampler() (since it is used only for
  groupArraySample())
- split merge methods into Last/RNG/...

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-02 15:20:21 +01:00
Robert Schulze
545576fe01
Merge pull request #43818 from bigo-sg/improve_from_unixtime 
Add new functions to format datetime in joda datetime style
 2023-01-02 13:41:50 +01:00
Robert Schulze
e9e04166d9
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-02 08:20:27 +00:00
DanRoscigno
ec5314ff84 full path for links, split sql from response 2022-12-30 11:17:43 -05:00
Alexey Milovidov
5ca6b317b0
Update type-conversion-functions.md 2022-12-30 15:57:39 +03:00
Kruglov Pavel
894726bd8f
Merge branch 'master' into improve-streaming-engines 2022-12-29 22:59:45 +01:00
taiyang-li
3e44f6574c update doc 2022-12-28 14:58:18 +08:00
taiyang-li
5ae280611b merge master and solve conflict 2022-12-28 14:44:10 +08:00
SmitaRKulkarni
4d7459bd65
Merge branch 'master' into 40907_Parameterized_views_as_table_functions 2022-12-27 08:15:42 +01:00
Denny Crane
850f77f4d2
Update external-dicts-dict-sources.md 2022-12-26 16:21:36 -04:00
Denys Golotiuk
f364c28f4a
Added docs for randUniform 
Implemented in [22.10](https://clickhouse.com/docs/en/whats-new/changelog/#new-feature-2) and delivered in https://github.com/ClickHouse/ClickHouse/pull/42411
 2022-12-23 11:59:43 +02:00
Dan Roscigno
5c860133d6
Merge pull request #44514 from mrcrypster/patch-1 
Added docs for new rand* functions (distributions)
 2022-12-22 13:12:16 -05:00
Dan Roscigno
8da98001da
Merge pull request #44488 from DanRoscigno/from-final 
From final
 2022-12-22 11:30:10 -05:00
Dan Roscigno
37826d6301
Update docs/en/sql-reference/statements/select/from.md 2022-12-22 11:13:36 -05:00
Denys Golotiuk
83d2b4da52
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:14:59 +02:00
Denys Golotiuk
d33670d965
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:14:55 +02:00
Denys Golotiuk
859fa04dfb
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:14:48 +02:00
Denys Golotiuk
6e5703125c
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:14:14 +02:00
Denys Golotiuk
e8d8b60e34
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:14:08 +02:00
Denys Golotiuk
ddd3b99d40
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:14:02 +02:00
Denys Golotiuk
5a2e6ec568
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:13:57 +02:00
Denys Golotiuk
88ad6d47b4
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:13:51 +02:00
Denys Golotiuk
fd81509a48
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:13:45 +02:00
Denys Golotiuk
344dfb0064
Update docs/en/sql-reference/functions/random-functions.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-12-22 17:13:28 +02:00
Denys Golotiuk
3de02287bc
Added docs for new rand* functions (distributions) 2022-12-22 16:10:25 +02:00
Yakov Olkhovskiy
a8cb29da4b
Merge branch 'master' into refactoring-ip-types 2022-12-21 23:56:24 -05:00
Alexander Gololobov
c95e10777f
Fixed formatiing 2022-12-21 21:40:30 +01:00
Alexander Gololobov
269700df42
Merge branch 'master' into feature/format-datetime-fractional-second 2022-12-21 21:34:46 +01:00
Dan Roscigno
37af44501d
Update docs/en/sql-reference/functions/hash-functions.md 
Co-authored-by: Ilya Yatsishin <2159081+qoega@users.noreply.github.com>
 2022-12-21 09:12:06 -05:00
DanRoscigno
4da00b0b1d clarify which engines support final 2022-12-21 09:07:40 -05:00
DanRoscigno
e791e7bbfe clarify which engines support final 2022-12-21 08:58:12 -05:00
DanRoscigno
4981d4a013 clarify which engines support final 2022-12-21 08:55:38 -05:00
Dan Roscigno
30eb95d7d1
Update hash-functions.md 2022-12-21 08:39:44 -05:00
wineternity
1544e412f5 [DOC] Add support for signed arguments in range() #43333 2022-12-21 19:58:01 +08:00
Kruglov Pavel
5e01a3d74e
Merge branch 'master' into improve-streaming-engines 2022-12-21 10:51:50 +01:00
Robert Schulze
3f03b0b53d
Revert "Revert "Add function 'age'"" 
This reverts commit 4549b14027.
 2022-12-20 10:18:43 +00:00
Robert Schulze
b93c56323c
Merge remote-tracking branch 'origin/master' into query-result-cache 2022-12-19 09:18:36 +00:00
Bharat Nallan Chakravarthy
633f2bc9d8 add docs for quantileInterpolatedWeighted 2022-12-16 10:27:22 -08:00
Dale Mcdiarmid
1f5e6799ec revert contents change 2022-12-16 12:03:57 +00:00
Dale Mcdiarmid
ba52210124 revert format issue 2022-12-16 12:00:12 +00:00
Smita Kulkarni
16d8fd02fb Merge branch 'master' into 40907_Parameterized_views_as_table_functions 2022-12-16 08:52:48 +01:00
Robert Schulze
3790952631
Move server-level settings into the appropriate document 2022-12-15 22:51:47 +00:00
Kruglov Pavel
c5b2e4cc23
Merge branch 'master' into improve-streaming-engines 2022-12-15 18:44:35 +01:00
Robert Schulze
537c64aad2
Merge remote-tracking branch 'origin/master' into query-result-cache 
Conflicts:
- tests/queries/0_stateless/02117_show_create_table_system.reference
 2022-12-15 12:17:58 +00:00
李扬
db0091d5f2
Merge branch 'master' into improve_from_unixtime 2022-12-15 10:11:32 +08:00
Dale Mcdiarmid
22e8477b2a cross link dictionaries + udf posts£ 2022-12-14 15:01:15 +00:00
Vladimir C
06ff93d801
Merge pull request #39129 from unbyte/issue-28967 
closes https://github.com/ClickHouse/ClickHouse/issues/28967
 2022-12-14 12:17:44 +01:00
taiyang-li
58cbd8162f Add new functions to format datetime in joda datetime style 2022-12-14 14:28:43 +08:00
Alexey Milovidov
4549b14027
Revert "Add function 'age'" 2022-12-13 23:28:09 +03:00
vdimir
a591213925
Add info about underscores in numbers to doc 2022-12-13 13:00:39 +01:00
李扬
6e5e2d5923
Merge branch 'master' into improve_concat 2022-12-13 12:12:48 +08:00
Peignon Melvyn
69fc75a717
Clearer message about Float vs Decimal (#44175) 
* Clearer message about Float vs Decimal

* Update docs/en/sql-reference/data-types/float.md

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2022-12-12 23:19:07 +01:00
Robert Schulze
b78652e138
Query result cache 2022-12-12 10:37:10 +00:00
ltrk2
4cbda15acf Drop toFractionalSecond 2022-12-09 07:52:27 -08:00
Nikolay Degterinsky
43ef217134
Merge branch 'master' into patch-1 2022-12-09 10:01:18 +01:00
ltrk2
cae7a1d24a Implement formatDateTime fractional second formatter 2022-12-08 14:53:16 -08:00
Dan Roscigno
b026f5583b
Merge pull request #44048 from ClickHouse/fix-case 
Update exponentialmovingaverage.md
 2022-12-08 15:45:15 -05:00
Dan Roscigno
e99456605d
Update exponentialmovingaverage.md 2022-12-08 11:40:27 -05:00
Yakov Olkhovskiy
0641066183
Merge branch 'master' into refactoring-ip-types 2022-12-08 11:12:05 -05:00
Nikolay Degterinsky
bd23b0fa61
Fix docs 2022-12-08 14:17:55 +01:00
vahid-sohrabloo
8594274e99
fix docs 2022-12-07 22:50:27 +01:00
李扬
c297f9d22a
Merge branch 'master' into improve_concat 2022-12-07 19:59:01 +08:00
Dan Roscigno
c5eb269515
Merge pull request #43943 from DanRoscigno/update-operations-docs 
Update operations docs
 2022-12-05 20:58:42 -05:00
Dale Mcdiarmid
5ab5aa13f4 cross link docs to blogs 2022-12-05 17:28:03 +00:00
Robert Schulze
b14de0017c
Merge pull request #43788 from arenadata/ADQM-626 
Add support of array parameters in `cutURLParameter` function
 2022-12-05 16:18:42 +01:00
DanRoscigno
538d9cf598 update link 2022-12-05 08:26:59 -05:00
DanRoscigno
08e8ea1bfa update link 2022-12-05 08:23:51 -05:00
taiyang-li
88c9438515 rename function 2022-12-05 17:38:25 +08:00
Roman Vasin
a09e7fddcc
Merge branch 'master' into ADQM-626 2022-12-04 20:34:55 +03:00
Roman Vasin
bcb65eb420
Merge branch 'master' into ADQM-623 2022-12-04 20:21:27 +03:00