Commit Graph

1565 Commits

Author SHA1 Message Date
Nikolay Degterinsky
c6daf0a6eb Merge remote-tracking branch 'upstream/master' into ulid 2023-01-03 19:58:50 +00:00
Robert Schulze
421473e974
Merge pull request #44421 from ClickHouse/revert-of-revert-of-age-function
Revert revert of age function
2023-01-03 10:02:18 +01:00
Alexey Milovidov
e855d3519a
Merge branch 'master' into refactoring-ip-types 2023-01-02 21:58:53 +03:00
Kruglov Pavel
966f57ef68
Merge pull request #42777 from Avogar/improve-streaming-engines
Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and data formats
2023-01-02 15:59:06 +01:00
Robert Schulze
545576fe01
Merge pull request #43818 from bigo-sg/improve_from_unixtime
Add new functions to format datetime in joda datetime style
2023-01-02 13:41:50 +01:00
DanRoscigno
ec5314ff84 full path for links, split sql from response 2022-12-30 11:17:43 -05:00
Alexey Milovidov
5ca6b317b0
Update type-conversion-functions.md 2022-12-30 15:57:39 +03:00
Kruglov Pavel
894726bd8f
Merge branch 'master' into improve-streaming-engines 2022-12-29 22:59:45 +01:00
taiyang-li
3e44f6574c update doc 2022-12-28 14:58:18 +08:00
taiyang-li
5ae280611b merge master and solve conflict 2022-12-28 14:44:10 +08:00
Nikolay Degterinsky
7bb8db4bb3 Add generateULID function 2022-12-28 00:54:50 +00:00
Denys Golotiuk
f364c28f4a
Added docs for randUniform
Implemented in [22.10](https://clickhouse.com/docs/en/whats-new/changelog/#new-feature-2) and delivered in https://github.com/ClickHouse/ClickHouse/pull/42411
2022-12-23 11:59:43 +02:00
Denys Golotiuk
83d2b4da52
Update docs/en/sql-reference/functions/random-functions.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-12-22 17:14:59 +02:00
Denys Golotiuk
d33670d965
Update docs/en/sql-reference/functions/random-functions.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-12-22 17:14:55 +02:00
Denys Golotiuk
859fa04dfb
Update docs/en/sql-reference/functions/random-functions.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-12-22 17:14:48 +02:00
Denys Golotiuk
6e5703125c
Update docs/en/sql-reference/functions/random-functions.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-12-22 17:14:14 +02:00
Denys Golotiuk
e8d8b60e34
Update docs/en/sql-reference/functions/random-functions.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-12-22 17:14:08 +02:00
Denys Golotiuk
ddd3b99d40
Update docs/en/sql-reference/functions/random-functions.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-12-22 17:14:02 +02:00
Denys Golotiuk
5a2e6ec568
Update docs/en/sql-reference/functions/random-functions.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-12-22 17:13:57 +02:00
Denys Golotiuk
88ad6d47b4
Update docs/en/sql-reference/functions/random-functions.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-12-22 17:13:51 +02:00
Denys Golotiuk
fd81509a48
Update docs/en/sql-reference/functions/random-functions.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-12-22 17:13:45 +02:00
Denys Golotiuk
344dfb0064
Update docs/en/sql-reference/functions/random-functions.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-12-22 17:13:28 +02:00
Denys Golotiuk
3de02287bc
Added docs for new rand* functions (distributions) 2022-12-22 16:10:25 +02:00
Yakov Olkhovskiy
a8cb29da4b
Merge branch 'master' into refactoring-ip-types 2022-12-21 23:56:24 -05:00
Alexander Gololobov
c95e10777f
Fixed formatiing 2022-12-21 21:40:30 +01:00
Alexander Gololobov
269700df42
Merge branch 'master' into feature/format-datetime-fractional-second 2022-12-21 21:34:46 +01:00
Dan Roscigno
37af44501d
Update docs/en/sql-reference/functions/hash-functions.md
Co-authored-by: Ilya Yatsishin <2159081+qoega@users.noreply.github.com>
2022-12-21 09:12:06 -05:00
Dan Roscigno
30eb95d7d1
Update hash-functions.md 2022-12-21 08:39:44 -05:00
wineternity
1544e412f5 [DOC] Add support for signed arguments in range() #43333 2022-12-21 19:58:01 +08:00
Kruglov Pavel
5e01a3d74e
Merge branch 'master' into improve-streaming-engines 2022-12-21 10:51:50 +01:00
Robert Schulze
3f03b0b53d
Revert "Revert "Add function 'age'""
This reverts commit 4549b14027.
2022-12-20 10:18:43 +00:00
Kruglov Pavel
c5b2e4cc23
Merge branch 'master' into improve-streaming-engines 2022-12-15 18:44:35 +01:00
Dale Mcdiarmid
22e8477b2a cross link dictionaries + udf posts£ 2022-12-14 15:01:15 +00:00
taiyang-li
58cbd8162f Add new functions to format datetime in joda datetime style 2022-12-14 14:28:43 +08:00
Alexey Milovidov
4549b14027
Revert "Add function 'age'" 2022-12-13 23:28:09 +03:00
ltrk2
4cbda15acf Drop toFractionalSecond 2022-12-09 07:52:27 -08:00
ltrk2
cae7a1d24a Implement formatDateTime fractional second formatter 2022-12-08 14:53:16 -08:00
Yakov Olkhovskiy
0641066183
Merge branch 'master' into refactoring-ip-types 2022-12-08 11:12:05 -05:00
李扬
c297f9d22a
Merge branch 'master' into improve_concat 2022-12-07 19:59:01 +08:00
Robert Schulze
b14de0017c
Merge pull request #43788 from arenadata/ADQM-626
Add support of array parameters in `cutURLParameter` function
2022-12-05 16:18:42 +01:00
taiyang-li
88c9438515 rename function 2022-12-05 17:38:25 +08:00
Roman Vasin
a09e7fddcc
Merge branch 'master' into ADQM-626 2022-12-04 20:34:55 +03:00
Roman Vasin
bcb65eb420
Merge branch 'master' into ADQM-623 2022-12-04 20:21:27 +03:00
Roman Vasin
373a353ed9 Update docs 2022-12-02 17:34:02 +00:00
Robert Schulze
da0002c4c4
Document how the library-bridge port can be changed
Fixes #43605
2022-12-02 10:54:54 +00:00
Roman Vasin
325cd07fa1 Update docs 2022-12-01 13:47:44 +00:00
Roman Vasin
cea63dbca0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-626 2022-12-01 07:32:06 +00:00
taiyang-li
f14582334c Add function concatWs 2022-12-01 10:56:53 +08:00
Roman Vasin
96d7cf319b
Merge branch 'master' into ADQM-623 2022-11-30 19:25:53 +03:00
Roman Vasin
107a0d50f3 Update docs 2022-11-30 16:12:58 +00:00
Roman Vasin
668366af4a Update documentation 2022-11-29 07:10:31 +00:00
Alexander Gololobov
8c6fc171fc Fix EN doc as in #43765 2022-11-28 21:24:43 +01:00
Yakov Olkhovskiy
770b520ded
Merge branch 'master' into refactoring-ip-types 2022-11-28 08:50:19 -05:00
Robert Schulze
dce0b78198
Merge pull request #42778 from FArthur-cmd/annoy_cosine
Add cosine distance for annoy
2022-11-28 09:53:17 +01:00
Vladimir C
ff5bb69584
Merge branch 'master' into zvonand-decdiv 2022-11-25 17:05:22 +01:00
Yakov Olkhovskiy
19a01b77eb refactoring on settings for casting, dirty hack for inaccessable context in cast function (will require review), docs appended 2022-11-25 15:57:49 +00:00
zvonand
d42a29ac0f fix ubsan + expand docs 2022-11-24 01:23:59 +03:00
zvonand
faef0699b6 fix issues 2022-11-22 17:30:44 +03:00
Nikolay Degterinsky
e7e21adf17
Merge pull request #43207 from freedomDR/improve_unhex
unhex support FixedString arguments
2022-11-18 03:09:58 +01:00
Nikita Taranov
11b535d443
impl (#43283) 2022-11-17 11:17:27 +01:00
Maksim Kita
64b2a4d1bf
Merge pull request #43110 from bigo-sg/function_factorial
Add function factorial
2022-11-16 12:49:47 +03:00
李扬
d9adf2f02d
fix doc 2022-11-16 09:34:04 +08:00
Dan Roscigno
b178a3711c
Merge branch 'master' into standardize-dictionary-categories 2022-11-15 16:18:18 -05:00
Christoph Wurm
2a9ab046dd Unify spelling of DateTime 2022-11-15 11:51:14 +00:00
freedomDR
37c448c6be complete unhex doc 2022-11-15 12:33:14 +08:00
Dan Roscigno
b5a306c4db
Merge branch 'master' into standardize-dictionary-categories 2022-11-14 21:30:05 -05:00
taiyang-li
7178d80c51 Merge branch 'function_factorial' of https://github.com/bigo-sg/ClickHouse into function_factorial 2022-11-15 09:46:44 +08:00
taiyang-li
5eba20e119 modify return type from Int64 to UInt64 2022-11-15 09:46:24 +08:00
李扬
10449247fd
Merge branch 'master' into function_factorial 2022-11-15 09:34:43 +08:00
李扬
1de5bb2392
Add function canonicalRand (#43124)
* add function canonicalRand

* add perf test

* revert rand.xml
2022-11-15 00:27:19 +01:00
李扬
ef45889ecb
Add function pmod which return non-negative result based on modulo (#42755)
* add function positive_modulo

* add ducument

* fix type deduction of positive_modulo

* add function positive_modulo

* add ducument

* fix type deduction of positive_modulo

* add notice

* fix typo

* fix typo

* fix bug

* fix ub error

* fix ub error
2022-11-15 00:15:58 +01:00
Roman Vasin
ee0baa679b Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-623 2022-11-14 09:45:32 +00:00
李扬
bf88816da4
Merge branch 'master' into function_factorial 2022-11-14 10:30:41 +08:00
FArthur-cmd
5eebc27d24 improve test 2022-11-12 09:23:49 +00:00
taiyang-li
f58e960a7d update as request 2022-11-10 21:07:44 +08:00
Roman Vasin
753895026f Improve docs and add more queries to 02477_age test 2022-11-10 12:18:29 +00:00
Roman Vasin
31d84d5aed Add doc for age() function 2022-11-10 12:05:53 +00:00
taiyang-li
839de0cd09 add function factorial 2022-11-10 16:03:11 +08:00
zvonand
90e3aed957 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-decdiv 2022-11-09 15:05:31 +03:00
李扬
1728f1e436
Merge branch 'master' into enable_max_splits 2022-11-08 10:15:42 +08:00
DanRoscigno
34f90ff6ef update pages that refer to dictionaries 2022-11-07 09:26:50 -05:00
李扬
70fd664dd1
Merge branch 'master' into ascii_function 2022-11-07 10:30:10 +08:00
Nikolay Degterinsky
fbf891d375
Merge pull request #42774 from alexon1234/add_format_redable_decimal_size
Published formatReadableDecimalSize so it can be used as function
2022-11-05 12:34:20 +03:00
Dan Roscigno
fb43aa3db9
Merge pull request #42939 from DanRoscigno/add-vis-to-cell-towers
Add vis to cell towers
2022-11-04 15:47:13 -04:00
Nikolay Degterinsky
16fc05b734
Merge branch 'master' into add_format_redable_decimal_size 2022-11-04 15:02:01 +03:00
Robert Schulze
6df8f7ef25
Merge pull request #42907 from ClickHouse/cleanup-regexpreplace
Cleanup implementation of regexpReplace(All|One)
2022-11-04 12:49:44 +01:00
李扬
fccf6c037f
Merge branch 'master' into ascii_function 2022-11-03 22:48:55 -05:00
李扬
e65b0f1c2e
Merge branch 'master' into enable_max_splits 2022-11-03 22:47:15 -05:00
Kruglov Pavel
b124875257
Merge branch 'master' into improve-streaming-engines 2022-11-03 13:22:06 +01:00
taiyang-li
0df7e95845 improve doc and uts 2022-11-03 16:12:19 +08:00
Alejandro
62ab271b82 fix docs 2022-11-03 09:04:22 +01:00
Alejandro
4e3f43650a Added function to docs 2022-11-03 09:04:22 +01:00
taiyang-li
5fa0968bd5 reset to original solution 2022-11-03 15:05:23 +08:00
taiyang-li
6770723027 modify as requested 2022-11-03 12:02:31 +08:00
taiyang-li
aeea21e4d7 Merge branch 'master' into ascii_function 2022-11-03 11:13:20 +08:00
Robert Schulze
494d6ca3df
Cleanup implementation of regexpReplace(All|One)
This is a pure refactoring, there are no semantic changes.

Cherry-picked from #42682.
2022-11-02 15:49:53 +00:00
ltrk2
14141c9071 Add support for FixedString input to base64 functions 2022-11-02 08:14:28 -04:00
Dan Roscigno
8d7d1cf682
Merge branch 'ClickHouse:master' into add-vis-to-cell-towers 2022-11-02 07:58:15 -04:00
zvonand
3c46673534 upd docs 2022-11-01 16:40:26 +03:00
zvonand
83fb05e5ca Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-decdiv 2022-11-01 09:03:29 +03:00
Roman Vasin
24a4f4afe7
Merge branch 'master' into ADQM-605 2022-10-30 18:03:07 +03:00
Dan Roscigno
bb15156b1f
Merge branch 'ClickHouse:master' into add-vis-to-cell-towers 2022-10-28 15:58:30 -04:00
Filatenkov Artur
21c024b043
Merge branch 'master' into annoy_cosine 2022-10-28 20:15:53 +03:00
FArthur-cmd
f187d4e1d4 add cosine distance for annoy and fix docs for cosineDistance 2022-10-28 17:03:35 +00:00
avogar
8e13d1f1ec Improve and refactor Kafka/StorageMQ/NATS and data formats 2022-10-28 16:41:10 +00:00
DanRoscigno
1ec10ade5b add link to geo fn, fix index 2022-10-28 09:56:16 -04:00
Roman Vasin
fc16752844 Update docs for FROM_UNIXTIME 2022-10-28 12:56:52 +00:00
taiyang-li
2254bef74a implement function ascii 2022-10-26 14:19:26 +08:00
ltrk2
2c902bbc65
Implement support for different UUID binary formats (#42108)
* Implement support for different UUID binary formats

* Declare error codes that the implementation uses

* Make single-argument constructor explicit

* Modernize parts of the solution

* Make improvements based on review comments

* Declare an error code being used
2022-10-25 21:57:50 +02:00
Robert Schulze
b746224217
Merge pull request #42554 from arenadata/ADQM-604
Add support of Date32 arguments for dateName function
2022-10-22 17:20:10 +02:00
Alexey Milovidov
bc6762d613
Merge pull request #42565 from alexeyerm/other-functions.md-fix
other-functions.md example fix
2022-10-22 04:20:23 +02:00
Alexey Milovidov
592fbb3eaf
Merge pull request #42367 from ClickHouse/revert-40217
Revert #40217
2022-10-21 21:56:15 +02:00
alexeyerm
9abfe76fbb
doc fix fix 2022-10-21 20:08:44 +03:00
alexeyerm
95943dbdda
fix transform() example 2022-10-21 19:44:35 +03:00
Roman Vasin
537f7000d6 Update documentation 2022-10-21 06:55:24 +00:00
zvonand
890b292c88 added docs 2022-10-19 13:55:24 +03:00
Alexey Milovidov
d1f0c80ffe Revert "Merge pull request #40217 from zvonand/zvonand-minmax"
This reverts commit df934d8762, reversing
changes made to d3a7945b1b.
2022-10-17 04:57:15 +02:00
Kruglov Pavel
7980920bd7
Merge branch 'master' into fix-format-row 2022-10-14 20:49:21 +02:00
Roman Vasin
90f9bd24a3 Update documentation 2022-10-14 08:02:38 +00:00
Duc Canh Le
fbb9b3f5ab Merge branch 'master' into ch_canh_fix_decrypt_with_null 2022-10-03 17:56:06 +08:00
Robert Schulze
8e727d4fbc
Merge pull request #41910 from arenadata/ADQM-583
Improve enable_extended_results_for_datetime_functions option to return results of type DateTime64
2022-10-02 20:46:51 +02:00
Alexey Milovidov
0d1d177013
Merge pull request #41131 from JackyWoo/add_function_java_int_hash
Support Java integers hashing in `javaHash`
2022-10-02 18:10:51 +03:00
Duc Canh Le
99bf356220
Merge branch 'master' into ch_canh_fix_decrypt_with_null 2022-10-02 14:35:42 +08:00
Roman Vasin
f716fc2fe5 Put list of functions in correct order in docs; Use new formatting in exception messages. 2022-09-30 07:54:35 +00:00
Roman Vasin
45414b251d Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-583 2022-09-29 17:02:49 +00:00
Roman Vasin
9dfb2d058c Add DateTime64 returing functions in Note box 2022-09-29 14:23:50 +00:00
Robert Schulze
6381631836
Merge pull request #41824 from ClickHouse/tryBase58
Add function tryBase58Decode()
2022-09-29 12:38:58 +02:00
avogar
c353928eb5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-format-row 2022-09-28 13:15:51 +00:00
Duc Canh Le
6fd234d652 fix document typo and format 2022-09-28 20:06:18 +08:00
Robert Schulze
82139fad0e
Docs: Remove obsolete modelEvaluate() mention 2022-09-28 11:47:16 +00:00
Duc Canh Le
170ca26435 add document 2022-09-28 17:55:20 +08:00
Alexey Milovidov
683b7e5e95
Merge branch 'master' into add_function_java_int_hash 2022-09-28 01:30:26 +03:00
Robert Schulze
33891c275e
Fix typo 2022-09-27 10:20:39 +00:00
Robert Schulze
aa7e62ad5f
Add functio ntryBase58Decode()
- makes it consistent with tryBase64Decode(), follow-up to #39292

- additionally the following minor changes:

  - rename Common/base58.h|cpp to Common/Base58.h|cpp for constency with
    Common/Base64.h|cpp

  - check that (encode|decode|tryDecode)Base64() gets just one argument
2022-09-27 10:18:36 +00:00
Kruglov Pavel
57f0dc1f89
Merge branch 'master' into fix-format-row 2022-09-19 14:37:58 +02:00
Robert Schulze
38aecc15a2
Merge pull request #41214 from arenadata/ADQM-528-B
Add enable_extended_results_for_datetime_functions option to return results of type Date32
2022-09-17 19:25:11 +02:00
Robert Schulze
b32b02d844
Merge pull request #40897 from ClickHouse/catboost-bridge-resurrected
Move CatBoost evaluation into clickhouse-library-bridge
2022-09-16 13:12:09 +02:00
Roman Vasin
d82cd7b007 Add many cosmetic changes to C++ code and MD docs 2022-09-16 09:37:30 +00:00
Roman Vasin
5c242de43a Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-528-B 2022-09-15 13:47:51 +00:00
Roman Vasin
3ce66eab83 Correct all needed MD files 2022-09-15 13:28:11 +00:00
JackyWoo
afcbf3a853
Merge branch 'master' into add_function_java_int_hash 2022-09-15 10:08:26 +08:00
JackyWoo
05516bfd03 fix docs 2022-09-15 10:07:39 +08:00
Denny Crane
69d90de9a3
Update date-time-functions.md 2022-09-14 15:23:59 -03:00
Denny Crane
cbdbe1077a
Update date-time-functions.md 2022-09-14 12:16:32 -03:00
JackyWoo
e3caa6f096 some fixes 2022-09-13 21:21:35 +08:00
avogar
6d5f9e5554 Proper implementation for rowFormat function, delete rowFormatNoNewLine function 2022-09-09 17:42:33 +00:00
Denny Crane
132727d212
Doc. Fix links. 2022-09-08 14:37:42 -03:00
Robert Schulze
60f9f6855d
feat: implement catboost in library-bridge
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
2022-09-08 09:01:32 +00:00
Denny Crane
a75eb5ad84
Update date-time-functions.md 2022-09-07 15:59:23 -03:00
Denny Crane
0071ef9e38
Update date-time-functions.md 2022-09-07 15:56:31 -03:00
Kruglov Pavel
582216a3ca
Merge pull request #39919 from pzhdfy/UniqSketch
UniqThetaSketch support set operation such as union/intersect/not
2022-09-05 13:42:14 +02:00
Alexey Milovidov
1963baa11e
Merge pull request #40964 from ClickHouse/fix-docs-formatting
Fix formatting of notes box in documentation
2022-09-04 03:39:39 +03:00
Denny Crane
dd19b0856e
Doc. mapApply, mapFilter, mapUpdate (#40961)
* Update tuple-map-functions.md

* Update tuple-map-functions.md
2022-09-04 00:43:39 +02:00
Robert Schulze
385427ade8
Fix formatting of notes box in documentation
Follow-up to PR #38435
2022-09-03 17:25:14 +00:00
Fangyuan Deng
bc7d661668
Merge branch 'master' into UniqSketch 2022-09-01 19:31:53 +08:00
pzhdfy
acec516271 add docs 2022-09-01 19:31:01 +08:00
Robert Schulze
56eece40ec
Merge pull request #40736 from LevyCory/add-offset-to-formatDateTime
Add timezone offset support  to `formatDateTime`
2022-09-01 09:50:17 +02:00
Robert Schulze
912663b719
Revert "Move CatBoost evaluation into clickhouse-library-bridge" 2022-08-31 20:54:43 +02:00
Robert Schulze
ca01286028
Merge pull request #39629 from ClickHouse/catboost-bridge
Move CatBoost evaluation into clickhouse-library-bridge
2022-08-31 16:16:11 +02:00
Denny Crane
0d7cc82267
Update string-functions.md 2022-08-30 11:08:23 -03:00
Andrey Zvonov
93f9abf130
upd2 2022-08-30 14:41:40 +03:00
Andrey Zvonov
14adea8792
fix error in docs 2022-08-30 14:40:26 +03:00
Cory Levy
1e2eee7146 Remove unnecessary backslashes in markdown sql blocks 2022-08-29 16:31:31 -04:00
Robert Schulze
6b2b3c1eb3
feat: implement catboost in library-bridge
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
2022-08-29 20:26:45 +00:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
Cory Levy
deb2a97020 Add docs 2022-08-28 22:28:34 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
DanRoscigno
db1a3b717c add slugs 2022-08-28 09:58:27 -04:00
DanRoscigno
c4caa35cfd add frontmatter dashes 2022-08-28 09:53:52 -04:00
zvonand
e257f9d0cd update docs, tests + small fixes 2022-08-24 01:09:14 +03:00
zvonand
a9fd733871 updated docs 2022-08-24 01:09:14 +03:00
Andrey Zvonov
f40bd2194f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:42:19 +03:00
Andrey Zvonov
b54a04d48f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:42:01 +03:00
Andrey Zvonov
6c1fa6844f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:41:19 +03:00
Andrey Zvonov
946223df20
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:41:01 +03:00
Andrey Zvonov
e4f00e2f15
Update docs 1
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:40:34 +03:00
zvonand
d789dabc9d Fixed , updated docs 2022-08-22 17:36:56 +03:00
zvonand
963d838647 updated docs 2022-08-22 17:36:56 +03:00
Denny Crane
b6329293a9
Update date-time-functions.md 2022-08-21 16:45:13 -03:00
Denny Crane
c926d04c21
Update date-time-functions.md 2022-08-21 16:42:40 -03:00
Denny Crane
54374e22e6
Update date-time-functions.md 2022-08-19 15:09:40 -03:00
Robert Schulze
24615059fb
Merge pull request #40319 from ClickHouse/custom-error-code-in-throwif
Allow custom error code in throwIf
2022-08-19 09:49:35 +02:00
Robert Schulze
f121941916
feat: allow custom error code for SQL function throwIf() 2022-08-17 21:14:40 +00:00
Stephan
5252d41fdb
Provide missing documentation for arrayWithConstant
Documentation of `arrayWithConstant(l, const)`-function, as this was not part of the documentation so far.
2022-08-17 13:21:03 +02:00
Denny Crane
f574b49825
Update array-join.md 2022-08-15 16:45:07 -03:00
Denny Crane
f3b349fd18
Update array-join.md 2022-08-15 16:42:55 -03:00
Denny Crane
73f51a0f19 doc array-join 2022-08-15 16:40:48 -03:00
Robert Schulze
55ff546322
Fix typo 2022-08-11 20:42:59 +00:00
Dan Roscigno
35ee71a908
Merge pull request #40110 from ClickHouse/fix-docs-for-39287
Fix documentation of "modulo(a, b)"
2022-08-11 16:14:28 -04:00
Robert Schulze
aa42a42e0f
Fix documentation of "modulo(a, b)"
Fixes #39287

ClickHouse uses the same semantics for modulo on floats as Python, i.e.
  4.2 % 2.0 = 0.2
and not as previously documented:
  4.2 % 2.0 --> (drop decimal places) --> 4 % 2 = 0.

Fixed the documentation.
2022-08-11 08:23:43 +00:00
Alexey Milovidov
8374f31306
Merge pull request #39425 from arenadata/ADQM-485
Add support of dates from year 1900 to 2299 for Date32 and DateTime64
2022-08-11 05:01:53 +03:00
Alexey Milovidov
53097b3d65
Merge pull request #40015 from tbragin/master
Add parseDateTime64BestEffortUS* functions
2022-08-10 20:00:50 +03:00
Tanya Bragin
be51187f85 Update tests to use UTC, and docs to consistent order 2022-08-09 17:27:06 -07:00
Robert Schulze
76cc0cdc27
Remove redundancy in documentation of parseDateTimeBestEffortUS[OrNull|OrZero]()
The documentation of functions
- parseDateTimeBestEffortUS(),
- parseDateTimeBestEffortUSOrNull() and
- parseDateTimeBestEffortUSOrZero()
previously repeated the text of functions
- parseDateTimeBestEffort(),
- parseDateTimeBestEffortOrNull() and
- parseDateTimeBestEffortOrZero().

In the docs of the first function, the duplication  was removed and we
now emphasize the difference to the non-US version more clearly.

The docs of the second and third functions were just stripped of the
duplication. Chinese docs did not mention the US-date variants, hence
nothing was changed in them.
2022-08-09 16:54:06 +00:00
Robert Schulze
7c59331e0e
Make examples for function 'parseDateTimeBestEffort()' less ambiguous
"12/12" and "12-12" could be interpreted as MM/DD or DD/MM and therefore
were not great examples.
2022-08-09 08:56:05 +00:00
Tanya Bragin
eb61db3b67 initial changes to close #37492 2022-08-08 19:45:00 -07:00
Anton Popov
f94d4d4877
Merge branch 'master' into hash-functions-map 2022-08-02 13:26:54 +02:00
Anton Popov
2a841d0860 update docs for hash functions 2022-08-01 14:22:40 +00:00
Kruglov Pavel
dfdfabec94
Merge pull request #39218 from evillique/file_default_value
Add default argument to the function `file`
2022-08-01 13:04:19 +02:00
Robert Schulze
b52843d5fd
Merge pull request #37951 from zvonand/dt64_timeslots
Fix timeSlots for DateTime64
2022-07-30 20:49:05 +02:00
Roman Vasin
b462366415 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-485 2022-07-25 17:55:47 +00:00
Alexey Milovidov
6fdcb009ff
Merge pull request #39533 from ClickHouse/now-in-block
Add function `nowInBlock`
2022-07-25 04:22:11 +03:00
Denny Crane
a1a1d357b4
Update string-replace-functions.md 2022-07-24 20:15:48 -03:00
Alexey Milovidov
0492f23d07 Add the docs 2022-07-24 23:11:54 +02:00
Andrey Zvonov
e473606cd1
Merge branch 'master' into zvonand-b58-datatype 2022-07-21 15:55:05 +02:00
Roman Vasin
e3192cf753 Correct docs to reflect new range 1900..2299 for Date32 and DateTime64; Cleanup code 2022-07-20 15:19:02 +00:00
Nikolay Degterinsky
c9ae525da7
Merge branch 'master' into file_default_value 2022-07-20 14:22:58 +02:00
Kruglov Pavel
12221cffc9
Merge pull request #39071 from jiahui-97/parse_timedelta
implementation of parseTimeDelta function
2022-07-19 12:39:56 +02:00
jiahui-97
e7af88b688 implementation of parseTimeDelta function
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
2022-07-19 09:33:02 +08:00
Andrey Zvonov
e0d1954fac
Merge branch 'master' into dt64_timeslots 2022-07-16 22:33:46 +02:00
zvonand
728219e640 updated due to review 2022-07-16 22:16:19 +02:00
zvonand
9ac7e41e07 updated docs 2022-07-16 19:45:33 +02:00
zvonand
d07a652883 merge 2022-07-16 19:05:07 +02:00
zvonand
4ab52b6873 added new DataType + fixes 2022-07-16 18:58:47 +02:00
Xoel Lopez Barata
10625e7c54
Fix typo
Replace "indicies" by "indices"
2022-07-14 17:41:48 +02:00
Vladimir C
b5011b5157
Merge pull request #39169 from FArthur-cmd/add_docs_for_dist_func
Documentation for array's distance functions
2022-07-14 12:36:17 +02:00
Nikolay Degterinsky
9ca2935d72 Add default argument to function file 2022-07-14 09:54:44 +00:00
Nikolay Degterinsky
e3a79520c1 Merge remote-tracking branch 'upstream/master' into translate 2022-07-13 11:42:40 +00:00
FArthur-cmd
411a08630c add docs 2022-07-13 10:29:13 +00:00
Nikolay Degterinsky
185978bfbe Add docs 2022-07-13 01:52:25 +00:00
Andrey Zvonov
7bfe155f09
Merge branch 'master' into dt64_timeslots 2022-07-12 10:26:38 +03:00
Nikolay Degterinsky
5c5c7ae6db Fix typos 2022-07-07 02:17:57 +00:00
DanRoscigno
95c3eff4c7 remove 404ing original article URL 2022-06-30 11:17:38 -04:00
Nikolay Degterinsky
384603a656
Merge pull request #38592 from ClibMouse/PR_38549_updates
Updated Geo Functions Index.md
2022-06-30 03:20:37 +02:00
HeenaBansal2009
6bf9c7cd4d Updated index file for Geo functions 2022-06-29 12:21:05 -07:00
Maksim Kita
c45e9a36bd
Merge pull request #38549 from ClibMouse/Issue_38457
Updated Index file for GeoFunctions
2022-06-29 12:11:43 +02:00
HeenaBansal2009
d5886e4861 Updated Index file for GeoFunctions 2022-06-28 19:24:06 -07:00
Kruglov Pavel
7ec83add46
Merge pull request #38454 from mdonkers/docs-clarify-datetime64-parsing
Docs: clarify processing of DateTime64 values
2022-06-27 15:09:09 +02:00
Miel Donkers
674188bd7f
Docs: clarify processing of DateTime64 values 2022-06-27 12:19:30 +02:00
Andrey Zvonov
c18d09a617
Merge branch 'master' into zvonand-base58 2022-06-24 07:05:49 +03:00
zvonand
a94c40e33a Merge branch 'master' of github.com:ClickHouse/ClickHouse into dt64_timeslots 2022-06-23 17:08:28 +05:00
zvonand
946117ec89 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-base58 2022-06-23 17:04:40 +05:00
zvonand
e33324bd35 fix docs 2022-06-23 16:56:28 +05:00
zvonand
7ae7b1e421 fix wrong docs location 2022-06-22 14:58:39 +05:00
zvonand
a7ff956c83 updated docs 2022-06-22 14:56:37 +05:00
Alexey Milovidov
5855668514 Remove trash 2022-06-22 06:23:35 +02:00
zvonand
9c6b2b9ba0 added docs 2022-06-20 20:10:28 +05:00
Alexey Milovidov
3da495d15e
Merge pull request #37779 from ClickHouse/like_match_utf8
Clarify that match() & like() use UTF-8 for matching
2022-06-18 05:43:52 +03:00
Robert Schulze
ba0761fb6a
More details on matching with Unicode 2022-06-17 15:29:32 +02:00
Robert Schulze
26b3dd2d9e
Fix description 2022-06-17 13:41:58 +02:00
Kruglov Pavel
023e7132fc
Fix 2022-06-16 14:50:35 +02:00
Kruglov Pavel
d14a2d3583
Fix docs about encryption functions 2022-06-16 14:47:15 +02:00
zvonand
fb67b080b9 added docs 2022-06-10 14:30:17 +03:00
Mikhail f. Shiryaev
62f60c1462
Merge branch 'master' into doc-aspell 2022-06-09 11:01:25 +02:00
Maksim Kita
ec7b99e564 ExecutableUserDefinedFunctions added parameters documentation 2022-06-08 16:59:41 +02:00
vdimir
9bd9c3d1d1
Fix some typos in docs 2022-06-08 14:26:02 +02:00
Rich Raposa
567f98b1e4
Merge pull request #37784 from ClickHouse/rfraposa-patch-2
Remove H1 anchor tags from docs
2022-06-02 15:51:28 -06:00
mergify[bot]
2e637df7c6
Merge branch 'master' into like_match_utf8 2022-06-02 17:37:52 +00:00
Maksim Kita
3261134f6d
Merge pull request #37762 from den-crane/patch-13
Doc. Note about Map supported types
2022-06-02 19:26:26 +02:00
Maksim Kita
e8ab3e3395
Update tuple-map-functions.md 2022-06-02 19:25:59 +02:00
Sergei Trifonov
1efd59f0b9
Improve high-order array functions descriptions 2022-06-02 17:16:25 +02:00
rfraposa
869967de41 Remove H1 anchor tags from docs 2022-06-02 04:55:18 -06:00
Robert Schulze
0588142b7e
Clarify that match() & like() assume UTF-8
The previous explanation sentence

  "The regular expression works with the string as if it is a set of bytes."

suggested otherwise and since we don't have separate methods matchUTF8()
and likeUTF8(), it makes sense to clarify.
2022-06-02 11:56:06 +02:00
Denny Crane
320fd567dd
Update tuple-map-functions.md 2022-06-01 15:38:41 -03:00
Denny Crane
608ad73c93
Update tuple-map-functions.md 2022-06-01 15:34:15 -03:00
Sergei Trifonov
2589f78135
Fix misleading arrayFunction description 2022-05-30 10:32:22 +02:00
Maksim Kita
58cd1bd3ec
Merge pull request #36843 from bharatnc/ncb/h3-unidirectionaledges-funcs
add h3 unidirectional edge functions
2022-05-25 22:46:40 +02:00
Alexey Milovidov
3431376d4e
Merge pull request #37396 from MasterOdin/patch-1
Fix docs for regionToTopContinent parameters
2022-05-23 03:09:53 +03:00
Alexey Milovidov
5d43f46908
Update ym-dict-functions.md 2022-05-23 03:09:28 +03:00
Denny Crane
f8e2e0f1b2
Update uuid-functions.md 2022-05-22 20:24:18 -03:00
Denny Crane
5984d9993d
Update uuid-functions.md 2022-05-22 20:17:45 -03:00
Matthew Peveler
4c005e53b6
Update ym-dict-functions.md 2022-05-20 15:54:23 -04:00
Matthew Peveler
91bd0b6f69
Fix docs for regionToTopContinent parameters 2022-05-20 15:52:19 -04:00
Denny Crane
c3c468af86
Update random-functions.md 2022-05-19 21:16:27 -03:00
Bharat Nallan Chakravarthy
c476b8dd92 Merge remote-tracking branch 'upstream/master' into ncb/h3-unidirectionaledges-funcs 2022-05-17 20:10:03 -07:00
Alexander Gololobov
38f291c70d
Merge pull request #37030 from bharatnc/ncb/h3-missing-traversal-funcs
add remaining h3 traversal funcs
2022-05-17 18:19:56 +02:00
rfraposa
044e76d91b Add BLAKE3 hash function 2022-05-11 12:10:16 -06:00
Rich Raposa
34f0d1c5f8
Revert "BLAKE3 hash function documentation" 2022-05-10 13:28:36 -06:00
Rich Raposa
23608b5e53
Merge pull request #36999 from BoloniniD/BLAKE3_docs
BLAKE3 hash function documentation
2022-05-10 13:28:21 -06:00
bharatnc
592de6895c Merge remote-tracking branch 'upstream/master' into ncb/h3-missing-traversal-funcs 2022-05-09 22:41:03 -07:00
ni1l
f1eee40345 Add isIPAddressInRange function example 2022-05-10 00:03:10 +08:00
bharatnc
6fc6acf93b docs for h3HexRing 2022-05-08 22:16:40 -07:00
bharatnc
2721955f49 docs for h3Distance 2022-05-08 22:05:44 -07:00
bharatnc
a6cc23aaed docs for h3Line 2022-05-08 22:05:39 -07:00
BoloniniD
aa21a8925f Fixes 2022-05-07 17:08:40 +03:00
Alexey Milovidov
fd363695dc
Update array-functions.md 2022-05-07 13:48:11 +03:00
Alexey Milovidov
40c049b0c9
Update bit-functions.md 2022-05-07 13:47:15 +03:00
Alexey Milovidov
0cac59a9f9
Update string-functions.md 2022-05-07 13:46:17 +03:00
mergify[bot]
2d1057bc87
Merge branch 'master' into fix-substring-negative-offset-length 2022-05-07 10:30:39 +00:00
BoloniniD
0cf6f66fcf Add BLAKE3 hash docs 2022-05-07 12:08:37 +03:00
bharatnc
01ea1beee5 Merge remote-tracking branch 'upstream/master' into ncb/h3-unidirectionaledges-funcs 2022-05-04 15:55:56 -07:00
Sergei Trifonov
6730ad9799
update docs for time window functions 2022-05-03 19:12:42 +02:00
bharatnc
0491341953 docs for h3GetUnidirectionalEdgeBoundary 2022-05-02 21:53:39 -07:00
bharatnc
680fb0f265 docs for h3GetUnidirectionalEdgesFromHexagon 2022-05-01 22:38:01 -07:00
bharatnc
03db6738bb docs for h3GetIndexesFromUnidirectionalEdge 2022-05-01 21:34:32 -07:00
bharatnc
b5a914ed04 docs for h3GetDestinationIndexFromUnidirectionalEdge 2022-05-01 14:11:53 -07:00
bharatnc
9ec187ef22 docs for h3GetOriginIndexFromUnidirectionalEdge 2022-05-01 13:53:44 -07:00
bharatnc
59e1f252fd docs for h3UnidirectionalEdgeIsValid func 2022-05-01 13:27:48 -07:00
bharatnc
925afc8f19 docs for h3GetUnidirectionalEdge 2022-05-01 11:12:11 -07:00
Rich Raposa
8c3f313671
Merge pull request #36791 from ClickHouse/rfraposa-patch-3
Various docs fixes
2022-04-29 06:09:23 -06:00
rfraposa
e7b7b7ecd3 Various docs fixes 2022-04-29 05:33:51 -06:00
Maksim Kita
fc4f241f01 Fix documentation for executable user defined functions configuration 2022-04-28 18:01:10 +02:00
mergify[bot]
705d5af3a0
Merge branch 'master' into to_start_of_five_minutes 2022-04-24 22:24:24 +00:00
Alexey Milovidov
b06c544256
Merge pull request #36292 from simpl1g/simpl1g/fix-json-value-docs
[DOCS] JSON_VALUE return unquoted string after 21.12
2022-04-25 01:22:22 +03:00
Memo
956d525840 fix conflict 2022-04-22 11:22:50 +08:00
Memo
39aadf0975 replaced toStartOfFiveMinute to toStartOfFiveMinutes 2022-04-22 10:49:59 +08:00
rfraposa
6576fd88c1 EOL fixes 2022-04-19 13:50:45 -06:00
Konstantin Ilchenko
1b8b43af52 [DOCS] JSON_VALUE return unqouted string after 21.12 2022-04-15 13:03:59 +02:00
rfraposa
d9e6f780db Fixed broken links 2022-04-10 23:01:34 -06:00
rfraposa
4da4259c78 Added reference docs to sidebar 2022-04-10 21:27:48 -06:00