thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-18 12:22:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
97,714 Commits 9,330 Branches 1,783 Tags 2.2 GiB
f7edbeba22
Commit Graph

2864 Commits

Author SHA1 Message Date
Alexey Milovidov
0190c56faf
Merge pull request #40770 from den-crane/patch-40 
Doc. Fix cache dictionaries doc.
 2022-08-30 02:19:32 +03:00
Cory Levy
1e2eee7146 Remove unnecessary backslashes in markdown sql blocks 2022-08-29 16:31:31 -04:00
Robert Schulze
64a6aa328e
fix: broken links in documentation (hopefully) 2022-08-29 20:27:06 +00:00
Robert Schulze
6b2b3c1eb3
feat: implement catboost in library-bridge 
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
 2022-08-29 20:26:45 +00:00
Denny Crane
fe0f18f21d
Update external-dicts-dict-layout.md 2022-08-29 15:19:15 -03:00
DanRoscigno
76a3212fc8 replace symlinks 2022-08-29 12:26:17 -04:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
Cory Levy
deb2a97020 Add docs 2022-08-28 22:28:34 -04:00
DanRoscigno
b50fa8b5a9 replace symlinks 2022-08-28 17:34:50 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
DanRoscigno
db1a3b717c add slugs 2022-08-28 09:58:27 -04:00
DanRoscigno
c4caa35cfd add frontmatter dashes 2022-08-28 09:53:52 -04:00
Robert Schulze
df934d8762
Merge pull request #40217 from zvonand/zvonand-minmax 
Fix conversion Date32 / DateTime64 / Date to narrow types
 2022-08-28 09:42:39 +02:00
Dan Roscigno
c9dea66f8d
Merge pull request #38308 from DanRoscigno/38284-add-grouping-function-docs 
38284 add grouping function docs
 2022-08-25 16:03:31 -04:00
DanRoscigno
5847c5cdbd reducing samples 2022-08-25 15:46:48 -04:00
Alexey Milovidov
64b8b8294d
Update grouping_function.md 2022-08-25 22:01:13 +03:00
zvonand
6ad02fd687 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-minmax 2022-08-24 01:12:38 +03:00
zvonand
e257f9d0cd update docs, tests + small fixes 2022-08-24 01:09:14 +03:00
zvonand
a9fd733871 updated docs 2022-08-24 01:09:14 +03:00
Andrey Zvonov
f40bd2194f
Update docs/en/sql-reference/functions/date-time-functions.md 
Co-authored-by: Robert Schulze <robert@clickhouse.com>
 2022-08-23 23:42:19 +03:00
Andrey Zvonov
b54a04d48f
Update docs/en/sql-reference/functions/date-time-functions.md 
Co-authored-by: Robert Schulze <robert@clickhouse.com>
 2022-08-23 23:42:01 +03:00
Andrey Zvonov
6c1fa6844f
Update docs/en/sql-reference/functions/date-time-functions.md 
Co-authored-by: Robert Schulze <robert@clickhouse.com>
 2022-08-23 23:41:19 +03:00
Andrey Zvonov
946223df20
Update docs/en/sql-reference/functions/date-time-functions.md 
Co-authored-by: Robert Schulze <robert@clickhouse.com>
 2022-08-23 23:41:01 +03:00
Andrey Zvonov
e4f00e2f15
Update docs 1 
Co-authored-by: Robert Schulze <robert@clickhouse.com>
 2022-08-23 23:40:34 +03:00
Denny Crane
add65a17e7
Update index.md 2022-08-23 15:02:44 -03:00
Denny Crane
a790725bea
Update index.md 2022-08-23 14:35:33 -03:00
Denny Crane
f93bb53c1f
Update index.md 2022-08-23 14:32:56 -03:00
zvonand
d789dabc9d Fixed , updated docs 2022-08-22 17:36:56 +03:00
zvonand
963d838647 updated docs 2022-08-22 17:36:56 +03:00
Denny Crane
b6329293a9
Update date-time-functions.md 2022-08-21 16:45:13 -03:00
Denny Crane
c926d04c21
Update date-time-functions.md 2022-08-21 16:42:40 -03:00
Alexey Milovidov
34a07a5db0
Update datetime64.md 2022-08-21 17:22:40 +03:00
Denny Crane
54374e22e6
Update date-time-functions.md 2022-08-19 15:09:40 -03:00
Robert Schulze
24615059fb
Merge pull request #40319 from ClickHouse/custom-error-code-in-throwif 
Allow custom error code in throwIf
 2022-08-19 09:49:35 +02:00
Robert Schulze
f121941916
feat: allow custom error code for SQL function throwIf() 2022-08-17 21:14:40 +00:00
Stephan
5252d41fdb
Provide missing documentation for arrayWithConstant 
Documentation of `arrayWithConstant(l, const)`-function, as this was not part of the documentation so far.
 2022-08-17 13:21:03 +02:00
Stephan
9242c2adb4
Add description of {condition}-keyword 
Using the {condition}-keyword for Dictionaries is supported since a few weeks (see https://github.com/ClickHouse/ClickHouse/issues/33746 ). This PR adds a corresponding documentation.
 2022-08-17 11:56:48 +02:00
Denny Crane
f574b49825
Update array-join.md 2022-08-15 16:45:07 -03:00
Denny Crane
f3b349fd18
Update array-join.md 2022-08-15 16:42:55 -03:00
Denny Crane
73f51a0f19 doc array-join 2022-08-15 16:40:48 -03:00
DanRoscigno
d47fa94ded promote to H1 to fix case in title 2022-08-15 13:22:10 -04:00
DanRoscigno
71409f8f67 trying tags with Algolia 2022-08-15 11:08:46 -04:00
DanRoscigno
ced68e9298 add title frontmatter 2022-08-15 09:27:20 -04:00
Robert Schulze
55ff546322
Fix typo 2022-08-11 20:42:59 +00:00
Dan Roscigno
35ee71a908
Merge pull request #40110 from ClickHouse/fix-docs-for-39287 
Fix documentation of "modulo(a, b)"
 2022-08-11 16:14:28 -04:00
Robert Schulze
aa42a42e0f
Fix documentation of "modulo(a, b)" 
Fixes #39287

ClickHouse uses the same semantics for modulo on floats as Python, i.e.
  4.2 % 2.0 = 0.2
and not as previously documented:
  4.2 % 2.0 --> (drop decimal places) --> 4 % 2 = 0.

Fixed the documentation.
 2022-08-11 08:23:43 +00:00
Alexey Milovidov
8374f31306
Merge pull request #39425 from arenadata/ADQM-485 
Add support of dates from year 1900 to 2299 for Date32 and DateTime64
 2022-08-11 05:01:53 +03:00
DanRoscigno
b268e4206a remove indent as it causes codeblock 2022-08-10 20:09:43 -04:00
Alexey Milovidov
53097b3d65
Merge pull request #40015 from tbragin/master 
Add parseDateTime64BestEffortUS* functions
 2022-08-10 20:00:50 +03:00
Tanya Bragin
be51187f85 Update tests to use UTC, and docs to consistent order 2022-08-09 17:27:06 -07:00
Robert Schulze
76cc0cdc27
Remove redundancy in documentation of parseDateTimeBestEffortUS[OrNull|OrZero]() 
The documentation of functions
- parseDateTimeBestEffortUS(),
- parseDateTimeBestEffortUSOrNull() and
- parseDateTimeBestEffortUSOrZero()
previously repeated the text of functions
- parseDateTimeBestEffort(),
- parseDateTimeBestEffortOrNull() and
- parseDateTimeBestEffortOrZero().

In the docs of the first function, the duplication  was removed and we
now emphasize the difference to the non-US version more clearly.

The docs of the second and third functions were just stripped of the
duplication. Chinese docs did not mention the US-date variants, hence
nothing was changed in them.
 2022-08-09 16:54:06 +00:00
Robert Schulze
7c59331e0e
Make examples for function 'parseDateTimeBestEffort()' less ambiguous 
"12/12" and "12-12" could be interpreted as MM/DD or DD/MM and therefore
were not great examples.
 2022-08-09 08:56:05 +00:00
Tanya Bragin
eb61db3b67 initial changes to close #37492 2022-08-08 19:45:00 -07:00
DanRoscigno
51928ebbac add example 2022-08-05 13:23:53 -04:00
Alexey Milovidov
23353c376f
Update docs/en/sql-reference/aggregate-functions/grouping_function.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2022-08-05 07:17:50 +03:00
alesapin
29273d2bc1
Merge pull request #39847 from nityanandagohain/patch-1 
Extra semicolon removed from the TTL example
 2022-08-04 14:48:10 +02:00
Nityananda Gohain
0b82fb7816
Extra semicolon removed from the TTL example 
This PR removes an extra semicolon from the TTL example.
 2022-08-03 12:52:06 +05:30
Anton Popov
f94d4d4877
Merge branch 'master' into hash-functions-map 2022-08-02 13:26:54 +02:00
Anton Popov
2a841d0860 update docs for hash functions 2022-08-01 14:22:40 +00:00
Kruglov Pavel
dfdfabec94
Merge pull request #39218 from evillique/file_default_value 
Add default argument to the function `file`
 2022-08-01 13:04:19 +02:00
Robert Schulze
b52843d5fd
Merge pull request #37951 from zvonand/dt64_timeslots 
Fix timeSlots for DateTime64
 2022-07-30 20:49:05 +02:00
Alexey Milovidov
45d9bb5270
Update grouping_function.md 2022-07-30 05:27:28 +03:00
Alexey Milovidov
1ab7d68a99
Update grouping_function.md 2022-07-30 05:25:57 +03:00
Alexey Milovidov
99ccbd21f6
Update grouping_function.md 2022-07-30 05:25:31 +03:00
Dan Roscigno
d3477e9b94
Merge pull request #38967 from kceventus/patch-2 
Update any.md
 2022-07-27 12:02:18 -04:00
alesapin
2dfb547847
Merge pull request #39054 from SmitaRKulkarni/add-option-for-outfile-to-print-stdout 
Add an option to INTO OUTFILE to also print details to standard output.
 2022-07-27 13:51:38 +02:00
Robert Schulze
7d653b3bd8
Merge pull request #39495 from ClickHouse/mark-qpl-deflate-experimental 
Mark new codec DEFLATE_QPL as experimental + cosmetics
 2022-07-26 19:00:21 +02:00
Dan Roscigno
b9c8feb2b2
Merge pull request #39356 from nickitat/small_addition_to_docs 
Small addition to mysql dictionary docs
 2022-07-26 11:11:28 -04:00
Dan Roscigno
39d6327fe1
Update docs/en/sql-reference/aggregate-functions/reference/any.md 2022-07-26 11:10:16 -04:00
Vladimir C
3bd5ca9b6a
Merge pull request #39271 from vdimir/join-alg-setting 
Cleanup logic around join_algorithm setting, add docs
 2022-07-26 11:00:22 +02:00
Roman Vasin
b462366415 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-485 2022-07-25 17:55:47 +00:00
Alexey Milovidov
6fdcb009ff
Merge pull request #39533 from ClickHouse/now-in-block 
Add function `nowInBlock`
 2022-07-25 04:22:11 +03:00
Denny Crane
a1a1d357b4
Update string-replace-functions.md 2022-07-24 20:15:48 -03:00
Alexey Milovidov
0492f23d07 Add the docs 2022-07-24 23:11:54 +02:00
Robert Schulze
2785783def
Mark DEFLAPT_QPL as 'experimental' codec + cosmetics 2022-07-24 20:10:11 +00:00
Robert Schulze
c788e05c77
Merge pull request #39292 from zvonand/zvonand-b58-datatype 
Simplify Base58 encoding/decoding
 2022-07-24 18:09:40 +02:00
mergify[bot]
0933dd7904
Merge branch 'master' into add-option-for-outfile-to-print-stdout 2022-07-23 19:50:10 +00:00
Kruglov Pavel
f79924f270
Merge branch 'master' into file_default_value 2022-07-22 21:17:37 +02:00
vdimir
e8834c5ea3
Remove trailing whitespaces from docs/en/sql-reference/statements/select/join.md 2022-07-21 14:53:40 +00:00
Andrey Zvonov
e473606cd1
Merge branch 'master' into zvonand-b58-datatype 2022-07-21 15:55:05 +02:00
Roman Vasin
e3192cf753 Correct docs to reflect new range 1900..2299 for Date32 and DateTime64; Cleanup code 2022-07-20 15:19:02 +00:00
DanRoscigno
c411763c2f split the note into two notes 2022-07-20 09:41:00 -04:00
Nikolay Degterinsky
c9ae525da7
Merge branch 'master' into file_default_value 2022-07-20 14:22:58 +02:00
Robert Schulze
4e41cac07a
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-19 18:48:24 +02:00
zvonand
30eb2cbcb3 removed Base58 domain type 2022-07-19 14:03:13 +02:00
Kruglov Pavel
12221cffc9
Merge pull request #39071 from jiahui-97/parse_timedelta 
implementation of parseTimeDelta function
 2022-07-19 12:39:56 +02:00
jasperzhu
c044c67745
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-19 15:32:57 +08:00
jiahui-97
e7af88b688 implementation of parseTimeDelta function 
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
 2022-07-19 09:33:02 +08:00
Nikita Taranov
7f6b175c3e impl 2022-07-18 19:39:10 +02:00
Denny Crane
577978026a
Update partition.md 2022-07-17 21:09:01 -03:00
Andrey Zvonov
e0d1954fac
Merge branch 'master' into dt64_timeslots 2022-07-16 22:33:46 +02:00
zvonand
728219e640 updated due to review 2022-07-16 22:16:19 +02:00
zvonand
9ac7e41e07 updated docs 2022-07-16 19:45:33 +02:00
zvonand
d07a652883 merge 2022-07-16 19:05:07 +02:00
zvonand
4ab52b6873 added new DataType + fixes 2022-07-16 18:58:47 +02:00
jinjunzh
d3d0605c00 add words of caution into documentation 2022-07-15 14:33:51 -04:00
Smita Kulkarni
1dc2187f9c Addressed review comments 
Implementation:
- Added a new buffer ForkWriteBuffer takes a vector of WriteBuffer and writes data to all of them. It uses the buffer of the first element as its buffer and copies data from first buffer to all the other buffers
Testing:
- Updated tests/queries/0_stateless/02346_into_outfile_and_stdout.sh
Documentation:
- Updated the english documentation for SELECT.. INTO OUTFILE with AND STDOUT.
 2022-07-14 22:47:38 +02:00
Xoel Lopez Barata
10625e7c54
Fix typo 
Replace "indicies" by "indices"
 2022-07-14 17:41:48 +02:00
Dan Roscigno
9955b097d4
spelling 2022-07-14 09:00:54 -04:00
Dan Roscigno
564de52f8d
Merge pull request #39205 from DanRoscigno/fix-indent 
fix indent and link on remote table function
 2022-07-14 08:54:22 -04:00