Commit Graph

3166 Commits

Author SHA1 Message Date
Sergei Trifonov
9066e0c3da
Merge pull request #42760 from ClickHouse/serxa-patch-2
Fix anchor links
2022-10-31 12:38:48 +01:00
Roman Vasin
24a4f4afe7
Merge branch 'master' into ADQM-605 2022-10-30 18:03:07 +03:00
Filatenkov Artur
66c179217c
Merge branch 'master' into annoy_cosine 2022-10-29 11:55:20 +03:00
Alexander Gololobov
800e789ac4
Small fix 2022-10-29 09:26:16 +02:00
taofengliu
73a35f1bc4 Merge remote-tracking branch 'upstream/master' into group_by_all 2022-10-29 13:58:27 +08:00
Dan Roscigno
bb15156b1f
Merge branch 'ClickHouse:master' into add-vis-to-cell-towers 2022-10-28 15:58:30 -04:00
Miel Donkers
fb1623a5f8 Add SSL_CERTIFICATE auth method to all places missing 2022-10-28 21:17:59 +02:00
Denny Crane
7fa71d8c04
Update column.md 2022-10-28 16:04:00 -03:00
Denny Crane
e903efda0a
Update column.md 2022-10-28 16:00:37 -03:00
avogar
5412911592 Add documentation for 'format' table function 2022-10-28 17:43:28 +00:00
Filatenkov Artur
21c024b043
Merge branch 'master' into annoy_cosine 2022-10-28 20:15:53 +03:00
FArthur-cmd
f187d4e1d4 add cosine distance for annoy and fix docs for cosineDistance 2022-10-28 17:03:35 +00:00
avogar
8e13d1f1ec Improve and refactor Kafka/StorageMQ/NATS and data formats 2022-10-28 16:41:10 +00:00
UnamedRus
d4c6268806
Fix Polygon dict xml config
Missing  <attribute> tag
2022-10-28 18:47:32 +04:00
Vitalii S
665fcf55aa
Update database.md
Minor text correction
2022-10-28 10:08:04 -04:00
DanRoscigno
1ec10ade5b add link to geo fn, fix index 2022-10-28 09:56:16 -04:00
taofengliu
7d1fbdbfeb Merge remote-tracking branch 'upstream/master' into group_by_all 2022-10-28 21:48:56 +08:00
taofengliu
56ab264ec9 fix 2022-10-28 21:48:48 +08:00
Roman Vasin
fc16752844 Update docs for FROM_UNIXTIME 2022-10-28 12:56:52 +00:00
Sergei Trifonov
acec447526
Fix anchor links 2022-10-28 12:35:18 +02:00
SmitaRKulkarni
e860ecc80c
Merge branch 'master' into 42414_Enable_functions_in_readonly_mode 2022-10-27 08:26:44 +02:00
李扬
24ffaee18c
Merge branch 'master' into ascii_function 2022-10-26 21:43:46 -05:00
Smita Kulkarni
6a8fa2d4a5 Added new field allow_readonly in system.table_functions to allow using table functions in readonly mode.
Implementation:
* Added a new field allow_readonly to table system.table_functions.
* Updated to use new field allow_readonly to allow using table functions in readonly mode.
* Added TableFunctionProperties similar to AggregateFunctionProperties.
* The functions allowed in readonly mode are in this set table_functions_allowed_in_readonly_mode.
Testing:
* Added a test for filesystem tests/queries/0_stateless/02473_functions_in_readonly_mode.sh
Documentation:
* Updated the english documentation for Table Functions.
2022-10-26 18:45:23 +02:00
Dan Roscigno
4bf48bce90
Merge branch 'master' into update-backup-for-s3 2022-10-26 10:38:30 -04:00
李扬
04f8f38580
Merge branch 'master' into ascii_function 2022-10-26 07:29:49 -05:00
SmitaRKulkarni
5df138da82
Merge pull request #42376 from ClickHouse/36316_Support_glob_for_recursive_directory_traversal
Added ** glob support for recursive directory traversal to filesystem…
2022-10-26 11:49:20 +02:00
taiyang-li
2254bef74a implement function ascii 2022-10-26 14:19:26 +08:00
Dan Roscigno
690e4e70ae
Merge branch 'master' into update-backup-for-s3 2022-10-25 21:40:49 -04:00
DanRoscigno
91c3744cfe add backup to S3 endpoint 2022-10-25 21:33:09 -04:00
ltrk2
2c902bbc65
Implement support for different UUID binary formats (#42108)
* Implement support for different UUID binary formats

* Declare error codes that the implementation uses

* Make single-argument constructor explicit

* Modernize parts of the solution

* Make improvements based on review comments

* Declare an error code being used
2022-10-25 21:57:50 +02:00
SmitaRKulkarni
96c8260230
Merge branch 'master' into 36316_Support_glob_for_recursive_directory_traversal 2022-10-24 18:34:19 +02:00
Robert Schulze
b746224217
Merge pull request #42554 from arenadata/ADQM-604
Add support of Date32 arguments for dateName function
2022-10-22 17:20:10 +02:00
taofengliu
46b24380f2 Merge remote-tracking branch 'upstream/master' into group_by_all 2022-10-22 13:57:31 +08:00
Alexey Milovidov
bc6762d613
Merge pull request #42565 from alexeyerm/other-functions.md-fix
other-functions.md example fix
2022-10-22 04:20:23 +02:00
Alexey Milovidov
592fbb3eaf
Merge pull request #42367 from ClickHouse/revert-40217
Revert #40217
2022-10-21 21:56:15 +02:00
Dan Roscigno
440af00c74
Merge pull request #42151 from ClickHouse/remove-misc-statements
Docs: Remove obsolete misc page
2022-10-21 13:48:53 -04:00
alexeyerm
9abfe76fbb
doc fix fix 2022-10-21 20:08:44 +03:00
alexeyerm
95943dbdda
fix transform() example 2022-10-21 19:44:35 +03:00
Robert Schulze
2d448c139c
Merge pull request #42308 from arenadata/ADQM-584
Add support of Date32 arguments for date_diff function
2022-10-21 13:18:44 +02:00
Roman Vasin
537f7000d6 Update documentation 2022-10-21 06:55:24 +00:00
taofengliu
66c0765c8a fix docs 2022-10-20 18:26:11 +08:00
taofengliu
7fe812b480 fix docs 2022-10-20 18:20:40 +08:00
taofengliu
4d5bf0e3b2 avoid extracting the deepest columns 2022-10-20 18:17:40 +08:00
zvonand
890b292c88 added docs 2022-10-19 13:55:24 +03:00
Smita Kulkarni
32fad205f0 Added documentation for file and s3 - 36316 Support ** glob for recursive directory traversal 2022-10-18 14:08:26 +02:00
taofengliu
17be6ab492 docs for GROUP BY ALL 2022-10-18 10:46:38 +08:00
Alexey Milovidov
d1f0c80ffe Revert "Merge pull request #40217 from zvonand/zvonand-minmax"
This reverts commit df934d8762, reversing
changes made to d3a7945b1b.
2022-10-17 04:57:15 +02:00
Kruglov Pavel
7980920bd7
Merge branch 'master' into fix-format-row 2022-10-14 20:49:21 +02:00
Roman Vasin
90f9bd24a3 Update documentation 2022-10-14 08:02:38 +00:00
Alexey Milovidov
9bf5fe728b
Merge pull request #42173 from ClickHouse/remove-temporary-live-view
Remove TEMPORARY LIVE VIEW
2022-10-08 19:05:33 +03:00
Alexey Milovidov
b9159db82f Remove temporary live views 2022-10-08 00:16:36 +02:00
Robert Schulze
3e3c0a7bb6
Docs: Add "TABLE" to CHECK/DESCRIBE statements in sidebar 2022-10-07 14:41:00 +00:00
Robert Schulze
cde0257d11
Docs: Remove obsolete pages
Removes page https://clickhouse.com/docs/en/sql-reference/statements/misc

It indexes "miscellaneous" SQL statements but these are already easily
reachable by the sidebar.
2022-10-07 14:37:22 +00:00
Robert Schulze
e759a64d38
Docs: Redirect links to misc.md
--> https://clickhouse.com/docs/en/sql-reference/statements/misc

This page indexes a bunch of SQL statements but they are easily
reachable by the sidebar already.
2022-10-07 13:22:40 +00:00
Duc Canh Le
a886804cbf Merge branch 'master' into ch_canh_fix_decrypt_with_null 2022-10-04 13:20:29 +08:00
Sergei Trifonov
a2cf5a650e
Merge pull request #41989 from alexey-ivanov-official/fix-cumulative-sum-documentation-bug
Fix "Cumulative sum" example in "Window functions"
2022-10-03 18:19:51 +02:00
Sergei Trifonov
939b9091cc
Merge pull request #42007 from aldy505/master
docs(statements): specify ON CLUSTER clause for CREATE ROLE
2022-10-03 15:13:25 +02:00
Duc Canh Le
fbb9b3f5ab Merge branch 'master' into ch_canh_fix_decrypt_with_null 2022-10-03 17:56:06 +08:00
Robert Schulze
8e727d4fbc
Merge pull request #41910 from arenadata/ADQM-583
Improve enable_extended_results_for_datetime_functions option to return results of type DateTime64
2022-10-02 20:46:51 +02:00
Alexey Milovidov
0d1d177013
Merge pull request #41131 from JackyWoo/add_function_java_int_hash
Support Java integers hashing in `javaHash`
2022-10-02 18:10:51 +03:00
Duc Canh Le
99bf356220
Merge branch 'master' into ch_canh_fix_decrypt_with_null 2022-10-02 14:35:42 +08:00
Reinaldy Rafli
b52d58dcae
docs(statements): specify ON CLUSTER clause for CREATE ROLE 2022-10-02 09:51:17 +07:00
Alexey Ivanov
5e290da99b
Fix "Cumulative sum" example in "Window functions"
Fixes a problem in "Cumulative sum" example in "Window functions" documentation, 
when CREATE TABLE part of example was not match to SQL examples.

see: https://clickhouse.com/docs/en/sql-reference/window-functions/#cumulative-sum
2022-10-01 17:49:20 +03:00
Roman Vasin
f716fc2fe5 Put list of functions in correct order in docs; Use new formatting in exception messages. 2022-09-30 07:54:35 +00:00
Roman Vasin
45414b251d Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-583 2022-09-29 17:02:49 +00:00
Roman Vasin
9dfb2d058c Add DateTime64 returing functions in Note box 2022-09-29 14:23:50 +00:00
Robert Schulze
6381631836
Merge pull request #41824 from ClickHouse/tryBase58
Add function tryBase58Decode()
2022-09-29 12:38:58 +02:00
Robert Schulze
6379cb41ce
Merge branch 'master' into fix-links 2022-09-29 09:17:39 +02:00
avogar
c353928eb5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-format-row 2022-09-28 13:15:51 +00:00
Robert Schulze
fa93952231
Docs: Reference external papers as DOIs
See also #31076 which noted that links were broken but didn't fix.
2022-09-28 12:21:58 +00:00
Duc Canh Le
6fd234d652 fix document typo and format 2022-09-28 20:06:18 +08:00
Robert Schulze
82139fad0e
Docs: Remove obsolete modelEvaluate() mention 2022-09-28 11:47:16 +00:00
Duc Canh Le
170ca26435 add document 2022-09-28 17:55:20 +08:00
Alexey Milovidov
683b7e5e95
Merge branch 'master' into add_function_java_int_hash 2022-09-28 01:30:26 +03:00
Dan Roscigno
4f23f6ef25
fix other links
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2022-09-27 14:07:35 -04:00
DanRoscigno
4be153cbd3 fix link from intro 2022-09-27 10:21:35 -04:00
Robert Schulze
33891c275e
Fix typo 2022-09-27 10:20:39 +00:00
Robert Schulze
aa7e62ad5f
Add functio ntryBase58Decode()
- makes it consistent with tryBase64Decode(), follow-up to #39292

- additionally the following minor changes:

  - rename Common/base58.h|cpp to Common/Base58.h|cpp for constency with
    Common/Base64.h|cpp

  - check that (encode|decode|tryDecode)Base64() gets just one argument
2022-09-27 10:18:36 +00:00
Kseniia Sumarokova
5caac39328
Merge pull request #41508 from kssenii/rename-some-cache-commands
Rename: `show caches` -> `show filesystem caches`, `describe cache` -> `describe filesystem cache`
2022-09-22 13:09:14 +02:00
Kruglov Pavel
55d7addcfe
Merge branch 'master' into fix-format-row 2022-09-22 12:32:58 +02:00
Alexey Milovidov
bca4cc98c3
Merge pull request #41595 from Algunenano/fix_variadic_reading_random_data
Do not process rows in aggregations if any of the parameters is NULL
2022-09-22 07:57:37 +03:00
Denny Crane
a59f7a3aa9
Update tuple.md 2022-09-21 13:00:46 -03:00
Raúl Marín
fd503b34d9 Remove any processing of undelying values for NULLs 2022-09-20 18:43:21 +02:00
avogar
90e0f98d45 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-format-row 2022-09-20 13:55:44 +00:00
kssenii
b8079e4577 Merge remote-tracking branch 'upstream/master' into rename-some-cache-commands 2022-09-20 13:02:18 +02:00
kssenii
6dcbeceeb9 Update doc 2022-09-20 13:00:10 +02:00
Kruglov Pavel
57f0dc1f89
Merge branch 'master' into fix-format-row 2022-09-19 14:37:58 +02:00
Sergei Trifonov
f7a1ed3141
Merge branch 'master' into readonly-settings-allow 2022-09-19 12:52:36 +02:00
Alexey Milovidov
2e5fa7880e
Update geo.md 2022-09-19 07:52:24 +03:00
Kruglov Pavel
519bcbb3be
Merge pull request #41236 from Avogar/fix-totals-extremes
Don't output totals/extremes in all row formats, update docs
2022-09-18 14:55:07 +02:00
Robert Schulze
38aecc15a2
Merge pull request #41214 from arenadata/ADQM-528-B
Add enable_extended_results_for_datetime_functions option to return results of type Date32
2022-09-17 19:25:11 +02:00
DanRoscigno
149970447a add link to formats 2022-09-16 17:21:03 -04:00
Kruglov Pavel
2d4a6b38af
Merge branch 'master' into fix-totals-extremes 2022-09-16 15:03:59 +02:00
Robert Schulze
b32b02d844
Merge pull request #40897 from ClickHouse/catboost-bridge-resurrected
Move CatBoost evaluation into clickhouse-library-bridge
2022-09-16 13:12:09 +02:00
Roman Vasin
d82cd7b007 Add many cosmetic changes to C++ code and MD docs 2022-09-16 09:37:30 +00:00
Roman Vasin
5c242de43a Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-528-B 2022-09-15 13:47:51 +00:00
Roman Vasin
3ce66eab83 Correct all needed MD files 2022-09-15 13:28:11 +00:00
Kseniia Sumarokova
c511c3f168
Merge pull request #40889 from AVMusorin/docs_table_function_update
Doc. Updated optional parameters for table functions
2022-09-15 13:12:20 +02:00
JackyWoo
afcbf3a853
Merge branch 'master' into add_function_java_int_hash 2022-09-15 10:08:26 +08:00
JackyWoo
05516bfd03 fix docs 2022-09-15 10:07:39 +08:00
Denny Crane
69d90de9a3
Update date-time-functions.md 2022-09-14 15:23:59 -03:00
Denny Crane
cbdbe1077a
Update date-time-functions.md 2022-09-14 12:16:32 -03:00
JackyWoo
9578594439
Merge branch 'master' into add_function_java_int_hash 2022-09-14 20:42:41 +08:00
Robert Schulze
cb04c724b9
Merge pull request #41285 from ClickHouse/fix-broken-doc-links
System statements docs: Fix broken links
2022-09-14 13:03:01 +02:00
JackyWoo
2c8e5f0156 Merge branch 'master' into add_function_java_int_hash 2022-09-14 10:11:15 +08:00
Robert Schulze
49136d26aa
docs: fix internal links
The links at the very beginning of
https://clickhouse.com/docs/en/sql-reference/statements/system
don't work. They are reference other sections of the same document. This
is weird because there is a small index already on the right side. I
searched our documentation and this seems to be the only pages which do
so. Therefore removing the links altogether instead of fixing them.
2022-09-13 19:45:46 +00:00
Dan Roscigno
078b9bff3c
Update docs/en/sql-reference/statements/delete.md 2022-09-13 13:18:01 -04:00
Rich Raposa
b833c39dcf
Update delete.md 2022-09-13 10:55:26 -06:00
Rich Raposa
e85b222136
Update delete.md 2022-09-13 10:54:47 -06:00
DanRoscigno
64bd1ea77a spelling 2022-09-13 12:42:24 -04:00
DanRoscigno
fc2e7159f0 add note about privs 2022-09-13 12:40:16 -04:00
Robert Schulze
3e6821e8d7
fix: repair broken documentation links and update docs 2022-09-13 16:00:53 +00:00
JackyWoo
e3caa6f096 some fixes 2022-09-13 21:21:35 +08:00
Kruglov Pavel
3f4e998802
Merge branch 'master' into fix-format-row 2022-09-13 14:37:10 +02:00
Kruglov Pavel
17621b5607
Merge branch 'master' into fix-totals-extremes 2022-09-13 14:36:31 +02:00
Robert Schulze
fac1be9700
chore: restore SYSTEM RELOAD MODEL(S) and moniting view SYSTEM.MODELS
- This commit restores statements "SYSTEM RELOAD MODEL(S)" which provide
  a mechanism to update a model explicitly. It also saves potentially
  unnecessary reloads of a model from disk after it's initial load.

  To keep the complexity low, the semantics of "SYSTEM RELOAD MODEL(S)
  was changed from eager to lazy. This means that both statements
  previously immedately reloaded the specified/all models, whereas now
  the statements only trigger an unload and the first call to
  catboostEvaluate() does the actual load.

- Monitoring view SYSTEM.MODELS is also restored but with some obsolete
  fields removed. The view was not documented in the past and for now it
  remains undocumented. The commit is thus not considered a breach of
  ClickHouse's public interface.
2022-09-12 19:33:02 +00:00
avogar
8ac2fc7b26 Don't outout totals/extremes in all row formats, update docs 2022-09-12 17:21:40 +00:00
Sergei Trifonov
fe88a7991d
Merge branch 'master' into readonly-settings-allow 2022-09-12 16:20:40 +02:00
Rich Raposa
b9e9d776f0
Update delete.md 2022-09-09 15:55:57 -06:00
rfraposa
4af246a2e0 Feedback 2022-09-09 13:59:21 -06:00
Aleksandr
503398ac96
Merge branch 'master' into docs_table_function_update 2022-09-09 20:54:28 +02:00
Rich Raposa
9870957621
Update docs/en/sql-reference/statements/delete.md
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
2022-09-09 12:16:54 -06:00
Rich Raposa
50789126a8
Update docs/en/sql-reference/statements/delete.md
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
2022-09-09 12:15:59 -06:00
Rich Raposa
34c2c4bb52
Merge branch 'master' into lightweight-delete 2022-09-09 12:13:51 -06:00
Nikolay Degterinsky
6dcaa9f14d
Merge pull request #41106 from vincentbernat/fix/docs-sync
docs: mention SYNC modifier for DROP and DETACH statements
2022-09-09 20:12:47 +02:00
avogar
6d5f9e5554 Proper implementation for rowFormat function, delete rowFormatNoNewLine function 2022-09-09 17:42:33 +00:00
Sergei Trifonov
76eb001e78 add test for changeable_in_readonly + fix SQL in docs 2022-09-09 14:01:29 +02:00
rfraposa
18f5b5e5b0 Add docs for lightweight deletes 2022-09-08 16:05:56 -06:00
Denny Crane
132727d212
Doc. Fix links. 2022-09-08 14:37:42 -03:00
Vincent Bernat
fab1b40928 docs: mention SYNC modifier for DROP and DETACH statements 2022-09-08 15:21:59 +02:00
Robert Schulze
c16707ff00
chore: delete obsolete modelEvaluate() function + SYSTEM.MODELS view
- The deleted function modelEvaluate() was superseded by
  catboostEvaluate().

- Also delete the external model repository, as modelEvaluate() was it's
  last user. Additionally remove the system view SYSTEM.MODELS for
  inspecting the repository.

- SYSTEM RELOAD MODELS is also obsolete. HOWEVER, it was retained and
  made a no-op instead of deleted.

  Why?
  The reason is that RBAC in distributed setups works by storing
  privileges (granted and revoked) as plain SQL statements in Keeper.
  Nodes read these statements at startup and parse them. If a privilege
  for SYSTEM RELOAD MODELS exists but parser doesn't recognize it
  nodes would fail to come up.

  Considered but rejected alternatives:
  - Ignore SYSTEM RELOAD MODELS during parsing RBAC privileges and
    return an error for regular SYSTEM RELOAD MODELS SQL. Special-case
    of no-op behavior, too brittle.
  - Remove SYSTEM RELOAD MODELS manually from Keeper via command-line
    manipulation of Keeper nodes or via SQL by dropping the privileges.
    Needs user intervention during upgrade.
2022-09-08 09:10:11 +00:00
Robert Schulze
60f9f6855d
feat: implement catboost in library-bridge
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
2022-09-08 09:01:32 +00:00
Denny Crane
a75eb5ad84
Update date-time-functions.md 2022-09-07 15:59:23 -03:00
Denny Crane
0071ef9e38
Update date-time-functions.md 2022-09-07 15:56:31 -03:00
Kruglov Pavel
582216a3ca
Merge pull request #39919 from pzhdfy/UniqSketch
UniqThetaSketch support set operation such as union/intersect/not
2022-09-05 13:42:14 +02:00
Alexey Milovidov
deeaea004d
Merge pull request #40295 from cyber-moon/patch-1
Add description of {condition}-keyword
2022-09-04 04:57:30 +03:00
Alexey Milovidov
1963baa11e
Merge pull request #40964 from ClickHouse/fix-docs-formatting
Fix formatting of notes box in documentation
2022-09-04 03:39:39 +03:00
Denny Crane
dd19b0856e
Doc. mapApply, mapFilter, mapUpdate (#40961)
* Update tuple-map-functions.md

* Update tuple-map-functions.md
2022-09-04 00:43:39 +02:00
Robert Schulze
385427ade8
Fix formatting of notes box in documentation
Follow-up to PR #38435
2022-09-03 17:25:14 +00:00
Robert Schulze
53836bbeeb
Fix typo
The system view is called 'role*_*grants', documented on page
'role*-*grants.md'.
2022-09-02 12:49:50 +00:00
Александр
97e55ca2f5
Merge branch 'master' into docs_table_function_update 2022-09-01 14:01:32 +02:00
Fangyuan Deng
bc7d661668
Merge branch 'master' into UniqSketch 2022-09-01 19:31:53 +08:00
Denny Crane
e3af5a7a11
Doc. Added ON CLUSTER cluster in couple places (#40874) 2022-09-01 13:31:22 +02:00
pzhdfy
acec516271 add docs 2022-09-01 19:31:01 +08:00
Aleksandr Musorin
310e1484f6
docs - updated optional parameters for table functions 2022-09-01 13:28:56 +02:00
Robert Schulze
56eece40ec
Merge pull request #40736 from LevyCory/add-offset-to-formatDateTime
Add timezone offset support  to `formatDateTime`
2022-09-01 09:50:17 +02:00
Robert Schulze
912663b719
Revert "Move CatBoost evaluation into clickhouse-library-bridge" 2022-08-31 20:54:43 +02:00
Robert Schulze
ca01286028
Merge pull request #39629 from ClickHouse/catboost-bridge
Move CatBoost evaluation into clickhouse-library-bridge
2022-08-31 16:16:11 +02:00
Robert Schulze
40468d3304
Fix typo in docs 2022-08-30 20:45:31 +00:00
Denny Crane
0d7cc82267
Update string-functions.md 2022-08-30 11:08:23 -03:00
Andrey Zvonov
93f9abf130
upd2 2022-08-30 14:41:40 +03:00
Andrey Zvonov
14adea8792
fix error in docs 2022-08-30 14:40:26 +03:00
Alexey Milovidov
0190c56faf
Merge pull request #40770 from den-crane/patch-40
Doc. Fix cache dictionaries doc.
2022-08-30 02:19:32 +03:00
Cory Levy
1e2eee7146 Remove unnecessary backslashes in markdown sql blocks 2022-08-29 16:31:31 -04:00
Robert Schulze
64a6aa328e
fix: broken links in documentation (hopefully) 2022-08-29 20:27:06 +00:00
Robert Schulze
6b2b3c1eb3
feat: implement catboost in library-bridge
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
2022-08-29 20:26:45 +00:00
Denny Crane
fe0f18f21d
Update external-dicts-dict-layout.md 2022-08-29 15:19:15 -03:00
DanRoscigno
76a3212fc8 replace symlinks 2022-08-29 12:26:17 -04:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
Cory Levy
deb2a97020 Add docs 2022-08-28 22:28:34 -04:00
DanRoscigno
b50fa8b5a9 replace symlinks 2022-08-28 17:34:50 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
DanRoscigno
db1a3b717c add slugs 2022-08-28 09:58:27 -04:00
DanRoscigno
c4caa35cfd add frontmatter dashes 2022-08-28 09:53:52 -04:00
Robert Schulze
df934d8762
Merge pull request #40217 from zvonand/zvonand-minmax
Fix conversion Date32 / DateTime64 / Date to narrow types
2022-08-28 09:42:39 +02:00
Dan Roscigno
c9dea66f8d
Merge pull request #38308 from DanRoscigno/38284-add-grouping-function-docs
38284 add grouping function docs
2022-08-25 16:03:31 -04:00
DanRoscigno
5847c5cdbd reducing samples 2022-08-25 15:46:48 -04:00
Alexey Milovidov
64b8b8294d
Update grouping_function.md 2022-08-25 22:01:13 +03:00
zvonand
6ad02fd687 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-minmax 2022-08-24 01:12:38 +03:00
zvonand
e257f9d0cd update docs, tests + small fixes 2022-08-24 01:09:14 +03:00
zvonand
a9fd733871 updated docs 2022-08-24 01:09:14 +03:00
Andrey Zvonov
f40bd2194f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:42:19 +03:00
Andrey Zvonov
b54a04d48f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:42:01 +03:00
Andrey Zvonov
6c1fa6844f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:41:19 +03:00
Andrey Zvonov
946223df20
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:41:01 +03:00
Andrey Zvonov
e4f00e2f15
Update docs 1
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:40:34 +03:00
Denny Crane
add65a17e7
Update index.md 2022-08-23 15:02:44 -03:00
Denny Crane
a790725bea
Update index.md 2022-08-23 14:35:33 -03:00
Denny Crane
f93bb53c1f
Update index.md 2022-08-23 14:32:56 -03:00
zvonand
d789dabc9d Fixed , updated docs 2022-08-22 17:36:56 +03:00
zvonand
963d838647 updated docs 2022-08-22 17:36:56 +03:00
Denny Crane
b6329293a9
Update date-time-functions.md 2022-08-21 16:45:13 -03:00
Denny Crane
c926d04c21
Update date-time-functions.md 2022-08-21 16:42:40 -03:00
Alexey Milovidov
34a07a5db0
Update datetime64.md 2022-08-21 17:22:40 +03:00
Denny Crane
54374e22e6
Update date-time-functions.md 2022-08-19 15:09:40 -03:00
Robert Schulze
24615059fb
Merge pull request #40319 from ClickHouse/custom-error-code-in-throwif
Allow custom error code in throwIf
2022-08-19 09:49:35 +02:00
Robert Schulze
f121941916
feat: allow custom error code for SQL function throwIf() 2022-08-17 21:14:40 +00:00
Stephan
5252d41fdb
Provide missing documentation for arrayWithConstant
Documentation of `arrayWithConstant(l, const)`-function, as this was not part of the documentation so far.
2022-08-17 13:21:03 +02:00
Stephan
9242c2adb4
Add description of {condition}-keyword
Using the {condition}-keyword for Dictionaries is supported since a few weeks (see https://github.com/ClickHouse/ClickHouse/issues/33746 ). This PR adds a corresponding documentation.
2022-08-17 11:56:48 +02:00
Denny Crane
f574b49825
Update array-join.md 2022-08-15 16:45:07 -03:00
Denny Crane
f3b349fd18
Update array-join.md 2022-08-15 16:42:55 -03:00
Denny Crane
73f51a0f19 doc array-join 2022-08-15 16:40:48 -03:00
DanRoscigno
d47fa94ded promote to H1 to fix case in title 2022-08-15 13:22:10 -04:00
DanRoscigno
71409f8f67 trying tags with Algolia 2022-08-15 11:08:46 -04:00
DanRoscigno
ced68e9298 add title frontmatter 2022-08-15 09:27:20 -04:00
Robert Schulze
55ff546322
Fix typo 2022-08-11 20:42:59 +00:00
Dan Roscigno
35ee71a908
Merge pull request #40110 from ClickHouse/fix-docs-for-39287
Fix documentation of "modulo(a, b)"
2022-08-11 16:14:28 -04:00
Robert Schulze
aa42a42e0f
Fix documentation of "modulo(a, b)"
Fixes #39287

ClickHouse uses the same semantics for modulo on floats as Python, i.e.
  4.2 % 2.0 = 0.2
and not as previously documented:
  4.2 % 2.0 --> (drop decimal places) --> 4 % 2 = 0.

Fixed the documentation.
2022-08-11 08:23:43 +00:00
Alexey Milovidov
8374f31306
Merge pull request #39425 from arenadata/ADQM-485
Add support of dates from year 1900 to 2299 for Date32 and DateTime64
2022-08-11 05:01:53 +03:00
DanRoscigno
b268e4206a remove indent as it causes codeblock 2022-08-10 20:09:43 -04:00
Alexey Milovidov
53097b3d65
Merge pull request #40015 from tbragin/master
Add parseDateTime64BestEffortUS* functions
2022-08-10 20:00:50 +03:00
Tanya Bragin
be51187f85 Update tests to use UTC, and docs to consistent order 2022-08-09 17:27:06 -07:00
Robert Schulze
76cc0cdc27
Remove redundancy in documentation of parseDateTimeBestEffortUS[OrNull|OrZero]()
The documentation of functions
- parseDateTimeBestEffortUS(),
- parseDateTimeBestEffortUSOrNull() and
- parseDateTimeBestEffortUSOrZero()
previously repeated the text of functions
- parseDateTimeBestEffort(),
- parseDateTimeBestEffortOrNull() and
- parseDateTimeBestEffortOrZero().

In the docs of the first function, the duplication  was removed and we
now emphasize the difference to the non-US version more clearly.

The docs of the second and third functions were just stripped of the
duplication. Chinese docs did not mention the US-date variants, hence
nothing was changed in them.
2022-08-09 16:54:06 +00:00
Robert Schulze
7c59331e0e
Make examples for function 'parseDateTimeBestEffort()' less ambiguous
"12/12" and "12-12" could be interpreted as MM/DD or DD/MM and therefore
were not great examples.
2022-08-09 08:56:05 +00:00
Tanya Bragin
eb61db3b67 initial changes to close #37492 2022-08-08 19:45:00 -07:00
DanRoscigno
51928ebbac add example 2022-08-05 13:23:53 -04:00
Alexey Milovidov
23353c376f
Update docs/en/sql-reference/aggregate-functions/grouping_function.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-08-05 07:17:50 +03:00
alesapin
29273d2bc1
Merge pull request #39847 from nityanandagohain/patch-1
Extra semicolon removed from the TTL example
2022-08-04 14:48:10 +02:00
Nityananda Gohain
0b82fb7816
Extra semicolon removed from the TTL example
This PR removes an extra semicolon from the TTL example.
2022-08-03 12:52:06 +05:30
Anton Popov
f94d4d4877
Merge branch 'master' into hash-functions-map 2022-08-02 13:26:54 +02:00
Anton Popov
2a841d0860 update docs for hash functions 2022-08-01 14:22:40 +00:00
Kruglov Pavel
dfdfabec94
Merge pull request #39218 from evillique/file_default_value
Add default argument to the function `file`
2022-08-01 13:04:19 +02:00
Robert Schulze
b52843d5fd
Merge pull request #37951 from zvonand/dt64_timeslots
Fix timeSlots for DateTime64
2022-07-30 20:49:05 +02:00
Alexey Milovidov
45d9bb5270
Update grouping_function.md 2022-07-30 05:27:28 +03:00
Alexey Milovidov
1ab7d68a99
Update grouping_function.md 2022-07-30 05:25:57 +03:00
Alexey Milovidov
99ccbd21f6
Update grouping_function.md 2022-07-30 05:25:31 +03:00
Dan Roscigno
d3477e9b94
Merge pull request #38967 from kceventus/patch-2
Update any.md
2022-07-27 12:02:18 -04:00
alesapin
2dfb547847
Merge pull request #39054 from SmitaRKulkarni/add-option-for-outfile-to-print-stdout
Add an option to INTO OUTFILE to also print details to standard output.
2022-07-27 13:51:38 +02:00
Robert Schulze
7d653b3bd8
Merge pull request #39495 from ClickHouse/mark-qpl-deflate-experimental
Mark new codec DEFLATE_QPL as experimental + cosmetics
2022-07-26 19:00:21 +02:00
Dan Roscigno
b9c8feb2b2
Merge pull request #39356 from nickitat/small_addition_to_docs
Small addition to mysql dictionary docs
2022-07-26 11:11:28 -04:00
Dan Roscigno
39d6327fe1
Update docs/en/sql-reference/aggregate-functions/reference/any.md 2022-07-26 11:10:16 -04:00
Vladimir C
3bd5ca9b6a
Merge pull request #39271 from vdimir/join-alg-setting
Cleanup logic around join_algorithm setting, add docs
2022-07-26 11:00:22 +02:00
Roman Vasin
b462366415 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-485 2022-07-25 17:55:47 +00:00
Alexey Milovidov
6fdcb009ff
Merge pull request #39533 from ClickHouse/now-in-block
Add function `nowInBlock`
2022-07-25 04:22:11 +03:00
Denny Crane
a1a1d357b4
Update string-replace-functions.md 2022-07-24 20:15:48 -03:00
Alexey Milovidov
0492f23d07 Add the docs 2022-07-24 23:11:54 +02:00
Robert Schulze
2785783def
Mark DEFLAPT_QPL as 'experimental' codec + cosmetics 2022-07-24 20:10:11 +00:00
Robert Schulze
c788e05c77
Merge pull request #39292 from zvonand/zvonand-b58-datatype
Simplify Base58 encoding/decoding
2022-07-24 18:09:40 +02:00
mergify[bot]
0933dd7904
Merge branch 'master' into add-option-for-outfile-to-print-stdout 2022-07-23 19:50:10 +00:00
Kruglov Pavel
f79924f270
Merge branch 'master' into file_default_value 2022-07-22 21:17:37 +02:00
vdimir
e8834c5ea3
Remove trailing whitespaces from docs/en/sql-reference/statements/select/join.md 2022-07-21 14:53:40 +00:00
Andrey Zvonov
e473606cd1
Merge branch 'master' into zvonand-b58-datatype 2022-07-21 15:55:05 +02:00
Roman Vasin
e3192cf753 Correct docs to reflect new range 1900..2299 for Date32 and DateTime64; Cleanup code 2022-07-20 15:19:02 +00:00
DanRoscigno
c411763c2f split the note into two notes 2022-07-20 09:41:00 -04:00
Nikolay Degterinsky
c9ae525da7
Merge branch 'master' into file_default_value 2022-07-20 14:22:58 +02:00
Robert Schulze
4e41cac07a
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-19 18:48:24 +02:00
zvonand
30eb2cbcb3 removed Base58 domain type 2022-07-19 14:03:13 +02:00
Kruglov Pavel
12221cffc9
Merge pull request #39071 from jiahui-97/parse_timedelta
implementation of parseTimeDelta function
2022-07-19 12:39:56 +02:00
jasperzhu
c044c67745
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-19 15:32:57 +08:00
jiahui-97
e7af88b688 implementation of parseTimeDelta function
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
2022-07-19 09:33:02 +08:00
Nikita Taranov
7f6b175c3e impl 2022-07-18 19:39:10 +02:00
Denny Crane
577978026a
Update partition.md 2022-07-17 21:09:01 -03:00
Andrey Zvonov
e0d1954fac
Merge branch 'master' into dt64_timeslots 2022-07-16 22:33:46 +02:00
zvonand
728219e640 updated due to review 2022-07-16 22:16:19 +02:00
zvonand
9ac7e41e07 updated docs 2022-07-16 19:45:33 +02:00
zvonand
d07a652883 merge 2022-07-16 19:05:07 +02:00
zvonand
4ab52b6873 added new DataType + fixes 2022-07-16 18:58:47 +02:00
jinjunzh
d3d0605c00 add words of caution into documentation 2022-07-15 14:33:51 -04:00
Smita Kulkarni
1dc2187f9c Addressed review comments
Implementation:
- Added a new buffer ForkWriteBuffer takes a vector of WriteBuffer and writes data to all of them. It uses the buffer of the first element as its buffer and copies data from first buffer to all the other buffers
Testing:
- Updated tests/queries/0_stateless/02346_into_outfile_and_stdout.sh
Documentation:
- Updated the english documentation for SELECT.. INTO OUTFILE with AND STDOUT.
2022-07-14 22:47:38 +02:00
Xoel Lopez Barata
10625e7c54
Fix typo
Replace "indicies" by "indices"
2022-07-14 17:41:48 +02:00