Commit Graph

12044 Commits

Author SHA1 Message Date
DanRoscigno
3e9225aafa move title to frontmatter, remove orig article link 2022-09-01 12:24:03 -04:00
Ivan Blinkov
a947487afe
[docs] fix link markdown 2022-09-01 18:16:13 +03:00
Dan Roscigno
29ac78a92b
Update uk price paid (#40828) 2022-09-01 13:32:33 +02:00
Fangyuan Deng
bc7d661668
Merge branch 'master' into UniqSketch 2022-09-01 19:31:53 +08:00
Denny Crane
e3af5a7a11
Doc. Added ON CLUSTER cluster in couple places (#40874) 2022-09-01 13:31:22 +02:00
pzhdfy
acec516271 add docs 2022-09-01 19:31:01 +08:00
Robert Schulze
56eece40ec
Merge pull request #40736 from LevyCory/add-offset-to-formatDateTime
Add timezone offset support  to `formatDateTime`
2022-09-01 09:50:17 +02:00
Robert Schulze
912663b719
Revert "Move CatBoost evaluation into clickhouse-library-bridge" 2022-08-31 20:54:43 +02:00
robot-clickhouse
5309831a1a Update version_date.tsv and changelogs after v22.8.4.7-lts 2022-08-31 14:32:54 +00:00
Robert Schulze
ca01286028
Merge pull request #39629 from ClickHouse/catboost-bridge
Move CatBoost evaluation into clickhouse-library-bridge
2022-08-31 16:16:11 +02:00
DanRoscigno
50f9b12af8 review feedback 2022-08-31 09:12:48 -04:00
Dan Roscigno
ddac1b3f11
Merge pull request #40560 from DanRoscigno/add-backup
Add backup restore docs
2022-08-31 08:19:00 -04:00
Robert Schulze
40468d3304
Fix typo in docs 2022-08-30 20:45:31 +00:00
Denny Crane
0d7cc82267
Update string-functions.md 2022-08-30 11:08:23 -03:00
DanRoscigno
f72b341e8b add status info 2022-08-30 09:34:08 -04:00
Alexander Tokmakov
6fdfb964d0
Revert "Add Annoy index" 2022-08-30 15:10:10 +03:00
Vladimir C
c8c8428052
Apply suggestions from code review 2022-08-30 13:49:21 +02:00
Andrey Zvonov
93f9abf130
upd2 2022-08-30 14:41:40 +03:00
Andrey Zvonov
14adea8792
fix error in docs 2022-08-30 14:40:26 +03:00
Kseniia Sumarokova
c88db2ef97
Merge pull request #40751 from kssenii/fix-mysql-timeouts
Fix issue with mysql db / table function timeouts
2022-08-30 11:59:01 +02:00
Robert Schulze
cc4225109f
Merge pull request #37215 from Vector-Similarity-Search-for-ClickHouse/annoy-2
Test failures are unrelated, merging.
2022-08-30 09:25:57 +02:00
DanRoscigno
d712a91a20 add alternatives 2022-08-29 19:36:20 -04:00
DanRoscigno
0abeebd3ca updated with dev help 2022-08-29 19:29:10 -04:00
Alexey Milovidov
d5fae3d16b
Merge pull request #40752 from ClickHouse/auto/v22.8.3.13-lts
Update version_date.tsv and changelogs after v22.8.3.13-lts
2022-08-30 02:21:55 +03:00
Alexey Milovidov
c4e664a899
Merge pull request #40753 from ClickHouse/auto/v22.7.5.13-stable
Update version_date.tsv and changelogs after v22.7.5.13-stable
2022-08-30 02:21:44 +03:00
Alexey Milovidov
0af90273f9
Merge pull request #40757 from ClickHouse/auto/v22.3.12.19-lts
Update version_date.tsv and changelogs after v22.3.12.19-lts
2022-08-30 02:21:34 +03:00
Alexey Milovidov
bddbbafea0
Merge pull request #40755 from ClickHouse/auto/v22.6.7.7-stable
Update version_date.tsv and changelogs after v22.6.7.7-stable
2022-08-30 02:21:12 +03:00
Alexey Milovidov
6bc8983756
Merge pull request #40771 from den-crane/patch-41
Doc. fix description min_bytes_to_rebalance_partition_over_jbod
2022-08-30 02:20:07 +03:00
Alexey Milovidov
0190c56faf
Merge pull request #40770 from den-crane/patch-40
Doc. Fix cache dictionaries doc.
2022-08-30 02:19:32 +03:00
DanRoscigno
3a65d58c13 updated with dev help 2022-08-29 18:33:26 -04:00
Cory Levy
1e2eee7146 Remove unnecessary backslashes in markdown sql blocks 2022-08-29 16:31:31 -04:00
Robert Schulze
64a6aa328e
fix: broken links in documentation (hopefully) 2022-08-29 20:27:06 +00:00
Robert Schulze
4d511332c4
chore: delete obsolete modelEvaluate() function
- superseded by catboostEvaluate() which no longer uses the internal
  repository for external models

- also removed was statement SYSTEM RELOAD MODELS and the monitoring view
  SYSTEM.SYSTEMMODELS
2022-08-29 20:27:06 +00:00
Robert Schulze
6b2b3c1eb3
feat: implement catboost in library-bridge
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
2022-08-29 20:26:45 +00:00
Dan Roscigno
76a45aa750
Merge branch 'master' into add-backup 2022-08-29 16:23:53 -04:00
DanRoscigno
d37029dd82 updates for filename changes 2022-08-29 15:20:28 -04:00
DanRoscigno
576b7ea604 updates for filename changes 2022-08-29 14:39:15 -04:00
Denny Crane
29e7414697
Update merge-tree-settings.md 2022-08-29 15:25:46 -03:00
Denny Crane
19c3a9c6bf
Update external-dicts-dict-layout.md 2022-08-29 15:20:46 -03:00
Denny Crane
fe0f18f21d
Update external-dicts-dict-layout.md 2022-08-29 15:19:15 -03:00
DanRoscigno
687ac1805a updates for filename changes 2022-08-29 13:59:51 -04:00
Kseniia Sumarokova
c5c48e44ea
Merge branch 'master' into fix-mysql-timeouts 2022-08-29 19:33:29 +02:00
DanRoscigno
76a3212fc8 replace symlinks 2022-08-29 12:26:17 -04:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
robot-clickhouse
92c14e80f1 Update version_date.tsv and changelogs after v22.3.12.19-lts 2022-08-29 14:52:19 +00:00
robot-clickhouse
57980161c9 Update version_date.tsv and changelogs after v22.6.7.7-stable 2022-08-29 14:44:03 +00:00
Filatenkov Artur
d73f661732
Merge branch 'master' into annoy-2 2022-08-29 17:33:13 +03:00
robot-clickhouse
4a229ad08c Update version_date.tsv and changelogs after v22.7.5.13-stable 2022-08-29 14:29:06 +00:00
kssenii
0a6c4b9265 Fix 2022-08-29 16:20:53 +02:00
robot-clickhouse
764e2e5ac8 Update version_date.tsv and changelogs after v22.8.3.13-lts 2022-08-29 14:05:36 +00:00
alesapin
7ce0afc0df
Merge pull request #40670 from Avogar/kafka
Add setting to disable limit on kafka_num_consumers
2022-08-29 10:53:35 +02:00
Cory Levy
deb2a97020 Add docs 2022-08-28 22:28:34 -04:00
DanRoscigno
753afd0584 update links 2022-08-28 20:41:29 -04:00
DanRoscigno
b50fa8b5a9 replace symlinks 2022-08-28 17:34:50 -04:00
DanRoscigno
3c36660488 replace symlinks 2022-08-28 17:27:24 -04:00
DanRoscigno
71891938ae replace symlinks with includes 2022-08-28 14:08:07 -04:00
Dan Roscigno
96cd94196e
Merge branch 'ClickHouse:master' into add-more-slugs 2022-08-28 12:06:37 -04:00
DanRoscigno
fad2e071eb replace symlinks with includes 2022-08-28 11:58:59 -04:00
DanRoscigno
37127c683c remove symlinks 2022-08-28 11:35:03 -04:00
DanRoscigno
5d1e3ee4d8 remove duplicate 2022-08-28 11:04:51 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
Alexey Milovidov
ddff5e9145
Merge pull request #40712 from ClickHouse/ci-cmake-self-extractable
cmake: Disable default ENABLE_CLICKHOUSE_SELF_EXTRACTING
2022-08-28 17:12:19 +03:00
DanRoscigno
db1a3b717c add slugs 2022-08-28 09:58:27 -04:00
DanRoscigno
c4caa35cfd add frontmatter dashes 2022-08-28 09:53:52 -04:00
Robert Schulze
df934d8762
Merge pull request #40217 from zvonand/zvonand-minmax
Fix conversion Date32 / DateTime64 / Date to narrow types
2022-08-28 09:42:39 +02:00
Yakov Olkhovskiy
d96f32d655
Update developer-instruction.md 2022-08-27 23:46:09 -04:00
Alexey Milovidov
6e564b18bf
Merge pull request #40600 from FrankChen021/check_url_arg
Validate the CompressionMethod parameter of URL table engine
2022-08-27 19:29:55 +03:00
DanRoscigno
4c0eabe1da add label 2022-08-26 20:15:45 -04:00
DanRoscigno
8f77d2e33b rename file 2022-08-26 19:57:37 -04:00
DanRoscigno
0edbef2c8c remove symlinks, use MDX import 2022-08-26 19:14:11 -04:00
DanRoscigno
9e34d2ee9c add about us links 2022-08-26 17:47:49 -04:00
Alexey Milovidov
859defa687
Merge pull request #40680 from DanRoscigno/add-slugs-everywhere
Add slugs everywhere
2022-08-27 00:05:22 +03:00
Mikhail f. Shiryaev
12bbc4a276
Merge pull request #40681 from ClickHouse/obsolete-tgz
Fix clickhouse-server doinst.sh
2022-08-26 22:04:34 +02:00
DanRoscigno
79f8e1c03c add slugs to all docs 2022-08-26 15:49:26 -04:00
Dan Roscigno
8e5ef64d57
Merge branch 'ClickHouse:master' into add-slugs-everywhere 2022-08-26 15:44:57 -04:00
Dan Roscigno
1ac2cfdc0a
Update docs/zh/faq/general/why-clickhouse-is-so-fast.md 2022-08-26 15:14:30 -04:00
DanRoscigno
7f92006428 add slugs to all docs 2022-08-26 15:07:59 -04:00
Mikhail f. Shiryaev
3f967b1822
Fix _includes/install/tgz.sh script for linux 2022-08-26 20:57:38 +02:00
Alexey Milovidov
eac54c0375
Merge pull request #40671 from vmihailenco/chore/uptrace
chore: add Uptrace tool and go-clickhouse client
2022-08-26 21:11:16 +03:00
Dan Roscigno
52fc319c83
Merge branch 'master' into add-slugs-everywhere 2022-08-26 14:09:57 -04:00
DanRoscigno
b49ca28ca0 remove files that should be soft links 2022-08-26 14:04:53 -04:00
DanRoscigno
d948ee81b6 remove files that should be soft links 2022-08-26 13:53:16 -04:00
DanRoscigno
a88d33d025 remove files that should be soft links 2022-08-26 13:48:39 -04:00
DanRoscigno
726d3c0739 add slugs to all docs 2022-08-26 13:37:11 -04:00
FArthur-cmd
f3d0083e57 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-26 13:53:53 +00:00
Vladimir Mihailenco
d23d42251f chore: add Uptrace tool and go-clickhouse client 2022-08-26 16:04:33 +03:00
avogar
e31bba7731 Add docs 2022-08-26 12:52:15 +00:00
Peignon Melvyn
18c75d8ca9
Update settings.md
Fix according to: aaafb797c0/src/Core/Settings.h (L586)
2022-08-26 12:27:16 +02:00
Lloyd-Pottiger
0d33327eda
Merge branch 'master' into feat/support-read-only-for-embeddedrocksdb 2022-08-26 15:36:21 +08:00
DanRoscigno
ad56971e61 add text 2022-08-25 16:25:39 -04:00
Dan Roscigno
c9dea66f8d
Merge pull request #38308 from DanRoscigno/38284-add-grouping-function-docs
38284 add grouping function docs
2022-08-25 16:03:31 -04:00
DanRoscigno
5847c5cdbd reducing samples 2022-08-25 15:46:48 -04:00
Alexey Milovidov
64b8b8294d
Update grouping_function.md 2022-08-25 22:01:13 +03:00
Frank Chen
6f8af95e34 Update doc
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-08-25 14:49:43 +08:00
Lloyd-Pottiger
9d7ace3286
Merge branch 'master' into feat/support-read-only-for-embeddedrocksdb 2022-08-24 23:52:34 +08:00
Dan Roscigno
9972e758e4
Merge branch 'master' into add-backup 2022-08-23 21:20:53 -04:00
DanRoscigno
7bc08900ec added config for backup dest 2022-08-23 21:13:40 -04:00
DanRoscigno
cf2a6dab32 add selects 2022-08-23 20:43:09 -04:00
DanRoscigno
e617532d40 wip 2022-08-23 19:16:15 -04:00
zvonand
6ad02fd687 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-minmax 2022-08-24 01:12:38 +03:00