Commit Graph

12019 Commits

Author SHA1 Message Date
Alexey Milovidov
0af90273f9
Merge pull request #40757 from ClickHouse/auto/v22.3.12.19-lts
Update version_date.tsv and changelogs after v22.3.12.19-lts
2022-08-30 02:21:34 +03:00
Alexey Milovidov
bddbbafea0
Merge pull request #40755 from ClickHouse/auto/v22.6.7.7-stable
Update version_date.tsv and changelogs after v22.6.7.7-stable
2022-08-30 02:21:12 +03:00
Alexey Milovidov
6bc8983756
Merge pull request #40771 from den-crane/patch-41
Doc. fix description min_bytes_to_rebalance_partition_over_jbod
2022-08-30 02:20:07 +03:00
Alexey Milovidov
0190c56faf
Merge pull request #40770 from den-crane/patch-40
Doc. Fix cache dictionaries doc.
2022-08-30 02:19:32 +03:00
DanRoscigno
3a65d58c13 updated with dev help 2022-08-29 18:33:26 -04:00
Cory Levy
1e2eee7146 Remove unnecessary backslashes in markdown sql blocks 2022-08-29 16:31:31 -04:00
Robert Schulze
64a6aa328e
fix: broken links in documentation (hopefully) 2022-08-29 20:27:06 +00:00
Robert Schulze
4d511332c4
chore: delete obsolete modelEvaluate() function
- superseded by catboostEvaluate() which no longer uses the internal
  repository for external models

- also removed was statement SYSTEM RELOAD MODELS and the monitoring view
  SYSTEM.SYSTEMMODELS
2022-08-29 20:27:06 +00:00
Robert Schulze
6b2b3c1eb3
feat: implement catboost in library-bridge
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
2022-08-29 20:26:45 +00:00
Dan Roscigno
76a45aa750
Merge branch 'master' into add-backup 2022-08-29 16:23:53 -04:00
DanRoscigno
d37029dd82 updates for filename changes 2022-08-29 15:20:28 -04:00
DanRoscigno
576b7ea604 updates for filename changes 2022-08-29 14:39:15 -04:00
Denny Crane
29e7414697
Update merge-tree-settings.md 2022-08-29 15:25:46 -03:00
Denny Crane
19c3a9c6bf
Update external-dicts-dict-layout.md 2022-08-29 15:20:46 -03:00
Denny Crane
fe0f18f21d
Update external-dicts-dict-layout.md 2022-08-29 15:19:15 -03:00
DanRoscigno
687ac1805a updates for filename changes 2022-08-29 13:59:51 -04:00
Kseniia Sumarokova
c5c48e44ea
Merge branch 'master' into fix-mysql-timeouts 2022-08-29 19:33:29 +02:00
DanRoscigno
76a3212fc8 replace symlinks 2022-08-29 12:26:17 -04:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
robot-clickhouse
92c14e80f1 Update version_date.tsv and changelogs after v22.3.12.19-lts 2022-08-29 14:52:19 +00:00
robot-clickhouse
57980161c9 Update version_date.tsv and changelogs after v22.6.7.7-stable 2022-08-29 14:44:03 +00:00
Filatenkov Artur
d73f661732
Merge branch 'master' into annoy-2 2022-08-29 17:33:13 +03:00
robot-clickhouse
4a229ad08c Update version_date.tsv and changelogs after v22.7.5.13-stable 2022-08-29 14:29:06 +00:00
kssenii
0a6c4b9265 Fix 2022-08-29 16:20:53 +02:00
robot-clickhouse
764e2e5ac8 Update version_date.tsv and changelogs after v22.8.3.13-lts 2022-08-29 14:05:36 +00:00
alesapin
7ce0afc0df
Merge pull request #40670 from Avogar/kafka
Add setting to disable limit on kafka_num_consumers
2022-08-29 10:53:35 +02:00
Cory Levy
deb2a97020 Add docs 2022-08-28 22:28:34 -04:00
DanRoscigno
753afd0584 update links 2022-08-28 20:41:29 -04:00
DanRoscigno
b50fa8b5a9 replace symlinks 2022-08-28 17:34:50 -04:00
DanRoscigno
3c36660488 replace symlinks 2022-08-28 17:27:24 -04:00
DanRoscigno
71891938ae replace symlinks with includes 2022-08-28 14:08:07 -04:00
Dan Roscigno
96cd94196e
Merge branch 'ClickHouse:master' into add-more-slugs 2022-08-28 12:06:37 -04:00
DanRoscigno
fad2e071eb replace symlinks with includes 2022-08-28 11:58:59 -04:00
DanRoscigno
37127c683c remove symlinks 2022-08-28 11:35:03 -04:00
DanRoscigno
5d1e3ee4d8 remove duplicate 2022-08-28 11:04:51 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
Alexey Milovidov
ddff5e9145
Merge pull request #40712 from ClickHouse/ci-cmake-self-extractable
cmake: Disable default ENABLE_CLICKHOUSE_SELF_EXTRACTING
2022-08-28 17:12:19 +03:00
DanRoscigno
db1a3b717c add slugs 2022-08-28 09:58:27 -04:00
DanRoscigno
c4caa35cfd add frontmatter dashes 2022-08-28 09:53:52 -04:00
Robert Schulze
df934d8762
Merge pull request #40217 from zvonand/zvonand-minmax
Fix conversion Date32 / DateTime64 / Date to narrow types
2022-08-28 09:42:39 +02:00
Yakov Olkhovskiy
d96f32d655
Update developer-instruction.md 2022-08-27 23:46:09 -04:00
Alexey Milovidov
6e564b18bf
Merge pull request #40600 from FrankChen021/check_url_arg
Validate the CompressionMethod parameter of URL table engine
2022-08-27 19:29:55 +03:00
DanRoscigno
4c0eabe1da add label 2022-08-26 20:15:45 -04:00
DanRoscigno
8f77d2e33b rename file 2022-08-26 19:57:37 -04:00
DanRoscigno
0edbef2c8c remove symlinks, use MDX import 2022-08-26 19:14:11 -04:00
DanRoscigno
9e34d2ee9c add about us links 2022-08-26 17:47:49 -04:00
Alexey Milovidov
859defa687
Merge pull request #40680 from DanRoscigno/add-slugs-everywhere
Add slugs everywhere
2022-08-27 00:05:22 +03:00
Mikhail f. Shiryaev
12bbc4a276
Merge pull request #40681 from ClickHouse/obsolete-tgz
Fix clickhouse-server doinst.sh
2022-08-26 22:04:34 +02:00
DanRoscigno
79f8e1c03c add slugs to all docs 2022-08-26 15:49:26 -04:00
Dan Roscigno
8e5ef64d57
Merge branch 'ClickHouse:master' into add-slugs-everywhere 2022-08-26 15:44:57 -04:00
Dan Roscigno
1ac2cfdc0a
Update docs/zh/faq/general/why-clickhouse-is-so-fast.md 2022-08-26 15:14:30 -04:00
DanRoscigno
7f92006428 add slugs to all docs 2022-08-26 15:07:59 -04:00
Mikhail f. Shiryaev
3f967b1822
Fix _includes/install/tgz.sh script for linux 2022-08-26 20:57:38 +02:00
Alexey Milovidov
eac54c0375
Merge pull request #40671 from vmihailenco/chore/uptrace
chore: add Uptrace tool and go-clickhouse client
2022-08-26 21:11:16 +03:00
Dan Roscigno
52fc319c83
Merge branch 'master' into add-slugs-everywhere 2022-08-26 14:09:57 -04:00
DanRoscigno
b49ca28ca0 remove files that should be soft links 2022-08-26 14:04:53 -04:00
DanRoscigno
d948ee81b6 remove files that should be soft links 2022-08-26 13:53:16 -04:00
DanRoscigno
a88d33d025 remove files that should be soft links 2022-08-26 13:48:39 -04:00
DanRoscigno
726d3c0739 add slugs to all docs 2022-08-26 13:37:11 -04:00
FArthur-cmd
f3d0083e57 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-26 13:53:53 +00:00
Vladimir Mihailenco
d23d42251f chore: add Uptrace tool and go-clickhouse client 2022-08-26 16:04:33 +03:00
avogar
e31bba7731 Add docs 2022-08-26 12:52:15 +00:00
Peignon Melvyn
18c75d8ca9
Update settings.md
Fix according to: aaafb797c0/src/Core/Settings.h (L586)
2022-08-26 12:27:16 +02:00
Lloyd-Pottiger
0d33327eda
Merge branch 'master' into feat/support-read-only-for-embeddedrocksdb 2022-08-26 15:36:21 +08:00
DanRoscigno
ad56971e61 add text 2022-08-25 16:25:39 -04:00
Dan Roscigno
c9dea66f8d
Merge pull request #38308 from DanRoscigno/38284-add-grouping-function-docs
38284 add grouping function docs
2022-08-25 16:03:31 -04:00
DanRoscigno
5847c5cdbd reducing samples 2022-08-25 15:46:48 -04:00
Alexey Milovidov
64b8b8294d
Update grouping_function.md 2022-08-25 22:01:13 +03:00
Frank Chen
6f8af95e34 Update doc
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-08-25 14:49:43 +08:00
Lloyd-Pottiger
9d7ace3286
Merge branch 'master' into feat/support-read-only-for-embeddedrocksdb 2022-08-24 23:52:34 +08:00
Dan Roscigno
9972e758e4
Merge branch 'master' into add-backup 2022-08-23 21:20:53 -04:00
DanRoscigno
7bc08900ec added config for backup dest 2022-08-23 21:13:40 -04:00
DanRoscigno
cf2a6dab32 add selects 2022-08-23 20:43:09 -04:00
DanRoscigno
e617532d40 wip 2022-08-23 19:16:15 -04:00
zvonand
6ad02fd687 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-minmax 2022-08-24 01:12:38 +03:00
zvonand
e257f9d0cd update docs, tests + small fixes 2022-08-24 01:09:14 +03:00
zvonand
a9fd733871 updated docs 2022-08-24 01:09:14 +03:00
Alexey Milovidov
12f306481b
Merge pull request #40551 from den-crane/patch-39
Doc. Window functions, one more range example
2022-08-24 00:21:43 +03:00
Alexey Milovidov
5d4c6e975b
Merge pull request #40555 from ClickHouse/auto/v22.6.6.16-stable
Update version_date.tsv and changelogs after v22.6.6.16-stable
2022-08-24 00:20:41 +03:00
Alexey Milovidov
13527346d0
Merge pull request #40553 from ClickHouse/auto/v22.8.2.11-lts
Update version_date.tsv and changelogs after v22.8.2.11-lts
2022-08-24 00:20:29 +03:00
Andrey Zvonov
f40bd2194f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:42:19 +03:00
Andrey Zvonov
b54a04d48f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:42:01 +03:00
Andrey Zvonov
6c1fa6844f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:41:19 +03:00
Andrey Zvonov
946223df20
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:41:01 +03:00
Andrey Zvonov
e4f00e2f15
Update docs 1
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:40:34 +03:00
robot-clickhouse
619e924bfa Update version_date.tsv and changelogs after v22.6.6.16-stable 2022-08-23 19:19:49 +00:00
robot-clickhouse
274f3dbb95 Update version_date.tsv and changelogs after v22.7.4.16-stable 2022-08-23 19:13:49 +00:00
robot-clickhouse
c1747edf19 Update version_date.tsv and changelogs after v22.8.2.11-lts 2022-08-23 19:08:30 +00:00
Denny Crane
add65a17e7
Update index.md 2022-08-23 15:02:44 -03:00
Denny Crane
a790725bea
Update index.md 2022-08-23 14:35:33 -03:00
Denny Crane
f93bb53c1f
Update index.md 2022-08-23 14:32:56 -03:00
Andrey Zvonov
52159b77d0
Merge branch 'master' into zvonand-minmax 2022-08-23 17:18:57 +03:00
Lloyd-Pottiger
ac3cf0beb4 add read_only option
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-08-23 20:58:57 +08:00
Kseniia Sumarokova
7acad11b90
Merge pull request #40504 from den-crane/patch-38
Doc. Example named-collections + clickhouse database
2022-08-23 10:51:02 +02:00
Antonio Andelic
a87a762b0c
Merge pull request #39973 from ClickHouse/keeper-listen-host
Support `interserver_listen_host` in Keeper
2022-08-23 09:03:08 +02:00
Antonio Andelic
0765495be1
Merge pull request #39986 from Lloyd-Pottiger/feat/support-ttl-for-embeddedrocksdb
Support TTL for EmbeddedRocksDB
2022-08-23 08:27:47 +02:00
Denny Crane
e6912c86b9
Update named-collections.md 2022-08-22 19:36:01 -03:00
Denny Crane
7428193a82
Update named-collections.md 2022-08-22 19:17:39 -03:00
FArthur-cmd
9222e41a5b add test and docs 2022-08-22 19:00:20 +00:00
Lloyd-Pottiger
85a1a36167 remove read_only option
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-08-22 23:31:55 +08:00