Commit Graph

12067 Commits

Author SHA1 Message Date
Alexey Milovidov
6bc8983756
Merge pull request #40771 from den-crane/patch-41
Doc. fix description min_bytes_to_rebalance_partition_over_jbod
2022-08-30 02:20:07 +03:00
Alexey Milovidov
0190c56faf
Merge pull request #40770 from den-crane/patch-40
Doc. Fix cache dictionaries doc.
2022-08-30 02:19:32 +03:00
DanRoscigno
3a65d58c13 updated with dev help 2022-08-29 18:33:26 -04:00
Cory Levy
1e2eee7146 Remove unnecessary backslashes in markdown sql blocks 2022-08-29 16:31:31 -04:00
Robert Schulze
64a6aa328e
fix: broken links in documentation (hopefully) 2022-08-29 20:27:06 +00:00
Robert Schulze
4d511332c4
chore: delete obsolete modelEvaluate() function
- superseded by catboostEvaluate() which no longer uses the internal
  repository for external models

- also removed was statement SYSTEM RELOAD MODELS and the monitoring view
  SYSTEM.SYSTEMMODELS
2022-08-29 20:27:06 +00:00
Robert Schulze
6b2b3c1eb3
feat: implement catboost in library-bridge
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
2022-08-29 20:26:45 +00:00
Dan Roscigno
76a45aa750
Merge branch 'master' into add-backup 2022-08-29 16:23:53 -04:00
DanRoscigno
d37029dd82 updates for filename changes 2022-08-29 15:20:28 -04:00
DanRoscigno
576b7ea604 updates for filename changes 2022-08-29 14:39:15 -04:00
Denny Crane
29e7414697
Update merge-tree-settings.md 2022-08-29 15:25:46 -03:00
Denny Crane
19c3a9c6bf
Update external-dicts-dict-layout.md 2022-08-29 15:20:46 -03:00
Denny Crane
fe0f18f21d
Update external-dicts-dict-layout.md 2022-08-29 15:19:15 -03:00
DanRoscigno
687ac1805a updates for filename changes 2022-08-29 13:59:51 -04:00
Kseniia Sumarokova
c5c48e44ea
Merge branch 'master' into fix-mysql-timeouts 2022-08-29 19:33:29 +02:00
DanRoscigno
76a3212fc8 replace symlinks 2022-08-29 12:26:17 -04:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
robot-clickhouse
92c14e80f1 Update version_date.tsv and changelogs after v22.3.12.19-lts 2022-08-29 14:52:19 +00:00
robot-clickhouse
57980161c9 Update version_date.tsv and changelogs after v22.6.7.7-stable 2022-08-29 14:44:03 +00:00
Filatenkov Artur
d73f661732
Merge branch 'master' into annoy-2 2022-08-29 17:33:13 +03:00
robot-clickhouse
4a229ad08c Update version_date.tsv and changelogs after v22.7.5.13-stable 2022-08-29 14:29:06 +00:00
kssenii
0a6c4b9265 Fix 2022-08-29 16:20:53 +02:00
robot-clickhouse
764e2e5ac8 Update version_date.tsv and changelogs after v22.8.3.13-lts 2022-08-29 14:05:36 +00:00
alesapin
7ce0afc0df
Merge pull request #40670 from Avogar/kafka
Add setting to disable limit on kafka_num_consumers
2022-08-29 10:53:35 +02:00
Cory Levy
deb2a97020 Add docs 2022-08-28 22:28:34 -04:00
DanRoscigno
753afd0584 update links 2022-08-28 20:41:29 -04:00
DanRoscigno
b50fa8b5a9 replace symlinks 2022-08-28 17:34:50 -04:00
DanRoscigno
3c36660488 replace symlinks 2022-08-28 17:27:24 -04:00
DanRoscigno
71891938ae replace symlinks with includes 2022-08-28 14:08:07 -04:00
Dan Roscigno
96cd94196e
Merge branch 'ClickHouse:master' into add-more-slugs 2022-08-28 12:06:37 -04:00
DanRoscigno
fad2e071eb replace symlinks with includes 2022-08-28 11:58:59 -04:00
DanRoscigno
37127c683c remove symlinks 2022-08-28 11:35:03 -04:00
DanRoscigno
5d1e3ee4d8 remove duplicate 2022-08-28 11:04:51 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
Alexey Milovidov
ddff5e9145
Merge pull request #40712 from ClickHouse/ci-cmake-self-extractable
cmake: Disable default ENABLE_CLICKHOUSE_SELF_EXTRACTING
2022-08-28 17:12:19 +03:00
DanRoscigno
db1a3b717c add slugs 2022-08-28 09:58:27 -04:00
DanRoscigno
c4caa35cfd add frontmatter dashes 2022-08-28 09:53:52 -04:00
Robert Schulze
df934d8762
Merge pull request #40217 from zvonand/zvonand-minmax
Fix conversion Date32 / DateTime64 / Date to narrow types
2022-08-28 09:42:39 +02:00
Yakov Olkhovskiy
d96f32d655
Update developer-instruction.md 2022-08-27 23:46:09 -04:00
Alexey Milovidov
6e564b18bf
Merge pull request #40600 from FrankChen021/check_url_arg
Validate the CompressionMethod parameter of URL table engine
2022-08-27 19:29:55 +03:00
DanRoscigno
4c0eabe1da add label 2022-08-26 20:15:45 -04:00
DanRoscigno
8f77d2e33b rename file 2022-08-26 19:57:37 -04:00
DanRoscigno
0edbef2c8c remove symlinks, use MDX import 2022-08-26 19:14:11 -04:00
DanRoscigno
9e34d2ee9c add about us links 2022-08-26 17:47:49 -04:00
Alexey Milovidov
859defa687
Merge pull request #40680 from DanRoscigno/add-slugs-everywhere
Add slugs everywhere
2022-08-27 00:05:22 +03:00
Mikhail f. Shiryaev
12bbc4a276
Merge pull request #40681 from ClickHouse/obsolete-tgz
Fix clickhouse-server doinst.sh
2022-08-26 22:04:34 +02:00
DanRoscigno
79f8e1c03c add slugs to all docs 2022-08-26 15:49:26 -04:00
Dan Roscigno
8e5ef64d57
Merge branch 'ClickHouse:master' into add-slugs-everywhere 2022-08-26 15:44:57 -04:00
Dan Roscigno
1ac2cfdc0a
Update docs/zh/faq/general/why-clickhouse-is-so-fast.md 2022-08-26 15:14:30 -04:00
DanRoscigno
7f92006428 add slugs to all docs 2022-08-26 15:07:59 -04:00
Mikhail f. Shiryaev
3f967b1822
Fix _includes/install/tgz.sh script for linux 2022-08-26 20:57:38 +02:00
Alexey Milovidov
eac54c0375
Merge pull request #40671 from vmihailenco/chore/uptrace
chore: add Uptrace tool and go-clickhouse client
2022-08-26 21:11:16 +03:00
Dan Roscigno
52fc319c83
Merge branch 'master' into add-slugs-everywhere 2022-08-26 14:09:57 -04:00
DanRoscigno
b49ca28ca0 remove files that should be soft links 2022-08-26 14:04:53 -04:00
DanRoscigno
d948ee81b6 remove files that should be soft links 2022-08-26 13:53:16 -04:00
DanRoscigno
a88d33d025 remove files that should be soft links 2022-08-26 13:48:39 -04:00
DanRoscigno
726d3c0739 add slugs to all docs 2022-08-26 13:37:11 -04:00
FArthur-cmd
f3d0083e57 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-26 13:53:53 +00:00
Vladimir Mihailenco
d23d42251f chore: add Uptrace tool and go-clickhouse client 2022-08-26 16:04:33 +03:00
avogar
e31bba7731 Add docs 2022-08-26 12:52:15 +00:00
Peignon Melvyn
18c75d8ca9
Update settings.md
Fix according to: aaafb797c0/src/Core/Settings.h (L586)
2022-08-26 12:27:16 +02:00
Lloyd-Pottiger
0d33327eda
Merge branch 'master' into feat/support-read-only-for-embeddedrocksdb 2022-08-26 15:36:21 +08:00
DanRoscigno
ad56971e61 add text 2022-08-25 16:25:39 -04:00
Dan Roscigno
c9dea66f8d
Merge pull request #38308 from DanRoscigno/38284-add-grouping-function-docs
38284 add grouping function docs
2022-08-25 16:03:31 -04:00
DanRoscigno
5847c5cdbd reducing samples 2022-08-25 15:46:48 -04:00
Alexey Milovidov
64b8b8294d
Update grouping_function.md 2022-08-25 22:01:13 +03:00
Frank Chen
6f8af95e34 Update doc
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-08-25 14:49:43 +08:00
Lloyd-Pottiger
9d7ace3286
Merge branch 'master' into feat/support-read-only-for-embeddedrocksdb 2022-08-24 23:52:34 +08:00
Dan Roscigno
9972e758e4
Merge branch 'master' into add-backup 2022-08-23 21:20:53 -04:00
DanRoscigno
7bc08900ec added config for backup dest 2022-08-23 21:13:40 -04:00
DanRoscigno
cf2a6dab32 add selects 2022-08-23 20:43:09 -04:00
DanRoscigno
e617532d40 wip 2022-08-23 19:16:15 -04:00
zvonand
6ad02fd687 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-minmax 2022-08-24 01:12:38 +03:00
zvonand
e257f9d0cd update docs, tests + small fixes 2022-08-24 01:09:14 +03:00
zvonand
a9fd733871 updated docs 2022-08-24 01:09:14 +03:00
Alexey Milovidov
12f306481b
Merge pull request #40551 from den-crane/patch-39
Doc. Window functions, one more range example
2022-08-24 00:21:43 +03:00
Alexey Milovidov
5d4c6e975b
Merge pull request #40555 from ClickHouse/auto/v22.6.6.16-stable
Update version_date.tsv and changelogs after v22.6.6.16-stable
2022-08-24 00:20:41 +03:00
Alexey Milovidov
13527346d0
Merge pull request #40553 from ClickHouse/auto/v22.8.2.11-lts
Update version_date.tsv and changelogs after v22.8.2.11-lts
2022-08-24 00:20:29 +03:00
Andrey Zvonov
f40bd2194f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:42:19 +03:00
Andrey Zvonov
b54a04d48f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:42:01 +03:00
Andrey Zvonov
6c1fa6844f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:41:19 +03:00
Andrey Zvonov
946223df20
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:41:01 +03:00
Andrey Zvonov
e4f00e2f15
Update docs 1
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:40:34 +03:00
robot-clickhouse
619e924bfa Update version_date.tsv and changelogs after v22.6.6.16-stable 2022-08-23 19:19:49 +00:00
robot-clickhouse
274f3dbb95 Update version_date.tsv and changelogs after v22.7.4.16-stable 2022-08-23 19:13:49 +00:00
robot-clickhouse
c1747edf19 Update version_date.tsv and changelogs after v22.8.2.11-lts 2022-08-23 19:08:30 +00:00
Denny Crane
add65a17e7
Update index.md 2022-08-23 15:02:44 -03:00
Denny Crane
a790725bea
Update index.md 2022-08-23 14:35:33 -03:00
Denny Crane
f93bb53c1f
Update index.md 2022-08-23 14:32:56 -03:00
Andrey Zvonov
52159b77d0
Merge branch 'master' into zvonand-minmax 2022-08-23 17:18:57 +03:00
Lloyd-Pottiger
ac3cf0beb4 add read_only option
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-08-23 20:58:57 +08:00
Kseniia Sumarokova
7acad11b90
Merge pull request #40504 from den-crane/patch-38
Doc. Example named-collections + clickhouse database
2022-08-23 10:51:02 +02:00
Antonio Andelic
a87a762b0c
Merge pull request #39973 from ClickHouse/keeper-listen-host
Support `interserver_listen_host` in Keeper
2022-08-23 09:03:08 +02:00
Antonio Andelic
0765495be1
Merge pull request #39986 from Lloyd-Pottiger/feat/support-ttl-for-embeddedrocksdb
Support TTL for EmbeddedRocksDB
2022-08-23 08:27:47 +02:00
Denny Crane
e6912c86b9
Update named-collections.md 2022-08-22 19:36:01 -03:00
Denny Crane
7428193a82
Update named-collections.md 2022-08-22 19:17:39 -03:00
FArthur-cmd
9222e41a5b add test and docs 2022-08-22 19:00:20 +00:00
Lloyd-Pottiger
85a1a36167 remove read_only option
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-08-22 23:31:55 +08:00
konnectr
ee3f6d7783
ru docs update nlp-functions 2022-08-22 19:37:31 +05:00
zvonand
d789dabc9d Fixed , updated docs 2022-08-22 17:36:56 +03:00
zvonand
963d838647 updated docs 2022-08-22 17:36:56 +03:00
zvonand
eba4bd2a87 update test and chinese docs 2022-08-22 17:36:55 +03:00
zvonand
a7a1269e60 updated tests + improve logic 2022-08-22 17:36:55 +03:00
konnectr
375325601b
ru docs other-functions 2022-08-22 19:36:36 +05:00
konnectr
82b5bb56ca
ru docs update introspection 2022-08-22 19:35:23 +05:00
konnectr
518373e575
ru docs update ext-dict-functions 2022-08-22 19:32:19 +05:00
konnectr
66da1a101c
ru docs update json-functions 2022-08-22 19:29:58 +05:00
konnectr
c53726a236
ru docs update encoding-functions 2022-08-22 19:27:58 +05:00
konnectr
44883aacc4
ru docs update string-search-functions 2022-08-22 19:23:11 +05:00
konnectr
895a5fef4a
ru docs update date-time-functions 2022-08-22 19:20:02 +05:00
konnectr
06d42dcb88
ru update type-conversion 2022-08-22 19:15:25 +05:00
konnectr
8937854dad
ru update array-function 2022-08-22 19:11:55 +05:00
Alexey Milovidov
766a3a0e11
Merge pull request #40473 from den-crane/patch-37
Doc. Some notes about insert deduplication
2022-08-22 02:52:36 +03:00
Alexey Milovidov
1a5e08fb65
Update settings.md 2022-08-22 02:19:18 +03:00
Denny Crane
6e329686b8
Update settings.md 2022-08-21 19:31:46 -03:00
Alexey Milovidov
de1e2eed49
Merge pull request #40471 from den-crane/patch-36
Doc. now64
2022-08-22 01:27:15 +03:00
Denny Crane
dc40e4b935
Update merge-tree-settings.md 2022-08-21 17:30:13 -03:00
Denny Crane
069e2cf4a0
Update settings.md 2022-08-21 17:27:47 -03:00
Denny Crane
244b7aa118
Update merge-tree-settings.md 2022-08-21 17:17:06 -03:00
Denny Crane
b6329293a9
Update date-time-functions.md 2022-08-21 16:45:13 -03:00
Denny Crane
c926d04c21
Update date-time-functions.md 2022-08-21 16:42:40 -03:00
konnectr
f4130c0342
ru docs fix danger 2022-08-21 22:01:17 +05:00
Antonio Andelic
af02c76a3c
Merge branch 'master' into keeper-listen-host 2022-08-21 18:43:55 +02:00
Alexey Milovidov
34a07a5db0
Update datetime64.md 2022-08-21 17:22:40 +03:00
FArthur-cmd
1e8910f048 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-21 08:45:03 +00:00
konnectr
c447a8d5ed
docs ru removed blank row 2022-08-21 00:21:19 +05:00
konnectr
00b56552af
docs ru histogram params fixed 2022-08-21 00:18:18 +05:00
konnectr
be821e0143
docs ru fixed danger text 2022-08-20 23:54:19 +05:00
konnectr
29e7c2bb4c
add doc nowInBlock 2022-08-20 22:52:14 +05:00
Denny Crane
54374e22e6
Update date-time-functions.md 2022-08-19 15:09:40 -03:00
Alexey Milovidov
3b399ad549
Merge pull request #40358 from ClickHouse/auto/v22.8.1.2097-lts
Update version_date.tsv and changelogs after v22.8.1.2097-lts
2022-08-19 15:54:05 +03:00
Alexey Milovidov
5f4d4fd878
Merge pull request #40362 from den-crane/patch-33
Doc. ReplacingMergeTree Example
2022-08-19 15:52:40 +03:00
Alexey Milovidov
b6388583b3
Merge pull request #40366 from DanRoscigno/update-zero-copy-replication
update for setting change
2022-08-19 15:48:35 +03:00
Sergei Trifonov
7c18d5b34f
Merge pull request #40348 from ClickHouse/threads-soft-limit-rename
split concurrent_threads_soft_limit setting into two
2022-08-19 13:39:32 +02:00
Robert Schulze
24615059fb
Merge pull request #40319 from ClickHouse/custom-error-code-in-throwif
Allow custom error code in throwIf
2022-08-19 09:49:35 +02:00
Denny Crane
2929632058
Update docs/ru/engines/table-engines/mergetree-family/replacingmergetree.md
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2022-08-18 23:58:54 -03:00
DanRoscigno
23b054617e update for setting change 2022-08-18 16:05:44 -04:00
Denny Crane
01a1aa8518
Update replacingmergetree.md 2022-08-18 16:35:54 -03:00
Denny Crane
8bf8dc628c
Update replacingmergetree.md 2022-08-18 16:34:14 -03:00
Denny Crane
e653583e87
Update replacingmergetree.md 2022-08-18 16:29:06 -03:00
robot-clickhouse
a9b3df37dd Update version_date.tsv and changelogs after v22.8.1.2097-lts 2022-08-18 17:45:23 +00:00
Sergei Trifonov
2262717a1b
Merge branch 'master' into threads-soft-limit-rename 2022-08-18 19:32:53 +02:00
Jonathan-Ackerman
22bd572d78
Update docs for max_replica_delay_for_distributed_queries (#40174)
A replica is unusable if its lag is greater than or equal to the
value of max_replica_delay_for_distributed_queries. However, the
current documentation says that a replica is only unusable if it lags
more than the set value.

Also, when the value of max_replica_delay_for_distributed_queries
is read, if it is 0, then a replica is considered up to date
right away without checking its delay. This behavior should be
documented.
2022-08-18 19:09:46 +02:00
Vladimir C
277310f4e7
Merge pull request #40345 from DanRoscigno/fix-replacingmergetree-doc-indent
fix indent
2022-08-18 17:27:21 +02:00
Sergei Trifonov
42a711015f split concurrent_threads_soft_limit setting into two: concurrent_threads_soft_limit_{num,ratio_to_cores} 2022-08-18 14:51:08 +02:00
DanRoscigno
229f18766e fix indent 2022-08-18 08:13:41 -04:00
Nikolai Kochetov
5a85531ef7
Merge pull request #38286 from Avogar/schema-inference-cache
Add schema inference cache for s3/hdfs/file/url
2022-08-18 13:07:50 +02:00
Kruglov Pavel
d7056376eb
Merge pull request #40068 from Avogar/schema-inference-hints
Allow to specify structure hints in schema inference
2022-08-18 12:19:45 +02:00
Lloyd-Pottiger
d9cfda905c
Merge branch 'master' into feat/support-ttl-for-embeddedrocksdb 2022-08-18 16:27:13 +08:00
Antonio Andelic
26b7117b6c Merge branch 'master' into keeper-listen-host 2022-08-18 07:05:20 +00:00