Alexey Milovidov
5b6be92042
Update build.md
2022-10-13 05:31:50 +03:00
vdimir
0178307c27
Followup for TemporaryDataOnDisk
2022-10-12 15:25:23 +02:00
lixuchun
b724b7a74a
update docs error
2022-10-12 11:57:35 +08:00
Alexey Milovidov
023f11fb86
Update developer-instruction.md
2022-10-09 03:54:00 +03:00
Alexey Milovidov
9bf5fe728b
Merge pull request #42173 from ClickHouse/remove-temporary-live-view
...
Remove TEMPORARY LIVE VIEW
2022-10-08 19:05:33 +03:00
Alexey Milovidov
b9159db82f
Remove temporary live views
2022-10-08 00:16:36 +02:00
Robert Schulze
3e3c0a7bb6
Docs: Add "TABLE" to CHECK/DESCRIBE statements in sidebar
2022-10-07 14:41:00 +00:00
Robert Schulze
cde0257d11
Docs: Remove obsolete pages
...
Removes page https://clickhouse.com/docs/en/sql-reference/statements/misc
It indexes "miscellaneous" SQL statements but these are already easily
reachable by the sidebar.
2022-10-07 14:37:22 +00:00
Robert Schulze
e759a64d38
Docs: Redirect links to misc.md
...
--> https://clickhouse.com/docs/en/sql-reference/statements/misc
This page indexes a bunch of SQL statements but they are easily
reachable by the sidebar already.
2022-10-07 13:22:40 +00:00
Nikolay Degterinsky
522948fa2a
Merge branch 'master' into patch-1
2022-10-06 17:47:36 +02:00
Dan Roscigno
41fb3cb7da
Merge branch 'master' into combine-requirements-install-docs
2022-10-06 09:39:11 -04:00
DanRoscigno
655d2b298d
adjust heading level
2022-10-06 09:38:30 -04:00
Kseniia Sumarokova
3cff776109
Merge pull request #41254 from filimonov/system_disks_unreserved_space
...
Add unreserved_space column to system.disks
2022-10-06 12:28:23 +02:00
DanRoscigno
12acfb9943
code review, preserve link
2022-10-05 12:04:00 -04:00
Nikolay Degterinsky
61ec576900
Merge branch 'master' into patch-1
2022-10-05 16:18:08 +02:00
DanRoscigno
5b22f63d07
updated packages URL
2022-10-05 09:49:55 -04:00
Maksim Kita
324c922121
Merge pull request #42069 from den-crane/patch-52
...
Doc. Some clarification about log_formatted_queries setting
2022-10-05 13:41:25 +03:00
Adam Rutkowski
3c4eae4276
Fix tag mismatch in sample users config
2022-10-05 09:55:28 +02:00
Nikolay Degterinsky
980600dc2f
Merge pull request #41206 from canhld94/ch_canh_fix_decrypt_with_null
...
Add function tryDecrypt that returns NULL when decrypt fail
2022-10-05 09:13:36 +02:00
Denny Crane
5341bf445a
Update settings.md
2022-10-04 15:08:29 -03:00
Dan Roscigno
f4f85a069b
Go live with doc updates ( #42053 )
...
* QIP to add overview page
* wip
* New Tutorial and Datasets landing page
* give an example for Cloud
* Update UK Price Paid for Cloud
* Update nyc-taxi.md
* add option for Cloud Load Data button
* Removed the Import Raw Data section
* Update nyc-taxi.md
* update user management and replication docs
* mark self managed
* set doc ordering
* add redirects setting
* Simple fixes to index.md
Co-authored-by: rfraposa <richraposa@gmail.com>
2022-10-04 14:36:59 +03:00
Nikita Mikhaylov
d767e1f0d8
Added an option to specify environment name in Sentry's config ( #42037 )
2022-10-04 13:23:51 +02:00
Duc Canh Le
a886804cbf
Merge branch 'master' into ch_canh_fix_decrypt_with_null
2022-10-04 13:20:29 +08:00
Sergei Trifonov
a2cf5a650e
Merge pull request #41989 from alexey-ivanov-official/fix-cumulative-sum-documentation-bug
...
Fix "Cumulative sum" example in "Window functions"
2022-10-03 18:19:51 +02:00
Sergei Trifonov
939b9091cc
Merge pull request #42007 from aldy505/master
...
docs(statements): specify ON CLUSTER clause for CREATE ROLE
2022-10-03 15:13:25 +02:00
Sergei Trifonov
ea13b81cc3
Merge pull request #42016 from peter279k/improve_mysql_interface_setting
...
Improve the MySQL interface usage description
2022-10-03 15:04:15 +02:00
Kseniia Sumarokova
0bfbb5c38a
Merge branch 'master' into system_disks_unreserved_space
2022-10-03 14:25:47 +02:00
Duc Canh Le
fbb9b3f5ab
Merge branch 'master' into ch_canh_fix_decrypt_with_null
2022-10-03 17:56:06 +08:00
peter279k
fc382a0144
Improve the MySQL interface usage description
2022-10-03 17:19:02 +08:00
peter279k
2c30b5febb
Improve gRPC client example
2022-10-03 16:54:35 +08:00
Robert Schulze
8e727d4fbc
Merge pull request #41910 from arenadata/ADQM-583
...
Improve enable_extended_results_for_datetime_functions option to return results of type DateTime64
2022-10-02 20:46:51 +02:00
Alexey Milovidov
0d1d177013
Merge pull request #41131 from JackyWoo/add_function_java_int_hash
...
Support Java integers hashing in `javaHash`
2022-10-02 18:10:51 +03:00
Duc Canh Le
99bf356220
Merge branch 'master' into ch_canh_fix_decrypt_with_null
2022-10-02 14:35:42 +08:00
Reinaldy Rafli
b52d58dcae
docs(statements): specify ON CLUSTER clause for CREATE ROLE
2022-10-02 09:51:17 +07:00
Alexey Milovidov
b9e8ae2fd9
Merge pull request #41913 from BoloniniD/Corrosion_docs
...
Fix Rust integration docs
2022-10-01 18:17:19 +03:00
Alexey Ivanov
5e290da99b
Fix "Cumulative sum" example in "Window functions"
...
Fixes a problem in "Cumulative sum" example in "Window functions" documentation,
when CREATE TABLE part of example was not match to SQL examples.
see: https://clickhouse.com/docs/en/sql-reference/window-functions/#cumulative-sum
2022-10-01 17:49:20 +03:00
Alexey Milovidov
c177061f75
Merge pull request #41958 from dbanda/patch-1
...
Update criteo.md
2022-09-30 22:37:41 +03:00
Alexey Milovidov
a92e24fdc1
Update criteo.md
2022-09-30 17:37:51 +03:00
Vladimir C
895afdec45
Merge pull request #40893 from ClickHouse/vdimir/track-tmp-disk
2022-09-30 11:27:24 +02:00
Roman Vasin
f716fc2fe5
Put list of functions in correct order in docs; Use new formatting in exception messages.
2022-09-30 07:54:35 +00:00
Dalitso Banda
b7d65f7a2d
Update criteo.md
...
The new spec states that MergeTree does not take any parameters. Updating the doc to reflect this.
2022-09-29 20:17:42 -07:00
Roman Vasin
45414b251d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-583
2022-09-29 17:02:49 +00:00
Roman Vasin
9dfb2d058c
Add DateTime64 returing functions in Note box
2022-09-29 14:23:50 +00:00
Raúl Marín
7c38b3f60d
Update MergeTree settings docs to match current defaults
2022-09-29 14:12:10 +02:00
Robert Schulze
6381631836
Merge pull request #41824 from ClickHouse/tryBase58
...
Add function tryBase58Decode()
2022-09-29 12:38:58 +02:00
vdimir
367c77f0fb
Check if tmp volume contains only local disks
2022-09-29 09:51:39 +00:00
Robert Schulze
6379cb41ce
Merge branch 'master' into fix-links
2022-09-29 09:17:39 +02:00
BoloniniD
fcb039d465
Fix docs for corrosion
2022-09-28 22:24:26 +03:00
Kruglov Pavel
9c1e654584
Fix typo
2022-09-28 16:38:04 +02:00
Roman Vasin
109c5ee1a1
Update docs for DateTime64 return types.
2022-09-28 12:49:58 +00:00
avogar
03ee7efcb9
Better example in docs
2022-09-28 12:48:31 +00:00
Robert Schulze
fa93952231
Docs: Reference external papers as DOIs
...
See also #31076 which noted that links were broken but didn't fix.
2022-09-28 12:21:58 +00:00
Kruglov Pavel
bfddb91c9a
Update docs/en/interfaces/formats.md
...
Co-authored-by: Sergei Trifonov <svtrifonov@gmail.com>
2022-09-28 14:15:53 +02:00
Kruglov Pavel
f1ac2d66be
Merge branch 'master' into json-object-each-row
2022-09-28 14:15:02 +02:00
Duc Canh Le
6fd234d652
fix document typo and format
2022-09-28 20:06:18 +08:00
Robert Schulze
82139fad0e
Docs: Remove obsolete modelEvaluate() mention
2022-09-28 11:47:16 +00:00
Duc Canh Le
170ca26435
add document
2022-09-28 17:55:20 +08:00
Alexey Milovidov
683b7e5e95
Merge branch 'master' into add_function_java_int_hash
2022-09-28 01:30:26 +03:00
Dan Roscigno
4f23f6ef25
fix other links
...
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2022-09-27 14:07:35 -04:00
DanRoscigno
4be153cbd3
fix link from intro
2022-09-27 10:21:35 -04:00
Robert Schulze
33891c275e
Fix typo
2022-09-27 10:20:39 +00:00
Robert Schulze
aa7e62ad5f
Add functio ntryBase58Decode()
...
- makes it consistent with tryBase64Decode(), follow-up to #39292
- additionally the following minor changes:
- rename Common/base58.h|cpp to Common/Base58.h|cpp for constency with
Common/Base64.h|cpp
- check that (encode|decode|tryDecode)Base64() gets just one argument
2022-09-27 10:18:36 +00:00
JackyWoo
dfb2be3a67
fix docs
2022-09-26 18:34:53 +08:00
JackyWoo
d1c85f68e8
manually snapshot creation for keeper
2022-09-26 18:29:15 +08:00
Dan Roscigno
636d2f9fbf
Merge branch 'master' into format-cell-tower-dataset
2022-09-23 13:32:52 -04:00
DanRoscigno
f2cbe97223
reformat cell tower example doc
2022-09-23 13:28:29 -04:00
Kseniia Sumarokova
4b170cc1cf
Update storing-data.md
2022-09-23 12:54:10 +02:00
avogar
4f32ef9bb7
Add docs
2022-09-22 17:04:42 +00:00
Kseniia Sumarokova
951a85a0fb
Update storing-data.md
2022-09-22 17:04:44 +02:00
Kseniia Sumarokova
a6b1586b17
Update storing-data.md
2022-09-22 17:03:19 +02:00
kssenii
f038c7ea00
Better config for cache
2022-09-22 14:50:29 +02:00
Kseniia Sumarokova
5caac39328
Merge pull request #41508 from kssenii/rename-some-cache-commands
...
Rename: `show caches` -> `show filesystem caches`, `describe cache` -> `describe filesystem cache`
2022-09-22 13:09:14 +02:00
Alexey Milovidov
bca4cc98c3
Merge pull request #41595 from Algunenano/fix_variadic_reading_random_data
...
Do not process rows in aggregations if any of the parameters is NULL
2022-09-22 07:57:37 +03:00
Peignon Melvyn
d040e41460
Update http.md
2022-09-22 00:23:05 +02:00
Denny Crane
a59f7a3aa9
Update tuple.md
2022-09-21 13:00:46 -03:00
Kruglov Pavel
22e11aef2d
Merge pull request #40910 from Avogar/new-json-formats
...
Add new JSON formats, add improvements and refactoring
2022-09-21 14:19:08 +02:00
Robert Schulze
186d4e4140
Merge pull request #40818 from Vector-Similarity-Search-for-ClickHouse/annoy
...
Add annoy index
2022-09-21 13:42:43 +02:00
Kseniia Sumarokova
1e7308832c
Merge branch 'master' into system_disks_unreserved_space
2022-09-21 13:04:39 +02:00
Raúl Marín
fd503b34d9
Remove any processing of undelying values for NULLs
2022-09-20 18:43:21 +02:00
avogar
868ce8bc16
Fix comments, make better naming, add docs, add setting output_format_json_quote_64bit_floats
2022-09-20 13:49:17 +00:00
DanRoscigno
bf4b12be43
rename doc
2022-09-20 09:32:35 -04:00
Filatenkov Artur
2139d5be17
Merge branch 'master' into annoy
2022-09-20 15:28:08 +03:00
Kseniia Sumarokova
364bdb0676
Update storing-data.md
2022-09-20 13:39:07 +02:00
kssenii
b8079e4577
Merge remote-tracking branch 'upstream/master' into rename-some-cache-commands
2022-09-20 13:02:18 +02:00
kssenii
6dcbeceeb9
Update doc
2022-09-20 13:00:10 +02:00
Sergei Trifonov
7902922ae4
Merge branch 'master' into readonly-settings-allow
2022-09-19 21:00:12 +02:00
Derek Chia
cb613b8675
Change input_format_skip_unknown_fields default to 1
...
As per PR https://github.com/ClickHouse/ClickHouse/pull/37192 , `input_format_skip_unknown_fields` is enabled by default. Likewise, it is also set as `true` in the factory settings https://github.com/ClickHouse/ClickHouse/blob/master/src/Core/Settings.h#L696
Updating the docs to reflect the change.
2022-09-19 22:37:03 +08:00
kssenii
972d65d575
Update doc
2022-09-19 14:08:07 +02:00
Sergei Trifonov
f7a1ed3141
Merge branch 'master' into readonly-settings-allow
2022-09-19 12:52:36 +02:00
Diego Nieto (lesandie)
1a14515e35
Fixed cache parameter name
2022-09-19 10:29:41 +02:00
Alexey Milovidov
2e5fa7880e
Update geo.md
2022-09-19 07:52:24 +03:00
Kruglov Pavel
519bcbb3be
Merge pull request #41236 from Avogar/fix-totals-extremes
...
Don't output totals/extremes in all row formats, update docs
2022-09-18 14:55:07 +02:00
Robert Schulze
38aecc15a2
Merge pull request #41214 from arenadata/ADQM-528-B
...
Add enable_extended_results_for_datetime_functions option to return results of type Date32
2022-09-17 19:25:11 +02:00
DanRoscigno
149970447a
add link to formats
2022-09-16 17:21:03 -04:00
vvbufetov
fb94e43a60
Fix the link on the original article about MaterializedView ( #41339 )
...
Fix the link on the original article about MaterializedView
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2022-09-16 17:52:32 +02:00
Kruglov Pavel
2d4a6b38af
Merge branch 'master' into fix-totals-extremes
2022-09-16 15:03:59 +02:00
Robert Schulze
b32b02d844
Merge pull request #40897 from ClickHouse/catboost-bridge-resurrected
...
Move CatBoost evaluation into clickhouse-library-bridge
2022-09-16 13:12:09 +02:00
Roman Vasin
d82cd7b007
Add many cosmetic changes to C++ code and MD docs
2022-09-16 09:37:30 +00:00
avogar
ef7f7b30aa
Fix tests
2022-09-15 18:20:17 +00:00
Roman Vasin
5c242de43a
Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-528-B
2022-09-15 13:47:51 +00:00
Roman Vasin
3ce66eab83
Correct all needed MD files
2022-09-15 13:28:11 +00:00
Roman Vasin
563449779c
Replace enable_date32_results by enable_extended_results_for_datetime_functions
2022-09-15 12:48:09 +00:00
Kseniia Sumarokova
08f00a7593
Merge pull request #41354 from ClickHouse/kssenii-patch-5
...
Update storing-data.md
2022-09-15 14:07:43 +02:00
Kseniia Sumarokova
c511c3f168
Merge pull request #40889 from AVMusorin/docs_table_function_update
...
Doc. Updated optional parameters for table functions
2022-09-15 13:12:20 +02:00
Kseniia Sumarokova
1ec7ce265b
Update storing-data.md
2022-09-15 12:30:02 +02:00
Kseniia Sumarokova
4935a4bf96
Update storing-data.md
2022-09-15 12:29:22 +02:00
JackyWoo
afcbf3a853
Merge branch 'master' into add_function_java_int_hash
2022-09-15 10:08:26 +08:00
JackyWoo
05516bfd03
fix docs
2022-09-15 10:07:39 +08:00
Denny Crane
69d90de9a3
Update date-time-functions.md
2022-09-14 15:23:59 -03:00
Denny Crane
cbdbe1077a
Update date-time-functions.md
2022-09-14 12:16:32 -03:00
Dan Roscigno
c8dcd34abe
Merge pull request #41237 from DanRoscigno/move-title
...
move title to frontmatter in troubleshooting doc
2022-09-14 10:15:18 -04:00
JackyWoo
9578594439
Merge branch 'master' into add_function_java_int_hash
2022-09-14 20:42:41 +08:00
Robert Schulze
cb04c724b9
Merge pull request #41285 from ClickHouse/fix-broken-doc-links
...
System statements docs: Fix broken links
2022-09-14 13:03:01 +02:00
Kseniia Sumarokova
bb5f9e578a
Update storing-data.md
2022-09-14 12:17:24 +02:00
JackyWoo
2c8e5f0156
Merge branch 'master' into add_function_java_int_hash
2022-09-14 10:11:15 +08:00
Robert Schulze
d071dbe5a0
Merge branch 'master' into patch-1
2022-09-13 22:27:48 +02:00
Robert Schulze
49136d26aa
docs: fix internal links
...
The links at the very beginning of
https://clickhouse.com/docs/en/sql-reference/statements/system
don't work. They are reference other sections of the same document. This
is weird because there is a small index already on the right side. I
searched our documentation and this seems to be the only pages which do
so. Therefore removing the links altogether instead of fixing them.
2022-09-13 19:45:46 +00:00
Dan Roscigno
078b9bff3c
Update docs/en/sql-reference/statements/delete.md
2022-09-13 13:18:01 -04:00
Rich Raposa
b833c39dcf
Update delete.md
2022-09-13 10:55:26 -06:00
Rich Raposa
e85b222136
Update delete.md
2022-09-13 10:54:47 -06:00
DanRoscigno
64bd1ea77a
spelling
2022-09-13 12:42:24 -04:00
DanRoscigno
fc2e7159f0
add note about privs
2022-09-13 12:40:16 -04:00
Robert Schulze
3e6821e8d7
fix: repair broken documentation links and update docs
2022-09-13 16:00:53 +00:00
JackyWoo
e3caa6f096
some fixes
2022-09-13 21:21:35 +08:00
Kruglov Pavel
17621b5607
Merge branch 'master' into fix-totals-extremes
2022-09-13 14:36:31 +02:00
Mikhail Filimonov
d2d8c179b6
Add unreserved_space column to system.disks
2022-09-13 13:16:18 +02:00
Robert Schulze
fac1be9700
chore: restore SYSTEM RELOAD MODEL(S) and moniting view SYSTEM.MODELS
...
- This commit restores statements "SYSTEM RELOAD MODEL(S)" which provide
a mechanism to update a model explicitly. It also saves potentially
unnecessary reloads of a model from disk after it's initial load.
To keep the complexity low, the semantics of "SYSTEM RELOAD MODEL(S)
was changed from eager to lazy. This means that both statements
previously immedately reloaded the specified/all models, whereas now
the statements only trigger an unload and the first call to
catboostEvaluate() does the actual load.
- Monitoring view SYSTEM.MODELS is also restored but with some obsolete
fields removed. The view was not documented in the past and for now it
remains undocumented. The commit is thus not considered a breach of
ClickHouse's public interface.
2022-09-12 19:33:02 +00:00
Kruglov Pavel
060adfbe93
Merge branch 'master' into new-json-formats
2022-09-12 19:37:46 +02:00
DanRoscigno
a3826c4b3f
move title to frontmatter
2022-09-12 13:27:52 -04:00
avogar
8ac2fc7b26
Don't outout totals/extremes in all row formats, update docs
2022-09-12 17:21:40 +00:00
Sergei Trifonov
fe88a7991d
Merge branch 'master' into readonly-settings-allow
2022-09-12 16:20:40 +02:00
Roman Vasin
bc2c2130fc
Add documentation for enable_date32_results option
2022-09-12 09:09:01 +00:00
Rich Raposa
b9e9d776f0
Update delete.md
2022-09-09 15:55:57 -06:00
rfraposa
4af246a2e0
Feedback
2022-09-09 13:59:21 -06:00
Aleksandr
503398ac96
Merge branch 'master' into docs_table_function_update
2022-09-09 20:54:28 +02:00
Rich Raposa
9870957621
Update docs/en/sql-reference/statements/delete.md
...
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
2022-09-09 12:16:54 -06:00
Rich Raposa
50789126a8
Update docs/en/sql-reference/statements/delete.md
...
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
2022-09-09 12:15:59 -06:00
Rich Raposa
34c2c4bb52
Merge branch 'master' into lightweight-delete
2022-09-09 12:13:51 -06:00
Nikolay Degterinsky
6dcaa9f14d
Merge pull request #41106 from vincentbernat/fix/docs-sync
...
docs: mention SYNC modifier for DROP and DETACH statements
2022-09-09 20:12:47 +02:00
avogar
9abc6a9c3f
Fix typos
2022-09-09 15:10:00 +00:00
DanRoscigno
afe3717761
move title to frontmatter to allow inclusion in other docs
2022-09-09 08:34:42 -04:00
avogar
ae7f9abd32
Add documentation
2022-09-09 12:04:49 +00:00
Sergei Trifonov
76eb001e78
add test for changeable_in_readonly + fix SQL in docs
2022-09-09 14:01:29 +02:00
rfraposa
18f5b5e5b0
Add docs for lightweight deletes
2022-09-08 16:05:56 -06:00
Alexey Milovidov
4d7097f47a
Merge pull request #41080 from kssenii/add-documentation-for-cache
...
Add documentation for filesystem cache
2022-09-09 00:03:16 +03:00
Alexey Milovidov
9199656175
Merge pull request #41082 from peter279k/remove_strange_train
...
Remove strange release trains
2022-09-09 00:01:35 +03:00
Denny Crane
132727d212
Doc. Fix links.
2022-09-08 14:37:42 -03:00
Sergei Trifonov
f92b6a6176
Merge branch 'master' into readonly-settings-allow
2022-09-08 17:44:32 +02:00
Alexey Milovidov
928c1cd0d4
Merge pull request #40967 from ClickHouse/alexey-milovidov-patch-4
...
Update tips.md about filesystems
2022-09-08 16:56:27 +03:00
Vincent Bernat
fab1b40928
docs: mention SYNC modifier for DROP and DETACH statements
2022-09-08 15:21:59 +02:00
Kseniia Sumarokova
7f086a94a7
Update storing-data.md
2022-09-08 12:34:58 +02:00
Vladimir C
90647cb0c5
Merge pull request #39970 from SachinSetiya/majority_quorum
...
Add majority_insert_quorum setting
2022-09-08 11:31:33 +02:00
Robert Schulze
c16707ff00
chore: delete obsolete modelEvaluate() function + SYSTEM.MODELS view
...
- The deleted function modelEvaluate() was superseded by
catboostEvaluate().
- Also delete the external model repository, as modelEvaluate() was it's
last user. Additionally remove the system view SYSTEM.MODELS for
inspecting the repository.
- SYSTEM RELOAD MODELS is also obsolete. HOWEVER, it was retained and
made a no-op instead of deleted.
Why?
The reason is that RBAC in distributed setups works by storing
privileges (granted and revoked) as plain SQL statements in Keeper.
Nodes read these statements at startup and parse them. If a privilege
for SYSTEM RELOAD MODELS exists but parser doesn't recognize it
nodes would fail to come up.
Considered but rejected alternatives:
- Ignore SYSTEM RELOAD MODELS during parsing RBAC privileges and
return an error for regular SYSTEM RELOAD MODELS SQL. Special-case
of no-op behavior, too brittle.
- Remove SYSTEM RELOAD MODELS manually from Keeper via command-line
manipulation of Keeper nodes or via SQL by dropping the privileges.
Needs user intervention during upgrade.
2022-09-08 09:10:11 +00:00
Robert Schulze
60f9f6855d
feat: implement catboost in library-bridge
...
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.
SQL syntax:
SELECT
catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
ACTION AS target
FROM amazon_train
LIMIT 10
Required configuration:
<catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>
*** Implementation Details ***
The internal protocol between the server and the library-bridge is
simple:
- HTTP GET on path "/extdict_ping":
A ping, used during the handshake to check if the library-bridge runs.
- HTTP POST on path "extdict_request"
(1) Send a "catboost_GetTreeCount" request from the server to the
bridge, containing a library path (e.g /home/user/libcatboost.so) and
a model path (e.g. /home/user/model.bin). Rirst, this unloads the
catboost library handler associated to the model path (if it was
loaded), then loads the catboost library handler associated to the
model path, then executes GetTreeCount() on the library handler and
finally sends the result back to the server. Step (1) is called once
by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
library path handler is unloaded in the beginning because it contains
state which may no longer be valid if the user runs
catboost("/path/to/model.bin", ...) more than once and if "model.bin"
was updated in between.
(2) Send "catboost_Evaluate" from the server to the bridge, containing
the model path and the features to run the interference on. Step (2)
is called multiple times (once per chunk) by the server from function
FunctionCatBoostEvaluate::executeImpl(). The library handler for the
given model path is expected to be already loaded by Step (1).
Fixes #27870
2022-09-08 09:01:32 +00:00
Alexey Milovidov
9544b8fdd6
Merge pull request #40996 from ClickHouse/vdimir/issue-40994
...
Minor update doc for mysql_port
2022-09-08 02:39:12 +03:00
Alexey Milovidov
84a00e3992
Merge pull request #41087 from peter279k/improve_clickhouse_start
...
Improve clickhouse start command
2022-09-08 02:35:02 +03:00
Kseniia Sumarokova
eb53df48d1
Update storing-data.md
2022-09-07 22:26:52 +02:00
Kseniia Sumarokova
3af51f4340
Update storing-data.md
2022-09-07 22:21:46 +02:00
Denny Crane
a75eb5ad84
Update date-time-functions.md
2022-09-07 15:59:23 -03:00
Denny Crane
0071ef9e38
Update date-time-functions.md
2022-09-07 15:56:31 -03:00
peter279k
945299de99
Remove strange release trains
2022-09-08 01:24:12 +08:00
peter279k
1ae54d3d16
Improve clickhouse start command
2022-09-08 01:18:27 +08:00
Kseniia Sumarokova
4cb07bd48d
Merge branch 'master' into add-documentation-for-cache
2022-09-07 17:52:53 +02:00
Kseniia Sumarokova
6f06633df6
Update storing-data.md
2022-09-07 13:59:39 +02:00
vdimir
000ba8a60d
Use insert_qurum = auto instead of majority_insert_quorum
2022-09-07 11:19:27 +00:00
Sachin
ade4337978
Add majority_insert_quorum setting
...
majority_insert_quorum is defined as (number_of_replicas/2)+1. Insert
will be successful only if majority of quorum have applied it. If
insert_quorum and majority_insert_quorum both are specified, max of
both will be used.
2022-09-07 11:19:24 +00:00
kssenii
613c688331
Add documentation for cache
2022-09-07 13:12:19 +02:00
peter279k
b716988991
Remove non-existed released trains
2022-09-07 18:39:38 +08:00
DanRoscigno
3073da9ba5
move doc
2022-09-06 18:39:06 -04:00
Sergei Trifonov
2a55741dcb
Merge branch 'master' into readonly-settings-allow
2022-09-06 20:29:41 +02:00
DanRoscigno
7032a1b267
move title to frontmatter
2022-09-06 11:14:55 -04:00
Sergei Trifonov
6217559175
Merge branch 'master' into readonly-settings-allow
2022-09-06 16:10:48 +02:00
Filatenkov Artur
7949b3fb74
Merge branch 'master' into annoy
2022-09-06 11:23:15 +03:00
FArthur-cmd
7f311ad03c
add words about setting to docs
2022-09-05 13:20:49 +00:00
Kruglov Pavel
582216a3ca
Merge pull request #39919 from pzhdfy/UniqSketch
...
UniqThetaSketch support set operation such as union/intersect/not
2022-09-05 13:42:14 +02:00
Vladimir C
8c3c3e7667
Minor update doc for mysql_port
2022-09-05 12:39:39 +02:00
Antonio Andelic
3a0581e990
Merge pull request #40543 from Lloyd-Pottiger/feat/support-read-only-for-embeddedrocksdb
...
Add read-only support for EmbeddedRocksDB
2022-09-05 09:31:07 +02:00
Alexey Milovidov
8ea7b9c978
Merge pull request #40980 from ClickHouse/alexey-milovidov-patch-5
...
Update replicated.md
2022-09-05 03:18:25 +03:00
Alexey Milovidov
f8e72eb7cb
Update replicated.md
2022-09-05 01:02:42 +03:00
Alexey Milovidov
053a2186b5
Update replicated.md
2022-09-05 01:01:23 +03:00
Alexey Milovidov
6a7593ec53
Merge branch 'master' into alexey-milovidov-patch-4
2022-09-04 20:30:15 +03:00
Alexey Milovidov
deeaea004d
Merge pull request #40295 from cyber-moon/patch-1
...
Add description of {condition}-keyword
2022-09-04 04:57:30 +03:00
Alexey Milovidov
7c3c367e01
Update tips.md
2022-09-04 04:18:57 +03:00
Alexey Milovidov
001733b6d0
Merge pull request #40921 from FrankChen021/mac_doc
...
Update doc about building on macOS
2022-09-04 04:05:34 +03:00
Alexey Milovidov
46f40c0c41
Merge pull request #40949 from AVMusorin/doc_generate_random_fix
...
Doc. optional params for GenerateRandom table
2022-09-04 03:54:51 +03:00
Alexey Milovidov
1963baa11e
Merge pull request #40964 from ClickHouse/fix-docs-formatting
...
Fix formatting of notes box in documentation
2022-09-04 03:39:39 +03:00
Denny Crane
dd19b0856e
Doc. mapApply, mapFilter, mapUpdate ( #40961 )
...
* Update tuple-map-functions.md
* Update tuple-map-functions.md
2022-09-04 00:43:39 +02:00
Denny Crane
f2de8ff8ff
Doc. commpressions http.md ( #40959 )
2022-09-04 00:42:47 +02:00
Robert Schulze
385427ade8
Fix formatting of notes box in documentation
...
Follow-up to PR #38435
2022-09-03 17:25:14 +00:00
Robert Schulze
5cff329439
Merge branch 'master' into typo-role-grants
2022-09-03 18:32:41 +02:00
Alexey Milovidov
1768a82a53
git checkout c4b8137d31 docs/en/getting-started/example-datasets/uk-price-paid.md
2022-09-03 06:45:18 +02:00
Aleksandr Musorin
69b9d34b10
docs. optional params for GenerateRandom table
2022-09-02 17:25:10 +02:00
Sergei Trifonov
005b2588d8
Merge branch 'master' into readonly-settings-allow
2022-09-02 16:37:43 +02:00
Sergei Trifonov
014d109175
fix build, fix docs, fix comments, logical fixes, test are still to be fixed and new test are to be added
2022-09-02 16:20:09 +02:00
Frank Chen
0f3003e37b
Add ccache brew install list
2022-09-02 16:01:31 +02:00
Robert Schulze
53836bbeeb
Fix typo
...
The system view is called 'role*_*grants', documented on page
'role*-*grants.md'.
2022-09-02 12:49:50 +00:00
Lloyd-Pottiger
5a6b2106b5
Merge branch 'master' of github.com:ClickHouse/ClickHouse into feat/support-read-only-for-embeddedrocksdb
2022-09-02 18:10:00 +08:00
Lloyd-Pottiger
59dccd6e49
fix test
...
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-09-02 11:14:49 +08:00
DanRoscigno
6efd07cbc8
correct statement
2022-09-01 20:32:06 -04:00
DanRoscigno
662eed214f
correct statements
2022-09-01 20:28:25 -04:00
Dan Roscigno
a733381821
Merge branch 'master' into update-nav
2022-09-01 16:56:43 -04:00
DanRoscigno
3e9225aafa
move title to frontmatter, remove orig article link
2022-09-01 12:24:03 -04:00
Ivan Blinkov
a947487afe
[docs] fix link markdown
2022-09-01 18:16:13 +03:00
Александр
97e55ca2f5
Merge branch 'master' into docs_table_function_update
2022-09-01 14:01:32 +02:00
Dan Roscigno
29ac78a92b
Update uk price paid ( #40828 )
2022-09-01 13:32:33 +02:00
Fangyuan Deng
bc7d661668
Merge branch 'master' into UniqSketch
2022-09-01 19:31:53 +08:00
Denny Crane
e3af5a7a11
Doc. Added ON CLUSTER cluster in couple places ( #40874 )
2022-09-01 13:31:22 +02:00
pzhdfy
acec516271
add docs
2022-09-01 19:31:01 +08:00
Aleksandr Musorin
310e1484f6
docs - updated optional parameters for table functions
2022-09-01 13:28:56 +02:00
MaceWindu
21ab72365a
Update integrations.md
...
Add linq2db to list of third-party libraries
2022-09-01 11:39:27 +02:00
Robert Schulze
56eece40ec
Merge pull request #40736 from LevyCory/add-offset-to-formatDateTime
...
Add timezone offset support to `formatDateTime`
2022-09-01 09:50:17 +02:00
Robert Schulze
912663b719
Revert "Move CatBoost evaluation into clickhouse-library-bridge"
2022-08-31 20:54:43 +02:00
Robert Schulze
ca01286028
Merge pull request #39629 from ClickHouse/catboost-bridge
...
Move CatBoost evaluation into clickhouse-library-bridge
2022-08-31 16:16:11 +02:00
DanRoscigno
50f9b12af8
review feedback
2022-08-31 09:12:48 -04:00
Dan Roscigno
ddac1b3f11
Merge pull request #40560 from DanRoscigno/add-backup
...
Add backup restore docs
2022-08-31 08:19:00 -04:00
Robert Schulze
40468d3304
Fix typo in docs
2022-08-30 20:45:31 +00:00
FArthur-cmd
e7abc06c89
Revert "Revert "Add Annoy index""
...
This reverts commit 6fdfb964d0
2022-08-30 15:26:56 +00:00
Denny Crane
0d7cc82267
Update string-functions.md
2022-08-30 11:08:23 -03:00
DanRoscigno
f72b341e8b
add status info
2022-08-30 09:34:08 -04:00
Alexander Tokmakov
6fdfb964d0
Revert "Add Annoy index"
2022-08-30 15:10:10 +03:00
Andrey Zvonov
93f9abf130
upd2
2022-08-30 14:41:40 +03:00
Andrey Zvonov
14adea8792
fix error in docs
2022-08-30 14:40:26 +03:00
Kseniia Sumarokova
c88db2ef97
Merge pull request #40751 from kssenii/fix-mysql-timeouts
...
Fix issue with mysql db / table function timeouts
2022-08-30 11:59:01 +02:00
Robert Schulze
cc4225109f
Merge pull request #37215 from Vector-Similarity-Search-for-ClickHouse/annoy-2
...
Test failures are unrelated, merging.
2022-08-30 09:25:57 +02:00
DanRoscigno
d712a91a20
add alternatives
2022-08-29 19:36:20 -04:00
DanRoscigno
0abeebd3ca
updated with dev help
2022-08-29 19:29:10 -04:00
Alexey Milovidov
0190c56faf
Merge pull request #40770 from den-crane/patch-40
...
Doc. Fix cache dictionaries doc.
2022-08-30 02:19:32 +03:00
DanRoscigno
3a65d58c13
updated with dev help
2022-08-29 18:33:26 -04:00
Cory Levy
1e2eee7146
Remove unnecessary backslashes in markdown sql blocks
2022-08-29 16:31:31 -04:00
Robert Schulze
64a6aa328e
fix: broken links in documentation (hopefully)
2022-08-29 20:27:06 +00:00
Robert Schulze
6b2b3c1eb3
feat: implement catboost in library-bridge
...
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.
SQL syntax:
SELECT
catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
ACTION AS target
FROM amazon_train
LIMIT 10
Required configuration:
<catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>
*** Implementation Details ***
The internal protocol between the server and the library-bridge is
simple:
- HTTP GET on path "/extdict_ping":
A ping, used during the handshake to check if the library-bridge runs.
- HTTP POST on path "extdict_request"
(1) Send a "catboost_GetTreeCount" request from the server to the
bridge, containing a library path (e.g /home/user/libcatboost.so) and
a model path (e.g. /home/user/model.bin). Rirst, this unloads the
catboost library handler associated to the model path (if it was
loaded), then loads the catboost library handler associated to the
model path, then executes GetTreeCount() on the library handler and
finally sends the result back to the server. Step (1) is called once
by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
library path handler is unloaded in the beginning because it contains
state which may no longer be valid if the user runs
catboost("/path/to/model.bin", ...) more than once and if "model.bin"
was updated in between.
(2) Send "catboost_Evaluate" from the server to the bridge, containing
the model path and the features to run the interference on. Step (2)
is called multiple times (once per chunk) by the server from function
FunctionCatBoostEvaluate::executeImpl(). The library handler for the
given model path is expected to be already loaded by Step (1).
Fixes #27870
2022-08-29 20:26:45 +00:00
Dan Roscigno
76a45aa750
Merge branch 'master' into add-backup
2022-08-29 16:23:53 -04:00
Denny Crane
fe0f18f21d
Update external-dicts-dict-layout.md
2022-08-29 15:19:15 -03:00
Kseniia Sumarokova
c5c48e44ea
Merge branch 'master' into fix-mysql-timeouts
2022-08-29 19:33:29 +02:00
DanRoscigno
76a3212fc8
replace symlinks
2022-08-29 12:26:17 -04:00
DanRoscigno
c4b8137d31
replace symlinks
2022-08-29 12:19:50 -04:00
Filatenkov Artur
d73f661732
Merge branch 'master' into annoy-2
2022-08-29 17:33:13 +03:00
kssenii
0a6c4b9265
Fix
2022-08-29 16:20:53 +02:00
Sergei Trifonov
899bf99d44
Merge branch 'master' into readonly-settings-allow
2022-08-29 14:35:05 +02:00
alesapin
7ce0afc0df
Merge pull request #40670 from Avogar/kafka
...
Add setting to disable limit on kafka_num_consumers
2022-08-29 10:53:35 +02:00
Cory Levy
deb2a97020
Add docs
2022-08-28 22:28:34 -04:00
DanRoscigno
b50fa8b5a9
replace symlinks
2022-08-28 17:34:50 -04:00
Dan Roscigno
96cd94196e
Merge branch 'ClickHouse:master' into add-more-slugs
2022-08-28 12:06:37 -04:00
DanRoscigno
fad2e071eb
replace symlinks with includes
2022-08-28 11:58:59 -04:00
DanRoscigno
5d1e3ee4d8
remove duplicate
2022-08-28 11:04:51 -04:00
DanRoscigno
5b5fcc56aa
add slugs
2022-08-28 10:53:34 -04:00
Alexey Milovidov
ddff5e9145
Merge pull request #40712 from ClickHouse/ci-cmake-self-extractable
...
cmake: Disable default ENABLE_CLICKHOUSE_SELF_EXTRACTING
2022-08-28 17:12:19 +03:00
DanRoscigno
db1a3b717c
add slugs
2022-08-28 09:58:27 -04:00
DanRoscigno
c4caa35cfd
add frontmatter dashes
2022-08-28 09:53:52 -04:00
Robert Schulze
df934d8762
Merge pull request #40217 from zvonand/zvonand-minmax
...
Fix conversion Date32 / DateTime64 / Date to narrow types
2022-08-28 09:42:39 +02:00
