thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-03 13:02:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
101,404 Commits 9,183 Branches 1,782 Tags 2.2 GiB
5e61022bac
Commit Graph

8373 Commits

Author SHA1 Message Date
DanRoscigno
22011aeaec remove frontmatter 2022-10-26 12:39:17 -04:00
Dan Roscigno
4bf48bce90
Merge branch 'master' into update-backup-for-s3 2022-10-26 10:38:30 -04:00
李扬
04f8f38580
Merge branch 'master' into ascii_function 2022-10-26 07:29:49 -05:00
SmitaRKulkarni
5df138da82
Merge pull request #42376 from ClickHouse/36316_Support_glob_for_recursive_directory_traversal 
Added ** glob support for recursive directory traversal to filesystem…
 2022-10-26 11:49:20 +02:00
taiyang-li
2254bef74a implement function ascii 2022-10-26 14:19:26 +08:00
Dan Roscigno
690e4e70ae
Merge branch 'master' into update-backup-for-s3 2022-10-25 21:40:49 -04:00
DanRoscigno
91c3744cfe add backup to S3 endpoint 2022-10-25 21:33:09 -04:00
ltrk2
2c902bbc65
Implement support for different UUID binary formats (#42108) 
* Implement support for different UUID binary formats

* Declare error codes that the implementation uses

* Make single-argument constructor explicit

* Modernize parts of the solution

* Make improvements based on review comments

* Declare an error code being used
 2022-10-25 21:57:50 +02:00
Dan Roscigno
1e53fd7374
Merge branch 'master' into add_deb_migration 2022-10-25 10:29:54 -04:00
peter279k
7626406b86 Add two troubleshootings about installation 2022-10-25 21:53:28 +08:00
JackyWoo
c7a0ebeb05 little fix 2022-10-25 17:46:24 +08:00
JackyWoo
9a36a509fe fix test 2022-10-25 17:15:49 +08:00
peter279k
dd4121a290 Migration method for installing the deb-packages 2022-10-25 15:27:52 +08:00
Dan Roscigno
0c50114190
Update Fedora build info 
I am using Fedora 36.

yum install of `clang-c++` failed for me, `clang` worked.  And I had an error message telling me to install `ccache` also.
 2022-10-24 14:41:38 -04:00
SmitaRKulkarni
96c8260230
Merge branch 'master' into 36316_Support_glob_for_recursive_directory_traversal 2022-10-24 18:34:19 +02:00
JackyWoo
b5d1c4e657 replace snpd with lgif 2022-10-24 20:08:58 +08:00
Alexey Milovidov
9b1b436e4d
Merge branch 'master' into DanRoscigno-patch-2 2022-10-24 10:28:29 +02:00
Robert Schulze
b746224217
Merge pull request #42554 from arenadata/ADQM-604 
Add support of Date32 arguments for dateName function
 2022-10-22 17:20:10 +02:00
JackyWoo
39c88c74e8 check whether last manually created snapshot is done 2022-10-22 22:31:17 +08:00
JackyWoo
bf291790b7
Merge branch 'master' into manual_snapshot_for_keeper 2022-10-22 16:57:50 +08:00
Alexey Milovidov
bc6762d613
Merge pull request #42565 from alexeyerm/other-functions.md-fix 
other-functions.md example fix
 2022-10-22 04:20:23 +02:00
Alexey Milovidov
592fbb3eaf
Merge pull request #42367 from ClickHouse/revert-40217 
Revert #40217
 2022-10-21 21:56:15 +02:00
Dan Roscigno
440af00c74
Merge pull request #42151 from ClickHouse/remove-misc-statements 
Docs: Remove obsolete misc page
 2022-10-21 13:48:53 -04:00
alexeyerm
9abfe76fbb
doc fix fix 2022-10-21 20:08:44 +03:00
alexeyerm
95943dbdda
fix transform() example 2022-10-21 19:44:35 +03:00
DanRoscigno
52ca29140e WIP: add Superset deploy instructions 2022-10-21 12:27:20 -04:00
Robert Schulze
2d448c139c
Merge pull request #42308 from arenadata/ADQM-584 
Add support of Date32 arguments for date_diff function
 2022-10-21 13:18:44 +02:00
Roman Vasin
537f7000d6 Update documentation 2022-10-21 06:55:24 +00:00
Alexey Milovidov
48694def2c
Merge branch 'master' into revert-40217 2022-10-21 05:49:34 +02:00
Alexey Milovidov
b720030ac6 Remove outdated documentation 2022-10-21 00:13:30 +02:00
Robert Schulze
9b7294ef45
Merge remote-tracking branch 'origin/master' into revert-40217 2022-10-20 15:27:31 +00:00
Robert Schulze
42f680849c
Fix bad_cast in Annoy index 
- Problem originally found by data type fuzzer
  https://s3.amazonaws.com/clickhouse-test-reports/42180/2f83d8790581dce0ffeec56c137b1d13160cfa7b/fuzzer_astfuzzermsan//report.html

- This commit restricts which data types are allowed for Annoy indexes
  (similar things are done for other index types).
 2022-10-19 13:40:39 +00:00
DanRoscigno
e76560619c moved into dev/getting-started 2022-10-18 14:52:28 -04:00
Dan Roscigno
b125fd8718
Update uk-price-paid.md 2022-10-18 09:34:53 -04:00
Kruglov Pavel
9588653a6e
Merge branch 'master' into improve-schema-inference-insert-select 2022-10-18 15:17:27 +02:00
Smita Kulkarni
32fad205f0 Added documentation for file and s3 - 36316 Support ** glob for recursive directory traversal 2022-10-18 14:08:26 +02:00
Vitaly Baranov
eb637a6f81
Merge pull request #42232 from azat/backups/s3 
Support BACKUP to S3 with as-is path/data structure
 2022-10-18 02:37:07 +02:00
Alexey Milovidov
d1f0c80ffe Revert "Merge pull request #40217 from zvonand/zvonand-minmax" 
This reverts commit df934d8762, reversing
changes made to d3a7945b1b.
 2022-10-17 04:57:15 +02:00
Alexey Milovidov
9ccbadc359
Merge pull request #42275 from zimv/doc-update-client-libraries 
Docs: Add  "node-clickhouse-orm" to the client-libraries.md
 2022-10-15 08:18:16 +02:00
Kruglov Pavel
6fc12dd922
Merge pull request #41703 from Avogar/json-object-each-row 
Add setting to obtain object name as column value in JSONObjectEachRow format
 2022-10-14 20:11:04 +02:00
Kruglov Pavel
f1dd247181
Merge branch 'master' into improve-schema-inference-insert-select 2022-10-14 17:16:58 +02:00
avogar
2b150a575e Add docs 2022-10-14 15:15:03 +00:00
Azat Khuzhin
8830f0608d Support BACKUP to S3 with as-is path/data structure 
Right now backup to S3 does not make a lot of sense, since:
- it has random names, and to decoding them
- requires metadata from local disk (/var/lib/disks/DISK/BACKUP_NAME)
- or send_metadata (but it is also tricky even with it)

So this patch adds simpler interface for S3, it is only suitable for
BACKUP/RESTORE, so don't try to use it for MergeTree engine.

It is done by adding separate disk - `s3_plain` for this, that:
- does not support any extended features, like renames/hardlinks/attrs/...
  (so basically everything that MergeTree requires)
- only write/read/unlink/list files

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-14 12:59:25 +02:00
Roman Vasin
90f9bd24a3 Update documentation 2022-10-14 08:02:38 +00:00
zimv
56ef17e083 Docs: Add "node-clickhouse-orm" to the client-libraries.md 2022-10-13 14:57:35 +08:00
Alexey Milovidov
5b6be92042
Update build.md 2022-10-13 05:31:50 +03:00
vdimir
0178307c27 Followup for TemporaryDataOnDisk 2022-10-12 15:25:23 +02:00
lixuchun
b724b7a74a update docs error 2022-10-12 11:57:35 +08:00
Alexey Milovidov
023f11fb86
Update developer-instruction.md 2022-10-09 03:54:00 +03:00
Alexey Milovidov
9bf5fe728b
Merge pull request #42173 from ClickHouse/remove-temporary-live-view 
Remove TEMPORARY LIVE VIEW
 2022-10-08 19:05:33 +03:00
Alexey Milovidov
b9159db82f Remove temporary live views 2022-10-08 00:16:36 +02:00
Robert Schulze
3e3c0a7bb6
Docs: Add "TABLE" to CHECK/DESCRIBE statements in sidebar 2022-10-07 14:41:00 +00:00
Robert Schulze
cde0257d11
Docs: Remove obsolete pages 
Removes page https://clickhouse.com/docs/en/sql-reference/statements/misc

It indexes "miscellaneous" SQL statements but these are already easily
reachable by the sidebar.
 2022-10-07 14:37:22 +00:00
Robert Schulze
e759a64d38
Docs: Redirect links to misc.md 
--> https://clickhouse.com/docs/en/sql-reference/statements/misc

This page indexes a bunch of SQL statements but they are easily
reachable by the sidebar already.
 2022-10-07 13:22:40 +00:00
Nikolay Degterinsky
522948fa2a
Merge branch 'master' into patch-1 2022-10-06 17:47:36 +02:00
Dan Roscigno
41fb3cb7da
Merge branch 'master' into combine-requirements-install-docs 2022-10-06 09:39:11 -04:00
DanRoscigno
655d2b298d adjust heading level 2022-10-06 09:38:30 -04:00
Kseniia Sumarokova
3cff776109
Merge pull request #41254 from filimonov/system_disks_unreserved_space 
Add unreserved_space column to system.disks
 2022-10-06 12:28:23 +02:00
DanRoscigno
12acfb9943 code review, preserve link 2022-10-05 12:04:00 -04:00
Nikolay Degterinsky
61ec576900
Merge branch 'master' into patch-1 2022-10-05 16:18:08 +02:00
DanRoscigno
5b22f63d07 updated packages URL 2022-10-05 09:49:55 -04:00
Maksim Kita
324c922121
Merge pull request #42069 from den-crane/patch-52 
Doc. Some clarification about log_formatted_queries setting
 2022-10-05 13:41:25 +03:00
Adam Rutkowski
3c4eae4276
Fix tag mismatch in sample users config 2022-10-05 09:55:28 +02:00
Nikolay Degterinsky
980600dc2f
Merge pull request #41206 from canhld94/ch_canh_fix_decrypt_with_null 
Add function tryDecrypt that returns NULL when decrypt fail
 2022-10-05 09:13:36 +02:00
Denny Crane
5341bf445a
Update settings.md 2022-10-04 15:08:29 -03:00
Dan Roscigno
f4f85a069b
Go live with doc updates (#42053) 
* QIP to add overview page

* wip

* New Tutorial and Datasets landing page

* give an example for Cloud

* Update UK Price Paid for Cloud

* Update nyc-taxi.md

* add option for Cloud Load Data button

* Removed the Import Raw Data section

* Update nyc-taxi.md

* update user management and replication docs

* mark self managed

* set doc ordering

* add redirects setting

* Simple fixes to index.md

Co-authored-by: rfraposa <richraposa@gmail.com>
 2022-10-04 14:36:59 +03:00
Nikita Mikhaylov
d767e1f0d8
Added an option to specify environment name in Sentry's config (#42037) 2022-10-04 13:23:51 +02:00
Duc Canh Le
a886804cbf Merge branch 'master' into ch_canh_fix_decrypt_with_null 2022-10-04 13:20:29 +08:00
Sergei Trifonov
a2cf5a650e
Merge pull request #41989 from alexey-ivanov-official/fix-cumulative-sum-documentation-bug 
Fix "Cumulative sum" example in "Window functions"
 2022-10-03 18:19:51 +02:00
Sergei Trifonov
939b9091cc
Merge pull request #42007 from aldy505/master 
docs(statements): specify ON CLUSTER clause for CREATE ROLE
 2022-10-03 15:13:25 +02:00
Sergei Trifonov
ea13b81cc3
Merge pull request #42016 from peter279k/improve_mysql_interface_setting 
Improve the MySQL interface usage description
 2022-10-03 15:04:15 +02:00
Kseniia Sumarokova
0bfbb5c38a
Merge branch 'master' into system_disks_unreserved_space 2022-10-03 14:25:47 +02:00
Duc Canh Le
fbb9b3f5ab Merge branch 'master' into ch_canh_fix_decrypt_with_null 2022-10-03 17:56:06 +08:00
peter279k
fc382a0144 Improve the MySQL interface usage description 2022-10-03 17:19:02 +08:00
peter279k
2c30b5febb Improve gRPC client example 2022-10-03 16:54:35 +08:00
Robert Schulze
8e727d4fbc
Merge pull request #41910 from arenadata/ADQM-583 
Improve enable_extended_results_for_datetime_functions option to return results of type DateTime64
 2022-10-02 20:46:51 +02:00
Alexey Milovidov
0d1d177013
Merge pull request #41131 from JackyWoo/add_function_java_int_hash 
Support Java integers hashing in `javaHash`
 2022-10-02 18:10:51 +03:00
Duc Canh Le
99bf356220
Merge branch 'master' into ch_canh_fix_decrypt_with_null 2022-10-02 14:35:42 +08:00
Reinaldy Rafli
b52d58dcae
docs(statements): specify ON CLUSTER clause for CREATE ROLE 2022-10-02 09:51:17 +07:00
Alexey Milovidov
b9e8ae2fd9
Merge pull request #41913 from BoloniniD/Corrosion_docs 
Fix Rust integration docs
 2022-10-01 18:17:19 +03:00
Alexey Ivanov
5e290da99b
Fix "Cumulative sum" example in "Window functions" 
Fixes a problem in "Cumulative sum" example in "Window functions" documentation, 
when CREATE TABLE part of example was not match to SQL examples.

see: https://clickhouse.com/docs/en/sql-reference/window-functions/#cumulative-sum
 2022-10-01 17:49:20 +03:00
Alexey Milovidov
c177061f75
Merge pull request #41958 from dbanda/patch-1 
Update criteo.md
 2022-09-30 22:37:41 +03:00
Alexey Milovidov
a92e24fdc1
Update criteo.md 2022-09-30 17:37:51 +03:00
Vladimir C
895afdec45
Merge pull request #40893 from ClickHouse/vdimir/track-tmp-disk 2022-09-30 11:27:24 +02:00
Roman Vasin
f716fc2fe5 Put list of functions in correct order in docs; Use new formatting in exception messages. 2022-09-30 07:54:35 +00:00
Dalitso Banda
b7d65f7a2d
Update criteo.md 
The new spec states that MergeTree does not take any parameters. Updating the doc to reflect this.
 2022-09-29 20:17:42 -07:00
Roman Vasin
45414b251d Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-583 2022-09-29 17:02:49 +00:00
Roman Vasin
9dfb2d058c Add DateTime64 returing functions in Note box 2022-09-29 14:23:50 +00:00
Raúl Marín
7c38b3f60d Update MergeTree settings docs to match current defaults 2022-09-29 14:12:10 +02:00
Robert Schulze
6381631836
Merge pull request #41824 from ClickHouse/tryBase58 
Add function tryBase58Decode()
 2022-09-29 12:38:58 +02:00
vdimir
367c77f0fb
Check if tmp volume contains only local disks 2022-09-29 09:51:39 +00:00
Robert Schulze
6379cb41ce
Merge branch 'master' into fix-links 2022-09-29 09:17:39 +02:00
BoloniniD
fcb039d465 Fix docs for corrosion 2022-09-28 22:24:26 +03:00
Kruglov Pavel
9c1e654584
Fix typo 2022-09-28 16:38:04 +02:00
Roman Vasin
109c5ee1a1 Update docs for DateTime64 return types. 2022-09-28 12:49:58 +00:00
avogar
03ee7efcb9 Better example in docs 2022-09-28 12:48:31 +00:00
Robert Schulze
fa93952231
Docs: Reference external papers as DOIs 
See also #31076 which noted that links were broken but didn't fix.
 2022-09-28 12:21:58 +00:00
Kruglov Pavel
bfddb91c9a
Update docs/en/interfaces/formats.md 
Co-authored-by: Sergei Trifonov <svtrifonov@gmail.com>
 2022-09-28 14:15:53 +02:00
Kruglov Pavel
f1ac2d66be
Merge branch 'master' into json-object-each-row 2022-09-28 14:15:02 +02:00
Duc Canh Le
6fd234d652 fix document typo and format 2022-09-28 20:06:18 +08:00
Robert Schulze
82139fad0e
Docs: Remove obsolete modelEvaluate() mention 2022-09-28 11:47:16 +00:00
Duc Canh Le
170ca26435 add document 2022-09-28 17:55:20 +08:00
Alexey Milovidov
683b7e5e95
Merge branch 'master' into add_function_java_int_hash 2022-09-28 01:30:26 +03:00
Dan Roscigno
4f23f6ef25
fix other links 
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
 2022-09-27 14:07:35 -04:00
DanRoscigno
4be153cbd3 fix link from intro 2022-09-27 10:21:35 -04:00
Robert Schulze
33891c275e
Fix typo 2022-09-27 10:20:39 +00:00
Robert Schulze
aa7e62ad5f
Add functio ntryBase58Decode() 
- makes it consistent with tryBase64Decode(), follow-up to #39292

- additionally the following minor changes:

  - rename Common/base58.h|cpp to Common/Base58.h|cpp for constency with
    Common/Base64.h|cpp

  - check that (encode|decode|tryDecode)Base64() gets just one argument
 2022-09-27 10:18:36 +00:00
JackyWoo
dfb2be3a67 fix docs 2022-09-26 18:34:53 +08:00
JackyWoo
d1c85f68e8 manually snapshot creation for keeper 2022-09-26 18:29:15 +08:00
Dan Roscigno
636d2f9fbf
Merge branch 'master' into format-cell-tower-dataset 2022-09-23 13:32:52 -04:00
DanRoscigno
f2cbe97223 reformat cell tower example doc 2022-09-23 13:28:29 -04:00
Kseniia Sumarokova
4b170cc1cf
Update storing-data.md 2022-09-23 12:54:10 +02:00
avogar
4f32ef9bb7 Add docs 2022-09-22 17:04:42 +00:00
Kseniia Sumarokova
951a85a0fb
Update storing-data.md 2022-09-22 17:04:44 +02:00
Kseniia Sumarokova
a6b1586b17
Update storing-data.md 2022-09-22 17:03:19 +02:00
kssenii
f038c7ea00 Better config for cache 2022-09-22 14:50:29 +02:00
Kseniia Sumarokova
5caac39328
Merge pull request #41508 from kssenii/rename-some-cache-commands 
Rename: `show caches` -> `show filesystem caches`, `describe cache` -> `describe filesystem cache`
 2022-09-22 13:09:14 +02:00
Alexey Milovidov
bca4cc98c3
Merge pull request #41595 from Algunenano/fix_variadic_reading_random_data 
Do not process rows in aggregations if any of the parameters is NULL
 2022-09-22 07:57:37 +03:00
Peignon Melvyn
d040e41460
Update http.md 2022-09-22 00:23:05 +02:00
Denny Crane
a59f7a3aa9
Update tuple.md 2022-09-21 13:00:46 -03:00
Kruglov Pavel
22e11aef2d
Merge pull request #40910 from Avogar/new-json-formats 
Add new JSON formats, add improvements and refactoring
 2022-09-21 14:19:08 +02:00
Robert Schulze
186d4e4140
Merge pull request #40818 from Vector-Similarity-Search-for-ClickHouse/annoy 
Add annoy index
 2022-09-21 13:42:43 +02:00
Kseniia Sumarokova
1e7308832c
Merge branch 'master' into system_disks_unreserved_space 2022-09-21 13:04:39 +02:00
Raúl Marín
fd503b34d9 Remove any processing of undelying values for NULLs 2022-09-20 18:43:21 +02:00
avogar
868ce8bc16 Fix comments, make better naming, add docs, add setting output_format_json_quote_64bit_floats 2022-09-20 13:49:17 +00:00
DanRoscigno
bf4b12be43 rename doc 2022-09-20 09:32:35 -04:00
Filatenkov Artur
2139d5be17
Merge branch 'master' into annoy 2022-09-20 15:28:08 +03:00
Kseniia Sumarokova
364bdb0676
Update storing-data.md 2022-09-20 13:39:07 +02:00
kssenii
b8079e4577 Merge remote-tracking branch 'upstream/master' into rename-some-cache-commands 2022-09-20 13:02:18 +02:00
kssenii
6dcbeceeb9 Update doc 2022-09-20 13:00:10 +02:00
Sergei Trifonov
7902922ae4
Merge branch 'master' into readonly-settings-allow 2022-09-19 21:00:12 +02:00
Derek Chia
cb613b8675
Change input_format_skip_unknown_fields default to 1 
As per PR https://github.com/ClickHouse/ClickHouse/pull/37192, `input_format_skip_unknown_fields` is enabled by default. Likewise, it is also set as `true` in the factory settings https://github.com/ClickHouse/ClickHouse/blob/master/src/Core/Settings.h#L696

Updating the docs to reflect the change.
 2022-09-19 22:37:03 +08:00
kssenii
972d65d575 Update doc 2022-09-19 14:08:07 +02:00
Sergei Trifonov
f7a1ed3141
Merge branch 'master' into readonly-settings-allow 2022-09-19 12:52:36 +02:00
Diego Nieto (lesandie)
1a14515e35 Fixed cache parameter name 2022-09-19 10:29:41 +02:00
Alexey Milovidov
2e5fa7880e
Update geo.md 2022-09-19 07:52:24 +03:00
Kruglov Pavel
519bcbb3be
Merge pull request #41236 from Avogar/fix-totals-extremes 
Don't output totals/extremes in all row formats, update docs
 2022-09-18 14:55:07 +02:00
Robert Schulze
38aecc15a2
Merge pull request #41214 from arenadata/ADQM-528-B 
Add enable_extended_results_for_datetime_functions option to return results of type Date32
 2022-09-17 19:25:11 +02:00
DanRoscigno
149970447a add link to formats 2022-09-16 17:21:03 -04:00
vvbufetov
fb94e43a60
Fix the link on the original article about MaterializedView (#41339) 
Fix the link on the original article about MaterializedView

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2022-09-16 17:52:32 +02:00
Kruglov Pavel
2d4a6b38af
Merge branch 'master' into fix-totals-extremes 2022-09-16 15:03:59 +02:00
Robert Schulze
b32b02d844
Merge pull request #40897 from ClickHouse/catboost-bridge-resurrected 
Move CatBoost evaluation into clickhouse-library-bridge
 2022-09-16 13:12:09 +02:00
Roman Vasin
d82cd7b007 Add many cosmetic changes to C++ code and MD docs 2022-09-16 09:37:30 +00:00
avogar
ef7f7b30aa Fix tests 2022-09-15 18:20:17 +00:00
Roman Vasin
5c242de43a Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-528-B 2022-09-15 13:47:51 +00:00
Roman Vasin
3ce66eab83 Correct all needed MD files 2022-09-15 13:28:11 +00:00
Roman Vasin
563449779c Replace enable_date32_results by enable_extended_results_for_datetime_functions 2022-09-15 12:48:09 +00:00
Kseniia Sumarokova
08f00a7593
Merge pull request #41354 from ClickHouse/kssenii-patch-5 
Update storing-data.md
 2022-09-15 14:07:43 +02:00
Kseniia Sumarokova
c511c3f168
Merge pull request #40889 from AVMusorin/docs_table_function_update 
Doc. Updated optional parameters for table functions
 2022-09-15 13:12:20 +02:00
Kseniia Sumarokova
1ec7ce265b
Update storing-data.md 2022-09-15 12:30:02 +02:00
Kseniia Sumarokova
4935a4bf96
Update storing-data.md 2022-09-15 12:29:22 +02:00
JackyWoo
afcbf3a853
Merge branch 'master' into add_function_java_int_hash 2022-09-15 10:08:26 +08:00
JackyWoo
05516bfd03 fix docs 2022-09-15 10:07:39 +08:00
Denny Crane
69d90de9a3
Update date-time-functions.md 2022-09-14 15:23:59 -03:00
Denny Crane
cbdbe1077a
Update date-time-functions.md 2022-09-14 12:16:32 -03:00
Dan Roscigno
c8dcd34abe
Merge pull request #41237 from DanRoscigno/move-title 
move title to frontmatter in troubleshooting doc
 2022-09-14 10:15:18 -04:00
JackyWoo
9578594439
Merge branch 'master' into add_function_java_int_hash 2022-09-14 20:42:41 +08:00
Robert Schulze
cb04c724b9
Merge pull request #41285 from ClickHouse/fix-broken-doc-links 
System statements docs: Fix broken links
 2022-09-14 13:03:01 +02:00
Kseniia Sumarokova
bb5f9e578a
Update storing-data.md 2022-09-14 12:17:24 +02:00
JackyWoo
2c8e5f0156 Merge branch 'master' into add_function_java_int_hash 2022-09-14 10:11:15 +08:00
Robert Schulze
d071dbe5a0
Merge branch 'master' into patch-1 2022-09-13 22:27:48 +02:00
Robert Schulze
49136d26aa
docs: fix internal links 
The links at the very beginning of
https://clickhouse.com/docs/en/sql-reference/statements/system
don't work. They are reference other sections of the same document. This
is weird because there is a small index already on the right side. I
searched our documentation and this seems to be the only pages which do
so. Therefore removing the links altogether instead of fixing them.
 2022-09-13 19:45:46 +00:00
Dan Roscigno
078b9bff3c
Update docs/en/sql-reference/statements/delete.md 2022-09-13 13:18:01 -04:00
Rich Raposa
b833c39dcf
Update delete.md 2022-09-13 10:55:26 -06:00
Rich Raposa
e85b222136
Update delete.md 2022-09-13 10:54:47 -06:00
DanRoscigno
64bd1ea77a spelling 2022-09-13 12:42:24 -04:00
DanRoscigno
fc2e7159f0 add note about privs 2022-09-13 12:40:16 -04:00
Robert Schulze
3e6821e8d7
fix: repair broken documentation links and update docs 2022-09-13 16:00:53 +00:00
JackyWoo
e3caa6f096 some fixes 2022-09-13 21:21:35 +08:00
Kruglov Pavel
17621b5607
Merge branch 'master' into fix-totals-extremes 2022-09-13 14:36:31 +02:00
Mikhail Filimonov
d2d8c179b6
Add unreserved_space column to system.disks 2022-09-13 13:16:18 +02:00
Robert Schulze
fac1be9700
chore: restore SYSTEM RELOAD MODEL(S) and moniting view SYSTEM.MODELS 
- This commit restores statements "SYSTEM RELOAD MODEL(S)" which provide
  a mechanism to update a model explicitly. It also saves potentially
  unnecessary reloads of a model from disk after it's initial load.

  To keep the complexity low, the semantics of "SYSTEM RELOAD MODEL(S)
  was changed from eager to lazy. This means that both statements
  previously immedately reloaded the specified/all models, whereas now
  the statements only trigger an unload and the first call to
  catboostEvaluate() does the actual load.

- Monitoring view SYSTEM.MODELS is also restored but with some obsolete
  fields removed. The view was not documented in the past and for now it
  remains undocumented. The commit is thus not considered a breach of
  ClickHouse's public interface.
 2022-09-12 19:33:02 +00:00
Kruglov Pavel
060adfbe93
Merge branch 'master' into new-json-formats 2022-09-12 19:37:46 +02:00
DanRoscigno
a3826c4b3f move title to frontmatter 2022-09-12 13:27:52 -04:00
avogar
8ac2fc7b26 Don't outout totals/extremes in all row formats, update docs 2022-09-12 17:21:40 +00:00
Sergei Trifonov
fe88a7991d
Merge branch 'master' into readonly-settings-allow 2022-09-12 16:20:40 +02:00
Roman Vasin
bc2c2130fc Add documentation for enable_date32_results option 2022-09-12 09:09:01 +00:00
Rich Raposa
b9e9d776f0
Update delete.md 2022-09-09 15:55:57 -06:00
rfraposa
4af246a2e0 Feedback 2022-09-09 13:59:21 -06:00
Aleksandr
503398ac96
Merge branch 'master' into docs_table_function_update 2022-09-09 20:54:28 +02:00
Rich Raposa
9870957621
Update docs/en/sql-reference/statements/delete.md 
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
 2022-09-09 12:16:54 -06:00
Rich Raposa
50789126a8
Update docs/en/sql-reference/statements/delete.md 
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
 2022-09-09 12:15:59 -06:00
Rich Raposa
34c2c4bb52
Merge branch 'master' into lightweight-delete 2022-09-09 12:13:51 -06:00
Nikolay Degterinsky
6dcaa9f14d
Merge pull request #41106 from vincentbernat/fix/docs-sync 
docs: mention SYNC modifier for DROP and DETACH statements
 2022-09-09 20:12:47 +02:00
avogar
9abc6a9c3f Fix typos 2022-09-09 15:10:00 +00:00
DanRoscigno
afe3717761 move title to frontmatter to allow inclusion in other docs 2022-09-09 08:34:42 -04:00
avogar
ae7f9abd32 Add documentation 2022-09-09 12:04:49 +00:00
Sergei Trifonov
76eb001e78 add test for changeable_in_readonly + fix SQL in docs 2022-09-09 14:01:29 +02:00
rfraposa
18f5b5e5b0 Add docs for lightweight deletes 2022-09-08 16:05:56 -06:00
Alexey Milovidov
4d7097f47a
Merge pull request #41080 from kssenii/add-documentation-for-cache 
Add documentation for filesystem cache
 2022-09-09 00:03:16 +03:00
Alexey Milovidov
9199656175
Merge pull request #41082 from peter279k/remove_strange_train 
Remove strange release trains
 2022-09-09 00:01:35 +03:00
Denny Crane
132727d212
Doc. Fix links. 2022-09-08 14:37:42 -03:00
Sergei Trifonov
f92b6a6176
Merge branch 'master' into readonly-settings-allow 2022-09-08 17:44:32 +02:00
Alexey Milovidov
928c1cd0d4
Merge pull request #40967 from ClickHouse/alexey-milovidov-patch-4 
Update tips.md about filesystems
 2022-09-08 16:56:27 +03:00
Vincent Bernat
fab1b40928 docs: mention SYNC modifier for DROP and DETACH statements 2022-09-08 15:21:59 +02:00
Kseniia Sumarokova
7f086a94a7
Update storing-data.md 2022-09-08 12:34:58 +02:00
Vladimir C
90647cb0c5
Merge pull request #39970 from SachinSetiya/majority_quorum 
Add majority_insert_quorum setting
 2022-09-08 11:31:33 +02:00
Robert Schulze
c16707ff00
chore: delete obsolete modelEvaluate() function + SYSTEM.MODELS view 
- The deleted function modelEvaluate() was superseded by
  catboostEvaluate().

- Also delete the external model repository, as modelEvaluate() was it's
  last user. Additionally remove the system view SYSTEM.MODELS for
  inspecting the repository.

- SYSTEM RELOAD MODELS is also obsolete. HOWEVER, it was retained and
  made a no-op instead of deleted.

  Why?
  The reason is that RBAC in distributed setups works by storing
  privileges (granted and revoked) as plain SQL statements in Keeper.
  Nodes read these statements at startup and parse them. If a privilege
  for SYSTEM RELOAD MODELS exists but parser doesn't recognize it
  nodes would fail to come up.

  Considered but rejected alternatives:
  - Ignore SYSTEM RELOAD MODELS during parsing RBAC privileges and
    return an error for regular SYSTEM RELOAD MODELS SQL. Special-case
    of no-op behavior, too brittle.
  - Remove SYSTEM RELOAD MODELS manually from Keeper via command-line
    manipulation of Keeper nodes or via SQL by dropping the privileges.
    Needs user intervention during upgrade.
 2022-09-08 09:10:11 +00:00
Robert Schulze
60f9f6855d
feat: implement catboost in library-bridge 
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
 2022-09-08 09:01:32 +00:00
Alexey Milovidov
9544b8fdd6
Merge pull request #40996 from ClickHouse/vdimir/issue-40994 
Minor update doc for mysql_port
 2022-09-08 02:39:12 +03:00