Commit Graph

8933 Commits

Author SHA1 Message Date
JackyWoo
f8d71f60a2
Merge branch 'master' into keeper_manually_assign_leader 2022-11-16 09:34:40 +08:00
李扬
d9adf2f02d
fix doc 2022-11-16 09:34:04 +08:00
Dan Roscigno
b178a3711c
Merge branch 'master' into standardize-dictionary-categories 2022-11-15 16:18:18 -05:00
DanRoscigno
c60b98f576 updates from review 2022-11-15 16:17:43 -05:00
Dan Roscigno
fbff52847c
Merge pull request #43242 from cwurm/datetime_spelling
Docs: Unify spelling of DateTime
2022-11-15 15:09:35 -05:00
DanRoscigno
7e08798fa8 edits 2022-11-15 13:47:50 -05:00
Camilo Sierra
2a48fb344d
Added examples and extra info to projections
I have added two examples about how we can use projections
2022-11-15 19:22:46 +01:00
DanRoscigno
63ae261119 move tip to snippet 2022-11-15 12:44:54 -05:00
DanRoscigno
5aae1d0724 update note ot include default user 2022-11-15 10:49:13 -05:00
avogar
2af60f34eb Restrict document size in parallel parsing, allow to read ObjectId/JS code into String column 2022-11-15 13:35:17 +00:00
avogar
4d993e653a Fix build and style 2022-11-15 13:06:24 +00:00
Christoph Wurm
2a9ab046dd Unify spelling of DateTime 2022-11-15 11:51:14 +00:00
Kseniia Sumarokova
59cf5def67
Merge branch 'master' into disk-s3-throttler 2022-11-15 12:13:37 +01:00
freedomDR
37c448c6be complete unhex doc 2022-11-15 12:33:14 +08:00
Dan Roscigno
b5a306c4db
Merge branch 'master' into standardize-dictionary-categories 2022-11-14 21:30:05 -05:00
taiyang-li
7178d80c51 Merge branch 'function_factorial' of https://github.com/bigo-sg/ClickHouse into function_factorial 2022-11-15 09:46:44 +08:00
taiyang-li
5eba20e119 modify return type from Int64 to UInt64 2022-11-15 09:46:24 +08:00
李扬
10449247fd
Merge branch 'master' into function_factorial 2022-11-15 09:34:43 +08:00
李扬
1de5bb2392
Add function canonicalRand (#43124)
* add function canonicalRand

* add perf test

* revert rand.xml
2022-11-15 00:27:19 +01:00
李扬
ef45889ecb
Add function pmod which return non-negative result based on modulo (#42755)
* add function positive_modulo

* add ducument

* fix type deduction of positive_modulo

* add function positive_modulo

* add ducument

* fix type deduction of positive_modulo

* add notice

* fix typo

* fix typo

* fix bug

* fix ub error

* fix ub error
2022-11-15 00:15:58 +01:00
Dan Roscigno
b30a0656e1
Merge pull request #43226 from ClickHouse/DanRoscigno-patch-4
Update set-role.md
2022-11-14 17:01:51 -05:00
Dale Mcdiarmid
fcf8e5bfd0 Merge remote-tracking branch 'upstream/master' into git_analysis 2022-11-14 20:07:21 +00:00
Dale Mcdiarmid
d557bece04 fix consecutive days query 2022-11-14 20:06:41 +00:00
avogar
842d25c358 Minor improvements, better docs 2022-11-14 20:05:01 +00:00
Dan Roscigno
00fe401961
Merge pull request #43224 from ClickHouse/DanRoscigno-patch-2
Update permissions-for-queries.md
2022-11-14 14:35:12 -05:00
DanRoscigno
5d6c622e40 apply suggestions and simplify 2022-11-14 14:20:55 -05:00
Dan Roscigno
4b182e7b58
Update set-role.md 2022-11-14 12:17:31 -05:00
DanRoscigno
446c029810 make read only clearer 2022-11-14 11:53:44 -05:00
Dan Roscigno
b8bb7e3842
Merge branch 'master' into git_analysis 2022-11-14 11:36:02 -05:00
Dan Roscigno
4a90f8d3f5
Update permissions-for-queries.md
closes https://github.com/ClickHouse/ClickHouse/issues/43068
2022-11-14 11:34:06 -05:00
Dale Mcdiarmid
3c21c1cba7 fixed tests query 2022-11-14 14:00:47 +00:00
Kruglov Pavel
58b7f6ca04
Merge pull request #42320 from Avogar/improve-schema-inference-insert-select
Improve using structure from insertion table in table functions
2022-11-14 14:51:27 +01:00
Dale Mcdiarmid
a0fadf8ba7 more improvements + flipped sankey 2022-11-14 09:59:47 +00:00
Roman Vasin
ee0baa679b Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-623 2022-11-14 09:45:32 +00:00
李扬
bf88816da4
Merge branch 'master' into function_factorial 2022-11-14 10:30:41 +08:00
Dale Mcdiarmid
c2a3d83197 fix link 2022-11-12 20:20:35 +00:00
Dale Mcdiarmid
b5428f535e fix 2022-11-12 20:19:29 +00:00
FArthur-cmd
5eebc27d24 improve test 2022-11-12 09:23:49 +00:00
Smita Kulkarni
4dec8337f0 Merge branch 'master' into 40907_Parameterized_views_as_table_functions 2022-11-11 19:04:35 +01:00
Dale Mcdiarmid
b010645c91 play links 2022-11-11 13:40:10 +00:00
avogar
564d83bbc7 Better handle uint64 2022-11-11 13:24:12 +00:00
avogar
94c6dc42eb Use better types 2022-11-11 13:17:48 +00:00
Kruglov Pavel
0270f6003c
Merge branch 'master' into add-format-func-doc 2022-11-11 14:05:34 +01:00
Dale Mcdiarmid
fbe84e0853 Merge remote-tracking branch 'upstream/master' into git_analysis 2022-11-11 12:34:53 +00:00
Dale Mcdiarmid
e064fb38cc edits to github repo analysis 2022-11-11 12:34:23 +00:00
Robert Schulze
cbe4e2b8ce
Merge pull request #42673 from bigo-sg/enable_max_splits
Add optional max_tokens argument for function splitByRegexp
2022-11-11 11:11:26 +01:00
Roman Vasin
35a1c406ad Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-623 2022-11-11 07:35:44 +00:00
avogar
9e89af28c6 Refactor BSONEachRow format, fix bugs, support more data types, support parallel parsing and schema inference 2022-11-10 20:15:14 +00:00
DanRoscigno
790a3b94fa bad code indent 2022-11-10 14:08:54 -05:00
Dan Roscigno
2e5a3adaf0
Merge branch 'master' into git_analysis 2022-11-10 13:56:00 -05:00
DanRoscigno
312875627b spelling 2022-11-10 13:55:39 -05:00
DanRoscigno
978f567d42 broken img markdown? 2022-11-10 13:47:35 -05:00
Dale Mcdiarmid
5c147262e9 add toc 2022-11-10 16:36:30 +00:00
Dale Mcdiarmid
49e53e48f9 initial analysis 2022-11-10 15:32:06 +00:00
taiyang-li
f58e960a7d update as request 2022-11-10 21:07:44 +08:00
Roman Vasin
753895026f Improve docs and add more queries to 02477_age test 2022-11-10 12:18:29 +00:00
Roman Vasin
31d84d5aed Add doc for age() function 2022-11-10 12:05:53 +00:00
taiyang-li
839de0cd09 add function factorial 2022-11-10 16:03:11 +08:00
JackyWoo
8e881e6009
Merge branch 'master' into keeper_manually_assign_leader 2022-11-10 14:38:04 +08:00
serxa
7448d1bb5d add docs 2022-11-09 14:58:41 +00:00
zvonand
90e3aed957 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-decdiv 2022-11-09 15:05:31 +03:00
李扬
9b2dd49b4a
Merge branch 'master' into enable_max_splits 2022-11-09 15:31:06 +08:00
DanRoscigno
c822c8161f fix nav 2022-11-08 20:21:26 -05:00
DanRoscigno
45c9debeaf update links 2022-11-08 19:17:58 -05:00
DanRoscigno
d225366335 update links 2022-11-08 18:04:22 -05:00
DanRoscigno
090b153b1e a dir named index with index.md broke nav 2022-11-08 17:37:20 -05:00
Dan Roscigno
616c3e219b
Merge branch 'master' into fix-pagination 2022-11-08 10:14:33 -05:00
DanRoscigno
a4cd562914 fix next button 2022-11-08 10:12:29 -05:00
SmitaRKulkarni
658036d179
Merge pull request #42708 from ClickHouse/42414_Enable_functions_in_readonly_mode
42414 enable functions in readonly mode
2022-11-08 15:22:31 +01:00
JackyWoo
9060141f16 revert last change 2022-11-08 18:44:43 +08:00
JackyWoo
eeedd7d9ba Keeper support manually assigning leader 2022-11-08 12:01:53 +08:00
taofengliu
eff3d121e9 Merge remote-tracking branch 'upstream/master' into group_by_all 2022-11-08 10:44:53 +08:00
李扬
1728f1e436
Merge branch 'master' into enable_max_splits 2022-11-08 10:15:42 +08:00
alesapin
c88dcba36e
Merge pull request #42852 from SaltTan/patch-1
Docs. Add PARTITION clause  to CHECK TABLE
2022-11-07 22:49:33 +01:00
Alexander Tokmakov
c5edea19f3
Merge pull request #43004 from ClickHouse/devcrafter-restart-replica-patch
Simple fixes for restart replica description
2022-11-07 22:18:28 +03:00
Igor Nikonov
434c0f24f9
Update docs/en/sql-reference/statements/system.md
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2022-11-07 19:40:59 +01:00
Dan Roscigno
501e43dd01
Merge pull request #43013 from DanRoscigno/fix-troubleshooting-missing-nav
move troubleshooting to FAQ
2022-11-07 12:05:08 -05:00
DanRoscigno
d446eca882 move troubleshooting to FAQ 2022-11-07 11:56:09 -05:00
Alexander Tokmakov
a24bff1029
Merge pull request #42256 from lixuchun314/update-docs
update docs error
2022-11-07 18:54:15 +03:00
Vitaly Baranov
ab8feb5bff
Merge pull request #42782 from mdonkers/session-log-support-sslcertificate-auth
Add SSL_CERTIFICATE auth method to all places missing
2022-11-07 16:36:42 +01:00
Dan Roscigno
9123eacdeb
Merge branch 'master' into patch-1 2022-11-07 09:44:22 -05:00
DanRoscigno
34f90ff6ef update pages that refer to dictionaries 2022-11-07 09:26:50 -05:00
Igor Nikonov
e7fbe40b1c
Simple fixes for restart replica description 2022-11-07 14:30:52 +01:00
Vladimir C
3ed11c7a7b
Merge pull request #42994 from CamiloSierraH/patch-3 2022-11-07 10:39:15 +01:00
Vladimir C
e8fb5f9afa
Merge pull request #42670 from bigo-sg/ascii_function 2022-11-07 10:33:56 +01:00
Camilo Sierra
e2c23344d1
full example using AggregatingMergeTree
Discussing with a dev the `AggregatingMergeTree` usage was not clear, they do not understand how use the `AggregateFunction` or how we could get the final aggregated value.
I hope this full example could better show the capabilities of this feature and help the new users to better understand it.
2022-11-07 09:54:45 +01:00
SmitaRKulkarni
c563e124c2
Merge branch 'master' into 42414_Enable_functions_in_readonly_mode 2022-11-07 09:50:05 +01:00
李扬
70fd664dd1
Merge branch 'master' into ascii_function 2022-11-07 10:30:10 +08:00
Rami Dridi
b0b3942aae
docs : updating comparing mode command and results 2022-11-05 21:33:47 +01:00
taofengliu
fb6616895a Merge remote-tracking branch 'upstream/master' into group_by_all 2022-11-05 22:29:50 +08:00
JackyWoo
00e93482c8 fix docs 2022-11-05 18:00:26 +08:00
JackyWoo
73dfe4acd7 Add to default white list 2022-11-05 17:56:55 +08:00
JackyWoo
9404e089fc
Merge branch 'master' into manual_snapshot_for_keeper 2022-11-05 17:37:36 +08:00
Nikolay Degterinsky
fbf891d375
Merge pull request #42774 from alexon1234/add_format_redable_decimal_size
Published formatReadableDecimalSize so it can be used as function
2022-11-05 12:34:20 +03:00
taofengliu
1864ed3363 Merge remote-tracking branch 'upstream/master' into group_by_all 2022-11-05 17:22:52 +08:00
Dan Roscigno
fb43aa3db9
Merge pull request #42939 from DanRoscigno/add-vis-to-cell-towers
Add vis to cell towers
2022-11-04 15:47:13 -04:00
Dan Roscigno
c88a214865
Merge branch 'ClickHouse:master' into standardize-dictionary-categories 2022-11-04 09:19:09 -04:00
Nikolay Degterinsky
b5b2a62f93
Merge pull request #42943 from ClickHouse/rfraposa-patch-2
Update default value of allow_experimental_projection_optimization
2022-11-04 15:46:28 +03:00
Nikolay Degterinsky
16fc05b734
Merge branch 'master' into add_format_redable_decimal_size 2022-11-04 15:02:01 +03:00
Robert Schulze
6df8f7ef25
Merge pull request #42907 from ClickHouse/cleanup-regexpreplace
Cleanup implementation of regexpReplace(All|One)
2022-11-04 12:49:44 +01:00
Mikhail f. Shiryaev
d3acb4cc09
Merge pull request #42859 from ClickHouse/packages-apt-troubleshooting
Add more possible issues for cleaning apt cache
2022-11-04 11:58:40 +01:00
李扬
fccf6c037f
Merge branch 'master' into ascii_function 2022-11-03 22:48:55 -05:00
李扬
e65b0f1c2e
Merge branch 'master' into enable_max_splits 2022-11-03 22:47:15 -05:00
Yakov Olkhovskiy
4012fcbf01
Merge pull request #42285 from ClibMouse/feature/base64-encode-fixed-string
Add support for FixedString input to base64 functions
2022-11-03 18:56:21 -04:00
Rich Raposa
0cadb8ac63
Update default value of allow_experimental_projection_optimization
The setting is actually obsolete, but I suppose we should keep it here for users of older versions of ClickHouse
2022-11-03 15:30:43 -06:00
DanRoscigno
1d34400cce ready for review 2022-11-03 13:43:15 -04:00
Kruglov Pavel
83c5c44b11
Merge branch 'master' into improve-schema-inference-insert-select 2022-11-03 18:41:51 +01:00
Dan Roscigno
c92329c56a
Merge branch 'master' into improve_build 2022-11-03 08:27:04 -04:00
Kruglov Pavel
b124875257
Merge branch 'master' into improve-streaming-engines 2022-11-03 13:22:06 +01:00
Robert Schulze
43df3f9607
Merge branch 'master' into cleanup-regexpreplace 2022-11-03 13:13:10 +01:00
taiyang-li
0df7e95845 improve doc and uts 2022-11-03 16:12:19 +08:00
Alejandro
62ab271b82 fix docs 2022-11-03 09:04:22 +01:00
Alejandro
4e3f43650a Added function to docs 2022-11-03 09:04:22 +01:00
Antonio Andelic
25b19e6ba0
Merge branch 'master' into manual_snapshot_for_keeper 2022-11-03 08:55:01 +01:00
taiyang-li
5fa0968bd5 reset to original solution 2022-11-03 15:05:23 +08:00
taiyang-li
6770723027 modify as requested 2022-11-03 12:02:31 +08:00
taiyang-li
aeea21e4d7 Merge branch 'master' into ascii_function 2022-11-03 11:13:20 +08:00
DanRoscigno
7271d4d122 add note to embedded dict 2022-11-02 17:52:35 -04:00
DanRoscigno
df4868587b add note to use DDL 2022-11-02 17:40:55 -04:00
DanRoscigno
3dd5df4615 update examples 2022-11-02 16:58:07 -04:00
DanRoscigno
c8f9af1afa start renaming 2022-11-02 15:47:11 -04:00
Alexey Milovidov
c3466fb52f
Update clickhouse-keeper.md 2022-11-02 22:22:16 +03:00
Dan Roscigno
0c21434ec7
Merge pull request #42903 from CamiloSierraH/patch-1
range hashed missing parameters on query + example
2022-11-02 14:05:08 -04:00
Robert Schulze
494d6ca3df
Cleanup implementation of regexpReplace(All|One)
This is a pure refactoring, there are no semantic changes.

Cherry-picked from #42682.
2022-11-02 15:49:53 +00:00
taofengliu
e08c33ac85 Merge remote-tracking branch 'upstream/master' into group_by_all 2022-11-02 23:08:52 +08:00
Camilo Sierra
b6d84ef5fa
range hashed missing parameters
On the query we have missing two options:
- `LIFETIME` Is not on the example if you copy paste you will have an Exception `DB::Exception: Cannot create dictionary with empty lifetime.`
- `SOURCE` was not mentioned and it's important to link to the main/source table.
- There was an error on the `dictGetT` function there was an additional T this function do not exist (I have tested and we need to use `dictGet`).
- Also in the Dictionary example we have no extra attribute other than the id and the two dates, and for running the queries and the `dicGet` function you need an additional attribute this is why I have added `advertiser_id` (BTW I use advertiser_id as this was use in the example just before) and also add one example, without the example it was not easy to understand what was the 'attr_name' mentioned before.
- I add an example as an user did not knew how to cast the date to a Uint64 (Because most of the time the original/raw dates are defined on the range as Date64, so this example will explain them how to cast when doing the query)
2022-11-02 15:43:57 +01:00
Dan Roscigno
4c77987bf8
Update projection.md
Experiment with Algolia search
2022-11-02 10:41:55 -04:00
DanRoscigno
cc77e30024 add text, update image 2022-11-02 09:59:20 -04:00
ltrk2
14141c9071 Add support for FixedString input to base64 functions 2022-11-02 08:14:28 -04:00
Dan Roscigno
8d7d1cf682
Merge branch 'ClickHouse:master' into add-vis-to-cell-towers 2022-11-02 07:58:15 -04:00
alesapin
8965ac2dfe
Merge pull request #42625 from ClickHouse/DanRoscigno-patch-2
Update Fedora build info
2022-11-02 12:32:02 +01:00
Habibullah Oladepo
ba34ad37d1
Fix minor typos in intersect statement documentation 2022-11-02 08:02:01 +01:00
taofengliu
c9576e3761 Merge remote-tracking branch 'upstream/master' into group_by_all 2022-11-02 10:33:27 +08:00
DanRoscigno
32e1c3b1e6 rename update file as it is included in Manage > Updates 2022-11-01 16:25:54 -04:00
Mikhail f. Shiryaev
b99ea56db8
Add more possible issues for cleaning apt cache 2022-11-01 21:00:52 +01:00
DanRoscigno
e5f9c65590 add to page title for search 2022-11-01 12:56:41 -04:00
Dan Roscigno
6d855755ef
Merge pull request #42844 from i94rain/fix-broken-links
Fix broken links in system tables docs
2022-11-01 11:47:26 -04:00
taofengliu
c43dd96f14 Merge remote-tracking branch 'upstream/master' into group_by_all
# Conflicts:
#	src/Analyzer/QueryNode.h
2022-11-01 22:53:44 +08:00
Mikhail f. Shiryaev
09b320f9a1
Merge pull request #42643 from peter279k/add_deb_migration
Migration method for installing the deb-packages
2022-11-01 14:46:45 +01:00
zvonand
3c46673534 upd docs 2022-11-01 16:40:26 +03:00
Kruglov Pavel
95e64310a6
Update format.md 2022-11-01 14:06:45 +01:00
SaltTan
3afc688751
Update docs/en/sql-reference/statements/check-table.md
Co-authored-by: Ilya Yatsishin <2159081+qoega@users.noreply.github.com>
2022-11-01 13:04:24 +00:00
Derek Chia
29318a1e13
Update nyc-taxi.md
- Add enum 'UNK' = 5 to `payment_type` to avoid `Unknown element 'UNK' for enum` error when loading trips_*.gz
- Change url table function to s3 table function as described in the earlier paragraph
2022-11-01 18:03:17 +08:00
SaltTan
97d361bce0
Update check-table.md 2022-11-01 10:02:04 +00:00
taofengliu
4862586417 fix docs 2022-11-01 16:27:34 +08:00
taofengliu
d0767cab1d GROUP BY ALL in Analyzer 2022-11-01 16:18:56 +08:00
taofengliu
5630bc4d44 Merge remote-tracking branch 'upstream/master' into group_by_all 2022-11-01 16:17:04 +08:00
Vitaly Baranov
9d46547daa
Merge branch 'master' into session-log-support-sslcertificate-auth 2022-11-01 08:32:09 +01:00
zvonand
83fb05e5ca Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-decdiv 2022-11-01 09:03:29 +03:00
shuyang
7234600ec3 Apply suggestions from code review
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-10-31 19:15:20 -05:00
94rain
8b849d4b37 Fix broken links in system tables docs
Signed-off-by: 94rain <21193371+94rain@users.noreply.github.com>
2022-10-31 19:15:20 -05:00
Alexander Yakovlev
70eaf69df1
Fix a typo in table-engines/integrations/s3.md 2022-11-01 02:57:55 +03:00
Smita Kulkarni
9aa06e48f6 Merge branch 'master' into 40907_Parameterized_views_as_table_functions 2022-10-31 15:46:52 +01:00
SmitaRKulkarni
54035270b2
Merge branch 'master' into 42414_Enable_functions_in_readonly_mode 2022-10-31 14:15:29 +01:00
DanRoscigno
e3a2079ef0 grammar 2022-10-31 09:04:47 -04:00
Nikolay Degterinsky
81a812c1ea
Merge pull request #42822 from ClickHouse/serxa-patch-3
Link to proper place in docs
2022-10-31 13:11:15 +01:00
Sergei Trifonov
e43ecf9ca0
Link to proper place in docs 2022-10-31 12:52:31 +01:00
Sergei Trifonov
b677e68c4e
Update column.md 2022-10-31 12:46:14 +01:00
Sergei Trifonov
9066e0c3da
Merge pull request #42760 from ClickHouse/serxa-patch-2
Fix anchor links
2022-10-31 12:38:48 +01:00
Roman Vasin
24a4f4afe7
Merge branch 'master' into ADQM-605 2022-10-30 18:03:07 +03:00
Filatenkov Artur
66c179217c
Merge branch 'master' into annoy_cosine 2022-10-29 11:55:20 +03:00
Alexander Gololobov
800e789ac4
Small fix 2022-10-29 09:26:16 +02:00
taofengliu
73a35f1bc4 Merge remote-tracking branch 'upstream/master' into group_by_all 2022-10-29 13:58:27 +08:00
Dan Roscigno
bb15156b1f
Merge branch 'ClickHouse:master' into add-vis-to-cell-towers 2022-10-28 15:58:30 -04:00
DanRoscigno
030111ac11 add image for UMTS radio 2022-10-28 15:56:48 -04:00
Miel Donkers
fb1623a5f8 Add SSL_CERTIFICATE auth method to all places missing 2022-10-28 21:17:59 +02:00
Denny Crane
7fa71d8c04
Update column.md 2022-10-28 16:04:00 -03:00
Denny Crane
e903efda0a
Update column.md 2022-10-28 16:00:37 -03:00
DanRoscigno
be85232610 new images 2022-10-28 14:36:00 -04:00
avogar
5412911592 Add documentation for 'format' table function 2022-10-28 17:43:28 +00:00
Filatenkov Artur
21c024b043
Merge branch 'master' into annoy_cosine 2022-10-28 20:15:53 +03:00
FArthur-cmd
f187d4e1d4 add cosine distance for annoy and fix docs for cosineDistance 2022-10-28 17:03:35 +00:00
avogar
8e13d1f1ec Improve and refactor Kafka/StorageMQ/NATS and data formats 2022-10-28 16:41:10 +00:00
DanRoscigno
418539cd51 add images 2022-10-28 11:54:44 -04:00
UnamedRus
d4c6268806
Fix Polygon dict xml config
Missing  <attribute> tag
2022-10-28 18:47:32 +04:00
Vitalii S
665fcf55aa
Update database.md
Minor text correction
2022-10-28 10:08:04 -04:00
DanRoscigno
1ec10ade5b add link to geo fn, fix index 2022-10-28 09:56:16 -04:00
taofengliu
7d1fbdbfeb Merge remote-tracking branch 'upstream/master' into group_by_all 2022-10-28 21:48:56 +08:00
taofengliu
56ab264ec9 fix 2022-10-28 21:48:48 +08:00
Roman Vasin
fc16752844 Update docs for FROM_UNIXTIME 2022-10-28 12:56:52 +00:00
Sergei Trifonov
acec447526
Fix anchor links 2022-10-28 12:35:18 +02:00
SmitaRKulkarni
e860ecc80c
Merge branch 'master' into 42414_Enable_functions_in_readonly_mode 2022-10-27 08:26:44 +02:00
李扬
24ffaee18c
Merge branch 'master' into ascii_function 2022-10-26 21:43:46 -05:00
Dan Roscigno
61c3de2ec5
Merge branch 'master' into improve_build 2022-10-26 16:23:48 -04:00
Smita Kulkarni
6a8fa2d4a5 Added new field allow_readonly in system.table_functions to allow using table functions in readonly mode.
Implementation:
* Added a new field allow_readonly to table system.table_functions.
* Updated to use new field allow_readonly to allow using table functions in readonly mode.
* Added TableFunctionProperties similar to AggregateFunctionProperties.
* The functions allowed in readonly mode are in this set table_functions_allowed_in_readonly_mode.
Testing:
* Added a test for filesystem tests/queries/0_stateless/02473_functions_in_readonly_mode.sh
Documentation:
* Updated the english documentation for Table Functions.
2022-10-26 18:45:23 +02:00
DanRoscigno
22011aeaec remove frontmatter 2022-10-26 12:39:17 -04:00
Dan Roscigno
4bf48bce90
Merge branch 'master' into update-backup-for-s3 2022-10-26 10:38:30 -04:00
李扬
04f8f38580
Merge branch 'master' into ascii_function 2022-10-26 07:29:49 -05:00
SmitaRKulkarni
5df138da82
Merge pull request #42376 from ClickHouse/36316_Support_glob_for_recursive_directory_traversal
Added ** glob support for recursive directory traversal to filesystem…
2022-10-26 11:49:20 +02:00
taiyang-li
2254bef74a implement function ascii 2022-10-26 14:19:26 +08:00
Dan Roscigno
690e4e70ae
Merge branch 'master' into update-backup-for-s3 2022-10-25 21:40:49 -04:00
DanRoscigno
91c3744cfe add backup to S3 endpoint 2022-10-25 21:33:09 -04:00
ltrk2
2c902bbc65
Implement support for different UUID binary formats (#42108)
* Implement support for different UUID binary formats

* Declare error codes that the implementation uses

* Make single-argument constructor explicit

* Modernize parts of the solution

* Make improvements based on review comments

* Declare an error code being used
2022-10-25 21:57:50 +02:00
Dan Roscigno
1e53fd7374
Merge branch 'master' into add_deb_migration 2022-10-25 10:29:54 -04:00
peter279k
7626406b86 Add two troubleshootings about installation 2022-10-25 21:53:28 +08:00
JackyWoo
c7a0ebeb05 little fix 2022-10-25 17:46:24 +08:00
JackyWoo
9a36a509fe fix test 2022-10-25 17:15:49 +08:00
peter279k
dd4121a290 Migration method for installing the deb-packages 2022-10-25 15:27:52 +08:00
Dan Roscigno
0c50114190
Update Fedora build info
I am using Fedora 36.

yum install of `clang-c++` failed for me, `clang` worked.  And I had an error message telling me to install `ccache` also.
2022-10-24 14:41:38 -04:00
SmitaRKulkarni
96c8260230
Merge branch 'master' into 36316_Support_glob_for_recursive_directory_traversal 2022-10-24 18:34:19 +02:00
JackyWoo
b5d1c4e657 replace snpd with lgif 2022-10-24 20:08:58 +08:00
Alexey Milovidov
9b1b436e4d
Merge branch 'master' into DanRoscigno-patch-2 2022-10-24 10:28:29 +02:00
Robert Schulze
b746224217
Merge pull request #42554 from arenadata/ADQM-604
Add support of Date32 arguments for dateName function
2022-10-22 17:20:10 +02:00
JackyWoo
39c88c74e8 check whether last manually created snapshot is done 2022-10-22 22:31:17 +08:00
JackyWoo
bf291790b7
Merge branch 'master' into manual_snapshot_for_keeper 2022-10-22 16:57:50 +08:00
taofengliu
46b24380f2 Merge remote-tracking branch 'upstream/master' into group_by_all 2022-10-22 13:57:31 +08:00
Alexey Milovidov
bc6762d613
Merge pull request #42565 from alexeyerm/other-functions.md-fix
other-functions.md example fix
2022-10-22 04:20:23 +02:00
Alexey Milovidov
592fbb3eaf
Merge pull request #42367 from ClickHouse/revert-40217
Revert #40217
2022-10-21 21:56:15 +02:00
Dan Roscigno
440af00c74
Merge pull request #42151 from ClickHouse/remove-misc-statements
Docs: Remove obsolete misc page
2022-10-21 13:48:53 -04:00
alexeyerm
9abfe76fbb
doc fix fix 2022-10-21 20:08:44 +03:00
alexeyerm
95943dbdda
fix transform() example 2022-10-21 19:44:35 +03:00
DanRoscigno
52ca29140e WIP: add Superset deploy instructions 2022-10-21 12:27:20 -04:00
Robert Schulze
2d448c139c
Merge pull request #42308 from arenadata/ADQM-584
Add support of Date32 arguments for date_diff function
2022-10-21 13:18:44 +02:00
Roman Vasin
537f7000d6 Update documentation 2022-10-21 06:55:24 +00:00
Alexey Milovidov
48694def2c
Merge branch 'master' into revert-40217 2022-10-21 05:49:34 +02:00
taofengliu
6521bd5841 Merge remote-tracking branch 'upstream/master' into group_by_all 2022-10-21 10:29:51 +08:00
Alexey Milovidov
b720030ac6 Remove outdated documentation 2022-10-21 00:13:30 +02:00
Robert Schulze
9b7294ef45
Merge remote-tracking branch 'origin/master' into revert-40217 2022-10-20 15:27:31 +00:00
taofengliu
66c0765c8a fix docs 2022-10-20 18:26:11 +08:00
taofengliu
7fe812b480 fix docs 2022-10-20 18:20:40 +08:00
taofengliu
4d5bf0e3b2 avoid extracting the deepest columns 2022-10-20 18:17:40 +08:00
Robert Schulze
42f680849c
Fix bad_cast in Annoy index
- Problem originally found by data type fuzzer
  https://s3.amazonaws.com/clickhouse-test-reports/42180/2f83d8790581dce0ffeec56c137b1d13160cfa7b/fuzzer_astfuzzermsan//report.html

- This commit restricts which data types are allowed for Annoy indexes
  (similar things are done for other index types).
2022-10-19 13:40:39 +00:00
zvonand
890b292c88 added docs 2022-10-19 13:55:24 +03:00
taofengliu
4e1b96fa4c Merge remote-tracking branch 'upstream/master' into group_by_all 2022-10-19 12:16:20 +08:00
DanRoscigno
e76560619c moved into dev/getting-started 2022-10-18 14:52:28 -04:00
Dan Roscigno
b125fd8718
Update uk-price-paid.md 2022-10-18 09:34:53 -04:00
Kruglov Pavel
9588653a6e
Merge branch 'master' into improve-schema-inference-insert-select 2022-10-18 15:17:27 +02:00
Smita Kulkarni
32fad205f0 Added documentation for file and s3 - 36316 Support ** glob for recursive directory traversal 2022-10-18 14:08:26 +02:00
taofengliu
17be6ab492 docs for GROUP BY ALL 2022-10-18 10:46:38 +08:00
Vitaly Baranov
eb637a6f81
Merge pull request #42232 from azat/backups/s3
Support BACKUP to S3 with as-is path/data structure
2022-10-18 02:37:07 +02:00
Smita Kulkarni
3034229c37 Merge branch 'master' of github.com:ClickHouse/ClickHouse into 40907_Parameterized_views_as_table_functions 2022-10-17 18:37:31 +02:00
Smita Kulkarni
614fd4cf42 Added is_parameterized_view to Context and removed flag from ASTs, updated to use tryGetTable, addressed review comments - 40907 Parameterized views as table functions 2022-10-17 18:11:22 +02:00
Alexey Milovidov
d1f0c80ffe Revert "Merge pull request #40217 from zvonand/zvonand-minmax"
This reverts commit df934d8762, reversing
changes made to d3a7945b1b.
2022-10-17 04:57:15 +02:00
Alexey Milovidov
9ccbadc359
Merge pull request #42275 from zimv/doc-update-client-libraries
Docs: Add  "node-clickhouse-orm" to the client-libraries.md
2022-10-15 08:18:16 +02:00
Kruglov Pavel
7980920bd7
Merge branch 'master' into fix-format-row 2022-10-14 20:49:21 +02:00
Kruglov Pavel
6fc12dd922
Merge pull request #41703 from Avogar/json-object-each-row
Add setting to obtain object name as column value in JSONObjectEachRow format
2022-10-14 20:11:04 +02:00
Kruglov Pavel
f1dd247181
Merge branch 'master' into improve-schema-inference-insert-select 2022-10-14 17:16:58 +02:00
avogar
2b150a575e Add docs 2022-10-14 15:15:03 +00:00
Azat Khuzhin
8830f0608d Support BACKUP to S3 with as-is path/data structure
Right now backup to S3 does not make a lot of sense, since:
- it has random names, and to decoding them
- requires metadata from local disk (/var/lib/disks/DISK/BACKUP_NAME)
- or send_metadata (but it is also tricky even with it)

So this patch adds simpler interface for S3, it is only suitable for
BACKUP/RESTORE, so don't try to use it for MergeTree engine.

It is done by adding separate disk - `s3_plain` for this, that:
- does not support any extended features, like renames/hardlinks/attrs/...
  (so basically everything that MergeTree requires)
- only write/read/unlink/list files

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-14 12:59:25 +02:00
Roman Vasin
90f9bd24a3 Update documentation 2022-10-14 08:02:38 +00:00
zimv
56ef17e083 Docs: Add "node-clickhouse-orm" to the client-libraries.md 2022-10-13 14:57:35 +08:00
Alexey Milovidov
5b6be92042
Update build.md 2022-10-13 05:31:50 +03:00
vdimir
0178307c27 Followup for TemporaryDataOnDisk 2022-10-12 15:25:23 +02:00
lixuchun
b724b7a74a update docs error 2022-10-12 11:57:35 +08:00
Alexey Milovidov
023f11fb86
Update developer-instruction.md 2022-10-09 03:54:00 +03:00
Alexey Milovidov
9bf5fe728b
Merge pull request #42173 from ClickHouse/remove-temporary-live-view
Remove TEMPORARY LIVE VIEW
2022-10-08 19:05:33 +03:00
Alexey Milovidov
b9159db82f Remove temporary live views 2022-10-08 00:16:36 +02:00
Robert Schulze
3e3c0a7bb6
Docs: Add "TABLE" to CHECK/DESCRIBE statements in sidebar 2022-10-07 14:41:00 +00:00
Robert Schulze
cde0257d11
Docs: Remove obsolete pages
Removes page https://clickhouse.com/docs/en/sql-reference/statements/misc

It indexes "miscellaneous" SQL statements but these are already easily
reachable by the sidebar.
2022-10-07 14:37:22 +00:00
Robert Schulze
e759a64d38
Docs: Redirect links to misc.md
--> https://clickhouse.com/docs/en/sql-reference/statements/misc

This page indexes a bunch of SQL statements but they are easily
reachable by the sidebar already.
2022-10-07 13:22:40 +00:00
Dan Roscigno
22576fa2f2
Merge branch 'master' into improve_build 2022-10-06 14:53:15 -04:00
Nikolay Degterinsky
522948fa2a
Merge branch 'master' into patch-1 2022-10-06 17:47:36 +02:00
Dan Roscigno
41fb3cb7da
Merge branch 'master' into combine-requirements-install-docs 2022-10-06 09:39:11 -04:00
DanRoscigno
655d2b298d adjust heading level 2022-10-06 09:38:30 -04:00
Kseniia Sumarokova
3cff776109
Merge pull request #41254 from filimonov/system_disks_unreserved_space
Add unreserved_space column to system.disks
2022-10-06 12:28:23 +02:00
DanRoscigno
12acfb9943 code review, preserve link 2022-10-05 12:04:00 -04:00
Nikolay Degterinsky
61ec576900
Merge branch 'master' into patch-1 2022-10-05 16:18:08 +02:00
DanRoscigno
5b22f63d07 updated packages URL 2022-10-05 09:49:55 -04:00
Maksim Kita
324c922121
Merge pull request #42069 from den-crane/patch-52
Doc. Some clarification about log_formatted_queries setting
2022-10-05 13:41:25 +03:00
Smita Kulkarni
ec95294621 Merge branch 'master' into 40907_Parameterized_views_as_table_functions 2022-10-05 11:48:14 +02:00
Adam Rutkowski
3c4eae4276
Fix tag mismatch in sample users config 2022-10-05 09:55:28 +02:00
Nikolay Degterinsky
980600dc2f
Merge pull request #41206 from canhld94/ch_canh_fix_decrypt_with_null
Add function tryDecrypt that returns NULL when decrypt fail
2022-10-05 09:13:36 +02:00
Denny Crane
5341bf445a
Update settings.md 2022-10-04 15:08:29 -03:00
Dan Roscigno
f4f85a069b
Go live with doc updates (#42053)
* QIP to add overview page

* wip

* New Tutorial and Datasets landing page

* give an example for Cloud

* Update UK Price Paid for Cloud

* Update nyc-taxi.md

* add option for Cloud Load Data button

* Removed the Import Raw Data section

* Update nyc-taxi.md

* update user management and replication docs

* mark self managed

* set doc ordering

* add redirects setting

* Simple fixes to index.md

Co-authored-by: rfraposa <richraposa@gmail.com>
2022-10-04 14:36:59 +03:00
Nikita Mikhaylov
d767e1f0d8
Added an option to specify environment name in Sentry's config (#42037) 2022-10-04 13:23:51 +02:00
Duc Canh Le
a886804cbf Merge branch 'master' into ch_canh_fix_decrypt_with_null 2022-10-04 13:20:29 +08:00
Sergei Trifonov
a2cf5a650e
Merge pull request #41989 from alexey-ivanov-official/fix-cumulative-sum-documentation-bug
Fix "Cumulative sum" example in "Window functions"
2022-10-03 18:19:51 +02:00
Sergei Trifonov
939b9091cc
Merge pull request #42007 from aldy505/master
docs(statements): specify ON CLUSTER clause for CREATE ROLE
2022-10-03 15:13:25 +02:00
Sergei Trifonov
ea13b81cc3
Merge pull request #42016 from peter279k/improve_mysql_interface_setting
Improve the MySQL interface usage description
2022-10-03 15:04:15 +02:00
Kseniia Sumarokova
0bfbb5c38a
Merge branch 'master' into system_disks_unreserved_space 2022-10-03 14:25:47 +02:00
Duc Canh Le
fbb9b3f5ab Merge branch 'master' into ch_canh_fix_decrypt_with_null 2022-10-03 17:56:06 +08:00
peter279k
fc382a0144 Improve the MySQL interface usage description 2022-10-03 17:19:02 +08:00
peter279k
2c30b5febb Improve gRPC client example 2022-10-03 16:54:35 +08:00
Robert Schulze
8e727d4fbc
Merge pull request #41910 from arenadata/ADQM-583
Improve enable_extended_results_for_datetime_functions option to return results of type DateTime64
2022-10-02 20:46:51 +02:00
Alexey Milovidov
0d1d177013
Merge pull request #41131 from JackyWoo/add_function_java_int_hash
Support Java integers hashing in `javaHash`
2022-10-02 18:10:51 +03:00
Duc Canh Le
99bf356220
Merge branch 'master' into ch_canh_fix_decrypt_with_null 2022-10-02 14:35:42 +08:00
Reinaldy Rafli
b52d58dcae
docs(statements): specify ON CLUSTER clause for CREATE ROLE 2022-10-02 09:51:17 +07:00
Alexey Milovidov
b9e8ae2fd9
Merge pull request #41913 from BoloniniD/Corrosion_docs
Fix Rust integration docs
2022-10-01 18:17:19 +03:00
Alexey Ivanov
5e290da99b
Fix "Cumulative sum" example in "Window functions"
Fixes a problem in "Cumulative sum" example in "Window functions" documentation, 
when CREATE TABLE part of example was not match to SQL examples.

see: https://clickhouse.com/docs/en/sql-reference/window-functions/#cumulative-sum
2022-10-01 17:49:20 +03:00
Alexey Milovidov
c177061f75
Merge pull request #41958 from dbanda/patch-1
Update criteo.md
2022-09-30 22:37:41 +03:00
Alexey Milovidov
a92e24fdc1
Update criteo.md 2022-09-30 17:37:51 +03:00
Vladimir C
895afdec45
Merge pull request #40893 from ClickHouse/vdimir/track-tmp-disk 2022-09-30 11:27:24 +02:00
Roman Vasin
f716fc2fe5 Put list of functions in correct order in docs; Use new formatting in exception messages. 2022-09-30 07:54:35 +00:00
Dalitso Banda
b7d65f7a2d
Update criteo.md
The new spec states that MergeTree does not take any parameters. Updating the doc to reflect this.
2022-09-29 20:17:42 -07:00
Roman Vasin
45414b251d Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-583 2022-09-29 17:02:49 +00:00
Roman Vasin
9dfb2d058c Add DateTime64 returing functions in Note box 2022-09-29 14:23:50 +00:00
Raúl Marín
7c38b3f60d Update MergeTree settings docs to match current defaults 2022-09-29 14:12:10 +02:00
Robert Schulze
6381631836
Merge pull request #41824 from ClickHouse/tryBase58
Add function tryBase58Decode()
2022-09-29 12:38:58 +02:00
vdimir
367c77f0fb
Check if tmp volume contains only local disks 2022-09-29 09:51:39 +00:00
Robert Schulze
6379cb41ce
Merge branch 'master' into fix-links 2022-09-29 09:17:39 +02:00
BoloniniD
fcb039d465 Fix docs for corrosion 2022-09-28 22:24:26 +03:00
Kruglov Pavel
9c1e654584
Fix typo 2022-09-28 16:38:04 +02:00
avogar
c353928eb5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-format-row 2022-09-28 13:15:51 +00:00
Roman Vasin
109c5ee1a1 Update docs for DateTime64 return types. 2022-09-28 12:49:58 +00:00
avogar
03ee7efcb9 Better example in docs 2022-09-28 12:48:31 +00:00
Robert Schulze
fa93952231
Docs: Reference external papers as DOIs
See also #31076 which noted that links were broken but didn't fix.
2022-09-28 12:21:58 +00:00
Kruglov Pavel
bfddb91c9a
Update docs/en/interfaces/formats.md
Co-authored-by: Sergei Trifonov <svtrifonov@gmail.com>
2022-09-28 14:15:53 +02:00
Kruglov Pavel
f1ac2d66be
Merge branch 'master' into json-object-each-row 2022-09-28 14:15:02 +02:00
Duc Canh Le
6fd234d652 fix document typo and format 2022-09-28 20:06:18 +08:00
Robert Schulze
82139fad0e
Docs: Remove obsolete modelEvaluate() mention 2022-09-28 11:47:16 +00:00
Duc Canh Le
170ca26435 add document 2022-09-28 17:55:20 +08:00
Alexey Milovidov
683b7e5e95
Merge branch 'master' into add_function_java_int_hash 2022-09-28 01:30:26 +03:00
Dan Roscigno
4f23f6ef25
fix other links
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2022-09-27 14:07:35 -04:00
Smita Kulkarni
bbc33a54b2 Addressed review comments - 40907 Parameterized views as table functions
Implementation
* Fix for clang-today build fails - updated to use const in Context.cpp & const function in ActionsVisitior.cpp
* Updated to use QueryParameterVisitor to check if query has query parameters
* Updated executeTableFunction to check if table/table exists instead of try-catch approach
* Fixed small review comments and style comments.
Documentation:
* Addressed review comments and added the LIVE view part which was removed by mistake in the previous commits.
2022-09-27 16:30:59 +02:00
DanRoscigno
4be153cbd3 fix link from intro 2022-09-27 10:21:35 -04:00
Robert Schulze
33891c275e
Fix typo 2022-09-27 10:20:39 +00:00
Robert Schulze
aa7e62ad5f
Add functio ntryBase58Decode()
- makes it consistent with tryBase64Decode(), follow-up to #39292

- additionally the following minor changes:

  - rename Common/base58.h|cpp to Common/Base58.h|cpp for constency with
    Common/Base64.h|cpp

  - check that (encode|decode|tryDecode)Base64() gets just one argument
2022-09-27 10:18:36 +00:00
Smita Kulkarni
038352bfce 40907 Parameterized views as table functions
Implementation:
* Updated parsers by adding a bool allow_query_parameters while creating ordinary view, which is used in interpreters to allow query parameters in SELECT.
* Added a check in ActionsVisitor if multiple parameters have same names while creating parameterised view.
* Added bool in StorageView to represent parameterized view.
* Updated processing of SELECT with parameter values to check for views and added substitution of values in the query parameters.

Testing:
* Added a test tests/queries/0_stateless/02428_parameterized_view.sql

Documentation:
* Updated the english documentation for VIEW.
2022-09-26 15:22:17 +02:00
Dan Roscigno
a5e80af1e7
Merge branch 'master' into improve_build 2022-09-26 08:46:04 -04:00
JackyWoo
dfb2be3a67 fix docs 2022-09-26 18:34:53 +08:00
JackyWoo
d1c85f68e8 manually snapshot creation for keeper 2022-09-26 18:29:15 +08:00
Dan Roscigno
636d2f9fbf
Merge branch 'master' into format-cell-tower-dataset 2022-09-23 13:32:52 -04:00
DanRoscigno
f2cbe97223 reformat cell tower example doc 2022-09-23 13:28:29 -04:00
Dan Roscigno
1233560152
Merge branch 'master' into improve_build 2022-09-23 11:43:53 -04:00
Kseniia Sumarokova
4b170cc1cf
Update storing-data.md 2022-09-23 12:54:10 +02:00
avogar
4f32ef9bb7 Add docs 2022-09-22 17:04:42 +00:00
Kseniia Sumarokova
951a85a0fb
Update storing-data.md 2022-09-22 17:04:44 +02:00
Kseniia Sumarokova
a6b1586b17
Update storing-data.md 2022-09-22 17:03:19 +02:00
kssenii
f038c7ea00 Better config for cache 2022-09-22 14:50:29 +02:00
Kseniia Sumarokova
5caac39328
Merge pull request #41508 from kssenii/rename-some-cache-commands
Rename: `show caches` -> `show filesystem caches`, `describe cache` -> `describe filesystem cache`
2022-09-22 13:09:14 +02:00
Kruglov Pavel
55d7addcfe
Merge branch 'master' into fix-format-row 2022-09-22 12:32:58 +02:00
Alexey Milovidov
bca4cc98c3
Merge pull request #41595 from Algunenano/fix_variadic_reading_random_data
Do not process rows in aggregations if any of the parameters is NULL
2022-09-22 07:57:37 +03:00
Peignon Melvyn
d040e41460
Update http.md 2022-09-22 00:23:05 +02:00
Denny Crane
a59f7a3aa9
Update tuple.md 2022-09-21 13:00:46 -03:00
Kruglov Pavel
22e11aef2d
Merge pull request #40910 from Avogar/new-json-formats
Add new JSON formats, add improvements and refactoring
2022-09-21 14:19:08 +02:00
Robert Schulze
186d4e4140
Merge pull request #40818 from Vector-Similarity-Search-for-ClickHouse/annoy
Add annoy index
2022-09-21 13:42:43 +02:00
Kseniia Sumarokova
1e7308832c
Merge branch 'master' into system_disks_unreserved_space 2022-09-21 13:04:39 +02:00
Raúl Marín
fd503b34d9 Remove any processing of undelying values for NULLs 2022-09-20 18:43:21 +02:00
avogar
90e0f98d45 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-format-row 2022-09-20 13:55:44 +00:00
avogar
868ce8bc16 Fix comments, make better naming, add docs, add setting output_format_json_quote_64bit_floats 2022-09-20 13:49:17 +00:00
DanRoscigno
bf4b12be43 rename doc 2022-09-20 09:32:35 -04:00
Filatenkov Artur
2139d5be17
Merge branch 'master' into annoy 2022-09-20 15:28:08 +03:00
Kseniia Sumarokova
364bdb0676
Update storing-data.md 2022-09-20 13:39:07 +02:00
kssenii
b8079e4577 Merge remote-tracking branch 'upstream/master' into rename-some-cache-commands 2022-09-20 13:02:18 +02:00
kssenii
6dcbeceeb9 Update doc 2022-09-20 13:00:10 +02:00
Sergei Trifonov
7902922ae4
Merge branch 'master' into readonly-settings-allow 2022-09-19 21:00:12 +02:00
Derek Chia
cb613b8675
Change input_format_skip_unknown_fields default to 1
As per PR https://github.com/ClickHouse/ClickHouse/pull/37192, `input_format_skip_unknown_fields` is enabled by default. Likewise, it is also set as `true` in the factory settings https://github.com/ClickHouse/ClickHouse/blob/master/src/Core/Settings.h#L696

Updating the docs to reflect the change.
2022-09-19 22:37:03 +08:00
Kruglov Pavel
57f0dc1f89
Merge branch 'master' into fix-format-row 2022-09-19 14:37:58 +02:00
kssenii
972d65d575 Update doc 2022-09-19 14:08:07 +02:00
Sergei Trifonov
f7a1ed3141
Merge branch 'master' into readonly-settings-allow 2022-09-19 12:52:36 +02:00
Diego Nieto (lesandie)
1a14515e35 Fixed cache parameter name 2022-09-19 10:29:41 +02:00
Alexey Milovidov
2e5fa7880e
Update geo.md 2022-09-19 07:52:24 +03:00
Kruglov Pavel
519bcbb3be
Merge pull request #41236 from Avogar/fix-totals-extremes
Don't output totals/extremes in all row formats, update docs
2022-09-18 14:55:07 +02:00
Robert Schulze
38aecc15a2
Merge pull request #41214 from arenadata/ADQM-528-B
Add enable_extended_results_for_datetime_functions option to return results of type Date32
2022-09-17 19:25:11 +02:00
DanRoscigno
149970447a add link to formats 2022-09-16 17:21:03 -04:00
vvbufetov
fb94e43a60
Fix the link on the original article about MaterializedView (#41339)
Fix the link on the original article about MaterializedView

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2022-09-16 17:52:32 +02:00
Kruglov Pavel
2d4a6b38af
Merge branch 'master' into fix-totals-extremes 2022-09-16 15:03:59 +02:00
Robert Schulze
b32b02d844
Merge pull request #40897 from ClickHouse/catboost-bridge-resurrected
Move CatBoost evaluation into clickhouse-library-bridge
2022-09-16 13:12:09 +02:00
Roman Vasin
d82cd7b007 Add many cosmetic changes to C++ code and MD docs 2022-09-16 09:37:30 +00:00
avogar
ef7f7b30aa Fix tests 2022-09-15 18:20:17 +00:00
Roman Vasin
5c242de43a Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-528-B 2022-09-15 13:47:51 +00:00
Roman Vasin
3ce66eab83 Correct all needed MD files 2022-09-15 13:28:11 +00:00
Roman Vasin
563449779c Replace enable_date32_results by enable_extended_results_for_datetime_functions 2022-09-15 12:48:09 +00:00
Kseniia Sumarokova
08f00a7593
Merge pull request #41354 from ClickHouse/kssenii-patch-5
Update storing-data.md
2022-09-15 14:07:43 +02:00
Kseniia Sumarokova
c511c3f168
Merge pull request #40889 from AVMusorin/docs_table_function_update
Doc. Updated optional parameters for table functions
2022-09-15 13:12:20 +02:00
Kseniia Sumarokova
1ec7ce265b
Update storing-data.md 2022-09-15 12:30:02 +02:00
Kseniia Sumarokova
4935a4bf96
Update storing-data.md 2022-09-15 12:29:22 +02:00
JackyWoo
afcbf3a853
Merge branch 'master' into add_function_java_int_hash 2022-09-15 10:08:26 +08:00
JackyWoo
05516bfd03 fix docs 2022-09-15 10:07:39 +08:00
Denny Crane
69d90de9a3
Update date-time-functions.md 2022-09-14 15:23:59 -03:00
Denny Crane
cbdbe1077a
Update date-time-functions.md 2022-09-14 12:16:32 -03:00
Dan Roscigno
c8dcd34abe
Merge pull request #41237 from DanRoscigno/move-title
move title to frontmatter in troubleshooting doc
2022-09-14 10:15:18 -04:00
JackyWoo
9578594439
Merge branch 'master' into add_function_java_int_hash 2022-09-14 20:42:41 +08:00
Robert Schulze
cb04c724b9
Merge pull request #41285 from ClickHouse/fix-broken-doc-links
System statements docs: Fix broken links
2022-09-14 13:03:01 +02:00
Kseniia Sumarokova
bb5f9e578a
Update storing-data.md 2022-09-14 12:17:24 +02:00
JackyWoo
2c8e5f0156 Merge branch 'master' into add_function_java_int_hash 2022-09-14 10:11:15 +08:00
Robert Schulze
d071dbe5a0
Merge branch 'master' into patch-1 2022-09-13 22:27:48 +02:00
Robert Schulze
49136d26aa
docs: fix internal links
The links at the very beginning of
https://clickhouse.com/docs/en/sql-reference/statements/system
don't work. They are reference other sections of the same document. This
is weird because there is a small index already on the right side. I
searched our documentation and this seems to be the only pages which do
so. Therefore removing the links altogether instead of fixing them.
2022-09-13 19:45:46 +00:00
Dan Roscigno
078b9bff3c
Update docs/en/sql-reference/statements/delete.md 2022-09-13 13:18:01 -04:00
Rich Raposa
b833c39dcf
Update delete.md 2022-09-13 10:55:26 -06:00
Rich Raposa
e85b222136
Update delete.md 2022-09-13 10:54:47 -06:00
DanRoscigno
64bd1ea77a spelling 2022-09-13 12:42:24 -04:00
DanRoscigno
fc2e7159f0 add note about privs 2022-09-13 12:40:16 -04:00
Robert Schulze
3e6821e8d7
fix: repair broken documentation links and update docs 2022-09-13 16:00:53 +00:00
JackyWoo
e3caa6f096 some fixes 2022-09-13 21:21:35 +08:00
Kruglov Pavel
3f4e998802
Merge branch 'master' into fix-format-row 2022-09-13 14:37:10 +02:00
Kruglov Pavel
17621b5607
Merge branch 'master' into fix-totals-extremes 2022-09-13 14:36:31 +02:00
Mikhail Filimonov
d2d8c179b6
Add unreserved_space column to system.disks 2022-09-13 13:16:18 +02:00
Robert Schulze
fac1be9700
chore: restore SYSTEM RELOAD MODEL(S) and moniting view SYSTEM.MODELS
- This commit restores statements "SYSTEM RELOAD MODEL(S)" which provide
  a mechanism to update a model explicitly. It also saves potentially
  unnecessary reloads of a model from disk after it's initial load.

  To keep the complexity low, the semantics of "SYSTEM RELOAD MODEL(S)
  was changed from eager to lazy. This means that both statements
  previously immedately reloaded the specified/all models, whereas now
  the statements only trigger an unload and the first call to
  catboostEvaluate() does the actual load.

- Monitoring view SYSTEM.MODELS is also restored but with some obsolete
  fields removed. The view was not documented in the past and for now it
  remains undocumented. The commit is thus not considered a breach of
  ClickHouse's public interface.
2022-09-12 19:33:02 +00:00
Kruglov Pavel
060adfbe93
Merge branch 'master' into new-json-formats 2022-09-12 19:37:46 +02:00
DanRoscigno
a3826c4b3f move title to frontmatter 2022-09-12 13:27:52 -04:00
avogar
8ac2fc7b26 Don't outout totals/extremes in all row formats, update docs 2022-09-12 17:21:40 +00:00
Sergei Trifonov
fe88a7991d
Merge branch 'master' into readonly-settings-allow 2022-09-12 16:20:40 +02:00
Roman Vasin
bc2c2130fc Add documentation for enable_date32_results option 2022-09-12 09:09:01 +00:00
Rich Raposa
b9e9d776f0
Update delete.md 2022-09-09 15:55:57 -06:00
rfraposa
4af246a2e0 Feedback 2022-09-09 13:59:21 -06:00
Aleksandr
503398ac96
Merge branch 'master' into docs_table_function_update 2022-09-09 20:54:28 +02:00
Rich Raposa
9870957621
Update docs/en/sql-reference/statements/delete.md
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
2022-09-09 12:16:54 -06:00
Rich Raposa
50789126a8
Update docs/en/sql-reference/statements/delete.md
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
2022-09-09 12:15:59 -06:00
Rich Raposa
34c2c4bb52
Merge branch 'master' into lightweight-delete 2022-09-09 12:13:51 -06:00
Nikolay Degterinsky
6dcaa9f14d
Merge pull request #41106 from vincentbernat/fix/docs-sync
docs: mention SYNC modifier for DROP and DETACH statements
2022-09-09 20:12:47 +02:00
avogar
6d5f9e5554 Proper implementation for rowFormat function, delete rowFormatNoNewLine function 2022-09-09 17:42:33 +00:00
avogar
9abc6a9c3f Fix typos 2022-09-09 15:10:00 +00:00
Dan Roscigno
cdab391c39
Merge branch 'master' into improve_build 2022-09-09 09:05:16 -04:00
DanRoscigno
afe3717761 move title to frontmatter to allow inclusion in other docs 2022-09-09 08:34:42 -04:00
avogar
ae7f9abd32 Add documentation 2022-09-09 12:04:49 +00:00
Sergei Trifonov
76eb001e78 add test for changeable_in_readonly + fix SQL in docs 2022-09-09 14:01:29 +02:00
rfraposa
18f5b5e5b0 Add docs for lightweight deletes 2022-09-08 16:05:56 -06:00
Alexey Milovidov
4d7097f47a
Merge pull request #41080 from kssenii/add-documentation-for-cache
Add documentation for filesystem cache
2022-09-09 00:03:16 +03:00
Alexey Milovidov
9199656175
Merge pull request #41082 from peter279k/remove_strange_train
Remove strange release trains
2022-09-09 00:01:35 +03:00
Denny Crane
132727d212
Doc. Fix links. 2022-09-08 14:37:42 -03:00
Sergei Trifonov
f92b6a6176
Merge branch 'master' into readonly-settings-allow 2022-09-08 17:44:32 +02:00
Alexey Milovidov
928c1cd0d4
Merge pull request #40967 from ClickHouse/alexey-milovidov-patch-4
Update tips.md about filesystems
2022-09-08 16:56:27 +03:00
Vincent Bernat
fab1b40928 docs: mention SYNC modifier for DROP and DETACH statements 2022-09-08 15:21:59 +02:00
Kseniia Sumarokova
7f086a94a7
Update storing-data.md 2022-09-08 12:34:58 +02:00
Vladimir C
90647cb0c5
Merge pull request #39970 from SachinSetiya/majority_quorum
Add majority_insert_quorum setting
2022-09-08 11:31:33 +02:00
Robert Schulze
c16707ff00
chore: delete obsolete modelEvaluate() function + SYSTEM.MODELS view
- The deleted function modelEvaluate() was superseded by
  catboostEvaluate().

- Also delete the external model repository, as modelEvaluate() was it's
  last user. Additionally remove the system view SYSTEM.MODELS for
  inspecting the repository.

- SYSTEM RELOAD MODELS is also obsolete. HOWEVER, it was retained and
  made a no-op instead of deleted.

  Why?
  The reason is that RBAC in distributed setups works by storing
  privileges (granted and revoked) as plain SQL statements in Keeper.
  Nodes read these statements at startup and parse them. If a privilege
  for SYSTEM RELOAD MODELS exists but parser doesn't recognize it
  nodes would fail to come up.

  Considered but rejected alternatives:
  - Ignore SYSTEM RELOAD MODELS during parsing RBAC privileges and
    return an error for regular SYSTEM RELOAD MODELS SQL. Special-case
    of no-op behavior, too brittle.
  - Remove SYSTEM RELOAD MODELS manually from Keeper via command-line
    manipulation of Keeper nodes or via SQL by dropping the privileges.
    Needs user intervention during upgrade.
2022-09-08 09:10:11 +00:00
Robert Schulze
60f9f6855d
feat: implement catboost in library-bridge
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
2022-09-08 09:01:32 +00:00
peter279k
9d26235416 Improve building steps 2022-09-08 13:41:24 +08:00
Alexey Milovidov
9544b8fdd6
Merge pull request #40996 from ClickHouse/vdimir/issue-40994
Minor update doc for mysql_port
2022-09-08 02:39:12 +03:00
Alexey Milovidov
84a00e3992
Merge pull request #41087 from peter279k/improve_clickhouse_start
Improve clickhouse start command
2022-09-08 02:35:02 +03:00
Kseniia Sumarokova
eb53df48d1
Update storing-data.md 2022-09-07 22:26:52 +02:00
Kseniia Sumarokova
3af51f4340
Update storing-data.md 2022-09-07 22:21:46 +02:00
Denny Crane
a75eb5ad84
Update date-time-functions.md 2022-09-07 15:59:23 -03:00
Denny Crane
0071ef9e38
Update date-time-functions.md 2022-09-07 15:56:31 -03:00
peter279k
945299de99 Remove strange release trains 2022-09-08 01:24:12 +08:00
peter279k
1ae54d3d16 Improve clickhouse start command 2022-09-08 01:18:27 +08:00
Kseniia Sumarokova
4cb07bd48d
Merge branch 'master' into add-documentation-for-cache 2022-09-07 17:52:53 +02:00
Kseniia Sumarokova
6f06633df6
Update storing-data.md 2022-09-07 13:59:39 +02:00
vdimir
000ba8a60d
Use insert_qurum = auto instead of majority_insert_quorum 2022-09-07 11:19:27 +00:00
Sachin
ade4337978
Add majority_insert_quorum setting
majority_insert_quorum is defined as (number_of_replicas/2)+1. Insert
will be successful only if majority of quorum have applied it. If
insert_quorum and majority_insert_quorum both are specified, max of
both will be used.
2022-09-07 11:19:24 +00:00
kssenii
613c688331 Add documentation for cache 2022-09-07 13:12:19 +02:00
peter279k
b716988991 Remove non-existed released trains 2022-09-07 18:39:38 +08:00
DanRoscigno
3073da9ba5 move doc 2022-09-06 18:39:06 -04:00
Sergei Trifonov
2a55741dcb
Merge branch 'master' into readonly-settings-allow 2022-09-06 20:29:41 +02:00
DanRoscigno
7032a1b267 move title to frontmatter 2022-09-06 11:14:55 -04:00
Sergei Trifonov
6217559175
Merge branch 'master' into readonly-settings-allow 2022-09-06 16:10:48 +02:00
Filatenkov Artur
7949b3fb74
Merge branch 'master' into annoy 2022-09-06 11:23:15 +03:00
FArthur-cmd
7f311ad03c add words about setting to docs 2022-09-05 13:20:49 +00:00
Kruglov Pavel
582216a3ca
Merge pull request #39919 from pzhdfy/UniqSketch
UniqThetaSketch support set operation such as union/intersect/not
2022-09-05 13:42:14 +02:00
Vladimir C
8c3c3e7667
Minor update doc for mysql_port 2022-09-05 12:39:39 +02:00
Antonio Andelic
3a0581e990
Merge pull request #40543 from Lloyd-Pottiger/feat/support-read-only-for-embeddedrocksdb
Add read-only support for EmbeddedRocksDB
2022-09-05 09:31:07 +02:00
Alexey Milovidov
8ea7b9c978
Merge pull request #40980 from ClickHouse/alexey-milovidov-patch-5
Update replicated.md
2022-09-05 03:18:25 +03:00
Alexey Milovidov
f8e72eb7cb
Update replicated.md 2022-09-05 01:02:42 +03:00
Alexey Milovidov
053a2186b5
Update replicated.md 2022-09-05 01:01:23 +03:00
Alexey Milovidov
6a7593ec53
Merge branch 'master' into alexey-milovidov-patch-4 2022-09-04 20:30:15 +03:00
Alexey Milovidov
deeaea004d
Merge pull request #40295 from cyber-moon/patch-1
Add description of {condition}-keyword
2022-09-04 04:57:30 +03:00
Alexey Milovidov
7c3c367e01
Update tips.md 2022-09-04 04:18:57 +03:00
Alexey Milovidov
001733b6d0
Merge pull request #40921 from FrankChen021/mac_doc
Update doc about building on macOS
2022-09-04 04:05:34 +03:00
Alexey Milovidov
46f40c0c41
Merge pull request #40949 from AVMusorin/doc_generate_random_fix
Doc. optional params for GenerateRandom table
2022-09-04 03:54:51 +03:00
Alexey Milovidov
1963baa11e
Merge pull request #40964 from ClickHouse/fix-docs-formatting
Fix formatting of notes box in documentation
2022-09-04 03:39:39 +03:00
Denny Crane
dd19b0856e
Doc. mapApply, mapFilter, mapUpdate (#40961)
* Update tuple-map-functions.md

* Update tuple-map-functions.md
2022-09-04 00:43:39 +02:00
Denny Crane
f2de8ff8ff
Doc. commpressions http.md (#40959) 2022-09-04 00:42:47 +02:00
Robert Schulze
385427ade8
Fix formatting of notes box in documentation
Follow-up to PR #38435
2022-09-03 17:25:14 +00:00
Robert Schulze
5cff329439
Merge branch 'master' into typo-role-grants 2022-09-03 18:32:41 +02:00
Alexey Milovidov
1768a82a53 git checkout c4b8137d31 docs/en/getting-started/example-datasets/uk-price-paid.md 2022-09-03 06:45:18 +02:00
Aleksandr Musorin
69b9d34b10
docs. optional params for GenerateRandom table 2022-09-02 17:25:10 +02:00
Sergei Trifonov
005b2588d8
Merge branch 'master' into readonly-settings-allow 2022-09-02 16:37:43 +02:00
Sergei Trifonov
014d109175 fix build, fix docs, fix comments, logical fixes, test are still to be fixed and new test are to be added 2022-09-02 16:20:09 +02:00
Frank Chen
0f3003e37b Add ccache brew install list 2022-09-02 16:01:31 +02:00
Robert Schulze
53836bbeeb
Fix typo
The system view is called 'role*_*grants', documented on page
'role*-*grants.md'.
2022-09-02 12:49:50 +00:00
Lloyd-Pottiger
5a6b2106b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into feat/support-read-only-for-embeddedrocksdb 2022-09-02 18:10:00 +08:00
Lloyd-Pottiger
59dccd6e49 fix test
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-09-02 11:14:49 +08:00
DanRoscigno
6efd07cbc8 correct statement 2022-09-01 20:32:06 -04:00
DanRoscigno
662eed214f correct statements 2022-09-01 20:28:25 -04:00
Dan Roscigno
a733381821
Merge branch 'master' into update-nav 2022-09-01 16:56:43 -04:00
DanRoscigno
3e9225aafa move title to frontmatter, remove orig article link 2022-09-01 12:24:03 -04:00
Ivan Blinkov
a947487afe
[docs] fix link markdown 2022-09-01 18:16:13 +03:00
Александр
97e55ca2f5
Merge branch 'master' into docs_table_function_update 2022-09-01 14:01:32 +02:00
Dan Roscigno
29ac78a92b
Update uk price paid (#40828) 2022-09-01 13:32:33 +02:00
Fangyuan Deng
bc7d661668
Merge branch 'master' into UniqSketch 2022-09-01 19:31:53 +08:00
Denny Crane
e3af5a7a11
Doc. Added ON CLUSTER cluster in couple places (#40874) 2022-09-01 13:31:22 +02:00
pzhdfy
acec516271 add docs 2022-09-01 19:31:01 +08:00
Aleksandr Musorin
310e1484f6
docs - updated optional parameters for table functions 2022-09-01 13:28:56 +02:00
MaceWindu
21ab72365a
Update integrations.md
Add linq2db to list of third-party libraries
2022-09-01 11:39:27 +02:00
Robert Schulze
56eece40ec
Merge pull request #40736 from LevyCory/add-offset-to-formatDateTime
Add timezone offset support  to `formatDateTime`
2022-09-01 09:50:17 +02:00
Robert Schulze
912663b719
Revert "Move CatBoost evaluation into clickhouse-library-bridge" 2022-08-31 20:54:43 +02:00
Robert Schulze
ca01286028
Merge pull request #39629 from ClickHouse/catboost-bridge
Move CatBoost evaluation into clickhouse-library-bridge
2022-08-31 16:16:11 +02:00
DanRoscigno
50f9b12af8 review feedback 2022-08-31 09:12:48 -04:00
Dan Roscigno
ddac1b3f11
Merge pull request #40560 from DanRoscigno/add-backup
Add backup restore docs
2022-08-31 08:19:00 -04:00
Robert Schulze
40468d3304
Fix typo in docs 2022-08-30 20:45:31 +00:00
FArthur-cmd
e7abc06c89 Revert "Revert "Add Annoy index""
This reverts commit 6fdfb964d0.
2022-08-30 15:26:56 +00:00
Denny Crane
0d7cc82267
Update string-functions.md 2022-08-30 11:08:23 -03:00
DanRoscigno
f72b341e8b add status info 2022-08-30 09:34:08 -04:00
Alexander Tokmakov
6fdfb964d0
Revert "Add Annoy index" 2022-08-30 15:10:10 +03:00
Andrey Zvonov
93f9abf130
upd2 2022-08-30 14:41:40 +03:00
Andrey Zvonov
14adea8792
fix error in docs 2022-08-30 14:40:26 +03:00
Kseniia Sumarokova
c88db2ef97
Merge pull request #40751 from kssenii/fix-mysql-timeouts
Fix issue with mysql db / table function timeouts
2022-08-30 11:59:01 +02:00
Robert Schulze
cc4225109f
Merge pull request #37215 from Vector-Similarity-Search-for-ClickHouse/annoy-2
Test failures are unrelated, merging.
2022-08-30 09:25:57 +02:00
DanRoscigno
d712a91a20 add alternatives 2022-08-29 19:36:20 -04:00
DanRoscigno
0abeebd3ca updated with dev help 2022-08-29 19:29:10 -04:00
Alexey Milovidov
0190c56faf
Merge pull request #40770 from den-crane/patch-40
Doc. Fix cache dictionaries doc.
2022-08-30 02:19:32 +03:00
DanRoscigno
3a65d58c13 updated with dev help 2022-08-29 18:33:26 -04:00
Cory Levy
1e2eee7146 Remove unnecessary backslashes in markdown sql blocks 2022-08-29 16:31:31 -04:00
Robert Schulze
64a6aa328e
fix: broken links in documentation (hopefully) 2022-08-29 20:27:06 +00:00
Robert Schulze
6b2b3c1eb3
feat: implement catboost in library-bridge
This commit moves the catboost model evaluation out of the server
process into the library-bridge binary. This serves two goals: On the
one hand, crashes / memory corruptions of the catboost library no longer
affect the server. On the other hand, we can forbid loading dynamic
libraries in the server (catboost was the last consumer of this
functionality), thus improving security.

SQL syntax:

  SELECT
    catboostEvaluate('/path/to/model.bin', FEAT_1, ..., FEAT_N) > 0 AS prediction,
    ACTION AS target
  FROM amazon_train
  LIMIT 10

Required configuration:

  <catboost_lib_path>/path/to/libcatboostmodel.so</catboost_lib_path>

*** Implementation Details ***

The internal protocol between the server and the library-bridge is
simple:

- HTTP GET on path "/extdict_ping":
  A ping, used during the handshake to check if the library-bridge runs.

- HTTP POST on path "extdict_request"
  (1) Send a "catboost_GetTreeCount" request from the server to the
      bridge, containing a library path (e.g /home/user/libcatboost.so) and
      a model path (e.g. /home/user/model.bin). Rirst, this unloads the
      catboost library handler associated to the model path (if it was
      loaded), then loads the catboost library handler associated to the
      model path, then executes GetTreeCount() on the library handler and
      finally sends the result back to the server. Step (1) is called once
      by the server from FunctionCatBoostEvaluate::getReturnTypeImpl(). The
      library path handler is unloaded in the beginning because it contains
      state which may no longer be valid if the user runs
      catboost("/path/to/model.bin", ...) more than once and if "model.bin"
      was updated in between.
  (2) Send "catboost_Evaluate" from the server to the bridge, containing
      the model path and the features to run the interference on. Step (2)
      is called multiple times (once per chunk) by the server from function
      FunctionCatBoostEvaluate::executeImpl(). The library handler for the
      given model path is expected to be already loaded by Step (1).

Fixes #27870
2022-08-29 20:26:45 +00:00
Dan Roscigno
76a45aa750
Merge branch 'master' into add-backup 2022-08-29 16:23:53 -04:00
Denny Crane
fe0f18f21d
Update external-dicts-dict-layout.md 2022-08-29 15:19:15 -03:00
Kseniia Sumarokova
c5c48e44ea
Merge branch 'master' into fix-mysql-timeouts 2022-08-29 19:33:29 +02:00
DanRoscigno
76a3212fc8 replace symlinks 2022-08-29 12:26:17 -04:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
Filatenkov Artur
d73f661732
Merge branch 'master' into annoy-2 2022-08-29 17:33:13 +03:00
kssenii
0a6c4b9265 Fix 2022-08-29 16:20:53 +02:00
Sergei Trifonov
899bf99d44
Merge branch 'master' into readonly-settings-allow 2022-08-29 14:35:05 +02:00
alesapin
7ce0afc0df
Merge pull request #40670 from Avogar/kafka
Add setting to disable limit on kafka_num_consumers
2022-08-29 10:53:35 +02:00
Cory Levy
deb2a97020 Add docs 2022-08-28 22:28:34 -04:00
DanRoscigno
b50fa8b5a9 replace symlinks 2022-08-28 17:34:50 -04:00
Dan Roscigno
96cd94196e
Merge branch 'ClickHouse:master' into add-more-slugs 2022-08-28 12:06:37 -04:00
DanRoscigno
fad2e071eb replace symlinks with includes 2022-08-28 11:58:59 -04:00
DanRoscigno
5d1e3ee4d8 remove duplicate 2022-08-28 11:04:51 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
Alexey Milovidov
ddff5e9145
Merge pull request #40712 from ClickHouse/ci-cmake-self-extractable
cmake: Disable default ENABLE_CLICKHOUSE_SELF_EXTRACTING
2022-08-28 17:12:19 +03:00
DanRoscigno
db1a3b717c add slugs 2022-08-28 09:58:27 -04:00
DanRoscigno
c4caa35cfd add frontmatter dashes 2022-08-28 09:53:52 -04:00
Robert Schulze
df934d8762
Merge pull request #40217 from zvonand/zvonand-minmax
Fix conversion Date32 / DateTime64 / Date to narrow types
2022-08-28 09:42:39 +02:00
Yakov Olkhovskiy
d96f32d655
Update developer-instruction.md 2022-08-27 23:46:09 -04:00
Alexey Milovidov
6e564b18bf
Merge pull request #40600 from FrankChen021/check_url_arg
Validate the CompressionMethod parameter of URL table engine
2022-08-27 19:29:55 +03:00
Alexey Milovidov
859defa687
Merge pull request #40680 from DanRoscigno/add-slugs-everywhere
Add slugs everywhere
2022-08-27 00:05:22 +03:00
Mikhail f. Shiryaev
12bbc4a276
Merge pull request #40681 from ClickHouse/obsolete-tgz
Fix clickhouse-server doinst.sh
2022-08-26 22:04:34 +02:00
DanRoscigno
79f8e1c03c add slugs to all docs 2022-08-26 15:49:26 -04:00
Sergei Trifonov
c5d1bbf680 reimplement with <allow> tag 2022-08-26 21:20:00 +02:00
Mikhail f. Shiryaev
3f967b1822
Fix _includes/install/tgz.sh script for linux 2022-08-26 20:57:38 +02:00
Alexey Milovidov
eac54c0375
Merge pull request #40671 from vmihailenco/chore/uptrace
chore: add Uptrace tool and go-clickhouse client
2022-08-26 21:11:16 +03:00
FArthur-cmd
f3d0083e57 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-26 13:53:53 +00:00
Vladimir Mihailenco
d23d42251f chore: add Uptrace tool and go-clickhouse client 2022-08-26 16:04:33 +03:00
avogar
e31bba7731 Add docs 2022-08-26 12:52:15 +00:00
Peignon Melvyn
18c75d8ca9
Update settings.md
Fix according to: aaafb797c0/src/Core/Settings.h (L586)
2022-08-26 12:27:16 +02:00
Lloyd-Pottiger
0d33327eda
Merge branch 'master' into feat/support-read-only-for-embeddedrocksdb 2022-08-26 15:36:21 +08:00
DanRoscigno
ad56971e61 add text 2022-08-25 16:25:39 -04:00
Dan Roscigno
c9dea66f8d
Merge pull request #38308 from DanRoscigno/38284-add-grouping-function-docs
38284 add grouping function docs
2022-08-25 16:03:31 -04:00
DanRoscigno
5847c5cdbd reducing samples 2022-08-25 15:46:48 -04:00
Alexey Milovidov
64b8b8294d
Update grouping_function.md 2022-08-25 22:01:13 +03:00
Sergei Trifonov
6af43e7676
Merge branch 'master' into readonly-settings-allow 2022-08-25 17:27:03 +02:00
Sergei Trifonov
856a2f5956 Allow to modify constrained settings in readonly mode 2022-08-25 17:24:24 +02:00
Frank Chen
6f8af95e34 Update doc
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-08-25 14:49:43 +08:00
Lloyd-Pottiger
9d7ace3286
Merge branch 'master' into feat/support-read-only-for-embeddedrocksdb 2022-08-24 23:52:34 +08:00
Dan Roscigno
9972e758e4
Merge branch 'master' into add-backup 2022-08-23 21:20:53 -04:00
DanRoscigno
7bc08900ec added config for backup dest 2022-08-23 21:13:40 -04:00
DanRoscigno
cf2a6dab32 add selects 2022-08-23 20:43:09 -04:00
DanRoscigno
e617532d40 wip 2022-08-23 19:16:15 -04:00
zvonand
6ad02fd687 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-minmax 2022-08-24 01:12:38 +03:00
zvonand
e257f9d0cd update docs, tests + small fixes 2022-08-24 01:09:14 +03:00
zvonand
a9fd733871 updated docs 2022-08-24 01:09:14 +03:00
Andrey Zvonov
f40bd2194f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:42:19 +03:00
Andrey Zvonov
b54a04d48f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:42:01 +03:00
Andrey Zvonov
6c1fa6844f
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:41:19 +03:00
Andrey Zvonov
946223df20
Update docs/en/sql-reference/functions/date-time-functions.md
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:41:01 +03:00
Andrey Zvonov
e4f00e2f15
Update docs 1
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2022-08-23 23:40:34 +03:00
Denny Crane
add65a17e7
Update index.md 2022-08-23 15:02:44 -03:00
Denny Crane
a790725bea
Update index.md 2022-08-23 14:35:33 -03:00
Denny Crane
f93bb53c1f
Update index.md 2022-08-23 14:32:56 -03:00
Andrey Zvonov
52159b77d0
Merge branch 'master' into zvonand-minmax 2022-08-23 17:18:57 +03:00
Lloyd-Pottiger
ac3cf0beb4 add read_only option
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-08-23 20:58:57 +08:00
Kseniia Sumarokova
7acad11b90
Merge pull request #40504 from den-crane/patch-38
Doc. Example named-collections + clickhouse database
2022-08-23 10:51:02 +02:00
Antonio Andelic
a87a762b0c
Merge pull request #39973 from ClickHouse/keeper-listen-host
Support `interserver_listen_host` in Keeper
2022-08-23 09:03:08 +02:00
Antonio Andelic
0765495be1
Merge pull request #39986 from Lloyd-Pottiger/feat/support-ttl-for-embeddedrocksdb
Support TTL for EmbeddedRocksDB
2022-08-23 08:27:47 +02:00
Denny Crane
e6912c86b9
Update named-collections.md 2022-08-22 19:36:01 -03:00
Denny Crane
7428193a82
Update named-collections.md 2022-08-22 19:17:39 -03:00
FArthur-cmd
9222e41a5b add test and docs 2022-08-22 19:00:20 +00:00
Lloyd-Pottiger
85a1a36167 remove read_only option
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-08-22 23:31:55 +08:00