Commit Graph

707 Commits

Author SHA1 Message Date
Azat Khuzhin
1a8437f2c9 Add ability to ignore unknown keys in JSON object for named tuples
This can be useful in case your input JSON is complex, while you need
only few fields in it.

This behaviour is controlled by the
input_format_json_ignore_unknown_keys_in_named_tuple setting name, that
is turned OFF by default.

This will, almost, allow to parse gharchive dataset without jq. "almost"
because of two things:
- Tuple cannot be Nullable, so such keys with Tuple type in ClickHouse
  cannot be `null` in JSON
- You cannot use dot.dot notation to extract columns for file() engine,
  only tupleElement()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 10:01:08 +01:00
Dan Roscigno
777ddf80ab
Update docs/en/interfaces/formats.md 2023-01-26 11:18:18 -05:00
Denys Golotiuk
0eadb7112d
Added markdown format docs 2023-01-26 13:33:14 +02:00
Dan Roscigno
1cc3708092
Merge branch 'master' into update-settings-url 2023-01-24 19:51:39 -05:00
DanRoscigno
77ae27f26c update for split of format settings 2023-01-24 19:37:55 -05:00
Kruglov Pavel
23c12ac8ee
Merge branch 'master' into parquet-fixed-binary 2023-01-24 16:51:05 +01:00
Kruglov Pavel
4bd3f0e5ef
Merge pull request #44953 from Avogar/tsv-csv-detect-header
Detect header in CSV/TSV/CustomSeparated files automatically
2023-01-24 15:13:52 +01:00
Rich Raposa
429e93965c
Update formats.md
Google has a new website for Protocol Buffers. The old link expires on Jan 31, 2023
2023-01-23 15:42:35 -07:00
Kruglov Pavel
9820beae68
Apply suggestions from code review
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-01-19 16:11:13 +01:00
avogar
5bf4704e7a Support FixedSizeBinary type in Parquet/Arrow 2023-01-16 21:01:31 +00:00
Kruglov Pavel
e9d6590926
Merge branch 'master' into tsv-csv-detect-header 2023-01-16 17:50:24 +01:00
avogar
1c0941d72a Add docs and examples 2023-01-16 16:46:41 +00:00
avogar
87b934c472 Insert default values in case of missing tuple elements in JSONEachRow 2023-01-12 16:36:44 +00:00
DanRoscigno
7168c217b0 switch text to response for query blocks 2023-01-11 10:08:11 -05:00
serxa
8d099a4417 make more SQL queries copyable from docs in one click 2023-01-11 13:43:51 +00:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
Ivan Blinkov
b7e082d033 Remove "Original article links" 2023-01-09 15:13:36 +01:00
Kruglov Pavel
027b525820
Slightly better docs 2022-12-31 15:06:45 +01:00
Kruglov Pavel
791e8a90cf
Fix 2022-12-30 23:15:45 +01:00
Kruglov Pavel
7e14ee6eef
Fix incorrect docs 2022-12-30 23:14:14 +01:00
Dan Roscigno
bc456feb4b
Merge pull request #44708 from Avogar/schema-inference-docs
Add detailed documentation about schema inference
2022-12-30 11:19:09 -05:00
DanRoscigno
f6c94d8645 remove table of contents 2022-12-30 10:19:09 -05:00
DanRoscigno
0df0fe2cf0 edits 2022-12-30 09:55:03 -05:00
DanRoscigno
925ce4b96c edits 2022-12-30 09:21:12 -05:00
DanRoscigno
0902db3fe0 edits 2022-12-29 22:34:25 -05:00
avogar
f7168ce46b Add missing new line 2022-12-29 21:31:52 +00:00
avogar
ced668fafb Better 2022-12-29 21:21:37 +00:00
avogar
ae715b9d00 Finish docs 2022-12-29 20:42:03 +00:00
avogar
46b7ec4209 Add detailed documentation about schema inference 2022-12-29 13:42:56 +00:00
DanRoscigno
54e66d875c move title to frontatter 2022-12-23 19:33:10 -05:00
Yakov Olkhovskiy
9ce4e6b7e2
fix style 2022-12-16 17:30:40 -05:00
Yakov Olkhovskiy
bb5d7ff28b
Append requirement for FORMAT RowBinary with strict delimiter 2022-12-16 15:43:52 -05:00
Kruglov Pavel
59201c71cb
Merge pull request #44052 from Avogar/object-as-string
Allow to parse JSON objects into Strings in JSON input formats
2022-12-09 15:12:25 +01:00
San
1fe7fb01ff
Update html interface doc
Fixing doc to recommend user NOT to use username and password in URL parameters
2022-12-09 01:15:50 +00:00
avogar
d0f9bb2ec2 Allow to parse JSON objects into Strings 2022-12-08 18:58:18 +00:00
Kruglov Pavel
c35b2a6495
Add a limit for string size in RowBinary format (#43842) 2022-12-02 13:57:11 +01:00
Kruglov Pavel
98d6b96c82
Merge pull request #42033 from mark-polokhov/BSONEachRow
Add BSONEachRow input/output format
2022-11-22 14:45:21 +01:00
avogar
2af60f34eb Restrict document size in parallel parsing, allow to read ObjectId/JS code into String column 2022-11-15 13:35:17 +00:00
avogar
4d993e653a Fix build and style 2022-11-15 13:06:24 +00:00
avogar
842d25c358 Minor improvements, better docs 2022-11-14 20:05:01 +00:00
avogar
564d83bbc7 Better handle uint64 2022-11-11 13:24:12 +00:00
avogar
94c6dc42eb Use better types 2022-11-11 13:17:48 +00:00
avogar
9e89af28c6 Refactor BSONEachRow format, fix bugs, support more data types, support parallel parsing and schema inference 2022-11-10 20:15:14 +00:00
DanRoscigno
34f90ff6ef update pages that refer to dictionaries 2022-11-07 09:26:50 -05:00
Alexey Milovidov
9ccbadc359
Merge pull request #42275 from zimv/doc-update-client-libraries
Docs: Add  "node-clickhouse-orm" to the client-libraries.md
2022-10-15 08:18:16 +02:00
Kruglov Pavel
6fc12dd922
Merge pull request #41703 from Avogar/json-object-each-row
Add setting to obtain object name as column value in JSONObjectEachRow format
2022-10-14 20:11:04 +02:00
zimv
56ef17e083 Docs: Add "node-clickhouse-orm" to the client-libraries.md 2022-10-13 14:57:35 +08:00
Dan Roscigno
f4f85a069b
Go live with doc updates (#42053)
* QIP to add overview page

* wip

* New Tutorial and Datasets landing page

* give an example for Cloud

* Update UK Price Paid for Cloud

* Update nyc-taxi.md

* add option for Cloud Load Data button

* Removed the Import Raw Data section

* Update nyc-taxi.md

* update user management and replication docs

* mark self managed

* set doc ordering

* add redirects setting

* Simple fixes to index.md

Co-authored-by: rfraposa <richraposa@gmail.com>
2022-10-04 14:36:59 +03:00
Sergei Trifonov
ea13b81cc3
Merge pull request #42016 from peter279k/improve_mysql_interface_setting
Improve the MySQL interface usage description
2022-10-03 15:04:15 +02:00
peter279k
fc382a0144 Improve the MySQL interface usage description 2022-10-03 17:19:02 +08:00
peter279k
2c30b5febb Improve gRPC client example 2022-10-03 16:54:35 +08:00
Kruglov Pavel
9c1e654584
Fix typo 2022-09-28 16:38:04 +02:00
avogar
03ee7efcb9 Better example in docs 2022-09-28 12:48:31 +00:00
Kruglov Pavel
bfddb91c9a
Update docs/en/interfaces/formats.md
Co-authored-by: Sergei Trifonov <svtrifonov@gmail.com>
2022-09-28 14:15:53 +02:00
avogar
4f32ef9bb7 Add docs 2022-09-22 17:04:42 +00:00
Peignon Melvyn
d040e41460
Update http.md 2022-09-22 00:23:05 +02:00
Kruglov Pavel
22e11aef2d
Merge pull request #40910 from Avogar/new-json-formats
Add new JSON formats, add improvements and refactoring
2022-09-21 14:19:08 +02:00
avogar
868ce8bc16 Fix comments, make better naming, add docs, add setting output_format_json_quote_64bit_floats 2022-09-20 13:49:17 +00:00
DanRoscigno
149970447a add link to formats 2022-09-16 17:21:03 -04:00
avogar
ef7f7b30aa Fix tests 2022-09-15 18:20:17 +00:00
Robert Schulze
d071dbe5a0
Merge branch 'master' into patch-1 2022-09-13 22:27:48 +02:00
avogar
9abc6a9c3f Fix typos 2022-09-09 15:10:00 +00:00
avogar
ae7f9abd32 Add documentation 2022-09-09 12:04:49 +00:00
Denny Crane
f2de8ff8ff
Doc. commpressions http.md (#40959) 2022-09-04 00:42:47 +02:00
MaceWindu
21ab72365a
Update integrations.md
Add linq2db to list of third-party libraries
2022-09-01 11:39:27 +02:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
Vladimir Mihailenco
d23d42251f chore: add Uptrace tool and go-clickhouse client 2022-08-26 16:04:33 +03:00
Nikita Taranov
ce89660432
Update "Queries with Parameter" docs (#40317)
* impl

* Update docs/en/interfaces/cli.md

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2022-08-17 22:31:50 +02:00
Rich Raposa
a3a124cc34
Added --ask-password option to documentation (#40289) 2022-08-17 00:20:10 +02:00
Lorenzo Mangani
5f90de93e3
Update gui.md 2022-08-14 11:00:57 +02:00
Lorenzo Mangani
297e49ff6c
Add metrico applications (qryn, clickhouse-mate) 2022-08-14 10:53:51 +02:00
Kruglov Pavel
99b9e85a8f
Merge pull request #39646 from Avogar/more-formats
Add more Pretty formats
2022-08-09 13:59:47 +02:00
Rich Raposa
b08bdfcfc2
Update gui.md
Typo in clickcat description
2022-07-29 07:25:29 -06:00
qinghuan wang
4047a865cb
update clickcat 2022-07-29 10:26:21 +08:00
avogar
f925046dc4 Add more Pretty formats 2022-07-27 11:37:02 +00:00
Alexey Milovidov
71060a7e8c
Merge pull request #39501 from ClickHouse/DanRoscigno-patch-3
update Grafana plugin in docs
2022-07-26 07:04:22 +03:00
Denny Crane
bca33a5a0a
Update formats.md 2022-07-24 20:57:37 -03:00
Dan Roscigno
e016f73b31
update Grafana plugin 2022-07-22 11:42:14 -04:00
Denny Crane
1d5b2b770e
Update formats.md 2022-07-19 18:23:02 -03:00
Denny Crane
be1d40916a
Update formats.md 2022-07-19 18:22:21 -03:00
Kruglov Pavel
4080f055b6
Merge pull request #38477 from Avogar/sql-insert-format
Add SQLInsert output format
2022-07-04 15:06:33 +02:00
santrancisco
974e99fcfe Remove broken client library link 2022-07-01 19:07:42 +10:00
avogar
34a92383f1 Update docs 2022-06-30 16:17:14 +00:00
avogar
9bb68bc6de Add SQLInsert output format 2022-06-27 18:31:57 +00:00
DanRoscigno
d6149a210f add H2 for Algolia indexing 2022-06-21 08:20:30 -04:00
Alexey Milovidov
7e9a3796e9 Fix wrong docs 2022-06-21 00:09:55 +02:00
Alexey Milovidov
a60a55b83c
Merge pull request #38203 from pan3793/patch-1
Docs: Mention Spark ClickHouse Connector in thrid party
2022-06-19 19:51:58 +03:00
Cheng Pan
ee47ab1aa4
Docs: Mention Spark ClickHouse Connector in thrid party
It builds on Spark DataSourceV2 API and gRPC protocol.
2022-06-19 09:11:44 +08:00
Alexey Milovidov
c8304d232e
Add userver to the docs 2022-06-18 20:08:32 +03:00
Alexey Milovidov
84ec17704e
Merge pull request #37880 from loyd/docs/more-rust-libs
Add more Rust client libraries to documentation
2022-06-11 21:31:24 +03:00
Vladimir C
38892951d0
clickhouse.rs in docs 2022-06-10 12:58:00 +02:00
Kruglov Pavel
d49dcc2b58
Fix using INSERT INTO ... FORMAT ... SETTINGS ... in docs 2022-06-09 16:16:43 +02:00
vdimir
dc772335ee
Doc typos, dict 2022-06-08 14:31:01 +02:00
vdimir
94bddec0bc
More typos checked and fixed 2022-06-08 14:28:41 +02:00
vdimir
9bd9c3d1d1
Fix some typos in docs 2022-06-08 14:26:02 +02:00
Kruglov Pavel
91c8951a1a
Merge pull request #37698 from Avogar/update_format_settings_docs
Refactor docs related to format settings
2022-06-07 13:28:36 +02:00
Paul Loyd
6da9f708ad
docs: add more Rust client libraries 2022-06-06 14:23:47 +08:00
Alexey Milovidov
fd14d168df
Merge pull request #37635 from kl7sn/master
add clickvisual intro
2022-06-04 14:36:43 +03:00
avogar
f65ad93ff0 Add some fixes 2022-06-03 12:11:46 +00:00
rfraposa
869967de41 Remove H1 anchor tags from docs 2022-06-02 04:55:18 -06:00
avogar
636cd6e1d3 Add fixes 2022-05-31 15:20:38 +00:00
avogar
858570d335 Refactor docs related to format settings 2022-05-31 15:18:49 +00:00
Kruglov Pavel
7cc87d9a65
Merge pull request #37537 from Avogar/skip-first-lines
Allow to skip some of the first lines in CSV/TSV formats
2022-05-31 14:26:21 +02:00
avogar
139a7e19a9 Fix comments 2022-05-30 11:43:29 +00:00
MEX7
fa34663708 Merge remote-tracking branch 'upstream/master' 2022-05-30 15:55:23 +08:00
MEX7
1b6aa31419 docs: add clickvisual intro 2022-05-30 15:44:06 +08:00
qinghuan wang
ded9f5675d
Update gui.md 2022-05-30 09:22:06 +08:00
Alexey Milovidov
746ff42239
Update gui.md 2022-05-30 01:13:03 +03:00
qinghuan wang
c14b547f00
Update gui.md 2022-05-29 20:19:23 +08:00
avogar
ede6e2f433 Add docs for settings 2022-05-25 15:10:20 +00:00
avogar
d2304f5d15 Make better 2022-05-20 12:07:29 +00:00
avogar
12010a81b7 Make better 2022-05-18 09:25:26 +00:00
mergify[bot]
4a661b6e78
Merge branch 'master' into json-columns-formats 2022-05-13 11:32:03 +00:00
rfraposa
3234534dd8 Fix table on formats.md page 2022-05-10 22:55:17 -06:00
rfraposa
22bb9bbf28 Add section on SSL 2022-05-10 09:12:48 -06:00
avogar
f6b16880bd Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-columns-formats 2022-05-10 12:57:18 +00:00
rfraposa
0b9da27ca2 Update postgresql.md 2022-05-09 14:21:38 -06:00
rfraposa
72b0cbbb53 Add a docs page for the PostgreSQL wire protocol 2022-05-09 13:53:22 -06:00
avogar
04fdd75c56 Make JSONColumns frormats mono block by default 2022-05-09 11:13:44 +00:00
Alexey Milovidov
3755466e8d
Merge pull request #34916 from nic11/pr/content-type
Support content_type in HTTP handler config
2022-05-08 16:36:21 +03:00
avogar
9c5ad1e773 Add docs 2022-05-06 16:51:50 +00:00
Kruglov Pavel
9618fddea2
Fix formats docs 2022-05-06 17:49:02 +02:00
Kruglov Pavel
4d08587559
Merge branch 'master' into mysqldump-format 2022-04-28 15:58:18 +02:00
vdimir
560d668c38
Add doc for output format Prometheus 2022-04-26 14:57:36 +00:00
avogar
33d845dade Add MySQLDump input format 2022-04-26 10:42:56 +00:00
Mikhail f. Shiryaev
7925d925a9
Merge branch 'master' into docs-staging 2022-04-19 11:00:03 +02:00
rfraposa
fb08c5b7e1 Merge branch 'master' into docs-staging 2022-04-15 07:25:27 -06:00
Alexey Milovidov
281ce4bfc7
Update http.md 2022-04-14 03:04:34 +03:00
Michael Lex
7b0f1fbb88 Extend TLS documentation.
Information about used defaults.
Better explanation of the extendedVerification option (which enables hostname verification)
Better explanation of the caConfig option and how files vs. paths are treated.
Mention TLS config in CLI documentation and link to server-side settings (which are the same).
2022-04-13 12:07:37 +02:00
rfraposa
d9e6f780db Fixed broken links 2022-04-10 23:01:34 -06:00
rfraposa
4da4259c78 Added reference docs to sidebar 2022-04-10 21:27:48 -06:00
Roman Nikonov
daceac5c0b Merge branch 'master' into pr/content-type 2022-04-10 01:21:28 +03:00
rfraposa
8f01fe9c49 Revised /en folder 2022-04-09 07:34:21 -06:00
rfraposa
5250d9ad11 Removed /ja folder, cleaned up /ru markdown 2022-04-09 07:29:05 -06:00
Alexey Milovidov
9854b55835
Revert "Format changes for new docs" 2022-04-04 02:05:35 +03:00
Roman Nikonov
d81a8cd317 Merge branch 'master' into pr/content-type 2022-04-03 20:53:51 +03:00
rfraposa
72a00e2c62 Fixed broken links 2022-04-02 17:38:54 -06:00
rfraposa
01ec63c909 Updates /operations docs 2022-03-29 20:38:50 -06:00
rfraposa
421812a877 Updates /interfaces docs 2022-03-29 17:57:11 -06:00
rfraposa
33e28bcb18 Updated /development folder 2022-03-29 08:26:35 -06:00
rfraposa
a5c7a947ad Merge branch 'master' of github.com:rfraposa/ClickHouse 2022-03-28 23:09:52 -06:00
rfraposa
c05bf7beb4 Testing new /en folder 2022-03-28 23:09:17 -06:00
Sergio Tulentsev
ef5062ec43
docs: Replace some usages of "rows" which are meant to be "strings"
The wrong term was confusing in the description of the CSV format.
2022-03-21 17:52:30 +00:00
taiyang-li
7a0e09db28 update data type mapping of clickhouse and arrow/orc/parquet 2022-03-19 11:25:59 +08:00
Robert Schulze
0d2ece6d91
Merge branch 'ClickHouse:master' into protobuf-batch-write 2022-03-16 09:43:33 +01:00
Sergei Trifonov
5fad4db4eb
LineAsString is supported output format now
support added in #30919
2022-03-15 14:56:43 +01:00
Robert Schulze
317166eac3
Document ProtobufList format 2022-03-15 14:11:32 +01:00
rfraposa
5a4466cec7 Update references in docs 2022-03-12 00:24:31 -06:00
Ivan Blinkov
4178a4de68
[docs] update integrations.md (#35221)
* Update integrations.md

* Update integrations.md

* Update integrations.md

* Update integrations.md
2022-03-11 23:51:56 +03:00
mergify[bot]
82e115c097
Merge branch 'master' into pr/content-type 2022-02-26 00:45:54 +00:00