Commit Graph

2799 Commits

Author SHA1 Message Date
Robert Schulze
0a8dee7000
Docs: Fix link 2023-01-29 11:26:49 +00:00
Alexey Milovidov
a62ca0f016
Merge pull request #45688 from jus1096/master
Add info about connect to remote Clickhouse
2023-01-28 02:21:28 +03:00
Robert Schulze
e30c38cab3
Fix up some leftovers 2023-01-27 10:43:43 +00:00
Azat Khuzhin
1a8437f2c9 Add ability to ignore unknown keys in JSON object for named tuples
This can be useful in case your input JSON is complex, while you need
only few fields in it.

This behaviour is controlled by the
input_format_json_ignore_unknown_keys_in_named_tuple setting name, that
is turned OFF by default.

This will, almost, allow to parse gharchive dataset without jq. "almost"
because of two things:
- Tuple cannot be Nullable, so such keys with Tuple type in ClickHouse
  cannot be `null` in JSON
- You cannot use dot.dot notation to extract columns for file() engine,
  only tupleElement()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 10:01:08 +01:00
Jus
9ce4bf1baf
Update named-collections.md
small fix name host on the remote host
2023-01-27 12:42:53 +04:00
Robert Schulze
7d97fab2dc
Untangle query result cache settings
This PR modularizes the configuration options of the query result cache
(QRC).

1. Add a feature toggle "allow_experimental_query_result_cache = false"
   which controls whether the experimental QRC can be used at all. This
   configuration option will be removed once the QRC becomes
   non-experimental.

2. Modularize the existing two configuration settings
   "enable_experimental_query_result_cache" and
   "enable_experimental_query_result_cache_passive_usage" into three
   orthogonal settings:

   - "use_query_result_cache = false" controls whether a query (or all
     queries of the session) utilize the query result cache

   - settings "use_query_result_cache_passive_usage = true" and
     "use_query_result_cache_active_usage = true" control the way a
     query (or all queries of the session) utilize the query result
     cache: "passive" use is reading, "active" use is writing.
2023-01-26 21:17:48 +00:00
Dan Roscigno
76d6e2edf9
Merge pull request #45569 from AVMusorin/docs_optimize_skip_merged_partitions
docs: added optimize_skip_merged_partitions setting
2023-01-26 16:04:27 -05:00
Igor Nikonov
ed01f76c6a
Merge pull request #45592 from ClickHouse/update-insert-delay-doc-2
Update INSERT delay doc with example
2023-01-26 12:55:35 +01:00
Antonio Andelic
07b2c5ce0f
Merge branch 'master' into custom-key-parallel-replicas 2023-01-26 12:42:04 +01:00
Dan Roscigno
b4ab361366
Merge branch 'master' into docs_optimize_skip_merged_partitions 2023-01-25 19:45:32 -05:00
sichenzhao
243ac52259
Added two metrics about memory usage in cgroup to asynchronous metrics (#45301) 2023-01-25 20:32:17 +01:00
Dan Roscigno
e520bd8052
Apply suggestions from code review 2023-01-24 19:10:30 -05:00
Igor Nikonov
29ef6b9574
Update INSERT delay doc properly 2023-01-25 00:26:32 +01:00
Dan Roscigno
dbb83dc9a4
Merge branch 'master' into docs-for-s3-settings 2023-01-24 17:55:31 -05:00
DanRoscigno
fe56967af7 fix note formatting 2023-01-24 17:44:10 -05:00
DanRoscigno
9775987ee9 add new settings for s3 and hdfs 2023-01-24 17:40:37 -05:00
DanRoscigno
f95bc55923 split Format settings out 2023-01-24 17:19:50 -05:00
rfraposa
6f7755ebcd Added optimize using constraints settings 2023-01-24 15:05:34 -07:00
Igor Nikonov
e585a1228f
Update docs/en/operations/settings/merge-tree-settings.md
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-01-24 16:52:32 +01:00
Igor Nikonov
21b009fdec
Update merge-tree-settings.md 2023-01-24 15:45:21 +01:00
AVMusorin
5f8658b2d6
docs: added optimize_skip_merged_partitions setting 2023-01-24 14:56:39 +01:00
DanRoscigno
72b1a65984 WIP 2023-01-24 07:45:59 -05:00
Antonio Andelic
95853af459 Merge branch 'master' into custom-key-parallel-replicas 2023-01-24 10:49:40 +00:00
Antonio Andelic
37b62b3a58 Use Map for custom_key 2023-01-24 10:46:47 +00:00
DanRoscigno
dedb4e4de2 add docs for PR 33302 2023-01-23 16:14:39 -05:00
Kruglov Pavel
478a552a0a
Merge branch 'master' into tsv-csv-detect-header 2023-01-23 21:47:17 +01:00
Dan Roscigno
ee31da9e1e
Merge pull request #45366 from gingerwizard/cross-link-docs
link docs to blogs
2023-01-23 14:04:59 -05:00
Robert Schulze
0ab7ae6c17
Merge pull request #43797 from ClickHouse/query-result-cache
Query result cache [experimental]
2023-01-23 19:54:35 +01:00
Antonio Andelic
c15128491b Update max_parallel_replicas docs 2023-01-23 17:24:48 +01:00
Robert Schulze
ed84021aa5
Formatting fixup 2023-01-22 16:45:26 +01:00
Robert Schulze
0ffffdd442
Docs: Fix weird formatting 2023-01-22 15:38:11 +00:00
Robert Schulze
340f406553
Merge branch 'master' into query-result-cache 2023-01-22 13:21:36 +01:00
Han Fei
18a397f8c9 address comments 2023-01-20 18:09:42 +01:00
Han Fei
449ace3373
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:07:19 +01:00
Han Fei
9d87bd10ee
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:07:08 +01:00
Han Fei
badfbcb3d8
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:06:58 +01:00
Han Fei
e9c4cf46cd
Update docs/en/operations/settings/merge-tree-settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:06:46 +01:00
Han Fei
9d254f7d87
Update docs/en/operations/settings/merge-tree-settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:06:32 +01:00
Kruglov Pavel
28ddcc2432
Merge branch 'master' into tsv-csv-detect-header 2023-01-20 15:08:38 +01:00
Han Fei
5fc4998f10 update docs for async insert deduplication 2023-01-20 14:42:11 +01:00
Robert Schulze
bfcb5e7915
Fix typos 2023-01-19 16:08:21 +00:00
Stig Bakken
420c179b55 Add <storage_policy> config parameter for system logs 2023-01-19 10:25:28 +01:00
Robert Schulze
4f90824347
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-17 22:49:53 +00:00
Robert Schulze
fd7f5dad1c
Docs improvements 2023-01-17 22:03:48 +00:00
Sergei Trifonov
ca0fb785f4
Merge pull request #45193 from ClickHouse/concurrency-control-docs
Add docs for concurrency control logic
2023-01-17 21:10:17 +01:00
Dale Mcdiarmid
9c4d3e0ffb link docs to blogs 2023-01-17 15:38:10 +00:00
Kruglov Pavel
96bb99f864
Merge branch 'master' into tsv-csv-detect-header 2023-01-17 15:33:02 +01:00
Vladimir C
b80ee8df50
Merge pull request #45256 from DanRoscigno/add-grace-hash-docs 2023-01-16 18:43:19 +01:00
Kruglov Pavel
e9d6590926
Merge branch 'master' into tsv-csv-detect-header 2023-01-16 17:50:24 +01:00
Kruglov Pavel
bdb3517512
Merge pull request #45231 from Avogar/json-tuples
Insert default values in case of missing tuple elements in JSONEachRow
2023-01-16 17:49:50 +01:00
avogar
1c0941d72a Add docs and examples 2023-01-16 16:46:41 +00:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-16 08:04:49 +00:00
Robert Schulze
27fe7ebd93
Cosmetics 2023-01-15 16:12:48 +00:00
Tanya Bragin
36ec76f53d
Update clickhouse-local.md
cc @DanRoscigno @gingerwizard Adding latest clickhouse-local blog to related content on this page.
2023-01-14 07:50:10 -08:00
DanRoscigno
d0a55f6dc9 doc grace_hash algorithm for join 2023-01-13 13:17:03 -05:00
Robert Schulze
15e11741cb
Cosmetics 2023-01-13 00:00:23 +00:00
Robert Schulze
475bb31f33
Make server configuratio hierarchical 2023-01-12 21:24:40 +00:00
Yakov Olkhovskiy
842a34666c
Merge pull request #44594 from arenadata/ADQM-634
Add keytab parameter in kerberos section of config.xml
2023-01-12 15:07:45 -05:00
avogar
87b934c472 Insert default values in case of missing tuple elements in JSONEachRow 2023-01-12 16:36:44 +00:00
serxa
2dae6a1ffe add docs for concurrency control logic 2023-01-11 19:19:51 +00:00
Sergei Trifonov
ec9f10e934
Merge pull request #45174 from ClickHouse/make-queries-copyable-from-docs
make more SQL queries copyable from docs in one click
2023-01-11 16:59:52 +01:00
DanRoscigno
7168c217b0 switch text to response for query blocks 2023-01-11 10:08:11 -05:00
Dan Roscigno
bb3c4641a7
Merge pull request #45167 from ClickHouse/add-sparse-serialization-to-docs
Add explanation of ratio_of_defaults_for_sparse_serialization setting to docs
2023-01-11 08:57:10 -05:00
serxa
8d099a4417 make more SQL queries copyable from docs in one click 2023-01-11 13:43:51 +00:00
DanRoscigno
4767147745 format query response 2023-01-11 08:23:44 -05:00
serxa
a79f6d19fa add docs for system.moves table 2023-01-11 13:04:05 +00:00
Robert Schulze
12a29fec35
Hide secrets from system.query_result_cache 2023-01-11 12:50:45 +00:00
rfraposa
1ddc9c3bb6 Update merge-tree-settings.md 2023-01-11 05:44:51 -07:00
Dan Roscigno
37da8e206b
Merge pull request #45119 from ClickHouse/add-default-table-engine-setting
Added description of default_table_engine setting
2023-01-10 09:59:09 -05:00
Dan Roscigno
ee88814cac
formal to form 2023-01-10 09:42:04 -05:00
rfraposa
d61eae8554 Update settings.md
Added description of default_table_engine
2023-01-10 07:40:22 -07:00
Rich Raposa
b76d0d60db
Merge pull request #45089 from ClickHouse/add-cnf-docs
Add convert_query_to_cnf to docs
2023-01-10 07:11:57 -07:00
Robert Schulze
8dc3cbc822
Merge pull request #45109 from ClickHouse/consistent-schema-interference-cache-heading
Docs: Make heading consistent with other headings in System Table docs
2023-01-10 14:02:49 +01:00
Robert Schulze
96a722793c
Docs: Make heading consistent with other headings in System Table docs 2023-01-10 12:49:49 +00:00
Robert Schulze
923fa2c15a
Fix review comments, pt. II 2023-01-10 10:21:08 +00:00
Robert Schulze
0c3b034887
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-10 09:02:41 +00:00
rfraposa
62b9e2f063 Update settings.md
Add convert_query_to_cnf setting
2023-01-09 21:30:24 -07:00
Rich Raposa
528acecc5c
Merge pull request #45076 from ClickHouse/new-mergetree-settings
Add docs for 2 new MergeTree settings
2023-01-09 16:48:26 -07:00
Dan Roscigno
99b1609fd3
Update docs/en/operations/settings/index.md 2023-01-09 18:17:29 -05:00
rfraposa
db7342769b Update merge-tree-settings.md
Added two new settings
2023-01-09 15:56:19 -07:00
rfraposa
eb96884ebf Add new DEFAULT value of settings 2023-01-09 15:02:35 -07:00
Robert Schulze
ad4884b394
Fix review comments, pt. I 2023-01-09 21:42:51 +00:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
Ivan Blinkov
b7e082d033 Remove "Original article links" 2023-01-09 15:13:36 +01:00
Roman Vasin
2995c6d866 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-634 2023-01-09 08:26:45 +00:00
DanRoscigno
e0b258b4a9 move persistence setting docs 2023-01-06 17:01:28 -05:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-06 20:42:48 +00:00
Ilya Yatsishin
71cb4ecde1
Add docs for #43308 2023-01-06 15:30:57 +01:00
DanRoscigno
273ad90d1d add additional table filters setting 2023-01-05 10:47:18 -05:00
Robert Schulze
4fcead15c3
Fix handling of exceptions during query runtime 2023-01-04 22:33:04 +00:00
DanRoscigno
bece361a79 add command summary 2023-01-04 07:32:52 -05:00
Dmitry Novik
c646048af9
Merge pull request #44461 from ClickHouse/parts-removal-limit
Add part removal limit for one CleanupThread iteration
2023-01-02 20:04:19 +01:00
Kruglov Pavel
966f57ef68
Merge pull request #42777 from Avogar/improve-streaming-engines
Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and data formats
2023-01-02 15:59:06 +01:00
Robert Schulze
9ab910102f
Add note + test about exception handling 2023-01-02 10:24:01 +00:00
Robert Schulze
8381d8b467
query_result_cache_keep_seconds_alive --> query_result_cache_ttl 2023-01-02 09:38:40 +00:00
Robert Schulze
ba55fd3ad2
Cosmetics 2023-01-02 09:30:44 +00:00
Robert Schulze
e9e04166d9
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-02 08:20:27 +00:00
Kruglov Pavel
5bdbee4e56
Edit URL->HDFS 2022-12-30 15:52:38 +01:00
DanRoscigno
2cc0ca3a29 full paths, add users_file_dir 2022-12-29 21:53:42 -05:00
Kruglov Pavel
894726bd8f
Merge branch 'master' into improve-streaming-engines 2022-12-29 22:59:45 +01:00
avogar
ced668fafb Better 2022-12-29 21:21:37 +00:00
avogar
46b7ec4209 Add detailed documentation about schema inference 2022-12-29 13:42:56 +00:00
Dmitry Novik
6efd64a61c
Merge branch 'master' into parts-removal-limit 2022-12-28 17:34:48 +01:00
Roman Vasin
483e26cf2f
Merge branch 'master' into ADQM-634 2022-12-26 15:34:38 +03:00
Roman Vasin
5a7257069b Updated docs 2022-12-26 12:22:29 +00:00
Robert Schulze
0dbed9e738
Mac OS X --> macOS 2022-12-22 09:37:17 +00:00
Dmitry Novik
c594ec3632 Add documentation 2022-12-21 14:56:32 +00:00
Sergei Trifonov
048525273f
Merge branch 'master' into Avogar-patch-1 2022-12-21 11:54:18 +01:00
Kruglov Pavel
5e01a3d74e
Merge branch 'master' into improve-streaming-engines 2022-12-21 10:51:50 +01:00
Kruglov Pavel
36a6ee4fdb
Add documentation for setting allow_settings_after_format_in_insert 2022-12-20 22:04:37 +01:00
DanRoscigno
c6513624c4 add support case note for compat setting 2022-12-20 15:03:42 -05:00
Robert Schulze
b93c56323c
Merge remote-tracking branch 'origin/master' into query-result-cache 2022-12-19 09:18:36 +00:00
Robert Schulze
5e446b0d21
AST --> Abstract Syntax Tree 2022-12-19 09:14:57 +00:00
Robert Schulze
d81e507952
Fix doc links 2022-12-18 12:23:38 +00:00
Robert Schulze
bc6bcdfd7b
Allow sharing of cache entries 2022-12-17 18:04:18 +00:00
Robert Schulze
aa50b9cf48
Invert config parameter name for more clarity 2022-12-17 15:10:04 +00:00
Kruglov Pavel
37df9b9990
Merge branch 'master' into refactor-schema-inference 2022-12-16 19:13:15 +01:00
Kruglov Pavel
3fad5c7f1f
Merge branch 'master' into refactor-schema-inference 2022-12-16 14:24:51 +01:00
Robert Schulze
d1615ec283
Display metrics for query result cache 2022-12-16 10:49:15 +00:00
Robert Schulze
3790952631
Move server-level settings into the appropriate document 2022-12-15 22:51:47 +00:00
Robert Schulze
4db33f16e3
Make DoS attack on cache less likely 2022-12-15 21:42:51 +00:00
Robert Schulze
c58bec0789
Fix grammar in docs 2022-12-15 20:21:02 +00:00
Robert Schulze
bcc54ab9b4
Add cfg for min query duration for caching 2022-12-15 20:10:37 +00:00
Robert Schulze
d92cdc5afd
Fix typo 2022-12-15 19:08:30 +00:00
Robert Schulze
08a36ac402
Improve documentation 2022-12-15 18:07:45 +00:00
Kruglov Pavel
c5b2e4cc23
Merge branch 'master' into improve-streaming-engines 2022-12-15 18:44:35 +01:00
Robert Schulze
f3f4f0c7a6
Slightly clearer docs 2022-12-15 17:33:30 +00:00
Kruglov Pavel
00d80e44cc
Fix typos 2022-12-15 16:18:40 +01:00
Kruglov Pavel
7657f16e2a
Add missing documentation for some schema inference settings 2022-12-15 16:17:18 +01:00
Kruglov Pavel
0816626373
Update docs 2022-12-15 16:10:06 +01:00
Sergei Trifonov
f0de30de92
fix typos 2022-12-15 14:11:16 +01:00
Robert Schulze
3a0bd18b62
Typos 2022-12-15 13:06:24 +00:00
Robert Schulze
537c64aad2
Merge remote-tracking branch 'origin/master' into query-result-cache
Conflicts:
- tests/queries/0_stateless/02117_show_create_table_system.reference
2022-12-15 12:17:58 +00:00
Robert Schulze
973d4f75de
More intuitive active/passive enablement of query result cache 2022-12-15 12:16:36 +00:00
Robert Schulze
f1e367179e
Make maximum record count per item configurable 2022-12-15 11:16:44 +00:00
Robert Schulze
e52dfaf45c
Make number of cached items configurable 2022-12-15 10:08:28 +00:00
Alexander Tokmakov
f9d63de22f
Merge pull request #43468 from lingtaolf/feature/add_create_database_query
Add engine_full column to system.databases
2022-12-13 23:00:42 +03:00
avogar
f3e37c2c9b Merge branch 'refactor-schema-inference' of github.com:Avogar/ClickHouse into refactor-schema-inference 2022-12-12 14:47:04 +00:00
Kruglov Pavel
a03549df28
Apply suggestions from code review
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2022-12-12 15:46:03 +01:00
Robert Schulze
fc972d760f
Make it configurable if queries with non-deterministic functions are cached 2022-12-12 14:03:21 +00:00
Robert Schulze
b78652e138
Query result cache 2022-12-12 10:37:10 +00:00
Alexander Tokmakov
714666e944 Merge branch 'master' into feature/add_create_database_query 2022-12-09 17:47:15 +01:00
avogar
cd4fa00d2c Merge branch 'master' of github.com:ClickHouse/ClickHouse into refactor-schema-inference 2022-12-09 14:45:10 +00:00
Kruglov Pavel
59201c71cb
Merge pull request #44052 from Avogar/object-as-string
Allow to parse JSON objects into Strings in JSON input formats
2022-12-09 15:12:25 +01:00
Dan Roscigno
1027ce8d77
Add issue list when running mismatched versions 2022-12-09 08:43:26 -05:00
Sergei Trifonov
7c37e48092
Merge pull request #43903 from ClickHouse/merge_tree_settings_constraints
Constraints on merge tree settings
2022-12-09 14:16:14 +01:00
DanRoscigno
5e909c1684 add notes from tavplubix 2022-12-08 19:05:05 -05:00
Sergei Trifonov
bae1519970
Merge branch 'master' into merge_tree_settings_constraints 2022-12-08 22:25:16 +01:00
DanRoscigno
6051301bfe add overview of rolling upgrade 2022-12-08 15:40:47 -05:00
Kruglov Pavel
0d17774440
Better example in docs 2022-12-08 20:57:28 +01:00
avogar
d0f9bb2ec2 Allow to parse JSON objects into Strings 2022-12-08 18:58:18 +00:00
avogar
7375a7d429 Refactor and improve schema inference for text formats 2022-12-07 21:19:27 +00:00
Dan Roscigno
c5eb269515
Merge pull request #43943 from DanRoscigno/update-operations-docs
Update operations docs
2022-12-05 20:58:42 -05:00
Dale Mcdiarmid
5ab5aa13f4 cross link docs to blogs 2022-12-05 17:28:03 +00:00
DanRoscigno
6f2dc66700 separate Cloud and self-managed upgrade pages 2022-12-05 08:19:44 -05:00
DanRoscigno
d38ce99b62 separate Cloud and self-managed backup pages 2022-12-05 08:15:15 -05:00
Kseniia Sumarokova
ec7649cd90
Merge pull request #43639 from CurtizJ/trace-profile-events
Allow to send profile events to `system.trace_log`
2022-12-04 15:50:07 +01:00
Sergei Trifonov
e27e79b45d
Merge branch 'master' into merge_tree_settings_constraints 2022-12-02 20:51:31 +01:00
serxa
006af1b6a4 constraints on merge tree settings 2022-12-02 19:30:14 +00:00
Kruglov Pavel
c35b2a6495
Add a limit for string size in RowBinary format (#43842) 2022-12-02 13:57:11 +01:00
Dan Roscigno
933f2a93f3
Update docs/en/operations/caches.md 2022-12-01 17:52:50 -05:00
Ivan Blinkov
15f8030e04
[docs] minor improvements to "Cache Types" article 2022-11-30 21:47:50 +03:00
Anton Popov
fd262cb56b update docs for trace_log 2022-11-30 14:48:46 +00:00
Alexander Gololobov
038cac1892 add engine_full to system table databases 2022-11-25 10:11:12 +08:00
Kruglov Pavel
98d6b96c82
Merge pull request #42033 from mark-polokhov/BSONEachRow
Add BSONEachRow input/output format
2022-11-22 14:45:21 +01:00
Antonio Andelic
3cb202a63b
Merge pull request #43026 from JackyWoo/keeper_manually_assign_leader
Keeper support manually assigning leader
2022-11-21 09:30:00 +01:00
Vitaliy
9e38b14fc1
docs: Clarified ZooKeeper tips comments. 2022-11-18 12:08:07 -05:00
Nikolay Degterinsky
00554ecd00
Merge pull request #43271 from evillique/fix-docs-2
Fix docs
2022-11-16 15:12:28 +01:00
Nikolay Degterinsky
81971acf35 Fix docs 2022-11-16 02:40:51 +00:00
JackyWoo
f8d71f60a2
Merge branch 'master' into keeper_manually_assign_leader 2022-11-16 09:34:40 +08:00
Dan Roscigno
b178a3711c
Merge branch 'master' into standardize-dictionary-categories 2022-11-15 16:18:18 -05:00
Christoph Wurm
2a9ab046dd Unify spelling of DateTime 2022-11-15 11:51:14 +00:00
Dan Roscigno
b5a306c4db
Merge branch 'master' into standardize-dictionary-categories 2022-11-14 21:30:05 -05:00
DanRoscigno
5d6c622e40 apply suggestions and simplify 2022-11-14 14:20:55 -05:00
DanRoscigno
446c029810 make read only clearer 2022-11-14 11:53:44 -05:00
Dan Roscigno
4a90f8d3f5
Update permissions-for-queries.md
closes https://github.com/ClickHouse/ClickHouse/issues/43068
2022-11-14 11:34:06 -05:00
Kruglov Pavel
58b7f6ca04
Merge pull request #42320 from Avogar/improve-schema-inference-insert-select
Improve using structure from insertion table in table functions
2022-11-14 14:51:27 +01:00
avogar
9e89af28c6 Refactor BSONEachRow format, fix bugs, support more data types, support parallel parsing and schema inference 2022-11-10 20:15:14 +00:00
JackyWoo
8e881e6009
Merge branch 'master' into keeper_manually_assign_leader 2022-11-10 14:38:04 +08:00
DanRoscigno
c822c8161f fix nav 2022-11-08 20:21:26 -05:00
DanRoscigno
45c9debeaf update links 2022-11-08 19:17:58 -05:00
Dan Roscigno
616c3e219b
Merge branch 'master' into fix-pagination 2022-11-08 10:14:33 -05:00
DanRoscigno
a4cd562914 fix next button 2022-11-08 10:12:29 -05:00
JackyWoo
9060141f16 revert last change 2022-11-08 18:44:43 +08:00
JackyWoo
eeedd7d9ba Keeper support manually assigning leader 2022-11-08 12:01:53 +08:00
Dan Roscigno
501e43dd01
Merge pull request #43013 from DanRoscigno/fix-troubleshooting-missing-nav
move troubleshooting to FAQ
2022-11-07 12:05:08 -05:00
DanRoscigno
d446eca882 move troubleshooting to FAQ 2022-11-07 11:56:09 -05:00
Vitaly Baranov
ab8feb5bff
Merge pull request #42782 from mdonkers/session-log-support-sslcertificate-auth
Add SSL_CERTIFICATE auth method to all places missing
2022-11-07 16:36:42 +01:00
Dan Roscigno
9123eacdeb
Merge branch 'master' into patch-1 2022-11-07 09:44:22 -05:00
DanRoscigno
34f90ff6ef update pages that refer to dictionaries 2022-11-07 09:26:50 -05:00
Rami Dridi
b0b3942aae
docs : updating comparing mode command and results 2022-11-05 21:33:47 +01:00
JackyWoo
00e93482c8 fix docs 2022-11-05 18:00:26 +08:00
JackyWoo
73dfe4acd7 Add to default white list 2022-11-05 17:56:55 +08:00
JackyWoo
9404e089fc
Merge branch 'master' into manual_snapshot_for_keeper 2022-11-05 17:37:36 +08:00
Dan Roscigno
c88a214865
Merge branch 'ClickHouse:master' into standardize-dictionary-categories 2022-11-04 09:19:09 -04:00
Nikolay Degterinsky
b5b2a62f93
Merge pull request #42943 from ClickHouse/rfraposa-patch-2
Update default value of allow_experimental_projection_optimization
2022-11-04 15:46:28 +03:00
Mikhail f. Shiryaev
d3acb4cc09
Merge pull request #42859 from ClickHouse/packages-apt-troubleshooting
Add more possible issues for cleaning apt cache
2022-11-04 11:58:40 +01:00
Rich Raposa
0cadb8ac63
Update default value of allow_experimental_projection_optimization
The setting is actually obsolete, but I suppose we should keep it here for users of older versions of ClickHouse
2022-11-03 15:30:43 -06:00
Kruglov Pavel
83c5c44b11
Merge branch 'master' into improve-schema-inference-insert-select 2022-11-03 18:41:51 +01:00
Kruglov Pavel
b124875257
Merge branch 'master' into improve-streaming-engines 2022-11-03 13:22:06 +01:00
Antonio Andelic
25b19e6ba0
Merge branch 'master' into manual_snapshot_for_keeper 2022-11-03 08:55:01 +01:00
DanRoscigno
c8f9af1afa start renaming 2022-11-02 15:47:11 -04:00
Alexey Milovidov
c3466fb52f
Update clickhouse-keeper.md 2022-11-02 22:22:16 +03:00
DanRoscigno
32e1c3b1e6 rename update file as it is included in Manage > Updates 2022-11-01 16:25:54 -04:00
Mikhail f. Shiryaev
b99ea56db8
Add more possible issues for cleaning apt cache 2022-11-01 21:00:52 +01:00
shuyang
7234600ec3 Apply suggestions from code review
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2022-10-31 19:15:20 -05:00
94rain
8b849d4b37 Fix broken links in system tables docs
Signed-off-by: 94rain <21193371+94rain@users.noreply.github.com>
2022-10-31 19:15:20 -05:00
Miel Donkers
fb1623a5f8 Add SSL_CERTIFICATE auth method to all places missing 2022-10-28 21:17:59 +02:00
avogar
8e13d1f1ec Improve and refactor Kafka/StorageMQ/NATS and data formats 2022-10-28 16:41:10 +00:00
DanRoscigno
22011aeaec remove frontmatter 2022-10-26 12:39:17 -04:00
Dan Roscigno
690e4e70ae
Merge branch 'master' into update-backup-for-s3 2022-10-25 21:40:49 -04:00
DanRoscigno
91c3744cfe add backup to S3 endpoint 2022-10-25 21:33:09 -04:00
peter279k
7626406b86 Add two troubleshootings about installation 2022-10-25 21:53:28 +08:00
JackyWoo
c7a0ebeb05 little fix 2022-10-25 17:46:24 +08:00
JackyWoo
9a36a509fe fix test 2022-10-25 17:15:49 +08:00
JackyWoo
b5d1c4e657 replace snpd with lgif 2022-10-24 20:08:58 +08:00
JackyWoo
39c88c74e8 check whether last manually created snapshot is done 2022-10-22 22:31:17 +08:00
JackyWoo
bf291790b7
Merge branch 'master' into manual_snapshot_for_keeper 2022-10-22 16:57:50 +08:00
Kruglov Pavel
9588653a6e
Merge branch 'master' into improve-schema-inference-insert-select 2022-10-18 15:17:27 +02:00
Vitaly Baranov
eb637a6f81
Merge pull request #42232 from azat/backups/s3
Support BACKUP to S3 with as-is path/data structure
2022-10-18 02:37:07 +02:00
Kruglov Pavel
6fc12dd922
Merge pull request #41703 from Avogar/json-object-each-row
Add setting to obtain object name as column value in JSONObjectEachRow format
2022-10-14 20:11:04 +02:00
Kruglov Pavel
f1dd247181
Merge branch 'master' into improve-schema-inference-insert-select 2022-10-14 17:16:58 +02:00
avogar
2b150a575e Add docs 2022-10-14 15:15:03 +00:00
Azat Khuzhin
8830f0608d Support BACKUP to S3 with as-is path/data structure
Right now backup to S3 does not make a lot of sense, since:
- it has random names, and to decoding them
- requires metadata from local disk (/var/lib/disks/DISK/BACKUP_NAME)
- or send_metadata (but it is also tricky even with it)

So this patch adds simpler interface for S3, it is only suitable for
BACKUP/RESTORE, so don't try to use it for MergeTree engine.

It is done by adding separate disk - `s3_plain` for this, that:
- does not support any extended features, like renames/hardlinks/attrs/...
  (so basically everything that MergeTree requires)
- only write/read/unlink/list files

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-14 12:59:25 +02:00
vdimir
0178307c27 Followup for TemporaryDataOnDisk 2022-10-12 15:25:23 +02:00
Alexey Milovidov
9bf5fe728b
Merge pull request #42173 from ClickHouse/remove-temporary-live-view
Remove TEMPORARY LIVE VIEW
2022-10-08 19:05:33 +03:00
Alexey Milovidov
b9159db82f Remove temporary live views 2022-10-08 00:16:36 +02:00
Robert Schulze
e759a64d38
Docs: Redirect links to misc.md
--> https://clickhouse.com/docs/en/sql-reference/statements/misc

This page indexes a bunch of SQL statements but they are easily
reachable by the sidebar already.
2022-10-07 13:22:40 +00:00
Nikolay Degterinsky
522948fa2a
Merge branch 'master' into patch-1 2022-10-06 17:47:36 +02:00
Dan Roscigno
41fb3cb7da
Merge branch 'master' into combine-requirements-install-docs 2022-10-06 09:39:11 -04:00
Kseniia Sumarokova
3cff776109
Merge pull request #41254 from filimonov/system_disks_unreserved_space
Add unreserved_space column to system.disks
2022-10-06 12:28:23 +02:00
Nikolay Degterinsky
61ec576900
Merge branch 'master' into patch-1 2022-10-05 16:18:08 +02:00
DanRoscigno
5b22f63d07 updated packages URL 2022-10-05 09:49:55 -04:00
Adam Rutkowski
3c4eae4276
Fix tag mismatch in sample users config 2022-10-05 09:55:28 +02:00
Denny Crane
5341bf445a
Update settings.md 2022-10-04 15:08:29 -03:00
Dan Roscigno
f4f85a069b
Go live with doc updates (#42053)
* QIP to add overview page

* wip

* New Tutorial and Datasets landing page

* give an example for Cloud

* Update UK Price Paid for Cloud

* Update nyc-taxi.md

* add option for Cloud Load Data button

* Removed the Import Raw Data section

* Update nyc-taxi.md

* update user management and replication docs

* mark self managed

* set doc ordering

* add redirects setting

* Simple fixes to index.md

Co-authored-by: rfraposa <richraposa@gmail.com>
2022-10-04 14:36:59 +03:00
Nikita Mikhaylov
d767e1f0d8
Added an option to specify environment name in Sentry's config (#42037) 2022-10-04 13:23:51 +02:00
Kseniia Sumarokova
0bfbb5c38a
Merge branch 'master' into system_disks_unreserved_space 2022-10-03 14:25:47 +02:00
Robert Schulze
8e727d4fbc
Merge pull request #41910 from arenadata/ADQM-583
Improve enable_extended_results_for_datetime_functions option to return results of type DateTime64
2022-10-02 20:46:51 +02:00
Vladimir C
895afdec45
Merge pull request #40893 from ClickHouse/vdimir/track-tmp-disk 2022-09-30 11:27:24 +02:00
Roman Vasin
45414b251d Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-583 2022-09-29 17:02:49 +00:00
Raúl Marín
7c38b3f60d Update MergeTree settings docs to match current defaults 2022-09-29 14:12:10 +02:00
vdimir
367c77f0fb
Check if tmp volume contains only local disks 2022-09-29 09:51:39 +00:00
Roman Vasin
109c5ee1a1 Update docs for DateTime64 return types. 2022-09-28 12:49:58 +00:00
Kruglov Pavel
f1ac2d66be
Merge branch 'master' into json-object-each-row 2022-09-28 14:15:02 +02:00
JackyWoo
dfb2be3a67 fix docs 2022-09-26 18:34:53 +08:00
JackyWoo
d1c85f68e8 manually snapshot creation for keeper 2022-09-26 18:29:15 +08:00
Kseniia Sumarokova
4b170cc1cf
Update storing-data.md 2022-09-23 12:54:10 +02:00
avogar
4f32ef9bb7 Add docs 2022-09-22 17:04:42 +00:00
Kseniia Sumarokova
951a85a0fb
Update storing-data.md 2022-09-22 17:04:44 +02:00
Kseniia Sumarokova
a6b1586b17
Update storing-data.md 2022-09-22 17:03:19 +02:00
kssenii
f038c7ea00 Better config for cache 2022-09-22 14:50:29 +02:00
Kseniia Sumarokova
5caac39328
Merge pull request #41508 from kssenii/rename-some-cache-commands
Rename: `show caches` -> `show filesystem caches`, `describe cache` -> `describe filesystem cache`
2022-09-22 13:09:14 +02:00
Kruglov Pavel
22e11aef2d
Merge pull request #40910 from Avogar/new-json-formats
Add new JSON formats, add improvements and refactoring
2022-09-21 14:19:08 +02:00
Kseniia Sumarokova
1e7308832c
Merge branch 'master' into system_disks_unreserved_space 2022-09-21 13:04:39 +02:00
avogar
868ce8bc16 Fix comments, make better naming, add docs, add setting output_format_json_quote_64bit_floats 2022-09-20 13:49:17 +00:00
DanRoscigno
bf4b12be43 rename doc 2022-09-20 09:32:35 -04:00
Kseniia Sumarokova
364bdb0676
Update storing-data.md 2022-09-20 13:39:07 +02:00
kssenii
b8079e4577 Merge remote-tracking branch 'upstream/master' into rename-some-cache-commands 2022-09-20 13:02:18 +02:00
kssenii
6dcbeceeb9 Update doc 2022-09-20 13:00:10 +02:00
Sergei Trifonov
7902922ae4
Merge branch 'master' into readonly-settings-allow 2022-09-19 21:00:12 +02:00
Derek Chia
cb613b8675
Change input_format_skip_unknown_fields default to 1
As per PR https://github.com/ClickHouse/ClickHouse/pull/37192, `input_format_skip_unknown_fields` is enabled by default. Likewise, it is also set as `true` in the factory settings https://github.com/ClickHouse/ClickHouse/blob/master/src/Core/Settings.h#L696

Updating the docs to reflect the change.
2022-09-19 22:37:03 +08:00
kssenii
972d65d575 Update doc 2022-09-19 14:08:07 +02:00
Sergei Trifonov
f7a1ed3141
Merge branch 'master' into readonly-settings-allow 2022-09-19 12:52:36 +02:00
Diego Nieto (lesandie)
1a14515e35 Fixed cache parameter name 2022-09-19 10:29:41 +02:00
Roman Vasin
d82cd7b007 Add many cosmetic changes to C++ code and MD docs 2022-09-16 09:37:30 +00:00
avogar
ef7f7b30aa Fix tests 2022-09-15 18:20:17 +00:00
Roman Vasin
5c242de43a Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-528-B 2022-09-15 13:47:51 +00:00
Roman Vasin
3ce66eab83 Correct all needed MD files 2022-09-15 13:28:11 +00:00
Roman Vasin
563449779c Replace enable_date32_results by enable_extended_results_for_datetime_functions 2022-09-15 12:48:09 +00:00
Kseniia Sumarokova
1ec7ce265b
Update storing-data.md 2022-09-15 12:30:02 +02:00
Kseniia Sumarokova
4935a4bf96
Update storing-data.md 2022-09-15 12:29:22 +02:00
Dan Roscigno
c8dcd34abe
Merge pull request #41237 from DanRoscigno/move-title
move title to frontmatter in troubleshooting doc
2022-09-14 10:15:18 -04:00
Kseniia Sumarokova
bb5f9e578a
Update storing-data.md 2022-09-14 12:17:24 +02:00
Mikhail Filimonov
d2d8c179b6
Add unreserved_space column to system.disks 2022-09-13 13:16:18 +02:00
Kruglov Pavel
060adfbe93
Merge branch 'master' into new-json-formats 2022-09-12 19:37:46 +02:00
DanRoscigno
a3826c4b3f move title to frontmatter 2022-09-12 13:27:52 -04:00
Sergei Trifonov
fe88a7991d
Merge branch 'master' into readonly-settings-allow 2022-09-12 16:20:40 +02:00
Roman Vasin
bc2c2130fc Add documentation for enable_date32_results option 2022-09-12 09:09:01 +00:00
avogar
ae7f9abd32 Add documentation 2022-09-09 12:04:49 +00:00
Alexey Milovidov
4d7097f47a
Merge pull request #41080 from kssenii/add-documentation-for-cache
Add documentation for filesystem cache
2022-09-09 00:03:16 +03:00
Sergei Trifonov
f92b6a6176
Merge branch 'master' into readonly-settings-allow 2022-09-08 17:44:32 +02:00
Alexey Milovidov
928c1cd0d4
Merge pull request #40967 from ClickHouse/alexey-milovidov-patch-4
Update tips.md about filesystems
2022-09-08 16:56:27 +03:00
Kseniia Sumarokova
7f086a94a7
Update storing-data.md 2022-09-08 12:34:58 +02:00
Vladimir C
90647cb0c5
Merge pull request #39970 from SachinSetiya/majority_quorum
Add majority_insert_quorum setting
2022-09-08 11:31:33 +02:00
Alexey Milovidov
9544b8fdd6
Merge pull request #40996 from ClickHouse/vdimir/issue-40994
Minor update doc for mysql_port
2022-09-08 02:39:12 +03:00
Kseniia Sumarokova
eb53df48d1
Update storing-data.md 2022-09-07 22:26:52 +02:00
Kseniia Sumarokova
3af51f4340
Update storing-data.md 2022-09-07 22:21:46 +02:00
Kseniia Sumarokova
4cb07bd48d
Merge branch 'master' into add-documentation-for-cache 2022-09-07 17:52:53 +02:00
Kseniia Sumarokova
6f06633df6
Update storing-data.md 2022-09-07 13:59:39 +02:00
vdimir
000ba8a60d
Use insert_qurum = auto instead of majority_insert_quorum 2022-09-07 11:19:27 +00:00
Sachin
ade4337978
Add majority_insert_quorum setting
majority_insert_quorum is defined as (number_of_replicas/2)+1. Insert
will be successful only if majority of quorum have applied it. If
insert_quorum and majority_insert_quorum both are specified, max of
both will be used.
2022-09-07 11:19:24 +00:00
kssenii
613c688331 Add documentation for cache 2022-09-07 13:12:19 +02:00
Sergei Trifonov
2a55741dcb
Merge branch 'master' into readonly-settings-allow 2022-09-06 20:29:41 +02:00
DanRoscigno
7032a1b267 move title to frontmatter 2022-09-06 11:14:55 -04:00
Vladimir C
8c3c3e7667
Minor update doc for mysql_port 2022-09-05 12:39:39 +02:00
Alexey Milovidov
7c3c367e01
Update tips.md 2022-09-04 04:18:57 +03:00
Sergei Trifonov
005b2588d8
Merge branch 'master' into readonly-settings-allow 2022-09-02 16:37:43 +02:00
Sergei Trifonov
014d109175 fix build, fix docs, fix comments, logical fixes, test are still to be fixed and new test are to be added 2022-09-02 16:20:09 +02:00
DanRoscigno
3e9225aafa move title to frontmatter, remove orig article link 2022-09-01 12:24:03 -04:00
DanRoscigno
50f9b12af8 review feedback 2022-08-31 09:12:48 -04:00
DanRoscigno
f72b341e8b add status info 2022-08-30 09:34:08 -04:00
DanRoscigno
d712a91a20 add alternatives 2022-08-29 19:36:20 -04:00
DanRoscigno
0abeebd3ca updated with dev help 2022-08-29 19:29:10 -04:00
DanRoscigno
3a65d58c13 updated with dev help 2022-08-29 18:33:26 -04:00
Dan Roscigno
76a45aa750
Merge branch 'master' into add-backup 2022-08-29 16:23:53 -04:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
Sergei Trifonov
899bf99d44
Merge branch 'master' into readonly-settings-allow 2022-08-29 14:35:05 +02:00
alesapin
7ce0afc0df
Merge pull request #40670 from Avogar/kafka
Add setting to disable limit on kafka_num_consumers
2022-08-29 10:53:35 +02:00
DanRoscigno
b50fa8b5a9 replace symlinks 2022-08-28 17:34:50 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
DanRoscigno
db1a3b717c add slugs 2022-08-28 09:58:27 -04:00
DanRoscigno
c4caa35cfd add frontmatter dashes 2022-08-28 09:53:52 -04:00
Sergei Trifonov
c5d1bbf680 reimplement with <allow> tag 2022-08-26 21:20:00 +02:00
avogar
e31bba7731 Add docs 2022-08-26 12:52:15 +00:00
Peignon Melvyn
18c75d8ca9
Update settings.md
Fix according to: aaafb797c0/src/Core/Settings.h (L586)
2022-08-26 12:27:16 +02:00
DanRoscigno
ad56971e61 add text 2022-08-25 16:25:39 -04:00
Sergei Trifonov
6af43e7676
Merge branch 'master' into readonly-settings-allow 2022-08-25 17:27:03 +02:00
Sergei Trifonov
856a2f5956 Allow to modify constrained settings in readonly mode 2022-08-25 17:24:24 +02:00
DanRoscigno
7bc08900ec added config for backup dest 2022-08-23 21:13:40 -04:00
DanRoscigno
cf2a6dab32 add selects 2022-08-23 20:43:09 -04:00
DanRoscigno
e617532d40 wip 2022-08-23 19:16:15 -04:00
Kseniia Sumarokova
7acad11b90
Merge pull request #40504 from den-crane/patch-38
Doc. Example named-collections + clickhouse database
2022-08-23 10:51:02 +02:00
Antonio Andelic
a87a762b0c
Merge pull request #39973 from ClickHouse/keeper-listen-host
Support `interserver_listen_host` in Keeper
2022-08-23 09:03:08 +02:00
Denny Crane
e6912c86b9
Update named-collections.md 2022-08-22 19:36:01 -03:00
Denny Crane
7428193a82
Update named-collections.md 2022-08-22 19:17:39 -03:00
Alexey Milovidov
1a5e08fb65
Update settings.md 2022-08-22 02:19:18 +03:00
Denny Crane
6e329686b8
Update settings.md 2022-08-21 19:31:46 -03:00
Denny Crane
dc40e4b935
Update merge-tree-settings.md 2022-08-21 17:30:13 -03:00
Denny Crane
069e2cf4a0
Update settings.md 2022-08-21 17:27:47 -03:00
Denny Crane
244b7aa118
Update merge-tree-settings.md 2022-08-21 17:17:06 -03:00
Antonio Andelic
af02c76a3c
Merge branch 'master' into keeper-listen-host 2022-08-21 18:43:55 +02:00
Alexey Milovidov
b6388583b3
Merge pull request #40366 from DanRoscigno/update-zero-copy-replication
update for setting change
2022-08-19 15:48:35 +03:00
DanRoscigno
23b054617e update for setting change 2022-08-18 16:05:44 -04:00
Sergei Trifonov
2262717a1b
Merge branch 'master' into threads-soft-limit-rename 2022-08-18 19:32:53 +02:00
Jonathan-Ackerman
22bd572d78
Update docs for max_replica_delay_for_distributed_queries (#40174)
A replica is unusable if its lag is greater than or equal to the
value of max_replica_delay_for_distributed_queries. However, the
current documentation says that a replica is only unusable if it lags
more than the set value.

Also, when the value of max_replica_delay_for_distributed_queries
is read, if it is 0, then a replica is considered up to date
right away without checking its delay. This behavior should be
documented.
2022-08-18 19:09:46 +02:00
Sergei Trifonov
42a711015f split concurrent_threads_soft_limit setting into two: concurrent_threads_soft_limit_{num,ratio_to_cores} 2022-08-18 14:51:08 +02:00
Nikolai Kochetov
5a85531ef7
Merge pull request #38286 from Avogar/schema-inference-cache
Add schema inference cache for s3/hdfs/file/url
2022-08-18 13:07:50 +02:00
Kruglov Pavel
d7056376eb
Merge pull request #40068 from Avogar/schema-inference-hints
Allow to specify structure hints in schema inference
2022-08-18 12:19:45 +02:00
Antonio Andelic
26b7117b6c Merge branch 'master' into keeper-listen-host 2022-08-18 07:05:20 +00:00
Denny Crane
d5465d32e1
Update settings.md 2022-08-17 09:38:06 -03:00
avogar
8dd54c043d Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-cache 2022-08-17 11:47:40 +00:00
Antonio Andelic
105073ea7b update docs 2022-08-17 09:31:16 +00:00
avogar
e1ff996ec3 Allow to specify structure hints in schema inference 2022-08-16 09:46:57 +00:00
avogar
c4ff3ffeea Rename settings 2022-08-15 12:45:18 +00:00
Igor Nikonov
5768e40ef7
Fix incorrect queries in example
Setting insert_deduplication_token: fix incorrect queries in example
2022-08-12 17:18:02 +02:00
avogar
9b1a267203 Refactor, remove TTL, add size limit, add system table and system query 2022-08-05 16:20:15 +00:00
Peignon Melvyn
a63fb07f54
Update settings.md 2022-08-01 16:20:33 +02:00
Alexey Milovidov
f80a4c184e
Merge branch 'master' into interserver_listen_port 2022-07-31 01:22:32 +03:00
Alexey Milovidov
df627a3e4d
Merge pull request #39172 from ClickHouse/DanRoscigno-patch-2
Update performance-test.md
2022-07-30 05:23:14 +03:00