thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-30 19:42:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
114,838 Commits 9,190 Branches 1,782 Tags 2.2 GiB
0f7c0859b0
Commit Graph

1217 Commits

Author SHA1 Message Date
Peignon Melvyn
8fe08bc458
Add a warning to the schema_inference_hints 2023-02-27 14:02:10 +01:00
Denny Crane
fd97f7ad0a
Update settings.md 2023-02-26 19:25:13 -04:00
Denny Crane
55b3bffe59
Update settings.md 2023-02-23 21:15:31 -04:00
avogar
54622566df Add setting to change parquet version 2023-02-23 16:14:10 +00:00
Kruglov Pavel
35887911e3
Merge pull request #46284 from Avogar/null-as-default-all-formats 
Extend setting `input_format_null_as_default` for more formats
 2023-02-23 14:48:22 +01:00
Nikolai Kochetov
dbfa641c47
Merge pull request #46621 from ClickHouse/resurrect-processors-profile-log-docs 
Resurrect processors_profile_log docs.
 2023-02-23 13:09:35 +01:00
avogar
50caa3d66c Update docs 2023-02-22 16:41:49 +00:00
Dan Roscigno
efea3cbc5c
Update docs/en/operations/settings/settings.md 2023-02-21 12:19:56 -05:00
Han Fei
eeac1abaa5 add docs for setting async_insert_max_query_number 2023-02-21 17:49:52 +01:00
Kruglov Pavel
9866ecfe8b
Merge branch 'master' into null-as-default-all-formats 2023-02-20 20:49:30 +01:00
Nikolai Kochetov
186a29a2aa Resurrect processors_profile_log docs. 2023-02-20 19:46:39 +01:00
Antonio Andelic
ab51c1d975
Merge branch 'master' into custom-key-parallel-replicas 2023-02-17 15:06:41 +01:00
Dmitry Novik
c95df21324 Review fixes 2023-02-16 15:38:25 +00:00
Dmitry Novik
b908fa32df Add documentation for group_by_use_nulls 2023-02-16 00:57:53 +00:00
Antonio Andelic
adde580756
Merge branch 'master' into custom-key-parallel-replicas 2023-02-14 14:09:12 +01:00
Antonio Andelic
8d16fe5793
Merge branch 'master' into add-support-for-settings-alias 2023-02-13 08:46:00 +01:00
avogar
04cf144edc Fix TSKV, update docs 2023-02-10 17:20:51 +00:00
Antonio Andelic
f96d480563
Merge branch 'master' into add-support-for-settings-alias 2023-02-09 16:07:45 +01:00
Kruglov Pavel
b5f90c608a
Merge branch 'master' into parquet-fixed-binary 2023-02-09 11:26:38 +01:00
Vladimir C
ecb5802c4b
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-02-09 10:59:14 +01:00
vdimir
88174fbaaa
Add doc for optimize_rewrite_aggregate_function_with_if 2023-02-08 14:27:25 +00:00
Kruglov Pavel
cf2587cd1b
Add docs 2023-02-08 12:32:26 +01:00
Antonio Andelic
f67e5505ab Merge branch 'master' into custom-key-parallel-replicas 2023-02-06 11:12:39 +00:00
Antonio Andelic
a58653820e Update docs 2023-02-03 18:19:12 +00:00
Robert Schulze
cfcf957c75
Docs: Remove obsolete query result cache page 2023-02-02 11:33:35 +00:00
Vladimir C
b389c1effb
Merge pull request #45589 from ClickHouse/optimize-constraints 2023-02-01 12:57:02 +01:00
Robert Schulze
9a8af6a42e
Update docs/en/operations/settings/settings.md 
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
 2023-01-31 12:44:20 +01:00
Antonio Andelic
c99efa75b7
Merge branch 'master' into custom-key-parallel-replicas 2023-01-31 11:58:30 +01:00
Robert Schulze
325c6bdf3d
Renaming: "Query Result Cache" --> "Query Cache" 
Reasons:

- The cache will at some point store intermediate results as opposed to
  only query results. We should change the terminology now without
  having to worry about backward compat.

- Equivalent caches in MySQL (1) and Starrocks (2) are called "query
  cache".

- The new name is ca. 13.8% more catchy.

(1) https://dev.mysql.com/doc/refman/5.6/en/query-cache.html
(2) https://docs.starrocks.io/en-us/2.5/using_starrocks/query_cache
 2023-01-31 09:54:34 +00:00
Robert Schulze
659a64a1d9
Merge pull request #45679 from ClickHouse/untangle-query-result-cache-settings 
Untangle configuration of query result cache
 2023-01-31 10:44:14 +01:00
Igor Nikonov
741c3ba23c Fix non-intentional change 2023-01-30 18:43:01 +01:00
Igor Nikonov
01b225f57e
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-30 18:30:59 +01:00
Igor Nikonov
211449d916
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-30 18:30:29 +01:00
Igor Nikonov
b095dab141
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-30 18:29:32 +01:00
Igor Nikonov
0c4bc489da
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-30 18:28:53 +01:00
Igor Nikonov
30c949ba27
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-30 18:28:34 +01:00
Igor Nikonov
c30a55b7ee Some polishing 2023-01-30 16:53:37 +01:00
Igor Nikonov
d8ba469b97
Fixes 2023-01-30 16:24:02 +01:00
Igor Nikonov
65caa77a0e
Update settings.md 2023-01-30 16:13:08 +01:00
Robert Schulze
27b978381b
Use more speaking setting names 2023-01-30 14:20:43 +00:00
Robert Schulze
e30c38cab3
Fix up some leftovers 2023-01-27 10:43:43 +00:00
Azat Khuzhin
1a8437f2c9 Add ability to ignore unknown keys in JSON object for named tuples 
This can be useful in case your input JSON is complex, while you need
only few fields in it.

This behaviour is controlled by the
input_format_json_ignore_unknown_keys_in_named_tuple setting name, that
is turned OFF by default.

This will, almost, allow to parse gharchive dataset without jq. "almost"
because of two things:
- Tuple cannot be Nullable, so such keys with Tuple type in ClickHouse
  cannot be `null` in JSON
- You cannot use dot.dot notation to extract columns for file() engine,
  only tupleElement()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-27 10:01:08 +01:00
Robert Schulze
7d97fab2dc
Untangle query result cache settings 
This PR modularizes the configuration options of the query result cache
(QRC).

1. Add a feature toggle "allow_experimental_query_result_cache = false"
   which controls whether the experimental QRC can be used at all. This
   configuration option will be removed once the QRC becomes
   non-experimental.

2. Modularize the existing two configuration settings
   "enable_experimental_query_result_cache" and
   "enable_experimental_query_result_cache_passive_usage" into three
   orthogonal settings:

   - "use_query_result_cache = false" controls whether a query (or all
     queries of the session) utilize the query result cache

   - settings "use_query_result_cache_passive_usage = true" and
     "use_query_result_cache_active_usage = true" control the way a
     query (or all queries of the session) utilize the query result
     cache: "passive" use is reading, "active" use is writing.
 2023-01-26 21:17:48 +00:00
Dan Roscigno
76d6e2edf9
Merge pull request #45569 from AVMusorin/docs_optimize_skip_merged_partitions 
docs: added optimize_skip_merged_partitions setting
 2023-01-26 16:04:27 -05:00
Igor Nikonov
ed01f76c6a
Merge pull request #45592 from ClickHouse/update-insert-delay-doc-2 
Update INSERT delay doc with example
 2023-01-26 12:55:35 +01:00
Antonio Andelic
07b2c5ce0f
Merge branch 'master' into custom-key-parallel-replicas 2023-01-26 12:42:04 +01:00
Dan Roscigno
b4ab361366
Merge branch 'master' into docs_optimize_skip_merged_partitions 2023-01-25 19:45:32 -05:00
Dan Roscigno
e520bd8052
Apply suggestions from code review 2023-01-24 19:10:30 -05:00
Igor Nikonov
29ef6b9574
Update INSERT delay doc properly 2023-01-25 00:26:32 +01:00
Dan Roscigno
dbb83dc9a4
Merge branch 'master' into docs-for-s3-settings 2023-01-24 17:55:31 -05:00
DanRoscigno
fe56967af7 fix note formatting 2023-01-24 17:44:10 -05:00
DanRoscigno
9775987ee9 add new settings for s3 and hdfs 2023-01-24 17:40:37 -05:00
DanRoscigno
f95bc55923 split Format settings out 2023-01-24 17:19:50 -05:00
rfraposa
6f7755ebcd Added optimize using constraints settings 2023-01-24 15:05:34 -07:00
Igor Nikonov
e585a1228f
Update docs/en/operations/settings/merge-tree-settings.md 
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-01-24 16:52:32 +01:00
Igor Nikonov
21b009fdec
Update merge-tree-settings.md 2023-01-24 15:45:21 +01:00
AVMusorin
5f8658b2d6
docs: added optimize_skip_merged_partitions setting 2023-01-24 14:56:39 +01:00
DanRoscigno
72b1a65984 WIP 2023-01-24 07:45:59 -05:00
Antonio Andelic
95853af459 Merge branch 'master' into custom-key-parallel-replicas 2023-01-24 10:49:40 +00:00
Antonio Andelic
37b62b3a58 Use Map for custom_key 2023-01-24 10:46:47 +00:00
DanRoscigno
dedb4e4de2 add docs for PR 33302 2023-01-23 16:14:39 -05:00
Kruglov Pavel
478a552a0a
Merge branch 'master' into tsv-csv-detect-header 2023-01-23 21:47:17 +01:00
Robert Schulze
0ab7ae6c17
Merge pull request #43797 from ClickHouse/query-result-cache 
Query result cache [experimental]
 2023-01-23 19:54:35 +01:00
Antonio Andelic
c15128491b Update max_parallel_replicas docs 2023-01-23 17:24:48 +01:00
Robert Schulze
ed84021aa5
Formatting fixup 2023-01-22 16:45:26 +01:00
Robert Schulze
0ffffdd442
Docs: Fix weird formatting 2023-01-22 15:38:11 +00:00
Robert Schulze
340f406553
Merge branch 'master' into query-result-cache 2023-01-22 13:21:36 +01:00
Han Fei
18a397f8c9 address comments 2023-01-20 18:09:42 +01:00
Han Fei
449ace3373
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:07:19 +01:00
Han Fei
9d87bd10ee
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:07:08 +01:00
Han Fei
badfbcb3d8
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:58 +01:00
Han Fei
e9c4cf46cd
Update docs/en/operations/settings/merge-tree-settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:46 +01:00
Han Fei
9d254f7d87
Update docs/en/operations/settings/merge-tree-settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:32 +01:00
Han Fei
5fc4998f10 update docs for async insert deduplication 2023-01-20 14:42:11 +01:00
Robert Schulze
4f90824347
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-17 22:49:53 +00:00
Kruglov Pavel
96bb99f864
Merge branch 'master' into tsv-csv-detect-header 2023-01-17 15:33:02 +01:00
Vladimir C
b80ee8df50
Merge pull request #45256 from DanRoscigno/add-grace-hash-docs 2023-01-16 18:43:19 +01:00
Kruglov Pavel
e9d6590926
Merge branch 'master' into tsv-csv-detect-header 2023-01-16 17:50:24 +01:00
avogar
1c0941d72a Add docs and examples 2023-01-16 16:46:41 +00:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-16 08:04:49 +00:00
DanRoscigno
d0a55f6dc9 doc grace_hash algorithm for join 2023-01-13 13:17:03 -05:00
avogar
87b934c472 Insert default values in case of missing tuple elements in JSONEachRow 2023-01-12 16:36:44 +00:00
rfraposa
1ddc9c3bb6 Update merge-tree-settings.md 2023-01-11 05:44:51 -07:00
Dan Roscigno
37da8e206b
Merge pull request #45119 from ClickHouse/add-default-table-engine-setting 
Added description of default_table_engine setting
 2023-01-10 09:59:09 -05:00
Dan Roscigno
ee88814cac
formal to form 2023-01-10 09:42:04 -05:00
rfraposa
d61eae8554 Update settings.md 
Added description of default_table_engine
 2023-01-10 07:40:22 -07:00
Robert Schulze
0c3b034887
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-10 09:02:41 +00:00
rfraposa
62b9e2f063 Update settings.md 
Add convert_query_to_cnf setting
 2023-01-09 21:30:24 -07:00
Rich Raposa
528acecc5c
Merge pull request #45076 from ClickHouse/new-mergetree-settings 
Add docs for 2 new MergeTree settings
 2023-01-09 16:48:26 -07:00
Dan Roscigno
99b1609fd3
Update docs/en/operations/settings/index.md 2023-01-09 18:17:29 -05:00
rfraposa
db7342769b Update merge-tree-settings.md 
Added two new settings
 2023-01-09 15:56:19 -07:00
rfraposa
eb96884ebf Add new DEFAULT value of settings 2023-01-09 15:02:35 -07:00
Robert Schulze
ad4884b394
Fix review comments, pt. I 2023-01-09 21:42:51 +00:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
Ivan Blinkov
b7e082d033 Remove "Original article links" 2023-01-09 15:13:36 +01:00
DanRoscigno
e0b258b4a9 move persistence setting docs 2023-01-06 17:01:28 -05:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-06 20:42:48 +00:00
DanRoscigno
273ad90d1d add additional table filters setting 2023-01-05 10:47:18 -05:00
Dmitry Novik
c646048af9
Merge pull request #44461 from ClickHouse/parts-removal-limit 
Add part removal limit for one CleanupThread iteration
 2023-01-02 20:04:19 +01:00
Kruglov Pavel
966f57ef68
Merge pull request #42777 from Avogar/improve-streaming-engines 
Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and data formats
 2023-01-02 15:59:06 +01:00
Robert Schulze
8381d8b467
query_result_cache_keep_seconds_alive --> query_result_cache_ttl 2023-01-02 09:38:40 +00:00
Robert Schulze
ba55fd3ad2
Cosmetics 2023-01-02 09:30:44 +00:00
Robert Schulze
e9e04166d9
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-02 08:20:27 +00:00
Kruglov Pavel
894726bd8f
Merge branch 'master' into improve-streaming-engines 2022-12-29 22:59:45 +01:00
avogar
46b7ec4209 Add detailed documentation about schema inference 2022-12-29 13:42:56 +00:00
Dmitry Novik
6efd64a61c
Merge branch 'master' into parts-removal-limit 2022-12-28 17:34:48 +01:00
Dmitry Novik
c594ec3632 Add documentation 2022-12-21 14:56:32 +00:00
Sergei Trifonov
048525273f
Merge branch 'master' into Avogar-patch-1 2022-12-21 11:54:18 +01:00
Kruglov Pavel
5e01a3d74e
Merge branch 'master' into improve-streaming-engines 2022-12-21 10:51:50 +01:00
Kruglov Pavel
36a6ee4fdb
Add documentation for setting allow_settings_after_format_in_insert 2022-12-20 22:04:37 +01:00
DanRoscigno
c6513624c4 add support case note for compat setting 2022-12-20 15:03:42 -05:00
Robert Schulze
b93c56323c
Merge remote-tracking branch 'origin/master' into query-result-cache 2022-12-19 09:18:36 +00:00
Robert Schulze
d81e507952
Fix doc links 2022-12-18 12:23:38 +00:00
Robert Schulze
bc6bcdfd7b
Allow sharing of cache entries 2022-12-17 18:04:18 +00:00
Robert Schulze
aa50b9cf48
Invert config parameter name for more clarity 2022-12-17 15:10:04 +00:00
Kruglov Pavel
37df9b9990
Merge branch 'master' into refactor-schema-inference 2022-12-16 19:13:15 +01:00
Kruglov Pavel
3fad5c7f1f
Merge branch 'master' into refactor-schema-inference 2022-12-16 14:24:51 +01:00
Robert Schulze
3790952631
Move server-level settings into the appropriate document 2022-12-15 22:51:47 +00:00
Robert Schulze
4db33f16e3
Make DoS attack on cache less likely 2022-12-15 21:42:51 +00:00
Robert Schulze
bcc54ab9b4
Add cfg for min query duration for caching 2022-12-15 20:10:37 +00:00
Kruglov Pavel
c5b2e4cc23
Merge branch 'master' into improve-streaming-engines 2022-12-15 18:44:35 +01:00
Kruglov Pavel
00d80e44cc
Fix typos 2022-12-15 16:18:40 +01:00
Kruglov Pavel
7657f16e2a
Add missing documentation for some schema inference settings 2022-12-15 16:17:18 +01:00
Kruglov Pavel
0816626373
Update docs 2022-12-15 16:10:06 +01:00
Sergei Trifonov
f0de30de92
fix typos 2022-12-15 14:11:16 +01:00
Robert Schulze
537c64aad2
Merge remote-tracking branch 'origin/master' into query-result-cache 
Conflicts:
- tests/queries/0_stateless/02117_show_create_table_system.reference
 2022-12-15 12:17:58 +00:00
Robert Schulze
973d4f75de
More intuitive active/passive enablement of query result cache 2022-12-15 12:16:36 +00:00
Robert Schulze
f1e367179e
Make maximum record count per item configurable 2022-12-15 11:16:44 +00:00
Robert Schulze
e52dfaf45c
Make number of cached items configurable 2022-12-15 10:08:28 +00:00
avogar
f3e37c2c9b Merge branch 'refactor-schema-inference' of github.com:Avogar/ClickHouse into refactor-schema-inference 2022-12-12 14:47:04 +00:00
Kruglov Pavel
a03549df28
Apply suggestions from code review 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2022-12-12 15:46:03 +01:00
Robert Schulze
fc972d760f
Make it configurable if queries with non-deterministic functions are cached 2022-12-12 14:03:21 +00:00
Robert Schulze
b78652e138
Query result cache 2022-12-12 10:37:10 +00:00
avogar
cd4fa00d2c Merge branch 'master' of github.com:ClickHouse/ClickHouse into refactor-schema-inference 2022-12-09 14:45:10 +00:00
Kruglov Pavel
59201c71cb
Merge pull request #44052 from Avogar/object-as-string 
Allow to parse JSON objects into Strings in JSON input formats
 2022-12-09 15:12:25 +01:00
Sergei Trifonov
bae1519970
Merge branch 'master' into merge_tree_settings_constraints 2022-12-08 22:25:16 +01:00
Kruglov Pavel
0d17774440
Better example in docs 2022-12-08 20:57:28 +01:00
avogar
d0f9bb2ec2 Allow to parse JSON objects into Strings 2022-12-08 18:58:18 +00:00
avogar
7375a7d429 Refactor and improve schema inference for text formats 2022-12-07 21:19:27 +00:00
Kseniia Sumarokova
ec7649cd90
Merge pull request #43639 from CurtizJ/trace-profile-events 
Allow to send profile events to `system.trace_log`
 2022-12-04 15:50:07 +01:00
Sergei Trifonov
e27e79b45d
Merge branch 'master' into merge_tree_settings_constraints 2022-12-02 20:51:31 +01:00
serxa
006af1b6a4 constraints on merge tree settings 2022-12-02 19:30:14 +00:00
Kruglov Pavel
c35b2a6495
Add a limit for string size in RowBinary format (#43842) 2022-12-02 13:57:11 +01:00
Anton Popov
fd262cb56b update docs for trace_log 2022-11-30 14:48:46 +00:00
Kruglov Pavel
98d6b96c82
Merge pull request #42033 from mark-polokhov/BSONEachRow 
Add BSONEachRow input/output format
 2022-11-22 14:45:21 +01:00
Nikolay Degterinsky
81971acf35 Fix docs 2022-11-16 02:40:51 +00:00
DanRoscigno
5d6c622e40 apply suggestions and simplify 2022-11-14 14:20:55 -05:00
DanRoscigno
446c029810 make read only clearer 2022-11-14 11:53:44 -05:00
Dan Roscigno
4a90f8d3f5
Update permissions-for-queries.md 
closes https://github.com/ClickHouse/ClickHouse/issues/43068
 2022-11-14 11:34:06 -05:00
Kruglov Pavel
58b7f6ca04
Merge pull request #42320 from Avogar/improve-schema-inference-insert-select 
Improve using structure from insertion table in table functions
 2022-11-14 14:51:27 +01:00