Commit Graph

11811 Commits

Author SHA1 Message Date
vdimir
3b775dee53
Merge pull request #55126 from ClickHouse/vdimir/jaccard_index_perf
Add function jaccardIndex back with better performance
2023-11-06 10:39:02 +01:00
kevinyhzou
2a50daf5dd Allow cr at end of csv line 2023-11-06 12:21:42 +08:00
kevinyhzou
ef30e6723d bug fix csv read while end of line is not crlf 2023-11-06 12:21:42 +08:00
Robert Schulze
049c811a38
Make type names in SHOW COLUMNS dependent only on connection type 2023-11-05 21:20:20 +00:00
Robert Schulze
8a64066ee1
+ formatQueryOrNull() 2023-11-05 20:24:23 +00:00
Arthur Passos
b6e205dcdf
Add ClickHouse setting to disable tunneling for HTTPS requests over HTTP proxy (#55033)
* initial commit. integ tests passing, need to re-run unit & my own personal tests

* partial refactoring to remove Protocol::ANY

* improve naming

* remove all usages of ProxyConfiguration::Protocol::ANY

* fix ut

* blabla

* support url functions as well

* support for HTTPS requests over HTTP proxy with tunneling off

* remove gtestabc

* fix silly mistake

* ...

* remove usages of httpclientsession::proxyconfig in src/

* got you

* remove stale comment

* it seems like I need reasonable defaults

* fix ut

* add some comments

* remove no longer needed header

* matrix out

* add https over http proxy with no tunneling

* soem docs

* partial refactoring

* rename to use_tunneling_for_https_requests_over_http_proxy

* improve docs

* use shorter version

* remove useless test

* rename the setting

* update

* fix typo

* fix setting docs typo

* move ); up

* move ) up
2023-11-04 13:47:52 -04:00
Alexey Milovidov
b4982e90da
Update build-cross-riscv.md 2023-11-04 02:51:48 +03:00
Robert Schulze
480e284db1
Merge pull request #56088 from jh0x/feature-from-days-zero
Add function `fromDaysSinceYearZero()`
2023-11-04 00:17:04 +01:00
yariks5s
d95262622b init 2023-11-03 16:47:06 +00:00
Denny Crane
dbaebe18f1
Update settings.md 2023-11-03 13:14:56 -03:00
Denny Crane
9dbd229462
Update settings.md 2023-11-03 13:09:51 -03:00
Nikita Mikhaylov
9666549d15
Merge pull request #56280 from ClickHouse/melvynator-patch-2
Update detach.md
2023-11-03 14:45:04 +01:00
Kruglov Pavel
81b1ca22bb
Merge pull request #51823 from canhld94/ch_add_max_execution_time_leaf
Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query
2023-11-03 13:31:15 +01:00
vdimir
55a1baf029
Merge pull request #56022 from ClickHouse/vdimir/check_all_tables
Add CHECK query for all the tables
2023-11-03 10:10:42 +01:00
Duc Canh Le
dd6b02a2fd add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-03 03:00:13 +00:00
Dmitry Novik
2db74997a8
Fix typo 2023-11-03 01:34:07 +01:00
Dmitry Novik
f6733ac7ab
Add documentation for ATTACH DATABASE 2023-11-03 01:21:11 +01:00
Dmitry Novik
49d553369e
Add info about DETACH DATABASE 2023-11-03 01:12:58 +01:00
Peignon Melvyn
5d939f6df0
Update detach.md
Added detach database
2023-11-03 00:23:56 +01:00
Robert Schulze
910477b1bd
Add FROM_DAYS() alias 2023-11-02 21:43:17 +00:00
Robert Schulze
0b587d3cea
Remove overflow setting
Reason 1:
- https://github.com/ClickHouse/ClickHouse/pull/55696#issuecomment-1774130793
  Basically: Setting `date_time_overflow_behavior` applies only to
  conversions between Date <-> Date32 <-> DateTime <-> DateTime64 but
  it does not control the behavior of functions.

Reason 2:
- It's overkill (even if well-intented overkill). ClickHouse generally
  has a garbage in - garbate out philosophy, so that should be the
  default behavior which corresponds to behavior "ignore". Moreover,
  function 'fromDaysSinceYearZero()' mostly exists for compatibility /
  parity with MySQL and MySQL takes the same stance.
2023-11-02 21:43:17 +00:00
Robert Schulze
492af27feb
Update docs 2023-11-02 20:56:01 +00:00
Sema Checherinda
90b64bcdb9 backward compatibility and implementation feature storage_metadata_write_full_object_key 2023-11-02 15:20:55 +01:00
robot-clickhouse
13adae0e42
Merge pull request #56244 from ne1r0n/patch-4
[Docs] fix typo
2023-11-02 14:59:19 +01:00
Nikita Taranov
b078443826
Fix typo in largestTriangleThreeBuckets.md (#56263) 2023-11-02 14:45:13 +01:00
Robert Schulze
79cbaf406d
Merge pull request #56199 from yokofly/update-cross-compile-doc
[Docs] Update cross-compilation guide for OSX
2023-11-02 13:38:06 +01:00
Robert Schulze
6d08a441fa
Update build-cross-osx.md 2023-11-02 12:41:31 +01:00
vdimir
14ba4696f9
Rename jaccardIndex -> stringJaccardIndex, upd doc 2023-11-02 11:37:50 +00:00
vdimir
1f936d1966
upd byteHammingDistance doc 2023-11-02 11:37:50 +00:00
Alexey Milovidov
1267246785
Merge pull request #55642 from ClickHouse/morton-utils
Indexing by space-filling curves
2023-11-02 12:21:33 +01:00
yokofly
84fd2191c9 fix comment:
Simplify ARM build instructions with replacement note
2023-11-02 03:55:22 -07:00
Alexander Chashnikov
3d88614e6b
fix typo
asteriks -> asterisk
2023-11-02 10:56:17 +02:00
Justin de Guzman
782d67766d
[Docs] Specify IAM role necessary for GCS table function 2023-11-01 21:56:20 -07:00
yokofly
46703bf7b9 Merge remote-tracking branch 'origin/master' into update-cross-compile-doc 2023-11-01 18:48:29 -07:00
yokofly
d2f9107889 clean blank 2023-11-01 18:47:56 -07:00
robot-ch-test-poll1
a5fb7b0a1e
Merge pull request #56213 from ttanay/sort-spill-to-disk-docs
Add `max_bytes_before_external_sort` setting to query complexity doc
2023-11-02 00:50:30 +01:00
Denny Crane
d145ddb293 fix asell 2023-11-02 00:01:42 +01:00
Denny Crane
71322bde3f
Update index.md 2023-11-01 17:07:27 -03:00
Joanna Hulboj
757dc8b944 Fix typos, add to/fromDaysSinceYearZero to fuzz 2023-11-01 17:48:58 +00:00
Tanay Tummalapalli
6a3b2a04d8 Add max_bytes_before_external_sort setting to query complexity doc
The setting should be mentioned here along with
`max_bytes_before_external_group_by` setting.

Note: The russian translation is courtesy of Google Translate.
2023-11-01 22:33:25 +05:30
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
Kruglov Pavel
bf77ce691c
Merge pull request #55982 from yariks5s/npy_input_format
New input format Npy
2023-11-01 14:26:22 +01:00
yokofly
6927a2cadf [Docs] Update cross-compilation guide for OSX
This commit addresses two primary changes:
1. Sync the cross-compilation code for use in the CI action docker:
   - Use `--depth=1` during cloning to reduce clone times.
   - Update to a newer version of the macOS SDK.
see:
eb3a7caa74/docker/packager/binary/Dockerfile (L82)

2. Intro cross-compilation support for aarch64 OSX. The key change involves replacing the `x86_64` phase with `aarch64`, which is the current configuration we use.
2023-11-01 05:46:18 -07:00
Nikolai Kochetov
4deaf7cefb
Merge pull request #56134 from yariks5s/force_optimize_projection_name
Implementing force_optimize_projection_name
2023-11-01 13:12:10 +01:00
Nikolay Degterinsky
cd779d4f50
Merge pull request #55856 from ClickHouse/rewrite-delete-docs
Rewrite DELETE docs
2023-11-01 00:10:01 +01:00
Joanna Hulboj
e5b4d7fac7 Fix failing checks 2023-10-31 21:00:11 +00:00
Justin de Guzman
a011990fd7
Add clangd recommendation for VS Code (#56071)
* Add clangd recommendation for VS Code

* Edit docs for clarity and add links

* Adds new words to dictionary. Sorts dictionary.

---------

Co-authored-by: johnnymatthews <9611008+johnnymatthews@users.noreply.github.com>
2023-10-31 16:35:47 +01:00
Robert Schulze
13b2946ae2
Merge pull request #55960 from rschu1ze/adddate-stringargs
Support string-encoded date arguments in `addDate()`
2023-10-31 15:37:34 +01:00
Raúl Marín
f3a3ec53f6
Merge pull request #56124 from den-crane/patch-64
Beautify `show merges`
2023-10-31 11:02:10 +01:00
Smita Kulkarni
3fdf0daf1b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-31 10:43:28 +01:00
Alexey Milovidov
016285ea87
Merge branch 'master' into morton-utils 2023-10-31 01:47:16 +01:00
yariks5s
0846714052 added docs, changed tests 2023-10-30 17:17:53 +00:00
Denny Crane
3535adf2af
Update show.md 2023-10-30 09:53:23 -03:00
yariks5s
9a2d89e3e4 removed getSize() and enhanced docs 2023-10-30 12:42:19 +00:00
Justin de Guzman
e33dc02c8c
Add note clarifying Prometheus support in ClickHouse Cloud (#56069) 2023-10-30 13:35:02 +01:00
Sergei Trifonov
58824fb02b
Merge pull request #56030 from azat/disks/least_used-fix
Fix incorrect free space accounting for least_used JBOD policy
2023-10-30 09:04:38 +01:00
Alexey Milovidov
3631e476eb
Merge pull request #54947 from amosbird/minmax-combinator
Introduce -ArgMin/-ArgMax combinators.
2023-10-30 03:35:28 +01:00
robot-ch-test-poll2
088a3ada7f
Merge pull request #56070 from ClickHouse/docs-dictionary-updates
Clarify query behavior dictionary updates
2023-10-30 01:20:21 +01:00
Alexey Milovidov
6eff22568f
Revert "Add function getHttpHeader" 2023-10-29 19:50:39 +03:00
Azat Khuzhin
c7f392500e Fix incorrect free space accounting for least_used JBOD policy
Before least_used fails to detect when the disk started to have more
space, it works only when the disk starts to have less space.

The reason for this is that it uses priority_queue, and once the disk
goes at the bottom of the queue, free space will not be updated for it
until it will be selected again.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-29 17:36:31 +01:00
justindeguzman
9fecf429b1 Docs: edit lightweight DELETE docs based on feedback 2023-10-28 20:23:26 -07:00
rfraposa
a993683a5b Update amazon-reviews.md 2023-10-28 19:34:04 -06:00
rfraposa
11f2dd1d10 Update amazon-reviews.md 2023-10-28 13:13:24 -06:00
rfraposa
7ab492edad Update amazon-reviews.md 2023-10-28 12:58:47 -06:00
yariks5s
894724bfb3 suggested changes 2023-10-28 01:17:25 +00:00
yariks5s
23635352f1 fixed due to review 2023-10-27 15:43:03 +00:00
vdimir
36c1919d7f
Add CHECK ALL TABLES to docs 2023-10-27 15:22:11 +00:00
Smita Kulkarni
960927a323 Updated name to use_compression 2023-10-27 14:53:54 +02:00
Rory Crispin
b817ab45bd
Fix dead link to Virtual Columns 2023-10-27 12:03:15 +02:00
Robert Schulze
a68e8be08f
Merge pull request #55696 from zvonand/zvonand-datetime-ranges
Introduce setting `date_time_overflow_behavior` to control the overflow behavior when converting to `Date` / `Date32` / `DateTime` / `DateTime64`
2023-10-27 10:40:20 +02:00
Robert Schulze
5801b06529
Merge pull request #55983 from rschu1ze/snowflake-scale
Fix dateTime64ToSnowflake64() with non-default scale
2023-10-27 10:22:35 +02:00
Justin de Guzman
b51f90362d
Clarify query behavior dictionary updates 2023-10-27 00:20:32 -07:00
zvonand
35baf7792d cleanup after rebase, add [[unlikely]] 2023-10-26 23:56:45 +02:00
Robert Schulze
325ff33c3a
Merge pull request #55239 from aiven-sal/aiven-sal/format_query
Add formatQuery function
2023-10-26 22:46:01 +02:00
vdimir
dbaf66b8f2
Fix function_json_value_return_type_allow_nullable setting name in doc 2023-10-26 19:26:18 +02:00
Smita Kulkarni
d1d8f4b2e1 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-26 16:56:03 +02:00
Alexander Tokmakov
fa963d60d0
Merge pull request #55641 from evillique/resubmit-cluster-groups
Resubmit #54421
2023-10-26 15:53:53 +02:00
Andrey Zvonov
71287788d1
Merge branch 'ClickHouse:master' into zvonand-datetime-ranges 2023-10-26 14:14:32 +02:00
Anton Popov
9e64f51ffa
Merge pull request #56020 from CurtizJ/minor-style-fixes
Correct the implementation of function `jsonMergePatch`
2023-10-26 13:26:55 +02:00
Salvatore Mesoraca
56bd61d207
Rename formatQueryOneLine -> formatQuerySingleLine 2023-10-26 13:09:20 +02:00
Salvatore Mesoraca
21e0c510c8
formatQuery: improve doc 2023-10-26 13:08:11 +02:00
Andrey Zvonov
5737369d0b
Merge branch 'ClickHouse:master' into zvonand-datetime-ranges 2023-10-26 11:42:13 +02:00
vdimir
12890eb70c
Merge pull request #55806 from canhld94/rocksdb_trivial_count
Support trivial count for rocksdb and storage join
2023-10-26 11:22:38 +02:00
vdimir
1d5f75fd71
Merge pull request #53404 from ClickHouse/vdimir/check_table_improvements2
Improve CHECK TABLE system query, support checking part
2023-10-26 10:57:44 +02:00
Andrey Zvonov
6fccd55d30
Merge branch 'ClickHouse:master' into zvonand-datetime-ranges 2023-10-26 10:49:38 +02:00
robot-ch-test-poll3
90c8efa23f
Merge pull request #55979 from kitaisreal/add-show-setting-query
Add SHOW SETTING query
2023-10-26 09:09:25 +02:00
zvonand
0766c73aab Rename date_time_overflow_mode -> date_time_overflow_behavior, moved it to format settings 2023-10-25 23:11:13 +02:00
zvonand
5b86e8c714 updated after review 2023-10-25 23:10:58 +02:00
zvonand
2f3695add8 Introduce setting for dt overflow exception
Added tests and docs
2023-10-25 23:10:24 +02:00
Alexey Milovidov
bb5a60dc19
Merge pull request #55893 from ClickHouse/revert-partial-result-2
Revert "Revert "Revert "Add settings for real-time updates during query execution"""
2023-10-25 22:20:28 +02:00
Nikolay Degterinsky
95f58777e9 Fix style 2023-10-25 19:04:30 +00:00
Nikolay Degterinsky
97c99132e0 Simplify the implementation 2023-10-25 19:02:48 +00:00
Dmitry Novik
e25ce7c5fb
Merge pull request #56007 from nellicus/patch-1
Fix toDayOfWeek return value description
2023-10-25 20:21:20 +02:00
Maksim Kita
108df081b7 Add documentation 2023-10-25 18:49:00 +03:00
Anton Popov
3e6ecf1858 correct the implementation of function jsonMergePatch 2023-10-25 15:17:28 +00:00
Dmitry Novik
3973b24302
Update docs/en/sql-reference/functions/date-time-functions.md 2023-10-25 16:58:25 +02:00
Anton Popov
6ba59b8408
Merge pull request #54364 from Joeywzr/master
Support jsonMerge function
2023-10-25 15:27:16 +02:00
Robert Schulze
5067fb342f
Support-encoded date arguments in addDate() 2023-10-25 10:41:18 +00:00
yariks5s
2ab1ae42c1 added docs and tests, style check 2023-10-25 10:37:05 +00:00