Commit Graph

11838 Commits

Author SHA1 Message Date
Alexey Milovidov
d34809bc7c Revert a wrong change in server settings 2023-11-09 00:32:43 +01:00
Robert Schulze
a5a7a16096
Merge pull request #56478 from rschu1ze/docs-fetch-repo
Docs: Update instructions to fetch the repo
2023-11-08 23:24:57 +01:00
Robert Schulze
9b2a65e10e
Docs: Update instructions to fetch the repo 2023-11-08 19:51:02 +00:00
Peignon Melvyn
ba87360114
Mark MaterializedPostreSQL as experimental in docs (#56462) 2023-11-08 20:26:19 +01:00
Yarik Briukhovetskyi
b8ea31db43
Merge pull request #56309 from yariks5s/preferred_optimize_projection_name
New setting preferred_projection_name
2023-11-08 18:06:03 +01:00
Alexey Milovidov
565559b7f3
Update sampling-query-profiler.md 2023-11-08 19:07:34 +03:00
pppeace
986154d6fb
Update wikistat.md
align the create sql and data load script about the column `size`.
2023-11-08 22:24:45 +08:00
Robert Schulze
2cf2c6bbd8
Merge pull request #56425 from slvrtrn/information-schema-statistics
Add `information_schema.statistics` system view
2023-11-08 10:29:18 +01:00
slvrtrn
1068478591 Update docs formatting 2023-11-07 19:18:59 +01:00
slvrtrn
94143ac002 Add information_schema.statistics docs 2023-11-07 19:14:44 +01:00
yariks5s
4da512d6a3 ehnanced docs 2023-11-07 17:57:39 +00:00
Robert Schulze
86b8ebf71c
Merge remote-tracking branch 'rschu1ze/master' into arrayRandomSample-improved 2023-11-07 15:25:29 +00:00
Robert Schulze
32a3b1b049
Merge remote-tracking branch 'rschu1ze/master' into idatatype-convenience-functions 2023-11-07 15:17:59 +00:00
Sema Checherinda
02df5ac59c
Merge pull request #54340 from KevinyhZou/bug_fix_csv_parse_crlf
Fix CSV read while the end of line is CR(\r)
2023-11-07 12:51:05 +01:00
Robert Schulze
842cc36598
Update docs 2023-11-07 10:25:27 +00:00
Robert Schulze
54b5d573d7
Merge remote-tracking branch 'rschu1ze/master' into idatatype-convenience-functions 2023-11-07 10:18:30 +00:00
Robert Schulze
e22c673299
Revert "Revert "Add function arrayRandomSample()""
This reverts commit e47e50e30d.
2023-11-07 10:16:13 +00:00
Pradeep Chhetri
0aaaf320b6 Update document of keeper-client to let CI run 2023-11-07 13:58:45 +08:00
robot-ch-test-poll1
845a235ad8
Merge pull request #56237 from ClickHouse/justindeguzman-patch-1
[Docs] Specify IAM role necessary for GCS table function
2023-11-07 01:20:06 +01:00
robot-clickhouse
25558fe0a6
Merge pull request #56390 from ClickHouse/vdimir/doc_architecture_upd_streams
Update development documentation about data streams
2023-11-07 00:54:31 +01:00
Alexey Milovidov
e47e50e30d
Revert "Add function arrayRandomSample()" 2023-11-07 02:49:11 +03:00
Robert Schulze
8846cc6770
Merge pull request #56327 from rschu1ze/parseQueryOrNull
Improve `formatQuery()`
2023-11-06 22:48:16 +01:00
vdimir
c583b992ba
Update development documentation about data streams 2023-11-06 18:42:56 +00:00
Sema Checherinda
a5e17dc919
Merge pull request #55566 from CheSema/remote-blobs-naming
feature: storage_metadata_write_full_object_key
2023-11-06 16:41:49 +01:00
Robert Schulze
5cfcf98d4a
Merge pull request #56277 from rschu1ze/show-columns-connection-type
Make type names in `SHOW COLUMNS` dependent on connection type
2023-11-06 16:24:27 +01:00
Robert Schulze
8896134531
Cleanup IDataType convenience functions 2023-11-06 13:25:32 +00:00
Robert Schulze
ae1dcb5254
Move documentation of string similarity functions to better location 2023-11-06 13:25:08 +00:00
vdimir
3b775dee53
Merge pull request #55126 from ClickHouse/vdimir/jaccard_index_perf
Add function jaccardIndex back with better performance
2023-11-06 10:39:02 +01:00
kevinyhzou
2a50daf5dd Allow cr at end of csv line 2023-11-06 12:21:42 +08:00
kevinyhzou
ef30e6723d bug fix csv read while end of line is not crlf 2023-11-06 12:21:42 +08:00
Robert Schulze
049c811a38
Make type names in SHOW COLUMNS dependent only on connection type 2023-11-05 21:20:20 +00:00
Robert Schulze
8a64066ee1
+ formatQueryOrNull() 2023-11-05 20:24:23 +00:00
Arthur Passos
b6e205dcdf
Add ClickHouse setting to disable tunneling for HTTPS requests over HTTP proxy (#55033)
* initial commit. integ tests passing, need to re-run unit & my own personal tests

* partial refactoring to remove Protocol::ANY

* improve naming

* remove all usages of ProxyConfiguration::Protocol::ANY

* fix ut

* blabla

* support url functions as well

* support for HTTPS requests over HTTP proxy with tunneling off

* remove gtestabc

* fix silly mistake

* ...

* remove usages of httpclientsession::proxyconfig in src/

* got you

* remove stale comment

* it seems like I need reasonable defaults

* fix ut

* add some comments

* remove no longer needed header

* matrix out

* add https over http proxy with no tunneling

* soem docs

* partial refactoring

* rename to use_tunneling_for_https_requests_over_http_proxy

* improve docs

* use shorter version

* remove useless test

* rename the setting

* update

* fix typo

* fix setting docs typo

* move ); up

* move ) up
2023-11-04 13:47:52 -04:00
Alexey Milovidov
b4982e90da
Update build-cross-riscv.md 2023-11-04 02:51:48 +03:00
Robert Schulze
480e284db1
Merge pull request #56088 from jh0x/feature-from-days-zero
Add function `fromDaysSinceYearZero()`
2023-11-04 00:17:04 +01:00
yariks5s
d95262622b init 2023-11-03 16:47:06 +00:00
Denny Crane
dbaebe18f1
Update settings.md 2023-11-03 13:14:56 -03:00
Denny Crane
9dbd229462
Update settings.md 2023-11-03 13:09:51 -03:00
Nikita Mikhaylov
9666549d15
Merge pull request #56280 from ClickHouse/melvynator-patch-2
Update detach.md
2023-11-03 14:45:04 +01:00
Kruglov Pavel
81b1ca22bb
Merge pull request #51823 from canhld94/ch_add_max_execution_time_leaf
Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query
2023-11-03 13:31:15 +01:00
vdimir
55a1baf029
Merge pull request #56022 from ClickHouse/vdimir/check_all_tables
Add CHECK query for all the tables
2023-11-03 10:10:42 +01:00
Duc Canh Le
dd6b02a2fd add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-03 03:00:13 +00:00
Dmitry Novik
2db74997a8
Fix typo 2023-11-03 01:34:07 +01:00
Dmitry Novik
f6733ac7ab
Add documentation for ATTACH DATABASE 2023-11-03 01:21:11 +01:00
Dmitry Novik
49d553369e
Add info about DETACH DATABASE 2023-11-03 01:12:58 +01:00
Peignon Melvyn
5d939f6df0
Update detach.md
Added detach database
2023-11-03 00:23:56 +01:00
Robert Schulze
910477b1bd
Add FROM_DAYS() alias 2023-11-02 21:43:17 +00:00
Robert Schulze
0b587d3cea
Remove overflow setting
Reason 1:
- https://github.com/ClickHouse/ClickHouse/pull/55696#issuecomment-1774130793
  Basically: Setting `date_time_overflow_behavior` applies only to
  conversions between Date <-> Date32 <-> DateTime <-> DateTime64 but
  it does not control the behavior of functions.

Reason 2:
- It's overkill (even if well-intented overkill). ClickHouse generally
  has a garbage in - garbate out philosophy, so that should be the
  default behavior which corresponds to behavior "ignore". Moreover,
  function 'fromDaysSinceYearZero()' mostly exists for compatibility /
  parity with MySQL and MySQL takes the same stance.
2023-11-02 21:43:17 +00:00
Robert Schulze
492af27feb
Update docs 2023-11-02 20:56:01 +00:00
Sema Checherinda
90b64bcdb9 backward compatibility and implementation feature storage_metadata_write_full_object_key 2023-11-02 15:20:55 +01:00
robot-clickhouse
13adae0e42
Merge pull request #56244 from ne1r0n/patch-4
[Docs] fix typo
2023-11-02 14:59:19 +01:00
Nikita Taranov
b078443826
Fix typo in largestTriangleThreeBuckets.md (#56263) 2023-11-02 14:45:13 +01:00
Robert Schulze
79cbaf406d
Merge pull request #56199 from yokofly/update-cross-compile-doc
[Docs] Update cross-compilation guide for OSX
2023-11-02 13:38:06 +01:00
Robert Schulze
6d08a441fa
Update build-cross-osx.md 2023-11-02 12:41:31 +01:00
vdimir
14ba4696f9
Rename jaccardIndex -> stringJaccardIndex, upd doc 2023-11-02 11:37:50 +00:00
vdimir
1f936d1966
upd byteHammingDistance doc 2023-11-02 11:37:50 +00:00
Alexey Milovidov
1267246785
Merge pull request #55642 from ClickHouse/morton-utils
Indexing by space-filling curves
2023-11-02 12:21:33 +01:00
yokofly
84fd2191c9 fix comment:
Simplify ARM build instructions with replacement note
2023-11-02 03:55:22 -07:00
Alexander Chashnikov
3d88614e6b
fix typo
asteriks -> asterisk
2023-11-02 10:56:17 +02:00
Justin de Guzman
782d67766d
[Docs] Specify IAM role necessary for GCS table function 2023-11-01 21:56:20 -07:00
yokofly
46703bf7b9 Merge remote-tracking branch 'origin/master' into update-cross-compile-doc 2023-11-01 18:48:29 -07:00
yokofly
d2f9107889 clean blank 2023-11-01 18:47:56 -07:00
robot-ch-test-poll1
a5fb7b0a1e
Merge pull request #56213 from ttanay/sort-spill-to-disk-docs
Add `max_bytes_before_external_sort` setting to query complexity doc
2023-11-02 00:50:30 +01:00
Denny Crane
d145ddb293 fix asell 2023-11-02 00:01:42 +01:00
Denny Crane
71322bde3f
Update index.md 2023-11-01 17:07:27 -03:00
Joanna Hulboj
757dc8b944 Fix typos, add to/fromDaysSinceYearZero to fuzz 2023-11-01 17:48:58 +00:00
Tanay Tummalapalli
6a3b2a04d8 Add max_bytes_before_external_sort setting to query complexity doc
The setting should be mentioned here along with
`max_bytes_before_external_group_by` setting.

Note: The russian translation is courtesy of Google Translate.
2023-11-01 22:33:25 +05:30
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
Kruglov Pavel
bf77ce691c
Merge pull request #55982 from yariks5s/npy_input_format
New input format Npy
2023-11-01 14:26:22 +01:00
yokofly
6927a2cadf [Docs] Update cross-compilation guide for OSX
This commit addresses two primary changes:
1. Sync the cross-compilation code for use in the CI action docker:
   - Use `--depth=1` during cloning to reduce clone times.
   - Update to a newer version of the macOS SDK.
see:
eb3a7caa74/docker/packager/binary/Dockerfile (L82)

2. Intro cross-compilation support for aarch64 OSX. The key change involves replacing the `x86_64` phase with `aarch64`, which is the current configuration we use.
2023-11-01 05:46:18 -07:00
Nikolai Kochetov
4deaf7cefb
Merge pull request #56134 from yariks5s/force_optimize_projection_name
Implementing force_optimize_projection_name
2023-11-01 13:12:10 +01:00
Nikolay Degterinsky
cd779d4f50
Merge pull request #55856 from ClickHouse/rewrite-delete-docs
Rewrite DELETE docs
2023-11-01 00:10:01 +01:00
Joanna Hulboj
e5b4d7fac7 Fix failing checks 2023-10-31 21:00:11 +00:00
Justin de Guzman
a011990fd7
Add clangd recommendation for VS Code (#56071)
* Add clangd recommendation for VS Code

* Edit docs for clarity and add links

* Adds new words to dictionary. Sorts dictionary.

---------

Co-authored-by: johnnymatthews <9611008+johnnymatthews@users.noreply.github.com>
2023-10-31 16:35:47 +01:00
Robert Schulze
13b2946ae2
Merge pull request #55960 from rschu1ze/adddate-stringargs
Support string-encoded date arguments in `addDate()`
2023-10-31 15:37:34 +01:00
Raúl Marín
f3a3ec53f6
Merge pull request #56124 from den-crane/patch-64
Beautify `show merges`
2023-10-31 11:02:10 +01:00
Smita Kulkarni
3fdf0daf1b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-31 10:43:28 +01:00
Alexey Milovidov
016285ea87
Merge branch 'master' into morton-utils 2023-10-31 01:47:16 +01:00
yariks5s
0846714052 added docs, changed tests 2023-10-30 17:17:53 +00:00
Denny Crane
3535adf2af
Update show.md 2023-10-30 09:53:23 -03:00
yariks5s
9a2d89e3e4 removed getSize() and enhanced docs 2023-10-30 12:42:19 +00:00
Justin de Guzman
e33dc02c8c
Add note clarifying Prometheus support in ClickHouse Cloud (#56069) 2023-10-30 13:35:02 +01:00
Sergei Trifonov
58824fb02b
Merge pull request #56030 from azat/disks/least_used-fix
Fix incorrect free space accounting for least_used JBOD policy
2023-10-30 09:04:38 +01:00
Alexey Milovidov
3631e476eb
Merge pull request #54947 from amosbird/minmax-combinator
Introduce -ArgMin/-ArgMax combinators.
2023-10-30 03:35:28 +01:00
robot-ch-test-poll2
088a3ada7f
Merge pull request #56070 from ClickHouse/docs-dictionary-updates
Clarify query behavior dictionary updates
2023-10-30 01:20:21 +01:00
Alexey Milovidov
6eff22568f
Revert "Add function getHttpHeader" 2023-10-29 19:50:39 +03:00
Azat Khuzhin
c7f392500e Fix incorrect free space accounting for least_used JBOD policy
Before least_used fails to detect when the disk started to have more
space, it works only when the disk starts to have less space.

The reason for this is that it uses priority_queue, and once the disk
goes at the bottom of the queue, free space will not be updated for it
until it will be selected again.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-29 17:36:31 +01:00
justindeguzman
9fecf429b1 Docs: edit lightweight DELETE docs based on feedback 2023-10-28 20:23:26 -07:00
rfraposa
a993683a5b Update amazon-reviews.md 2023-10-28 19:34:04 -06:00
rfraposa
11f2dd1d10 Update amazon-reviews.md 2023-10-28 13:13:24 -06:00
rfraposa
7ab492edad Update amazon-reviews.md 2023-10-28 12:58:47 -06:00
yariks5s
894724bfb3 suggested changes 2023-10-28 01:17:25 +00:00
yariks5s
23635352f1 fixed due to review 2023-10-27 15:43:03 +00:00
vdimir
36c1919d7f
Add CHECK ALL TABLES to docs 2023-10-27 15:22:11 +00:00
Smita Kulkarni
960927a323 Updated name to use_compression 2023-10-27 14:53:54 +02:00
Rory Crispin
b817ab45bd
Fix dead link to Virtual Columns 2023-10-27 12:03:15 +02:00
Robert Schulze
a68e8be08f
Merge pull request #55696 from zvonand/zvonand-datetime-ranges
Introduce setting `date_time_overflow_behavior` to control the overflow behavior when converting to `Date` / `Date32` / `DateTime` / `DateTime64`
2023-10-27 10:40:20 +02:00
Robert Schulze
5801b06529
Merge pull request #55983 from rschu1ze/snowflake-scale
Fix dateTime64ToSnowflake64() with non-default scale
2023-10-27 10:22:35 +02:00
Justin de Guzman
b51f90362d
Clarify query behavior dictionary updates 2023-10-27 00:20:32 -07:00