Commit Graph

612 Commits

Author SHA1 Message Date
Nikolai Kochetov
024f41888e
Merge pull request #53562 from yariks5s/group_sorted_array_function
Add new aggregation function groupArraySorted()
2023-11-29 17:52:01 +01:00
zvonand
c329e382ab resolve conflicts 2023-11-29 16:03:07 +01:00
Han Fei
6733438adc Merge branch 'master' into hanfei/statistic 2023-11-28 16:35:00 +01:00
zvonand
c306d21b54 merge master + resolve conflicts 2023-11-28 15:51:21 +01:00
Antonio Andelic
a61f32867e
Merge pull request #56488 from lingtaolf/feature/getHTTPHeader
add function getClientHTTPHeader
2023-11-28 11:41:56 +01:00
Robert Schulze
1448276bae
Merge pull request #55872 from azat/hour-no-leading-zero
Add ability to parse hours/months without leading zeros
2023-11-28 11:07:00 +01:00
Ubuntu
a85cf758b0 Fuzz JSON table function
Create a table function `fuzzJSON`

An example query:
```
CREATE NAMED COLLECTION json_fuzzer AS json_str={};

SELECT *
FROM fuzzJSON(json_fuzzer, json_str = '{"students" : ["Alice", "Bob"]}', random_seed = 666, max_output_length = 128, probability = 0.9)
LIMIT 3

Query id: 7f802052-efb0-41b4-87fa-03b7dd290e9d

┌─json──────────────────────────────────────────────────────────────────────────────────┐
│ {"ade0yX":[9200406572736542991, true, "sm"]}                                          │
│ {"students":["Alice", "eSN3WO#a6NYTBe0$#OWwyIQ"], "cVoP2BuQugQ":17384271928263249403} │
│ {"students":["Alice", "Bob", "T+-k4+PJGkL%XRRaF2BoeN@&A"]}                            │
└───────────────────────────────────────────────────────────────────────────────────────┘
```

Next step:
* Generate invalid string

Fixes #35962

add Object('json')

use named collection
2023-11-28 01:58:24 +00:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
Azat Khuzhin
3ab1d4ae68 Add "formatters" into spell excludes
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-27 14:42:03 +01:00
Nikolay Degterinsky
de0876ed68
Merge pull request #57234 from evillique/fix-docs-anchors
Fix docs
2023-11-27 01:22:43 +01:00
Nikolay Degterinsky
124fae7549 Fix style 2023-11-26 23:58:34 +00:00
Nikolay Degterinsky
dd49b46ca5 Fix style 2023-11-26 22:32:11 +00:00
Robert Schulze
5b7d2a903d
Merge pull request #57152 from rschu1ze/fine-granular-plan-opt-settings
Fine-granular enablement/disabling of plan-level optimizations
2023-11-25 20:44:23 +01:00
Robert Schulze
ace830a618
Fix spelling 2023-11-23 22:56:40 +00:00
Alexey Milovidov
10d5ba57e8
Merge pull request #57124 from azat/build/split-HashedDictionary-CU
Split HashedDictionary CU
2023-11-23 23:14:47 +01:00
Yarik Briukhovetskyi
69205769d0
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-11-23 20:23:47 +01:00
Alexey Milovidov
ac1e742afa
Merge pull request #57108 from azat/build/large-objects
Allow HashedDictionary/FunctionsConversion as large TU
2023-11-23 15:00:59 +01:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
Azat Khuzhin
cf3cd099a5 Split HashedDictionary CU
Before HashedDictionary.cpp exceeds 50MiB, now:

    -rw-r--r-- 1 azat azat  37M Nov 22 17:56 SparseHashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat  34M Nov 22 17:56 HashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat 716K Nov 22 17:56 registerHashedDictionary.cpp.o

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 19:00:40 +01:00
Azat Khuzhin
4925cb7eda Allow HashedDictionary/FunctionsConversion as large TU
In case of -DOMIT_HEAVY_DEBUG_SYMBOLS=OFF they are large.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 16:39:54 +01:00
zvonand
5153798aeb Introduced fileCluster table function
Added fileCluster function
Added test and docs
2023-11-22 15:06:04 +01:00
Bhavna Jindal
3731d57dd5 added method name in aspell-dict 2023-11-21 06:52:48 -08:00
凌涛
e86aa433c5
Merge branch 'master' into feature/getHTTPHeader 2023-11-21 19:48:47 +08:00
凌涛
c5f16725ec add function getClientHTTPHeader 2023-11-21 11:12:01 +08:00
avogar
872556a5d4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:03:36 +00:00
serxa
9023f61349 Merge branch 'master' into async-loader-integration 2023-11-19 13:05:58 +00:00
Andrey Zvonov
fc15b0c1e7
Merge branch 'ClickHouse:master' into zvonand-more-globs 2023-11-16 11:19:12 +01:00
Vitaly Baranov
946e02ecbc
Merge pull request #56268 from vitlibar/add-script-backup-view
Add an external utility to view backups and to extract information from them
2023-11-16 11:17:16 +01:00
zvonand
20163e6aba add globbing to aspell-ignore 2023-11-15 16:37:24 +01:00
Alexey Milovidov
e32f6e5556
Merge branch 'master' into remove-orphan-headers 2023-11-14 09:23:19 +01:00
Alexey Milovidov
9bf62dd622 Remove orphan header files 2023-11-14 07:43:11 +01:00
Alexey Milovidov
4e3e8e32fd Remove more garbage 2023-11-14 07:24:41 +01:00
Alexey Milovidov
d7df884cbb Merge branch 'master' into filter-large-translation-units 2023-11-13 19:31:13 +01:00
Alexey Milovidov
c1bba6ea4a Merge branch 'master' into filter-large-translation-units 2023-11-13 17:54:02 +01:00
Mikhail f. Shiryaev
88e04579fd
Add a simple validator for reusable workflows 2023-11-13 12:49:32 +01:00
Vitaly Baranov
f12b95df7d Add documentation. 2023-11-13 09:43:06 +01:00
Alexey Milovidov
96f73139b6 Check for large translation units 2023-11-10 06:13:55 +01:00
Robert Schulze
38c76eb709
Merge remote-tracking branch 'rschu1ze/master' into pcg 2023-11-08 09:43:27 +00:00
Robert Schulze
180eca7337
Restore check-style 2023-11-08 09:36:43 +00:00
Robert Schulze
e46dbcb2f1
Use pcg/randomSeed() random generator/seed instead of std::mt19937/std::random_device 2023-11-07 18:54:50 +00:00
Robert Schulze
86b8ebf71c
Merge remote-tracking branch 'rschu1ze/master' into arrayRandomSample-improved 2023-11-07 15:25:29 +00:00
serxa
19aa1375fc Merge branch 'master' into async-loader-integration 2023-11-07 10:25:38 +00:00
Robert Schulze
54b5d573d7
Merge remote-tracking branch 'rschu1ze/master' into idatatype-convenience-functions 2023-11-07 10:18:30 +00:00
Robert Schulze
e22c673299
Revert "Revert "Add function arrayRandomSample()""
This reverts commit e47e50e30d.
2023-11-07 10:16:13 +00:00
vdimir
2de73d3456
Merge pull request #56394 from ClickHouse/vdimir/check_doc_file
Option to check particular file with utils/check-style/check-doc-aspell
2023-11-07 10:34:16 +01:00
robot-clickhouse
25558fe0a6
Merge pull request #56390 from ClickHouse/vdimir/doc_architecture_upd_streams
Update development documentation about data streams
2023-11-07 00:54:31 +01:00
Alexey Milovidov
e47e50e30d
Revert "Add function arrayRandomSample()" 2023-11-07 02:49:11 +03:00
Robert Schulze
b195cba943
Fix spelling 2023-11-06 20:11:55 +00:00
vdimir
941ece31e1
Option to check particular file with utils/check-style/check-doc-aspell 2023-11-06 19:25:07 +00:00
vdimir
a091f0323e
Update aspell-dict.txt 2023-11-06 19:16:49 +00:00
serxa
6babc8e934 rename metrics for new pools to match settings 2023-11-06 12:24:00 +00:00
vdimir
3b775dee53
Merge pull request #55126 from ClickHouse/vdimir/jaccard_index_perf
Add function jaccardIndex back with better performance
2023-11-06 10:39:02 +01:00
Robert Schulze
480e284db1
Merge pull request #56088 from jh0x/feature-from-days-zero
Add function `fromDaysSinceYearZero()`
2023-11-04 00:17:04 +01:00
vdimir
f7ac4367d7
Add stringJaccardIndex to aspell-dict.txt 2023-11-02 11:37:51 +00:00
Denny Crane
d145ddb293 fix asell 2023-11-02 00:01:42 +01:00
Joanna Hulboj
757dc8b944 Fix typos, add to/fromDaysSinceYearZero to fuzz 2023-11-01 17:48:58 +00:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
Kruglov Pavel
bf77ce691c
Merge pull request #55982 from yariks5s/npy_input_format
New input format Npy
2023-11-01 14:26:22 +01:00
Nikolay Degterinsky
cd779d4f50
Merge pull request #55856 from ClickHouse/rewrite-delete-docs
Rewrite DELETE docs
2023-11-01 00:10:01 +01:00
Nikolay Degterinsky
7738f3aecb
Update aspell-dict.txt 2023-10-31 23:29:27 +01:00
Sergey Suvorov
0a5888b6f8 Add new function names to aspell-dict.txt 2023-10-31 17:04:37 +01:00
Justin de Guzman
a011990fd7
Add clangd recommendation for VS Code (#56071)
* Add clangd recommendation for VS Code

* Edit docs for clarity and add links

* Adds new words to dictionary. Sorts dictionary.

---------

Co-authored-by: johnnymatthews <9611008+johnnymatthews@users.noreply.github.com>
2023-10-31 16:35:47 +01:00
avogar
7eefb72c53 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-10-30 19:44:26 +00:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Alexey Milovidov
6eff22568f
Revert "Add function getHttpHeader" 2023-10-29 19:50:39 +03:00
Kruglov Pavel
bb4b95e891
Merge branch 'master' into schema-inference-union 2023-10-27 14:53:58 +02:00
Sergei Trifonov
a5d7c2b6a2
Merge branch 'master' into async-loader-integration 2023-10-27 10:39:12 +02:00
Robert Schulze
325ff33c3a
Merge pull request #55239 from aiven-sal/aiven-sal/format_query
Add formatQuery function
2023-10-26 22:46:01 +02:00
Kruglov Pavel
570b66f027
Merge branch 'master' into schema-inference-union 2023-10-26 19:26:00 +02:00
Salvatore Mesoraca
56bd61d207
Rename formatQueryOneLine -> formatQuerySingleLine 2023-10-26 13:09:20 +02:00
Anton Popov
6ba59b8408
Merge pull request #54364 from Joeywzr/master
Support jsonMerge function
2023-10-25 15:27:16 +02:00
yariks5s
a1b9ab5877 added spelling 2023-10-25 10:52:37 +00:00
Salvatore Mesoraca
0bda99e880
Fix code style 2023-10-25 11:07:34 +02:00
Salvatore Mesoraca
6be7fd0fa1
Ignore formatQuery word during spell check 2023-10-24 15:38:24 +02:00
Kruglov Pavel
64e5797fc8
Update aspell-dict.txt 2023-10-24 14:30:26 +02:00
serxa
749cdb9954 Merge branch 'master' into async-loader-integration 2023-10-24 10:09:49 +00:00
Robert Schulze
bef5cea5a0
Merge remote-tracking branch 'rschu1ze/master' into string-addinterval 2023-10-23 14:08:18 +00:00
Denny Crane
38a3655c5e add fibonacci to aspell 2023-10-23 10:09:06 +01:00
Alexander Tokmakov
f899254e2c
Merge pull request #55430 from arthurpassos/properly_split_remote_proxy_http_https
Properly split remote proxy http https
2023-10-20 21:15:34 +02:00
Robert Schulze
3551d7f2d6
Update docs 2023-10-20 15:46:17 +00:00
Sinan
c7f78ac73a
Add aggregation function for Largest-Triangle-Three-Buckets (#53145)
* Added a simple lttb aggregate function

* Added support for multiple datatypes

* Added support for Date and Date32, updated LTTBData struct

* Updated code to handle bucket size 0 and 1

* Added sort for LTTBData

* Added tests and documentation

* Added some code style fixes

* Added function to new func ref file

* Removed function from new func ref file

* Apply suggestions from code review

* Updated unit tests

* updated LTTB data code

* Minor style fixes

* Updated code with std sort

* updated tests

* Renamed lttb to largestTriangleThreeBuckets

* Added alias lttb

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-10-18 14:47:18 +02:00
Han Fei
4b23142775
Merge branch 'master' into hanfei/statistic 2023-10-17 16:40:31 +02:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450)
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
2023-10-16 17:00:07 -07:00
serxa
0e17da22eb Merge branch 'master' into async-loader-integration 2023-10-16 11:08:29 +00:00
Alexander Tokmakov
e40aa72883
Merge pull request #54826 from JackyWoo/lb_nearest_host_name
Add load balancing hostname_levenshtein_distance
2023-10-13 17:23:02 +02:00
Robert Schulze
d02a718076
Merge pull request #55211 from Priyansh121096/master
Add function byteSwap
2023-10-13 16:54:28 +02:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
Kruglov Pavel
3eb093d177
Fix style 2023-10-12 14:32:26 +02:00
robot-clickhouse-ci-2
2eedb31ae3
Merge pull request #55498 from bytadaniel/patch-4
add npm packages to both en and zh docs from ru
2023-10-12 11:31:24 +02:00
JackyWoo
1f553f3d65 Merge branch 'master' into lb_nearest_host_name 2023-10-12 10:19:17 +08:00
Daniel Byta
e3719f88b2
Update aspell-dict.txt 2023-10-11 20:42:49 +03:00
Arthur Passos
eca411ec92 that it? 2023-10-10 13:14:41 -03:00
Memo
b7f70c2ba3 Merge branch 'master' into master 2023-10-10 20:08:41 +08:00
Joey Wang
06a7b679f6 support merging of nested paths 2023-10-10 14:57:37 +08:00
凌涛
51e2e59a97 Merge remote-tracking branch 'origin/master' into feature/function-getClientHttpHeader 2023-10-10 10:56:24 +08:00
Han Fei
fcb19b4f77 Merge branch 'master' into hanfei/statistic 2023-10-09 14:24:58 +02:00
Robert Schulze
624dbcdb4f
Merge pull request #49794 from Lirikl/arrayFold
Added function `arrayFold()`
2023-10-09 13:38:35 +02:00
Robert Schulze
07e0cc196d
Some fixups 2023-10-08 20:27:13 +00:00
Priyansh Agrawal
2c04370e5f Use std::byteswap instead of custom implementations.
- Also allow signed ints now because std::byteswap accepts them.
- Fix for style check.
2023-10-07 23:59:24 +00:00
Robert Schulze
73ff017fb5
Merge remote-tracking branch 'rschu1ze/master' into israelov/generate-random-int-array 2023-10-07 18:10:09 +00:00
JackyWoo
784fe880eb Merge branch 'master' into lb_nearest_host_name 2023-10-07 09:04:26 +08:00
Alexey Milovidov
458cbb3b18 Fix function names in docs 2023-09-29 10:15:46 +02:00
凌涛
0d256a381a add doc
fix tests

modify code stype and spelling

add tests and modify code style
2023-09-27 17:03:53 +08:00
JackyWoo
f3bf1f8da9 Fix code style 2023-09-27 12:56:06 +08:00
Alexey Milovidov
9518f68683
Merge pull request #54976 from vitlibar/use-pregenerated-grpc-protocol-pb2
Use pregenerated gRPC protocol pb2 files to fix test flakyness.
2023-09-26 23:09:34 +03:00
Han Fei
4e7745f757 Merge branch 'master' into hanfei/statistic 2023-09-26 21:43:53 +02:00
Vitaly Baranov
d39bd7154f Use pregenerated gRPC protocol pb2 files to fix test flakyness. 2023-09-26 17:28:19 +02:00
Robert Schulze
d24130092b
Fix spelling 2023-09-25 17:08:42 +00:00
vdimir
70ae994e77
Merge pull request #54935 from ucasfl/hamming-distance
Add several string distance functions
2023-09-25 17:06:16 +02:00
Priyansh Agrawal
f27a76b923 Add function byteSwap.
byteSwap accepts an integer `operand` and returns the integer which is
obtained by swapping the **endianness** of `operand` i.e. reversing the
bytes of the `operand`.

Issue: #54734
2023-09-24 21:02:09 +01:00
flynn
661ba85865 add more functions 2023-09-23 17:17:35 +00:00
flynn
76bc7cf75b fix spell check 2023-09-23 04:14:21 +00:00
Robert Schulze
9a91f97ac4
Merge pull request #53831 from rschu1ze/clang-17
Switch CI to Clang 17
2023-09-22 12:28:35 +02:00
Han Fei
17243b84ab Merge branch 'master' into hanfei/statistic 2023-09-19 17:09:17 +02:00
Robert Schulze
d31a43a379
Remove Woboq 2023-09-18 17:44:04 +00:00
Yarik Briukhovetskyi
472d4d9503
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-09-18 20:01:29 +03:00
Robert Schulze
b583b80733
Fix spelling 2023-09-18 07:43:06 +00:00
Robert Schulze
40e272521b
Fix spell check 2023-09-18 07:43:03 +00:00
Robert Schulze
f5e8028bb1
Merge pull request #54642 from rschu1ze/broken-re2st
Remove broken lockless variant of re2
2023-09-17 15:30:57 +02:00
Andrey Zvonov
9e89055990
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-15 17:06:22 +03:00
Robert Schulze
3935c2bfb2
Merge pull request #54509 from rschu1ze/yyyymmdd
Add YYYYMMDD[hhmmss]to[Date, Date32, DateTime, DateTime64]()
2023-09-15 15:47:34 +02:00
Robert Schulze
7b378dbad3
Remove broken lockless variant of re2 2023-09-14 16:40:42 +00:00
Sergei Trifonov
12c71be9ca
Merge branch 'master' into async-loader-integration 2023-09-14 15:29:07 +02:00
Yarik Briukhovetskyi
9a40d517bf
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-09-14 14:05:40 +03:00
serxa
f2900e92c3 fix spell check 2023-09-14 10:46:07 +00:00
Andrey Zvonov
ff16ddbbb3
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-14 11:31:49 +03:00
Nikolay Degterinsky
140a466a1e
Merge pull request #54400 from evillique/adddate-function
Add `addDate` function for compatibility with MySQL
2023-09-13 18:59:26 +02:00
Itay Israelov
69ba32940e fix comments: rname randomSampleFromArray --> arrayRandomSample 2023-09-13 13:11:53 +03:00
Nikolay Degterinsky
e648646598 Fixes 2023-09-12 23:11:58 +00:00
Robert Schulze
27ac4be8e2
Fix style 2023-09-11 15:30:06 +00:00
Robert Schulze
49f29861a0
Merge pull request #54479 from rschu1ze/todayssinceyearzero
Add function toDaysSinceYearZero()
2023-09-11 17:05:28 +02:00
Robert Schulze
b72a49f090
Fix style 2023-09-11 06:32:14 +00:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
Han Fei
f9abf16441 fix fast tests 2023-09-10 02:02:01 +02:00
Andrey Zvonov
ff4586e663
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-08 18:17:06 +02:00
Andrey Zvonov
80aea109b2
Update aspell-dict.txt 2023-09-08 12:49:15 +03:00
Nikolay Degterinsky
9a3ea9d6dc Fix style 2023-09-07 11:31:09 +00:00
serxa
d11a9b4175 update spell dict 2023-09-07 08:51:35 +00:00
Joey Wang
872f981416 add doc 2023-09-07 16:19:17 +08:00
Mikhail Koviazin
f98007a4ed
Replace Turbo-Base64 with aklomp/base64
Closes #31643
2023-09-06 13:01:38 +00:00
Robert Schulze
b004aa8076
Fix style 2023-09-05 19:55:11 +00:00
Alexey Milovidov
b2821106fd
Merge pull request #53923 from myrrc/docs/ch-disks
Add docs for clickhouse-disks
2023-09-05 02:10:18 +03:00
robot-clickhouse-ci-1
ec628ee697
Merge pull request #54097 from bharatnc/ncb/decode-html-component
add function decodeHTMLComponent
2023-09-04 05:00:52 +02:00
Yarik Briukhovetskyi
965acddc46
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-09-01 10:57:39 +03:00
Bharat Nallan Chakravarthy
f6d1f6ce0a fix style check 2023-08-30 22:09:56 -07:00
Mike Kot
8b1e30d774 fix 2023-08-29 13:36:47 +00:00
Sergei Trifonov
c10e42ca05
Merge branch 'master' into async-loader-integration 2023-08-28 20:20:31 +02:00
Andrey Zvonov
911bf94fbd
Merge branch 'master' into zvonand-globs-small-fix 2023-08-25 23:50:07 +05:00
vdimir
50b8bbe0dc
Merge pull request #53557 from mkmkme/mkmkme/array-shift-rotate
Added functions `array{Rotate,Shift}{Left,Right}`
2023-08-25 13:24:31 +02:00
Yarik Briukhovetskyi
72958343ce
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-08-24 12:58:40 +03:00