Commit Graph

2508 Commits

Author SHA1 Message Date
Michael Kolupaev
673743e2ac Fix some of the CI 2023-12-27 20:24:55 +00:00
Sema Checherinda
617ee5abaf
Merge pull request #57551 from bharatnc/ncb/async-metrics-pri-key-size
add asynchronous metrics for total primary key size in memory and allocated
2023-12-27 20:24:20 +01:00
Alexey Milovidov
d0ca383bca
Merge pull request #58095 from azat/metrics/max-rss
Add max/peak RSS into system.asynchronous_metrics
2023-12-23 13:13:44 +01:00
Azat Khuzhin
74ea601dc2 Add documentation for MemoryResidentMax metric in system.asynchronous_metrics
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-22 18:38:44 +01:00
Bharat Nallan Chakravarthy
62b28d365c Merge with upstream/master 2023-12-21 17:04:25 -08:00
robot-clickhouse
547050d41b Update version_date.tsv and changelogs after v23.11.3.23-stable 2023-12-21 08:44:28 +00:00
jinjunzh
372de8a046 refine patch 2023-12-20 10:12:24 -05:00
Robert Schulze
ecb6f31211
Merge pull request #57969 from rschu1ze/punycode-is-cool
Implement punycode encoding/decoding
2023-12-20 10:20:34 +01:00
Kruglov Pavel
087946f385
Merge branch 'master' into variant-data-type 2023-12-20 00:40:18 +01:00
robot-ch-test-poll3
39b77ddc02
Merge pull request #56138 from crackhead-koala/add-documentation-for-sample-size-functions
Add documentation for minSampleSizeConversion and minSampleSizeContinous
2023-12-19 23:19:55 +01:00
avogar
bd84799aec Fix style 2023-12-19 17:21:45 +00:00
Robert Schulze
00c407ecc1
Merge remote-tracking branch 'rschu1ze/master' into punycode-is-cool 2023-12-19 06:27:23 +00:00
Bharat Nallan Chakravarthy
aef4e2e6ec Merge upstream/master into ncb/async-metrics-pri-key-size 2023-12-18 09:46:51 -08:00
Robert Schulze
29d70c12f6
Fix CI checks 2023-12-18 10:47:40 +00:00
Raúl Marín
2639d0715f Merge remote-tracking branch 'blessed/master' into log_message_string 2023-12-18 10:40:18 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904)
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
2023-12-18 09:07:22 +01:00
Sergei Trifonov
3634b949a8
Merge pull request #57793 from ClickHouse/rename-system-table
Rename `system.async_loader` into `system.asynchronous_loader`
2023-12-16 17:33:04 +01:00
Raúl Marín
b269f87f4c Better text_log with ErrnoException 2023-12-15 19:27:56 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)"
This reverts commit 7844fcc196.
2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317)
* CI with digests to tag docker images, reuse builds, reuse tests and others
2023-12-15 15:21:20 +01:00
Julia Kartseva
7a5b40563a
Merge pull request #57574 from ClibMouse/dev-seriesPeriodDetect
Revert "Revert "Implemented series period detect method using pocketfft lib""
2023-12-14 21:10:23 -08:00
jinjunzh
606a494447 add dictionary 2023-12-13 12:53:53 -05:00
robot-clickhouse
30e6797c7e Update version_date.tsv and changelogs after v23.11.2.11-stable 2023-12-13 17:19:14 +00:00
serxa
57d7a58dbe Rename system.async_loader into system.asynchronous_loader 2023-12-12 16:55:27 +00:00
Kruglov Pavel
3b1ffbd77c
Merge branch 'master' into schema-inference-union 2023-12-11 18:59:15 +01:00
Robert Schulze
d24f389a0a
Fix spelling 2023-12-11 11:28:38 +00:00
avogar
ee7af95bc0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-12-08 20:29:28 +00:00
Bhavna Jindal
1f58b0f150
Merge branch 'master' into dev-seriesPeriodDetect 2023-12-08 10:26:39 -05:00
robot-clickhouse
2d134fd120
Merge pull request #57612 from danipozo/fix-reading-s3-script-backupview
Fix parsing virtual hosted S3 URI in clickhouse_backupview script
2023-12-08 10:17:12 +01:00
hdhoang
fc8292182c
fix typo TKSV
correct name is TS-KV
2023-12-07 20:19:00 +07:00
Dani Pozo
7ac4e83acc Fix parsing virtual hosted S3 URI 2023-12-07 12:32:32 +01:00
Robert Schulze
0159a4d4a2
Merge pull request #57512 from rschu1ze/revert-revert-sqid
Revert "Revert "Add `sqid()` function""
2023-12-07 10:26:02 +01:00
robot-clickhouse
2bd0888966 Update version_date.tsv and changelogs after v23.11.1.2711-stable 2023-12-06 23:05:48 +00:00
Bhavna Jindal
dad268c33b Revert "Revert "Implemented series period detect method using pocketfft lib""
This reverts commit d7d83c99e5.
2023-12-06 13:31:49 -08:00
Bharat Nallan Chakravarthy
41b2b63cee add docs 2023-12-05 18:50:36 -08:00
Robert Schulze
f56dd6561f
Merge remote-tracking branch 'rschu1ze/master' into revert-revert-sqid 2023-12-05 18:41:10 +00:00
Alexey Milovidov
d7d83c99e5
Revert "Implemented series period detect method using pocketfft lib" 2023-12-05 18:17:07 +03:00
Alexey Milovidov
2988f6f92a
Revert "Add new aggregation function groupArraySorted()" 2023-12-05 15:31:17 +03:00
Robert Schulze
a2cd240317
Revert "Revert "Add sqid() function""
This reverts commit 8d5d0ef38f.
2023-12-05 10:50:30 +00:00
Alexey Milovidov
8d5d0ef38f
Revert "Add sqid() function" 2023-12-05 13:45:33 +03:00
Alexey Milovidov
cbea3545aa
Revert "add function getClientHTTPHeader" 2023-12-05 13:34:34 +03:00
Alexey Milovidov
02439eee58
Merge pull request #49351 from ClickHouse/async-loader-integration
Asynchronous loading of tables
2023-12-04 17:16:12 +01:00
Robert Schulze
f6036fbb29
Some fixups 2023-12-03 16:20:59 +00:00
Kruglov Pavel
575ee1e665
Merge pull request #56868 from zvonand/zvonand-fileCluster
Introduce `fileCluster` table function
2023-11-30 13:49:53 +01:00
Nikolai Kochetov
024f41888e
Merge pull request #53562 from yariks5s/group_sorted_array_function
Add new aggregation function groupArraySorted()
2023-11-29 17:52:01 +01:00
zvonand
c329e382ab resolve conflicts 2023-11-29 16:03:07 +01:00
Han Fei
6733438adc Merge branch 'master' into hanfei/statistic 2023-11-28 16:35:00 +01:00
zvonand
c306d21b54 merge master + resolve conflicts 2023-11-28 15:51:21 +01:00
Antonio Andelic
a61f32867e
Merge pull request #56488 from lingtaolf/feature/getHTTPHeader
add function getClientHTTPHeader
2023-11-28 11:41:56 +01:00
Robert Schulze
1448276bae
Merge pull request #55872 from azat/hour-no-leading-zero
Add ability to parse hours/months without leading zeros
2023-11-28 11:07:00 +01:00
Ubuntu
a85cf758b0 Fuzz JSON table function
Create a table function `fuzzJSON`

An example query:
```
CREATE NAMED COLLECTION json_fuzzer AS json_str={};

SELECT *
FROM fuzzJSON(json_fuzzer, json_str = '{"students" : ["Alice", "Bob"]}', random_seed = 666, max_output_length = 128, probability = 0.9)
LIMIT 3

Query id: 7f802052-efb0-41b4-87fa-03b7dd290e9d

┌─json──────────────────────────────────────────────────────────────────────────────────┐
│ {"ade0yX":[9200406572736542991, true, "sm"]}                                          │
│ {"students":["Alice", "eSN3WO#a6NYTBe0$#OWwyIQ"], "cVoP2BuQugQ":17384271928263249403} │
│ {"students":["Alice", "Bob", "T+-k4+PJGkL%XRRaF2BoeN@&A"]}                            │
└───────────────────────────────────────────────────────────────────────────────────────┘
```

Next step:
* Generate invalid string

Fixes #35962

add Object('json')

use named collection
2023-11-28 01:58:24 +00:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
Azat Khuzhin
3ab1d4ae68 Add "formatters" into spell excludes
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-27 14:42:03 +01:00
Nikolay Degterinsky
de0876ed68
Merge pull request #57234 from evillique/fix-docs-anchors
Fix docs
2023-11-27 01:22:43 +01:00
Nikolay Degterinsky
124fae7549 Fix style 2023-11-26 23:58:34 +00:00
Nikolay Degterinsky
dd49b46ca5 Fix style 2023-11-26 22:32:11 +00:00
Robert Schulze
5b7d2a903d
Merge pull request #57152 from rschu1ze/fine-granular-plan-opt-settings
Fine-granular enablement/disabling of plan-level optimizations
2023-11-25 20:44:23 +01:00
robot-clickhouse
2bb12386dd Update version_date.tsv and changelogs after v23.9.6.20-stable 2023-11-25 18:37:17 +00:00
Mikhail f. Shiryaev
57445d46cc
Slightly improve the generator readbility 2023-11-24 20:23:11 +01:00
Robert Schulze
ace830a618
Fix spelling 2023-11-23 22:56:40 +00:00
Alexey Milovidov
10d5ba57e8
Merge pull request #57124 from azat/build/split-HashedDictionary-CU
Split HashedDictionary CU
2023-11-23 23:14:47 +01:00
Yarik Briukhovetskyi
69205769d0
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-11-23 20:23:47 +01:00
Alexey Milovidov
ac1e742afa
Merge pull request #57108 from azat/build/large-objects
Allow HashedDictionary/FunctionsConversion as large TU
2023-11-23 15:00:59 +01:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
Azat Khuzhin
cf3cd099a5 Split HashedDictionary CU
Before HashedDictionary.cpp exceeds 50MiB, now:

    -rw-r--r-- 1 azat azat  37M Nov 22 17:56 SparseHashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat  34M Nov 22 17:56 HashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat 716K Nov 22 17:56 registerHashedDictionary.cpp.o

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 19:00:40 +01:00
Azat Khuzhin
4925cb7eda Allow HashedDictionary/FunctionsConversion as large TU
In case of -DOMIT_HEAVY_DEBUG_SYMBOLS=OFF they are large.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 16:39:54 +01:00
zvonand
5153798aeb Introduced fileCluster table function
Added fileCluster function
Added test and docs
2023-11-22 15:06:04 +01:00
Bhavna Jindal
3731d57dd5 added method name in aspell-dict 2023-11-21 06:52:48 -08:00
凌涛
e86aa433c5
Merge branch 'master' into feature/getHTTPHeader 2023-11-21 19:48:47 +08:00
凌涛
c5f16725ec add function getClientHTTPHeader 2023-11-21 11:12:01 +08:00
Alexey Milovidov
6a1955cb34 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-useless-install 2023-11-20 21:34:31 +01:00
Mikhail f. Shiryaev
94824a0194
Fix shellcheck for time-trace 2023-11-20 15:15:37 +01:00
avogar
872556a5d4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:03:36 +00:00
Alexey Milovidov
241cc2abf4 Merge branch 'master' into remove-useless-install 2023-11-20 01:12:08 +01:00
serxa
9023f61349 Merge branch 'master' into async-loader-integration 2023-11-19 13:05:58 +00:00
Alexey Milovidov
d56cbda185 Add metrics for the number of queued jobs, which is useful for the IO thread pool 2023-11-18 19:07:59 +01:00
robot-clickhouse
af2f06db52 Update version_date.tsv and changelogs after v23.9.5.29-stable 2023-11-17 11:12:16 +00:00
Andrey Zvonov
fc15b0c1e7
Merge branch 'ClickHouse:master' into zvonand-more-globs 2023-11-16 11:19:12 +01:00
Vitaly Baranov
946e02ecbc
Merge pull request #56268 from vitlibar/add-script-backup-view
Add an external utility to view backups and to extract information from them
2023-11-16 11:17:16 +01:00
Vitaly Baranov
21a283049c Add the test for clickhouse_backupview to CI. 2023-11-15 17:40:53 +01:00
zvonand
20163e6aba add globbing to aspell-ignore 2023-11-15 16:37:24 +01:00
Alexey Milovidov
2791a95214 Merge branch 'master' into linker-time-trace 2023-11-15 07:44:02 +01:00
Alexey Milovidov
ed7d1dbb82 Pick up linker's trace files 2023-11-15 07:43:55 +01:00
Alexey Milovidov
e32f6e5556
Merge branch 'master' into remove-orphan-headers 2023-11-14 09:23:19 +01:00
Alexey Milovidov
9bf62dd622 Remove orphan header files 2023-11-14 07:43:11 +01:00
Alexey Milovidov
4e3e8e32fd Remove more garbage 2023-11-14 07:24:41 +01:00
Alexey Milovidov
d7df884cbb Merge branch 'master' into filter-large-translation-units 2023-11-13 19:31:13 +01:00
Alexey Milovidov
c1bba6ea4a Merge branch 'master' into filter-large-translation-units 2023-11-13 17:54:02 +01:00
Mikhail f. Shiryaev
88e04579fd
Add a simple validator for reusable workflows 2023-11-13 12:49:32 +01:00
Vitaly Baranov
a4d57fe108 Rename the name of the utility "backupview" -> "clickhouse_backupview". 2023-11-13 10:15:37 +01:00
Vitaly Baranov
f12b95df7d Add documentation. 2023-11-13 09:43:06 +01:00
Alexey Milovidov
225c78681e Merge branch 'master' into collect-binary-size 2023-11-13 04:00:25 +01:00
Vitaly Baranov
6807e52d2c Use S3(*args) to simplify conditions in __parse_location(). 2023-11-12 23:54:27 +01:00
Vitaly Baranov
8a8afc54fc Improve the test. 2023-11-12 23:54:23 +01:00
Vitaly Baranov
e67dfc7e04 Add a script to view backups and to extract information from them. 2023-11-12 23:42:38 +01:00
Robert Schulze
3f49e1c5ed
Merge remote-tracking branch 'rschu1ze/master' into pcg 2023-11-12 11:43:19 +00:00
Alexey Milovidov
63a1671054 Collect information about binary sizes to the CI database 2023-11-12 04:04:09 +01:00
Alexey Milovidov
6c30aa121c Collect information about binary sizes to the CI database 2023-11-12 04:01:59 +01:00
Alexey Milovidov
75b98b65dd Merge branch 'master' into filter-large-translation-units 2023-11-11 00:43:58 +01:00
robot-clickhouse
9ac7159a93 Update version_date.tsv and changelogs after v23.10.3.5-stable 2023-11-10 21:07:22 +00:00
Alexey Milovidov
96f73139b6 Check for large translation units 2023-11-10 06:13:55 +01:00
Antonio Andelic
e9542e4153
Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol
Support compression for keeper protocol
2023-11-09 10:00:19 +01:00
robot-clickhouse
bc4de36e51 Update version_date.tsv and changelogs after v23.9.4.11-stable 2023-11-08 15:36:31 +00:00
Robert Schulze
38c76eb709
Merge remote-tracking branch 'rschu1ze/master' into pcg 2023-11-08 09:43:27 +00:00
Robert Schulze
180eca7337
Restore check-style 2023-11-08 09:36:43 +00:00
Robert Schulze
e46dbcb2f1
Use pcg/randomSeed() random generator/seed instead of std::mt19937/std::random_device 2023-11-07 18:54:50 +00:00
Robert Schulze
86b8ebf71c
Merge remote-tracking branch 'rschu1ze/master' into arrayRandomSample-improved 2023-11-07 15:25:29 +00:00
serxa
19aa1375fc Merge branch 'master' into async-loader-integration 2023-11-07 10:25:38 +00:00
Robert Schulze
54b5d573d7
Merge remote-tracking branch 'rschu1ze/master' into idatatype-convenience-functions 2023-11-07 10:18:30 +00:00
Robert Schulze
e22c673299
Revert "Revert "Add function arrayRandomSample()""
This reverts commit e47e50e30d.
2023-11-07 10:16:13 +00:00
vdimir
2de73d3456
Merge pull request #56394 from ClickHouse/vdimir/check_doc_file
Option to check particular file with utils/check-style/check-doc-aspell
2023-11-07 10:34:16 +01:00
Antonio Andelic
f06d3b29be
Merge pull request #56360 from ClickHouse/add-logs-in-decompressor
Print info while decompressing the binary
2023-11-07 09:36:29 +01:00
robot-clickhouse
25558fe0a6
Merge pull request #56390 from ClickHouse/vdimir/doc_architecture_upd_streams
Update development documentation about data streams
2023-11-07 00:54:31 +01:00
Alexey Milovidov
e47e50e30d
Revert "Add function arrayRandomSample()" 2023-11-07 02:49:11 +03:00
Robert Schulze
b195cba943
Fix spelling 2023-11-06 20:11:55 +00:00
vdimir
941ece31e1
Option to check particular file with utils/check-style/check-doc-aspell 2023-11-06 19:25:07 +00:00
vdimir
a091f0323e
Update aspell-dict.txt 2023-11-06 19:16:49 +00:00
Smita Kulkarni
3d5f7a65a8 Updated protocol_version and keeper-bench 2023-11-06 15:00:56 +01:00
serxa
6babc8e934 rename metrics for new pools to match settings 2023-11-06 12:24:00 +00:00
vdimir
3b775dee53
Merge pull request #55126 from ClickHouse/vdimir/jaccard_index_perf
Add function jaccardIndex back with better performance
2023-11-06 10:39:02 +01:00
Antonio Andelic
fce276c441 Print info while decompressing 2023-11-06 09:29:02 +00:00
Alexander Gololobov
af469cecb6
Merge pull request #56267 from ClickHouse/diag_stack_addr
Print stack trace addresses in clickhouse-diagnostics
2023-11-06 10:01:08 +01:00
Robert Schulze
480e284db1
Merge pull request #56088 from jh0x/feature-from-days-zero
Add function `fromDaysSinceYearZero()`
2023-11-04 00:17:04 +01:00
robot-clickhouse
a8aa32fd3d Update version_date.tsv and changelogs after v23.10.1.1976-stable 2023-11-02 19:34:42 +00:00
Alexander Gololobov
f21e294330 Update readme 2023-11-02 16:04:54 +01:00
Alexander Gololobov
c1aa49122f Collect addresses in stack traces 2023-11-02 15:56:27 +01:00
vdimir
f7ac4367d7
Add stringJaccardIndex to aspell-dict.txt 2023-11-02 11:37:51 +00:00
Denny Crane
d145ddb293 fix asell 2023-11-02 00:01:42 +01:00
Joanna Hulboj
757dc8b944 Fix typos, add to/fromDaysSinceYearZero to fuzz 2023-11-01 17:48:58 +00:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
Kruglov Pavel
bf77ce691c
Merge pull request #55982 from yariks5s/npy_input_format
New input format Npy
2023-11-01 14:26:22 +01:00
Nikolay Degterinsky
cd779d4f50
Merge pull request #55856 from ClickHouse/rewrite-delete-docs
Rewrite DELETE docs
2023-11-01 00:10:01 +01:00
Nikolay Degterinsky
7738f3aecb
Update aspell-dict.txt 2023-10-31 23:29:27 +01:00
Sergey Suvorov
0a5888b6f8 Add new function names to aspell-dict.txt 2023-10-31 17:04:37 +01:00
Justin de Guzman
a011990fd7
Add clangd recommendation for VS Code (#56071)
* Add clangd recommendation for VS Code

* Edit docs for clarity and add links

* Adds new words to dictionary. Sorts dictionary.

---------

Co-authored-by: johnnymatthews <9611008+johnnymatthews@users.noreply.github.com>
2023-10-31 16:35:47 +01:00
robot-clickhouse
3d2e295855 Update version_date.tsv and changelogs after v23.8.5.16-lts 2023-10-31 00:58:27 +00:00
avogar
7eefb72c53 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-10-30 19:44:26 +00:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Alexey Milovidov
6eff22568f
Revert "Add function getHttpHeader" 2023-10-29 19:50:39 +03:00
Kruglov Pavel
bb4b95e891
Merge branch 'master' into schema-inference-union 2023-10-27 14:53:58 +02:00
Sergei Trifonov
a5d7c2b6a2
Merge branch 'master' into async-loader-integration 2023-10-27 10:39:12 +02:00
Robert Schulze
325ff33c3a
Merge pull request #55239 from aiven-sal/aiven-sal/format_query
Add formatQuery function
2023-10-26 22:46:01 +02:00
Kruglov Pavel
570b66f027
Merge branch 'master' into schema-inference-union 2023-10-26 19:26:00 +02:00
Salvatore Mesoraca
56bd61d207
Rename formatQueryOneLine -> formatQuerySingleLine 2023-10-26 13:09:20 +02:00
Anton Popov
6ba59b8408
Merge pull request #54364 from Joeywzr/master
Support jsonMerge function
2023-10-25 15:27:16 +02:00
yariks5s
a1b9ab5877 added spelling 2023-10-25 10:52:37 +00:00
Salvatore Mesoraca
0bda99e880
Fix code style 2023-10-25 11:07:34 +02:00
Salvatore Mesoraca
6be7fd0fa1
Ignore formatQuery word during spell check 2023-10-24 15:38:24 +02:00
Kruglov Pavel
64e5797fc8
Update aspell-dict.txt 2023-10-24 14:30:26 +02:00
serxa
749cdb9954 Merge branch 'master' into async-loader-integration 2023-10-24 10:09:49 +00:00
Robert Schulze
bef5cea5a0
Merge remote-tracking branch 'rschu1ze/master' into string-addinterval 2023-10-23 14:08:18 +00:00
Denny Crane
38a3655c5e add fibonacci to aspell 2023-10-23 10:09:06 +01:00
Alexander Tokmakov
f899254e2c
Merge pull request #55430 from arthurpassos/properly_split_remote_proxy_http_https
Properly split remote proxy http https
2023-10-20 21:15:34 +02:00
Robert Schulze
3551d7f2d6
Update docs 2023-10-20 15:46:17 +00:00
helifu
57d60dc4f2
Add a new column xid for zookeeper_connection (#50702)
* Refactor the code

* Add a new column xid for zookeeper_connection

* Support hostnames in the configuration

* Fix a typo

* Fix a typo

* Fix a typo

* Fix a bug about connect_time

* Update test case

* Update test case

* Fix a special build check error

* Resolve conflicts caused by rebase.

* Update failed test case

* Refactor the code according to comment

* Fix two compilation errors
2023-10-20 11:38:44 +02:00
robot-clickhouse
84f2d46642 Update version_date.tsv and changelogs after v23.3.14.78-lts 2023-10-19 18:18:34 +00:00
Sinan
c7f78ac73a
Add aggregation function for Largest-Triangle-Three-Buckets (#53145)
* Added a simple lttb aggregate function

* Added support for multiple datatypes

* Added support for Date and Date32, updated LTTBData struct

* Updated code to handle bucket size 0 and 1

* Added sort for LTTBData

* Added tests and documentation

* Added some code style fixes

* Added function to new func ref file

* Removed function from new func ref file

* Apply suggestions from code review

* Updated unit tests

* updated LTTB data code

* Minor style fixes

* Updated code with std sort

* updated tests

* Renamed lttb to largestTriangleThreeBuckets

* Added alias lttb

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-10-18 14:47:18 +02:00
Han Fei
4b23142775
Merge branch 'master' into hanfei/statistic 2023-10-17 16:40:31 +02:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450)
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
2023-10-16 17:00:07 -07:00
serxa
0e17da22eb Merge branch 'master' into async-loader-integration 2023-10-16 11:08:29 +00:00
Alexander Tokmakov
e40aa72883
Merge pull request #54826 from JackyWoo/lb_nearest_host_name
Add load balancing hostname_levenshtein_distance
2023-10-13 17:23:02 +02:00
Robert Schulze
d02a718076
Merge pull request #55211 from Priyansh121096/master
Add function byteSwap
2023-10-13 16:54:28 +02:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
Kruglov Pavel
3eb093d177
Fix style 2023-10-12 14:32:26 +02:00
robot-clickhouse-ci-2
2eedb31ae3
Merge pull request #55498 from bytadaniel/patch-4
add npm packages to both en and zh docs from ru
2023-10-12 11:31:24 +02:00
JackyWoo
1f553f3d65 Merge branch 'master' into lb_nearest_host_name 2023-10-12 10:19:17 +08:00
Daniel Byta
e3719f88b2
Update aspell-dict.txt 2023-10-11 20:42:49 +03:00
Arthur Passos
eca411ec92 that it? 2023-10-10 13:14:41 -03:00
Memo
b7f70c2ba3 Merge branch 'master' into master 2023-10-10 20:08:41 +08:00
Joey Wang
06a7b679f6 support merging of nested paths 2023-10-10 14:57:37 +08:00
凌涛
51e2e59a97 Merge remote-tracking branch 'origin/master' into feature/function-getClientHttpHeader 2023-10-10 10:56:24 +08:00
Han Fei
fcb19b4f77 Merge branch 'master' into hanfei/statistic 2023-10-09 14:24:58 +02:00
Robert Schulze
624dbcdb4f
Merge pull request #49794 from Lirikl/arrayFold
Added function `arrayFold()`
2023-10-09 13:38:35 +02:00
Robert Schulze
07e0cc196d
Some fixups 2023-10-08 20:27:13 +00:00
Priyansh Agrawal
2c04370e5f Use std::byteswap instead of custom implementations.
- Also allow signed ints now because std::byteswap accepts them.
- Fix for style check.
2023-10-07 23:59:24 +00:00
Robert Schulze
73ff017fb5
Merge remote-tracking branch 'rschu1ze/master' into israelov/generate-random-int-array 2023-10-07 18:10:09 +00:00
JackyWoo
784fe880eb Merge branch 'master' into lb_nearest_host_name 2023-10-07 09:04:26 +08:00
Alexey Milovidov
9aaab27373
Merge pull request #55120 from ClickHouse/fix-functions-in-docs
Fix function names in docs
2023-09-30 00:36:39 +03:00
Alexey Milovidov
458cbb3b18 Fix function names in docs 2023-09-29 10:15:46 +02:00
robot-clickhouse
485422328d Update version_date.tsv and changelogs after v23.9.1.1854-stable 2023-09-29 07:04:45 +00:00
Robert Schulze
2d750e9e2f
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-reenable-checks 2023-09-27 12:15:29 +00:00
凌涛
0d256a381a add doc
fix tests

modify code stype and spelling

add tests and modify code style
2023-09-27 17:03:53 +08:00
JackyWoo
f3bf1f8da9 Fix code style 2023-09-27 12:56:06 +08:00
Alexey Milovidov
9518f68683
Merge pull request #54976 from vitlibar/use-pregenerated-grpc-protocol-pb2
Use pregenerated gRPC protocol pb2 files to fix test flakyness.
2023-09-26 23:09:34 +03:00
Han Fei
4e7745f757 Merge branch 'master' into hanfei/statistic 2023-09-26 21:43:53 +02:00
Robert Schulze
cde10fe7b5
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-reenable-checks 2023-09-26 18:59:41 +00:00
Vitaly Baranov
d39bd7154f Use pregenerated gRPC protocol pb2 files to fix test flakyness. 2023-09-26 17:28:19 +02:00
Robert Schulze
e4c081652d
Suppress more checks 2023-09-26 11:01:35 +00:00
Robert Schulze
d24130092b
Fix spelling 2023-09-25 17:08:42 +00:00
vdimir
70ae994e77
Merge pull request #54935 from ucasfl/hamming-distance
Add several string distance functions
2023-09-25 17:06:16 +02:00
Priyansh Agrawal
f27a76b923 Add function byteSwap.
byteSwap accepts an integer `operand` and returns the integer which is
obtained by swapping the **endianness** of `operand` i.e. reversing the
bytes of the `operand`.

Issue: #54734
2023-09-24 21:02:09 +01:00
flynn
661ba85865 add more functions 2023-09-23 17:17:35 +00:00
flynn
76bc7cf75b fix spell check 2023-09-23 04:14:21 +00:00
Robert Schulze
9a91f97ac4
Merge pull request #53831 from rschu1ze/clang-17
Switch CI to Clang 17
2023-09-22 12:28:35 +02:00
Robert Schulze
7b585da613
Fix clang-tidy 2023-09-22 10:12:11 +00:00
Robert Schulze
f5137dd0b4
More clang-tidy fixes 2023-09-21 14:40:57 +00:00
Robert Schulze
50c51c2854
Fix new clang-tidy-s 2023-09-20 22:17:39 +00:00
Han Fei
17243b84ab Merge branch 'master' into hanfei/statistic 2023-09-19 17:09:17 +02:00
Robert Schulze
d31a43a379
Remove Woboq 2023-09-18 17:44:04 +00:00
Yarik Briukhovetskyi
472d4d9503
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-09-18 20:01:29 +03:00
Robert Schulze
b583b80733
Fix spelling 2023-09-18 07:43:06 +00:00
Robert Schulze
40e272521b
Fix spell check 2023-09-18 07:43:03 +00:00
Robert Schulze
f5e8028bb1
Merge pull request #54642 from rschu1ze/broken-re2st
Remove broken lockless variant of re2
2023-09-17 15:30:57 +02:00
Andrey Zvonov
9e89055990
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-15 17:06:22 +03:00
Robert Schulze
3935c2bfb2
Merge pull request #54509 from rschu1ze/yyyymmdd
Add YYYYMMDD[hhmmss]to[Date, Date32, DateTime, DateTime64]()
2023-09-15 15:47:34 +02:00
Robert Schulze
7b378dbad3
Remove broken lockless variant of re2 2023-09-14 16:40:42 +00:00
Sergei Trifonov
12c71be9ca
Merge branch 'master' into async-loader-integration 2023-09-14 15:29:07 +02:00
Yarik Briukhovetskyi
9a40d517bf
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-09-14 14:05:40 +03:00
Andrey Zvonov
7dd5dbb2ac
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-14 13:49:59 +03:00
serxa
f2900e92c3 fix spell check 2023-09-14 10:46:07 +00:00
Antonio Andelic
6306180333
Merge pull request #53049 from ClickHouse/keeper-batch-flushes
Try batching multiple flush requests in Keeper
2023-09-14 11:39:33 +02:00
Andrey Zvonov
ff16ddbbb3
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-14 11:31:49 +03:00
Alexey Milovidov
aaa7025b1a
Merge pull request #54603 from fionera/use-env
use env to find bash
2023-09-13 23:50:55 +03:00
Nikolay Degterinsky
140a466a1e
Merge pull request #54400 from evillique/adddate-function
Add `addDate` function for compatibility with MySQL
2023-09-13 18:59:26 +02:00
Tim Windelschmidt
7979090333 use env to find bash 2023-09-13 18:57:11 +02:00
Itay Israelov
69ba32940e fix comments: rname randomSampleFromArray --> arrayRandomSample 2023-09-13 13:11:53 +03:00
Nikolay Degterinsky
e648646598 Fixes 2023-09-12 23:11:58 +00:00
Robert Schulze
27ac4be8e2
Fix style 2023-09-11 15:30:06 +00:00
Robert Schulze
49f29861a0
Merge pull request #54479 from rschu1ze/todayssinceyearzero
Add function toDaysSinceYearZero()
2023-09-11 17:05:28 +02:00
Antonio Andelic
479ae52f9c Merge branch 'master' into keeper-batch-flushes 2023-09-11 11:36:23 +00:00
Robert Schulze
b72a49f090
Fix style 2023-09-11 06:32:14 +00:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
Han Fei
f9abf16441 fix fast tests 2023-09-10 02:02:01 +02:00
Andrey Zvonov
ff4586e663
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-08 18:17:06 +02:00
Antonio Andelic
5207997bd4 Merge branch 'master' into keeper-batch-flushes 2023-09-08 13:05:47 +00:00
Andrey Zvonov
80aea109b2
Update aspell-dict.txt 2023-09-08 12:49:15 +03:00
Nikolay Degterinsky
9a3ea9d6dc Fix style 2023-09-07 11:31:09 +00:00
serxa
d11a9b4175 update spell dict 2023-09-07 08:51:35 +00:00
Joey Wang
872f981416 add doc 2023-09-07 16:19:17 +08:00
Antonio Andelic
824b90f754 Merge branch 'master' into keeper-batch-flushes 2023-09-06 13:29:35 +00:00
Mikhail Koviazin
f98007a4ed
Replace Turbo-Base64 with aklomp/base64
Closes #31643
2023-09-06 13:01:38 +00:00
Robert Schulze
b004aa8076
Fix style 2023-09-05 19:55:11 +00:00
robot-clickhouse
3991c38765 Update version_date.tsv and changelogs after v23.3.13.6-lts 2023-09-05 13:08:25 +00:00
Alexey Milovidov
b2821106fd
Merge pull request #53923 from myrrc/docs/ch-disks
Add docs for clickhouse-disks
2023-09-05 02:10:18 +03:00
robot-clickhouse
0ca2c545e9 Update version_date.tsv and changelogs after v23.8.2.7-lts 2023-09-04 20:18:07 +00:00
Alexey Milovidov
a941a040e4
Merge pull request #54259 from ClickHouse/auto/v23.3.12.11-lts
Update version_date.tsv and changelogs after v23.3.12.11-lts
2023-09-04 20:42:29 +03:00
robot-clickhouse
5df95f2ed1 Update version_date.tsv and changelogs after v23.3.12.11-lts 2023-09-04 15:22:02 +00:00
Mikhail f. Shiryaev
a082167d85
Move ci-slack-bot from utils to tests/ci 2023-09-04 17:06:51 +02:00
Alexander Tokmakov
a663f7e06a
Update ci-slack-bot.py (#54253) 2023-09-04 15:39:09 +02:00
Antonio Andelic
365bc584ec Merge branch 'master' into keeper-batch-flushes 2023-09-04 07:24:21 +00:00
robot-clickhouse-ci-1
ec628ee697
Merge pull request #54097 from bharatnc/ncb/decode-html-component
add function decodeHTMLComponent
2023-09-04 05:00:52 +02:00
robot-clickhouse
cc03880bbd Update version_date.tsv and changelogs after v23.8.1.2992-lts 2023-09-01 16:00:28 +00:00
Yarik Briukhovetskyi
965acddc46
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-09-01 10:57:39 +03:00
Antonio Andelic
dd824fe558 Merge branch 'master' into keeper-batch-flushes 2023-08-31 14:35:36 +00:00
Bharat Nallan Chakravarthy
f6d1f6ce0a fix style check 2023-08-30 22:09:56 -07:00
Mike Kot
8b1e30d774 fix 2023-08-29 13:36:47 +00:00
Andrey Zvonov
6195390c77
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-08-29 13:46:09 +05:00
Sergei Trifonov
c10e42ca05
Merge branch 'master' into async-loader-integration 2023-08-28 20:20:31 +02:00
Antonio Andelic
4137cb916d Merge branch 'master' into keeper-batch-flushes 2023-08-28 13:14:06 +00:00
Andrey Zvonov
c9b0db9c61
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-08-28 17:15:33 +05:00
robot-clickhouse
fa1b5fe2a8 Update version_date.tsv and changelogs after v22.8.21.38-lts 2023-08-28 12:00:47 +00:00
robot-clickhouse
0e277d4f90 Update version_date.tsv and changelogs after v23.7.5.30-stable 2023-08-28 10:06:28 +00:00
Andrey Zvonov
911bf94fbd
Merge branch 'master' into zvonand-globs-small-fix 2023-08-25 23:50:07 +05:00
vdimir
50b8bbe0dc
Merge pull request #53557 from mkmkme/mkmkme/array-shift-rotate
Added functions `array{Rotate,Shift}{Left,Right}`
2023-08-25 13:24:31 +02:00
Yarik Briukhovetskyi
72958343ce
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-08-24 12:58:40 +03:00
Mikhail Koviazin
a5eb1aa22f
Added functions array{Rotate,Shift}{Left,Right}
Fixes #52755 and #52895
2023-08-24 09:16:39 +00:00
Antonio Andelic
322b53dd62 Merge branch 'master' into keeper-batch-flushes 2023-08-24 09:08:47 +00:00
Alexey Milovidov
d475dc424e
Merge pull request #53701 from ClibMouse/feature/qemu-s390x-docs
Update s390x VSCode environment setup
2023-08-23 18:29:45 +03:00
ltrk2
c2559026c4 Extend aspell dictionary 2023-08-23 06:22:11 -07:00
robot-clickhouse
0fc2a5b6f0 Update version_date.tsv and changelogs after v23.3.10.5-lts 2023-08-23 09:10:08 +00:00
Antonio Andelic
625be86dc0 Fix tests 2023-08-23 09:00:57 +00:00
Robert Schulze
a20ceef398
Merge pull request #53447 from davvard/master
USearch HNSW index for ANN search
2023-08-21 23:34:26 +02:00
Kruglov Pavel
47b551180b
Merge pull request #52117 from KevinyhZou/support_from_to_utc_timestamp
Support From/To UTC Timestamp function like spark
2023-08-21 13:16:57 +02:00
Yarik Briukhovetskyi
c6af1fd6c8
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-08-21 13:06:37 +03:00
robot-clickhouse
c54ff5d451 Update version_date.tsv and changelogs after v23.3.9.55-lts 2023-08-21 08:32:51 +00:00
kevinyhzou
48cb9b59f4 Support from/to utc timestamp 2023-08-21 09:28:00 +08:00
Yarik Briukhovetskyi
ed7d0fa4cc
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-08-19 01:50:56 +03:00
yariks5s
0406001f6e fixed style check 2023-08-18 18:07:37 +00:00
Robert Schulze
b711802c43
Fix spelling 2023-08-16 21:23:11 +00:00
Andrey Zvonov
413b0f227b
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-08-14 10:59:44 +03:00
Krisztián Szűcs
7135b344bf
Documentation: exclude PyArrow from spell checking 2023-08-14 08:49:11 +02:00
Andrey Zvonov
3d902e65e4
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-08-12 23:12:47 +03:00
Alexey Milovidov
67b45619eb
Merge pull request #53239 from evillique/tuple-concat
Add tupleConcat function
2023-08-12 03:35:25 +03:00
Andrey Zvonov
02c511a008
Merge branch 'master' into zvonand-globs-small-fix 2023-08-11 15:56:44 +02:00
zvonand
1983c7ce95 update docs 2023-08-11 16:53:17 +03:00
Alexey Milovidov
ae6e59c4c5
Merge pull request #53099 from ClickHouse/remove-wikistat-loader
Remove old util
2023-08-10 17:01:57 +03:00
Kruglov Pavel
14aad359e6
Merge pull request #52555 from bigo-sg/starts_ends_with_utf8
Add new function startsWithUTF8 and endsWithUTF8
2023-08-10 13:18:04 +02:00
Alexey Milovidov
8f2a0a5290
Merge branch 'master' into remove-wikistat-loader 2023-08-10 03:44:07 +03:00
Nikolay Degterinsky
8c63088a31 Fixes 2023-08-09 21:54:58 +00:00
Alexey Milovidov
964c407d48
Revert "Revert "Upload build time-trace data to CI database"" 2023-08-09 16:11:17 +03:00
Alexander Gololobov
63183c56f1
Revert "Upload build time-trace data to CI database" 2023-08-09 13:58:05 +02:00
Alexey Milovidov
98a2a117c2 Merge branch 'master' into remove-wikistat-loader 2023-08-08 22:36:21 +02:00
Alexey Milovidov
3ffffb0b5e
Merge pull request #53100 from ClickHouse/upload-build-profile
Upload build time-trace data to CI database
2023-08-08 23:33:50 +03:00
robot-clickhouse
fe7168c1c3 Update version_date.tsv and changelogs after v23.7.4.5-stable 2023-08-08 19:16:27 +00:00
李扬
d15ae5e120
Merge branch 'master' into starts_ends_with_utf8 2023-08-08 16:18:04 +08:00
Alexey Milovidov
8ce4ff0f95 Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile 2023-08-07 21:18:30 +02:00
Sergei Trifonov
f35c68623d
Merge branch 'master' into async-loader-integration 2023-08-07 11:24:19 +02:00
SmitaRKulkarni
75f81bdc44
Merge pull request #50795 from ClickHouse/azure_table_function_cluster
Table function azureBlobStorageCluster
2023-08-07 09:16:52 +02:00
Alexey Milovidov
d977e221b4 Upload build time-trace data to CI database 2023-08-07 03:26:59 +02:00
Alexey Milovidov
c3edb57953 Remove old util 2023-08-07 02:29:29 +02:00
robot-clickhouse
f65fa627e7 Update version_date.tsv and changelogs after v23.7.3.14-stable 2023-08-05 19:26:13 +00:00
SmitaRKulkarni
1e3ae89161
Merge branch 'master' into azure_table_function_cluster 2023-08-04 21:39:32 +02:00
Sergei Trifonov
432d359a2b
Merge branch 'master' into async-loader-integration 2023-08-04 18:51:06 +02:00
Anton Popov
92cb5e9ae3
Merge pull request #52687 from alkorgun/fix-named-collections-on-cluster-23.7
Fix named collections on cluster 23.7
2023-08-03 14:50:28 +02:00
robot-clickhouse
659c907d38 Update version_date.tsv and changelogs after v23.7.2.25-stable 2023-08-03 09:55:00 +00:00
Smita Kulkarni
2c47679918 Merge branch 'master' into azure_table_function_cluster 2023-08-02 14:19:45 +02:00
李扬
041af6899d
Merge branch 'master' into starts_ends_with_utf8 2023-08-02 10:29:29 +08:00
Alexander Zaitsev
107759aec8 doc: add ClickBench and AutoFDO to the aspell ignore list 2023-08-01 18:02:48 +02:00
Kruglov Pavel
8f6526a930
Merge branch 'master' into structure-to-schema 2023-08-01 16:22:14 +02:00
Vitaly Baranov
0a8b88eed2
Merge branch 'master' into print-backup-info 2023-08-01 13:15:23 +02:00
Sergei Trifonov
e4ae2ece7c
Merge branch 'master' into async-loader-integration 2023-08-01 13:04:11 +02:00
Alexey Milovidov
985b2a010a
Add a tool to upload -ftime-trace to ClickHouse (#52776)
* Add a tool to upload `-ftime-trace` to ClickHouse

* Add a tool to upload `-ftime-trace` to ClickHouse

* Add a tool to upload `-ftime-trace` to ClickHouse
2023-07-31 14:17:47 +02:00
Илья Коргун
9c5b96e26c Add "bugfix" to aspell-ignore 2023-07-30 09:37:19 +03:00
Alexey Milovidov
a4f2eea516 Maybe better 2023-07-30 02:19:39 +02:00
Alexey Milovidov
caa4590361 Merge branch 'master' into check-for-hiding-cyrillic-characters 2023-07-30 02:16:56 +02:00
Kruglov Pavel
3e1c409e60
Merge branch 'master' into structure-to-schema 2023-07-28 11:32:16 +02:00
robot-ch-test-poll
22e5da914c
Merge pull request #52650 from rschu1ze/query-cache-asynchronous_metrics
Add query cache metrics to SYSTEM.ASYNCHRONOUS_METRICS
2023-07-28 11:06:55 +02:00
李扬
d0c9425711
Merge branch 'master' into starts_ends_with_utf8 2023-07-28 10:03:39 +08:00
Kruglov Pavel
32d23b0904
Update aspell-dict.txt 2023-07-27 21:28:28 +02:00
Robert Schulze
9340f02d26
Silence spell check 2023-07-27 18:33:07 +00:00
Vitaly Baranov
faca843ac0 Add utility to parse a backup metadata file and print information about the backup. 2023-07-27 18:25:21 +02:00
robot-clickhouse
28c49e3f20 Update version_date.tsv and changelogs after v23.7.1.2470-stable 2023-07-27 13:47:11 +00:00
Alexey Milovidov
6aab4cc835 Check for unexpected cyrillic 2023-07-27 05:25:40 +02:00
Robert Schulze
d4737ca033
Merge pull request #50986 from arenadata/ADQM-822
Implement support of encrypted elements in configuration file
2023-07-26 12:27:04 +02:00
taiyang-li
d83eabcf77 fix spell 2023-07-26 17:39:45 +08:00
Nikita Mikhaylov
1dc9ca2c24
Merge pull request #52549 from ClickHouse/whitespace-before-comma
Check for punctuation
2023-07-25 20:30:36 +02:00
Yakov Olkhovskiy
e133db7937
Merge pull request #51472 from bigo-sg/substring_index
Add function substring_index, as in spark or mysql
2023-07-25 08:43:13 -04:00
taiyang-li
23897b823d fix code style 2023-07-25 20:41:16 +08:00
Alexey Milovidov
21382afa2b Check for punctuation 2023-07-25 06:10:04 +02:00
Roman Vasin
0af869ff0f
Merge branch 'master' into ADQM-822 2023-07-24 12:23:11 +03:00
robot-clickhouse-ci-2
66c0015b87
Merge pull request #52050 from arenadata/ADQM-982
Subsequence string matching (new hasSubsequence() function)
2023-07-23 21:18:27 +02:00
robot-ch-test-poll4
1d6e85da91
Merge pull request #52084 from valbok/conv-charsets
MaterializedMySQL: Introduce charset conversion
2023-07-23 18:36:30 +02:00
Alexey Milovidov
0b5730ffd0
Merge branch 'master' into fix-system-licenses 2023-07-22 17:53:46 +03:00
Sergei Trifonov
8eaf3b6d94
Merge branch 'master' into async-loader-integration 2023-07-21 21:46:06 +02:00
Antonio Andelic
10c2d5dade
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 13:24:18 +02:00
Antonio Andelic
4a47040763
Merge pull request #52358 from ClickHouse/fix-keeper-apply-snapshot
Fix `apply_snapshot` in Keeper
2023-07-21 12:52:12 +02:00
Alexander Tokmakov
c0aa3e4567
Update ci-slack-bot.py 2023-07-20 17:59:43 +03:00
Roman Vasin
8649c84461 Remove conditional linking 2023-07-20 13:28:37 +00:00
Alexander Tokmakov
3c9e46b557
Update ci-slack-bot.py 2023-07-20 16:19:12 +03:00
Antonio Andelic
53c46e2dff
Merge branch 'master' into fix-keeper-apply-snapshot 2023-07-20 14:37:32 +02:00
Alexey Milovidov
f4ec421292
Merge pull request #52106 from Lloyd-Pottiger/add-alias-for-today-and-now
Add alias for today(curdate/current_date) and now(current_timestamp)
2023-07-20 15:02:25 +03:00
Antonio Andelic
a24bf14450 Use correct ZXID 2023-07-20 10:44:44 +00:00
Kruglov Pavel
0fca64ced4
Merge pull request #51695 from Avogar/row-binary-with-defaults
Add RowBinaryWithDefaults format
2023-07-19 22:10:30 +02:00
Sergei Trifonov
b8a46ff822
Merge branch 'master' into async-loader-integration 2023-07-19 18:45:41 +02:00
alesapin
45a7134478
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-19 14:04:59 +02:00
vdimir
92f04d2c53
Merge pull request #52209 from mkmkme/mkmkme/first-line 2023-07-19 11:10:13 +02:00
SmitaRKulkarni
4456adfd4a
Merge branch 'master' into azure_table_function_cluster 2023-07-19 08:28:30 +02:00
Alexey Milovidov
3c1d881f84
Merge branch 'master' into fix-system-licenses 2023-07-18 23:01:43 +03:00
Song Liyong
6ae5207819 MaterializedMySQL: Introduce charset conversion 2023-07-18 15:55:55 +02:00
Lloyd-Pottiger
a58ace75a2
Merge branch 'master' into add-alias-for-today-and-now 2023-07-18 20:32:32 +08:00
Kruglov Pavel
6985bf0cdb
Merge branch 'master' into row-binary-with-defaults 2023-07-18 13:36:56 +02:00
robot-ch-test-poll2
d816d8b92f
Merge pull request #52198 from azat/qemu-compressor
Fix self extracting binaries under qemu linux-user (qemu-$ARCH-static)
2023-07-18 12:02:47 +02:00
Mikhail Koviazin
4f7fd69883
Added function firstLine to extract the first line from a multiline string
Fixes #51172
2023-07-18 12:18:26 +03:00
Lloyd-Pottiger
9d11385543
Merge branch 'master' into add-alias-for-today-and-now 2023-07-18 10:29:49 +08:00
Alexey Milovidov
f4e095b502
Merge pull request #52149 from ucasfl/array_concat_agg
Add array_concat_agg for compatibility with BigQuery
2023-07-18 03:03:27 +03:00
Sergei Trifonov
850ab23991
Merge branch 'master' into async-loader-integration 2023-07-17 19:14:54 +02:00
Kruglov Pavel
1e616e17ab
Merge branch 'master' into row-binary-with-defaults 2023-07-17 19:13:57 +02:00
SmitaRKulkarni
e4fb9e88f8
Merge branch 'master' into azure_table_function_cluster 2023-07-17 17:23:38 +02:00
vdimir
5de1cfee7d
Merge pull request #51735 from arenadata/ADQM-976 2023-07-17 16:24:11 +02:00
Azat Khuzhin
1fb7605fb4 Fix self extracting binaries under qemu linux-user (qemu-$ARCH-static)
The problem was that the decompressor uses realpath(/proc/self/exe)
instead of readlink(/proc/self/exe), while realpath() does lots of
trickerly [1] which leads to bypassing qemu linux-user override [2] of
/proc/self/exe to the executable with with it had been called -- and
the reason for this is that the getpid() after unshare returns 1, while
reading /proc/self returns the pid that was before unshare (from the
chroot) [3].

  [1]: 4290aed051/stdlib/canonicalize.c (L223)
  [2]: ed8ad9728a/linux-user/syscall.c (L8634)
  [3]: https://gist.github.com/azat/fcbd8b6c26afd505ae5f3387fc15f0e2

But note, that even after this patch qemu without binfmt will not work,
due to internally the code calls execv() while qemu does not handle it
(see [4]).

  [4]: https://patchwork.kernel.org/project/qemu-devel/patch/1453091602-21843-1-git-send-email-petrosagg@gmail.com/

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 13:10:40 +02:00
Azat Khuzhin
16165d9498 Improve error messages for decompressor
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 13:10:40 +02:00
Azat Khuzhin
c374653c7b Revert "Merge pull request #52138 from azat/decompressor-inode"
This reverts commit 6524031348, reversing
changes made to 9bf114f9a3.

This was not a good idea, since the underlying problem was that
`/proc/self/exe` was pointing to `qemu-$ARCH-static` (because the code
uses realpath() over normal interface readlink(), which is not caught by
the qemu linux-user).

And this means that later, it will try to overwrite incorrect binary and
then execute some garbage.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 13:10:29 +02:00
Antonio Andelic
61dc020b4d
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-17 12:50:17 +02:00
Dmitry Kardymon
2de9ea6925 Merge remote-tracking branch 'origin/master' into ADQM-982 2023-07-17 10:03:16 +00:00
Lloyd-Pottiger
3636c2a847
Merge branch 'master' into add-alias-for-today-and-now 2023-07-17 14:28:24 +08:00
FFFFFFFHHHHHHH
0895e47629
Merge branch 'master' into jaccard_similarity 2023-07-17 10:33:10 +08:00
Lloyd-Pottiger
e38a9de7c9 add aspell
Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>
2023-07-17 10:24:45 +08:00
flynn
7f80f7dcb0
Merge branch 'master' into array_concat_agg 2023-07-17 01:15:24 +08:00
flynn
6899070f95 fix 2023-07-16 09:54:13 +00:00
Azat Khuzhin
20a671b8cf Skip protection from double decompression if inode from maps cannot be obtained
Under some circumstances, like using qemu-$ARCH-static, /proc/self/maps
will not contain information about /proc/self/exe.

Well, strictly speaking it does contains, however qemu will not pass it
to the user program:

<details>

<summary>strace</summary>

    $ sudo strace -s10000 -f arch-chroot . /qemu-riscv64-static /clickhouse
    ...
    execve("/qemu-riscv64-static", ["/qemu-riscv64-static", "/clickhouse"], 0x7fffffffe458 /* 20 vars */) = 0
    readlinkat(AT_FDCWD, "/proc/self/exe", "/qemu-riscv64-static", 4096) = 20
    openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_CLOEXEC) = 4
    [pid  3126] read(4, "00010000-00111000 r--p 00000000 fe:01 30312571                           /clickhouse\n00111000-00119000 r--p 00100000 fe:01 30312571                           /clickhouse\n00119000-0011a000 rw-p 00108000 fe:01 30312571                           /clickhouse\n0011a000-0013d000 rw-p 00000000 00:00 0 \n4000000000-4000001000 ---p 00000000 00:00 0 \n4000001000-4000801000 rw-p 00000000 00:00 0 \n4000801000-400081a000 r--p 00000000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081a000-400081b000 ---p 00000000 00:00 0 \n400081b000-400081c000 r--p 00019000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081c000-400081e000 rw-p 0001a000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081e000-400081f000 r--p 00000000 00:00 0 \n400081f000-4000922000 r--p 00000000 fe:01 30316935 /lib/riscv64-linux-gnu/libc-2.32.so\n4000922000-4000926000 r--p 00102000 fe:01 30316935                       /lib/riscv64-linux-gnu/libc-2.32.so\n4000926000-4000928000 rw-p 00106000 fe:01 30316935                       /lib/riscv64-linux-gnu/libc-2.32.so\n4000928000-400092d000 rw-p 00000000 00:00 0 \n400092d000-40009af000 r--p 00000000 fe:01 30316943                       /lib/riscv64-linux-gnu/libm-2.32.so\n40009af000-40009b0000 r--p 00081000 fe:01 30316943                       /lib/riscv64-linux-gnu/libm-2.32.so\n40009b0000-40009b1000 rw-p 00082000 fe:01 30316943 /lib/riscv64-linux-gnu/libm-2.32.so\n40009b1000-40009c5000 r--p 00000000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c5000-40009c6000 r--p 00013000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c6000-40009c7000 rw-p 00014000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c7000-40009cb000 rw-p 00000000 00:00 0 \n40009cb000-40009cd000 r--p 00000000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009cd000-40009ce000 r--p 00001000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009ce000-40009cf000 rw-p 00002000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009cf000-40009d1000 rw-p 00000000 00:00 0 \n7fffe8000000-7fffeffff000 rwxp 00000000 00:00 0 \n7fffeffff000-7ffff0000000 ---p 00000000 00:00 0 \n7ffff0000000-7ffff0021000 rw-p 00000000 00:00 0 \n7ffff0021000-7ffff4000000 ---p 00000000 00:00 0 \n7ffff6b4b000-7ffff6b5b000 rw-p 00000000 00:00 0 \n7ffff71ff000-7ffff7200000 ---p 00000000 00:00 0 \n7ffff7200000-7ffff7a00000 rw-p 00000000 00:00 0\n7ffff7a00000-7ffff7a3c000 r--p 00000000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7a3c000-7ffff7c74000 r-xp 0003c000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7c74000-7ffff7d77000 r--p 00274000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7d77000-7ffff7dce000 r--p 00377000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7dce000-7ffff7df7000 rw-p 003ce000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7df7000-7ffff7e0c000 rw-p 00000000 00:00 0                          [heap]\n7ffff7e0c000-7ffff7e70000 rw-p 00000000 00:00 0                          [heap]\n7ffff7f42000-7ffff7ff9000 rw-p 00000000 00:00 0 \n7ffff7ff9000-7ffff7ffd000 r--p 00000000 00:00 0                          [vvar]\n7ffff7ffd000-7ffff7fff000 r-xp 00000000 00:00 0                          [vdso]\n7ffffffde000-7ffffffff000 rw-p 00000000 00:00 0                          [stack]\nffffffffff600000-ffffffffff601000 --xp 00000000 00:00 0                  [vsyscall]\n", 4096) = 3608
    [pid  3126] read(4, "", 1024)           = 0
    [pid  3126] close(4)                    = 0
    [pid  3126] write(3, "10000-111000 r-xp 00000000 fe:01 30312571", 41) = 41
    [pid  3126] write(3, "                                /clickhouse\n", 44) = 44
    [pid  3126] write(3, "111000-119000 r--p 00100000 fe:01 30312571", 42) = 42
    [pid  3126] write(3, "                               /clickhouse\n", 43) = 43
    [pid  3126] write(3, "119000-11a000 rw-p 00108000 fe:01 30312571", 42) = 42
    [pid  3126] write(3, "                               /clickhouse\n", 43) = 43
    [pid  3126] write(3, "11a000-13d000 rw-p 00000000 00:00 0", 35) = 35
    [pid  3126] write(3, "                                      \n", 39) = 39
    [pid  3126] write(3, "4000000000-4000001000 ---p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "4000001000-4000801000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              [stack]\n", 38) = 38
    [pid  3126] write(3, "4000801000-400081a000 r-xp 00000000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57 <unfinished ...>
    [pid  3127] <... clock_nanosleep resumed>0x7ffff79ff060) = 0
    [pid  3126] <... write resumed>)        = 57
    [pid  3127] clock_nanosleep(CLOCK_REALTIME, 0, {tv_sec=0, tv_nsec=10000000},  <unfinished ...>
    [pid  3126] write(3, "400081a000-400081b000 ---p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400081b000-400081c000 r--p 00019000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57) = 57
    [pid  3126] write(3, "400081c000-400081e000 rw-p 0001a000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57) = 57
    [pid  3126] write(3, "400081e000-400081f000 r-xp 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400081f000-4000922000 r-xp 00000000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000922000-4000926000 r--p 00102000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000926000-4000928000 rw-p 00106000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000928000-400092d000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400092d000-40009af000 r-xp 00000000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009af000-40009b0000 r--p 00081000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009b0000-40009b1000 rw-p 00082000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009b1000-40009c5000 r-xp 00000000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c5000-40009c6000 r--p 00013000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c6000-40009c7000 rw-p 00014000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c7000-40009cb000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "40009cb000-40009cd000 r-xp 00000000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009cd000-40009ce000 r--p 00001000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009ce000-40009cf000 rw-p 00002000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009cf000-40009d1000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31

</details>

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-16 08:17:14 +02:00
Alexey Milovidov
527d77bc0f system.licenses table will display hard forks 2023-07-14 21:12:12 +02:00
robot-ch-test-poll
93b40c490f
Merge pull request #51945 from arenadata/ADQM-950-B
Implement support of date/time format specifiers in log and error log file names
2023-07-14 18:54:27 +02:00
robot-clickhouse
8916e7d69b Update version_date.tsv and changelogs after v23.3.8.21-lts 2023-07-13 08:49:48 +00:00
robot-clickhouse
798f31a612 Update version_date.tsv and changelogs after v23.4.6.25-stable 2023-07-12 12:36:57 +00:00
Roman Vasin
b6023d9f62 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-822 2023-07-11 10:35:31 +00:00
Robert Schulze
521c993eff
Merge branch 'master' into jaccard_similarity 2023-07-11 10:36:18 +02:00
Dmitry Kardymon
ae69627d87 Merge remote-tracking branch 'origin/master' into ADQM-982 2023-07-11 08:16:21 +00:00
Dmitry Kardymon
0cd4b753d6 Merge remote-tracking branch 'origin/master' into ADQM-976 2023-07-10 13:27:45 +00:00
Dmitry Kardymon
17891ca1eb Add case ins utf8 impl + tests 2023-07-10 09:18:09 +00:00
Victor Krasnov
e311d31d87 Merge branch 'master' into ADQM-950-B 2023-07-10 15:50:09 +08:00
Alexey Milovidov
dd1c528d2f
Merge pull request #51985 from azat/cleanup-remote-servers
[RFC] Cleanup remote_servers in dist config.xml
2023-07-10 01:24:06 +03:00
Azat Khuzhin
2db092f9d8 Cleanup remote_servers in dist config.xml
At first, there was no such amount of clusters in dist config, they
added when someone need to write some new cluster for tests.

So let's move them to the clusters.xml that is deployed only for tests,
and leave only default cluster.

And cleanup also some configs that had been copied from dist config in
the repo (about test_config_* integration tests, this should be OK,
since there are more_clusters.xml as well, that covers additional
cases).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-09 16:55:27 +02:00
Alexey Milovidov
29f625e7bb Add a check to validate that the stateful tests are stateful 2023-07-09 03:43:18 +02:00
robot-clickhouse
45d36b736a Update version_date.tsv and changelogs after v23.6.2.18-stable 2023-07-08 23:14:02 +00:00
Robert Schulze
08b2441784
Merge branch 'master' into jaccard_similarity 2023-07-07 12:41:09 +02:00
Victor Krasnov
3edee4174c Add AWST time zone abbreviation to the ignore list 2023-07-07 11:34:03 +08:00
Alexey Milovidov
685f2949b7
Revert "Fix build" 2023-07-07 02:53:13 +03:00
Alexey Milovidov
c47b32b17a Fix build 2023-07-07 01:52:18 +02:00
Alexey Milovidov
48eb30de51 Fix build 2023-07-07 01:42:29 +02:00
Mike Kot
c46b125d0a review fixes 2023-07-07 00:20:54 +03:00
Mike Kot
8b6376005a "reconfig" support for CH Keeper 2023-07-07 00:20:54 +03:00
Kruglov Pavel
665b6d4334
Update aspell-dict.txt 2023-07-05 14:50:15 +02:00
Robert Schulze
01caf205bd
Merge branch 'master' into jaccard_similarity 2023-07-04 10:39:52 +02:00
Robert Schulze
d738ae00a3
Merge remote-tracking branch 'rschu1ze/master' into jaccard_similarity 2023-07-03 18:34:18 +00:00
Sergei Trifonov
bbb5850dec
Merge branch 'master' into async-loader-integration 2023-07-03 20:21:26 +02:00
Vitaly Baranov
8dd1b7b8b9
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-03 18:00:33 +02:00
Dmitry Kardymon
16ab84d804 Style fix 2023-07-03 11:50:26 +00:00
Dmitry Kardymon
1a40e30797 Add initcapUtf8: impl + tests 2023-07-03 11:37:55 +00:00
FFFFFFFHHHHHHH
91d091a806 fix style 2023-07-02 18:58:58 +08:00
Vitaly Baranov
35d1b8448b
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-02 01:32:54 +02:00
Antonio Andelic
eba60dd81e
Merge branch 'master' into keeper-with-disks 2023-07-01 20:59:16 +02:00
robot-clickhouse
8ed1ec49d1 Update version_date.tsv and changelogs after v23.6.1.1524-stable 2023-06-30 15:21:13 +00:00
DanRoscigno
904c533a84 spelling list 2023-06-30 09:32:54 -04:00
Antonio Andelic
2058b1346e Merge branch 'master' into keeper-with-disks 2023-06-30 13:22:33 +00:00
robot-clickhouse
f48de18640 Update version_date.tsv and changelogs after v23.4.5.22-stable 2023-06-29 20:59:01 +00:00
DanRoscigno
a8172ca5d2 update spelling list 2023-06-29 14:47:23 -04:00
robot-clickhouse
5656d18690 Update version_date.tsv and changelogs after v23.5.4.25-stable 2023-06-29 13:36:55 +00:00
Vitaly Baranov
0cccba62cf Support getHexUIntLowercase() with CityHash_v1_0_2::uint128 parameter. 2023-06-29 15:29:37 +02:00
Vitaly Baranov
fb6243ec9d
Merge pull request #51040 from vitlibar/reorder-part-checksum-halves
Show halves of checksums in correct order
2023-06-29 12:04:51 +02:00
Mikhail f. Shiryaev
d8f4e45b21
Merge pull request #51548 from ClickHouse/auto/v23.3.6.7-lts
Update version_date.tsv and changelogs after v23.3.6.7-lts
2023-06-28 20:19:17 +02:00