thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 02:41:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
149,498 Commits 9,328 Branches 1,783 Tags 2.1 GiB
2074485083
Commit Graph

2741 Commits

Author SHA1 Message Date
Anton Popov
0aa8dafe0a Merge remote-tracking branch 'upstream/master' into HEAD 2024-02-19 14:07:55 +00:00
Robert Schulze
ba9661a5d4
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-19 09:54:08 +00:00
Alexey Milovidov
6fd563df52 Miscellaneous 2024-02-19 02:58:51 +01:00
Alexey Milovidov
2f315e0eb5 Style check for abbreviations 2024-02-17 02:14:15 +01:00
Alexander Tokmakov
228a29b93f fix 2024-02-16 14:05:22 +01:00
Antonio Andelic
0f489de46e
Merge pull request #59945 from ClickHouse/keeper-prometheus-filtered-events 
Send only Keeper related metrics/events for Prometheus
 2024-02-16 09:43:43 +01:00
Peignon Melvyn
8ccd41f943
Update aspell-dict.txt 2024-02-16 05:08:51 +01:00
Yarik Briukhovetskyi
a41edd8646
Merge branch 'master' into group_array_intersect 2024-02-15 19:50:57 +01:00
Yarik Briukhovetskyi
a7af4e860e
Merge pull request #60014 from ClickHouse/docs-starts-with-UTF8-min-version 
[Docs] Add min version for startsWithUTF8
 2024-02-15 13:09:25 +01:00
Yarik Briukhovetskyi
7396fa0b14 add docs spelling 2024-02-15 11:23:54 +00:00
Robert Schulze
ddaef8d342
Merge pull request #59752 from rschu1ze/countMatches-fuzzed 
Fix AST fuzzer issue in function `countMatches`
 2024-02-15 10:02:48 +01:00
Alexey Milovidov
0b58f16938
Merge pull request #59964 from ClickHouse/cleanups 
Cleanups
 2024-02-15 02:59:54 +01:00
robot-clickhouse
08df19157b Update version_date.tsv and changelogs after v24.1.5.6-stable 2024-02-14 17:22:21 +00:00
Antonio Andelic
40d4fc1c24 More resilient Disk related operations 2024-02-14 14:53:22 +01:00
robot-clickhouse
7514158353 Update version_date.tsv and changelogs after v24.1.4.20-stable 2024-02-14 10:30:32 +00:00
Mikhail f. Shiryaev
9e7ac6d0ee
Revert "Update version_date.tsv and changelogs after v24.1.4.19-stable" 2024-02-14 10:07:09 +01:00
Robert Schulze
7b7ea6d477
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-14 08:56:22 +00:00
robot-clickhouse
3c0abe08cb Update version_date.tsv and changelogs after v24.1.4.19-stable 2024-02-14 00:29:24 +00:00
Alexey Milovidov
2b4949bd18 Cleanups 2024-02-14 00:21:13 +01:00
Antonio Andelic
2389cd5e61 Fix style 2024-02-13 16:27:29 +01:00
Nikita Taranov
91a38e73b4 impl 2024-02-12 19:36:12 +01:00
Yakov Olkhovskiy
3aefd0f50b copy on mac instead renaming 2024-02-12 18:01:43 +00:00
Raúl Marín
c7f18be9a3 Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-02-12 18:24:32 +01:00
yariks5s
bba0fdee97 fix style 2024-02-12 11:57:11 +00:00
Antonio Andelic
36b966967b Merge branch 'master' into keeper-more-reduce 2024-02-12 10:03:07 +01:00
Alexey Milovidov
a65b9cc1f8
Merge pull request #59800 from ClickHouse/auto/v23.12.4.15-stable 
Update version_date.tsv and changelogs after v23.12.4.15-stable
 2024-02-11 23:41:09 +01:00
Robert Schulze
04f6178176
Fix spellcheck, pt. II 2024-02-10 16:32:49 +00:00
Robert Schulze
3a4b6a2379
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-10 13:53:19 +00:00
Robert Schulze
f1193bcd5d
Fix spellcheck 2024-02-10 13:22:58 +00:00
Maksim Kita
dc52def9eb Revert "Revert "Poco Logger small refactoring"" 2024-02-09 21:39:35 +03:00
robot-clickhouse
582abd40fd Update version_date.tsv and changelogs after v23.12.4.15-stable 2024-02-09 12:25:38 +00:00
Raúl Marín
d17b0867e6 Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-02-09 13:08:23 +01:00
Antonio Andelic
d2eac53c86 Fix 2024-02-09 12:06:01 +01:00
Robert Schulze
5f542bf38d
Fix spelling 2024-02-08 16:52:32 +00:00
Antonio Andelic
dfb3a8f7be Another fix 2024-02-08 17:17:12 +01:00
Antonio Andelic
15c89bdd66 Merge branch 'master' into keeper-more-reduce 2024-02-07 14:21:31 +01:00
Robert Schulze
7edcb86c08
Merge pull request #58632 from ClibMouse/series_outlier 
Added function `seriesOutliersTukey` for outlier detetion in series data
 2024-02-07 13:08:53 +01:00
Yakov Olkhovskiy
648fa52583 move instead copy 2024-02-06 18:48:57 +00:00
Antonio Andelic
a0170bcbd5 Fix utils 2024-02-05 17:58:33 +01:00
Raúl Marín
062b0b211e
Merge pull request #59509 from ClickHouse/revert-59375-poco-logger-small-refactoring 
Revert "Poco Logger small refactoring"
 2024-02-02 16:06:12 +01:00
robot-clickhouse
67ac92e1a1 Update version_date.tsv and changelogs after v23.11.5.29-stable 2024-02-02 12:55:17 +00:00
robot-clickhouse
e7f63abc2f Update version_date.tsv and changelogs after v24.1.2.5-stable 2024-02-02 11:41:46 +00:00
Raúl Marín
87d493533c
Revert "Poco Logger small refactoring" 2024-02-02 12:10:05 +01:00
Han Fei
a9fc299764 Merge branch 'master' into hanfei/keeperrocks 2024-02-01 17:14:36 +01:00
Han Fei
4883082a6a Merge branch 'master' into hanfei/keeperrocks 2024-02-01 12:43:46 +01:00
Maksim Kita
056108667f Fixed tests 2024-02-01 12:51:50 +03:00
Maksim Kita
ecbea6f625 Updated implementation 2024-02-01 12:51:50 +03:00
Alexey Milovidov
8d2f3508f2
Merge pull request #58767 from gingerwizard/weather-data 
weather data
 2024-01-31 23:12:08 +01:00
Alexey Milovidov
5128023e8f
Merge pull request #59350 from AVMusorin/clickhouse-client-docs 
docs: added hidden clickhouse-client shortkeys and aliases
 2024-01-31 23:11:25 +01:00
Bhavna Jindal
4bc26fe45f Added support for custom percentiles and K 2024-01-31 10:41:05 -08:00
Bhavna Jindal
d2ce39387f implemented series_outlier method 2024-01-31 10:39:39 -08:00
Kruglov Pavel
325419b096
Merge pull request #59398 from Avogar/variant-type-func 
Add function variantType
 2024-01-31 13:06:54 +01:00
Nikolai Kochetov
7e722b52a9
Merge pull request #59003 from kitaisreal/revert-57519-revert-53562-group_sorted_array_function 
Revert "Revert "Add new aggregation function groupArraySorted()""
 2024-01-31 12:31:26 +01:00
Dale Mcdiarmid
db84527dd0 more words 2024-01-30 20:39:37 +00:00
Dale Mcdiarmid
4dbf184da6 Merge branch 'weather-data' of github.com:gingerwizard/ClickHouse into weather-data 2024-01-30 20:38:38 +00:00
Dale Mcdiarmid
0f5cb76a61 more words 2024-01-30 20:37:51 +00:00
Kruglov Pavel
80376fdbfa
Fix style 2024-01-30 19:28:39 +01:00
robot-clickhouse
ef6c90c71b Update version_date.tsv and changelogs after v24.1.1.2048-stable 2024-01-30 18:01:46 +00:00
Maksim Kita
20c1f0c18f Revert "Revert "Add new aggregation function groupArraySorted()"" 2024-01-30 17:15:29 +03:00
Aleksandr Musorin
49d2b26820 Added new words in aspell-dict 2024-01-30 12:11:00 +01:00
Alexey Milovidov
798f655276 Rename quantileDDSketch to quantileDD 2024-01-30 11:49:56 +01:00
Dale McDiarmid
a4ed4a1827
Merge branch 'master' into weather-data 2024-01-30 09:12:32 +00:00
Dale Mcdiarmid
7e0bea4a66 fix spelling 2024-01-30 08:55:40 +00:00
Raúl Marín
ab2b12ba9f Fix typo 2024-01-29 11:40:12 +01:00
UnamedRus
94770f8d8a
Merge branch 'master' into topk-statistics-count-errors 2024-01-28 20:50:45 +03:00
Duc Canh Le
adad010345 Merge branch 'master' into rocksdb_bypass_memtable 
Try fixing weird CI errors
 2024-01-27 01:16:32 +00:00
avogar
5833641fa5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into variant-data-type 2024-01-26 16:54:02 +00:00
Duc Canh Le
84efec443b fix document spell check 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2024-01-26 01:28:26 +00:00
Raúl Marín
c10a0f1253 Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-01-24 21:04:00 +01:00
Anton Popov
bceda4cd29 Merge remote-tracking branch 'upstream/master' into HEAD 2024-01-23 14:03:34 +00:00
Antonio Andelic
59f9abcf58 Merge branch 'master' into keeper-reduce-memory 2024-01-22 08:04:17 +00:00
Antonio Andelic
0132455b39 Reduce Keeper memory usage 2024-01-19 17:00:53 +00:00
Kruglov Pavel
5444cde408
Merge branch 'master' into variant-data-type 2024-01-18 18:31:27 +01:00
Dale McDiarmid
8b730811ef
Update aspell-dict.txt 2024-01-18 13:24:40 +00:00
Raúl Marín
6aa5ac4cc6 Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-01-18 12:04:19 +01:00
Robert Schulze
316669b90f
Merge pull request #58396 from zenmiao7/u/zhengmiao/AddArrayFunctionShingles 
Add function `arrayShingles()`
 2024-01-18 11:38:56 +01:00
Srikanth Chekuri
c23c7e0b6f
feat: add DDSketch quantile (#56342) 
* feat: add DDSketch quantile

* Fix StyleCheck

* Move quantileddsketch.md under right dir

* Update stateless test number and add stateful test

* Throw exception when relative accuracy is too low

* Update test number

* Fix undefined behaviour for empty store

* Fix quantileGK test

* Update test numbers

* Update src/AggregateFunctions/

* Throw exception on out of range values

* Update relative accuracy docs and add encoding details

* Address review comments and suggestions

* Remove unused function

* Address alexey review comments

* Remove unused function isFloat64FieldType

* Throw error on invalid relative accuracy

* Simplify mapping

* Address remaining review comments

* Add effective memory usage suggestions

* Fix Stylecheck

* Fix fast test

* Incorporate bins capacity suggestion

* Fix fuzzer

* Remove inheritance in Mapping, Store and DDSketch

* Add checks for bin resizing

* Add note about the binary compatible implementation
 2024-01-17 19:51:32 -08:00
Robert Schulze
226f1804b7
Fix spelling and style 2024-01-17 15:26:18 +00:00
Han Fei
e562b9f050 Merge branch 'master' into hanfei/keeperrocks 2024-01-17 15:43:36 +01:00
Raúl Marín
d7b59d1eb7 Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-01-16 18:19:07 +01:00
Anton Popov
134d389bea Merge remote-tracking branch 'upstream/master' into HEAD 2024-01-15 18:23:25 +00:00
Antonio Andelic
76c9bf42d7 Add docs for allocation profiling 2024-01-15 13:57:16 +01:00
Alexey Milovidov
c132e0141c
Merge pull request #58791 from ClickHouse/better-stateful-tests 
Simplify stateful tests
 2024-01-14 21:39:13 +01:00
Alexander Tokmakov
5128607995
Merge pull request #58393 from jaymebrd/feat/add-from-modifier-sync-replica-lightweight 
add `from srcreplicas` modifier  for `SYSTEM SYNC REPLICA LIGHTWEIGHT`
 2024-01-14 20:53:16 +01:00
UnamedRus
877c643955 fix docs 2024-01-13 23:53:05 +00:00
Alexey Milovidov
7ca8ea9d23 Simplify stateful tests 2024-01-13 23:53:01 +01:00
Raúl Marín
c65677e24b Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-01-12 10:07:22 +01:00
Robert Schulze
52d75ab68f
Merge pull request #58458 from rschu1ze/replace-std_regexp-by-re2 
Replace `std::regex` by re2
 2024-01-10 17:46:54 +01:00
Robert Schulze
582a9cc2a7
Merge pull request #58655 from rschu1ze/docs-match 
Document that `match()` can use `ngrambf_v1` and `tokenbf_v1` indexes
 2024-01-10 15:43:52 +01:00
Robert Schulze
d7fbb1a4d9
Fix style 2024-01-10 13:54:52 +00:00
Robert Schulze
a0128e0f51
Merge pull request #58544 from rschu1ze/sqid-decode 
Add `sqidDecode()` function
 2024-01-10 13:47:13 +01:00
Robert Schulze
499227b9cf
Merge remote-tracking branch 'rschu1ze/master' into replace-std_regexp-by-re2 2024-01-10 10:02:53 +00:00
Robert Schulze
4cacfa6b43
Merge pull request #57509 from jinjunzh/qatzstd_main 
Add Intel-QAT-based `ZSTD_QAT` compression codec
 2024-01-10 10:31:39 +01:00
Kseniia Sumarokova
1b517105db
Merge pull request #57323 from valbok/mysql-binlog-client 
MaterializedMySQL: Introduce MySQL Binlog Client
 2024-01-10 09:08:13 +01:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-09 20:36:02 +00:00
Raúl Marín
d3cbbb319e Implement argMin 2024-01-09 20:58:05 +01:00
Robert Schulze
69ba1a706a
Merge remote-tracking branch 'rschu1ze/master' into string-similarity 2024-01-09 15:22:52 +00:00
Robert Schulze
64ab30f446
Merge pull request #57078 from ClibMouse/seriesDecompose 
Seasonal decompose of time series into seasonal, trend and residue components
 2024-01-09 11:18:13 +01:00
Kruglov Pavel
b947609b8e
Merge branch 'master' into variant-data-type 2024-01-08 15:04:51 +01:00
Robert Schulze
a2a86caf0f
Fix style, pt. II 2024-01-08 13:45:46 +00:00
Jayme Bird
4f7e4fef40 ignore spelling srcReplicas 2024-01-08 12:58:26 +00:00
Robert Schulze
f553b55e3a
Merge remote-tracking branch 'rschu1ze/master' into regex-std-re2 2024-01-07 22:31:35 +00:00
Robert Schulze
8e804487f3
Some fixups 2024-01-07 22:28:08 +00:00
Robert Schulze
14cda082d2
Fix style 2024-01-07 18:08:52 +00:00
Robert Schulze
0f51e32bb5
Rename from ZSTDQPL to ZSTD_QPL 2024-01-07 17:47:31 +00:00
Robert Schulze
53965bb9f1
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-07 14:11:22 +00:00
Robert Schulze
5f105a56af
Fix style 2024-01-07 08:34:41 +00:00
Robert Schulze
dd2d9ff168
Minor fixes 2024-01-07 08:25:19 +00:00
Robert Schulze
d54e500832
Merge remote-tracking branch 'rschu1ze/master' into punycode-revert-revert 2024-01-07 08:08:46 +00:00
Robert Schulze
1e5f7ff80d
Merge remote-tracking branch 'rschu1ze/master' into sqid-decode 2024-01-07 07:55:06 +00:00
Robert Schulze
44b9547fba
Rename decode/encodeSqid() to sqidDecode/Encode() 2024-01-05 21:40:35 +00:00
robot-clickhouse
5b9cc914db Update version_date.tsv and changelogs after v23.8.9.54-lts 2024-01-05 14:11:11 +00:00
Robert Schulze
a813431fcb
Fix spelling 2024-01-03 20:09:12 +00:00
Robert Schulze
8d4b519bb1
Replace std::regex by re2 2024-01-03 15:06:20 +00:00
Val Doroshchuk
5c221d123d MaterializedMySQL: Introduce MySQL Binlog Client 
One binlog connection for many databases.

Suggesting to disable this feature by default for now. It should be explicitly enabled by SETTINGS use_binlog_client=1.
But if you would permanently enable it in MaterializedMySQLSettings, it should keep old behavior and all tests should pass too.

1. Introduced `IBinlog` and its impl to read the binlog events from socket - `BinlogFromSocket`, or file - `BinlogFromFile`. Based on prev impl of `EventBase` and the same old binlog parsers. It fully keeps BC with old version. Fixed `./check-mysql-binlog` to test new impl.
2. Introduced `BinlogEventsDispatcher`, it reads the event from the source `IBinlog` and sends it to currently attached `IBinlog` instances.
3. Introduced `BinlogClient`, which is used to group a list of `BinlogEventsDispatcher` by MySQL binlog connection which is defined by `user:password@host:port`. All dispatchers with the same binlog position should be merged to one.
4. Introduced `BinlogClientFactory`, which is a singleton and it is used to track all binlogs created over the instance.
5. Introduced `use_binlog_client` setting to `MaterializedMySQL`, which forces to reuse a `BinlogClient` if it already exists in `BinlogClientCatalog` or create new one. By default, it is disabled.
6. Introduced `max_bytes_in_binlog_queue` setting to define the limit of bytes in binlog's queue of events. If bytes in the queue increases this limit, `BinlogEventsDispatcher` will stop reading new events from source `IBinlog` until the space for new events will be freed.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
8. Introduced `max_bytes_in_binlog_dispatcher_buffer` setting to define max bytes in the binlog dispatcher's buffer before it is flushed to attached binlogs.
9. Introduced `max_flush_milliseconds_in_binlog_dispatcher` setting to define max milliseconds in the binlog dispatcher's buffer to wait before it is flushed to attached binlogs.
10. Introduced `system.mysql_binlogs` system table, which shows a list of active binlogs.
11. Introduced `UnparsedRowsEvent` and `MYSQL_UNPARSED_ROWS_EVENT`, which defines that an event is not parsed and should be explicitly parsed later.
12. Fixed bug when not possible to apply DDL since syntax error or unsupported SQL.

@larspars is the author of following:
`GTIDSets::contains()`
`ReplicationHelper`
`shouldReconnectOnException()`
 2024-01-03 15:26:09 +01:00
Kruglov Pavel
4d8cf71ba7
Merge branch 'master' into variant-data-type 2024-01-03 15:21:23 +01:00
Robert Schulze
2186aa8f21
Revert "Revert "Implement punycode encoding/decoding"" 
This reverts commit 345d29a3c1.
 2024-01-03 08:03:01 +00:00
Bhavna Jindal
6d58c99408 fixed the failing fasttest and style-check 2024-01-02 08:52:28 -08:00
Bhavna Jindal
a407cd270d Added new library stl-cpp for sesonal decompose of time series data 2024-01-02 08:48:10 -08:00
Alexey Milovidov
78523639e0 Remove function 2023-12-30 14:52:54 +01:00
Alexey Milovidov
96876aa4f4
Merge pull request #58345 from ClickHouse/dos-windows 
Add a style check against DOS and Windows
 2023-12-29 15:02:46 +01:00
Alexey Milovidov
4843d5d099
Update check-style 2023-12-29 16:29:30 +03:00
Alexey Milovidov
48a397577c Add a style check against DOS and Windows 2023-12-29 13:10:40 +01:00
Michael Kolupaev
609b2c216c Fix some of the CI 2023-12-28 17:56:05 +00:00
Anton Popov
482e01dea3 add docs 2023-12-28 17:36:56 +00:00
Han Fei
05f0bcaa9c Merge branch 'master' into hanfei/keeperrocks 2023-12-28 15:58:41 +01:00
Alexander Tokmakov
38fe70c68a
Revert "Refreshable materialized views (takeover)" 2023-12-28 13:12:20 +01:00
robot-clickhouse
27657a3eb6 Update version_date.tsv and changelogs after v23.12.1.1368-stable 2023-12-28 10:32:09 +00:00
Alexey Milovidov
a2faa65b08
Merge pull request #56946 from ClickHouse/mv 
Refreshable materialized views (takeover)
 2023-12-28 09:29:44 +01:00
Alexey Milovidov
345d29a3c1
Revert "Implement punycode encoding/decoding" 2023-12-28 09:12:22 +03:00
Michael Kolupaev
673743e2ac Fix some of the CI 2023-12-27 20:24:55 +00:00
Sema Checherinda
617ee5abaf
Merge pull request #57551 from bharatnc/ncb/async-metrics-pri-key-size 
add asynchronous metrics for total primary key size in memory and allocated
 2023-12-27 20:24:20 +01:00
Alexey Milovidov
d0ca383bca
Merge pull request #58095 from azat/metrics/max-rss 
Add max/peak RSS into system.asynchronous_metrics
 2023-12-23 13:13:44 +01:00
Azat Khuzhin
74ea601dc2 Add documentation for MemoryResidentMax metric in system.asynchronous_metrics 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-12-22 18:38:44 +01:00
Bharat Nallan Chakravarthy
62b28d365c Merge with upstream/master 2023-12-21 17:04:25 -08:00
robot-clickhouse
547050d41b Update version_date.tsv and changelogs after v23.11.3.23-stable 2023-12-21 08:44:28 +00:00
jinjunzh
372de8a046 refine patch 2023-12-20 10:12:24 -05:00
Robert Schulze
ecb6f31211
Merge pull request #57969 from rschu1ze/punycode-is-cool 
Implement punycode encoding/decoding
 2023-12-20 10:20:34 +01:00
Kruglov Pavel
087946f385
Merge branch 'master' into variant-data-type 2023-12-20 00:40:18 +01:00
robot-ch-test-poll3
39b77ddc02
Merge pull request #56138 from crackhead-koala/add-documentation-for-sample-size-functions 
Add documentation for minSampleSizeConversion and minSampleSizeContinous
 2023-12-19 23:19:55 +01:00
avogar
bd84799aec Fix style 2023-12-19 17:21:45 +00:00
Robert Schulze
00c407ecc1
Merge remote-tracking branch 'rschu1ze/master' into punycode-is-cool 2023-12-19 06:27:23 +00:00
Bharat Nallan Chakravarthy
aef4e2e6ec Merge upstream/master into ncb/async-metrics-pri-key-size 2023-12-18 09:46:51 -08:00
Robert Schulze
29d70c12f6
Fix CI checks 2023-12-18 10:47:40 +00:00
Raúl Marín
2639d0715f Merge remote-tracking branch 'blessed/master' into log_message_string 2023-12-18 10:40:18 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904) 
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
 2023-12-18 09:07:22 +01:00
Sergei Trifonov
3634b949a8
Merge pull request #57793 from ClickHouse/rename-system-table 
Rename `system.async_loader` into `system.asynchronous_loader`
 2023-12-16 17:33:04 +01:00
Raúl Marín
b269f87f4c Better text_log with ErrnoException 2023-12-15 19:27:56 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)" 
This reverts commit 7844fcc196.
 2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317) 
* CI with digests to tag docker images, reuse builds, reuse tests and others
 2023-12-15 15:21:20 +01:00
Julia Kartseva
7a5b40563a
Merge pull request #57574 from ClibMouse/dev-seriesPeriodDetect 
Revert "Revert "Implemented series period detect method using pocketfft lib""
 2023-12-14 21:10:23 -08:00
jinjunzh
606a494447 add dictionary 2023-12-13 12:53:53 -05:00
robot-clickhouse
30e6797c7e Update version_date.tsv and changelogs after v23.11.2.11-stable 2023-12-13 17:19:14 +00:00
serxa
57d7a58dbe Rename system.async_loader into system.asynchronous_loader 2023-12-12 16:55:27 +00:00
Kruglov Pavel
3b1ffbd77c
Merge branch 'master' into schema-inference-union 2023-12-11 18:59:15 +01:00
Robert Schulze
d24f389a0a
Fix spelling 2023-12-11 11:28:38 +00:00
avogar
ee7af95bc0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-12-08 20:29:28 +00:00
Bhavna Jindal
1f58b0f150
Merge branch 'master' into dev-seriesPeriodDetect 2023-12-08 10:26:39 -05:00
robot-clickhouse
2d134fd120
Merge pull request #57612 from danipozo/fix-reading-s3-script-backupview 
Fix parsing virtual hosted S3 URI in clickhouse_backupview script
 2023-12-08 10:17:12 +01:00
hdhoang
fc8292182c
fix typo TKSV 
correct name is TS-KV
 2023-12-07 20:19:00 +07:00
Dani Pozo
7ac4e83acc Fix parsing virtual hosted S3 URI 2023-12-07 12:32:32 +01:00
Robert Schulze
0159a4d4a2
Merge pull request #57512 from rschu1ze/revert-revert-sqid 
Revert "Revert "Add `sqid()` function""
 2023-12-07 10:26:02 +01:00
robot-clickhouse
2bd0888966 Update version_date.tsv and changelogs after v23.11.1.2711-stable 2023-12-06 23:05:48 +00:00
Bhavna Jindal
dad268c33b Revert "Revert "Implemented series period detect method using pocketfft lib"" 
This reverts commit d7d83c99e5.
 2023-12-06 13:31:49 -08:00
Bharat Nallan Chakravarthy
41b2b63cee add docs 2023-12-05 18:50:36 -08:00
Robert Schulze
f56dd6561f
Merge remote-tracking branch 'rschu1ze/master' into revert-revert-sqid 2023-12-05 18:41:10 +00:00
Alexey Milovidov
d7d83c99e5
Revert "Implemented series period detect method using pocketfft lib" 2023-12-05 18:17:07 +03:00
Alexey Milovidov
2988f6f92a
Revert "Add new aggregation function groupArraySorted()" 2023-12-05 15:31:17 +03:00
Robert Schulze
a2cd240317
Revert "Revert "Add sqid() function"" 
This reverts commit 8d5d0ef38f.
 2023-12-05 10:50:30 +00:00
Alexey Milovidov
8d5d0ef38f
Revert "Add sqid() function" 2023-12-05 13:45:33 +03:00
Alexey Milovidov
cbea3545aa
Revert "add function getClientHTTPHeader" 2023-12-05 13:34:34 +03:00
Alexey Milovidov
02439eee58
Merge pull request #49351 from ClickHouse/async-loader-integration 
Asynchronous loading of tables
 2023-12-04 17:16:12 +01:00
Robert Schulze
f6036fbb29
Some fixups 2023-12-03 16:20:59 +00:00
Kruglov Pavel
575ee1e665
Merge pull request #56868 from zvonand/zvonand-fileCluster 
Introduce `fileCluster` table function
 2023-11-30 13:49:53 +01:00
Nikolai Kochetov
024f41888e
Merge pull request #53562 from yariks5s/group_sorted_array_function 
Add new aggregation function groupArraySorted()
 2023-11-29 17:52:01 +01:00
zvonand
c329e382ab resolve conflicts 2023-11-29 16:03:07 +01:00
Han Fei
6733438adc Merge branch 'master' into hanfei/statistic 2023-11-28 16:35:00 +01:00
zvonand
c306d21b54 merge master + resolve conflicts 2023-11-28 15:51:21 +01:00
Antonio Andelic
a61f32867e
Merge pull request #56488 from lingtaolf/feature/getHTTPHeader 
add function getClientHTTPHeader
 2023-11-28 11:41:56 +01:00
Robert Schulze
1448276bae
Merge pull request #55872 from azat/hour-no-leading-zero 
Add ability to parse hours/months without leading zeros
 2023-11-28 11:07:00 +01:00
Ubuntu
a85cf758b0 Fuzz JSON table function 
Create a table function `fuzzJSON`

An example query:
```
CREATE NAMED COLLECTION json_fuzzer AS json_str={};

SELECT *
FROM fuzzJSON(json_fuzzer, json_str = '{"students" : ["Alice", "Bob"]}', random_seed = 666, max_output_length = 128, probability = 0.9)
LIMIT 3

Query id: 7f802052-efb0-41b4-87fa-03b7dd290e9d

┌─json──────────────────────────────────────────────────────────────────────────────────┐
│ {"ade0yX":[9200406572736542991, true, "sm"]}                                          │
│ {"students":["Alice", "eSN3WO#a6NYTBe0$#OWwyIQ"], "cVoP2BuQugQ":17384271928263249403} │
│ {"students":["Alice", "Bob", "T+-k4+PJGkL%XRRaF2BoeN@&A"]}                            │
└───────────────────────────────────────────────────────────────────────────────────────┘
```

Next step:
* Generate invalid string

Fixes #35962

add Object('json')

use named collection
 2023-11-28 01:58:24 +00:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
Azat Khuzhin
3ab1d4ae68 Add "formatters" into spell excludes 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-27 14:42:03 +01:00
Nikolay Degterinsky
de0876ed68
Merge pull request #57234 from evillique/fix-docs-anchors 
Fix docs
 2023-11-27 01:22:43 +01:00
Nikolay Degterinsky
124fae7549 Fix style 2023-11-26 23:58:34 +00:00
Nikolay Degterinsky
dd49b46ca5 Fix style 2023-11-26 22:32:11 +00:00
Robert Schulze
5b7d2a903d
Merge pull request #57152 from rschu1ze/fine-granular-plan-opt-settings 
Fine-granular enablement/disabling of plan-level optimizations
 2023-11-25 20:44:23 +01:00
robot-clickhouse
2bb12386dd Update version_date.tsv and changelogs after v23.9.6.20-stable 2023-11-25 18:37:17 +00:00
Mikhail f. Shiryaev
57445d46cc
Slightly improve the generator readbility 2023-11-24 20:23:11 +01:00
Robert Schulze
ace830a618
Fix spelling 2023-11-23 22:56:40 +00:00
Alexey Milovidov
10d5ba57e8
Merge pull request #57124 from azat/build/split-HashedDictionary-CU 
Split HashedDictionary CU
 2023-11-23 23:14:47 +01:00
Yarik Briukhovetskyi
69205769d0
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-11-23 20:23:47 +01:00
Alexey Milovidov
ac1e742afa
Merge pull request #57108 from azat/build/large-objects 
Allow HashedDictionary/FunctionsConversion as large TU
 2023-11-23 15:00:59 +01:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
Azat Khuzhin
cf3cd099a5 Split HashedDictionary CU 
Before HashedDictionary.cpp exceeds 50MiB, now:

    -rw-r--r-- 1 azat azat  37M Nov 22 17:56 SparseHashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat  34M Nov 22 17:56 HashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat 716K Nov 22 17:56 registerHashedDictionary.cpp.o

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-22 19:00:40 +01:00
Azat Khuzhin
4925cb7eda Allow HashedDictionary/FunctionsConversion as large TU 
In case of -DOMIT_HEAVY_DEBUG_SYMBOLS=OFF they are large.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-22 16:39:54 +01:00
zvonand
5153798aeb Introduced fileCluster table function 
Added fileCluster function
Added test and docs
 2023-11-22 15:06:04 +01:00
Bhavna Jindal
3731d57dd5 added method name in aspell-dict 2023-11-21 06:52:48 -08:00
凌涛
e86aa433c5
Merge branch 'master' into feature/getHTTPHeader 2023-11-21 19:48:47 +08:00
凌涛
c5f16725ec add function getClientHTTPHeader 2023-11-21 11:12:01 +08:00
Alexey Milovidov
6a1955cb34 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-useless-install 2023-11-20 21:34:31 +01:00
Han Fei
4b3630b7f9 Merge branch 'master' into hanfei/keeperrocks 2023-11-20 16:50:14 +01:00
Mikhail f. Shiryaev
94824a0194
Fix shellcheck for time-trace 2023-11-20 15:15:37 +01:00
avogar
872556a5d4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:03:36 +00:00
Alexey Milovidov
241cc2abf4 Merge branch 'master' into remove-useless-install 2023-11-20 01:12:08 +01:00
serxa
9023f61349 Merge branch 'master' into async-loader-integration 2023-11-19 13:05:58 +00:00
Alexey Milovidov
d56cbda185 Add metrics for the number of queued jobs, which is useful for the IO thread pool 2023-11-18 19:07:59 +01:00
robot-clickhouse
af2f06db52 Update version_date.tsv and changelogs after v23.9.5.29-stable 2023-11-17 11:12:16 +00:00
Andrey Zvonov
fc15b0c1e7
Merge branch 'ClickHouse:master' into zvonand-more-globs 2023-11-16 11:19:12 +01:00
Vitaly Baranov
946e02ecbc
Merge pull request #56268 from vitlibar/add-script-backup-view 
Add an external utility to view backups and to extract information from them
 2023-11-16 11:17:16 +01:00
Vitaly Baranov
21a283049c Add the test for clickhouse_backupview to CI. 2023-11-15 17:40:53 +01:00
zvonand
20163e6aba add globbing to aspell-ignore 2023-11-15 16:37:24 +01:00
Alexey Milovidov
2791a95214 Merge branch 'master' into linker-time-trace 2023-11-15 07:44:02 +01:00
Alexey Milovidov
ed7d1dbb82 Pick up linker's trace files 2023-11-15 07:43:55 +01:00
Han Fei
eb64d4215e Merge branch 'master' into hanfei/keeperrocks 2023-11-14 12:57:13 +01:00
Alexey Milovidov
e32f6e5556
Merge branch 'master' into remove-orphan-headers 2023-11-14 09:23:19 +01:00
Alexey Milovidov
9bf62dd622 Remove orphan header files 2023-11-14 07:43:11 +01:00
Alexey Milovidov
4e3e8e32fd Remove more garbage 2023-11-14 07:24:41 +01:00
Alexey Milovidov
d7df884cbb Merge branch 'master' into filter-large-translation-units 2023-11-13 19:31:13 +01:00
Alexey Milovidov
c1bba6ea4a Merge branch 'master' into filter-large-translation-units 2023-11-13 17:54:02 +01:00
Han Fei
d67e3019af try to fix data race 2023-11-13 14:46:14 +01:00
Mikhail f. Shiryaev
88e04579fd
Add a simple validator for reusable workflows 2023-11-13 12:49:32 +01:00
Vitaly Baranov
a4d57fe108 Rename the name of the utility "backupview" -> "clickhouse_backupview". 2023-11-13 10:15:37 +01:00
Vitaly Baranov
f12b95df7d Add documentation. 2023-11-13 09:43:06 +01:00
Alexey Milovidov
225c78681e Merge branch 'master' into collect-binary-size 2023-11-13 04:00:25 +01:00
Vitaly Baranov
6807e52d2c Use S3(*args) to simplify conditions in __parse_location(). 2023-11-12 23:54:27 +01:00
Vitaly Baranov
8a8afc54fc Improve the test. 2023-11-12 23:54:23 +01:00
Vitaly Baranov
e67dfc7e04 Add a script to view backups and to extract information from them. 2023-11-12 23:42:38 +01:00
Robert Schulze
3f49e1c5ed
Merge remote-tracking branch 'rschu1ze/master' into pcg 2023-11-12 11:43:19 +00:00
Alexey Milovidov
63a1671054 Collect information about binary sizes to the CI database 2023-11-12 04:04:09 +01:00
Alexey Milovidov
6c30aa121c Collect information about binary sizes to the CI database 2023-11-12 04:01:59 +01:00
Alexey Milovidov
75b98b65dd Merge branch 'master' into filter-large-translation-units 2023-11-11 00:43:58 +01:00
robot-clickhouse
9ac7159a93 Update version_date.tsv and changelogs after v23.10.3.5-stable 2023-11-10 21:07:22 +00:00
Alexey Milovidov
96f73139b6 Check for large translation units 2023-11-10 06:13:55 +01:00
Antonio Andelic
e9542e4153
Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol 
Support compression for keeper protocol
 2023-11-09 10:00:19 +01:00
robot-clickhouse
bc4de36e51 Update version_date.tsv and changelogs after v23.9.4.11-stable 2023-11-08 15:36:31 +00:00
Robert Schulze
38c76eb709
Merge remote-tracking branch 'rschu1ze/master' into pcg 2023-11-08 09:43:27 +00:00
Robert Schulze
180eca7337
Restore check-style 2023-11-08 09:36:43 +00:00
Robert Schulze
e46dbcb2f1
Use pcg/randomSeed() random generator/seed instead of std::mt19937/std::random_device 2023-11-07 18:54:50 +00:00
Robert Schulze
86b8ebf71c
Merge remote-tracking branch 'rschu1ze/master' into arrayRandomSample-improved 2023-11-07 15:25:29 +00:00
serxa
19aa1375fc Merge branch 'master' into async-loader-integration 2023-11-07 10:25:38 +00:00
Robert Schulze
54b5d573d7
Merge remote-tracking branch 'rschu1ze/master' into idatatype-convenience-functions 2023-11-07 10:18:30 +00:00
Robert Schulze
e22c673299
Revert "Revert "Add function arrayRandomSample()"" 
This reverts commit e47e50e30d.
 2023-11-07 10:16:13 +00:00
vdimir
2de73d3456
Merge pull request #56394 from ClickHouse/vdimir/check_doc_file 
Option to check particular file with utils/check-style/check-doc-aspell
 2023-11-07 10:34:16 +01:00
Antonio Andelic
f06d3b29be
Merge pull request #56360 from ClickHouse/add-logs-in-decompressor 
Print info while decompressing the binary
 2023-11-07 09:36:29 +01:00
robot-clickhouse
25558fe0a6
Merge pull request #56390 from ClickHouse/vdimir/doc_architecture_upd_streams 
Update development documentation about data streams
 2023-11-07 00:54:31 +01:00
Alexey Milovidov
e47e50e30d
Revert "Add function arrayRandomSample()" 2023-11-07 02:49:11 +03:00
Robert Schulze
b195cba943
Fix spelling 2023-11-06 20:11:55 +00:00
vdimir
941ece31e1
Option to check particular file with utils/check-style/check-doc-aspell 2023-11-06 19:25:07 +00:00
vdimir
a091f0323e
Update aspell-dict.txt 2023-11-06 19:16:49 +00:00
Smita Kulkarni
3d5f7a65a8 Updated protocol_version and keeper-bench 2023-11-06 15:00:56 +01:00
serxa
6babc8e934 rename metrics for new pools to match settings 2023-11-06 12:24:00 +00:00
vdimir
3b775dee53
Merge pull request #55126 from ClickHouse/vdimir/jaccard_index_perf 
Add function jaccardIndex back with better performance
 2023-11-06 10:39:02 +01:00
Antonio Andelic
fce276c441 Print info while decompressing 2023-11-06 09:29:02 +00:00
Alexander Gololobov
af469cecb6
Merge pull request #56267 from ClickHouse/diag_stack_addr 
Print stack trace addresses in clickhouse-diagnostics
 2023-11-06 10:01:08 +01:00
Robert Schulze
480e284db1
Merge pull request #56088 from jh0x/feature-from-days-zero 
Add function `fromDaysSinceYearZero()`
 2023-11-04 00:17:04 +01:00
robot-clickhouse
a8aa32fd3d Update version_date.tsv and changelogs after v23.10.1.1976-stable 2023-11-02 19:34:42 +00:00
Alexander Gololobov
f21e294330 Update readme 2023-11-02 16:04:54 +01:00
Alexander Gololobov
c1aa49122f Collect addresses in stack traces 2023-11-02 15:56:27 +01:00
vdimir
f7ac4367d7
Add stringJaccardIndex to aspell-dict.txt 2023-11-02 11:37:51 +00:00
Denny Crane
d145ddb293 fix asell 2023-11-02 00:01:42 +01:00
Joanna Hulboj
757dc8b944 Fix typos, add to/fromDaysSinceYearZero to fuzz 2023-11-01 17:48:58 +00:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors 
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
 2023-11-01 14:35:35 +01:00
Kruglov Pavel
bf77ce691c
Merge pull request #55982 from yariks5s/npy_input_format 
New input format Npy
 2023-11-01 14:26:22 +01:00
Nikolay Degterinsky
cd779d4f50
Merge pull request #55856 from ClickHouse/rewrite-delete-docs 
Rewrite DELETE docs
 2023-11-01 00:10:01 +01:00
Nikolay Degterinsky
7738f3aecb
Update aspell-dict.txt 2023-10-31 23:29:27 +01:00
Sergey Suvorov
0a5888b6f8 Add new function names to aspell-dict.txt 2023-10-31 17:04:37 +01:00
Justin de Guzman
a011990fd7
Add clangd recommendation for VS Code (#56071) 
* Add clangd recommendation for VS Code

* Edit docs for clarity and add links

* Adds new words to dictionary. Sorts dictionary.

---------

Co-authored-by: johnnymatthews <9611008+johnnymatthews@users.noreply.github.com>
 2023-10-31 16:35:47 +01:00
robot-clickhouse
3d2e295855 Update version_date.tsv and changelogs after v23.8.5.16-lts 2023-10-31 00:58:27 +00:00
avogar
7eefb72c53 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-10-30 19:44:26 +00:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Alexey Milovidov
6eff22568f
Revert "Add function getHttpHeader" 2023-10-29 19:50:39 +03:00
Kruglov Pavel
bb4b95e891
Merge branch 'master' into schema-inference-union 2023-10-27 14:53:58 +02:00
Sergei Trifonov
a5d7c2b6a2
Merge branch 'master' into async-loader-integration 2023-10-27 10:39:12 +02:00
Robert Schulze
325ff33c3a
Merge pull request #55239 from aiven-sal/aiven-sal/format_query 
Add formatQuery function
 2023-10-26 22:46:01 +02:00
Kruglov Pavel
570b66f027
Merge branch 'master' into schema-inference-union 2023-10-26 19:26:00 +02:00
Salvatore Mesoraca
56bd61d207
Rename formatQueryOneLine -> formatQuerySingleLine 2023-10-26 13:09:20 +02:00
Anton Popov
6ba59b8408
Merge pull request #54364 from Joeywzr/master 
Support jsonMerge function
 2023-10-25 15:27:16 +02:00
yariks5s
a1b9ab5877 added spelling 2023-10-25 10:52:37 +00:00
Salvatore Mesoraca
0bda99e880
Fix code style 2023-10-25 11:07:34 +02:00
Salvatore Mesoraca
6be7fd0fa1
Ignore formatQuery word during spell check 2023-10-24 15:38:24 +02:00
Kruglov Pavel
64e5797fc8
Update aspell-dict.txt 2023-10-24 14:30:26 +02:00
serxa
749cdb9954 Merge branch 'master' into async-loader-integration 2023-10-24 10:09:49 +00:00
Robert Schulze
bef5cea5a0
Merge remote-tracking branch 'rschu1ze/master' into string-addinterval 2023-10-23 14:08:18 +00:00
Denny Crane
38a3655c5e add fibonacci to aspell 2023-10-23 10:09:06 +01:00
Alexander Tokmakov
f899254e2c
Merge pull request #55430 from arthurpassos/properly_split_remote_proxy_http_https 
Properly split remote proxy http https
 2023-10-20 21:15:34 +02:00
Robert Schulze
3551d7f2d6
Update docs 2023-10-20 15:46:17 +00:00
helifu
57d60dc4f2
Add a new column xid for zookeeper_connection (#50702) 
* Refactor the code

* Add a new column xid for zookeeper_connection

* Support hostnames in the configuration

* Fix a typo

* Fix a typo

* Fix a typo

* Fix a bug about connect_time

* Update test case

* Update test case

* Fix a special build check error

* Resolve conflicts caused by rebase.

* Update failed test case

* Refactor the code according to comment

* Fix two compilation errors
 2023-10-20 11:38:44 +02:00
robot-clickhouse
84f2d46642 Update version_date.tsv and changelogs after v23.3.14.78-lts 2023-10-19 18:18:34 +00:00
Sinan
c7f78ac73a
Add aggregation function for Largest-Triangle-Three-Buckets (#53145) 
* Added a simple lttb aggregate function

* Added support for multiple datatypes

* Added support for Date and Date32, updated LTTBData struct

* Updated code to handle bucket size 0 and 1

* Added sort for LTTBData

* Added tests and documentation

* Added some code style fixes

* Added function to new func ref file

* Removed function from new func ref file

* Apply suggestions from code review

* Updated unit tests

* updated LTTB data code

* Minor style fixes

* Updated code with std sort

* updated tests

* Renamed lttb to largestTriangleThreeBuckets

* Added alias lttb

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
 2023-10-18 14:47:18 +02:00
Han Fei
4b23142775
Merge branch 'master' into hanfei/statistic 2023-10-17 16:40:31 +02:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450) 
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
 2023-10-16 17:00:07 -07:00
serxa
0e17da22eb Merge branch 'master' into async-loader-integration 2023-10-16 11:08:29 +00:00
Alexander Tokmakov
e40aa72883
Merge pull request #54826 from JackyWoo/lb_nearest_host_name 
Add load balancing hostname_levenshtein_distance
 2023-10-13 17:23:02 +02:00
Robert Schulze
d02a718076
Merge pull request #55211 from Priyansh121096/master 
Add function byteSwap
 2023-10-13 16:54:28 +02:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
Kruglov Pavel
3eb093d177
Fix style 2023-10-12 14:32:26 +02:00
robot-clickhouse-ci-2
2eedb31ae3
Merge pull request #55498 from bytadaniel/patch-4 
add npm packages to both en and zh docs from ru
 2023-10-12 11:31:24 +02:00
JackyWoo
1f553f3d65 Merge branch 'master' into lb_nearest_host_name 2023-10-12 10:19:17 +08:00
Daniel Byta
e3719f88b2
Update aspell-dict.txt 2023-10-11 20:42:49 +03:00
Arthur Passos
eca411ec92 that it? 2023-10-10 13:14:41 -03:00
Memo
b7f70c2ba3 Merge branch 'master' into master 2023-10-10 20:08:41 +08:00
Joey Wang
06a7b679f6 support merging of nested paths 2023-10-10 14:57:37 +08:00
凌涛
51e2e59a97 Merge remote-tracking branch 'origin/master' into feature/function-getClientHttpHeader 2023-10-10 10:56:24 +08:00
Han Fei
fcb19b4f77 Merge branch 'master' into hanfei/statistic 2023-10-09 14:24:58 +02:00
Robert Schulze
624dbcdb4f
Merge pull request #49794 from Lirikl/arrayFold 
Added function `arrayFold()`
 2023-10-09 13:38:35 +02:00
Robert Schulze
07e0cc196d
Some fixups 2023-10-08 20:27:13 +00:00
Priyansh Agrawal
2c04370e5f Use std::byteswap instead of custom implementations. 
- Also allow signed ints now because std::byteswap accepts them.
- Fix for style check.
 2023-10-07 23:59:24 +00:00
Robert Schulze
73ff017fb5
Merge remote-tracking branch 'rschu1ze/master' into israelov/generate-random-int-array 2023-10-07 18:10:09 +00:00
JackyWoo
784fe880eb Merge branch 'master' into lb_nearest_host_name 2023-10-07 09:04:26 +08:00
Alexey Milovidov
9aaab27373
Merge pull request #55120 from ClickHouse/fix-functions-in-docs 
Fix function names in docs
 2023-09-30 00:36:39 +03:00
Alexey Milovidov
458cbb3b18 Fix function names in docs 2023-09-29 10:15:46 +02:00
robot-clickhouse
485422328d Update version_date.tsv and changelogs after v23.9.1.1854-stable 2023-09-29 07:04:45 +00:00
Robert Schulze
2d750e9e2f
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-reenable-checks 2023-09-27 12:15:29 +00:00
凌涛
0d256a381a add doc 
fix tests

modify code stype and spelling

add tests and modify code style
 2023-09-27 17:03:53 +08:00
JackyWoo
f3bf1f8da9 Fix code style 2023-09-27 12:56:06 +08:00
Alexey Milovidov
9518f68683
Merge pull request #54976 from vitlibar/use-pregenerated-grpc-protocol-pb2 
Use pregenerated gRPC protocol pb2 files to fix test flakyness.
 2023-09-26 23:09:34 +03:00
Han Fei
4e7745f757 Merge branch 'master' into hanfei/statistic 2023-09-26 21:43:53 +02:00
Robert Schulze
cde10fe7b5
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-reenable-checks 2023-09-26 18:59:41 +00:00
Vitaly Baranov
d39bd7154f Use pregenerated gRPC protocol pb2 files to fix test flakyness. 2023-09-26 17:28:19 +02:00
Robert Schulze
e4c081652d
Suppress more checks 2023-09-26 11:01:35 +00:00
Robert Schulze
d24130092b
Fix spelling 2023-09-25 17:08:42 +00:00
vdimir
70ae994e77
Merge pull request #54935 from ucasfl/hamming-distance 
Add several string distance functions
 2023-09-25 17:06:16 +02:00
Priyansh Agrawal
f27a76b923 Add function byteSwap. 
byteSwap accepts an integer `operand` and returns the integer which is
obtained by swapping the **endianness** of `operand` i.e. reversing the
bytes of the `operand`.

Issue: #54734
 2023-09-24 21:02:09 +01:00
flynn
661ba85865 add more functions 2023-09-23 17:17:35 +00:00
flynn
76bc7cf75b fix spell check 2023-09-23 04:14:21 +00:00
Robert Schulze
9a91f97ac4
Merge pull request #53831 from rschu1ze/clang-17 
Switch CI to Clang 17
 2023-09-22 12:28:35 +02:00
Robert Schulze
7b585da613
Fix clang-tidy 2023-09-22 10:12:11 +00:00
Robert Schulze
f5137dd0b4
More clang-tidy fixes 2023-09-21 14:40:57 +00:00
Robert Schulze
50c51c2854
Fix new clang-tidy-s 2023-09-20 22:17:39 +00:00
Han Fei
17243b84ab Merge branch 'master' into hanfei/statistic 2023-09-19 17:09:17 +02:00
Robert Schulze
d31a43a379
Remove Woboq 2023-09-18 17:44:04 +00:00
Yarik Briukhovetskyi
472d4d9503
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-09-18 20:01:29 +03:00
Robert Schulze
b583b80733
Fix spelling 2023-09-18 07:43:06 +00:00
Robert Schulze
40e272521b
Fix spell check 2023-09-18 07:43:03 +00:00
Robert Schulze
f5e8028bb1
Merge pull request #54642 from rschu1ze/broken-re2st 
Remove broken lockless variant of re2
 2023-09-17 15:30:57 +02:00
Andrey Zvonov
9e89055990
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-15 17:06:22 +03:00
Robert Schulze
3935c2bfb2
Merge pull request #54509 from rschu1ze/yyyymmdd 
Add YYYYMMDD[hhmmss]to[Date, Date32, DateTime, DateTime64]()
 2023-09-15 15:47:34 +02:00
Robert Schulze
7b378dbad3
Remove broken lockless variant of re2 2023-09-14 16:40:42 +00:00
Sergei Trifonov
12c71be9ca
Merge branch 'master' into async-loader-integration 2023-09-14 15:29:07 +02:00
Yarik Briukhovetskyi
9a40d517bf
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-09-14 14:05:40 +03:00
Andrey Zvonov
7dd5dbb2ac
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-14 13:49:59 +03:00
serxa
f2900e92c3 fix spell check 2023-09-14 10:46:07 +00:00
Antonio Andelic
6306180333
Merge pull request #53049 from ClickHouse/keeper-batch-flushes 
Try batching multiple flush requests in Keeper
 2023-09-14 11:39:33 +02:00
Andrey Zvonov
ff16ddbbb3
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-14 11:31:49 +03:00
Alexey Milovidov
aaa7025b1a
Merge pull request #54603 from fionera/use-env 
use env to find bash
 2023-09-13 23:50:55 +03:00
Nikolay Degterinsky
140a466a1e
Merge pull request #54400 from evillique/adddate-function 
Add `addDate` function for compatibility with MySQL
 2023-09-13 18:59:26 +02:00
Tim Windelschmidt
7979090333 use env to find bash 2023-09-13 18:57:11 +02:00
Itay Israelov
69ba32940e fix comments: rname randomSampleFromArray --> arrayRandomSample 2023-09-13 13:11:53 +03:00
Nikolay Degterinsky
e648646598 Fixes 2023-09-12 23:11:58 +00:00
Robert Schulze
27ac4be8e2
Fix style 2023-09-11 15:30:06 +00:00
Robert Schulze
49f29861a0
Merge pull request #54479 from rschu1ze/todayssinceyearzero 
Add function toDaysSinceYearZero()
 2023-09-11 17:05:28 +02:00
Antonio Andelic
479ae52f9c Merge branch 'master' into keeper-batch-flushes 2023-09-11 11:36:23 +00:00
Robert Schulze
b72a49f090
Fix style 2023-09-11 06:32:14 +00:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
Han Fei
f9abf16441 fix fast tests 2023-09-10 02:02:01 +02:00
Andrey Zvonov
ff4586e663
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-08 18:17:06 +02:00
Antonio Andelic
5207997bd4 Merge branch 'master' into keeper-batch-flushes 2023-09-08 13:05:47 +00:00
Andrey Zvonov
80aea109b2
Update aspell-dict.txt 2023-09-08 12:49:15 +03:00
Nikolay Degterinsky
9a3ea9d6dc Fix style 2023-09-07 11:31:09 +00:00
serxa
d11a9b4175 update spell dict 2023-09-07 08:51:35 +00:00
Joey Wang
872f981416 add doc 2023-09-07 16:19:17 +08:00
Antonio Andelic
824b90f754 Merge branch 'master' into keeper-batch-flushes 2023-09-06 13:29:35 +00:00
Mikhail Koviazin
f98007a4ed
Replace Turbo-Base64 with aklomp/base64 
Closes #31643
 2023-09-06 13:01:38 +00:00
Robert Schulze
b004aa8076
Fix style 2023-09-05 19:55:11 +00:00
robot-clickhouse
3991c38765 Update version_date.tsv and changelogs after v23.3.13.6-lts 2023-09-05 13:08:25 +00:00
Alexey Milovidov
b2821106fd
Merge pull request #53923 from myrrc/docs/ch-disks 
Add docs for clickhouse-disks
 2023-09-05 02:10:18 +03:00
robot-clickhouse
0ca2c545e9 Update version_date.tsv and changelogs after v23.8.2.7-lts 2023-09-04 20:18:07 +00:00
Alexey Milovidov
a941a040e4
Merge pull request #54259 from ClickHouse/auto/v23.3.12.11-lts 
Update version_date.tsv and changelogs after v23.3.12.11-lts
 2023-09-04 20:42:29 +03:00
robot-clickhouse
5df95f2ed1 Update version_date.tsv and changelogs after v23.3.12.11-lts 2023-09-04 15:22:02 +00:00
Mikhail f. Shiryaev
a082167d85
Move ci-slack-bot from utils to tests/ci 2023-09-04 17:06:51 +02:00
Alexander Tokmakov
a663f7e06a
Update ci-slack-bot.py (#54253) 2023-09-04 15:39:09 +02:00
Antonio Andelic
365bc584ec Merge branch 'master' into keeper-batch-flushes 2023-09-04 07:24:21 +00:00
robot-clickhouse-ci-1
ec628ee697
Merge pull request #54097 from bharatnc/ncb/decode-html-component 
add function decodeHTMLComponent
 2023-09-04 05:00:52 +02:00
robot-clickhouse
cc03880bbd Update version_date.tsv and changelogs after v23.8.1.2992-lts 2023-09-01 16:00:28 +00:00
Yarik Briukhovetskyi
965acddc46
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-09-01 10:57:39 +03:00
Antonio Andelic
dd824fe558 Merge branch 'master' into keeper-batch-flushes 2023-08-31 14:35:36 +00:00
Bharat Nallan Chakravarthy
f6d1f6ce0a fix style check 2023-08-30 22:09:56 -07:00
Mike Kot
8b1e30d774 fix 2023-08-29 13:36:47 +00:00
Andrey Zvonov
6195390c77
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-08-29 13:46:09 +05:00
Sergei Trifonov
c10e42ca05
Merge branch 'master' into async-loader-integration 2023-08-28 20:20:31 +02:00
Antonio Andelic
4137cb916d Merge branch 'master' into keeper-batch-flushes 2023-08-28 13:14:06 +00:00
Andrey Zvonov
c9b0db9c61
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-08-28 17:15:33 +05:00
robot-clickhouse
fa1b5fe2a8 Update version_date.tsv and changelogs after v22.8.21.38-lts 2023-08-28 12:00:47 +00:00
robot-clickhouse
0e277d4f90 Update version_date.tsv and changelogs after v23.7.5.30-stable 2023-08-28 10:06:28 +00:00
Andrey Zvonov
911bf94fbd
Merge branch 'master' into zvonand-globs-small-fix 2023-08-25 23:50:07 +05:00
vdimir
50b8bbe0dc
Merge pull request #53557 from mkmkme/mkmkme/array-shift-rotate 
Added functions `array{Rotate,Shift}{Left,Right}`
 2023-08-25 13:24:31 +02:00
Yarik Briukhovetskyi
72958343ce
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-08-24 12:58:40 +03:00
Mikhail Koviazin
a5eb1aa22f
Added functions array{Rotate,Shift}{Left,Right} 
Fixes #52755 and #52895
 2023-08-24 09:16:39 +00:00
Antonio Andelic
322b53dd62 Merge branch 'master' into keeper-batch-flushes 2023-08-24 09:08:47 +00:00
Alexey Milovidov
d475dc424e
Merge pull request #53701 from ClibMouse/feature/qemu-s390x-docs 
Update s390x VSCode environment setup
 2023-08-23 18:29:45 +03:00
ltrk2
c2559026c4 Extend aspell dictionary 2023-08-23 06:22:11 -07:00
robot-clickhouse
0fc2a5b6f0 Update version_date.tsv and changelogs after v23.3.10.5-lts 2023-08-23 09:10:08 +00:00
Antonio Andelic
625be86dc0 Fix tests 2023-08-23 09:00:57 +00:00
Robert Schulze
a20ceef398
Merge pull request #53447 from davvard/master 
USearch HNSW index for ANN search
 2023-08-21 23:34:26 +02:00
Kruglov Pavel
47b551180b
Merge pull request #52117 from KevinyhZou/support_from_to_utc_timestamp 
Support From/To UTC Timestamp function like spark
 2023-08-21 13:16:57 +02:00
Yarik Briukhovetskyi
c6af1fd6c8
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-08-21 13:06:37 +03:00
robot-clickhouse
c54ff5d451 Update version_date.tsv and changelogs after v23.3.9.55-lts 2023-08-21 08:32:51 +00:00
kevinyhzou
48cb9b59f4 Support from/to utc timestamp 2023-08-21 09:28:00 +08:00
Yarik Briukhovetskyi
ed7d0fa4cc
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-08-19 01:50:56 +03:00
yariks5s
0406001f6e fixed style check 2023-08-18 18:07:37 +00:00
Robert Schulze
b711802c43
Fix spelling 2023-08-16 21:23:11 +00:00
Andrey Zvonov
413b0f227b
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-08-14 10:59:44 +03:00
Krisztián Szűcs
7135b344bf
Documentation: exclude PyArrow from spell checking 2023-08-14 08:49:11 +02:00
Andrey Zvonov
3d902e65e4
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-08-12 23:12:47 +03:00
Alexey Milovidov
67b45619eb
Merge pull request #53239 from evillique/tuple-concat 
Add tupleConcat function
 2023-08-12 03:35:25 +03:00
Andrey Zvonov
02c511a008
Merge branch 'master' into zvonand-globs-small-fix 2023-08-11 15:56:44 +02:00
zvonand
1983c7ce95 update docs 2023-08-11 16:53:17 +03:00
Alexey Milovidov
ae6e59c4c5
Merge pull request #53099 from ClickHouse/remove-wikistat-loader 
Remove old util
 2023-08-10 17:01:57 +03:00
Kruglov Pavel
14aad359e6
Merge pull request #52555 from bigo-sg/starts_ends_with_utf8 
Add new function startsWithUTF8 and endsWithUTF8
 2023-08-10 13:18:04 +02:00
Alexey Milovidov
8f2a0a5290
Merge branch 'master' into remove-wikistat-loader 2023-08-10 03:44:07 +03:00
Nikolay Degterinsky
8c63088a31 Fixes 2023-08-09 21:54:58 +00:00
Alexey Milovidov
964c407d48
Revert "Revert "Upload build time-trace data to CI database"" 2023-08-09 16:11:17 +03:00
Alexander Gololobov
63183c56f1
Revert "Upload build time-trace data to CI database" 2023-08-09 13:58:05 +02:00
Alexey Milovidov
98a2a117c2 Merge branch 'master' into remove-wikistat-loader 2023-08-08 22:36:21 +02:00
Alexey Milovidov
3ffffb0b5e
Merge pull request #53100 from ClickHouse/upload-build-profile 
Upload build time-trace data to CI database
 2023-08-08 23:33:50 +03:00
robot-clickhouse
fe7168c1c3 Update version_date.tsv and changelogs after v23.7.4.5-stable 2023-08-08 19:16:27 +00:00
李扬
d15ae5e120
Merge branch 'master' into starts_ends_with_utf8 2023-08-08 16:18:04 +08:00
Alexey Milovidov
8ce4ff0f95 Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile 2023-08-07 21:18:30 +02:00
Sergei Trifonov
f35c68623d
Merge branch 'master' into async-loader-integration 2023-08-07 11:24:19 +02:00
SmitaRKulkarni
75f81bdc44
Merge pull request #50795 from ClickHouse/azure_table_function_cluster 
Table function azureBlobStorageCluster
 2023-08-07 09:16:52 +02:00
Alexey Milovidov
d977e221b4 Upload build time-trace data to CI database 2023-08-07 03:26:59 +02:00
Alexey Milovidov
c3edb57953 Remove old util 2023-08-07 02:29:29 +02:00
robot-clickhouse
f65fa627e7 Update version_date.tsv and changelogs after v23.7.3.14-stable 2023-08-05 19:26:13 +00:00
SmitaRKulkarni
1e3ae89161
Merge branch 'master' into azure_table_function_cluster 2023-08-04 21:39:32 +02:00
Sergei Trifonov
432d359a2b
Merge branch 'master' into async-loader-integration 2023-08-04 18:51:06 +02:00
Anton Popov
92cb5e9ae3
Merge pull request #52687 from alkorgun/fix-named-collections-on-cluster-23.7 
Fix named collections on cluster 23.7
 2023-08-03 14:50:28 +02:00
robot-clickhouse
659c907d38 Update version_date.tsv and changelogs after v23.7.2.25-stable 2023-08-03 09:55:00 +00:00
Smita Kulkarni
2c47679918 Merge branch 'master' into azure_table_function_cluster 2023-08-02 14:19:45 +02:00
李扬
041af6899d
Merge branch 'master' into starts_ends_with_utf8 2023-08-02 10:29:29 +08:00
Alexander Zaitsev
107759aec8 doc: add ClickBench and AutoFDO to the aspell ignore list 2023-08-01 18:02:48 +02:00
Kruglov Pavel
8f6526a930
Merge branch 'master' into structure-to-schema 2023-08-01 16:22:14 +02:00
Vitaly Baranov
0a8b88eed2
Merge branch 'master' into print-backup-info 2023-08-01 13:15:23 +02:00
Sergei Trifonov
e4ae2ece7c
Merge branch 'master' into async-loader-integration 2023-08-01 13:04:11 +02:00
Alexey Milovidov
985b2a010a
Add a tool to upload -ftime-trace to ClickHouse (#52776) 
* Add a tool to upload `-ftime-trace` to ClickHouse

* Add a tool to upload `-ftime-trace` to ClickHouse

* Add a tool to upload `-ftime-trace` to ClickHouse
 2023-07-31 14:17:47 +02:00
Илья Коргун
9c5b96e26c Add "bugfix" to aspell-ignore 2023-07-30 09:37:19 +03:00
Alexey Milovidov
a4f2eea516 Maybe better 2023-07-30 02:19:39 +02:00
Alexey Milovidov
caa4590361 Merge branch 'master' into check-for-hiding-cyrillic-characters 2023-07-30 02:16:56 +02:00
Kruglov Pavel
3e1c409e60
Merge branch 'master' into structure-to-schema 2023-07-28 11:32:16 +02:00
robot-ch-test-poll
22e5da914c
Merge pull request #52650 from rschu1ze/query-cache-asynchronous_metrics 
Add query cache metrics to SYSTEM.ASYNCHRONOUS_METRICS
 2023-07-28 11:06:55 +02:00
李扬
d0c9425711
Merge branch 'master' into starts_ends_with_utf8 2023-07-28 10:03:39 +08:00
Kruglov Pavel
32d23b0904
Update aspell-dict.txt 2023-07-27 21:28:28 +02:00
Robert Schulze
9340f02d26
Silence spell check 2023-07-27 18:33:07 +00:00
Vitaly Baranov
faca843ac0 Add utility to parse a backup metadata file and print information about the backup. 2023-07-27 18:25:21 +02:00
robot-clickhouse
28c49e3f20 Update version_date.tsv and changelogs after v23.7.1.2470-stable 2023-07-27 13:47:11 +00:00
Alexey Milovidov
6aab4cc835 Check for unexpected cyrillic 2023-07-27 05:25:40 +02:00
Robert Schulze
d4737ca033
Merge pull request #50986 from arenadata/ADQM-822 
Implement support of encrypted elements in configuration file
 2023-07-26 12:27:04 +02:00
taiyang-li
d83eabcf77 fix spell 2023-07-26 17:39:45 +08:00
Nikita Mikhaylov
1dc9ca2c24
Merge pull request #52549 from ClickHouse/whitespace-before-comma 
Check for punctuation
 2023-07-25 20:30:36 +02:00
Yakov Olkhovskiy
e133db7937
Merge pull request #51472 from bigo-sg/substring_index 
Add function substring_index, as in spark or mysql
 2023-07-25 08:43:13 -04:00
taiyang-li
23897b823d fix code style 2023-07-25 20:41:16 +08:00
Alexey Milovidov
21382afa2b Check for punctuation 2023-07-25 06:10:04 +02:00
Roman Vasin
0af869ff0f
Merge branch 'master' into ADQM-822 2023-07-24 12:23:11 +03:00
robot-clickhouse-ci-2
66c0015b87
Merge pull request #52050 from arenadata/ADQM-982 
Subsequence string matching (new hasSubsequence() function)
 2023-07-23 21:18:27 +02:00
robot-ch-test-poll4
1d6e85da91
Merge pull request #52084 from valbok/conv-charsets 
MaterializedMySQL: Introduce charset conversion
 2023-07-23 18:36:30 +02:00
Alexey Milovidov
0b5730ffd0
Merge branch 'master' into fix-system-licenses 2023-07-22 17:53:46 +03:00
Sergei Trifonov
8eaf3b6d94
Merge branch 'master' into async-loader-integration 2023-07-21 21:46:06 +02:00
Antonio Andelic
10c2d5dade
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 13:24:18 +02:00
Antonio Andelic
4a47040763
Merge pull request #52358 from ClickHouse/fix-keeper-apply-snapshot 
Fix `apply_snapshot` in Keeper
 2023-07-21 12:52:12 +02:00
Alexander Tokmakov
c0aa3e4567
Update ci-slack-bot.py 2023-07-20 17:59:43 +03:00
Roman Vasin
8649c84461 Remove conditional linking 2023-07-20 13:28:37 +00:00
Alexander Tokmakov
3c9e46b557
Update ci-slack-bot.py 2023-07-20 16:19:12 +03:00
Antonio Andelic
53c46e2dff
Merge branch 'master' into fix-keeper-apply-snapshot 2023-07-20 14:37:32 +02:00
Alexey Milovidov
f4ec421292
Merge pull request #52106 from Lloyd-Pottiger/add-alias-for-today-and-now 
Add alias for today(curdate/current_date) and now(current_timestamp)
 2023-07-20 15:02:25 +03:00
Antonio Andelic
a24bf14450 Use correct ZXID 2023-07-20 10:44:44 +00:00
Kruglov Pavel
0fca64ced4
Merge pull request #51695 from Avogar/row-binary-with-defaults 
Add RowBinaryWithDefaults format
 2023-07-19 22:10:30 +02:00
Sergei Trifonov
b8a46ff822
Merge branch 'master' into async-loader-integration 2023-07-19 18:45:41 +02:00
alesapin
45a7134478
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-19 14:04:59 +02:00
vdimir
92f04d2c53
Merge pull request #52209 from mkmkme/mkmkme/first-line 2023-07-19 11:10:13 +02:00
SmitaRKulkarni
4456adfd4a
Merge branch 'master' into azure_table_function_cluster 2023-07-19 08:28:30 +02:00
Alexey Milovidov
3c1d881f84
Merge branch 'master' into fix-system-licenses 2023-07-18 23:01:43 +03:00
Song Liyong
6ae5207819 MaterializedMySQL: Introduce charset conversion 2023-07-18 15:55:55 +02:00
Lloyd-Pottiger
a58ace75a2
Merge branch 'master' into add-alias-for-today-and-now 2023-07-18 20:32:32 +08:00
Kruglov Pavel
6985bf0cdb
Merge branch 'master' into row-binary-with-defaults 2023-07-18 13:36:56 +02:00
robot-ch-test-poll2
d816d8b92f
Merge pull request #52198 from azat/qemu-compressor 
Fix self extracting binaries under qemu linux-user (qemu-$ARCH-static)
 2023-07-18 12:02:47 +02:00
Mikhail Koviazin
4f7fd69883
Added function firstLine to extract the first line from a multiline string 
Fixes #51172
 2023-07-18 12:18:26 +03:00
Lloyd-Pottiger
9d11385543
Merge branch 'master' into add-alias-for-today-and-now 2023-07-18 10:29:49 +08:00
Alexey Milovidov
f4e095b502
Merge pull request #52149 from ucasfl/array_concat_agg 
Add array_concat_agg for compatibility with BigQuery
 2023-07-18 03:03:27 +03:00
Sergei Trifonov
850ab23991
Merge branch 'master' into async-loader-integration 2023-07-17 19:14:54 +02:00
Kruglov Pavel
1e616e17ab
Merge branch 'master' into row-binary-with-defaults 2023-07-17 19:13:57 +02:00
SmitaRKulkarni
e4fb9e88f8
Merge branch 'master' into azure_table_function_cluster 2023-07-17 17:23:38 +02:00
vdimir
5de1cfee7d
Merge pull request #51735 from arenadata/ADQM-976 2023-07-17 16:24:11 +02:00
Azat Khuzhin
1fb7605fb4 Fix self extracting binaries under qemu linux-user (qemu-$ARCH-static) 
The problem was that the decompressor uses realpath(/proc/self/exe)
instead of readlink(/proc/self/exe), while realpath() does lots of
trickerly [1] which leads to bypassing qemu linux-user override [2] of
/proc/self/exe to the executable with with it had been called -- and
the reason for this is that the getpid() after unshare returns 1, while
reading /proc/self returns the pid that was before unshare (from the
chroot) [3].

  [1]: 4290aed051/stdlib/canonicalize.c (L223)
  [2]: ed8ad9728a/linux-user/syscall.c (L8634)
  [3]: https://gist.github.com/azat/fcbd8b6c26afd505ae5f3387fc15f0e2

But note, that even after this patch qemu without binfmt will not work,
due to internally the code calls execv() while qemu does not handle it
(see [4]).

  [4]: https://patchwork.kernel.org/project/qemu-devel/patch/1453091602-21843-1-git-send-email-petrosagg@gmail.com/

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-17 13:10:40 +02:00
Azat Khuzhin
16165d9498 Improve error messages for decompressor 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-17 13:10:40 +02:00
Azat Khuzhin
c374653c7b Revert "Merge pull request #52138 from azat/decompressor-inode" 
This reverts commit 6524031348, reversing
changes made to 9bf114f9a3.

This was not a good idea, since the underlying problem was that
`/proc/self/exe` was pointing to `qemu-$ARCH-static` (because the code
uses realpath() over normal interface readlink(), which is not caught by
the qemu linux-user).

And this means that later, it will try to overwrite incorrect binary and
then execute some garbage.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-17 13:10:29 +02:00
Antonio Andelic
61dc020b4d
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-17 12:50:17 +02:00
Dmitry Kardymon
2de9ea6925 Merge remote-tracking branch 'origin/master' into ADQM-982 2023-07-17 10:03:16 +00:00
Lloyd-Pottiger
3636c2a847
Merge branch 'master' into add-alias-for-today-and-now 2023-07-17 14:28:24 +08:00
FFFFFFFHHHHHHH
0895e47629
Merge branch 'master' into jaccard_similarity 2023-07-17 10:33:10 +08:00
Lloyd-Pottiger
e38a9de7c9 add aspell 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>
 2023-07-17 10:24:45 +08:00
flynn
7f80f7dcb0
Merge branch 'master' into array_concat_agg 2023-07-17 01:15:24 +08:00
flynn
6899070f95 fix 2023-07-16 09:54:13 +00:00
Azat Khuzhin
20a671b8cf Skip protection from double decompression if inode from maps cannot be obtained 
Under some circumstances, like using qemu-$ARCH-static, /proc/self/maps
will not contain information about /proc/self/exe.

Well, strictly speaking it does contains, however qemu will not pass it
to the user program:

<details>

<summary>strace</summary>

    $ sudo strace -s10000 -f arch-chroot . /qemu-riscv64-static /clickhouse
    ...
    execve("/qemu-riscv64-static", ["/qemu-riscv64-static", "/clickhouse"], 0x7fffffffe458 /* 20 vars */) = 0
    readlinkat(AT_FDCWD, "/proc/self/exe", "/qemu-riscv64-static", 4096) = 20
    openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_CLOEXEC) = 4
    [pid  3126] read(4, "00010000-00111000 r--p 00000000 fe:01 30312571                           /clickhouse\n00111000-00119000 r--p 00100000 fe:01 30312571                           /clickhouse\n00119000-0011a000 rw-p 00108000 fe:01 30312571                           /clickhouse\n0011a000-0013d000 rw-p 00000000 00:00 0 \n4000000000-4000001000 ---p 00000000 00:00 0 \n4000001000-4000801000 rw-p 00000000 00:00 0 \n4000801000-400081a000 r--p 00000000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081a000-400081b000 ---p 00000000 00:00 0 \n400081b000-400081c000 r--p 00019000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081c000-400081e000 rw-p 0001a000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081e000-400081f000 r--p 00000000 00:00 0 \n400081f000-4000922000 r--p 00000000 fe:01 30316935 /lib/riscv64-linux-gnu/libc-2.32.so\n4000922000-4000926000 r--p 00102000 fe:01 30316935                       /lib/riscv64-linux-gnu/libc-2.32.so\n4000926000-4000928000 rw-p 00106000 fe:01 30316935                       /lib/riscv64-linux-gnu/libc-2.32.so\n4000928000-400092d000 rw-p 00000000 00:00 0 \n400092d000-40009af000 r--p 00000000 fe:01 30316943                       /lib/riscv64-linux-gnu/libm-2.32.so\n40009af000-40009b0000 r--p 00081000 fe:01 30316943                       /lib/riscv64-linux-gnu/libm-2.32.so\n40009b0000-40009b1000 rw-p 00082000 fe:01 30316943 /lib/riscv64-linux-gnu/libm-2.32.so\n40009b1000-40009c5000 r--p 00000000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c5000-40009c6000 r--p 00013000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c6000-40009c7000 rw-p 00014000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c7000-40009cb000 rw-p 00000000 00:00 0 \n40009cb000-40009cd000 r--p 00000000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009cd000-40009ce000 r--p 00001000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009ce000-40009cf000 rw-p 00002000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009cf000-40009d1000 rw-p 00000000 00:00 0 \n7fffe8000000-7fffeffff000 rwxp 00000000 00:00 0 \n7fffeffff000-7ffff0000000 ---p 00000000 00:00 0 \n7ffff0000000-7ffff0021000 rw-p 00000000 00:00 0 \n7ffff0021000-7ffff4000000 ---p 00000000 00:00 0 \n7ffff6b4b000-7ffff6b5b000 rw-p 00000000 00:00 0 \n7ffff71ff000-7ffff7200000 ---p 00000000 00:00 0 \n7ffff7200000-7ffff7a00000 rw-p 00000000 00:00 0\n7ffff7a00000-7ffff7a3c000 r--p 00000000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7a3c000-7ffff7c74000 r-xp 0003c000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7c74000-7ffff7d77000 r--p 00274000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7d77000-7ffff7dce000 r--p 00377000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7dce000-7ffff7df7000 rw-p 003ce000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7df7000-7ffff7e0c000 rw-p 00000000 00:00 0                          [heap]\n7ffff7e0c000-7ffff7e70000 rw-p 00000000 00:00 0                          [heap]\n7ffff7f42000-7ffff7ff9000 rw-p 00000000 00:00 0 \n7ffff7ff9000-7ffff7ffd000 r--p 00000000 00:00 0                          [vvar]\n7ffff7ffd000-7ffff7fff000 r-xp 00000000 00:00 0                          [vdso]\n7ffffffde000-7ffffffff000 rw-p 00000000 00:00 0                          [stack]\nffffffffff600000-ffffffffff601000 --xp 00000000 00:00 0                  [vsyscall]\n", 4096) = 3608
    [pid  3126] read(4, "", 1024)           = 0
    [pid  3126] close(4)                    = 0
    [pid  3126] write(3, "10000-111000 r-xp 00000000 fe:01 30312571", 41) = 41
    [pid  3126] write(3, "                                /clickhouse\n", 44) = 44
    [pid  3126] write(3, "111000-119000 r--p 00100000 fe:01 30312571", 42) = 42
    [pid  3126] write(3, "                               /clickhouse\n", 43) = 43
    [pid  3126] write(3, "119000-11a000 rw-p 00108000 fe:01 30312571", 42) = 42
    [pid  3126] write(3, "                               /clickhouse\n", 43) = 43
    [pid  3126] write(3, "11a000-13d000 rw-p 00000000 00:00 0", 35) = 35
    [pid  3126] write(3, "                                      \n", 39) = 39
    [pid  3126] write(3, "4000000000-4000001000 ---p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "4000001000-4000801000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              [stack]\n", 38) = 38
    [pid  3126] write(3, "4000801000-400081a000 r-xp 00000000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57 <unfinished ...>
    [pid  3127] <... clock_nanosleep resumed>0x7ffff79ff060) = 0
    [pid  3126] <... write resumed>)        = 57
    [pid  3127] clock_nanosleep(CLOCK_REALTIME, 0, {tv_sec=0, tv_nsec=10000000},  <unfinished ...>
    [pid  3126] write(3, "400081a000-400081b000 ---p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400081b000-400081c000 r--p 00019000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57) = 57
    [pid  3126] write(3, "400081c000-400081e000 rw-p 0001a000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57) = 57
    [pid  3126] write(3, "400081e000-400081f000 r-xp 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400081f000-4000922000 r-xp 00000000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000922000-4000926000 r--p 00102000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000926000-4000928000 rw-p 00106000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000928000-400092d000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400092d000-40009af000 r-xp 00000000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009af000-40009b0000 r--p 00081000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009b0000-40009b1000 rw-p 00082000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009b1000-40009c5000 r-xp 00000000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c5000-40009c6000 r--p 00013000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c6000-40009c7000 rw-p 00014000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c7000-40009cb000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "40009cb000-40009cd000 r-xp 00000000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009cd000-40009ce000 r--p 00001000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009ce000-40009cf000 rw-p 00002000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009cf000-40009d1000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31

</details>

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-16 08:17:14 +02:00
Alexey Milovidov
527d77bc0f system.licenses table will display hard forks 2023-07-14 21:12:12 +02:00
robot-ch-test-poll
93b40c490f
Merge pull request #51945 from arenadata/ADQM-950-B 
Implement support of date/time format specifiers in log and error log file names
 2023-07-14 18:54:27 +02:00
robot-clickhouse
8916e7d69b Update version_date.tsv and changelogs after v23.3.8.21-lts 2023-07-13 08:49:48 +00:00
robot-clickhouse
798f31a612 Update version_date.tsv and changelogs after v23.4.6.25-stable 2023-07-12 12:36:57 +00:00
Roman Vasin
b6023d9f62 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-822 2023-07-11 10:35:31 +00:00
Robert Schulze
521c993eff
Merge branch 'master' into jaccard_similarity 2023-07-11 10:36:18 +02:00
Dmitry Kardymon
ae69627d87 Merge remote-tracking branch 'origin/master' into ADQM-982 2023-07-11 08:16:21 +00:00