Commit Graph

2405 Commits

Author SHA1 Message Date
Raúl Marín
52b14c3f0a Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-02-27 16:40:59 +01:00
Robert Schulze
e185805c1c
Minor: Replace boost::algorithm::ends_with() by std::string::ends_with() 2024-02-27 15:28:02 +00:00
Yarik Briukhovetskyi
7c6a5f4513
Merge pull request #59598 from yariks5s/group_array_intersect
New aggregate function groupArrayIntersect
2024-02-27 14:30:49 +01:00
Raúl Marín
c1c4a8c02a Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-02-27 12:49:18 +01:00
Alexey Milovidov
043da08143
Fix style 2024-02-27 03:50:30 +03:00
Anton Popov
d683977fe9 Revert "Revert "Add table function mergeTreeIndex""
This reverts commit 1e4199d704.
2024-02-26 22:47:39 +00:00
Alexey Milovidov
04fe5dc55c Merge branch 'master' into fix-inconsistent-formatting 2024-02-26 23:46:24 +01:00
Alexey Milovidov
0b90076a36
Revert "Revert "Check stack size in Parser"" 2024-02-27 01:34:50 +03:00
Alexander Tokmakov
1e4199d704
Revert "Add table function mergeTreeIndex" 2024-02-26 19:37:06 +01:00
Alexey Milovidov
a3f1411679 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-26 19:01:11 +01:00
Anton Popov
814cd53918
Merge pull request #58140 from CurtizJ/storage-merge-tree-index
Add table function `mergeTreeIndex`
2024-02-26 16:31:56 +01:00
Raúl Marín
dfbca34298
Merge pull request #60053 from ClickHouse/melvynator-patch-2
Update settings.md
2024-02-26 16:22:08 +01:00
Robert Schulze
048f7ec3e9
Merge pull request #59516 from rschu1ze/cgroup-observing-memory-tracker
Update memory tracker periodically with cgroup memory usage
2024-02-26 15:27:19 +01:00
Raúl Marín
a8878bfdc5 Merge remote-tracking branch 'blessed/master' into melvynator-patch-2 2024-02-26 14:18:41 +01:00
Yarik Briukhovetskyi
e04a89349d
Merge branch 'ClickHouse:master' into group_array_intersect 2024-02-26 12:29:22 +01:00
Alexey Milovidov
9e32d0f5b2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-23 15:05:46 +01:00
Alexander Tokmakov
97ed2c05b0 Merge branch 'master' into fix_undead_sessions 2024-02-22 14:36:36 +01:00
Alexey Milovidov
6c9e7073c7 Fix varieties and curiosities 2024-02-22 10:06:38 +01:00
yariks5s
626eab073c review 2024-02-21 13:15:19 +00:00
Robert Schulze
6a027b3528
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-21 11:48:34 +00:00
Antonio Andelic
fee1565780
Revert "Check stack size in Parser" 2024-02-21 11:33:08 +01:00
Alexander Tokmakov
45d407034f Merge branch 'master' into fix_undead_sessions 2024-02-20 22:21:37 +01:00
Antonio Andelic
a0bfb47e95 Merge branch 'master' into keeper-more-resilient-disks 2024-02-20 13:51:23 +01:00
Anton Popov
0aa8dafe0a Merge remote-tracking branch 'upstream/master' into HEAD 2024-02-19 14:07:55 +00:00
Robert Schulze
ba9661a5d4
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-19 09:54:08 +00:00
Alexey Milovidov
6fd563df52 Miscellaneous 2024-02-19 02:58:51 +01:00
Alexey Milovidov
2f315e0eb5 Style check for abbreviations 2024-02-17 02:14:15 +01:00
Alexander Tokmakov
228a29b93f fix 2024-02-16 14:05:22 +01:00
Antonio Andelic
0f489de46e
Merge pull request #59945 from ClickHouse/keeper-prometheus-filtered-events
Send only Keeper related metrics/events for Prometheus
2024-02-16 09:43:43 +01:00
Peignon Melvyn
8ccd41f943
Update aspell-dict.txt 2024-02-16 05:08:51 +01:00
Yarik Briukhovetskyi
a41edd8646
Merge branch 'master' into group_array_intersect 2024-02-15 19:50:57 +01:00
Yarik Briukhovetskyi
a7af4e860e
Merge pull request #60014 from ClickHouse/docs-starts-with-UTF8-min-version
[Docs] Add min version for startsWithUTF8
2024-02-15 13:09:25 +01:00
Yarik Briukhovetskyi
7396fa0b14 add docs spelling 2024-02-15 11:23:54 +00:00
Robert Schulze
ddaef8d342
Merge pull request #59752 from rschu1ze/countMatches-fuzzed
Fix AST fuzzer issue in function `countMatches`
2024-02-15 10:02:48 +01:00
Alexey Milovidov
0b58f16938
Merge pull request #59964 from ClickHouse/cleanups
Cleanups
2024-02-15 02:59:54 +01:00
robot-clickhouse
08df19157b Update version_date.tsv and changelogs after v24.1.5.6-stable 2024-02-14 17:22:21 +00:00
Antonio Andelic
40d4fc1c24 More resilient Disk related operations 2024-02-14 14:53:22 +01:00
robot-clickhouse
7514158353 Update version_date.tsv and changelogs after v24.1.4.20-stable 2024-02-14 10:30:32 +00:00
Mikhail f. Shiryaev
9e7ac6d0ee
Revert "Update version_date.tsv and changelogs after v24.1.4.19-stable" 2024-02-14 10:07:09 +01:00
Robert Schulze
7b7ea6d477
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-14 08:56:22 +00:00
robot-clickhouse
3c0abe08cb Update version_date.tsv and changelogs after v24.1.4.19-stable 2024-02-14 00:29:24 +00:00
Alexey Milovidov
2b4949bd18 Cleanups 2024-02-14 00:21:13 +01:00
Antonio Andelic
2389cd5e61 Fix style 2024-02-13 16:27:29 +01:00
Nikita Taranov
91a38e73b4 impl 2024-02-12 19:36:12 +01:00
Yakov Olkhovskiy
3aefd0f50b copy on mac instead renaming 2024-02-12 18:01:43 +00:00
Raúl Marín
c7f18be9a3 Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-02-12 18:24:32 +01:00
yariks5s
bba0fdee97 fix style 2024-02-12 11:57:11 +00:00
Antonio Andelic
36b966967b Merge branch 'master' into keeper-more-reduce 2024-02-12 10:03:07 +01:00
Alexey Milovidov
a65b9cc1f8
Merge pull request #59800 from ClickHouse/auto/v23.12.4.15-stable
Update version_date.tsv and changelogs after v23.12.4.15-stable
2024-02-11 23:41:09 +01:00
Robert Schulze
04f6178176
Fix spellcheck, pt. II 2024-02-10 16:32:49 +00:00
Robert Schulze
3a4b6a2379
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-10 13:53:19 +00:00
Robert Schulze
f1193bcd5d
Fix spellcheck 2024-02-10 13:22:58 +00:00
Maksim Kita
dc52def9eb Revert "Revert "Poco Logger small refactoring"" 2024-02-09 21:39:35 +03:00
robot-clickhouse
582abd40fd Update version_date.tsv and changelogs after v23.12.4.15-stable 2024-02-09 12:25:38 +00:00
Raúl Marín
d17b0867e6 Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-02-09 13:08:23 +01:00
Antonio Andelic
d2eac53c86 Fix 2024-02-09 12:06:01 +01:00
Robert Schulze
5f542bf38d
Fix spelling 2024-02-08 16:52:32 +00:00
Antonio Andelic
dfb3a8f7be Another fix 2024-02-08 17:17:12 +01:00
Antonio Andelic
15c89bdd66 Merge branch 'master' into keeper-more-reduce 2024-02-07 14:21:31 +01:00
Robert Schulze
7edcb86c08
Merge pull request #58632 from ClibMouse/series_outlier
Added function `seriesOutliersTukey` for outlier detetion in series data
2024-02-07 13:08:53 +01:00
Yakov Olkhovskiy
648fa52583 move instead copy 2024-02-06 18:48:57 +00:00
Antonio Andelic
a0170bcbd5 Fix utils 2024-02-05 17:58:33 +01:00
Raúl Marín
062b0b211e
Merge pull request #59509 from ClickHouse/revert-59375-poco-logger-small-refactoring
Revert "Poco Logger small refactoring"
2024-02-02 16:06:12 +01:00
robot-clickhouse
67ac92e1a1 Update version_date.tsv and changelogs after v23.11.5.29-stable 2024-02-02 12:55:17 +00:00
robot-clickhouse
e7f63abc2f Update version_date.tsv and changelogs after v24.1.2.5-stable 2024-02-02 11:41:46 +00:00
Raúl Marín
87d493533c
Revert "Poco Logger small refactoring" 2024-02-02 12:10:05 +01:00
Maksim Kita
056108667f Fixed tests 2024-02-01 12:51:50 +03:00
Maksim Kita
ecbea6f625 Updated implementation 2024-02-01 12:51:50 +03:00
Alexey Milovidov
8d2f3508f2
Merge pull request #58767 from gingerwizard/weather-data
weather data
2024-01-31 23:12:08 +01:00
Alexey Milovidov
5128023e8f
Merge pull request #59350 from AVMusorin/clickhouse-client-docs
docs: added hidden clickhouse-client shortkeys and aliases
2024-01-31 23:11:25 +01:00
Bhavna Jindal
4bc26fe45f Added support for custom percentiles and K 2024-01-31 10:41:05 -08:00
Bhavna Jindal
d2ce39387f implemented series_outlier method 2024-01-31 10:39:39 -08:00
Kruglov Pavel
325419b096
Merge pull request #59398 from Avogar/variant-type-func
Add function variantType
2024-01-31 13:06:54 +01:00
Nikolai Kochetov
7e722b52a9
Merge pull request #59003 from kitaisreal/revert-57519-revert-53562-group_sorted_array_function
Revert "Revert "Add new aggregation function groupArraySorted()""
2024-01-31 12:31:26 +01:00
Dale Mcdiarmid
db84527dd0 more words 2024-01-30 20:39:37 +00:00
Dale Mcdiarmid
4dbf184da6 Merge branch 'weather-data' of github.com:gingerwizard/ClickHouse into weather-data 2024-01-30 20:38:38 +00:00
Dale Mcdiarmid
0f5cb76a61 more words 2024-01-30 20:37:51 +00:00
Kruglov Pavel
80376fdbfa
Fix style 2024-01-30 19:28:39 +01:00
robot-clickhouse
ef6c90c71b Update version_date.tsv and changelogs after v24.1.1.2048-stable 2024-01-30 18:01:46 +00:00
Maksim Kita
20c1f0c18f Revert "Revert "Add new aggregation function groupArraySorted()"" 2024-01-30 17:15:29 +03:00
Aleksandr Musorin
49d2b26820 Added new words in aspell-dict 2024-01-30 12:11:00 +01:00
Alexey Milovidov
798f655276 Rename quantileDDSketch to quantileDD 2024-01-30 11:49:56 +01:00
Dale McDiarmid
a4ed4a1827
Merge branch 'master' into weather-data 2024-01-30 09:12:32 +00:00
Dale Mcdiarmid
7e0bea4a66 fix spelling 2024-01-30 08:55:40 +00:00
Raúl Marín
ab2b12ba9f Fix typo 2024-01-29 11:40:12 +01:00
UnamedRus
94770f8d8a
Merge branch 'master' into topk-statistics-count-errors 2024-01-28 20:50:45 +03:00
avogar
5833641fa5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into variant-data-type 2024-01-26 16:54:02 +00:00
Raúl Marín
c10a0f1253 Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-01-24 21:04:00 +01:00
Anton Popov
bceda4cd29 Merge remote-tracking branch 'upstream/master' into HEAD 2024-01-23 14:03:34 +00:00
Antonio Andelic
59f9abcf58 Merge branch 'master' into keeper-reduce-memory 2024-01-22 08:04:17 +00:00
Antonio Andelic
0132455b39 Reduce Keeper memory usage 2024-01-19 17:00:53 +00:00
Kruglov Pavel
5444cde408
Merge branch 'master' into variant-data-type 2024-01-18 18:31:27 +01:00
Dale McDiarmid
8b730811ef
Update aspell-dict.txt 2024-01-18 13:24:40 +00:00
Raúl Marín
6aa5ac4cc6 Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-01-18 12:04:19 +01:00
Robert Schulze
316669b90f
Merge pull request #58396 from zenmiao7/u/zhengmiao/AddArrayFunctionShingles
Add function `arrayShingles()`
2024-01-18 11:38:56 +01:00
Srikanth Chekuri
c23c7e0b6f
feat: add DDSketch quantile (#56342)
* feat: add DDSketch quantile

* Fix StyleCheck

* Move quantileddsketch.md under right dir

* Update stateless test number and add stateful test

* Throw exception when relative accuracy is too low

* Update test number

* Fix undefined behaviour for empty store

* Fix quantileGK test

* Update test numbers

* Update src/AggregateFunctions/

* Throw exception on out of range values

* Update relative accuracy docs and add encoding details

* Address review comments and suggestions

* Remove unused function

* Address alexey review comments

* Remove unused function isFloat64FieldType

* Throw error on invalid relative accuracy

* Simplify mapping

* Address remaining review comments

* Add effective memory usage suggestions

* Fix Stylecheck

* Fix fast test

* Incorporate bins capacity suggestion

* Fix fuzzer

* Remove inheritance in Mapping, Store and DDSketch

* Add checks for bin resizing

* Add note about the binary compatible implementation
2024-01-17 19:51:32 -08:00
Robert Schulze
226f1804b7
Fix spelling and style 2024-01-17 15:26:18 +00:00
Raúl Marín
d7b59d1eb7 Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-01-16 18:19:07 +01:00
Anton Popov
134d389bea Merge remote-tracking branch 'upstream/master' into HEAD 2024-01-15 18:23:25 +00:00
Antonio Andelic
76c9bf42d7 Add docs for allocation profiling 2024-01-15 13:57:16 +01:00
Alexey Milovidov
c132e0141c
Merge pull request #58791 from ClickHouse/better-stateful-tests
Simplify stateful tests
2024-01-14 21:39:13 +01:00
Alexander Tokmakov
5128607995
Merge pull request #58393 from jaymebrd/feat/add-from-modifier-sync-replica-lightweight
add `from srcreplicas` modifier  for `SYSTEM SYNC REPLICA LIGHTWEIGHT`
2024-01-14 20:53:16 +01:00
UnamedRus
877c643955 fix docs 2024-01-13 23:53:05 +00:00
Alexey Milovidov
7ca8ea9d23 Simplify stateful tests 2024-01-13 23:53:01 +01:00
Raúl Marín
c65677e24b Merge remote-tracking branch 'blessed/master' into argmin_optimization 2024-01-12 10:07:22 +01:00
Robert Schulze
52d75ab68f
Merge pull request #58458 from rschu1ze/replace-std_regexp-by-re2
Replace `std::regex` by re2
2024-01-10 17:46:54 +01:00
Robert Schulze
582a9cc2a7
Merge pull request #58655 from rschu1ze/docs-match
Document that `match()` can use `ngrambf_v1` and `tokenbf_v1` indexes
2024-01-10 15:43:52 +01:00
Robert Schulze
d7fbb1a4d9
Fix style 2024-01-10 13:54:52 +00:00
Robert Schulze
a0128e0f51
Merge pull request #58544 from rschu1ze/sqid-decode
Add `sqidDecode()` function
2024-01-10 13:47:13 +01:00
Robert Schulze
499227b9cf
Merge remote-tracking branch 'rschu1ze/master' into replace-std_regexp-by-re2 2024-01-10 10:02:53 +00:00
Robert Schulze
4cacfa6b43
Merge pull request #57509 from jinjunzh/qatzstd_main
Add Intel-QAT-based `ZSTD_QAT` compression codec
2024-01-10 10:31:39 +01:00
Kseniia Sumarokova
1b517105db
Merge pull request #57323 from valbok/mysql-binlog-client
MaterializedMySQL: Introduce MySQL Binlog Client
2024-01-10 09:08:13 +01:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-09 20:36:02 +00:00
Raúl Marín
d3cbbb319e Implement argMin 2024-01-09 20:58:05 +01:00
Robert Schulze
69ba1a706a
Merge remote-tracking branch 'rschu1ze/master' into string-similarity 2024-01-09 15:22:52 +00:00
Robert Schulze
64ab30f446
Merge pull request #57078 from ClibMouse/seriesDecompose
Seasonal decompose of time series into seasonal, trend and residue components
2024-01-09 11:18:13 +01:00
Kruglov Pavel
b947609b8e
Merge branch 'master' into variant-data-type 2024-01-08 15:04:51 +01:00
Robert Schulze
a2a86caf0f
Fix style, pt. II 2024-01-08 13:45:46 +00:00
Jayme Bird
4f7e4fef40 ignore spelling srcReplicas 2024-01-08 12:58:26 +00:00
Robert Schulze
f553b55e3a
Merge remote-tracking branch 'rschu1ze/master' into regex-std-re2 2024-01-07 22:31:35 +00:00
Robert Schulze
8e804487f3
Some fixups 2024-01-07 22:28:08 +00:00
Robert Schulze
14cda082d2
Fix style 2024-01-07 18:08:52 +00:00
Robert Schulze
0f51e32bb5
Rename from ZSTDQPL to ZSTD_QPL 2024-01-07 17:47:31 +00:00
Robert Schulze
53965bb9f1
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-07 14:11:22 +00:00
Robert Schulze
5f105a56af
Fix style 2024-01-07 08:34:41 +00:00
Robert Schulze
dd2d9ff168
Minor fixes 2024-01-07 08:25:19 +00:00
Robert Schulze
d54e500832
Merge remote-tracking branch 'rschu1ze/master' into punycode-revert-revert 2024-01-07 08:08:46 +00:00
Robert Schulze
1e5f7ff80d
Merge remote-tracking branch 'rschu1ze/master' into sqid-decode 2024-01-07 07:55:06 +00:00
Robert Schulze
44b9547fba
Rename decode/encodeSqid() to sqidDecode/Encode() 2024-01-05 21:40:35 +00:00
robot-clickhouse
5b9cc914db Update version_date.tsv and changelogs after v23.8.9.54-lts 2024-01-05 14:11:11 +00:00
Robert Schulze
a813431fcb
Fix spelling 2024-01-03 20:09:12 +00:00
Robert Schulze
8d4b519bb1
Replace std::regex by re2 2024-01-03 15:06:20 +00:00
Val Doroshchuk
5c221d123d MaterializedMySQL: Introduce MySQL Binlog Client
One binlog connection for many databases.

Suggesting to disable this feature by default for now. It should be explicitly enabled by SETTINGS use_binlog_client=1.
But if you would permanently enable it in MaterializedMySQLSettings, it should keep old behavior and all tests should pass too.

1. Introduced `IBinlog` and its impl to read the binlog events from socket - `BinlogFromSocket`, or file - `BinlogFromFile`. Based on prev impl of `EventBase` and the same old binlog parsers. It fully keeps BC with old version. Fixed `./check-mysql-binlog` to test new impl.
2. Introduced `BinlogEventsDispatcher`, it reads the event from the source `IBinlog` and sends it to currently attached `IBinlog` instances.
3. Introduced `BinlogClient`, which is used to group a list of `BinlogEventsDispatcher` by MySQL binlog connection which is defined by `user:password@host:port`. All dispatchers with the same binlog position should be merged to one.
4. Introduced `BinlogClientFactory`, which is a singleton and it is used to track all binlogs created over the instance.
5. Introduced `use_binlog_client` setting to `MaterializedMySQL`, which forces to reuse a `BinlogClient` if it already exists in `BinlogClientCatalog` or create new one. By default, it is disabled.
6. Introduced `max_bytes_in_binlog_queue` setting to define the limit of bytes in binlog's queue of events. If bytes in the queue increases this limit, `BinlogEventsDispatcher` will stop reading new events from source `IBinlog` until the space for new events will be freed.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
8. Introduced `max_bytes_in_binlog_dispatcher_buffer` setting to define max bytes in the binlog dispatcher's buffer before it is flushed to attached binlogs.
9. Introduced `max_flush_milliseconds_in_binlog_dispatcher` setting to define max milliseconds in the binlog dispatcher's buffer to wait before it is flushed to attached binlogs.
10. Introduced `system.mysql_binlogs` system table, which shows a list of active binlogs.
11. Introduced `UnparsedRowsEvent` and `MYSQL_UNPARSED_ROWS_EVENT`, which defines that an event is not parsed and should be explicitly parsed later.
12. Fixed bug when not possible to apply DDL since syntax error or unsupported SQL.

@larspars is the author of following:
`GTIDSets::contains()`
`ReplicationHelper`
`shouldReconnectOnException()`
2024-01-03 15:26:09 +01:00
Kruglov Pavel
4d8cf71ba7
Merge branch 'master' into variant-data-type 2024-01-03 15:21:23 +01:00
Robert Schulze
2186aa8f21
Revert "Revert "Implement punycode encoding/decoding""
This reverts commit 345d29a3c1.
2024-01-03 08:03:01 +00:00
Bhavna Jindal
6d58c99408 fixed the failing fasttest and style-check 2024-01-02 08:52:28 -08:00
Bhavna Jindal
a407cd270d Added new library stl-cpp for sesonal decompose of time series data 2024-01-02 08:48:10 -08:00
Alexey Milovidov
78523639e0 Remove function 2023-12-30 14:52:54 +01:00
Alexey Milovidov
96876aa4f4
Merge pull request #58345 from ClickHouse/dos-windows
Add a style check against DOS and Windows
2023-12-29 15:02:46 +01:00
Alexey Milovidov
4843d5d099
Update check-style 2023-12-29 16:29:30 +03:00
Alexey Milovidov
48a397577c Add a style check against DOS and Windows 2023-12-29 13:10:40 +01:00
Michael Kolupaev
609b2c216c Fix some of the CI 2023-12-28 17:56:05 +00:00
Anton Popov
482e01dea3 add docs 2023-12-28 17:36:56 +00:00
Alexander Tokmakov
38fe70c68a
Revert "Refreshable materialized views (takeover)" 2023-12-28 13:12:20 +01:00
robot-clickhouse
27657a3eb6 Update version_date.tsv and changelogs after v23.12.1.1368-stable 2023-12-28 10:32:09 +00:00
Alexey Milovidov
a2faa65b08
Merge pull request #56946 from ClickHouse/mv
Refreshable materialized views (takeover)
2023-12-28 09:29:44 +01:00
Alexey Milovidov
345d29a3c1
Revert "Implement punycode encoding/decoding" 2023-12-28 09:12:22 +03:00
Michael Kolupaev
673743e2ac Fix some of the CI 2023-12-27 20:24:55 +00:00
Sema Checherinda
617ee5abaf
Merge pull request #57551 from bharatnc/ncb/async-metrics-pri-key-size
add asynchronous metrics for total primary key size in memory and allocated
2023-12-27 20:24:20 +01:00
Alexey Milovidov
d0ca383bca
Merge pull request #58095 from azat/metrics/max-rss
Add max/peak RSS into system.asynchronous_metrics
2023-12-23 13:13:44 +01:00