thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-01 03:52:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
132,394 Commits 9,191 Branches 1,782 Tags 2.2 GiB
085833aaae
Commit Graph

12314 Commits

Author SHA1 Message Date
Alexander Tokmakov
972756486a
Merge pull request #58350 from ClickHouse/rdb_dont_wait_inactive 
An option to avoid waiting for inactive Replicated database replicas
 2024-01-04 14:50:11 +01:00
robot-ch-test-poll3
dfacb11123
Merge pull request #58452 from zvonand/zvonand-toWeek 
Edit docs for toWeek()
 2024-01-04 00:06:24 +01:00
Robert Schulze
f652c6050c
Implement idnaEn/Decode() 2024-01-03 18:08:32 +00:00
Bhavna Jindal
62521d30ce fix style-check 2024-01-03 09:34:58 -08:00
Bhavna Jindal
8a7eaed07e Added additional testcases 2024-01-03 09:16:32 -08:00
Alexander Tokmakov
b1688b1953 Merge branch 'master' into rdb_dont_wait_inactive 2024-01-03 17:03:01 +01:00
Val Doroshchuk
5c221d123d MaterializedMySQL: Introduce MySQL Binlog Client 
One binlog connection for many databases.

Suggesting to disable this feature by default for now. It should be explicitly enabled by SETTINGS use_binlog_client=1.
But if you would permanently enable it in MaterializedMySQLSettings, it should keep old behavior and all tests should pass too.

1. Introduced `IBinlog` and its impl to read the binlog events from socket - `BinlogFromSocket`, or file - `BinlogFromFile`. Based on prev impl of `EventBase` and the same old binlog parsers. It fully keeps BC with old version. Fixed `./check-mysql-binlog` to test new impl.
2. Introduced `BinlogEventsDispatcher`, it reads the event from the source `IBinlog` and sends it to currently attached `IBinlog` instances.
3. Introduced `BinlogClient`, which is used to group a list of `BinlogEventsDispatcher` by MySQL binlog connection which is defined by `user:password@host:port`. All dispatchers with the same binlog position should be merged to one.
4. Introduced `BinlogClientFactory`, which is a singleton and it is used to track all binlogs created over the instance.
5. Introduced `use_binlog_client` setting to `MaterializedMySQL`, which forces to reuse a `BinlogClient` if it already exists in `BinlogClientCatalog` or create new one. By default, it is disabled.
6. Introduced `max_bytes_in_binlog_queue` setting to define the limit of bytes in binlog's queue of events. If bytes in the queue increases this limit, `BinlogEventsDispatcher` will stop reading new events from source `IBinlog` until the space for new events will be freed.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
8. Introduced `max_bytes_in_binlog_dispatcher_buffer` setting to define max bytes in the binlog dispatcher's buffer before it is flushed to attached binlogs.
9. Introduced `max_flush_milliseconds_in_binlog_dispatcher` setting to define max milliseconds in the binlog dispatcher's buffer to wait before it is flushed to attached binlogs.
10. Introduced `system.mysql_binlogs` system table, which shows a list of active binlogs.
11. Introduced `UnparsedRowsEvent` and `MYSQL_UNPARSED_ROWS_EVENT`, which defines that an event is not parsed and should be explicitly parsed later.
12. Fixed bug when not possible to apply DDL since syntax error or unsupported SQL.

@larspars is the author of following:
`GTIDSets::contains()`
`ReplicationHelper`
`shouldReconnectOnException()`
 2024-01-03 15:26:09 +01:00
Mark Needham
3125482631
Add output_format_decimal_trailing_zeros setting for trailing spaces 2024-01-03 14:25:03 +00:00
zvonand
89beb32e64 Edit docs for toWeek() 2024-01-03 13:10:14 +01:00
Robert Schulze
b5d7ea2b02
Introduce OrNull() overloads for punycodeEncode/Decode() 2024-01-03 10:50:00 +00:00
Robert Schulze
2186aa8f21
Revert "Revert "Implement punycode encoding/decoding"" 
This reverts commit 345d29a3c1.
 2024-01-03 08:03:01 +00:00
Alexey Milovidov
eb930efebb
Merge pull request #57732 from ClickHouse/load-metadata-threads 
Increase `load_metadata_threads` to 16
 2024-01-02 22:26:18 +01:00
Bhavna Jindal
c0cff7b4f3 handled edge cases and addresses review comments 2024-01-02 08:52:28 -08:00
Bhavna Jindal
5c34ddab09 implemneted seriesDecomposeSTL method 2024-01-02 08:52:23 -08:00
Bharat Nallan Chakravarthy
00b5e28d6a Merge upstream/master into ncb/system-database-engines 2023-12-30 23:10:48 -08:00
Bharat Nallan Chakravarthy
2996c8167f add docs 2023-12-30 20:48:35 -08:00
Alexey Milovidov
7bded0a5e7
Merge pull request #58316 from ClickHouse/reintroduce_is_deleted 
Re-introduce `is_deleted` column for ReplacingMergeTree
 2023-12-31 00:57:19 +01:00
Alexey Milovidov
385f4da819
Update youtube-dislikes.md 2023-12-30 21:30:16 +03:00
Alexey Milovidov
78523639e0 Remove function 2023-12-30 14:52:54 +01:00
robot-ch-test-poll4
09ffe8ffcc
Merge pull request #57837 from ClickHouse/pufit/docs-patch-roles 
Added information about preconfigured roles in users.xml to the docs
 2023-12-30 13:09:50 +01:00
robot-ch-test-poll3
d5894aa286
Merge pull request #58311 from ClickHouse/system-errors-doc 
Improve system.errors documentation
 2023-12-30 12:58:12 +01:00
Dmitry Novik
46dfc37397
Fixup 2023-12-30 10:41:41 +01:00
Alexander Tokmakov
1013f6b23f
Merge branch 'master' into reintroduce_is_deleted 2023-12-29 15:46:24 +01:00
Alexander Tokmakov
bfc10bd234 an option to avoid waiting for inactive Replicated db replicas 2023-12-29 15:19:16 +01:00
Alexey Milovidov
96876aa4f4
Merge pull request #58345 from ClickHouse/dos-windows 
Add a style check against DOS and Windows
 2023-12-29 15:02:46 +01:00
Alexey Milovidov
ea03cc82aa
Merge pull request #58320 from ClickHouse/mv3 
Refreshable materialized views again
 2023-12-29 14:44:50 +01:00
Alexey Milovidov
48a397577c Add a style check against DOS and Windows 2023-12-29 13:10:40 +01:00
Alexey Milovidov
09181b6c37
Merge pull request #58335 from lingtaolf/feature/sparkBar_alias_to_sparkbar 
sparkBar as an alias to sparkbar
 2023-12-29 13:02:55 +01:00
凌涛
57c57360db add doc 2023-12-29 10:43:11 +08:00
Michael Kolupaev
96c68e5aae Remove pausing, enable multithreading, kick off refresh on table creation unless the query says EMPTY 2023-12-28 17:56:06 +00:00
Michael Kolupaev
bda01ca9db Spelling 2023-12-28 17:56:05 +00:00
Michael Kolupaev
edd120e8be Make it experimental 2023-12-28 17:56:05 +00:00
Michael Kolupaev
f0417d0ec3 Things 2023-12-28 17:56:05 +00:00
Michael Kolupaev
0fc7535eba Fixes 2023-12-28 17:56:05 +00:00
Michael Kolupaev
609b2c216c Fix some of the CI 2023-12-28 17:56:05 +00:00
Michael Kolupaev
8b8ef41407 Documentation 2023-12-28 17:56:05 +00:00
Dmitry Novik
50e531bf93 Improve system.errors documentation 2023-12-28 14:47:30 +00:00
Alexander Tokmakov
bdada351c8 Revert "Merge pull request #58274 from ClickHouse/revert-58267" 
This reverts commit 583b9637c2, reversing
changes made to 224e937620.
 2023-12-28 14:07:59 +01:00
Alexander Tokmakov
38fe70c68a
Revert "Refreshable materialized views (takeover)" 2023-12-28 13:12:20 +01:00
Alexey Milovidov
a2faa65b08
Merge pull request #56946 from ClickHouse/mv 
Refreshable materialized views (takeover)
 2023-12-28 09:29:44 +01:00
Alexey Milovidov
345d29a3c1
Revert "Implement punycode encoding/decoding" 2023-12-28 09:12:22 +03:00
Alexey Milovidov
524d53199d
Merge branch 'master' into mv 2023-12-28 04:11:48 +01:00
Alexey Milovidov
c7efd2afea Revert #58267 2023-12-28 04:09:33 +01:00
Alexey Milovidov
40a5dbdeba
Merge branch 'master' into mv 2023-12-28 03:16:27 +01:00
Alexey Milovidov
dcbd3b9c26
Merge pull request #58267 from ClickHouse/fix_is_deleted_compatibility 
Re-introduce `is_deleted` column for ReplacingMergeTree
 2023-12-28 00:13:01 +01:00
Michael Kolupaev
b9cbecb0df Remove pausing, enable multithreading, kick off refresh on table creation unless the query says EMPTY 2023-12-27 20:24:56 +00:00
Michael Kolupaev
dbf8fa23df Spelling 2023-12-27 20:24:55 +00:00
Michael Kolupaev
18cc5d1b76 Make it experimental 2023-12-27 20:24:55 +00:00
Michael Kolupaev
538b23d862 Things 2023-12-27 20:24:55 +00:00
Michael Kolupaev
802961f0a2 Fixes 2023-12-27 20:24:55 +00:00
Michael Kolupaev
673743e2ac Fix some of the CI 2023-12-27 20:24:55 +00:00
Michael Kolupaev
7786b12a89 Documentation 2023-12-27 20:24:55 +00:00
Sema Checherinda
617ee5abaf
Merge pull request #57551 from bharatnc/ncb/async-metrics-pri-key-size 
add asynchronous metrics for total primary key size in memory and allocated
 2023-12-27 20:24:20 +01:00
Alexander Tokmakov
01d042c490 Revert "Merge pull request #57932 from ClickHouse/remove-shit-cleanup" 
This reverts commit 2d58dc512c, reversing
changes made to 41873dc4a3.
 2023-12-27 13:46:06 +01:00
santrancisco
91835256aa
fix doc 2023-12-26 16:57:18 +11:00
Alexey Milovidov
658336f674 Add documentation 2023-12-24 12:22:31 +01:00
Alexey Milovidov
d0ca383bca
Merge pull request #58095 from azat/metrics/max-rss 
Add max/peak RSS into system.asynchronous_metrics
 2023-12-23 13:13:44 +01:00
Alexey Milovidov
11ca0b7b44
Merge pull request #58137 from ClickHouse/thomoco-patch-4 
Update from.md
 2023-12-23 05:22:15 +01:00
Alexey Milovidov
bcda9b9d6f
Update from.md 2023-12-23 07:21:43 +03:00
jinjunzh
aaf98f0ed7 refine setting with enable_zstd_qat_codec 2023-12-22 14:24:15 -05:00
Azat Khuzhin
74ea601dc2 Add documentation for MemoryResidentMax metric in system.asynchronous_metrics 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-12-22 18:38:44 +01:00
robot-ch-test-poll2
97c85e6e41
Merge pull request #58147 from cwurm/patch-3 
Update insert-into.md: Clarify position of SETTINGS clause
 2023-12-22 15:59:17 +01:00
Yarik Briukhovetskyi
483a377834
Merge pull request #57995 from yariks5s/paste_join 
Implementing PASTE JOIN
 2023-12-22 12:56:06 +01:00
Christoph Wurm
5d8e5ee5d2
Update insert-into.md: Clarify position of SETTINGS clause 
I've recently stumbled several times trying to figure out where to put the `SETTINGS` when inserting `VALUES` and `FROM INFILE`, so I'm clarifying it here in the docs.
 2023-12-22 11:40:46 +00:00
Bharat Nallan Chakravarthy
62b28d365c Merge with upstream/master 2023-12-21 17:04:25 -08:00
Thom O'Connor
6e0e4d154d
Update from.md 
Updated the SELECT...FROM...FINAL documentation to add better guidance to the use of FINAL, rather than saying "avoid using it"
 2023-12-21 12:01:00 -07:00
skyoct
342a4f7b96 add doc and opt some code 2023-12-21 14:25:18 +00:00
robot-clickhouse-ci-1
cc23ddd94a
Merge pull request #58094 from cwurm/fix_docs_settings_anchors 
Docs: Fix broken anchors to core settings
 2023-12-20 19:59:47 +01:00
Christoph Wurm
9def89d416 Fix anchors to settings.md 2023-12-20 18:26:36 +00:00
Kruglov Pavel
ca7001d70f
Merge pull request #57850 from shanielh/feature/s3-session-token 
Feature/s3 session token
 2023-12-20 17:22:09 +01:00
jinjunzh
372de8a046 refine patch 2023-12-20 10:12:24 -05:00
Anton Popov
87d0cec055
Merge pull request #57433 from CurtizJ/materialize-lightweight-delete 
Add mutation command `APPLY DELETED MASK`
 2023-12-20 14:44:11 +01:00
vdimir
ae4270465d
Merge pull request #57544 from ClickHouse/vdimir/dict_hashed_array_shard 
Support SHARDS for HashedArrayDictionary
 2023-12-20 13:02:26 +01:00
Robert Schulze
ecb6f31211
Merge pull request #57969 from rschu1ze/punycode-is-cool 
Implement punycode encoding/decoding
 2023-12-20 10:20:34 +01:00
San
e2fb159911
Merge pull request #58053 from ClickHouse/update_query_cache_doc 
Updating query cache doc with security consideration
 2023-12-20 13:50:08 +11:00
San
d2d0c970aa
Update query-cache.md 
Fixing spelling and explain clearer.
 2023-12-20 12:45:36 +11:00
Yakov Olkhovskiy
43fcea64b6
Merge pull request #57186 from chenlx0/bytes_uncompressed 
Show uncompressed data size in system.tables
 2023-12-19 19:04:47 -05:00
santrancisco
82ffb570b0
Remove newline 2023-12-20 10:44:46 +11:00
santrancisco
2dda0ccfb7
Updating query cache doc with security consideration 2023-12-20 10:39:07 +11:00
robot-ch-test-poll3
39b77ddc02
Merge pull request #56138 from crackhead-koala/add-documentation-for-sample-size-functions 
Add documentation for minSampleSizeConversion and minSampleSizeContinous
 2023-12-19 23:19:55 +01:00
Jordi Villar
7c281d9a6f
Allow max_size_to_drop settings in query time (#57452) 2023-12-19 23:16:03 +01:00
Yarik Briukhovetskyi
a58c35f2b4
fix docs 2023-12-19 21:30:35 +01:00
Yarik Briukhovetskyi
6e816d45ae
Merge branch 'master' into paste_join 2023-12-19 20:02:24 +01:00
yariks5s
4e418a89d9 fixed suggestions 2023-12-19 19:00:37 +00:00
Bharat Nallan Chakravarthy
ecd2843b47 add a clarification to docs 2023-12-19 08:35:14 -08:00
Yakov Olkhovskiy
3d8933f241
Revert "Revert "Add system.dropped_tables_parts table"" 2023-12-19 10:44:44 -05:00
Robert Schulze
952175ce39
Merge pull request #57875 from zhongyuankai/order_by_all 
Support `ORDER BY ALL`
 2023-12-19 13:38:07 +01:00
vdimir
252cb8a507
Merge pull request #54602 from fionera/issue-49028 
Add setting http_make_head_request
 2023-12-19 13:33:59 +01:00
Robert Schulze
91609a104c
Merge pull request #57547 from rschu1ze/docs-mv-table-engine 
Docs: Remove mention of materialized view table engine
 2023-12-19 13:29:56 +01:00
Robert Schulze
6053fa9d89
Merge remote-tracking branch 'rschu1ze/master' into docs-mv-table-engine 2023-12-19 11:52:26 +00:00
Antonio Andelic
52b3caec90
Revert "Add system.dropped_tables_parts table" 2023-12-19 10:36:22 +01:00
Robert Schulze
00c407ecc1
Merge remote-tracking branch 'rschu1ze/master' into punycode-is-cool 2023-12-19 06:27:23 +00:00
Shani Elharrar
679a0e1300 StorageS3 / TableFunctionS3: Allow passing session_token to AuthSettings 
This can help users that want to pass temporary credentials that
issued by AWS in order to load data from S3 without changing
configuration or creating an IAM User.

Fixes #57848
 2023-12-19 08:06:36 +02:00
Alexey Milovidov
eecacf528d
Merge pull request #57983 from cwurm/patch-2 
Update settings.md: allow_experimental_parallel_reading_from_replicas
 2023-12-18 21:30:10 +01:00
jsc0218
cc8f6ab809
Merge pull request #58000 from yariks5s/date_trunc_docs_enhancement 
enhanced docs for `date_trunc()`
 2023-12-18 15:17:58 -05:00
Alexey Milovidov
7178bd5c88
Merge pull request #57910 from Algunenano/log_message_string 
Improvements for 00002_log_and_exception_messages_formatting
 2023-12-18 21:02:23 +01:00
Bharat Nallan Chakravarthy
aef4e2e6ec Merge upstream/master into ncb/async-metrics-pri-key-size 2023-12-18 09:46:51 -08:00
Yarik Briukhovetskyi
0671ade7be
Merge branch 'ClickHouse:master' into date_trunc_docs_enhancement 2023-12-18 18:07:31 +01:00
Christoph Wurm
e357c088a0 Update settings.md: allow_experimental_parallel_reading_from_replicas 
Document all possible values for `allow_experimental_parallel_reading_from_replicas`.
 2023-12-18 16:55:44 +00:00
Yakov Olkhovskiy
8e39c61401 Merge remote-tracking branch 'origin/master' into ft-dropped_tables_parts 2023-12-18 15:40:07 +00:00