Commit Graph

12462 Commits

Author SHA1 Message Date
Val Doroshchuk
5c221d123d MaterializedMySQL: Introduce MySQL Binlog Client
One binlog connection for many databases.

Suggesting to disable this feature by default for now. It should be explicitly enabled by SETTINGS use_binlog_client=1.
But if you would permanently enable it in MaterializedMySQLSettings, it should keep old behavior and all tests should pass too.

1. Introduced `IBinlog` and its impl to read the binlog events from socket - `BinlogFromSocket`, or file - `BinlogFromFile`. Based on prev impl of `EventBase` and the same old binlog parsers. It fully keeps BC with old version. Fixed `./check-mysql-binlog` to test new impl.
2. Introduced `BinlogEventsDispatcher`, it reads the event from the source `IBinlog` and sends it to currently attached `IBinlog` instances.
3. Introduced `BinlogClient`, which is used to group a list of `BinlogEventsDispatcher` by MySQL binlog connection which is defined by `user:password@host:port`. All dispatchers with the same binlog position should be merged to one.
4. Introduced `BinlogClientFactory`, which is a singleton and it is used to track all binlogs created over the instance.
5. Introduced `use_binlog_client` setting to `MaterializedMySQL`, which forces to reuse a `BinlogClient` if it already exists in `BinlogClientCatalog` or create new one. By default, it is disabled.
6. Introduced `max_bytes_in_binlog_queue` setting to define the limit of bytes in binlog's queue of events. If bytes in the queue increases this limit, `BinlogEventsDispatcher` will stop reading new events from source `IBinlog` until the space for new events will be freed.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
8. Introduced `max_bytes_in_binlog_dispatcher_buffer` setting to define max bytes in the binlog dispatcher's buffer before it is flushed to attached binlogs.
9. Introduced `max_flush_milliseconds_in_binlog_dispatcher` setting to define max milliseconds in the binlog dispatcher's buffer to wait before it is flushed to attached binlogs.
10. Introduced `system.mysql_binlogs` system table, which shows a list of active binlogs.
11. Introduced `UnparsedRowsEvent` and `MYSQL_UNPARSED_ROWS_EVENT`, which defines that an event is not parsed and should be explicitly parsed later.
12. Fixed bug when not possible to apply DDL since syntax error or unsupported SQL.

@larspars is the author of following:
`GTIDSets::contains()`
`ReplicationHelper`
`shouldReconnectOnException()`
2024-01-03 15:26:09 +01:00
Mark Needham
3125482631
Add output_format_decimal_trailing_zeros setting for trailing spaces 2024-01-03 14:25:03 +00:00
Kruglov Pavel
4d8cf71ba7
Merge branch 'master' into variant-data-type 2024-01-03 15:21:23 +01:00
zvonand
89beb32e64 Edit docs for toWeek() 2024-01-03 13:10:14 +01:00
Robert Schulze
b5d7ea2b02
Introduce OrNull() overloads for punycodeEncode/Decode() 2024-01-03 10:50:00 +00:00
Robert Schulze
2186aa8f21
Revert "Revert "Implement punycode encoding/decoding""
This reverts commit 345d29a3c1.
2024-01-03 08:03:01 +00:00
Alexey Milovidov
eb930efebb
Merge pull request #57732 from ClickHouse/load-metadata-threads
Increase `load_metadata_threads` to 16
2024-01-02 22:26:18 +01:00
Bhavna Jindal
c0cff7b4f3 handled edge cases and addresses review comments 2024-01-02 08:52:28 -08:00
Bhavna Jindal
5c34ddab09 implemneted seriesDecomposeSTL method 2024-01-02 08:52:23 -08:00
Bharat Nallan Chakravarthy
00b5e28d6a Merge upstream/master into ncb/system-database-engines 2023-12-30 23:10:48 -08:00
Bharat Nallan Chakravarthy
2996c8167f add docs 2023-12-30 20:48:35 -08:00
Alexey Milovidov
7bded0a5e7
Merge pull request #58316 from ClickHouse/reintroduce_is_deleted
Re-introduce `is_deleted` column for ReplacingMergeTree
2023-12-31 00:57:19 +01:00
Alexey Milovidov
385f4da819
Update youtube-dislikes.md 2023-12-30 21:30:16 +03:00
Alexey Milovidov
78523639e0 Remove function 2023-12-30 14:52:54 +01:00
robot-ch-test-poll4
09ffe8ffcc
Merge pull request #57837 from ClickHouse/pufit/docs-patch-roles
Added information about preconfigured roles in users.xml to the docs
2023-12-30 13:09:50 +01:00
robot-ch-test-poll3
d5894aa286
Merge pull request #58311 from ClickHouse/system-errors-doc
Improve system.errors documentation
2023-12-30 12:58:12 +01:00
Dmitry Novik
46dfc37397
Fixup 2023-12-30 10:41:41 +01:00
Alexander Tokmakov
1013f6b23f
Merge branch 'master' into reintroduce_is_deleted 2023-12-29 15:46:24 +01:00
Alexander Tokmakov
bfc10bd234 an option to avoid waiting for inactive Replicated db replicas 2023-12-29 15:19:16 +01:00
Alexey Milovidov
96876aa4f4
Merge pull request #58345 from ClickHouse/dos-windows
Add a style check against DOS and Windows
2023-12-29 15:02:46 +01:00
Alexey Milovidov
ea03cc82aa
Merge pull request #58320 from ClickHouse/mv3
Refreshable materialized views again
2023-12-29 14:44:50 +01:00
Alexey Milovidov
48a397577c Add a style check against DOS and Windows 2023-12-29 13:10:40 +01:00
Alexey Milovidov
09181b6c37
Merge pull request #58335 from lingtaolf/feature/sparkBar_alias_to_sparkbar
sparkBar as an alias to sparkbar
2023-12-29 13:02:55 +01:00
凌涛
57c57360db add doc 2023-12-29 10:43:11 +08:00
Michael Kolupaev
96c68e5aae Remove pausing, enable multithreading, kick off refresh on table creation unless the query says EMPTY 2023-12-28 17:56:06 +00:00
Michael Kolupaev
bda01ca9db Spelling 2023-12-28 17:56:05 +00:00
Michael Kolupaev
edd120e8be Make it experimental 2023-12-28 17:56:05 +00:00
Michael Kolupaev
f0417d0ec3 Things 2023-12-28 17:56:05 +00:00
Michael Kolupaev
0fc7535eba Fixes 2023-12-28 17:56:05 +00:00
Michael Kolupaev
609b2c216c Fix some of the CI 2023-12-28 17:56:05 +00:00
Michael Kolupaev
8b8ef41407 Documentation 2023-12-28 17:56:05 +00:00
Dmitry Novik
50e531bf93 Improve system.errors documentation 2023-12-28 14:47:30 +00:00
Alexander Tokmakov
bdada351c8 Revert "Merge pull request #58274 from ClickHouse/revert-58267"
This reverts commit 583b9637c2, reversing
changes made to 224e937620.
2023-12-28 14:07:59 +01:00
Alexander Tokmakov
38fe70c68a
Revert "Refreshable materialized views (takeover)" 2023-12-28 13:12:20 +01:00
Alexey Milovidov
a2faa65b08
Merge pull request #56946 from ClickHouse/mv
Refreshable materialized views (takeover)
2023-12-28 09:29:44 +01:00
Alexey Milovidov
345d29a3c1
Revert "Implement punycode encoding/decoding" 2023-12-28 09:12:22 +03:00
Alexey Milovidov
524d53199d
Merge branch 'master' into mv 2023-12-28 04:11:48 +01:00
Alexey Milovidov
c7efd2afea Revert #58267 2023-12-28 04:09:33 +01:00
Alexey Milovidov
40a5dbdeba
Merge branch 'master' into mv 2023-12-28 03:16:27 +01:00
Alexey Milovidov
dcbd3b9c26
Merge pull request #58267 from ClickHouse/fix_is_deleted_compatibility
Re-introduce `is_deleted` column for ReplacingMergeTree
2023-12-28 00:13:01 +01:00
Michael Kolupaev
b9cbecb0df Remove pausing, enable multithreading, kick off refresh on table creation unless the query says EMPTY 2023-12-27 20:24:56 +00:00
Michael Kolupaev
dbf8fa23df Spelling 2023-12-27 20:24:55 +00:00
Michael Kolupaev
18cc5d1b76 Make it experimental 2023-12-27 20:24:55 +00:00
Michael Kolupaev
538b23d862 Things 2023-12-27 20:24:55 +00:00
Michael Kolupaev
802961f0a2 Fixes 2023-12-27 20:24:55 +00:00
Michael Kolupaev
673743e2ac Fix some of the CI 2023-12-27 20:24:55 +00:00
Michael Kolupaev
7786b12a89 Documentation 2023-12-27 20:24:55 +00:00
Sema Checherinda
617ee5abaf
Merge pull request #57551 from bharatnc/ncb/async-metrics-pri-key-size
add asynchronous metrics for total primary key size in memory and allocated
2023-12-27 20:24:20 +01:00
Kruglov Pavel
4b2a0b99fc
Update docs/en/sql-reference/functions/other-functions.md 2023-12-27 20:02:50 +01:00
Alexander Tokmakov
01d042c490 Revert "Merge pull request #57932 from ClickHouse/remove-shit-cleanup"
This reverts commit 2d58dc512c, reversing
changes made to 41873dc4a3.
2023-12-27 13:46:06 +01:00
santrancisco
91835256aa
fix doc 2023-12-26 16:57:18 +11:00
Alexey Milovidov
658336f674 Add documentation 2023-12-24 12:22:31 +01:00
Alexey Milovidov
d0ca383bca
Merge pull request #58095 from azat/metrics/max-rss
Add max/peak RSS into system.asynchronous_metrics
2023-12-23 13:13:44 +01:00
Alexey Milovidov
11ca0b7b44
Merge pull request #58137 from ClickHouse/thomoco-patch-4
Update from.md
2023-12-23 05:22:15 +01:00
Alexey Milovidov
bcda9b9d6f
Update from.md 2023-12-23 07:21:43 +03:00
jinjunzh
aaf98f0ed7 refine setting with enable_zstd_qat_codec 2023-12-22 14:24:15 -05:00
Azat Khuzhin
74ea601dc2 Add documentation for MemoryResidentMax metric in system.asynchronous_metrics
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-22 18:38:44 +01:00
robot-ch-test-poll2
97c85e6e41
Merge pull request #58147 from cwurm/patch-3
Update insert-into.md: Clarify position of SETTINGS clause
2023-12-22 15:59:17 +01:00
Yarik Briukhovetskyi
483a377834
Merge pull request #57995 from yariks5s/paste_join
Implementing PASTE JOIN
2023-12-22 12:56:06 +01:00
Christoph Wurm
5d8e5ee5d2
Update insert-into.md: Clarify position of SETTINGS clause
I've recently stumbled several times trying to figure out where to put the `SETTINGS` when inserting `VALUES` and `FROM INFILE`, so I'm clarifying it here in the docs.
2023-12-22 11:40:46 +00:00
Bharat Nallan Chakravarthy
62b28d365c Merge with upstream/master 2023-12-21 17:04:25 -08:00
Thom O'Connor
6e0e4d154d
Update from.md
Updated the SELECT...FROM...FINAL documentation to add better guidance to the use of FINAL, rather than saying "avoid using it"
2023-12-21 12:01:00 -07:00
skyoct
342a4f7b96 add doc and opt some code 2023-12-21 14:25:18 +00:00
robot-clickhouse-ci-1
cc23ddd94a
Merge pull request #58094 from cwurm/fix_docs_settings_anchors
Docs: Fix broken anchors to core settings
2023-12-20 19:59:47 +01:00
Christoph Wurm
9def89d416 Fix anchors to settings.md 2023-12-20 18:26:36 +00:00
Kruglov Pavel
ca7001d70f
Merge pull request #57850 from shanielh/feature/s3-session-token
Feature/s3 session token
2023-12-20 17:22:09 +01:00
jinjunzh
372de8a046 refine patch 2023-12-20 10:12:24 -05:00
Anton Popov
87d0cec055
Merge pull request #57433 from CurtizJ/materialize-lightweight-delete
Add mutation command `APPLY DELETED MASK`
2023-12-20 14:44:11 +01:00
vdimir
ae4270465d
Merge pull request #57544 from ClickHouse/vdimir/dict_hashed_array_shard
Support SHARDS for HashedArrayDictionary
2023-12-20 13:02:26 +01:00
Robert Schulze
ecb6f31211
Merge pull request #57969 from rschu1ze/punycode-is-cool
Implement punycode encoding/decoding
2023-12-20 10:20:34 +01:00
San
e2fb159911
Merge pull request #58053 from ClickHouse/update_query_cache_doc
Updating query cache doc with security consideration
2023-12-20 13:50:08 +11:00
San
d2d0c970aa
Update query-cache.md
Fixing spelling and explain clearer.
2023-12-20 12:45:36 +11:00
Yakov Olkhovskiy
43fcea64b6
Merge pull request #57186 from chenlx0/bytes_uncompressed
Show uncompressed data size in system.tables
2023-12-19 19:04:47 -05:00
santrancisco
82ffb570b0
Remove newline 2023-12-20 10:44:46 +11:00
Kruglov Pavel
087946f385
Merge branch 'master' into variant-data-type 2023-12-20 00:40:18 +01:00
santrancisco
2dda0ccfb7
Updating query cache doc with security consideration 2023-12-20 10:39:07 +11:00
robot-ch-test-poll3
39b77ddc02
Merge pull request #56138 from crackhead-koala/add-documentation-for-sample-size-functions
Add documentation for minSampleSizeConversion and minSampleSizeContinous
2023-12-19 23:19:55 +01:00
Jordi Villar
7c281d9a6f
Allow max_size_to_drop settings in query time (#57452) 2023-12-19 23:16:03 +01:00
Yarik Briukhovetskyi
a58c35f2b4
fix docs 2023-12-19 21:30:35 +01:00
Yarik Briukhovetskyi
6e816d45ae
Merge branch 'master' into paste_join 2023-12-19 20:02:24 +01:00
yariks5s
4e418a89d9 fixed suggestions 2023-12-19 19:00:37 +00:00
avogar
319ae440b6 Implement Variant data type 2023-12-19 16:45:15 +00:00
Bharat Nallan Chakravarthy
ecd2843b47 add a clarification to docs 2023-12-19 08:35:14 -08:00
Yakov Olkhovskiy
3d8933f241
Revert "Revert "Add system.dropped_tables_parts table"" 2023-12-19 10:44:44 -05:00
Robert Schulze
952175ce39
Merge pull request #57875 from zhongyuankai/order_by_all
Support `ORDER BY ALL`
2023-12-19 13:38:07 +01:00
vdimir
252cb8a507
Merge pull request #54602 from fionera/issue-49028
Add setting http_make_head_request
2023-12-19 13:33:59 +01:00
Robert Schulze
91609a104c
Merge pull request #57547 from rschu1ze/docs-mv-table-engine
Docs: Remove mention of materialized view table engine
2023-12-19 13:29:56 +01:00
Robert Schulze
6053fa9d89
Merge remote-tracking branch 'rschu1ze/master' into docs-mv-table-engine 2023-12-19 11:52:26 +00:00
Antonio Andelic
52b3caec90
Revert "Add system.dropped_tables_parts table" 2023-12-19 10:36:22 +01:00
Robert Schulze
00c407ecc1
Merge remote-tracking branch 'rschu1ze/master' into punycode-is-cool 2023-12-19 06:27:23 +00:00
Shani Elharrar
679a0e1300 StorageS3 / TableFunctionS3: Allow passing session_token to AuthSettings
This can help users that want to pass temporary credentials that
issued by AWS in order to load data from S3 without changing
configuration or creating an IAM User.

Fixes #57848
2023-12-19 08:06:36 +02:00
Alexey Milovidov
eecacf528d
Merge pull request #57983 from cwurm/patch-2
Update settings.md: allow_experimental_parallel_reading_from_replicas
2023-12-18 21:30:10 +01:00
jsc0218
cc8f6ab809
Merge pull request #58000 from yariks5s/date_trunc_docs_enhancement
enhanced docs for `date_trunc()`
2023-12-18 15:17:58 -05:00
Alexey Milovidov
7178bd5c88
Merge pull request #57910 from Algunenano/log_message_string
Improvements for 00002_log_and_exception_messages_formatting
2023-12-18 21:02:23 +01:00
Bharat Nallan Chakravarthy
aef4e2e6ec Merge upstream/master into ncb/async-metrics-pri-key-size 2023-12-18 09:46:51 -08:00
Yarik Briukhovetskyi
0671ade7be
Merge branch 'ClickHouse:master' into date_trunc_docs_enhancement 2023-12-18 18:07:31 +01:00
Christoph Wurm
e357c088a0 Update settings.md: allow_experimental_parallel_reading_from_replicas
Document all possible values for `allow_experimental_parallel_reading_from_replicas`.
2023-12-18 16:55:44 +00:00
Yakov Olkhovskiy
8e39c61401 Merge remote-tracking branch 'origin/master' into ft-dropped_tables_parts 2023-12-18 15:40:07 +00:00
yariks5s
1a66dd94fa init 2023-12-18 15:37:02 +00:00
yariks5s
37216ab312 docs 2023-12-18 15:06:34 +00:00
Robert Schulze
414a2893d0
Merge pull request #57821 from rschu1ze/consolidate-substring-tests
Dumb down `substring()` tests
2023-12-18 12:32:20 +01:00
Raúl Marín
2639d0715f Merge remote-tracking branch 'blessed/master' into log_message_string 2023-12-18 10:40:18 +01:00
Alexey Milovidov
33cf8842bc
Merge branch 'master' into fix-arrayfold 2023-12-18 04:57:07 +01:00
Robert Schulze
19c8ac567f
Implement punycodeEncode()/Decode() 2023-12-17 17:04:28 +00:00
Robert Schulze
7f675ddf80
Merge pull request #57878 from Jpnock/master
Apply full-text skipping index when using `hasAny()`
2023-12-17 11:06:29 +01:00
Robert Schulze
9033c96e29
Some fixups 2023-12-17 09:11:16 +00:00
ubuntu
a5e4495ee5 Merge branch 'master' into order_by_all 2023-12-17 10:07:35 +08:00
Sergei Trifonov
3634b949a8
Merge pull request #57793 from ClickHouse/rename-system-table
Rename `system.async_loader` into `system.asynchronous_loader`
2023-12-16 17:33:04 +01:00
Sergei Trifonov
37a01bc109
Merge branch 'master' into ft-dropped_tables_parts 2023-12-16 11:53:37 +01:00
Robert Schulze
2cfb543b33 Doc updates 2023-12-16 18:48:23 +08:00
zhongyuankai
01f5b20517 Support ORDER BY ALL 2023-12-16 18:48:23 +08:00
Alexey Milovidov
ee502ef6b9 Remove trash (OPTIMIZE CLEANUP) 2023-12-15 22:41:58 +01:00
Raúl Marín
b269f87f4c Better text_log with ErrnoException 2023-12-15 19:27:56 +01:00
James Nock
2c24e438aa Add docs for skip index support of hasXXX() funcs 2023-12-15 17:28:45 +00:00
Sema Checherinda
0dfe530a7f
Merge pull request #56744 from MikhailBurdukov/native_copy_for_s3_disks
Enabled s3 `copyObject` for copy between s3 disks.
2023-12-15 16:05:16 +01:00
Raúl Marín
946defa8a6
Merge pull request #57860 from zvonand/zvonand-fix-57819
Try to fix memory leak in StorageHDFS
2023-12-15 11:50:17 +01:00
Julia Kartseva
7a5b40563a
Merge pull request #57574 from ClibMouse/dev-seriesPeriodDetect
Revert "Revert "Implemented series period detect method using pocketfft lib""
2023-12-14 21:10:23 -08:00
Alexey Milovidov
23cee7ef37
Merge pull request #57851 from azat/revert-55271-local-lazy-database
Revert "Replace --no-system-tables with loading virtual tables of system database lazily"
2023-12-15 03:25:59 +01:00
Andrey Zvonov
0174b94469
Merge branch 'ClickHouse:master' into zvonand-fix-57819 2023-12-14 20:14:54 +01:00
Bhavna Jindal
bb8589cabe minor cosmetic changes 2023-12-14 08:34:37 -08:00
Andrey Zvonov
f9579580e9 Retrigger CI + make docs a bit better 2023-12-14 16:34:10 +01:00
Christoph Wurm
64a58ee445
Update clickhouse-benchmark.md: Remove json output
Suppport for `--json` was removed in https://github.com/ClickHouse/ClickHouse/pull/53293.
2023-12-14 14:15:41 +00:00
serxa
eff4196be1 review fix 2023-12-14 14:12:27 +00:00
Robert Schulze
b36a93a25d
Revert "Remove arrayFold"
This reverts commit 15dc0ed610.
2023-12-14 09:52:29 +00:00
Azat Khuzhin
0e86e16a01
Revert "Replace --no-system-tables with loading virtual tables of system database lazily" 2023-12-14 09:07:47 +01:00
Alexey Milovidov
e4901323fd
Merge pull request #57836 from ClickHouse/remove-array-fold
Remove `arrayFold`
2023-12-14 07:15:29 +01:00
Nikolay Degterinsky
4c8cc4e0bd
Update string-functions.md 2023-12-14 05:32:12 +01:00
pufit
f49894f644
Added information about preconfigured roles in users.xml to the docs 2023-12-13 23:28:21 -05:00
Alexey Milovidov
15dc0ed610 Remove arrayFold 2023-12-14 04:34:32 +01:00
andrewzolotukhin
c29007beeb
Fixed typo in string-functions.md 2023-12-14 04:54:52 +02:00
Yakov Olkhovskiy
de755202dd
Create dropped_tables_parts.md 2023-12-13 18:32:54 -05:00
Julia Kartseva
b8d274d070
Add malformed output generation to JSON fuzzer (#57646)
Randomly modify structural characters of a valid JSON ('{', '}', '[', ']',
':', '"', ',') to generate output that cannot be parsed as JSON.

Follow-up to https://github.com/ClickHouse/ClickHouse/pull/56490
2023-12-13 19:59:31 +01:00
Anton Popov
1960713176 add docs 2023-12-13 17:29:34 +00:00
Robert Schulze
d0a4443bbc
Consolidate substring() tests 2023-12-13 16:49:39 +00:00
jinjunzh
bce1814363 add codec into doc 2023-12-13 11:18:21 -05:00
Robert Schulze
bbd7d0c057
Merge pull request #57277 from slvrtrn/substr-with-enums
Add Enums support to `substring` function
2023-12-13 17:03:03 +01:00
Nikolay Degterinsky
dd91ce2a14
Merge pull request #57788 from ClickHouse/docs/append-or-truncate-when-into-outfile
Mentions that `APPEND` or `TRUNCATE` should be used with `INTO-OUTFILE`.
2023-12-13 14:59:57 +01:00
Johnny
54abbf146d
Update into-outfile.md 2023-12-13 09:04:07 -04:00
vdimir
398499d253
Support SHARDS for HashedArrayDictionary 2023-12-13 13:00:28 +00:00
Han Fei
6abe4b113a
Merge pull request #57375 from lingtaolf/feature/more_warnings
Feature/more warnings
2023-12-12 22:48:51 +01:00
serxa
57d7a58dbe Rename system.async_loader into system.asynchronous_loader 2023-12-12 16:55:27 +00:00
Kruglov Pavel
6567fb2c08
Merge pull request #56859 from Avogar/csv-infer-numbers-from-strings
Allow to infer numbers from strings in CSV format
2023-12-12 17:09:02 +01:00
johnnymatthews
5467670741 Mentions that APPEND or TRUNCATE should be used with INTO-OUTFILE. 2023-12-12 11:13:34 -04:00
Han Fei
a96593c8b1 Merge branch 'master' into feature/more_warnings 2023-12-12 15:25:01 +01:00
Chen Lixiang
68af81196d
Merge branch 'ClickHouse:master' into bytes_uncompressed 2023-12-12 22:06:45 +08:00
Kruglov Pavel
8a447bf57c
Merge pull request #55892 from Avogar/schema-inference-union
Add 'union' mode for schema inference
2023-12-12 15:02:06 +01:00
Robert Schulze
e6372d5528
Merge remote-tracking branch 'rschu1ze/master' into substr-with-enums 2023-12-12 12:59:30 +00:00
Robert Schulze
efa2e0341a
Docs: Fix typo 2023-12-12 08:45:25 +00:00
Johnny
23ba3b5fa5
Merge pull request #57488 from ClickHouse/add/no-cloud-distributed-table-engine
Adds callout that distributed table engine that it is not supported in Cloud.
2023-12-11 17:06:12 -04:00
avogar
1db000dae5 Add docs 2023-12-11 18:02:05 +00:00
Kruglov Pavel
3b1ffbd77c
Merge branch 'master' into schema-inference-union 2023-12-11 18:59:15 +01:00
Bhavna Jindal
1ea8cb2a45 Added more testcases and spell check 2023-12-11 08:48:10 -08:00
Robert Schulze
0c29e8094a
Merge pull request #57731 from tbragin/patch-9
Docs: Add note about platform-specific guides to getting started guide
2023-12-11 13:29:42 +01:00
Robert Schulze
c141dd1330
Merge pull request #57549 from rschu1ze/format-arbitrary-types
Support arguments of arbitary type in function `format()`
2023-12-11 12:33:51 +01:00
Robert Schulze
4c14758f23
Some fixups 2023-12-11 10:23:54 +00:00
Robert Schulze
9e434d43d7
Merge remote-tracking branch 'rschu1ze/master' into substr-with-enums 2023-12-11 10:21:08 +00:00
MikhailBurdukov
119e451967 Merge branch 'master' into native_copy_for_s3_disks 2023-12-11 07:25:20 +00:00
Alexey Milovidov
27f19635cd Increase load_metadata_threads to 16 2023-12-11 00:49:20 +01:00
Tanya Bragin
a39f3ea9f4
Update developer-instruction.md - add MacOSX link to general guide
Refer to MacOSX (and other OS & arch specific guides) in the build section of the general guide. 

cc @rschu1ze Per our chat, feel free to reject if you think it's not helpful.
2023-12-10 15:33:48 -08:00
Alexey Milovidov
0a20ce5d32
Merge pull request #55271 from azat/local-lazy-database
Replace --no-system-tables with loading virtual tables of system database lazily
2023-12-10 19:51:17 +01:00
Alexey Milovidov
5a33fdcd4d
Merge pull request #57645 from bharatnc/ncb/sha512-256
add SHA512_256 function
2023-12-10 18:02:09 +01:00
Azat Khuzhin
cc9afe6f6e Replace --no-system-tables with loading virtual tables of system database lazily
First of all the problem is that that simple 'SELECT 1' cannot be runned
without system.one, which makes --no-system-tables almost useless:

    $ ./clickhouse-debug local --no-system-tables -q "select 1"
    Code: 81. DB::Exception: Database system does not exist. (UNKNOWN_DATABASE)

Secondly there are just too much flags, and this one
(--no-system-tables) is too damn specific.

This patch should improve startup time of the clickhouse-local almost
3x in debug builds.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-09 23:08:29 +01:00
Alexey Milovidov
0d1bdff347 Deprecate LIVE VIEW 2023-12-09 16:57:42 +01:00
Chen Lixiang
7cd770e9a7 fix doc and comments 2023-12-09 20:09:41 +08:00
Alexey Milovidov
bb084466c4
Update build-cross-osx.md 2023-12-08 23:51:12 +03:00
avogar
ee7af95bc0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-12-08 20:29:28 +00:00
Bhavna Jindal
1f58b0f150
Merge branch 'master' into dev-seriesPeriodDetect 2023-12-08 10:26:39 -05:00
Bhavna Jindal
94943ec83d fix for non-constant arguments 2023-12-08 07:10:47 -08:00
Bharat Nallan Chakravarthy
e01e6671b3 Merge remote-tracking branch 'upstream/master' into ncb/sha512-256 2023-12-07 23:53:18 -08:00
Bharat Nallan Chakravarthy
2c1f57ba40 add docs 2023-12-07 08:58:11 -08:00
robot-ch-test-poll1
9b517e4712
Merge pull request #57617 from hdhoang/master
fix typo TKSV
2023-12-07 15:58:10 +01:00
Alexey Milovidov
11920e751a
Merge pull request #57592 from bharatnc/ncb/alias-format-readable-size
Add FORMAT_BYTES as an alias for formatReadableSize
2023-12-07 15:15:56 +01:00
hdhoang
fc8292182c
fix typo TKSV
correct name is TS-KV
2023-12-07 20:19:00 +07:00
Andrey Zvonov
f0bf5ef3c8
Update fileCluster.md 2023-12-07 13:00:00 +01:00
Chen Lixiang
9e95fe5d29 conflict fixed. 2023-12-07 18:10:45 +08:00
Robert Schulze
554c5d690c
Merge remote-tracking branch 'rschu1ze/master' into format-arbitrary-types 2023-12-07 09:36:39 +00:00
Robert Schulze
0159a4d4a2
Merge pull request #57512 from rschu1ze/revert-revert-sqid
Revert "Revert "Add `sqid()` function""
2023-12-07 10:26:02 +01:00
Bharat Nallan Chakravarthy
19e96c4351 add docs 2023-12-06 14:08:51 -08:00
Bhavna Jindal
dad268c33b Revert "Revert "Implemented series period detect method using pocketfft lib""
This reverts commit d7d83c99e5.
2023-12-06 13:31:49 -08:00
Alexey Milovidov
05bc8ef1e0
Merge pull request #57548 from ClickHouse/s3queue_production_ready
`S3Queue` is production ready
2023-12-06 22:21:08 +01:00
Mikhail f. Shiryaev
9cf87f4261
Merge pull request #57571 from ClickHouse/fix-install-deb
Ignore rare removal race issue "No such file or directory"
2023-12-06 19:33:56 +01:00
Mikhail f. Shiryaev
7dbe435c36
Ignore rare removal race issue "No such file or directory" 2023-12-06 15:40:43 +01:00
Alexey Milovidov
f8de7f6bc2 Merge branch 'master' into s3queue_production_ready 2023-12-06 12:25:29 +01:00
Alexey Milovidov
b91e0f89ec Address review comments 2023-12-06 12:24:58 +01:00
Alexey Milovidov
0b597eadf8 Clarify the usage of prefer_not_to_merge option 2023-12-06 12:11:03 +01:00
Robert Schulze
1276c3ab80
Try to fix broken links 2023-12-06 08:48:56 +00:00
Bharat Nallan Chakravarthy
41b2b63cee add docs 2023-12-05 18:50:36 -08:00
Robert Schulze
c0d56c7bee
Implement format() with arbitrary arguments 2023-12-05 22:51:30 +00:00
johnnymatthews
e9d9048903 Changes 'cannot run on cloud' message. 2023-12-05 17:14:10 -04:00
johnnymatthews
6c3a03d0c5 Merge branch 'master' into add/no-cloud-distributed-table-engine 2023-12-05 17:09:35 -04:00
Alexey Milovidov
76bbeaa676 S3Queue is production ready 2023-12-05 21:10:19 +01:00
Robert Schulze
afa6e4388b
Move docs of format() from general string functions to replacing string functions 2023-12-05 20:04:42 +00:00
Robert Schulze
b9f281f672
Docs: Remove mention of MV table engine 2023-12-05 19:24:47 +00:00
slvrtrn
e275080f52 Merge remote-tracking branch 'origin' into substr-with-enums 2023-12-05 19:48:10 +01:00
Robert Schulze
f56dd6561f
Merge remote-tracking branch 'rschu1ze/master' into revert-revert-sqid 2023-12-05 18:41:10 +00:00
Alexey Milovidov
d7d83c99e5
Revert "Implemented series period detect method using pocketfft lib" 2023-12-05 18:17:07 +03:00
robot-clickhouse
24edd44fe6
Merge pull request #57501 from xleoken/patch
fix tip doc
2023-12-05 16:03:42 +01:00
Nikolay Degterinsky
a776a5cac5
Merge pull request #57483 from joelynch/stop-listen-tcp-secure
bugfix: correctly parse SYSTEM STOP LISTEN TCP SECURE
2023-12-05 15:25:34 +01:00
Alexey Milovidov
2988f6f92a
Revert "Add new aggregation function groupArraySorted()" 2023-12-05 15:31:17 +03:00
Robert Schulze
f1a2b46d60
Incorporate feedback 2023-12-05 12:28:28 +00:00
Robert Schulze
a2cd240317
Revert "Revert "Add sqid() function""
This reverts commit 8d5d0ef38f.
2023-12-05 10:50:30 +00:00
Alexey Milovidov
8d5d0ef38f
Revert "Add sqid() function" 2023-12-05 13:45:33 +03:00
Alexey Milovidov
cbea3545aa
Revert "add function getClientHTTPHeader" 2023-12-05 13:34:34 +03:00
xleoken
f07599b7c0 fix tip doc 2023-12-05 17:52:33 +08:00
robot-clickhouse
22f840e24b
Merge pull request #57487 from ClickHouse/update/uniqUpTo-usage-example
Adds usage example for uniqUpTo.
2023-12-05 07:04:28 +01:00
Alexey Milovidov
1f752b79db
Merge pull request #55894 from bharatnc/ncb/hostname-system-log-tables
add hostname column to system log tables
2023-12-05 06:42:43 +01:00
robot-clickhouse-ci-1
9321238515
Merge pull request #56647 from ClickHouse/docs-observability-dashboard
[Docs] Add built-in observability dashboard
2023-12-05 06:37:41 +01:00
Alexey Milovidov
8603b4e92a
Update docs/en/sql-reference/aggregate-functions/parametric-functions.md
Co-authored-by: Johnny <9611008+johnnymatthews@users.noreply.github.com>
2023-12-05 08:12:47 +03:00
Nikolay Degterinsky
9b2cf06eb1
Fix docs 2023-12-05 05:14:19 +01:00
凌涛
9e05e79d66
Merge branch 'master' into feature/more_warnings 2023-12-05 11:50:05 +08:00
凌涛
6794bbe196 rebase master 2023-12-05 11:42:25 +08:00
凌涛
8ea9403d0f modify docs 2023-12-05 11:39:54 +08:00
johnnymatthews
c6ca43b341 Moves self-hosted-only box under page title. 2023-12-04 18:05:34 -04:00
johnnymatthews
06a52e1452 Merge branch 'master' into add/no-cloud-distributed-table-engine 2023-12-04 18:00:40 -04:00
johnnymatthews
40062405fb Adds 'not available on cloud' to Distributed Table Engine. 2023-12-04 17:59:11 -04:00
johnnymatthews
e2eb47b2ec Reverts last commit. 2023-12-04 17:58:19 -04:00
johnnymatthews
7ce33b0737 Adds 'not available on cloud' to Distributed Table Engine. 2023-12-04 17:57:33 -04:00
Johnny
ff746fb018
Grammar fixes. 2023-12-04 17:51:38 -04:00
Johnny
4d8084db31
Adds usage example for uniqUpTo.
A [user on Twitter](https://twitter.com/Dan_The_Goodman/status/1731453529078796740) pointed out that we didn't have a usage example here. This adds an example, and clarifies what `uniqUpTo` does.
2023-12-04 17:48:41 -04:00
joelynch
b312a9f4ee
bugfix: parse system stop listen tcp secure 2023-12-04 19:56:35 +01:00
Alexey Milovidov
02439eee58
Merge pull request #49351 from ClickHouse/async-loader-integration
Asynchronous loading of tables
2023-12-04 17:16:12 +01:00
Robert Schulze
8db3bac7bd
Merge pull request #57442 from awakeljw/dev
Add `sqid()` function
2023-12-04 15:50:28 +01:00
Bharat Nallan Chakravarthy
440dc66a5c Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-12-03 15:19:47 -08:00
Robert Schulze
f6036fbb29
Some fixups 2023-12-03 16:20:59 +00:00
awakeljw
06241de257 fix codes according to the reviews 2023-12-03 22:00:42 +08:00
robot-clickhouse
50dacbc7ac
Merge pull request #57440 from arvindpunk/patch-1
docs: fix arrayFold/arrayReduce anchors in see also section
2023-12-03 00:11:40 +01:00
Sema Checherinda
c61cd6aab2
Merge pull request #57335 from sichenzhao/increase_default_replicated_deduplication_window
increase default replicated_deduplication_window from 100 to 1k
2023-12-02 21:23:39 +01:00
Nikita Taranov
a32c5e976a
Don't print server revision in client on connect (#57435) 2023-12-02 16:32:34 +01:00
Arvind Pj
020f1d274d
docs: fix arrayReduce anchor in arrayFold see also 2023-12-02 18:49:58 +05:30
Arvind Pj
0e8cf43982
docs: fix arrayFold anchor in arrayReduce see also 2023-12-02 11:36:09 +05:30
JackyWoo
8a68d51261
Add index to table system.numbers (#50909) 2023-12-01 19:59:25 +01:00
slvrtrn
8eff62a4de Merge remote-tracking branch 'origin' into substr-with-enums 2023-12-01 03:43:48 +01:00
凌涛
31894bc9df
Update settings.md 2023-12-01 10:38:42 +08:00
Julia Kartseva
1f8031c6e1
Merge pull request #56892 from icuken/alter_temporary_table
allow ALTER for TEMPORARY tables
2023-11-30 18:29:43 -08:00
Raúl Marín
46acd8736c
Merge pull request #57189 from Algunenano/fix_respect_nulls
Fix RESPECT NULLS
2023-11-30 20:21:42 +01:00
Sergey Kviatkevich
b76bedb53a update docs 2023-11-30 21:42:13 +03:00
robot-ch-test-poll3
85be7cf6b8
Merge pull request #57383 from biggerfisch/docs/exists-examples
Add more doc examples for the EXISTS operator
2023-11-30 15:25:02 +01:00
Kruglov Pavel
575ee1e665
Merge pull request #56868 from zvonand/zvonand-fileCluster
Introduce `fileCluster` table function
2023-11-30 13:49:53 +01:00
Avery Fischer
b75653e449
Add more doc examples for the EXISTS operator
The existing documentation for EXISTS makes it look like it only works
as part of a WHERE clause, when in fact, it can be used in many places.
Changing the docs to note that a bit differently with another example
should provide more clarity on the use of this term.
2023-11-30 10:57:44 +01:00
Alexander Zaitsev
d001e25787
doc: update profile-guided-optimization.md
- update PGO recommendations according to the https://github.com/llvm/llvm-project/issues/45668
2023-11-30 06:41:59 +03:00
Nikolai Kochetov
024f41888e
Merge pull request #53562 from yariks5s/group_sorted_array_function
Add new aggregation function groupArraySorted()
2023-11-29 17:52:01 +01:00
zvonand
c329e382ab resolve conflicts 2023-11-29 16:03:07 +01:00
Han Fei
4c0efb0262
Merge pull request #53240 from hanfei1991/hanfei/statistic
use statistic to order prewhere conditions better
2023-11-29 12:26:44 +01:00
robot-clickhouse-ci-1
1740ef80e5
Merge pull request #57209 from ClickHouse/errors-prometheus
Expose the number of errors occurred on server from the Prometheus endpoint.
2023-11-29 10:39:04 +01:00
Sichen Zhao
1b8b1c0a63 increase default replicated_deduplication_window from 100 to 1k 2023-11-28 14:24:06 -08:00
Denny Crane
e33efaff9f
Revert "Update date-time-functions.md" 2023-11-28 15:56:51 -04:00
Dmitry Novik
e9faad77cb
Simplify docs 2023-11-28 17:41:51 +01:00
Han Fei
6733438adc Merge branch 'master' into hanfei/statistic 2023-11-28 16:35:00 +01:00
Robert Schulze
b56b48d2de
Update docs 2023-11-28 14:59:20 +00:00
zvonand
c306d21b54 merge master + resolve conflicts 2023-11-28 15:51:21 +01:00