Commit Graph

1620 Commits

Author SHA1 Message Date
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
zvonand
0766c73aab Rename date_time_overflow_mode -> date_time_overflow_behavior, moved it to format settings 2023-10-25 23:11:13 +02:00
zvonand
5b86e8c714 updated after review 2023-10-25 23:10:58 +02:00
zvonand
2f3695add8 Introduce setting for dt overflow exception
Added tests and docs
2023-10-25 23:10:24 +02:00
Denny Crane
0eeee950d7 Merge branch 'master' into background_fetches_pool_size 2023-09-28 15:34:17 -03:00
zvonand
5f67788c03 update docs and comments 2023-09-21 00:16:17 +02:00
Denny Crane
e78d09cc8e Merge branch 'master' into background_fetches_pool_size 2023-09-17 20:01:39 -03:00
Andrey Zvonov
ff16ddbbb3
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-14 11:31:49 +03:00
Dmitry Novik
7edc0a30a3
Merge pull request #54335 from arenadata/ADQM-1109
Added peak_threads_usage to query_log table
2023-09-12 16:03:27 +02:00
Denny Crane
a632b57780 Merge branch 'master' into background_fetches_pool_size 2023-09-11 10:57:58 -03:00
Andrey Zvonov
ff4586e663
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-08 18:17:06 +02:00
Robert Schulze
cd3c121a62
Various fixups 2023-09-07 10:32:49 +00:00
zvonand
c36a3fbd39 renamed setting 2023-09-07 12:00:25 +03:00
Alexey Gerasimchuck
c2f4dc0f14 Implemented peak_threads_usage 2023-09-07 01:32:39 +00:00
Mikhail Koviazin
f98007a4ed
Replace Turbo-Base64 with aklomp/base64
Closes #31643
2023-09-06 13:01:38 +00:00
Denny Crane
e1bc6cb0a7 increase background_fetches_pool_size to 16, background_schedule_pool_size to 512 2023-09-05 15:24:21 -03:00
robot-ch-test-poll
2e7edf4413
Merge pull request #53638 from arenadata/ADQM-987
Add `backup_log` system table
2023-09-05 17:03:41 +02:00
robot-clickhouse
9cafdbd972
Merge pull request #54309 from evillique/better-docs
Make docs better
2023-09-05 15:58:59 +02:00
Nikolay Degterinsky
2db239d6ad Make docs better 2023-09-05 12:43:53 +00:00
Victor Krasnov
52cce27e81 Merge branch 'master' into ADQM-987 2023-09-01 18:00:20 +03:00
Robert Schulze
97d960ba1d
Merge pull request #53818 from arenadata/ADQM-1070
Add new hide_in_preprocessed attribute in configuration file
2023-08-31 13:00:16 +02:00
Andrey Zvonov
83405a8808
Merge branch 'master' into zvonand-globs-small-fix 2023-08-31 08:42:48 +02:00
Alexey Gerasimchuck
3a212217a3 Implemented globs to select * from '<file>' 2023-08-31 04:20:44 +00:00
Alexey Gerasimchuck
a1687e618b backward compatibility changes + fixes 2023-08-29 23:50:41 +00:00
Alexey Gerasimchuck
de1ed97876 disabled validate_tcp_client_information 2023-08-29 08:59:49 +00:00
Alexey Gerasimchuck
e9757abea6 Added validate_tcp_client_information setting 2023-08-29 00:15:55 +00:00
Roman Vasin
0a5a9e8b65 Update MD docs 2023-08-28 13:53:06 +00:00
Roman Vasin
87cf0e38fd Update MD docs 2023-08-28 13:11:44 +00:00
Roman Vasin
ed3ad4c943 Add documentation 2023-08-25 05:37:10 +00:00
Victor Krasnov
8b005a9d02 Update the documentaion 2023-08-21 12:37:58 +03:00
zvonand
a8cdc94720 update docs acc to review 2023-08-15 23:42:04 +05:00
Andrey Zvonov
3d902e65e4
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-08-12 23:12:47 +03:00
Alexey Milovidov
d87997d001
Merge pull request #52893 from knoguchi/CVE-2016-2183
CVE-2016-2183: disable 3DES
2023-08-12 03:34:49 +03:00
zvonand
1983c7ce95 update docs 2023-08-11 16:53:17 +03:00
Vitaliy
f90e80e27d docs: Fixed invalid MySQL named collection examples
It's not valid to specify both on_duplicate_clause and replace_query, plus on_duplicate_clause
was supposed to be an SQL clause and not a boolean/integer.
2023-08-09 09:20:53 -04:00
Sean Haynes
77dd869414
Add ability to log when max_partitions_per_insert_block is reached (#50948)
* Add ability to log when max_partitions_per_insert_block is reached

There's plenty of reasons to drop max_partitions_per_insert_block
down from it's default of 100, with the main one being even touching
remotely close to this number of partitions will create a lot of
merge activity that can de-stabilise a cluster.

This commit adds the ability to log when the above limit is reached
rather than throw an exception, so that you can gauge the impact on
users when dropping this value down.

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

---------

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-08-07 23:28:19 +02:00
Kruglov Pavel
b1fe9ce8f7
Merge branch 'master' into formats-with-subcolumns 2023-08-04 13:01:12 +02:00
Alexander Zaitsev
b4d692c95f doc: try to fix PGO docs 2023-08-02 16:08:38 +02:00
Anton Popov
ff137773e7
Merge branch 'master' into formats-with-subcolumns 2023-08-02 15:24:56 +02:00
Kenji Noguchi
17c4abce10 CVE-2016-2183: disable 3DES 2023-08-01 10:44:43 -07:00
Andrey Zvonov
99cd8f9ba9
Merge branch 'master' into zvonand-float-parsing 2023-07-31 23:43:24 +03:00
Andrey Zvonov
cb5bebf4e4
Update docs/ru/operations/settings/settings.md
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2023-07-31 11:09:01 +03:00
Alexey Gerasimchuck
e58b3cfd32 Implemented max sessions for user 2023-07-30 22:09:03 +00:00
zvonand
00a1a9f6bd added docs 2023-07-30 20:59:15 +02:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988
Added possibility to save logs on crash and options to configure logs buffer
2023-07-28 16:55:00 +03:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
Robert Schulze
aa25ce9e3d
Follow-up to "Implement support of encrypted elements in configuration file"
Cf. PR #50986

- rename XML attribute "encryption_codec" to "encrypted_by"
2023-07-26 13:27:13 +00:00
Kruglov Pavel
0d34e97dbe
Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
Roman Vasin
0af869ff0f
Merge branch 'master' into ADQM-822 2023-07-24 12:23:11 +03:00
Roman Vasin
12df1b2d7f Fix MD docs style 2023-07-18 14:52:38 +00:00
Kruglov Pavel
d3d0f101f7
Merge branch 'master' into full-filename-placeholder 2023-07-17 19:14:10 +02:00
Kruglov Pavel
1dd05319b5
Merge branch 'master' into formats-with-subcolumns 2023-07-17 19:13:42 +02:00
robot-ch-test-poll
93b40c490f
Merge pull request #51945 from arenadata/ADQM-950-B
Implement support of date/time format specifiers in log and error log file names
2023-07-14 18:54:27 +02:00
Roman Vasin
b9adb2039b Update MD docs 2023-07-11 15:13:47 +00:00
Roman Vasin
b6023d9f62 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-822 2023-07-11 10:35:31 +00:00
Dmitry Kardymon
385a210fee Merge remote-tracking branch 'origin/master' into ADQM-870 2023-07-10 13:19:21 +00:00
Victor Krasnov
e311d31d87 Merge branch 'master' into ADQM-950-B 2023-07-10 15:50:09 +08:00
Victor Krasnov
7080d85d2d Amend the documentation 2023-07-07 10:54:36 +08:00
Dmitry Kardymon
32f5a78302 Fix setting name 2023-07-06 07:32:46 +00:00
Dmitry Kardymon
24b5c9c204 Use one setting input_format_csv_allow_variable_number_of_colums and code in RowInput 2023-07-06 06:05:43 +00:00
Kruglov Pavel
a2805f8f44
Merge branch 'master' into formats-with-subcolumns 2023-07-04 23:27:03 +02:00
avogar
3dc4ff1760 Remove obsolete settings 2023-07-04 21:21:22 +00:00
Rory Crispin
c9a26d43c5 (docs) Remove async_metric_log event_time_microseconds
event_time_microseconds was removed from the
system.asynchronous_metric_log in
https://github.com/ClickHouse/ClickHouse/pull/36360
2023-07-04 12:06:15 +01:00
Dmitry Kardymon
ab4142eb8f Merge remote-tracking branch 'clickhouse/master' into ADQM-870 2023-07-04 08:23:31 +03:00
avogar
ebeef65920 Add placeholder for rull filename in rename_files_after_processing setting 2023-06-29 13:35:27 +00:00
Alexey Milovidov
0e88aae9d7 Remove ConsoleCertificateHandler 2023-06-26 04:27:50 +02:00
Dmitry Kardymon
dbced8a30c Merge remote-tracking branch 'origin/master' into ADQM-870 2023-06-22 19:49:06 +00:00
Andrey Zvonov
d4316c7189
Merge branch 'master' into zvonand-implicit-tz 2023-06-22 17:23:20 +02:00
Roman Vasin
d55878d587
Merge branch 'master' into ADQM-822 2023-06-16 18:57:51 +03:00
Andrey Zvonov
66d86a9ea2
Update settings.md 2023-06-16 12:33:37 +03:00
Andrey Zvonov
d065fb756d
Update settings.md 2023-06-16 12:24:19 +03:00
zvonand
4155d13d69 merge master and resolve conflict 2023-06-16 02:20:32 +02:00
zvonand
e60506f41b changes requested in review 2023-06-16 02:16:04 +02:00
Dmitry Kardymon
806176d88e Add input_format_csv_missing_as_default setting and tests 2023-06-15 11:23:08 +00:00
Denny Crane
fd01cb7bec
Merge branch 'master' into Docs/ip_addresses 2023-06-14 17:38:48 -03:00
Dmitry Kardymon
a91fc3ddb3 Add docs/ add more cases in test 2023-06-14 16:44:31 +00:00
Roman Vasin
14dfebba49 Fix links in MD 2023-06-14 13:35:11 +00:00
Roman Vasin
a4e982442f Update documentation 2023-06-14 11:13:59 +00:00
Andrey Zvonov
d95be4162f
Merge branch 'master' into zvonand-implicit-tz 2023-06-08 18:34:45 +03:00
Kruglov Pavel
b83b057045
Merge branch 'master' into renamefile 2023-06-06 19:38:05 +02:00
Dan Roscigno
f691fe787b
Merge branch 'master' into Docs/ip_addresses 2023-06-06 09:12:31 -04:00
Denny Crane
aa35689cb1 fix links in other lang-s 2023-06-04 19:39:30 -03:00
Alexey Gerasimchuk
9958731c27
Merge branch 'master' into ADQM-830 2023-06-05 07:46:47 +10:00
Andrey Zvonov
2e427ee028
Merge branch 'master' into zvonand-implicit-tz 2023-06-02 01:15:56 +03:00
Andrey Zvonov
87fc780c14
Merge branch 'master' into zvonand-implicit-tz 2023-05-30 13:13:46 +03:00
Victor Krasnov
9a8086a377 Reorder toLastDayOf* functions in settings.md 2023-05-29 22:12:44 +00:00
Victor Krasnov
0ad5b9f598 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-810-dev 2023-05-29 08:26:26 +00:00
alekseygolub
36e8f13242 Added docs for feature 2023-05-25 20:10:02 +00:00
Alexey Gerasimchuck
4eb944fef1 minor changes in documentation 2023-05-25 08:05:11 +00:00
Alexey Gerasimchuck
75791d7a63 Added input_format_csv_trim_whitespaces parameter 2023-05-25 07:51:32 +00:00
Victor Krasnov
99a7967f11 Amend the dicumentation with regard to toLastDayOfWeek 2023-05-24 11:58:39 +00:00
zvonand
f459ac5517 resolve ambiguity by adding a section to docs 2023-05-20 01:38:35 +02:00
zvonand
7dccb51bc0 fix conflict and update 2023-05-19 23:40:51 +02:00
Alexey Milovidov
f5506210d6 Geo types are production ready 2023-05-19 12:43:55 +02:00
zvonand
c3af36915f fixed docs 2 2023-05-12 01:29:34 +02:00
zvonand
60b69601e9 update docs 2023-05-12 00:27:11 +02:00
Vitaly Baranov
ec011b9113
Merge branch 'master' into user-grants-from-config 2023-05-11 17:08:06 +02:00
zvonand
ecd0b4cc06 update settings from master 2023-05-11 00:37:58 +02:00
Alexey Milovidov
8a6e07f0ea Make projections production-ready 2023-05-10 03:35:13 +02:00
pufit
e1fa147e51 docs 2023-05-05 22:57:48 -04:00