Commit Graph

3293 Commits

Author SHA1 Message Date
serxa
a94ae9a7ab review fixes 2023-09-07 14:02:58 +00:00
Robert Schulze
cd3c121a62
Various fixups 2023-09-07 10:32:49 +00:00
Fern
25c06c9764
Update sampling-query-profiler.md
Adding a note to clarify that the sample query provided, in CH Cloud, might return empty information as it cycles through nodes of the cluster. You need to add clusterAllReplicas.
2023-09-07 10:47:42 +01:00
zvonand
c36a3fbd39 renamed setting 2023-09-07 12:00:25 +03:00
pufit
fef80f176e Fix typo 2023-09-06 21:56:14 -04:00
Alexey Gerasimchuck
c2f4dc0f14 Implemented peak_threads_usage 2023-09-07 01:32:39 +00:00
pufit
ef2350cfc7 Implementing exists, sync commands. Better tests 2023-09-06 20:36:39 -04:00
serxa
77697211cd add docs for system.scheduler + small fix 2023-09-06 19:30:39 +00:00
Mikhail Koviazin
f98007a4ed
Replace Turbo-Base64 with aklomp/base64
Closes #31643
2023-09-06 13:01:38 +00:00
robot-ch-test-poll
2e7edf4413
Merge pull request #53638 from arenadata/ADQM-987
Add `backup_log` system table
2023-09-05 17:03:41 +02:00
Robert Schulze
f4c86fe34e
Merge pull request #53860 from irenjj/feat_markdown
Add a setting to escape special characters in Markdown.
2023-09-05 15:44:11 +02:00
János Benjamin Antal
3f7d8f1cae
Merge pull request #54099 from Tiakon/master
Add the default value of task-upload-force
2023-09-05 11:32:53 +02:00
Victor Krasnov
132ab6067b Merge branch 'master' into ADQM-987 2023-09-05 10:01:44 +03:00
Alexey Milovidov
b2821106fd
Merge pull request #53923 from myrrc/docs/ch-disks
Add docs for clickhouse-disks
2023-09-05 02:10:18 +03:00
Robert Schulze
d03fba52f0
Merge remote-tracking branch 'rschu1ze/master' into multiple_query_arguments 2023-09-04 16:10:00 +00:00
Alejandro
5d6a2609c8
Updated doc of distributed_ddl_queue (#54192)
* Updated doc of distributed_ddl_queue

* Update docs/en/operations/system-tables/distributed_ddl_queue.md

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>

* Update docs/en/operations/system-tables/distributed_ddl_queue.md

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>

* Update docs/en/operations/system-tables/distributed_ddl_queue.md

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>

---------

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-09-04 17:25:06 +02:00
irenjj
c9261bbf18 Merge remote-tracking branch 'upstream/master' into feat_markdown 2023-09-04 22:35:53 +08:00
Sergei Trifonov
258da91b5f
Merge branch 'master' into disks-and-io-sheduler 2023-09-04 15:14:28 +02:00
irenjj
b57e248aab Fix doc spell error. 2023-09-04 20:58:19 +08:00
Robert Schulze
44994fe51b
Incorporate review feedback 2023-09-04 11:44:37 +00:00
Tiakon
1ceda6fbfa
Update docs/en/operations/utilities/clickhouse-copier.md
Co-authored-by: János Benjamin Antal <antaljanosbenjamin@users.noreply.github.com>
2023-09-04 18:26:59 +08:00
Tiakon
74dedf2a5d
Merge branch 'ClickHouse:master' into master 2023-09-04 17:42:16 +08:00
serxa
14e2032d92 add documentation 2023-09-01 16:28:03 +00:00
Victor Krasnov
52cce27e81 Merge branch 'master' into ADQM-987 2023-09-01 18:00:20 +03:00
alexX512
36b8932b37 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-31 21:40:50 +00:00
Mike Kot
ebcc97ad1b change case for copy operation in clickhouse-disks 2023-08-31 13:39:32 +00:00
Anton Popov
579ec699bf Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-31 12:59:59 +00:00
Robert Schulze
aefb543734
Merge remote-tracking branch 'rschu1ze/master' into feat_markdown 2023-08-31 11:32:44 +00:00
Robert Schulze
d8e6395eea
Docs: Follow-up to #53818 2023-08-31 11:15:50 +00:00
Robert Schulze
97d960ba1d
Merge pull request #53818 from arenadata/ADQM-1070
Add new hide_in_preprocessed attribute in configuration file
2023-08-31 13:00:16 +02:00
Andrey Zvonov
83405a8808
Merge branch 'master' into zvonand-globs-small-fix 2023-08-31 08:42:48 +02:00
Alexey Gerasimchuck
3a212217a3 Implemented globs to select * from '<file>' 2023-08-31 04:20:44 +00:00
Tiakon
0dcc0be377
Update clickhouse-copier.md
Shows that the type of task-upload-force is Boolean.
2023-08-31 10:38:19 +08:00
irenjj
277be44250 add test 2023-08-30 22:57:46 +08:00
vdimir
7618b2d112
Add partial_result_update_duration_ms to settings.md 2023-08-30 12:05:04 +02:00
Alexey Gerasimchuck
a1687e618b backward compatibility changes + fixes 2023-08-29 23:50:41 +00:00
irenjj
473ba91c21 Refactor writeAnyMarkdownEscapedString and Add more info into doc. 2023-08-29 23:54:40 +08:00
Mike Kot
061bbe13c0 add docs for clickhouse-disks 2023-08-29 12:25:04 +00:00
Alexey Gerasimchuck
de1ed97876 disabled validate_tcp_client_information 2023-08-29 08:59:49 +00:00
Alexey Gerasimchuck
e9757abea6 Added validate_tcp_client_information setting 2023-08-29 00:15:55 +00:00
irenjj
13322f1a90 Remove redundant functions. 2023-08-28 23:54:07 +08:00
Roman Vasin
87cf0e38fd Update MD docs 2023-08-28 13:11:44 +00:00
irenjj
51aa89eed8 Add a setting to automatically escape special characters in Markdown. 2023-08-28 00:10:33 +08:00
Andrey Zvonov
911bf94fbd
Merge branch 'master' into zvonand-globs-small-fix 2023-08-25 23:50:07 +05:00
Victor Krasnov
921f0c8b5d Merge branch 'master' into ADQM-987 2023-08-25 21:20:23 +03:00
Roman Vasin
8cfab6d53f Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-1070 2023-08-25 12:13:53 +00:00
Kruglov Pavel
d80be4673b
Merge pull request #53692 from Avogar/cache-count
Cache number of rows in files for count in file/s3/url/hdfs/azure functions
2023-08-25 09:08:52 +02:00
Roman Vasin
ed3ad4c943 Add documentation 2023-08-25 05:37:10 +00:00
Alexander Tokmakov
cbbb81f5cc
Merge pull request #53405 from canhld94/limit_concurent_background_optimize
Limit number of concurrent background partition optimize
2023-08-24 20:49:38 +03:00
Kruglov Pavel
f7e1abd774
Merge branch 'master' into cache-count 2023-08-23 22:31:49 +02:00
Kruglov Pavel
592fa77987
Merge branch 'master' into cache-count 2023-08-23 15:18:02 +02:00
Kruglov Pavel
7e362a2110
Merge branch 'master' into fast-count-from-files 2023-08-23 15:13:20 +02:00
Robert Schulze
bea651e828
Merge pull request #53657 from rschu1ze/cache-improvements
Expose more settings from caches
2023-08-23 14:58:45 +02:00
Kruglov Pavel
e193aec583
Merge branch 'master' into fast-count-from-files 2023-08-23 12:15:34 +02:00
Kruglov Pavel
6e3f2fedbd
Apply suggestions from code review
Co-authored-by: Dmitry Novik <mrnovikd@gmail.com>
2023-08-22 19:05:06 +02:00
Denny Crane
0713dc5ee4
Update storing-data.md 2023-08-22 14:04:35 -03:00
Victor Krasnov
258f9927b4 Merge branch 'master' into ADQM-987 2023-08-22 16:49:32 +03:00
Kruglov Pavel
67c5c0203b
Merge branch 'master' into fast-count-from-files 2023-08-22 15:03:48 +02:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Robert Schulze
f2fb7365e6
Add settings for 1. size_ratio (all caches) and 2. policy (index caches)
1. is an expert-level setting, default is 0.5, applies only to SLRU.

Also, I noticed that we expose cache policy settings for the mark and
the uncompresed cache but not for the index mark and the index
uncompressed cache. Changed that as well, it simplifies the code a bit.
2023-08-22 11:04:29 +00:00
alesapin
1a5a9fca87
Merge pull request #53605 from irenjj/feat_53538
Add column 'name' to system.clusters as an alias to cluster.
2023-08-22 11:34:21 +02:00
Robert Schulze
583d9b33f0
Merge pull request #51446 from rschu1ze/recfgable-caches
Runtime-reconfigurable cache sizes
2023-08-21 23:27:21 +02:00
Anton Popov
3e9a182555 better interfaces for getting of stream name in part 2023-08-21 13:52:25 +00:00
Robert Schulze
96c8b250ce
Allow to configure cache sizes at runtime 2023-08-21 13:51:10 +00:00
Kruglov Pavel
88aee95122
Merge branch 'master' into fast-count-from-files 2023-08-21 14:46:33 +02:00
avogar
47304bf7aa Optimize count from files in most input formats 2023-08-21 12:30:52 +00:00
Victor Krasnov
a7813260c0 Merge branch 'master' into ADQM-987 2023-08-21 14:45:13 +03:00
Kruglov Pavel
c68456a20a
Merge pull request #52692 from Avogar/variable-number-of-volumns-more-formats
Allow variable number of columns in more formats, make it work with schema inference
2023-08-21 13:28:35 +02:00
Duc Canh Le
2c07065f81 increase the default value
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-08-21 11:04:24 +00:00
Victor Krasnov
7a4d891a37 Fix docs spelling 2023-08-21 12:50:10 +03:00
Victor Krasnov
8b005a9d02 Update the documentaion 2023-08-21 12:37:58 +03:00
irenjj
38d2e75690 Add doc. 2023-08-20 17:30:05 +08:00
Kseniia Sumarokova
c0b8d7eddf
Merge pull request #50999 from ilejn/system_kafka_consumers
system.kafka_consumers table to monitor kafka consumers
2023-08-19 13:31:18 +04:00
Michael Kolupaev
a1522e22ea
Merge pull request #53281 from Avogar/batch-small-parquet-row-groups
Optimize reading small row groups by batching them together in Parquet
2023-08-18 17:15:42 -07:00
Duc Canh Le
2d353f8c43 Merge branch 'master' into limit_concurent_background_optimize 2023-08-18 09:25:27 +00:00
Anton Popov
b9df41d5e3
Merge pull request #53129 from CurtizJ/non-deterministic-mutations
Allow to execute constant non-deterministic functions in mutations on initiator
2023-08-18 00:26:20 +02:00
Anton Popov
1805dec6ff Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-17 14:09:43 +00:00
Ilya Yatsishin
7115110dad
Update merge-tree-settings.md
parts_to_throw_insert=3000
2023-08-17 15:59:22 +02:00
avogar
bca91548ad Add setting input_format_parquet_local_file_min_bytes_for_seek 2023-08-17 12:28:01 +00:00
zvonand
a8cdc94720 update docs acc to review 2023-08-15 23:42:04 +05:00
Anton Popov
2e22b17d57 add docs and settings randomizations 2023-08-15 00:38:07 +00:00
Anton Popov
5a1265d16d add docs 2023-08-15 00:24:47 +00:00
Duc Canh Le
cd535bea7d limit number of concurrent background partition optimize 2023-08-14 10:21:13 +00:00
Andrey Zvonov
3d902e65e4
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-08-12 23:12:47 +03:00
Alexey Milovidov
d87997d001
Merge pull request #52893 from knoguchi/CVE-2016-2183
CVE-2016-2183: disable 3DES
2023-08-12 03:34:49 +03:00
robot-clickhouse-ci-1
9e7e581813
Merge pull request #53216 from vitaliyf/master
docs: Fixed invalid MySQL named collection examples
2023-08-11 17:14:51 +02:00
Andrey Zvonov
02c511a008
Merge branch 'master' into zvonand-globs-small-fix 2023-08-11 15:56:44 +02:00
zvonand
1983c7ce95 update docs 2023-08-11 16:53:17 +03:00
avogar
7e863a2726 Address comments 2023-08-11 13:17:49 +00:00
Kruglov Pavel
e67c6c2f0a Fix typo 2023-08-11 13:17:49 +00:00
avogar
3ad7e57059 Optimize reading small row groups by batching them together in Parquet 2023-08-11 13:17:45 +00:00
Kruglov Pavel
b6b0e9c6bc
Merge branch 'master' into variable-number-of-volumns-more-formats 2023-08-11 14:02:21 +02:00
Ilya Golshtein
978d8bf9a6 system_kafka_consumers: cleanup with exceptions 2023-08-10 22:35:05 +00:00
Ilya Golshtein
80829a6bf7 system_kafka_consumers: no offset_committed, new test with MV 2023-08-10 22:35:05 +00:00
Ilya Golshtein
46be5e5782 system_kafka_consumers: cleanup, test should be more stable 2023-08-10 22:35:05 +00:00
Ilya Golshtein
3f205f4997 system_kafka_consumers: tiny doc changes 2023-08-10 22:35:05 +00:00
Ilya Golshtein
6258ab6cb4 system_kafka_consumers: doc link fix, USE_RDKAFKA 2023-08-10 22:35:05 +00:00
Ilya Golshtein
40fd53c3e3 system_kafka_consumers: style check 2023-08-10 22:35:05 +00:00
Ilya Golshtein
82e8b40bf5 system_kafka_consumers: doc 2023-08-10 22:35:05 +00:00
pufit
8c9209745c
Merge pull request #53127 from ClickHouse/pufit/keeper-client-improvements
Revert Revert "Implementing new commands for keeper-client"
2023-08-10 09:51:36 -04:00
Kruglov Pavel
33a39900ad
Merge branch 'master' into variable-number-of-volumns-more-formats 2023-08-09 19:51:17 +02:00
Vitaliy
f90e80e27d docs: Fixed invalid MySQL named collection examples
It's not valid to specify both on_duplicate_clause and replace_query, plus on_duplicate_clause
was supposed to be an SQL clause and not a boolean/integer.
2023-08-09 09:20:53 -04:00
Justin de Guzman
632e314c11
Add note on settings profiles with ClickHouse Cloud 2023-08-07 19:37:36 -07:00
Sean Haynes
77dd869414
Add ability to log when max_partitions_per_insert_block is reached (#50948)
* Add ability to log when max_partitions_per_insert_block is reached

There's plenty of reasons to drop max_partitions_per_insert_block
down from it's default of 100, with the main one being even touching
remotely close to this number of partitions will create a lot of
merge activity that can de-stabilise a cluster.

This commit adds the ability to log when the above limit is reached
rather than throw an exception, so that you can gauge the impact on
users when dropping this value down.

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

---------

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-08-07 23:28:19 +02:00
Vitaly Baranov
6af6247f8a
Merge pull request #52970 from arenadata/ADQM-985
Add `storage_policy` parameter in the `SETTINGS` clause of `RESTORE` statements
2023-08-07 19:01:08 +02:00
pufit
30700996f0 Merge branch 'master' into pufit/keeper-client-improvements
# Conflicts:
#	docs/en/operations/utilities/clickhouse-keeper-client.md
#	programs/keeper-client/Commands.cpp
#	programs/keeper-client/Commands.h
#	programs/keeper-client/KeeperClient.cpp
#	tests/integration/test_keeper_client/test.py
2023-08-07 12:26:08 -04:00
pufit
8e6f7b4d0b Fix typo, fix tests, touch command. 2023-08-07 12:08:31 -04:00
pufit
dc347d3dcb
Merge pull request #53010 from ClickHouse/pufit/keeper-client-fix-defaults
Fix default port for Keeper Client
2023-08-07 10:48:52 -04:00
Dani Pozo
f500b0da14 Document limitation of BACKUP TO Disk('s3_backup') 2023-08-07 12:23:57 +02:00
Alexey Milovidov
7886e06217
Merge pull request #46051 from ucasfl/count-distinct-if
Continue of #42008, rewrite countDistinctIf with count_distinct_implementation
2023-08-06 19:31:44 +03:00
Alexey Milovidov
e5d3e348ce
Merge pull request #52635 from hendrik-m/table-names-as-string-literal
Allow writing table name as a string literal
2023-08-04 20:09:59 +03:00
Alexey Milovidov
6f88fc282b
Merge branch 'master' into count-distinct-if 2023-08-04 19:04:36 +03:00
Victor Krasnov
a2f48e5bb3 Merge branch 'master' into ADQM-985 2023-08-04 19:02:18 +03:00
pufit
d916601717
Merge branch 'master' into pufit/keeper-client-fix-defaults 2023-08-04 09:04:14 -04:00
Kruglov Pavel
b1fe9ce8f7
Merge branch 'master' into formats-with-subcolumns 2023-08-04 13:01:12 +02:00
hendrik-m
921b1eecb5 revert changes of clickhouse local to clickhouse-local 2023-08-03 21:12:20 +02:00
pufit
14a8ced906 Fix default port 2023-08-03 12:29:31 -04:00
Alexey Milovidov
29d386fec2
Merge branch 'master' into count-distinct-if 2023-08-03 15:36:11 +03:00
Alexey Milovidov
3a9f9e1297
Revert "Implementing new commands for keeper-client" 2023-08-03 15:05:52 +03:00
Victor Krasnov
8e3c98ca7a Amend the docs 2023-08-03 11:25:26 +03:00
hendrik-m
a915886b87 adapt documentation and change all references of clickhouse local
to `clickhouse-local`
2023-08-02 23:16:45 +02:00
Alexey Milovidov
e101f2011b
Merge branch 'master' into count-distinct-if 2023-08-03 00:09:52 +03:00
Victor Krasnov
d8792bf429 Merge branch 'master' into ADQM-985
# Conflicts:
#	docs/en/operations/backup.md
2023-08-02 20:17:59 +03:00
Victor Krasnov
d3f5551bb4 Clarify the documentation 2023-08-02 19:39:32 +03:00
Victor Krasnov
08aa90aa29 Amend the documentation 2023-08-02 17:26:59 +03:00
Anton Popov
ff137773e7
Merge branch 'master' into formats-with-subcolumns 2023-08-02 15:24:56 +02:00
Yakov Olkhovskiy
357fee99ff
Merge pull request #52791 from zvonand/zvonand-float-parsing
Add option to switch float parsing methods
2023-08-02 00:23:23 -04:00
Kenji Noguchi
17c4abce10 CVE-2016-2183: disable 3DES 2023-08-01 10:44:43 -07:00
Alexey Milovidov
561b094e69
Merge pull request #52877 from zamazan4ik/doc/add_pgo_to_docs
doc: add PGO information
2023-08-01 19:34:32 +03:00
Justin de Guzman
c485348486
Specify that written_bytes is uncompressed 2023-08-01 09:28:27 -07:00
Alexander Zaitsev
65329120c9
Merge branch 'master' into doc/add_pgo_to_docs 2023-08-01 19:03:16 +03:00
Yarik Briukhovetskyi
104a4aaee5
Merge pull request #51117 from ClickHouse/pufit/keeper-client-improvements
Implementing new commands for keeper-client
2023-08-01 17:47:33 +02:00
Alexander Zaitsev
e05f5ad5ac
Merge branch 'master' into doc/add_pgo_to_docs 2023-08-01 18:32:33 +03:00
Alexander Zaitsev
b79cd49ccf doc: add PGO article 2023-08-01 17:27:36 +02:00
Kruglov Pavel
8f6526a930
Merge branch 'master' into structure-to-schema 2023-08-01 16:22:14 +02:00
Alexey Milovidov
4578d43f79
Merge pull request #52656 from Avogar/rename-setting-for-url-encoding
Rename setting disable_url_encoding to enable_url_encoding and add a test
2023-08-01 16:09:01 +03:00
Andrey Zvonov
99cd8f9ba9
Merge branch 'master' into zvonand-float-parsing 2023-07-31 23:43:24 +03:00
Vitaly Baranov
f5ffef4014
Merge pull request #52658 from arenadata/ADQM-984
Add s3_storage_class parameter in SETTINGS of BACKUP statement
2023-07-31 17:32:12 +02:00
Alexander Tokmakov
7359a8108b
Merge pull request #51724 from arenadata/ADQM-939
Added max_sessions_for_user setting
2023-07-31 15:38:58 +03:00
Alexander Tokmakov
01f05e14eb
Merge pull request #50424 from tonickkozlov/tonickkozlov/zk-session-lifetime
Introduce fallback ZooKeeper sessions
2023-07-31 15:14:44 +03:00
flynn
c23893d7c1
Merge branch 'master' into count-distinct-if 2023-07-31 18:53:06 +08:00
Andrey Zvonov
987dd6602a
Update docs/en/operations/settings/settings.md
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2023-07-31 11:08:51 +03:00
Alexey Gerasimchuck
e58b3cfd32 Implemented max sessions for user 2023-07-30 22:09:03 +00:00
Kseniia Sumarokova
8daeeedc8f
Merge pull request #52315 from xiedeyantu/add-alias
system.events and system.metrics tables add column name as an alias to event and metric
2023-07-30 22:37:31 +02:00
zvonand
00a1a9f6bd added docs 2023-07-30 20:59:15 +02:00
Kseniia Sumarokova
08ef4d015c
Minor change 2023-07-30 13:36:52 +02:00
pufit
4e8f7f06af
Merge branch 'master' into pufit/keeper-client-improvements 2023-07-28 10:32:27 -04:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988
Added possibility to save logs on crash and options to configure logs buffer
2023-07-28 16:55:00 +03:00
Anton Kozlov
5dfc30528d Introduce fallback ZooKeeper sessions 2023-07-28 11:43:27 +00:00