Commit Graph

3229 Commits

Author SHA1 Message Date
alesapin
1a5a9fca87
Merge pull request #53605 from irenjj/feat_53538
Add column 'name' to system.clusters as an alias to cluster.
2023-08-22 11:34:21 +02:00
Robert Schulze
583d9b33f0
Merge pull request #51446 from rschu1ze/recfgable-caches
Runtime-reconfigurable cache sizes
2023-08-21 23:27:21 +02:00
Robert Schulze
96c8b250ce
Allow to configure cache sizes at runtime 2023-08-21 13:51:10 +00:00
Kruglov Pavel
88aee95122
Merge branch 'master' into fast-count-from-files 2023-08-21 14:46:33 +02:00
avogar
47304bf7aa Optimize count from files in most input formats 2023-08-21 12:30:52 +00:00
Victor Krasnov
a7813260c0 Merge branch 'master' into ADQM-987 2023-08-21 14:45:13 +03:00
Kruglov Pavel
c68456a20a
Merge pull request #52692 from Avogar/variable-number-of-volumns-more-formats
Allow variable number of columns in more formats, make it work with schema inference
2023-08-21 13:28:35 +02:00
Duc Canh Le
2c07065f81 increase the default value
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-08-21 11:04:24 +00:00
Victor Krasnov
7a4d891a37 Fix docs spelling 2023-08-21 12:50:10 +03:00
Victor Krasnov
8b005a9d02 Update the documentaion 2023-08-21 12:37:58 +03:00
irenjj
38d2e75690 Add doc. 2023-08-20 17:30:05 +08:00
Kseniia Sumarokova
c0b8d7eddf
Merge pull request #50999 from ilejn/system_kafka_consumers
system.kafka_consumers table to monitor kafka consumers
2023-08-19 13:31:18 +04:00
Michael Kolupaev
a1522e22ea
Merge pull request #53281 from Avogar/batch-small-parquet-row-groups
Optimize reading small row groups by batching them together in Parquet
2023-08-18 17:15:42 -07:00
Duc Canh Le
2d353f8c43 Merge branch 'master' into limit_concurent_background_optimize 2023-08-18 09:25:27 +00:00
Anton Popov
b9df41d5e3
Merge pull request #53129 from CurtizJ/non-deterministic-mutations
Allow to execute constant non-deterministic functions in mutations on initiator
2023-08-18 00:26:20 +02:00
Anton Popov
1805dec6ff Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-17 14:09:43 +00:00
Ilya Yatsishin
7115110dad
Update merge-tree-settings.md
parts_to_throw_insert=3000
2023-08-17 15:59:22 +02:00
avogar
bca91548ad Add setting input_format_parquet_local_file_min_bytes_for_seek 2023-08-17 12:28:01 +00:00
zvonand
a8cdc94720 update docs acc to review 2023-08-15 23:42:04 +05:00
Anton Popov
5a1265d16d add docs 2023-08-15 00:24:47 +00:00
Duc Canh Le
cd535bea7d limit number of concurrent background partition optimize 2023-08-14 10:21:13 +00:00
Andrey Zvonov
3d902e65e4
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-08-12 23:12:47 +03:00
Alexey Milovidov
d87997d001
Merge pull request #52893 from knoguchi/CVE-2016-2183
CVE-2016-2183: disable 3DES
2023-08-12 03:34:49 +03:00
robot-clickhouse-ci-1
9e7e581813
Merge pull request #53216 from vitaliyf/master
docs: Fixed invalid MySQL named collection examples
2023-08-11 17:14:51 +02:00
Andrey Zvonov
02c511a008
Merge branch 'master' into zvonand-globs-small-fix 2023-08-11 15:56:44 +02:00
zvonand
1983c7ce95 update docs 2023-08-11 16:53:17 +03:00
avogar
7e863a2726 Address comments 2023-08-11 13:17:49 +00:00
Kruglov Pavel
e67c6c2f0a Fix typo 2023-08-11 13:17:49 +00:00
avogar
3ad7e57059 Optimize reading small row groups by batching them together in Parquet 2023-08-11 13:17:45 +00:00
Kruglov Pavel
b6b0e9c6bc
Merge branch 'master' into variable-number-of-volumns-more-formats 2023-08-11 14:02:21 +02:00
Ilya Golshtein
978d8bf9a6 system_kafka_consumers: cleanup with exceptions 2023-08-10 22:35:05 +00:00
Ilya Golshtein
80829a6bf7 system_kafka_consumers: no offset_committed, new test with MV 2023-08-10 22:35:05 +00:00
Ilya Golshtein
46be5e5782 system_kafka_consumers: cleanup, test should be more stable 2023-08-10 22:35:05 +00:00
Ilya Golshtein
3f205f4997 system_kafka_consumers: tiny doc changes 2023-08-10 22:35:05 +00:00
Ilya Golshtein
6258ab6cb4 system_kafka_consumers: doc link fix, USE_RDKAFKA 2023-08-10 22:35:05 +00:00
Ilya Golshtein
40fd53c3e3 system_kafka_consumers: style check 2023-08-10 22:35:05 +00:00
Ilya Golshtein
82e8b40bf5 system_kafka_consumers: doc 2023-08-10 22:35:05 +00:00
pufit
8c9209745c
Merge pull request #53127 from ClickHouse/pufit/keeper-client-improvements
Revert Revert "Implementing new commands for keeper-client"
2023-08-10 09:51:36 -04:00
Kruglov Pavel
33a39900ad
Merge branch 'master' into variable-number-of-volumns-more-formats 2023-08-09 19:51:17 +02:00
Vitaliy
f90e80e27d docs: Fixed invalid MySQL named collection examples
It's not valid to specify both on_duplicate_clause and replace_query, plus on_duplicate_clause
was supposed to be an SQL clause and not a boolean/integer.
2023-08-09 09:20:53 -04:00
Justin de Guzman
632e314c11
Add note on settings profiles with ClickHouse Cloud 2023-08-07 19:37:36 -07:00
Sean Haynes
77dd869414
Add ability to log when max_partitions_per_insert_block is reached (#50948)
* Add ability to log when max_partitions_per_insert_block is reached

There's plenty of reasons to drop max_partitions_per_insert_block
down from it's default of 100, with the main one being even touching
remotely close to this number of partitions will create a lot of
merge activity that can de-stabilise a cluster.

This commit adds the ability to log when the above limit is reached
rather than throw an exception, so that you can gauge the impact on
users when dropping this value down.

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

---------

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-08-07 23:28:19 +02:00
Vitaly Baranov
6af6247f8a
Merge pull request #52970 from arenadata/ADQM-985
Add `storage_policy` parameter in the `SETTINGS` clause of `RESTORE` statements
2023-08-07 19:01:08 +02:00
pufit
30700996f0 Merge branch 'master' into pufit/keeper-client-improvements
# Conflicts:
#	docs/en/operations/utilities/clickhouse-keeper-client.md
#	programs/keeper-client/Commands.cpp
#	programs/keeper-client/Commands.h
#	programs/keeper-client/KeeperClient.cpp
#	tests/integration/test_keeper_client/test.py
2023-08-07 12:26:08 -04:00
pufit
8e6f7b4d0b Fix typo, fix tests, touch command. 2023-08-07 12:08:31 -04:00
pufit
dc347d3dcb
Merge pull request #53010 from ClickHouse/pufit/keeper-client-fix-defaults
Fix default port for Keeper Client
2023-08-07 10:48:52 -04:00
Alexey Milovidov
7886e06217
Merge pull request #46051 from ucasfl/count-distinct-if
Continue of #42008, rewrite countDistinctIf with count_distinct_implementation
2023-08-06 19:31:44 +03:00
Alexey Milovidov
e5d3e348ce
Merge pull request #52635 from hendrik-m/table-names-as-string-literal
Allow writing table name as a string literal
2023-08-04 20:09:59 +03:00
Alexey Milovidov
6f88fc282b
Merge branch 'master' into count-distinct-if 2023-08-04 19:04:36 +03:00
Victor Krasnov
a2f48e5bb3 Merge branch 'master' into ADQM-985 2023-08-04 19:02:18 +03:00
pufit
d916601717
Merge branch 'master' into pufit/keeper-client-fix-defaults 2023-08-04 09:04:14 -04:00
Kruglov Pavel
b1fe9ce8f7
Merge branch 'master' into formats-with-subcolumns 2023-08-04 13:01:12 +02:00
hendrik-m
921b1eecb5 revert changes of clickhouse local to clickhouse-local 2023-08-03 21:12:20 +02:00
pufit
14a8ced906 Fix default port 2023-08-03 12:29:31 -04:00
Alexey Milovidov
29d386fec2
Merge branch 'master' into count-distinct-if 2023-08-03 15:36:11 +03:00
Alexey Milovidov
3a9f9e1297
Revert "Implementing new commands for keeper-client" 2023-08-03 15:05:52 +03:00
Victor Krasnov
8e3c98ca7a Amend the docs 2023-08-03 11:25:26 +03:00
hendrik-m
a915886b87 adapt documentation and change all references of clickhouse local
to `clickhouse-local`
2023-08-02 23:16:45 +02:00
Alexey Milovidov
e101f2011b
Merge branch 'master' into count-distinct-if 2023-08-03 00:09:52 +03:00
Victor Krasnov
d8792bf429 Merge branch 'master' into ADQM-985
# Conflicts:
#	docs/en/operations/backup.md
2023-08-02 20:17:59 +03:00
Victor Krasnov
d3f5551bb4 Clarify the documentation 2023-08-02 19:39:32 +03:00
Victor Krasnov
08aa90aa29 Amend the documentation 2023-08-02 17:26:59 +03:00
Anton Popov
ff137773e7
Merge branch 'master' into formats-with-subcolumns 2023-08-02 15:24:56 +02:00
Yakov Olkhovskiy
357fee99ff
Merge pull request #52791 from zvonand/zvonand-float-parsing
Add option to switch float parsing methods
2023-08-02 00:23:23 -04:00
Kenji Noguchi
17c4abce10 CVE-2016-2183: disable 3DES 2023-08-01 10:44:43 -07:00
Alexey Milovidov
561b094e69
Merge pull request #52877 from zamazan4ik/doc/add_pgo_to_docs
doc: add PGO information
2023-08-01 19:34:32 +03:00
Justin de Guzman
c485348486
Specify that written_bytes is uncompressed 2023-08-01 09:28:27 -07:00
Alexander Zaitsev
65329120c9
Merge branch 'master' into doc/add_pgo_to_docs 2023-08-01 19:03:16 +03:00
Yarik Briukhovetskyi
104a4aaee5
Merge pull request #51117 from ClickHouse/pufit/keeper-client-improvements
Implementing new commands for keeper-client
2023-08-01 17:47:33 +02:00
Alexander Zaitsev
e05f5ad5ac
Merge branch 'master' into doc/add_pgo_to_docs 2023-08-01 18:32:33 +03:00
Alexander Zaitsev
b79cd49ccf doc: add PGO article 2023-08-01 17:27:36 +02:00
Kruglov Pavel
8f6526a930
Merge branch 'master' into structure-to-schema 2023-08-01 16:22:14 +02:00
Alexey Milovidov
4578d43f79
Merge pull request #52656 from Avogar/rename-setting-for-url-encoding
Rename setting disable_url_encoding to enable_url_encoding and add a test
2023-08-01 16:09:01 +03:00
Andrey Zvonov
99cd8f9ba9
Merge branch 'master' into zvonand-float-parsing 2023-07-31 23:43:24 +03:00
Vitaly Baranov
f5ffef4014
Merge pull request #52658 from arenadata/ADQM-984
Add s3_storage_class parameter in SETTINGS of BACKUP statement
2023-07-31 17:32:12 +02:00
Alexander Tokmakov
7359a8108b
Merge pull request #51724 from arenadata/ADQM-939
Added max_sessions_for_user setting
2023-07-31 15:38:58 +03:00
Alexander Tokmakov
01f05e14eb
Merge pull request #50424 from tonickkozlov/tonickkozlov/zk-session-lifetime
Introduce fallback ZooKeeper sessions
2023-07-31 15:14:44 +03:00
flynn
c23893d7c1
Merge branch 'master' into count-distinct-if 2023-07-31 18:53:06 +08:00
Andrey Zvonov
987dd6602a
Update docs/en/operations/settings/settings.md
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2023-07-31 11:08:51 +03:00
Alexey Gerasimchuck
e58b3cfd32 Implemented max sessions for user 2023-07-30 22:09:03 +00:00
Kseniia Sumarokova
8daeeedc8f
Merge pull request #52315 from xiedeyantu/add-alias
system.events and system.metrics tables add column name as an alias to event and metric
2023-07-30 22:37:31 +02:00
zvonand
00a1a9f6bd added docs 2023-07-30 20:59:15 +02:00
Kseniia Sumarokova
08ef4d015c
Minor change 2023-07-30 13:36:52 +02:00
pufit
4e8f7f06af
Merge branch 'master' into pufit/keeper-client-improvements 2023-07-28 10:32:27 -04:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988
Added possibility to save logs on crash and options to configure logs buffer
2023-07-28 16:55:00 +03:00
Anton Kozlov
5dfc30528d Introduce fallback ZooKeeper sessions 2023-07-28 11:43:27 +00:00
robot-ch-test-poll3
f888a961bb
Merge pull request #52698 from jaijhala/patch-1
Update default output_format_arrow_compression.md
2023-07-28 12:17:48 +02:00
Kruglov Pavel
3e1c409e60
Merge branch 'master' into structure-to-schema 2023-07-28 11:32:16 +02:00
robot-ch-test-poll
22e5da914c
Merge pull request #52650 from rschu1ze/query-cache-asynchronous_metrics
Add query cache metrics to SYSTEM.ASYNCHRONOUS_METRICS
2023-07-28 11:06:55 +02:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
Roman Vasin
cfa06725cc
Merge branch 'master' into ADQM-984 2023-07-28 10:15:27 +03:00
flynn
6de5127c0d fix conflict 2023-07-28 07:11:52 +00:00
Robert Schulze
0b0ad7d45d
Merge branch 'master' into follow-up-to-50986 2023-07-27 22:08:26 +02:00
Jai Jhala
dba8b445bd
Update default output_format_arrow_compression.md
Updates the default parameter of output_format_arrow_compression_method from "none" to "lz4_frame".
2023-07-27 12:32:53 -07:00
avogar
67b0993bdf Add documentation 2023-07-27 18:54:41 +00:00
avogar
6d77d52dfe Allow variable number of columns in TSV/CuatomSeprarated/JSONCompactEachRow, make schema inference work with variable number of columns 2023-07-27 18:02:29 +00:00
Robert Schulze
c2ee774350
Add query cache metrics to system.asynchronous_metrics
Cf. https://github.com/ClickHouse/ClickHouse/pull/52384#issuecomment-1653241216
2023-07-27 15:19:01 +00:00
Robert Schulze
d48b1cadb0
Merge pull request #52384 from rschu1ze/query_cache_usage_in_query_log
Include query cache usage in SYSTEM.QUERY_LOG
2023-07-27 17:16:54 +02:00
avogar
b5fc34b770 Rename setting disable_url_encoding to enable_url_encoding and add a test 2023-07-27 12:20:33 +00:00
Roman Vasin
578ea9c5e8 Update documentation 2023-07-27 09:50:42 +00:00
Robert Schulze
043ad45ec3
Incorporate review feedback, pt. II 2023-07-27 09:18:24 +00:00
Robert Schulze
2b18872e86
Incorporate review feedback 2023-07-27 08:55:19 +00:00
pufit
ea672ba618 Add docs, add tests, fix small issues. 2023-07-26 11:15:27 -04:00
chen
6bb1a3005e
Merge branch 'ClickHouse:master' into add-alias 2023-07-26 22:29:32 +08:00
Robert Schulze
aa25ce9e3d
Follow-up to "Implement support of encrypted elements in configuration file"
Cf. PR #50986

- rename XML attribute "encryption_codec" to "encrypted_by"
2023-07-26 13:27:13 +00:00
Kruglov Pavel
0d34e97dbe
Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
Robert Schulze
d4737ca033
Merge pull request #50986 from arenadata/ADQM-822
Implement support of encrypted elements in configuration file
2023-07-26 12:27:04 +02:00
Alexey Milovidov
168b84a592
Merge pull request #52337 from Avogar/no-decode-url
Allow to disable decoding/encoding path in uri in URL engine
2023-07-25 05:43:06 +03:00
Kseniia Sumarokova
265e1437a3
Merge branch 'master' into add-alias 2023-07-24 21:52:41 +02:00
Robert Schulze
c755fde3a4
Include query cache usage in SYSTEM.QUERY_LOG 2023-07-24 16:24:36 +00:00
Roman Vasin
0af869ff0f
Merge branch 'master' into ADQM-822 2023-07-24 12:23:11 +03:00
xiedeyantu
f46568929d add doc 2023-07-24 07:35:48 +08:00
flynn
2e61e92c86 update doc 2023-07-23 04:07:18 +00:00
Alexey Milovidov
9dc988981e
Merge branch 'master' into is_obsolete 2023-07-22 04:59:26 +03:00
Igor Nikonov
8c8e097b72
Merge pull request #51013 from bigo-sg/grace_hash_join_full_right_202306
Grace hash join support full & right join
2023-07-21 22:22:06 +02:00
avogar
fe934d3059 Make better 2023-07-20 12:38:41 +00:00
Kruglov Pavel
342400d0b3
Merge branch 'master' into revert-52322-revert-51716-bug_fix_csv_field_type_not_match 2023-07-20 12:39:38 +02:00
lgbo-ustc
0ba97eeea5 wip: grace hash join support full & right join 2023-07-20 18:22:01 +08:00
Nikolay Degterinsky
209429d0e3
Merge pull request #49664 from ilejn/test_for_basic_auth_registry
Basic auth to fetch Avro schema in Kafka
2023-07-20 10:58:11 +02:00
avogar
2b8e4ebd4c Allow to disable decoding/encoding path in uri in URL engine 2023-07-19 19:48:39 +00:00
Rory Crispin
c47f19303a
Correct CH capitalisation 2023-07-19 14:27:21 +01:00
Rory Crispin
7ad399cc6d
Rephrase ALL supported note
I interpreted the note as 'ALL' is only supported before 23.4 
I think this reordering makes it clearer
2023-07-19 14:25:36 +01:00
Kruglov Pavel
f0026af189
Revert "Revert "Improve CSVInputFormat to check and set default value to column if deserialize failed"" 2023-07-19 14:51:11 +02:00
Kruglov Pavel
7b3564f96a
Revert "Improve CSVInputFormat to check and set default value to column if deserialize failed" 2023-07-19 14:44:59 +02:00
robot-ch-test-poll4
63d0616a22
Merge pull request #51716 from KevinyhZou/bug_fix_csv_field_type_not_match
Improve CSVInputFormat to check and set default value to column if deserialize failed
2023-07-19 14:41:05 +02:00
kevinyhzou
dcf7ba2534 remove unuseful code 2023-07-19 19:36:19 +08:00
kevinyhzou
94796f28ad ci fix 2023-07-19 19:24:16 +08:00
kevinyhzou
95424177d5 review fix 2023-07-19 18:26:54 +08:00
Ilya Golshtein
c550a532e6 test_for_basic_auth_registry - black formatter happy + some doc 2023-07-19 08:32:45 +00:00
Roman Vasin
12df1b2d7f Fix MD docs style 2023-07-18 14:52:38 +00:00
Kruglov Pavel
d3d0f101f7
Merge branch 'master' into full-filename-placeholder 2023-07-17 19:14:10 +02:00
Kruglov Pavel
1dd05319b5
Merge branch 'master' into formats-with-subcolumns 2023-07-17 19:13:42 +02:00
kevinyhzou
355faa4251 ci fix 2023-07-17 20:08:32 +08:00
robot-ch-test-poll4
036fb1fc9b
Merge pull request #52041 from ClickHouse/docs-organize-user-profiles
Docs organize user setting profiles
2023-07-17 12:03:06 +02:00
Sergei Trifonov
381ab07e1b
Merge pull request #51496 from yariks5s/add-index-bytes-to-system-parts
Add column primary_key_size to system.parts
2023-07-17 10:39:56 +02:00
robot-clickhouse-ci-2
ac3cc1c2ff
Merge pull request #45671 from ClibMouse/feature/interval-kql-style-formatting
Implement KQL-style formatting for Interval
2023-07-16 04:06:54 +02:00
robot-ch-test-poll
93b40c490f
Merge pull request #51945 from arenadata/ADQM-950-B
Implement support of date/time format specifiers in log and error log file names
2023-07-14 18:54:27 +02:00
kevinyhzou
b2665031dc review fix 2023-07-13 20:27:14 +08:00
kevinyhzou
ba57c84db3 bug fix csv input field type mismatch 2023-07-13 20:24:10 +08:00
Dan Roscigno
7756620f15
Merge branch 'master' into docs-organize-user-profiles 2023-07-11 17:59:48 -04:00
DanRoscigno
46fd88dca4 add session setting 2023-07-11 17:50:52 -04:00
DanRoscigno
6086787957 add overview 2023-07-11 16:59:16 -04:00
Roman Vasin
b9adb2039b Update MD docs 2023-07-11 15:13:47 +00:00
Yarik Briukhovetskyi
9afafa9554
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-11 14:51:46 +02:00
Roman Vasin
b6023d9f62 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-822 2023-07-11 10:35:31 +00:00
DanRoscigno
bea58a2780 Docs: added two methods for user profile 2023-07-10 17:21:37 -04:00
Alexey Milovidov
c2514279e4 Update settings.md 2023-07-10 13:51:49 -04:00
ltrk2
2d2debe3ce Introduce a separate setting for interval output formatting 2023-07-10 13:51:49 -04:00
ltrk2
b673aa8e6b Use the dialect configuration 2023-07-10 13:51:49 -04:00
ltrk2
522b9ebf8c Implement KQL-style formatting for Interval 2023-07-10 13:51:49 -04:00