Commit Graph

5196 Commits

Author SHA1 Message Date
kssenii
6b3ab311c3 Allow to cache data for object storage table engines and data lakes using ETag and Path hash for cache key 2024-09-30 19:20:37 +02:00
Nikita Taranov
c05231e0cf impl 2024-09-30 16:32:54 +01:00
Pablo Marcos
7965c5dd34 Merge branch 'master' into system-query-metric-log 2024-09-30 07:56:32 +00:00
Tuan Pham Anh
a348183941 Merge branch 'master' into report-running-ddl-worker-hosts 2024-09-30 07:48:56 +00:00
Alexey Milovidov
5a91127310 Update LocalServer.cpp 2024-09-29 04:28:36 +02:00
Denis Hananein
5c575f01c4 Support --copy arg for clickhouse-local as shortcut for format conversion 2024-09-29 04:28:36 +02:00
Julia Kartseva
038ffe7cc0 Merge branch 'master' into refactor-object-storages 2024-09-28 08:58:14 +00:00
Julia Kartseva
6d8954a055 fix 02802_clickhouse_disks_s3_copy.sh 2024-09-28 08:08:14 +00:00
Alexander Tokmakov
39786f7352
Merge pull request #69448 from tuanpach/add-identifier-quoting-rule
Add show_create_query_identifier_quoting_rule setting
2024-09-27 19:05:40 +00:00
Tuan Pham Anh
09a4173a33 Merge branch 'master' into add-identifier-quoting-rule 2024-09-27 13:02:49 +00:00
Pablo Marcos
295c4590af Merge branch 'master' into system-query-metric-log 2024-09-27 10:28:18 +00:00
Tuan Pham Anh
53bb5f86b5 Merge branch 'master' into report-running-ddl-worker-hosts 2024-09-27 06:53:56 +00:00
serxa
0d6f79909b Merge branch 'master' into fix-use-concurrency-control 2024-09-26 16:57:58 +00:00
Kseniia Sumarokova
ec8cf035c1
Merge branch 'master' into fix-read-settings-in-index-loading 2024-09-26 17:47:15 +01:00
kssenii
a02f222326 Merge remote-tracking branch 'origin' into fix-read-settings-in-index-loading 2024-09-25 17:53:08 +02:00
tuanpach
c2d9951230
Merge branch 'master' into add-identifier-quoting-rule 2024-09-25 13:56:43 +08:00
Tuan Pham Anh
6a83b5cca7 Remove IdentifierQuotingStyle::None 2024-09-25 03:28:38 +00:00
Tuan Pham Anh
9ed14e047a Add distributed_ddl.replicas_path setting 2024-09-25 02:21:19 +00:00
Raúl Marín
a90790ce5b Remove dbms dependency on clickhouse_functions 2024-09-24 19:48:23 +02:00
vdimir
b858595e54
Merge pull request #69861 from ClickHouse/vdimir/fix-mongo-cxx-driver-gen
Resubmit #63279
2024-09-24 11:41:28 +00:00
Julia Kartseva
f988aa521f Merge remote-tracking branch 'origin/master' into refactor-object-storages 2024-09-23 21:14:11 +00:00
Robert Schulze
b0f49043fc
Fix build 2024-09-23 20:30:49 +00:00
vdimir
4c9c9015f8
Revert "Revert "Merge pull request #63279 from allmazz/mongodb_refactoring""
This reverts commit 2ae9c9ac16.
2024-09-23 07:06:58 +00:00
Alexey Milovidov
2ae9c9ac16 Revert "Merge pull request #63279 from allmazz/mongodb_refactoring"
This reverts commit 14cb02a18c, reversing
changes made to a940a9ebbc.
2024-09-22 22:28:24 +02:00
serxa
8aeb1120c1 Merge branch 'master' into sql-for-workload-management 2024-09-22 15:43:02 +00:00
serxa
d01655625f Add async_load_system_database setting 2024-09-22 12:06:59 +00:00
Alexey Milovidov
960434e59a Merge branch 'master' of github.com:ClickHouse/ClickHouse into revert-68608-revert-60197-format-settings-parsing 2024-09-21 18:29:56 +02:00
Julia Kartseva
5473e0b64b Merge remote-tracking branch 'upstream/master' into interactive-metrics-table 2024-09-19 22:34:13 +00:00
Kirill Nikiforov
8173c4fcff
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-09-19 17:00:00 +04:00
Raúl Marín
f3df7bd171 Hide Settings implementation 2024-09-18 15:48:02 +02:00
Kirill Nikiforov
2c360e86be
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-09-18 16:14:02 +04:00
kssenii
5f6d54f6fb Merge remote-tracking branch 'origin' into fix-read-settings-in-index-loading 2024-09-17 14:38:42 +02:00
serxa
907ef0f717 Merge branch 'master' into sql-for-workload-management 2024-09-17 11:24:31 +00:00
serxa
d86ad992f1 Merge branch 'master' into fix-use-concurrency-control 2024-09-16 15:05:14 +00:00
serxa
5473b5a051 get rid of ResourceManagersFactory 2024-09-14 09:45:59 +00:00
Julia Kartseva
a8eac8ed10 Merge remote-tracking branch 'upstream/master' into interactive-metrics-table 2024-09-13 19:44:43 +00:00
serxa
afd123f741 Merge branch 'master' into sql-for-workload-management 2024-09-12 17:04:02 +00:00
Kseniia Sumarokova
50e923caec
Merge branch 'master' into fix-read-settings-in-index-loading 2024-09-12 14:15:51 +02:00
Mikhail Artemenko
494455e4eb Merge branch 'master' into issues/68932/remove-recursive 2024-09-12 08:51:41 +00:00
Sergei Trifonov
90645d7c0e
Merge branch 'master' into fix-use-concurrency-control 2024-09-11 18:48:11 +02:00
Alexey Milovidov
bf7ec7d639
Revert "Revert "Fix unexpected behavior with FORMAT and SETTINGS parsing"" 2024-09-11 13:22:27 +02:00
Antonio Andelic
bdf8c859b1 Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-09-10 14:13:48 +02:00
Mikhail Artemenko
6309f36232 add limit option to rmr command 2024-09-09 09:44:19 +00:00
Pablo Marcos
058c977063 Merge branch 'master' into system-query-metric-log 2024-09-02 10:57:10 +00:00
serxa
31e2205c4e fix workload entity storage start 2024-09-01 17:28:56 +00:00
serxa
6b6cfd4e16 Integrate workload entity storage into server 2024-09-01 17:08:24 +00:00
Julia Kartseva
49372e58f8 Merge remote-tracking branch 'upstream/master' into interactive-metrics-table 2024-08-29 21:54:34 +00:00
Mikhail Artemenko
d8f0ce92af fix style 2024-08-29 13:28:00 +00:00
Mikhail Artemenko
e9497cdcbc use tryMulti instead of NoThrow 2024-08-29 12:20:42 +00:00
Mikhail Artemenko
8bbb78375e add try limit 2024-08-29 12:18:51 +00:00
Sergei Trifonov
897e2def34
Merge branch 'master' into fix-use-concurrency-control 2024-08-29 12:42:37 +02:00
Pablo Marcos
3b701dca41 Merge branch 'master' into system-query-metric-log 2024-08-29 10:38:29 +00:00
Mikhail Artemenko
4d486f1a74 update error policy 2024-08-28 15:36:15 +00:00
Mikhail Artemenko
7f613563e1 initial impl for cp/mv 2024-08-28 13:39:29 +00:00
Igor Nikonov
3bdad9baa5
Merge branch 'master' into asan-invalid-shared-context-access 2024-08-26 16:20:49 +02:00
Kirill Nikiforov
40462bc716
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-08-23 22:10:06 +04:00
Julia Kartseva
ab874d724d Merge remote-tracking branch 'upstream/master' into interactive-metrics-table 2024-08-22 09:20:49 +00:00
Pablo Marcos
dc169853b8 Merge branch 'master' into system-query-metric-log 2024-08-21 09:33:53 +00:00
Alexander Tokmakov
ee9080fba7
Revert "Fix unexpected behavior with FORMAT and SETTINGS parsing" 2024-08-20 15:11:06 +02:00
Robert Schulze
c25ddba0b4
Merge pull request #68578 from rschu1ze/minor-logging-fixes
Minor logging fixes
2024-08-20 12:09:26 +00:00
János Benjamin Antal
860bd66d7a
Merge pull request #68267 from azat/build/COMMAND_ERROR_IS_FATAL
Avoid ignoring errors of execute_process() (set COMMAND_ERROR_IS_FATAL=ANY)
2024-08-20 11:55:20 +00:00
Kseniia Sumarokova
0f37e46333
Merge branch 'master' into fix-read-settings-in-index-loading 2024-08-20 10:55:34 +02:00
Pablo Marcos
f1d453e544 Merge branch 'master' into system-query-metric-log 2024-08-20 08:36:43 +00:00
Alexey Milovidov
af43ee8682
Merge pull request #67134 from azat/client/ignore_shell_suspend
Make C-z ignorance configurable (ignore_shell_suspend) in clickhouse-client
2024-08-20 02:31:54 +00:00
Julia Kartseva
3c5569514c Merge remote-tracking branch 'upstream/master' into interactive-metrics-table 2024-08-19 23:08:32 +00:00
Kseniia Sumarokova
dddf7d3c86
Merge branch 'master' into fix-read-settings-in-index-loading 2024-08-19 20:40:50 +02:00
Robert Schulze
31f236d4f2
Minor logging fixes 2024-08-19 17:28:27 +00:00
pufit
d4da9b8c8e
Merge pull request #66895 from MikhailBurdukov/hostresolver_opt
Allow filtering ip addresses by ip family in DNS resolver
2024-08-19 15:00:31 +00:00
Azat Khuzhin
e623ad041f Make C-z ignorance configurable (ignore_shell_suspend) in clickhouse-client
C-z is extermelly useful for some users (like myself), so provide a way
to configure it in client and avoid it's ignorance in clickhouse-disks
(I hope it is OK since it is not that known utility and it does not have
it's own configuration, while cli option is useless, one should remeber
about it).

Honestly I've never seen any interactive client that forbids C-z, so
ignoring it my default looks strange to me.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-19 08:33:53 +02:00
Alexey Milovidov
5a6d765fa2
Merge pull request #60197 from ClickHouse/format-settings-parsing
Fix unexpected behavior with `FORMAT` and `SETTINGS` parsing
2024-08-19 05:55:25 +00:00
Alexey Milovidov
285f99f719
Merge pull request #68492 from ClickHouse/pretty-print-tuples-in-create-table-statements
Pretty print tuples in CREATE TABLE statements
2024-08-19 02:26:03 +00:00
Alexey Milovidov
c52c5b3818 Merge branch 'master' into refactor-object-storages 2024-08-19 03:05:09 +02:00
Alexey Milovidov
20ebbc3b26 Merge branch 'master' into format-settings-parsing 2024-08-19 01:48:16 +02:00
Alexey Milovidov
3c32d2828a
Merge pull request #68483 from ClickHouse/temporary-tables-clickhouse-local
Use temporary tables for input and output in `clickhouse-local`
2024-08-18 20:43:43 +00:00
Alexey Milovidov
017af6341b Merge branch 'master' into refactor-object-storages 2024-08-18 09:45:51 +02:00
Alexey Milovidov
7071942858 Miscellanous changes from #66999 2024-08-18 09:05:45 +02:00
Alexey Milovidov
60dd7e962a Fix tests 2024-08-18 05:56:27 +02:00
Alexey Milovidov
4b68ba23c0 Pretty print tuples in CREATE TABLE statements 2024-08-17 03:44:18 +02:00
Alexey Milovidov
b98249ea7f Use temporary tables for input and output in clickhouse-local 2024-08-17 00:06:47 +02:00
Alexey Milovidov
b738928c34 Merge branch 'master' into format-settings-parsing 2024-08-16 15:42:02 +02:00
Pablo Marcos
49e9baa0ff Merge branch 'master' into system-query-metric-log 2024-08-16 12:25:49 +02:00
avogar
fed37d24f0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-15 08:02:15 +00:00
Alexey Milovidov
5cf3cfc3d7 Merge branch 'master' into format-settings-parsing 2024-08-15 03:50:21 +02:00
Yakov Olkhovskiy
f4280203a0
Merge pull request #63781 from ClickHouse/ft-chunked-protocol
Add chunked wrapper to native protocol
2024-08-14 10:35:20 +00:00
Alexey Milovidov
ecb08a0d04 Merge branch 'master' into format-settings-parsing 2024-08-14 04:51:51 +02:00
avogar
f82822c993 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-13 17:14:30 +00:00
Nikita Taranov
dd3fa7c3b6
Merge pull request #61793 from nickitat/keep_alive_max_reqs
Implement `max_keep_alive_requests` setting for server
2024-08-13 15:06:43 +00:00
Yakov Olkhovskiy
3e8a177622
Merge pull request #61908 from ClickHouse/ci-fuzzer-enable
CI: enable libfuzzer (fixing build and docker)
2024-08-13 14:22:09 +00:00
Yarik Briukhovetskyi
086c0f03a6
Merge pull request #65997 from yariks5s/hive_style_partitioning
Implementing Hive-style partitioning
2024-08-13 10:04:21 +00:00
Azat Khuzhin
4c043301e6 Avoid ignoring errors of execute_process() (set COMMAND_ERROR_IS_FATAL=ANY)
This will fix with issues like this [1]:

    Aug 12 09:58:44 '/usr/bin/cmake' '--build' '/build/build_docker/native' '--target' 'pre_compressor'
    Aug 12 09:58:44 sccache: error: Server startup failed: cache storage failed to read: Unexpected (temporary) at stat
    Aug 12 09:58:45 ninja: build stopped: subcommand failed.
    Aug 12 09:58:45 -- Configuring done (77.7s)
    Aug 12 09:58:47 -- Generating done (1.8s)
    Aug 12 09:58:47 -- Build files have been written to: /build/build_docker

So as you can see even if ninja fails it still wrote build files, while
it should fail.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/64955/0af41e32a5822d25ac3760f1ebb2313557474701/builds/report.html
  [2]: 0af41e32a5/binary_darwin_aarch64/build_log.log

Note, COMMAND_ERROR_IS_FATAL is 3.19+, and the requirement for now is
3.20

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-13 10:35:54 +02:00
Yakov Olkhovskiy
93a922f169 merge master 2024-08-13 03:28:25 +00:00
Alexey Milovidov
30b2cb606f Merge branch 'master' of github.com:ClickHouse/ClickHouse into format-settings-parsing 2024-08-13 00:01:01 +02:00
Kruglov Pavel
01b2e67f2e
Merge branch 'master' into json-data-type 2024-08-12 23:32:35 +02:00
vdimir
5195bc9060
Merge branch 'master' into pr/allmazz/63279 2024-08-12 16:45:58 +00:00
Alexey Milovidov
c95a40cdf0
Merge pull request #68182 from ClickHouse/fix-transactions
Fix test `01172_transaction_counters`
2024-08-12 16:20:26 +00:00
avogar
cfd854882b Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-12 15:57:57 +00:00
Robert Schulze
85f63b056b
Merge pull request #68135 from ClickHouse/refactor-field-get
Only use Field::safeGet - Field::get prone to type punning
2024-08-12 14:25:11 +00:00
kssenii
ecee8721df Merge remote-tracking branch 'origin' into fix-read-settings-in-index-loading 2024-08-12 14:39:05 +02:00
Robert Schulze
037a1006fd
Merge remote-tracking branch 'ClickHouse/master' into ci-fuzzer-enable 2024-08-12 12:28:32 +00:00
avogar
9296d4ecfb Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-12 11:55:39 +00:00
kssenii
09c9ca62e8 Revert "Remove default constructor of ReadSettings"
This reverts commit ba1a23d0ea.
2024-08-12 13:06:03 +02:00
Yarik Briukhovetskyi
8bc89ac8df
Merge branch 'master' into hive_style_partitioning 2024-08-12 11:44:45 +02:00
Alexey Milovidov
9005256bd0 Merge branch 'master' into refactor-object-storages 2024-08-12 08:05:26 +02:00
Alexey Milovidov
6016dc96aa Fix test 01172_transaction_counters 2024-08-12 07:19:54 +02:00
Alexey Milovidov
69978dbc6d Merge branch 'master' into format-settings-parsing 2024-08-12 07:11:26 +02:00
Azat Khuzhin
29afd2de78 Remove "Processing configuration file" message from clickhouse-local
Make the behaviour identical to the clickhouse-client

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-11 13:26:45 +02:00
Alexey Milovidov
8e13b73ad3 Add support for cache disks in clickhouse-local 2024-08-11 09:30:30 +02:00
Alexey Milovidov
1fd9b60353 More direct interface of Disk and ObjectStorage 2024-08-11 00:13:40 +02:00
Yakov Olkhovskiy
9a45c136b8 merge master 2024-08-10 13:53:32 +00:00
Yakov Olkhovskiy
c1b5b908ba hide Field::get in private, only use Field::safeGet 2024-08-10 13:01:55 +00:00
Igor Nikonov
f2b60c4f74 Merge remote-tracking branch 'origin/master' into asan-invalid-shared-context-access 2024-08-10 10:08:40 +00:00
Alexey Milovidov
a25accdae3 Fix a test 2024-08-09 20:20:09 +02:00
Alexey Milovidov
d8670ecd91 Merge branch 'master' into format-settings-parsing 2024-08-09 20:12:33 +02:00
Kirill Nikiforov
4354b4193d
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-08-09 20:42:32 +03:00
Nikita Taranov
43a38fb5f0 rm redundant file 2024-08-09 15:11:08 +01:00
Antonio Andelic
0d38aa98ce Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-08-09 15:44:47 +02:00
Nikita Taranov
b757522fc4 fix build 2024-08-09 14:20:57 +01:00
Nikita Taranov
ffa1371dde Merge branch 'master' into keep_alive_max_reqs 2024-08-09 12:24:45 +01:00
Yarik Briukhovetskyi
aebb07884b
Merge branch 'master' into hive_style_partitioning 2024-08-09 11:53:14 +02:00
Robert Schulze
f14112fb8a
Merge pull request #67963 from rschu1ze/fix-concurrent_threads_soft_limit_ratio
Fix CPU count detection for `concurrent_threads_soft_limit_ratio` in in containers
2024-08-09 07:58:29 +00:00
pufit
99fbef3340
Merge branch 'master' into pufit/fuzz-query-revert-revert 2024-08-08 20:12:23 -04:00
Kirill Nikiforov
ea58b8062e
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-08-08 22:44:32 +03:00
Yarik Briukhovetskyi
edccd30016
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-08 14:52:33 +02:00
Nikita Mikhaylov
4c289aa2dc
Merge pull request #64183 from vitlibar/ts-engine
Add new TimeSeries table engine to handle Prometheus protocols
2024-08-08 12:03:12 +00:00
Yarik Briukhovetskyi
6384488826
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-08 11:45:01 +02:00
Robert Schulze
f2c8d9678c
Merge remote-tracking branch 'ClickHouse/master' into fix-concurrent_threads_soft_limit_ratio 2024-08-08 09:09:44 +00:00
Alexey Milovidov
6a2ebfc95b
Revert "Use Atomic database by default in clickhouse-local" 2024-08-08 10:07:14 +02:00
pufit
6c0cc194d3
Merge branch 'master' into pufit/fuzz-query-revert-revert 2024-08-07 23:26:05 -04:00
Alexey Milovidov
4fac40a3cb Step back 2024-08-08 04:41:22 +02:00
Alexey Milovidov
e37772e3c4 Merge branch 'master' into format-settings-parsing 2024-08-08 02:28:56 +02:00
Yarik Briukhovetskyi
9e3a2931d2
Merge branch 'master' into hive_style_partitioning 2024-08-07 23:59:34 +02:00
Nikita Mikhaylov
f37e0c7fc6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-07 21:01:13 +00:00
Alexander Tokmakov
a523125411
Merge pull request #66410 from ClickHouse/reject_poco
Add logs and metrics about rejected connections in Poco
2024-08-07 16:40:59 +00:00
Yakov Olkhovskiy
b246f7c17c merge master 2024-08-07 16:25:31 +00:00
khodyrevyurii
00b62b1c0d
Minor clarifycation for method getNumberOfPhysicalCPUCores 2024-08-07 08:47:55 +00:00
khodyrevyurii
c933a38955
change std:🧵:hardware_concurrency on container friendly method getNumberOfPhysicalCPUCores 2024-08-07 08:47:53 +00:00
Nikita Taranov
053285dc1c Merge branch 'master' into keep_alive_max_reqs 2024-08-06 20:55:48 +01:00
Alexander Tokmakov
77103aa729 Merge branch 'master' into reject_poco 2024-08-06 19:52:05 +02:00
MikhailBurdukov
304d01e2c3 Review fix 2024-08-06 15:21:49 +00:00
MikhailBurdukov
3ebc3852f4 Allow filtering ip addresses by ip family in DNS resolver 2024-08-06 15:21:49 +00:00
Nikita Mikhaylov
80d2686013 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-06 13:12:03 +02:00
Alexey Milovidov
6a3d4152d7 Merge branch 'master' into atomic-database-in-clickhouse-local 2024-08-06 03:29:50 +02:00
Alexey Milovidov
3419b916a9
Merge pull request #66457 from AVMusorin/add-play-now-param
Allow run query instantly in play
2024-08-06 00:50:51 +00:00
Kirill Nikiforov
a28a82d344
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-08-05 20:57:15 +03:00
Nikita Mikhaylov
6f025090eb Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-05 17:46:14 +02:00
Yarik Briukhovetskyi
9b06753bb7
Merge branch 'master' into hive_style_partitioning 2024-08-05 17:02:27 +02:00
Alexey Milovidov
f601b2870e
Merge pull request #65978 from azat/keeper-config-cleanup
Remove default values for certificateFile/privateKeyFile/dhParamsFile in keeper config (to avoid annoying errors in logs)
2024-08-05 12:25:48 +00:00
vdimir
80e948c8d2
try to fix server_settings in local 2024-08-05 10:08:30 +00:00
vdimir
7add8ecc7a
Merge pull request #67135 from azat/local/config-from-home
Read configuration for clickhouse-local from ~/.clickhouse-local
2024-08-05 09:44:22 +00:00
Azat Khuzhin
eed2edd7db Comment certificateFile/privateKeyFile/dhParamsFile in keeper config
Otherwise you will get annoying messages at startup:

    2024.07.02 10:03:38.331593 [ 1 ] {} <Error> CertificateReloader: Cannot obtain modification time for certificate file /etc/clickhouse-keeper/server.crt, skipping update. errno: 2, strerror: 0
    2024.07.02 10:03:38.331658 [ 1 ] {} <Error> CertificateReloader: Cannot obtain modification time for key file /etc/clickhouse-keeper/server.key, skipping update. errno: 2, strerror: 0
    2024.07.02 10:03:38.341085 [ 1 ] {} <Error> CertificateReloader: Poco::Exception. Code: 1000, e.code() = 0, SSL context exception: Error loading private key from file /etc/clickhouse-keeper/server.key: error:80000002:system library::No such file or directory

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 16:20:42 +02:00