Commit Graph

4699 Commits

Author SHA1 Message Date
Julia Kartseva
24d5abba10 extract plain_rewritable metadata type
Make PlainRewritableObjectStorage generic;

Support config type
```
<s3_plain_rewritable>
    <type>object_storage</type>
    <object_storage_type>s3</object_storage_type>
    <metadata_type>plain_rewritable</metadata_type>
    <endpoint>https://s3.eu-west-1.amazonaws.com/clickhouse-eu-west-1.clickhouse.com/data/</endpoint>
    <use_environment_credentials>1</use_environment_credentials>
</s3_plain_rewritable>
```
2024-04-29 18:01:21 +00:00
Julia Kartseva
802ee27b1b address feedback - pt.3
non-functional changes
2024-04-29 18:01:21 +00:00
Julia Kartseva
75147f3ac7 S3-plain based disk supporting directory rename
Fixes: https://github.com/ClickHouse/ClickHouse/issues/58347
2024-04-29 18:01:21 +00:00
Nikolay Degterinsky
8f06a1a993 Merge remote-tracking branch 'upstream/master' into fix-data-race-in-context 2024-04-29 14:37:46 +00:00
Alexey Milovidov
fae8080130 Allow using clickhouse-local with a positional argument 2024-04-28 04:39:56 +02:00
Alexey Milovidov
030f711404 Even less directories 2024-04-27 20:01:54 +02:00
Alexey Milovidov
6a083ebed0 Even less directories 2024-04-27 19:13:17 +02:00
Alexey Milovidov
089cc25d9b Less directories 2024-04-27 19:05:58 +02:00
Alexey Milovidov
39118ef461 Hopefully better 2024-04-27 18:47:03 +02:00
Alexey Milovidov
5610260399 Fix removal of temporary directories 2024-04-27 18:36:46 +02:00
Alexey Milovidov
2fafae45be Fix removal of temporary directories 2024-04-27 18:33:34 +02:00
Alexey Milovidov
14e32aa1a1 Less directories in clickhouse-local 2024-04-27 18:24:05 +02:00
Robert Schulze
0fd2d573ae
Move hint to system.settings up 2024-04-26 12:10:51 +00:00
Yarik Briukhovetskyi
eee6fa4242
cosmetic fixes, comments for tests, user hints fixes 2024-04-26 13:19:22 +02:00
Yarik Briukhovetskyi
f623ee99f8
Update message for clickhouse local 2024-04-25 18:57:42 +02:00
Yarik Briukhovetskyi
5b4b4087e3
fixed build, moved verbose to help, fixed exception message 2024-04-25 18:51:17 +02:00
Yarik Briukhovetskyi
87c54b79ef
revert changes for clickhouse benchmark 2024-04-25 18:34:28 +02:00
Yarik Briukhovetskyi
d87bd11d41
Update Benchmark.cpp 2024-04-25 17:43:24 +02:00
Yarik Briukhovetskyi
aae67062bf
Update Benchmark.cpp 2024-04-25 17:27:58 +02:00
Yarik Briukhovetskyi
317017c495
small fixes 2024-04-25 17:24:03 +02:00
Yarik Briukhovetskyi
a36d86f63a
add --verbose for help and suggest to use system.settings 2024-04-25 17:01:34 +02:00
yariks5s
0cc404a74c init 2024-04-25 13:39:09 +00:00
Alexander Tokmakov
e752ebdf9c
Merge pull request #62658 from ClickHouse/install_path
Don't allow relative paths when installing
2024-04-25 11:18:00 +00:00
Nikolay Degterinsky
bf3d33b61c Fix data race 2024-04-24 21:08:49 +00:00
Konstantin Bogdanov
38e8b4991e
Undo breaking change 2024-04-22 00:01:33 +02:00
Anton Popov
f09d0b6536
Merge pull request #62608 from CurtizJ/azure-retries
Better retries in azure sdk
2024-04-19 12:01:42 +00:00
jsc0218
7525b2acf4
Merge pull request #60117 from jsc0218/TableEngineGrant_version2
TableEngineGrant_version2
2024-04-18 14:30:34 +00:00
Anton Popov
b50117780c Merge remote-tracking branch 'upstream/master' into HEAD 2024-04-17 13:05:46 +00:00
János Benjamin Antal
599e928e1f
Merge pull request #61997 from azat/sentry-logical-error
[RFC] Send LOGICAL_ERRORs to sentry
2024-04-16 12:26:42 +00:00
Robert Schulze
7dc05d092b
Merge remote-tracking branch 'rschu1ze/master' into be-less-boring-32 2024-04-15 16:35:10 +00:00
Robert Schulze
2a3b5bd74d
Merge pull request #58956 from AVMusorin/kafka-settings
Separate consumer/producer settings for Kafka
2024-04-15 15:11:19 +00:00
Alexander Tokmakov
91d4284bdf don't allow relative paths when installing 2024-04-15 16:21:09 +02:00
Anton Popov
9e54a833ed fix build 2024-04-12 18:41:40 +00:00
Anton Popov
47c653f87c better retries in azure sdk 2024-04-12 15:39:14 +00:00
Alexander Tokmakov
b5ff1c0a6e
Merge branch 'master' into cannot_allocate_thread 2024-04-12 13:35:14 +02:00
Konstantin Bogdanov
c3af6b37e4
Merge pull request #62209 from ClickHouse/faster_01676_clickhouse_client_autocomplete
Unflake and speed up `01676_clickhouse_client_autocomplete`
2024-04-11 21:28:48 +00:00
Alexander Tokmakov
55c510563c Merge branch 'master' into cannot_allocate_thread 2024-04-11 23:06:17 +02:00
Azat Khuzhin
f1cb1f80b6 Make sending LOGICAL_ERRORs to sentry configurable
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-11 15:56:26 +02:00
Robert Schulze
bf03ed81a9
Merge pull request #62489 from yokofly/fix/macOS-binary-install-dir
Fix macOS binary install directory
2024-04-11 08:04:50 +00:00
Konstantin Bogdanov
63351e2fbb
Merge branch 'master' into faster_01676_clickhouse_client_autocomplete 2024-04-11 01:34:05 +02:00
Yakov Olkhovskiy
d554dc61fb
Merge pull request #61923 from azat/local-input
Implement input() for clickhouse-local
2024-04-10 21:55:51 +00:00
Alexander Tokmakov
d8e97b51bf Merge branch 'master' into cannot_allocate_thread 2024-04-10 21:21:42 +02:00
Robert Schulze
752a69b6dd
Minor fixups 2024-04-10 17:37:24 +00:00
Konstantin Bogdanov
fd0f6418e2
Merge branch 'master' into faster_01676_clickhouse_client_autocomplete 2024-04-10 16:15:21 +02:00
yokofly
e4cb27eda3 fix macOS binary install
the usr/bin is not suitable for macOS
https://superuser.com/questions/933019/sudo-cant-create-file-in-usr-bin-in-el-capitan
after apply this patch, we can `sudo ./clickhouse --install` on MacOS
2024-04-10 21:27:48 +08:00
Kruglov Pavel
8ef64b0581
Merge pull request #61476 from Avogar/better-stress-upgrade-checks
Ignore DROP queries in stress test with 1/2 probability and TRUNCATE Memory/JOIN table instead of ignoring DROP in upgrade check
2024-04-10 12:43:22 +00:00
Konstantin Bogdanov
414b028931
Support synchronous completions in local server too 2024-04-10 13:08:38 +02:00
Konstantin Bogdanov
c8598bdb54
Add a flag to load suggestion data synchronously 2024-04-10 13:08:38 +02:00
Robert Schulze
8167b774b5
Merge pull request #62307 from rschu1ze/cleanup-ssh
Cleanup SSH-based authentication code
2024-04-09 21:10:09 +00:00
Robert Schulze
22e164c65d
Merge pull request #62375 from rschu1ze/static-instance2
Don't access static members through instance, pt. II
2024-04-09 14:37:24 +00:00
Azat Khuzhin
5caa89a2b3 Fix completion of available ClickHouse tools
Now clickhouse --help/ch --help will print --help for clickhouse-local,
let's use just "clickhouse help" to get help with list of available
tools in clickhouse binary itself.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-09 15:37:56 +02:00
Robert Schulze
4035334634
Merge remote-tracking branch 'rschu1ze/master' into static-instance2 2024-04-09 11:45:27 +00:00
avogar
71666cb42f Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks 2024-04-08 13:58:14 +00:00
Robert Schulze
dca6e0abbd
Fix the build (after boringssl submodule removal) 2024-04-08 11:02:41 +00:00
Alexey Milovidov
cf0469e866
Merge pull request #62365 from ClickHouse/dhparams-are-not-by-default
dhparams are not enabled by default
2024-04-08 01:32:03 +02:00
Robert Schulze
97281203b8
Don't access static members through instance, pt. II
clang-tidy rightfully complains
(-readability-static-accessed-through-instance) that static member
functions are accessed through non-static members
2024-04-07 11:09:35 +00:00
Alexey Milovidov
a6dbaf5408 dhparams are not enabled by default 2024-04-06 21:45:26 +02:00
alesapin
22caa3eb73 Merge remote-tracking branch 'origin/master' into try_global_trace_collector 2024-04-06 11:21:27 +02:00
Kruglov Pavel
589034c34c
Merge branch 'master' into better-stress-upgrade-checks 2024-04-05 15:27:02 +02:00
alesapin
e514a8b49d Merge remote-tracking branch 'origin/master' into try_global_trace_collector 2024-04-05 12:40:25 +02:00
Robert Schulze
9d8f643f5b
Cleanup SSH-based authentication code 2024-04-05 08:43:23 +00:00
Alexey Milovidov
c8da569459 Merge branch 'master' into bridges-are-separate 2024-04-04 20:04:31 +02:00
Robert Schulze
7ce2a47ba5
Merge pull request #62265 from rschu1ze/static-instance
Don't access static members through instance
2024-04-04 14:36:03 +02:00
Yarik Briukhovetskyi
edacb991e0
Merge pull request #62257 from yariks5s/fix_retention_docs
Fix s3-style link mapper for gcs
2024-04-04 14:30:33 +02:00
Alexander Tokmakov
c53b20a770 fix 2024-04-03 20:57:12 +02:00
Robert Schulze
de2a0be025
Don't access static members through instance
- clang-tidy rightfully complains (-readability-static-accessed-through-instance)
- not going to enable the warning for now to avoid breaking the build
2024-04-03 18:50:33 +00:00
Alexander Tokmakov
98ac8031e0 add fault injection 2024-04-03 19:49:23 +02:00
jsc0218
ee589f8a8b Merge remote-tracking branch 'origin/master' into TableEngineGrant_version2 2024-04-03 17:17:33 +00:00
yariks5s
ca27cf3fde fix mapper for gcs 2024-04-03 16:38:41 +00:00
avogar
d87d5a9197 Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks 2024-04-03 12:07:22 +00:00
alesapin
f5c5146153 [RFC] Try to add global Real and CPU trace collector 2024-04-02 18:04:53 +02:00
Raúl Marín
c35a436435 Remove nested dependency on DateLutImpl 2024-04-02 14:45:48 +02:00
Alexey Milovidov
89cee0a3d6 Move bridges to separate packages 2024-03-31 01:59:36 +01:00
Aleksandr Musorin
f9d81bc774 refactore: improve reading several configurations for kafka
Simplify and do some refactoring for kafka client settings.

Allows to set up separate
settings for consumer and producer like:

```
<consumer>
    ...
</consumer>

<producer>
    <kafka_topic>
        <name>topic_name</name>
        ...
    </kafka_topic>
</producer>
```

Moreover, this fixes warnings from kafka client like:
`Configuration property session.timeout.ms is a consumer property and
will be ignored by this producer instance`
2024-03-27 14:53:33 +01:00
Azat Khuzhin
469be8ee8a Implement input() for clickhouse-local
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-26 13:49:53 +01:00
Azat Khuzhin
be2767b55c Make ClientBase::parseQuery() static
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-26 10:54:57 +01:00
Kruglov Pavel
de1229ba60
Merge branch 'master' into better-stress-upgrade-checks 2024-03-25 19:18:35 +01:00
Alexey Milovidov
aca3978f2d Remove DataStreams (2) 2024-03-24 17:21:53 +01:00
Alexey Milovidov
c0c8cdc185 Add modifications 2024-03-23 02:42:22 +01:00
Alexey Milovidov
7365f4e32b Add modifications 2024-03-23 01:43:28 +01:00
Alexey Milovidov
18c016caaa Support for --output-format in client 2024-03-22 21:06:36 +01:00
robot-ch-test-poll
03a4b5fb58
Merge pull request #61053 from ClickHouse/async-loader-waiters-limit
Separate limits on number of waiting and executing queries
2024-03-22 03:15:25 +01:00
Alexey Milovidov
4d113c2190
Merge pull request #61508 from ClickHouse/generic-clickhouse-local-fuzzer
Generic fuzzer of query text in clickhouse-local
2024-03-21 21:17:28 +03:00
Alexey Milovidov
9afe096ff5
Merge pull request #61681 from ClickHouse/remove-diagnostics
Remove clickhouse-diagnostics from the package
2024-03-21 19:50:47 +03:00
serxa
c31b958f88 Merge branch 'master' into async-loader-waiters-limit 2024-03-21 10:58:22 +00:00
Mikhail f. Shiryaev
5b0610b9e3
Merge pull request #61530 from ClickHouse/fix-client-s
Fix client `-s` argument
2024-03-21 10:17:45 +01:00
Alexey Milovidov
784de2dca3 Merge branch 'master' into generic-clickhouse-local-fuzzer 2024-03-21 03:18:05 +01:00
Alexey Milovidov
bfc7c3c89e Remove clickhouse-diagnostics 2024-03-21 02:52:51 +01:00
Alexey Milovidov
6f4ce33f02 Change how fuzzer arguments are parsed 2024-03-20 22:12:57 +01:00
Mikhail f. Shiryaev
5c1a54f643
Fix clickhouse-client -s argument 2024-03-20 12:33:45 +01:00
Alexey Milovidov
7b7e260585 Merge remote-tracking branch 'origin/master' into generic-clickhouse-local-fuzzer 2024-03-20 01:28:28 +01:00
Raúl Marín
de855ca917 Reduce header dependencies 2024-03-19 17:04:29 +01:00
avogar
31d5049f80 Move logic of ignoring drop queries to server 2024-03-18 16:26:05 +00:00
Nikita Mikhaylov
15896ecaf6
Add table system.keywords [Part 1] (#51808) 2024-03-18 16:58:57 +01:00
avogar
aadc610739 Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks 2024-03-18 15:27:58 +00:00
Han Fei
8a54c85f3c
Merge pull request #61049 from hanfei1991/hanfei/check-limit-periodically
Check cgroups memory limit update periodically
2024-03-18 15:15:46 +01:00
Robert Schulze
fe86741059
Some fixups 2024-03-18 10:44:56 +00:00
alesapin
0faf4eacb8
Merge pull request #61299 from ClickHouse/merge_config
Add ability to merge includes for config preprocessor for configs
2024-03-18 11:22:42 +01:00
Alexey Milovidov
2eb7de859d Correct arguments parsing 2024-03-18 02:35:32 +01:00
Alexey Milovidov
1a61da1bae Replace getFuzzerData with query text fuzzer in clickhouse-local 2024-03-18 02:17:24 +01:00
Alexey Milovidov
01136bbc3b Limit backtracking in parser 2024-03-17 19:54:45 +01:00
Alexey Milovidov
bfea36877b
Merge pull request #61499 from ClickHouse/fix-fuzzers
Fix fuzzers
2024-03-17 21:15:10 +03:00
Alexey Milovidov
44e918bc67 Revive getFuzzerData 2024-03-17 16:22:33 +01:00
Alexey Milovidov
427a8b3264 Less crap 2024-03-17 13:20:49 +01:00
avogar
4ceff16787 Fix bad conflict resolution 2024-03-15 20:29:19 +00:00
avogar
fa9d9ea3f7 Ignore DROP queries in stress test with 1/2 probability, use TRUNCATE instead of ignoring DROP in upgrade check for Memory/JOIN tables 2024-03-15 20:23:39 +00:00
Han Fei
91d18649f4 update comments 2024-03-15 16:23:51 +01:00
alesapin
38cd6ef27d Merge branch 'master' into merge_config 2024-03-15 13:52:52 +01:00
Alexey Milovidov
c9fb8ef54b Merge branch 'master' into split-cast-overload-resolver 2024-03-15 07:09:51 +01:00
Alexey Milovidov
1a41aa4ac7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver 2024-03-14 13:06:23 +01:00
Robert Schulze
3486b4a6e3
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list 2024-03-14 10:44:20 +00:00
jsc0218
c5dc35e5c4 try enable grant of table engine in test 2024-03-14 01:31:45 +00:00
jsc0218
b3b46ea708 Merge remote-tracking branch 'origin/master' into TableEngineGrant_version2 2024-03-14 00:36:29 +00:00
Robert Schulze
4e12b5dc91
Some fixups 2024-03-13 16:54:20 +00:00
Robert Schulze
ce665eae30
Doc fixups 2024-03-13 15:13:17 +00:00
Kruglov Pavel
14402e450a
Merge pull request #61036 from HowePa/detect_stdout
Detect output format by file exctension in clickhouse-client(local)
2024-03-13 14:57:59 +01:00
alesapin
9b1d8a2f52 fix style 2024-03-13 14:15:34 +01:00
alesapin
6203d45b96 working version with comments 2024-03-13 13:12:48 +01:00
Han Fei
c7c64636d0 add a test 2024-03-12 23:31:33 +01:00
Robert Schulze
1b1685e3f1
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list 2024-03-12 13:02:59 +00:00
Alexey Milovidov
5222ebc4b4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver 2024-03-12 06:37:38 +01:00
Nikita Mikhaylov
cfa042cb04 Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 15:45:20 +00:00
Robert Schulze
81b2a1f621
Fix build 2024-03-11 15:34:02 +00:00
Robert Schulze
802bae9661
GCC --> clang pragmas 2024-03-11 12:55:56 +00:00
Alexey Milovidov
4373d5ba16 Merge branch 'master' into split-cast-overload-resolver 2024-03-11 03:01:50 +01:00
serxa
5b796e1f42 Merge branch 'master' into async-loader-waiters-limit 2024-03-10 15:20:27 +00:00
Sema Checherinda
80179e50e4
Merge pull request #58845 from ClickHouse/chesema-session-pool
HTTP connections pool
2024-03-10 14:06:59 +01:00
Alexey Milovidov
1179a70c21
Merge pull request #61118 from ClickHouse/simplify-bridges
Simplify bridges
2024-03-10 14:46:52 +03:00
Sema Checherinda
5c41727725 http connections pools 2024-03-10 10:00:18 +01:00
Alexey Milovidov
3b8a8c9649 Better gitignore 2024-03-10 09:28:30 +01:00
Alexey Milovidov
157adefc70 Fix error 2024-03-10 09:17:29 +01:00
Alexey Milovidov
1a2d403f7b Miscellaneae 2024-03-10 09:16:21 +01:00
Alexey Milovidov
9ddec346a0 Miscellaneous 2024-03-10 09:02:34 +01:00
Alexey Milovidov
3ac4f56cfa Fix tests 2024-03-09 18:53:31 +01:00
Alexey Milovidov
e9ab3ed2dd Even better 2024-03-09 09:27:11 +01:00
Alexey Milovidov
47b308d234 Simplify bridges 2024-03-09 08:42:33 +01:00
Alexey Milovidov
70796e497f Miscellaneous 2024-03-09 08:32:13 +01:00
Alexey Milovidov
574d486322 Something 2024-03-09 07:55:59 +01:00
Alexey Milovidov
ea54ac3cb4 Remove garbage 2024-03-09 06:12:22 +01:00
Alexey Milovidov
6d45eecdad Remove garbage 2024-03-09 06:11:34 +01:00
Alexey Milovidov
2be09581dd Split CastOverloadResolver translation unit 2024-03-09 05:48:52 +01:00
Han Fei
c01a6775d7 fix style 2024-03-09 02:28:39 +01:00
Han Fei
4997f95426 fix build 2024-03-08 17:30:58 +01:00
Han Fei
c92fb8700f Merge branch 'master' into hanfei/check-limit-periodically 2024-03-08 03:59:41 +01:00
Nikita Mikhaylov
2bc4d27ac6 Bye bye 2024-03-07 19:24:39 +00:00
serxa
0f0ea422f2 separate limits on number of waiting and executing queries 2024-03-07 17:05:54 +00:00
Han Fei
7fd13df8a5 check memory limit periodically 2024-03-07 17:21:03 +01:00
HowePa
6d5fd2857e detect output format by file extension in clickhouse-client 2024-03-07 20:29:42 +08:00
HowePa
6c69e7d4dc detect output format by file extension in clickhouse-local 2024-03-07 20:29:04 +08:00
Sema Checherinda
62f9a00da8 shuffle resolved IPs 2024-03-07 13:09:26 +01:00
豪肥肥
1cd4bcdce8
Merge branch 'ClickHouse:master' into fix_local_option 2024-03-06 06:38:28 +08:00
Robert Schulze
b5a7ef5fd3
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-hdr 2024-03-05 11:24:28 +00:00
Alexey Milovidov
a7430004b3 Fix real time query profiler on AArch64 2024-03-04 18:13:49 +01:00
Alexey Milovidov
de6c5d3a40
Merge pull request #60552 from ClickHouse/pc2
Userspace page cache again
2024-03-04 17:47:35 +03:00
Alexey Milovidov
cbf5443585 Remove old code 2024-03-04 00:11:55 +01:00
Alexey Milovidov
c7fb3014ad Merge branch 'master' into async-load-by-default 2024-03-03 19:41:31 +01:00
Alexey Milovidov
079f5af0a8 Merge branch 'master' into async-load-by-default 2024-03-03 05:40:48 +01:00
Alexey Milovidov
4b69440e58 Dashboard: sticky header 2024-03-03 04:35:15 +01:00
Alexey Milovidov
e122a47b48 Simplification 2024-03-03 04:12:31 +01:00
Alexey Milovidov
df53b0c5f8 Merge branch 'master' into slightly-better-colors-on-dashboard 2024-03-03 04:09:09 +01:00
jsc0218
2b54c11d63
Merge branch 'ClickHouse:master' into TableEngineGrant_version2 2024-03-02 20:42:04 -05:00
Alexey Milovidov
c362bbc9ca
Merge pull request #60390 from ClickHouse/redirect-handlers
Allow configuring HTTP redirect handlers for clickhouse-server
2024-03-02 05:15:31 +03:00
Alexey Milovidov
e9fd11beea
Merge pull request #60624 from bluikko/patch-1
Fix typo in config.xml #60623
2024-03-02 04:52:56 +03:00
Antonio Andelic
8607e74966
Merge pull request #60537 from ClickHouse/keeper-snapshot-detached
Keeper improvement: abort during startup if an invalid snapshot is detected
2024-03-01 13:36:09 +01:00
Robert Schulze
af6755f241
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-hdr 2024-03-01 11:45:21 +00:00
bluikko
1aea952382
Fix typo in config.xml #60623
"be Tableau" should be "by Tableau".
2024-03-01 16:13:45 +07:00
Robert Schulze
562e483df4
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-hdr 2024-02-29 12:44:51 +00:00
Michael Kolupaev
42437a2ae1 Userspace page cache (#53770)
* Userspace page cache

* Maybe it'll build this time, who knows.

* 'auto' went out of fashion, I guess

* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary

* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.

* Fix

* Another fix

* Fix restricted seek, fix ppc64le build

* Don't allow page cache with file cache

* Adjust tests a little

* Fix clang-tidy

* Conflicts

* Comments

* Maybe unbroke AsynchronousBoundedReadBuffer

* SettingsChangesHistory.h

* Fix warning in test
2024-02-29 12:28:32 +00:00
Alexander Tokmakov
15e1191f74
Revert "Userspace page cache (#53770)"
This reverts commit 7b55c61551.
2024-02-29 13:20:17 +01:00
Robert Schulze
070f9d952f
Merge remote-tracking branch 'ClickHouse/master' into feature/increase_dns_cache_size 2024-02-29 11:27:59 +00:00
Michael Kolupaev
7b55c61551
Userspace page cache (#53770)
* Userspace page cache

* Maybe it'll build this time, who knows.

* 'auto' went out of fashion, I guess

* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary

* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.

* Fix

* Another fix

* Fix restricted seek, fix ppc64le build

* Don't allow page cache with file cache

* Adjust tests a little

* Fix clang-tidy

* Conflicts

* Comments

* Maybe unbroke AsynchronousBoundedReadBuffer

* SettingsChangesHistory.h

* Fix warning in test
2024-02-29 11:27:32 +00:00
Robert Schulze
0b4622ebf6
Add more suppressions for utils 2024-02-29 09:45:20 +00:00
Antonio Andelic
0cb839af0b Merge branch 'master' into keeper-snapshot-detached 2024-02-29 09:47:32 +01:00
Kirill Nikiforov
fe247cb64d rename dns_cache_max_size to dns_cache_max_entries 2024-02-29 06:03:44 +03:00
Robert Schulze
3b18eb4f17
Fix clang-tidy in some headers 2024-02-28 22:47:34 +00:00
jsc0218
b4b19ae2ad
Merge branch 'master' into TableEngineGrant_version2 2024-02-28 10:56:30 -05:00
豪肥肥
cca154b6b9
fix option ambiguous 2024-02-28 12:16:34 +08:00
Alexey Milovidov
8cf619bc03 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-28 00:30:44 +01:00
Antonio Andelic
f6d35cf4b1 Merge branch 'master' into keeper-snapshot-detached 2024-02-27 16:44:06 +01:00
Antonio Andelic
2c8759442d Move broken Keeper snapshots to detached folder 2024-02-27 15:16:10 +01:00
Alexey Milovidov
0721f524ce Merge branch 'master' into async-load-by-default 2024-02-27 02:19:32 +01:00
Alexey Milovidov
04fe5dc55c Merge branch 'master' into fix-inconsistent-formatting 2024-02-26 23:46:24 +01:00
Alexey Milovidov
fbfc4afb46
Merge branch 'master' into redirect-handlers 2024-02-27 01:27:38 +03:00
Robert Schulze
4794dc28f0
Merge remote-tracking branch 'ClickHouse/master' into dist/config-settings 2024-02-26 21:57:33 +00:00
Kirill Nikiforov
8b314a3ac8
Implement system.dns_cache table and dns_cache_max_size server setting (#60257)
* system.dns_cache table WIP

* system.dns_cache table

* rollback unexpected contrib changes

* rollback unexpected changes

* add docs

* code style fixes

* optimize dns cache exporting

* stateful test for system.dns_cache table

* stateful test for system.dns_cache table

* cr fixes

* stateful test for system.dns_cache table

* stateful test for system.dns_cache table

* implement system.dns_cache table

* system.dns_cache test

* system.dns_cache fix docs

* system.dns_cache prettify

* dns_cache_max_size settings

* fix system.dns_cache test

* Update dns_cache.md

* fix doc

Co-authored-by: pufit <pufit@clickhouse.com>

---------

Co-authored-by: pufit <pufit@clickhouse.com>
2024-02-26 15:48:02 -05:00
Alexey Milovidov
47734fbbe2
Merge pull request #60387 from ClickHouse/dashboard-more-convenient
Minor changes for dashboard
2024-02-26 22:52:44 +03:00
Alexey Milovidov
a3f1411679 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-26 19:01:11 +01:00
Alexey Milovidov
b71ae80fa9
Merge pull request #60392 from ClickHouse/fix-duplicate-chart-rendering
Fix duplicate and dangling charts on the Dashboard
2024-02-26 19:24:52 +03:00
Robert Schulze
048f7ec3e9
Merge pull request #59516 from rschu1ze/cgroup-observing-memory-tracker
Update memory tracker periodically with cgroup memory usage
2024-02-26 15:27:19 +01:00
Robert Schulze
1751d76234
Minor doc fixups 2024-02-26 11:42:11 +00:00
Robert Schulze
1e40b63cb1
Merge remote-tracking branch 'ClickHouse/master' into dist/config-settings 2024-02-26 11:15:51 +00:00
Alexey Milovidov
f9c0089526 Fix duplicate and dangling charts on the Dashboard 2024-02-26 01:31:29 +01:00
Alexey Milovidov
9d0e1c4deb Slightly better colors for multi-line graphs on the dashboard 2024-02-26 01:02:38 +01:00
Alexey Milovidov
2edb3d5ba1 Add documentation 2024-02-25 23:58:29 +01:00
Alexey Milovidov
b916479025 Add a test 2024-02-25 23:54:55 +01:00
Alexey Milovidov
27902ee4f6 Touch-up dashboard 2024-02-25 22:36:59 +01:00
Alexey Milovidov
9e32d0f5b2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-23 15:05:46 +01:00
Vitaly Baranov
db119eed49
Merge pull request #60002 from vitlibar/add-config-setting-remove-backup-files-after-failure
Add new config setting "backups.remove_backup_files_after_failure"
2024-02-23 12:42:55 +01:00
János Benjamin Antal
7cad0050c0
Disambiguate alter commands list (#59532)
* Add optional parentheses to TTL element and alter command

* Add some basic tests

* Extend tests with more test cases

* Add one more test case

* Add server setting to control new formatting behavior

* Automatic style fix

* Fix segfault in `clickhouse-format` related to new server setting

* Remove format_ttl_expressions_with_parentheses

* Fix unit test compilation failures

* Introduce global flag to control the new formatting behavior

* Revert "Fix segfault in `clickhouse-format` related to new server setting"

This reverts commit d7131a3145.

* Revert accidental changes

* Revert accidental include reorder

* Revert accidental changes

* Enable new format in client and local server

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-22 19:17:15 +01:00
Vitaly Baranov
b130726a0c
Merge branch 'master' into add-config-setting-remove-backup-files-after-failure 2024-02-22 18:09:12 +01:00
Alexander Tokmakov
97ed2c05b0 Merge branch 'master' into fix_undead_sessions 2024-02-22 14:36:36 +01:00
Alexey Milovidov
2d9fbaa859 Merge with master 2024-02-21 20:37:48 +01:00
Alexander Tokmakov
64a80f1011
Fix default path when path is not specified in config (#59654)
* Update Server.cpp

* Update SentryWriter.cpp

* Update Keeper.cpp

* Update SentryWriter.cpp
2024-02-21 20:33:39 +01:00
Igor Nikonov
a0105e94ba
Merge pull request #60077 from ClickHouse/cleanup-connection-pool-priority
Cleanup: less confusion between config priority and balancing priority in connection pools
2024-02-21 15:22:08 +01:00
Sergei Trifonov
6e3fddf4a3
Merge pull request #59313 from ClickHouse/abstract-concurrency-control
Split `ISlotControl` from `ConcurrencyControl`
2024-02-21 15:04:03 +01:00
Robert Schulze
6a027b3528
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-21 11:48:34 +00:00
Alexander Tokmakov
45d407034f Merge branch 'master' into fix_undead_sessions 2024-02-20 22:21:37 +01:00
Antonio Andelic
bb0b1fa9bc Fix 2024-02-20 14:46:16 +01:00
Antonio Andelic
a0bfb47e95 Merge branch 'master' into keeper-more-resilient-disks 2024-02-20 13:51:23 +01:00
Alexey Milovidov
c753550d0b Digging into a pile of garbage 2024-02-20 10:42:20 +01:00
jsc0218
afa7a95c8c add backward compatibility 2024-02-20 02:11:31 +00:00
Igor Nikonov
f06e15ce5f Merge remote-tracking branch 'origin/master' into cleanup-connection-pool-priority 2024-02-19 11:33:55 +00:00
Robert Schulze
ba9661a5d4
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-19 09:54:08 +00:00
Alexey Milovidov
a955ae8673
Merge pull request #60086 from ClickHouse/check-wrong-abbrs
Check wrong abbreviations
2024-02-17 05:17:11 +01:00
Alexey Milovidov
3128cf1f1b Remove the check for formatting consistency from the Fuzzer 2024-02-17 02:24:21 +01:00
Alexey Milovidov
509d8ee99c Apply review comments 2024-02-17 01:54:54 +01:00
Alexey Milovidov
ceb65bb114 Merge branch 'master' of github.com:ClickHouse/ClickHouse into print-cpu-flags-at-startup 2024-02-17 01:53:56 +01:00
Igor Nikonov
b85a68790a Cleanup: connection pool priority -> config priority
- names were creating confusion between config priority and balancing priority for a reader
2024-02-16 14:39:41 +00:00
Kruglov Pavel
4d6f167e0c
Merge pull request #59092 from Avogar/auto-format-detection
Try to detect file format automatically during schema inference if it's unknown
2024-02-16 14:32:18 +01:00
Alexey Milovidov
39f363ba6e Print CPU flags at startup 2024-02-16 13:09:07 +01:00
Alexey Milovidov
0787e9f402 Merge remote-tracking branch 'origin/master' into print-cpu-flags-at-startup 2024-02-16 13:07:03 +01:00
Alexey Milovidov
5b83e771ed Print CPU flags at startup 2024-02-16 13:06:57 +01:00
Antonio Andelic
0f489de46e
Merge pull request #59945 from ClickHouse/keeper-prometheus-filtered-events
Send only Keeper related metrics/events for Prometheus
2024-02-16 09:43:43 +01:00
Alexander Tokmakov
22c97be2a4 ability to detect undead ZooKeeper sessions 2024-02-15 22:17:31 +01:00
Konstantin Bogdanov
dbb6804a70
Merge pull request #59976 from ClickHouse/add-cloud-placement
Add `PlacementInfo`
2024-02-15 19:16:56 +03:00
Alexey Milovidov
0b58f16938
Merge pull request #59964 from ClickHouse/cleanups
Cleanups
2024-02-15 02:59:54 +01:00
Vitaly Baranov
5591d74076 Add new config setting "backups.remove_backup_files_after_failure". 2024-02-14 23:19:21 +01:00
Alexey Milovidov
7a5e152d9e
Merge pull request #59967 from ClickHouse/dashboards-to-use-merge-tables
Use merge table in the dashboard; add Cloud overview to the system table
2024-02-14 21:56:37 +01:00
Antonio Andelic
40d4fc1c24 More resilient Disk related operations 2024-02-14 14:53:22 +01:00
Antonio Andelic
0bee591a0c Fix build 2024-02-14 14:10:58 +01:00
Yarik Briukhovetskyi
4c57400664
Merge pull request #59922 from xuzifu666/Common_imporve
Commands node args should add rvalue to push_back to reduce object copy cost
2024-02-14 12:42:45 +01:00
Konstantin Bogdanov
48fcc3eeab
Fix standalone build 2024-02-14 12:41:41 +01:00
Konstantin Bogdanov
f678bdc546
Update tests 2024-02-14 10:51:42 +01:00
Konstantin Bogdanov
914fd27d5b
Add PlacementInfo 2024-02-14 10:19:36 +01:00
Robert Schulze
7b7ea6d477
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-14 08:56:22 +00:00
Alexey Milovidov
c49651ef89 Even less conflicts 2024-02-14 03:31:31 +01:00
Alexey Milovidov
39378deac1 Less conflicts 2024-02-14 03:09:40 +01:00
Alexey Milovidov
98f7602ea1 Less conflicts 2024-02-14 03:01:03 +01:00
Alexey Milovidov
27f115f581 Use merge table in the dashboard 2024-02-14 02:17:23 +01:00
Alexey Milovidov
2b4949bd18 Cleanups 2024-02-14 00:21:13 +01:00
Alexey Milovidov
8b59977639
Merge pull request #59909 from azat/rmt-macros-cleanup
Petite cleanup around macros and ReplicatedMergeTree
2024-02-14 00:09:34 +01:00
Kruglov Pavel
1dbfeafb42
Merge branch 'master' into auto-format-detection 2024-02-13 19:08:33 +01:00
Antonio Andelic
0d151e3f0d Send only specific events/metrics for Keeper prometheus 2024-02-13 16:01:50 +01:00
xuzifu666
12599c4b8e Commands node args should add rvalue to push_back 2024-02-13 17:35:55 +08:00
Alexey Milovidov
58563ef036
Merge pull request #59857 from azat/build/components-cleanup
Remove ability to disable generic clickhouse components
2024-02-13 04:21:08 +01:00
Azat Khuzhin
c61ac1d3bc Convert default_replica_path/default_replica_name into server settings
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-12 21:05:58 +01:00
Azat Khuzhin
13e3877254 Add chc/chl/ch into clickhouse-bundle target
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-12 14:32:15 +01:00
Azat Khuzhin
11fddc8d63 Unify binary aliases
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-12 12:06:33 +01:00
Azat Khuzhin
3145c5d5f5 Add missing install target for ch/chc/chl
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-12 12:02:42 +01:00
Azat Khuzhin
7fb31fe160 Remove ability to disable generic clickhouse components
Components like client/server/... are very generic, and there is no
point in disabling them, since it does not reduce amount of compiled
code a lot anyway (just a few modules for entrypoints, everything else
is already included in the clickhouse binary), and eventually they are
just symlinks to the clickhouse binary.

But there are few, that requires extra libraries, like ODBC bridge or
keeper components (and there is also standalone keeper binary compiled
with musl), those had been kept.

Also add some descriptions for some utils and change exit code to 0 for
--help.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-12 11:10:00 +01:00