Commit Graph

4530 Commits

Author SHA1 Message Date
Yarik Briukhovetskyi
edacb991e0
Merge pull request #62257 from yariks5s/fix_retention_docs
Fix s3-style link mapper for gcs
2024-04-04 14:30:33 +02:00
Alexander Tokmakov
c53b20a770 fix 2024-04-03 20:57:12 +02:00
Robert Schulze
de2a0be025
Don't access static members through instance
- clang-tidy rightfully complains (-readability-static-accessed-through-instance)
- not going to enable the warning for now to avoid breaking the build
2024-04-03 18:50:33 +00:00
Alexander Tokmakov
98ac8031e0 add fault injection 2024-04-03 19:49:23 +02:00
jsc0218
ee589f8a8b Merge remote-tracking branch 'origin/master' into TableEngineGrant_version2 2024-04-03 17:17:33 +00:00
yariks5s
ca27cf3fde fix mapper for gcs 2024-04-03 16:38:41 +00:00
avogar
d87d5a9197 Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks 2024-04-03 12:07:22 +00:00
alesapin
f5c5146153 [RFC] Try to add global Real and CPU trace collector 2024-04-02 18:04:53 +02:00
Raúl Marín
c35a436435 Remove nested dependency on DateLutImpl 2024-04-02 14:45:48 +02:00
Alexey Milovidov
89cee0a3d6 Move bridges to separate packages 2024-03-31 01:59:36 +01:00
Aleksandr Musorin
f9d81bc774 refactore: improve reading several configurations for kafka
Simplify and do some refactoring for kafka client settings.

Allows to set up separate
settings for consumer and producer like:

```
<consumer>
    ...
</consumer>

<producer>
    <kafka_topic>
        <name>topic_name</name>
        ...
    </kafka_topic>
</producer>
```

Moreover, this fixes warnings from kafka client like:
`Configuration property session.timeout.ms is a consumer property and
will be ignored by this producer instance`
2024-03-27 14:53:33 +01:00
Azat Khuzhin
469be8ee8a Implement input() for clickhouse-local
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-26 13:49:53 +01:00
Azat Khuzhin
be2767b55c Make ClientBase::parseQuery() static
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-26 10:54:57 +01:00
Kruglov Pavel
de1229ba60
Merge branch 'master' into better-stress-upgrade-checks 2024-03-25 19:18:35 +01:00
Alexey Milovidov
aca3978f2d Remove DataStreams (2) 2024-03-24 17:21:53 +01:00
Alexey Milovidov
c0c8cdc185 Add modifications 2024-03-23 02:42:22 +01:00
Alexey Milovidov
7365f4e32b Add modifications 2024-03-23 01:43:28 +01:00
Alexey Milovidov
18c016caaa Support for --output-format in client 2024-03-22 21:06:36 +01:00
robot-ch-test-poll
03a4b5fb58
Merge pull request #61053 from ClickHouse/async-loader-waiters-limit
Separate limits on number of waiting and executing queries
2024-03-22 03:15:25 +01:00
Alexey Milovidov
4d113c2190
Merge pull request #61508 from ClickHouse/generic-clickhouse-local-fuzzer
Generic fuzzer of query text in clickhouse-local
2024-03-21 21:17:28 +03:00
Alexey Milovidov
9afe096ff5
Merge pull request #61681 from ClickHouse/remove-diagnostics
Remove clickhouse-diagnostics from the package
2024-03-21 19:50:47 +03:00
serxa
c31b958f88 Merge branch 'master' into async-loader-waiters-limit 2024-03-21 10:58:22 +00:00
Mikhail f. Shiryaev
5b0610b9e3
Merge pull request #61530 from ClickHouse/fix-client-s
Fix client `-s` argument
2024-03-21 10:17:45 +01:00
Alexey Milovidov
784de2dca3 Merge branch 'master' into generic-clickhouse-local-fuzzer 2024-03-21 03:18:05 +01:00
Alexey Milovidov
bfc7c3c89e Remove clickhouse-diagnostics 2024-03-21 02:52:51 +01:00
Alexey Milovidov
6f4ce33f02 Change how fuzzer arguments are parsed 2024-03-20 22:12:57 +01:00
Mikhail f. Shiryaev
5c1a54f643
Fix clickhouse-client -s argument 2024-03-20 12:33:45 +01:00
Alexey Milovidov
7b7e260585 Merge remote-tracking branch 'origin/master' into generic-clickhouse-local-fuzzer 2024-03-20 01:28:28 +01:00
Raúl Marín
de855ca917 Reduce header dependencies 2024-03-19 17:04:29 +01:00
avogar
31d5049f80 Move logic of ignoring drop queries to server 2024-03-18 16:26:05 +00:00
Nikita Mikhaylov
15896ecaf6
Add table system.keywords [Part 1] (#51808) 2024-03-18 16:58:57 +01:00
avogar
aadc610739 Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks 2024-03-18 15:27:58 +00:00
Han Fei
8a54c85f3c
Merge pull request #61049 from hanfei1991/hanfei/check-limit-periodically
Check cgroups memory limit update periodically
2024-03-18 15:15:46 +01:00
Robert Schulze
fe86741059
Some fixups 2024-03-18 10:44:56 +00:00
alesapin
0faf4eacb8
Merge pull request #61299 from ClickHouse/merge_config
Add ability to merge includes for config preprocessor for configs
2024-03-18 11:22:42 +01:00
Alexey Milovidov
2eb7de859d Correct arguments parsing 2024-03-18 02:35:32 +01:00
Alexey Milovidov
1a61da1bae Replace getFuzzerData with query text fuzzer in clickhouse-local 2024-03-18 02:17:24 +01:00
Alexey Milovidov
01136bbc3b Limit backtracking in parser 2024-03-17 19:54:45 +01:00
Alexey Milovidov
bfea36877b
Merge pull request #61499 from ClickHouse/fix-fuzzers
Fix fuzzers
2024-03-17 21:15:10 +03:00
Alexey Milovidov
44e918bc67 Revive getFuzzerData 2024-03-17 16:22:33 +01:00
Alexey Milovidov
427a8b3264 Less crap 2024-03-17 13:20:49 +01:00
avogar
4ceff16787 Fix bad conflict resolution 2024-03-15 20:29:19 +00:00
avogar
fa9d9ea3f7 Ignore DROP queries in stress test with 1/2 probability, use TRUNCATE instead of ignoring DROP in upgrade check for Memory/JOIN tables 2024-03-15 20:23:39 +00:00
Han Fei
91d18649f4 update comments 2024-03-15 16:23:51 +01:00
alesapin
38cd6ef27d Merge branch 'master' into merge_config 2024-03-15 13:52:52 +01:00
Alexey Milovidov
c9fb8ef54b Merge branch 'master' into split-cast-overload-resolver 2024-03-15 07:09:51 +01:00
Alexey Milovidov
1a41aa4ac7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver 2024-03-14 13:06:23 +01:00
Robert Schulze
3486b4a6e3
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list 2024-03-14 10:44:20 +00:00
jsc0218
c5dc35e5c4 try enable grant of table engine in test 2024-03-14 01:31:45 +00:00
jsc0218
b3b46ea708 Merge remote-tracking branch 'origin/master' into TableEngineGrant_version2 2024-03-14 00:36:29 +00:00
Robert Schulze
4e12b5dc91
Some fixups 2024-03-13 16:54:20 +00:00
Robert Schulze
ce665eae30
Doc fixups 2024-03-13 15:13:17 +00:00
Kruglov Pavel
14402e450a
Merge pull request #61036 from HowePa/detect_stdout
Detect output format by file exctension in clickhouse-client(local)
2024-03-13 14:57:59 +01:00
alesapin
9b1d8a2f52 fix style 2024-03-13 14:15:34 +01:00
alesapin
6203d45b96 working version with comments 2024-03-13 13:12:48 +01:00
Han Fei
c7c64636d0 add a test 2024-03-12 23:31:33 +01:00
Robert Schulze
1b1685e3f1
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list 2024-03-12 13:02:59 +00:00
Alexey Milovidov
5222ebc4b4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver 2024-03-12 06:37:38 +01:00
Nikita Mikhaylov
cfa042cb04 Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 15:45:20 +00:00
Robert Schulze
81b2a1f621
Fix build 2024-03-11 15:34:02 +00:00
Robert Schulze
802bae9661
GCC --> clang pragmas 2024-03-11 12:55:56 +00:00
Alexey Milovidov
4373d5ba16 Merge branch 'master' into split-cast-overload-resolver 2024-03-11 03:01:50 +01:00
serxa
5b796e1f42 Merge branch 'master' into async-loader-waiters-limit 2024-03-10 15:20:27 +00:00
Sema Checherinda
80179e50e4
Merge pull request #58845 from ClickHouse/chesema-session-pool
HTTP connections pool
2024-03-10 14:06:59 +01:00
Alexey Milovidov
1179a70c21
Merge pull request #61118 from ClickHouse/simplify-bridges
Simplify bridges
2024-03-10 14:46:52 +03:00
Sema Checherinda
5c41727725 http connections pools 2024-03-10 10:00:18 +01:00
Alexey Milovidov
3b8a8c9649 Better gitignore 2024-03-10 09:28:30 +01:00
Alexey Milovidov
157adefc70 Fix error 2024-03-10 09:17:29 +01:00
Alexey Milovidov
1a2d403f7b Miscellaneae 2024-03-10 09:16:21 +01:00
Alexey Milovidov
9ddec346a0 Miscellaneous 2024-03-10 09:02:34 +01:00
Alexey Milovidov
3ac4f56cfa Fix tests 2024-03-09 18:53:31 +01:00
Alexey Milovidov
e9ab3ed2dd Even better 2024-03-09 09:27:11 +01:00
Alexey Milovidov
47b308d234 Simplify bridges 2024-03-09 08:42:33 +01:00
Alexey Milovidov
70796e497f Miscellaneous 2024-03-09 08:32:13 +01:00
Alexey Milovidov
574d486322 Something 2024-03-09 07:55:59 +01:00
Alexey Milovidov
ea54ac3cb4 Remove garbage 2024-03-09 06:12:22 +01:00
Alexey Milovidov
6d45eecdad Remove garbage 2024-03-09 06:11:34 +01:00
Alexey Milovidov
2be09581dd Split CastOverloadResolver translation unit 2024-03-09 05:48:52 +01:00
Han Fei
c01a6775d7 fix style 2024-03-09 02:28:39 +01:00
Han Fei
4997f95426 fix build 2024-03-08 17:30:58 +01:00
Han Fei
c92fb8700f Merge branch 'master' into hanfei/check-limit-periodically 2024-03-08 03:59:41 +01:00
Nikita Mikhaylov
2bc4d27ac6 Bye bye 2024-03-07 19:24:39 +00:00
serxa
0f0ea422f2 separate limits on number of waiting and executing queries 2024-03-07 17:05:54 +00:00
Han Fei
7fd13df8a5 check memory limit periodically 2024-03-07 17:21:03 +01:00
HowePa
6d5fd2857e detect output format by file extension in clickhouse-client 2024-03-07 20:29:42 +08:00
HowePa
6c69e7d4dc detect output format by file extension in clickhouse-local 2024-03-07 20:29:04 +08:00
Sema Checherinda
62f9a00da8 shuffle resolved IPs 2024-03-07 13:09:26 +01:00
豪肥肥
1cd4bcdce8
Merge branch 'ClickHouse:master' into fix_local_option 2024-03-06 06:38:28 +08:00
Robert Schulze
b5a7ef5fd3
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-hdr 2024-03-05 11:24:28 +00:00
Alexey Milovidov
a7430004b3 Fix real time query profiler on AArch64 2024-03-04 18:13:49 +01:00
Alexey Milovidov
de6c5d3a40
Merge pull request #60552 from ClickHouse/pc2
Userspace page cache again
2024-03-04 17:47:35 +03:00
Alexey Milovidov
cbf5443585 Remove old code 2024-03-04 00:11:55 +01:00
Alexey Milovidov
4b69440e58 Dashboard: sticky header 2024-03-03 04:35:15 +01:00
Alexey Milovidov
e122a47b48 Simplification 2024-03-03 04:12:31 +01:00
Alexey Milovidov
df53b0c5f8 Merge branch 'master' into slightly-better-colors-on-dashboard 2024-03-03 04:09:09 +01:00
jsc0218
2b54c11d63
Merge branch 'ClickHouse:master' into TableEngineGrant_version2 2024-03-02 20:42:04 -05:00
Alexey Milovidov
c362bbc9ca
Merge pull request #60390 from ClickHouse/redirect-handlers
Allow configuring HTTP redirect handlers for clickhouse-server
2024-03-02 05:15:31 +03:00
Alexey Milovidov
e9fd11beea
Merge pull request #60624 from bluikko/patch-1
Fix typo in config.xml #60623
2024-03-02 04:52:56 +03:00
Antonio Andelic
8607e74966
Merge pull request #60537 from ClickHouse/keeper-snapshot-detached
Keeper improvement: abort during startup if an invalid snapshot is detected
2024-03-01 13:36:09 +01:00
Robert Schulze
af6755f241
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-hdr 2024-03-01 11:45:21 +00:00
bluikko
1aea952382
Fix typo in config.xml #60623
"be Tableau" should be "by Tableau".
2024-03-01 16:13:45 +07:00
Robert Schulze
562e483df4
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-hdr 2024-02-29 12:44:51 +00:00
Michael Kolupaev
42437a2ae1 Userspace page cache (#53770)
* Userspace page cache

* Maybe it'll build this time, who knows.

* 'auto' went out of fashion, I guess

* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary

* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.

* Fix

* Another fix

* Fix restricted seek, fix ppc64le build

* Don't allow page cache with file cache

* Adjust tests a little

* Fix clang-tidy

* Conflicts

* Comments

* Maybe unbroke AsynchronousBoundedReadBuffer

* SettingsChangesHistory.h

* Fix warning in test
2024-02-29 12:28:32 +00:00
Alexander Tokmakov
15e1191f74
Revert "Userspace page cache (#53770)"
This reverts commit 7b55c61551.
2024-02-29 13:20:17 +01:00
Robert Schulze
070f9d952f
Merge remote-tracking branch 'ClickHouse/master' into feature/increase_dns_cache_size 2024-02-29 11:27:59 +00:00
Michael Kolupaev
7b55c61551
Userspace page cache (#53770)
* Userspace page cache

* Maybe it'll build this time, who knows.

* 'auto' went out of fashion, I guess

* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary

* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.

* Fix

* Another fix

* Fix restricted seek, fix ppc64le build

* Don't allow page cache with file cache

* Adjust tests a little

* Fix clang-tidy

* Conflicts

* Comments

* Maybe unbroke AsynchronousBoundedReadBuffer

* SettingsChangesHistory.h

* Fix warning in test
2024-02-29 11:27:32 +00:00
Robert Schulze
0b4622ebf6
Add more suppressions for utils 2024-02-29 09:45:20 +00:00
Antonio Andelic
0cb839af0b Merge branch 'master' into keeper-snapshot-detached 2024-02-29 09:47:32 +01:00
Kirill Nikiforov
fe247cb64d rename dns_cache_max_size to dns_cache_max_entries 2024-02-29 06:03:44 +03:00
Robert Schulze
3b18eb4f17
Fix clang-tidy in some headers 2024-02-28 22:47:34 +00:00
jsc0218
b4b19ae2ad
Merge branch 'master' into TableEngineGrant_version2 2024-02-28 10:56:30 -05:00
豪肥肥
cca154b6b9
fix option ambiguous 2024-02-28 12:16:34 +08:00
Alexey Milovidov
8cf619bc03 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-28 00:30:44 +01:00
Antonio Andelic
f6d35cf4b1 Merge branch 'master' into keeper-snapshot-detached 2024-02-27 16:44:06 +01:00
Antonio Andelic
2c8759442d Move broken Keeper snapshots to detached folder 2024-02-27 15:16:10 +01:00
Alexey Milovidov
04fe5dc55c Merge branch 'master' into fix-inconsistent-formatting 2024-02-26 23:46:24 +01:00
Alexey Milovidov
fbfc4afb46
Merge branch 'master' into redirect-handlers 2024-02-27 01:27:38 +03:00
Robert Schulze
4794dc28f0
Merge remote-tracking branch 'ClickHouse/master' into dist/config-settings 2024-02-26 21:57:33 +00:00
Kirill Nikiforov
8b314a3ac8
Implement system.dns_cache table and dns_cache_max_size server setting (#60257)
* system.dns_cache table WIP

* system.dns_cache table

* rollback unexpected contrib changes

* rollback unexpected changes

* add docs

* code style fixes

* optimize dns cache exporting

* stateful test for system.dns_cache table

* stateful test for system.dns_cache table

* cr fixes

* stateful test for system.dns_cache table

* stateful test for system.dns_cache table

* implement system.dns_cache table

* system.dns_cache test

* system.dns_cache fix docs

* system.dns_cache prettify

* dns_cache_max_size settings

* fix system.dns_cache test

* Update dns_cache.md

* fix doc

Co-authored-by: pufit <pufit@clickhouse.com>

---------

Co-authored-by: pufit <pufit@clickhouse.com>
2024-02-26 15:48:02 -05:00
Alexey Milovidov
47734fbbe2
Merge pull request #60387 from ClickHouse/dashboard-more-convenient
Minor changes for dashboard
2024-02-26 22:52:44 +03:00
Alexey Milovidov
a3f1411679 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-26 19:01:11 +01:00
Alexey Milovidov
b71ae80fa9
Merge pull request #60392 from ClickHouse/fix-duplicate-chart-rendering
Fix duplicate and dangling charts on the Dashboard
2024-02-26 19:24:52 +03:00
Robert Schulze
048f7ec3e9
Merge pull request #59516 from rschu1ze/cgroup-observing-memory-tracker
Update memory tracker periodically with cgroup memory usage
2024-02-26 15:27:19 +01:00
Robert Schulze
1751d76234
Minor doc fixups 2024-02-26 11:42:11 +00:00
Robert Schulze
1e40b63cb1
Merge remote-tracking branch 'ClickHouse/master' into dist/config-settings 2024-02-26 11:15:51 +00:00
Alexey Milovidov
f9c0089526 Fix duplicate and dangling charts on the Dashboard 2024-02-26 01:31:29 +01:00
Alexey Milovidov
9d0e1c4deb Slightly better colors for multi-line graphs on the dashboard 2024-02-26 01:02:38 +01:00
Alexey Milovidov
2edb3d5ba1 Add documentation 2024-02-25 23:58:29 +01:00
Alexey Milovidov
b916479025 Add a test 2024-02-25 23:54:55 +01:00
Alexey Milovidov
27902ee4f6 Touch-up dashboard 2024-02-25 22:36:59 +01:00
Alexey Milovidov
9e32d0f5b2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-23 15:05:46 +01:00
Vitaly Baranov
db119eed49
Merge pull request #60002 from vitlibar/add-config-setting-remove-backup-files-after-failure
Add new config setting "backups.remove_backup_files_after_failure"
2024-02-23 12:42:55 +01:00
János Benjamin Antal
7cad0050c0
Disambiguate alter commands list (#59532)
* Add optional parentheses to TTL element and alter command

* Add some basic tests

* Extend tests with more test cases

* Add one more test case

* Add server setting to control new formatting behavior

* Automatic style fix

* Fix segfault in `clickhouse-format` related to new server setting

* Remove format_ttl_expressions_with_parentheses

* Fix unit test compilation failures

* Introduce global flag to control the new formatting behavior

* Revert "Fix segfault in `clickhouse-format` related to new server setting"

This reverts commit d7131a3145.

* Revert accidental changes

* Revert accidental include reorder

* Revert accidental changes

* Enable new format in client and local server

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-22 19:17:15 +01:00
Vitaly Baranov
b130726a0c
Merge branch 'master' into add-config-setting-remove-backup-files-after-failure 2024-02-22 18:09:12 +01:00
Alexander Tokmakov
97ed2c05b0 Merge branch 'master' into fix_undead_sessions 2024-02-22 14:36:36 +01:00
Alexey Milovidov
2d9fbaa859 Merge with master 2024-02-21 20:37:48 +01:00
Alexander Tokmakov
64a80f1011
Fix default path when path is not specified in config (#59654)
* Update Server.cpp

* Update SentryWriter.cpp

* Update Keeper.cpp

* Update SentryWriter.cpp
2024-02-21 20:33:39 +01:00
Igor Nikonov
a0105e94ba
Merge pull request #60077 from ClickHouse/cleanup-connection-pool-priority
Cleanup: less confusion between config priority and balancing priority in connection pools
2024-02-21 15:22:08 +01:00
Sergei Trifonov
6e3fddf4a3
Merge pull request #59313 from ClickHouse/abstract-concurrency-control
Split `ISlotControl` from `ConcurrencyControl`
2024-02-21 15:04:03 +01:00
Robert Schulze
6a027b3528
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-21 11:48:34 +00:00
Alexander Tokmakov
45d407034f Merge branch 'master' into fix_undead_sessions 2024-02-20 22:21:37 +01:00
Antonio Andelic
bb0b1fa9bc Fix 2024-02-20 14:46:16 +01:00
Antonio Andelic
a0bfb47e95 Merge branch 'master' into keeper-more-resilient-disks 2024-02-20 13:51:23 +01:00
Alexey Milovidov
c753550d0b Digging into a pile of garbage 2024-02-20 10:42:20 +01:00
jsc0218
afa7a95c8c add backward compatibility 2024-02-20 02:11:31 +00:00
Igor Nikonov
f06e15ce5f Merge remote-tracking branch 'origin/master' into cleanup-connection-pool-priority 2024-02-19 11:33:55 +00:00
Robert Schulze
ba9661a5d4
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-19 09:54:08 +00:00
Alexey Milovidov
a955ae8673
Merge pull request #60086 from ClickHouse/check-wrong-abbrs
Check wrong abbreviations
2024-02-17 05:17:11 +01:00
Alexey Milovidov
3128cf1f1b Remove the check for formatting consistency from the Fuzzer 2024-02-17 02:24:21 +01:00
Alexey Milovidov
509d8ee99c Apply review comments 2024-02-17 01:54:54 +01:00