Commit Graph

1202 Commits

Author SHA1 Message Date
Igor Nikonov
f2b60c4f74 Merge remote-tracking branch 'origin/master' into asan-invalid-shared-context-access 2024-08-10 10:08:40 +00:00
Alexey Milovidov
d8670ecd91 Merge branch 'master' into format-settings-parsing 2024-08-09 20:12:33 +02:00
Kirill Nikiforov
4354b4193d
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-08-09 20:42:32 +03:00
Antonio Andelic
0d38aa98ce Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-08-09 15:44:47 +02:00
Nikita Taranov
ffa1371dde Merge branch 'master' into keep_alive_max_reqs 2024-08-09 12:24:45 +01:00
Kirill Nikiforov
ea58b8062e
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-08-08 22:44:32 +03:00
Robert Schulze
f2c8d9678c
Merge remote-tracking branch 'ClickHouse/master' into fix-concurrent_threads_soft_limit_ratio 2024-08-08 09:09:44 +00:00
Alexey Milovidov
e37772e3c4 Merge branch 'master' into format-settings-parsing 2024-08-08 02:28:56 +02:00
khodyrevyurii
00b62b1c0d
Minor clarifycation for method getNumberOfPhysicalCPUCores 2024-08-07 08:47:55 +00:00
khodyrevyurii
c933a38955
change std:🧵:hardware_concurrency on container friendly method getNumberOfPhysicalCPUCores 2024-08-07 08:47:53 +00:00
Nikita Taranov
053285dc1c Merge branch 'master' into keep_alive_max_reqs 2024-08-06 20:55:48 +01:00
Alexander Tokmakov
77103aa729 Merge branch 'master' into reject_poco 2024-08-06 19:52:05 +02:00
MikhailBurdukov
304d01e2c3 Review fix 2024-08-06 15:21:49 +00:00
MikhailBurdukov
3ebc3852f4 Allow filtering ip addresses by ip family in DNS resolver 2024-08-06 15:21:49 +00:00
Kirill Nikiforov
a28a82d344
Merge remote-tracking branch 'origin' into mongodb_refactoring 2024-08-05 20:57:15 +03:00
Alexey Milovidov
65bba77771 Fix typo 2024-08-03 18:30:33 +02:00
Igor Nikonov
76847d9b4c Fix(asan) : access destroyed shared context from handleCrash() 2024-08-02 22:43:05 +00:00
vdimir
90d2d36209
Merge branch 'master' into pr/allmazz/63279 2024-07-31 12:09:46 +00:00
serxa
384e2ff399 Merge branch 'master' into fix-use-concurrency-control 2024-07-31 07:25:16 +00:00
Nikita Mikhaylov
14d0cc2bf3
Merge pull request #67228 from ClickHouse/drop-tables-even-faster
Cleanup code and speedup table removal
2024-07-30 22:50:36 +00:00
Sergei Trifonov
05f1d122b1
Merge pull request #67232 from azat/dashboard-from-config-resubmit
Add ability to load dashboards for system.dashboards from config
2024-07-30 13:18:22 +00:00
vdimir
7eddb93935
Merge branch 'master' into pr/allmazz/63279 2024-07-30 10:54:45 +00:00
Nikita Mikhaylov
2aafd71146 Moved settings to ServerSettings and made the table drop even faster
(cherry picked from commit e1eb542dcc2b9fbc6a470a3cd9a183e79c86d7c7)
2024-07-30 00:39:29 +02:00
Antonio Andelic
a9b947d9ac Extract common 2024-07-28 11:51:09 +02:00
Kirill Nikiforov
c23e3d8663
Merge branch 'master' into mongodb_refactoring 2024-07-27 15:33:46 +03:00
Azat Khuzhin
870ec237bb Add ability to load dashboards for system.dashboards from config
One of the obvious reasons is to allow rendering them with readonly
user, which is not possible right now, due to usage of merge() function
there.

Another one, is to add some custom metrics.

Note, that once set, they overrides the default dashboards preset.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-07-26 21:21:09 +02:00
Antonio Andelic
287cce7d21 Fixes 2024-07-26 09:20:15 +02:00
Antonio Andelic
2988e13050 Free bitmask 2024-07-25 13:55:01 +02:00
Antonio Andelic
6557387148 Try calcualting memory with numactl if membind used 2024-07-25 11:49:02 +02:00
Antonio Andelic
d78cfd030f Use cgroups as source 2024-07-23 10:33:12 +02:00
Antonio Andelic
1c3f7d0fd0 Small fix 2024-07-22 15:18:13 +02:00
Antonio Andelic
1d1dc9c7ad
Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-07-21 10:37:01 +01:00
Alex Katsman
eb51dc8980 Don't start GWP allocations until init is finished 2024-07-19 13:34:50 +00:00
Antonio Andelic
9a43183eb3 Finish background memory thread 2024-07-18 10:40:47 +02:00
Antonio Andelic
21009577d8 Dedicated memory background thread 2024-07-18 09:01:20 +02:00
Alexey Milovidov
4217d029c0 Fix something 2024-07-18 03:33:36 +02:00
Antonio Andelic
97f4ec2adb Read cgroup memory usage in async metrics thread 2024-07-17 16:59:35 +02:00
Alexey Milovidov
f5db89faa2 Merge branch 'update-tidy-for-clang-19' into format-settings-parsing 2024-07-17 05:53:36 +02:00
Alexander Tokmakov
09dc79ad3a Merge branch 'master' into reject_poco 2024-07-15 20:17:28 +02:00
Alexey Milovidov
9745a5dd74 Merge branch 'master' into format-settings-parsing 2024-07-12 23:19:54 +02:00
serxa
bf125d5da6 Merge branch 'master' into fix-use-concurrency-control 2024-07-12 08:44:12 +00:00
Alexander Tokmakov
243edcc8aa add logs and metrics about rejected connections in Poco 2024-07-12 01:11:18 +02:00
Raúl Marín
a339dd020f Reduce dependencies on MergeTreeSettings.h 2024-07-09 19:39:41 +02:00
Alexey Milovidov
278f2bb14f Merge branch 'master' of github.com:ClickHouse/ClickHouse into format-settings-parsing 2024-07-05 22:57:11 +02:00
pufit
4195ce2183
Merge branch 'master' into pufit/startup-scripts 2024-07-05 13:52:58 -04:00
Anton Popov
907a365926
Merge pull request #66098 from CurtizJ/better-sanitizer-message
More precise warning message about sanitizers
2024-07-05 14:15:28 +00:00
Alexey Milovidov
dbcc2c6979 Merge branch 'master' into format-settings-parsing 2024-07-05 15:53:23 +02:00
Anton Popov
93afc8e613 more precise warning message about sanitizers 2024-07-04 15:11:29 +00:00
Antonio Andelic
613ed1ebbf Merge branch 'master' into try-disabling-jemalloc-background-threads 2024-07-04 13:58:26 +02:00
Antonio Andelic
c93d8cbb66 Fixes 2024-07-04 13:57:47 +02:00
Antonio Andelic
c86cdbb243 Remove scary jemalloc log 2024-07-03 11:05:34 +02:00
Alexey Milovidov
0a493b88f2 Merge branch 'master' into format-settings-parsing 2024-06-29 04:25:34 +02:00
Alexander Tokmakov
4748e2929f
Merge pull request #65570 from ClickHouse/keeper_az
Improve ZooKeeper load balancing
2024-06-28 22:57:20 +00:00
vdimir
77bdd5da8d
Merge branch 'master' into mongodb_refactoring 2024-06-27 12:24:04 +02:00
vdimir
27a72fd5c4
Merge branch 'master' into pufit/startup-scripts 2024-06-27 12:14:33 +02:00
Alexander Tokmakov
43cb2f6af7 remove trash 2024-06-26 02:03:22 +02:00
alesapin
12a129d838
Merge pull request #65545 from ClickHouse/add_customizeable_config_reloader_interval
Add ability to change config reload interval
2024-06-25 14:18:54 +00:00
Alexey Milovidov
3b149d1e0b Merge branch 'master' into format-settings-parsing 2024-06-25 03:18:37 +02:00
Sema Checherinda
fb2f0e78f7
Merge pull request #63985 from ianton-ru/protocols-tls-extend-params
More parameters for tls layer in protocols
2024-06-24 12:41:56 +00:00
alesapin
fc10bf544f Merge remote-tracking branch 'origin/master' into add_customizeable_config_reloader_interval 2024-06-24 11:38:02 +02:00
Kirill Nikiforov
edb3d0ab42
fix ssl, fix after master merge 2024-06-24 00:45:15 +03:00
Robert Schulze
4e1a68f33d
Show compiled expressions cache settings size in system.server_settings 2024-06-23 10:55:52 +00:00
alesapin
104dc8fa3e Fix server settings 2024-06-21 19:16:27 +02:00
alesapin
0dc01f4a94 Add ability to change config reload interval 2024-06-21 18:24:20 +02:00
Alexey Milovidov
9dcaade3bb Merge branch 'master' into format-settings-parsing 2024-06-21 16:02:53 +02:00
pufit
3786ca72d0 docs, review fixes 2024-06-21 02:02:30 -04:00
pufit
e1248d8d4d Merge branch 'master' into pufit/startup-scripts
# Conflicts:
#	src/Core/ServerSettings.h
2024-06-20 21:32:11 -04:00
Sema Checherinda
e36a641a80 Merge branch 'master' into protocols-tls-extend-params 2024-06-20 19:02:12 +02:00
Kseniia Sumarokova
784f66cf2f
Merge pull request #65239 from ClickHouse/tracing-try-2
Initialize global profiler for Poco::ThreadPool (needed for keeper, etc)
2024-06-19 09:00:46 +00:00
Alexey Milovidov
11d54f4809 Pass-through settings from the client 2024-06-18 15:18:53 +02:00
Sergei Trifonov
a17d9d92d7
Merge branch 'master' into workload-for-merges 2024-06-14 18:35:43 +02:00
Alexander Tokmakov
bc8c8ffd55
Merge pull request #64986 from ClickHouse/fix_init_order
Fix initialization order (ServerUUID/ZooKeeper)
2024-06-14 12:32:05 +00:00
kssenii
fb32a99578 Initialize global trace collector for Poco::ThreadPool 2024-06-13 19:20:58 +02:00
serxa
08a293a91f Merge branch 'master' into workload-for-merges 2024-06-11 21:33:25 +00:00
Antonio Andelic
f51ed35200 Merge branch 'master' into fix-gwp-asan 2024-06-11 16:57:50 +02:00
kssenii
571ddb66df Merge remote-tracking branch 'origin/master' into named-collecitons-in-keeper 2024-06-10 13:17:32 +02:00
Antonio Andelic
c2c5992434 Merge branch 'master' into fix-gwp-asan 2024-06-10 12:50:08 +02:00
Alexander Tokmakov
01ece14035 fix initialization order (ServerUUID/ZooKeeper) 2024-06-07 16:23:40 +02:00
serxa
7594e06ea2 Merge branch 'master' into workload-for-merges 2024-06-07 13:58:41 +00:00
Antonio Andelic
bfb1c4c793 better 2024-06-06 11:29:42 +02:00
Antonio Andelic
1d3cf17053 Fix global trace collector 2024-06-06 11:18:31 +02:00
pufit
86bbcb0037 Startup scripts 2024-06-06 01:42:07 -04:00
Antonio Andelic
5df91804f6 Add probability setting for GWPAsan 2024-06-03 11:54:37 +02:00
kssenii
0571485ef6 Merge remote-tracking branch 'origin/master' into named-collecitons-in-keeper 2024-05-30 19:45:01 +02:00
kssenii
83c0c9bcde Move everything to NamedCollecitonFactory 2024-05-30 19:43:05 +02:00
Robert Schulze
7f4c68c0b8
Port internal changes back to public repo 2024-05-29 08:45:28 +00:00
serxa
c04d7bc2b7 Merge branch 'master' into workload-for-merges 2024-05-28 10:44:59 +00:00
Alexander Tokmakov
3ee2307024
Revert "Refactoring of Server.h: Isolate server management from other logic" 2024-05-27 10:04:19 +02:00
TTPO100AJIEX
251010f109 Move protocol-server and inter-server management into separate classes
Co-authored-by: Alex Koledaev <ax3l3rator@gmail.com>
2024-05-24 02:14:26 +03:00
Anton Ivashkin
983fa64e4f Fix CertificateReloader usage for custom protocols 2024-05-23 17:53:23 +02:00
Sergei Trifonov
dd22140b57
Merge branch 'master' into fix-use-concurrency-control 2024-05-22 11:36:20 +02:00
Francisco Javier Jurado Moreno
e1caea6ab5 Split attached table count into attached tables, views and dictionaries 2024-05-21 11:29:07 +02:00
serxa
96e19ac548 add merge_workload and mutation_workload settings for server and merge tree 2024-05-17 17:10:40 +00:00
Han Fei
116055b532 refine load part logic 2024-05-08 15:04:16 +02:00
Alexey Milovidov
ed1bbd0bd0 Merge branch 'master' into local-less-directories 2024-05-03 02:35:44 +02:00
alesapin
eacbf5fe10 Fix premature server listen for connections 2024-04-30 14:32:03 +02:00
Alexey Milovidov
39118ef461 Hopefully better 2024-04-27 18:47:03 +02:00
Anton Popov
b50117780c Merge remote-tracking branch 'upstream/master' into HEAD 2024-04-17 13:05:46 +00:00
Robert Schulze
7dc05d092b
Merge remote-tracking branch 'rschu1ze/master' into be-less-boring-32 2024-04-15 16:35:10 +00:00
Anton Popov
9e54a833ed fix build 2024-04-12 18:41:40 +00:00
Anton Popov
47c653f87c better retries in azure sdk 2024-04-12 15:39:14 +00:00
Alexander Tokmakov
d8e97b51bf Merge branch 'master' into cannot_allocate_thread 2024-04-10 21:21:42 +02:00
Nikita Taranov
a2147b8ded
Merge branch 'master' into keep_alive_max_reqs 2024-04-09 21:32:36 +02:00
Robert Schulze
dca6e0abbd
Fix the build (after boringssl submodule removal) 2024-04-08 11:02:41 +00:00
Alexander Tokmakov
c53b20a770 fix 2024-04-03 20:57:12 +02:00
Alexander Tokmakov
98ac8031e0 add fault injection 2024-04-03 19:49:23 +02:00
alesapin
f5c5146153 [RFC] Try to add global Real and CPU trace collector 2024-04-02 18:04:53 +02:00
Sergei Trifonov
b252062767
Merge branch 'master' into fix-use-concurrency-control 2024-04-01 18:32:40 +02:00
Nikita Taranov
d7b34a80bb stash 2024-03-22 16:09:14 +00:00
serxa
c31b958f88 Merge branch 'master' into async-loader-waiters-limit 2024-03-21 10:58:22 +00:00
Raúl Marín
de855ca917 Reduce header dependencies 2024-03-19 17:04:29 +01:00
Han Fei
8a54c85f3c
Merge pull request #61049 from hanfei1991/hanfei/check-limit-periodically
Check cgroups memory limit update periodically
2024-03-18 15:15:46 +01:00
Robert Schulze
fe86741059
Some fixups 2024-03-18 10:44:56 +00:00
serxa
dd6c1ac19a add diagnostics for concurrency control 2024-03-15 18:40:50 +00:00
Robert Schulze
4e12b5dc91
Some fixups 2024-03-13 16:54:20 +00:00
Robert Schulze
ce665eae30
Doc fixups 2024-03-13 15:13:17 +00:00
alesapin
9b1d8a2f52 fix style 2024-03-13 14:15:34 +01:00
alesapin
6203d45b96 working version with comments 2024-03-13 13:12:48 +01:00
Han Fei
c7c64636d0 add a test 2024-03-12 23:31:33 +01:00
serxa
5b796e1f42 Merge branch 'master' into async-loader-waiters-limit 2024-03-10 15:20:27 +00:00
Sema Checherinda
5c41727725 http connections pools 2024-03-10 10:00:18 +01:00
Han Fei
c01a6775d7 fix style 2024-03-09 02:28:39 +01:00
Han Fei
4997f95426 fix build 2024-03-08 17:30:58 +01:00
Han Fei
c92fb8700f Merge branch 'master' into hanfei/check-limit-periodically 2024-03-08 03:59:41 +01:00
serxa
0f0ea422f2 separate limits on number of waiting and executing queries 2024-03-07 17:05:54 +00:00
Han Fei
7fd13df8a5 check memory limit periodically 2024-03-07 17:21:03 +01:00
Robert Schulze
b5a7ef5fd3
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-hdr 2024-03-05 11:24:28 +00:00
Alexey Milovidov
a7430004b3 Fix real time query profiler on AArch64 2024-03-04 18:13:49 +01:00
Alexey Milovidov
de6c5d3a40
Merge pull request #60552 from ClickHouse/pc2
Userspace page cache again
2024-03-04 17:47:35 +03:00
Robert Schulze
af6755f241
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-hdr 2024-03-01 11:45:21 +00:00
Michael Kolupaev
42437a2ae1 Userspace page cache (#53770)
* Userspace page cache

* Maybe it'll build this time, who knows.

* 'auto' went out of fashion, I guess

* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary

* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.

* Fix

* Another fix

* Fix restricted seek, fix ppc64le build

* Don't allow page cache with file cache

* Adjust tests a little

* Fix clang-tidy

* Conflicts

* Comments

* Maybe unbroke AsynchronousBoundedReadBuffer

* SettingsChangesHistory.h

* Fix warning in test
2024-02-29 12:28:32 +00:00
Alexander Tokmakov
15e1191f74
Revert "Userspace page cache (#53770)"
This reverts commit 7b55c61551.
2024-02-29 13:20:17 +01:00
Michael Kolupaev
7b55c61551
Userspace page cache (#53770)
* Userspace page cache

* Maybe it'll build this time, who knows.

* 'auto' went out of fashion, I guess

* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary

* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.

* Fix

* Another fix

* Fix restricted seek, fix ppc64le build

* Don't allow page cache with file cache

* Adjust tests a little

* Fix clang-tidy

* Conflicts

* Comments

* Maybe unbroke AsynchronousBoundedReadBuffer

* SettingsChangesHistory.h

* Fix warning in test
2024-02-29 11:27:32 +00:00
Kirill Nikiforov
2744fc0c2d rename dns_cache_max_size to dns_cache_max_entries 2024-02-29 02:32:13 +03:00
Robert Schulze
3b18eb4f17
Fix clang-tidy in some headers 2024-02-28 22:47:34 +00:00
Kirill Nikiforov
8b314a3ac8
Implement system.dns_cache table and dns_cache_max_size server setting (#60257)
* system.dns_cache table WIP

* system.dns_cache table

* rollback unexpected contrib changes

* rollback unexpected changes

* add docs

* code style fixes

* optimize dns cache exporting

* stateful test for system.dns_cache table

* stateful test for system.dns_cache table

* cr fixes

* stateful test for system.dns_cache table

* stateful test for system.dns_cache table

* implement system.dns_cache table

* system.dns_cache test

* system.dns_cache fix docs

* system.dns_cache prettify

* dns_cache_max_size settings

* fix system.dns_cache test

* Update dns_cache.md

* fix doc

Co-authored-by: pufit <pufit@clickhouse.com>

---------

Co-authored-by: pufit <pufit@clickhouse.com>
2024-02-26 15:48:02 -05:00
Robert Schulze
048f7ec3e9
Merge pull request #59516 from rschu1ze/cgroup-observing-memory-tracker
Update memory tracker periodically with cgroup memory usage
2024-02-26 15:27:19 +01:00
János Benjamin Antal
7cad0050c0
Disambiguate alter commands list (#59532)
* Add optional parentheses to TTL element and alter command

* Add some basic tests

* Extend tests with more test cases

* Add one more test case

* Add server setting to control new formatting behavior

* Automatic style fix

* Fix segfault in `clickhouse-format` related to new server setting

* Remove format_ttl_expressions_with_parentheses

* Fix unit test compilation failures

* Introduce global flag to control the new formatting behavior

* Revert "Fix segfault in `clickhouse-format` related to new server setting"

This reverts commit d7131a3145.

* Revert accidental changes

* Revert accidental include reorder

* Revert accidental changes

* Enable new format in client and local server

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-22 19:17:15 +01:00
Alexander Tokmakov
64a80f1011
Fix default path when path is not specified in config (#59654)
* Update Server.cpp

* Update SentryWriter.cpp

* Update Keeper.cpp

* Update SentryWriter.cpp
2024-02-21 20:33:39 +01:00
Sergei Trifonov
6e3fddf4a3
Merge pull request #59313 from ClickHouse/abstract-concurrency-control
Split `ISlotControl` from `ConcurrencyControl`
2024-02-21 15:04:03 +01:00
Robert Schulze
ba9661a5d4
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-19 09:54:08 +00:00
Alexey Milovidov
509d8ee99c Apply review comments 2024-02-17 01:54:54 +01:00
Alexey Milovidov
39f363ba6e Print CPU flags at startup 2024-02-16 13:09:07 +01:00
Alexey Milovidov
5b83e771ed Print CPU flags at startup 2024-02-16 13:06:57 +01:00
Konstantin Bogdanov
914fd27d5b
Add PlacementInfo 2024-02-14 10:19:36 +01:00
Robert Schulze
7b7ea6d477
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-14 08:56:22 +00:00
Azat Khuzhin
e6d96e4325 Better warning for disabled kernel.task_delayacct
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-10 14:49:43 +01:00
Robert Schulze
f6f1fd4d26
Initial implementation 2024-02-08 16:06:44 +00:00
Konstantin Bogdanov
5894fa9860
0 means number of cores 2024-02-06 19:10:34 +01:00
Konstantin Bogdanov
5969668503
Concurrent table creation in DatabaseReplicated 2024-02-01 09:51:52 +01:00