Vitaly Baranov
15ebbd2ed6
Merge pull request #48896 from vitlibar/write-encrypted-to-backup
...
BACKUP from encrypted disks must not decrypt data
2023-05-17 12:40:00 +02:00
Vitaly Baranov
6c8a923c9d
Merge branch 'master' into write-encrypted-to-backup
2023-05-17 12:37:05 +02:00
Kseniia Sumarokova
ac048cbbff
Merge pull request #49925 from kssenii/add-more-logging-for-cache
...
Add some logging
2023-05-17 12:29:40 +02:00
Kseniia Sumarokova
edceda494d
Merge branch 'master' into add-more-logging-for-cache
2023-05-17 12:24:59 +02:00
Kseniia Sumarokova
3787b7f127
Update Metadata.cpp
2023-05-17 12:16:18 +02:00
Azat Khuzhin
9fe4f1a934
Extensive coverage for bandwidth limiting settings
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-17 12:12:39 +02:00
Azat Khuzhin
fdfb1eda55
Fix {Local,Remote}ReadThrottlerSleepMicroseconds metric values
...
And also update the test, since now you could have slightly less sleep
intervals, if query spend some time in other places.
But what is important is that query_duration_ms does not exceeded
calculated delay.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-17 12:12:39 +02:00
Azat Khuzhin
7383da0c52
Fix per-query remote throttler
...
remote throttler by some reason had been overwritten by the global one
during reloads, likely this is for graceful reload of this option, but
it breaks per-query throttling, remove this logic.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-17 12:12:39 +02:00
Azat Khuzhin
3c80e30f02
Fix per-query IO/BACKUPs throttling settings (when default profile has them)
...
When some of this settings was set for default profile (in
users.xml/users.yml), then it will be always used regardless of what
user passed.
Fix this by not inherit per-query throttlers, for this they should be
reset before making query context and they should not be initialized as
before in Context::makeQueryContext(), since makeQueryContext() called
too early, when user settings was not read yet.
But there we had also initialization of per-server throttling, move this
into the ContextSharedPart::configureServerWideThrottling(), and call it
once we have ServerSettings set.
Also note, that this patch makes the following settings - server
settings:
- max_replicated_fetches_network_bandwidth_for_server
- max_replicated_sends_network_bandwidth_for_server
But this change should not affect anybody, since it is done with
compatiblity (i.e. if this setting is set in users profile it will be
read from it as well as a fallback).
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-17 12:12:39 +02:00
Vitaly Baranov
f4ac4c3f9d
Corrections after review.
2023-05-17 03:23:16 +02:00
Yakov Olkhovskiy
0a44a69dc8
remove unnecessary header
2023-05-17 00:22:13 +00:00
Yakov Olkhovskiy
282297b677
binary encoding of IPv6 in protobuf
2023-05-16 23:46:01 +00:00
Thom O'Connor
15cb627688
Update postgresql.md
...
The type cannot be optional, so we need to be clear in the docs that [type1] [type2] cannot be in square brackets, so removed them
2023-05-16 16:35:41 -06:00
Alexander Tokmakov
0da82945ac
fix
2023-05-16 18:18:48 +02:00
Alexander Tokmakov
3d26232cc0
Merge pull request #49918 from ClickHouse/remove_unused_code
...
Remove unused code
2023-05-16 18:53:49 +03:00
kssenii
724949927b
Add logging
2023-05-16 17:36:48 +02:00
Kruglov Pavel
353791b2dd
Try to fix flaky test_distributed_load_balancing tests ( #49912 )
...
* Try to fix flaky test_distributed_load_balancing tests
* Automatic style fix
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-05-16 18:26:22 +03:00
Antonio Andelic
4bc5a76fa7
Add Compose request for GCS ( #49693 )
...
* Add compose request
* Check if outcome is successful
---------
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-05-16 17:20:06 +02:00
Dmitry Novik
2287dd8633
Merge pull request #49800 from ClickHouse/fix-adding-cast
...
Analyzer: apply _CAST to constants only once
2023-05-16 17:05:02 +02:00
Dmitry Novik
77adb7c8bc
Update 02535_analyzer_group_by_use_nulls reference
2023-05-16 17:00:05 +02:00
vdimir
8e5af2a06b
Merge pull request #49826 from ClickHouse/vdimir/asof_join_right_null
2023-05-16 16:24:53 +02:00
vdimir
1308c29747
Update tests/broken_tests.txt
2023-05-16 16:23:53 +02:00
vdimir
1f55c320b4
Fix style
2023-05-16 16:23:53 +02:00
vdimir
ca005ecea1
Update comment about filtering nulls in asof join
2023-05-16 16:23:53 +02:00
vdimir
a7bb8f412f
Allow ASOF JOIN over nullable right column
2023-05-16 16:23:53 +02:00
alesapin
50a536bba8
Remove unused code
2023-05-16 15:26:24 +02:00
Alexander Tokmakov
b6716a8f0f
Merge branch 'master' into fix_some_tests4
2023-05-16 14:46:27 +02:00
Vitaly Baranov
b068f0b619
Fix build.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
2ec94a42b7
Remove default parameters from virtual functions.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
943707963f
Add backup setting "decrypt_files_from_encrypted_disks"
2023-05-16 14:27:27 +02:00
Vitaly Baranov
019493efa3
Fix throttling in backups.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
5198997fd8
Remove ReadSettings from backup entries.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
7cea264230
Fix whitespaces.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
d0fd81fa27
Add tests.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
c48c20fac8
Use combined checksums for encrypted immutable files.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
517e119e03
Move checksum calculation to IBackupEntry.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
002fd19cb7
Move the common part of BackupIO_* to BackupIO_Default.
2023-05-16 14:27:23 +02:00
Vitaly Baranov
c92219f01b
BACKUP now writes encrypted data for tables on encrypted disks.
2023-05-16 14:26:33 +02:00
Vitaly Baranov
cc50fcc60a
Remove the 'temporary_file_' argument from BackupEntryFromImmutableFile's constructor.
2023-05-16 14:25:37 +02:00
Vitaly Baranov
bc880db5d9
Add functions to read/write encrypted files from IDisk.
2023-05-16 14:25:37 +02:00
Vitaly Baranov
101aa6eff0
Add function copyS3FileFromDisk().
2023-05-16 14:25:37 +02:00
Vitaly Baranov
69114cb550
Add function getBlobPath() to IDisk interface to allow copying to/from disks which are not built on top of IObjectStorage.
2023-05-16 14:25:36 +02:00
Vitaly Baranov
fd2731845c
Simplify interface of IBackupWriter: Remove supportNativeCopy() function.
2023-05-16 14:25:36 +02:00
Smita Kulkarni
9a2645a729
Fixed clang build
2023-05-16 14:09:38 +02:00
kssenii
d4ea3ea045
Fix
2023-05-16 13:54:13 +02:00
robot-clickhouse
b3fc7d1a86
Automatic style fix
2023-05-16 11:15:15 +00:00
alesapin
a4f84cecfd
Retry connection expired in test_rename_column/test.py
2023-05-16 13:05:36 +02:00
alesapin
93bd09ddd6
Merge branch 'master' into fix_another_zero_copy_bug
2023-05-16 12:24:52 +02:00
Anton Popov
6061f3b90e
Merge pull request #49881 from azat/shutdown-log-level
...
Log with warning if the server was terminated forcefully
2023-05-16 12:22:21 +02:00
Kruglov Pavel
b414760d43
Merge pull request #49673 from Avogar/fiber-local-var
...
Fix assert in SpanHolder::finish() with fibers
2023-05-16 11:59:33 +02:00