Vitaly Baranov
019493efa3
Fix throttling in backups.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
5198997fd8
Remove ReadSettings from backup entries.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
7cea264230
Fix whitespaces.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
d0fd81fa27
Add tests.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
c48c20fac8
Use combined checksums for encrypted immutable files.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
517e119e03
Move checksum calculation to IBackupEntry.
2023-05-16 14:27:27 +02:00
Vitaly Baranov
002fd19cb7
Move the common part of BackupIO_* to BackupIO_Default.
2023-05-16 14:27:23 +02:00
Vitaly Baranov
c92219f01b
BACKUP now writes encrypted data for tables on encrypted disks.
2023-05-16 14:26:33 +02:00
Vitaly Baranov
cc50fcc60a
Remove the 'temporary_file_' argument from BackupEntryFromImmutableFile's constructor.
2023-05-16 14:25:37 +02:00
Vitaly Baranov
bc880db5d9
Add functions to read/write encrypted files from IDisk.
2023-05-16 14:25:37 +02:00
Vitaly Baranov
101aa6eff0
Add function copyS3FileFromDisk().
2023-05-16 14:25:37 +02:00
Vitaly Baranov
69114cb550
Add function getBlobPath() to IDisk interface to allow copying to/from disks which are not built on top of IObjectStorage.
2023-05-16 14:25:36 +02:00
Vitaly Baranov
fd2731845c
Simplify interface of IBackupWriter: Remove supportNativeCopy() function.
2023-05-16 14:25:36 +02:00
Smita Kulkarni
9a2645a729
Fixed clang build
2023-05-16 14:09:38 +02:00
kssenii
d4ea3ea045
Fix
2023-05-16 13:54:13 +02:00
robot-clickhouse
b3fc7d1a86
Automatic style fix
2023-05-16 11:15:15 +00:00
alesapin
a4f84cecfd
Retry connection expired in test_rename_column/test.py
2023-05-16 13:05:36 +02:00
Anton Popov
6061f3b90e
Merge pull request #49881 from azat/shutdown-log-level
...
Log with warning if the server was terminated forcefully
2023-05-16 12:22:21 +02:00
Kruglov Pavel
b414760d43
Merge pull request #49673 from Avogar/fiber-local-var
...
Fix assert in SpanHolder::finish() with fibers
2023-05-16 11:59:33 +02:00
alesapin
0b4ab70dd9
Merge pull request #49891 from hanfei1991/hanfei/chassert-1
...
use chassert in MergeTreeDeduplicationLog to have better log info
2023-05-16 11:50:11 +02:00
Sema Checherinda
03c51208d1
Merge pull request #44869 from CheSema/multi_part_upload
...
rework WriteBufferFromS3, add tests, add abortion
2023-05-16 10:52:01 +02:00
Robert Schulze
59bc3e25be
Merge pull request #49824 from AVMusorin/allow-alias-column-kafka
...
KafkaEngine: Allow usage of Alias column type
2023-05-15 23:40:03 +02:00
FFFFFFFHHHHHHH
11b94a626a
Fix aggregate function kolmogorovSmirnovTest ( #49768 )
2023-05-15 23:20:29 +02:00
Sergei Trifonov
cbc15bf35a
Add DynamicResourceManager
and FairPolicy
into scheduling subsystem ( #49671 )
...
* Add `DynamicResourceManager` and `FairPolicy` into scheduling subsystem
* fix test
* fix tidy build
2023-05-15 23:13:17 +02:00
Alexander Tokmakov
c9d6ee3c98
Merge pull request #49874 from azat/build/fix
...
Fix "reference to local binding" after fixes for clang-17
2023-05-15 23:25:18 +03:00
Vitaly Baranov
801cacc13f
Merge pull request #49831 from vitlibar/fix-setting-null-in-profile-def
...
Fix setting NULL in profile definition
2023-05-15 22:24:49 +02:00
robot-ch-test-poll4
e58d1821eb
Merge pull request #49788 from lesandie/master
...
Reworked Local File Cache documentation
2023-05-15 21:38:43 +02:00
Vitaly Baranov
bf3336a84e
Merge pull request #47640 from ilejn/row_policy_template
...
Row policy for database
2023-05-15 20:05:15 +02:00
Michael Kolupaev
91db148513
Fix AsynchronousReadIndirectBufferFromRemoteFS breaking on short seeks
2023-05-15 11:02:24 -07:00
Han Fei
4137a5e058
use chassert in MergeTreeDeduplicationLog to have better log info
2023-05-15 18:51:16 +02:00
Kruglov Pavel
900aca5f0a
Delete unneded files
2023-05-15 18:33:09 +02:00
Kruglov Pavel
bfcaf95aed
Delete unneded files
2023-05-15 18:32:54 +02:00
avogar
78064d0622
Better comments
2023-05-15 15:52:14 +00:00
avogar
b23afdc533
Fix build for aarch64-darwin
2023-05-15 15:48:00 +00:00
vdimir
07de815d96
Merge pull request #49836 from arthurpassos/add_extract_kv_max_number_of_pairs_safeguard
2023-05-15 16:31:01 +02:00
Anton Popov
512b27ef27
Merge pull request #49873 from amosbird/fix_49839
...
Fix a bug with projections and the aggregate_functions_null_for_empty setting (for query_plan_optimize_projection)
2023-05-15 15:58:42 +02:00
Azat Khuzhin
f2a023140e
Fix processing pending batch for Distributed async INSERT after restart
...
After abnormal server restart current_batch.txt (that contains list of
files to send to the remote shard), may not have all files, if it was
terminated between unlink .bin files and truncation of current_batch.txt
But it should be fixed in a more reliable way, though to backport the
patch I kept it simple.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-15 15:57:30 +02:00
Diego Nieto
bf201a09b7
Update docs/en/operations/storing-data.md
...
@kssenii comments
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2023-05-15 15:43:39 +02:00
AVMusorin
418a61a68c
Allow using Alias column type for KafkaEngine
...
```
create table kafka
(
a UInt32,
a_str String Alias toString(a)
) engine = Kafka;
create table data
(
a UInt32;
a_str String
) engine = MergeTree
order by tuple();
create materialized view data_mv to data
(
a UInt32,
a_str String
) as
select a, a_str from kafka;
```
Alias type works as expected in comparison with MATERIALIZED/EPHEMERAL
or column with default expression.
Ref: https://github.com/ClickHouse/ClickHouse/pull/47138
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2023-05-15 15:39:58 +02:00
Sema Checherinda
dccdb3e678
work with comments on PR
2023-05-15 14:41:51 +02:00
Arthur Passos
e8f971aa2b
use LIMIT_EXCEEDED instead of TOO_LARGE_MAP_SIZE
2023-05-15 09:25:10 -03:00
Azat Khuzhin
424a20ee1c
Log with warning if the server was terminated forcefully
...
In case of it is terminated forcefully it will not be terminated
gracefully (i.e. run dtors and stuff), and by using warning log level
those messages will go to clickhouse-server.err.log, in which messages
are kept for a longer period then in clickhouse-server.log (at least
because it contains only warnings, errors and fatals only).
This will help with investigating some obscure issues.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-15 14:20:42 +02:00
Azat Khuzhin
665545ec45
Fix "reference to local binding" after fixes for clang-17
...
Follow-up for: #49851 (cc @alexey-milovidov)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-15 12:45:20 +02:00
Alexander Tokmakov
25912a2673
Merge pull request #49876 from JackyWoo/fix_typo
...
fix typo
2023-05-15 13:32:58 +03:00
Kruglov Pavel
558eda4146
Merge pull request #49412 from azat/block-use-dense-hash-map
...
Switch Block::NameMap to google::dense_hash_map over HashMap
2023-05-15 12:22:55 +02:00
Alexander Gololobov
5aff9001bd
Merge pull request #49834 from ClickHouse/randomize_enable_multiple_prewhere_read_steps
...
Randomize enable_multiple_prewhere_read_steps setting
2023-05-15 12:08:49 +02:00
JackyWoo
8d1bcb5c2f
fix typo
2023-05-15 16:51:20 +08:00
Diego Nieto
52fdc49ef3
Merge branch 'master' into master
2023-05-15 10:28:31 +02:00
Amos Bird
4764259f60
Fix a bug with projections and the aggregate_functions_null_for_empty
...
setting (for query_plan_optimize_projection)
Fix a bug with projections and the aggregate_functions_null_for_empty
setting. This was already fixed in PR #42198 but got forgotten after
using query_plan_optimize_projection.
2023-05-15 14:17:16 +08:00
Alexey Milovidov
8b630f90c4
Merge pull request #49867 from ClickHouse/bitcount-big-int
...
Add support for big integers in function `bitCount`
2023-05-15 07:43:40 +03:00