alexey-milovidov
99392b5ca7
Merge pull request #13544 from amosbird/mdha
...
Multi-Disk auto-recovery.
2022-02-01 06:13:26 +03:00
alexey-milovidov
095d9bfa43
Revert "Add pool to WriteBufferFromS3"
2022-02-01 05:49:40 +03:00
Amos Bird
ec7d367814
DiskLocal checker
...
Add DiskLocal checker so that ReplicatedMergeTree can recover data when some of its disks are broken.
2022-02-01 05:55:27 +08:00
Nikolai Kochetov
efaed154d2
Update src/Disks/IDisk.h
...
Co-authored-by: alesapin <alesapin@clickhouse.com>
2022-01-26 14:58:38 +03:00
Nikolai Kochetov
4afa75e80b
Fix deduplication.
2022-01-24 14:43:36 +00:00
Nikolai Kochetov
b3cbb63487
Merge branch 'master' into add-pool-to-s3-write-buffer
2022-01-21 21:41:54 +03:00
Nikolai Kochetov
843983ea06
Add batch removing to IDiskl.
2022-01-12 15:58:04 +00:00
mergify[bot]
6fcd5a7d41
Merge branch 'master' into MDB-15474
2022-01-07 10:12:25 +00:00
Azat Khuzhin
71a99ab27c
Accept real file size in createReadBufferFromFileBase()
...
Right now streams relies on correct file size not the number of bytes
that will be read from the stream, to overcome one bug in the linux
kernel that may return EIINVAL for pread() with offset pass the EOF.
v2: Swap read_hint and file_size (since it is easy to miss something)
Before the first argument to readFile()/createReadBufferFromFileBase()
was read_hint, not the file_size, and let's preserve the order, since
it is easy to miss something
This will also fix 02051_read_settings test automatically because now
MergeTreeReaderStream will pass estimated_sum_mark_range_bytes to
read_hint not file_size, previously it cause on of the following errors:
- Attempt to read after EOF w/ O_DIRECT
- and LOGICAL_ERROR while adjusting granulas w/o O_DIRECT
This will also improve zero-length reads guard (via
ReadBufferFromEmptyFile), that had been added in #30190
v3: fix for other storages that wasn't enabled in fast-test
v4: ignore ENOENT/ENOTSUP in readFile
2022-01-04 10:53:17 +03:00
Anton Ivashkin
2d87f0a0e3
Fix debug build
2021-12-28 11:45:38 +03:00
Anton Ivashkin
f0b9a4327a
Use table UUID in zero-copy shared label in ZooKeeper
2021-12-20 16:19:00 +03:00
Anton Ivashkin
0e685c1aba
Fix types
2021-12-01 19:11:17 +03:00
Anton Ivashkin
0f9038ebed
Zero-copy: move shared mark outside table node in ZooKeeper
2021-11-29 19:05:31 +03:00
Azat Khuzhin
baf14444e6
Cleanup ProfileEvents and CurrentMetrics
2021-11-10 21:15:27 +03:00
Azat Khuzhin
2b96433daf
Replace estimated_size with optional<size> for IDisk::readFile()
...
v2: rebase to fix conflicts in DiskEncrypted.cpp
2021-10-24 18:58:11 +03:00
Alexey Milovidov
fe6b7c77c7
Rename "common" to "base"
2021-10-02 10:13:14 +03:00
Alexey Milovidov
ca6f6306f3
Merge branch 'master' into async-reads
2021-08-31 02:52:58 +03:00
Alexey Milovidov
183891eb0a
Add IDisk::isRemote method
2021-08-25 02:27:20 +03:00
Alexey Milovidov
7c1d0a3baf
Progress on development
2021-08-25 01:24:47 +03:00
kssenii
5307d31924
Throw for alter and silence for drop
2021-08-23 23:48:53 +00:00
Alexey Milovidov
d184b79bba
Progress on async reads.
2021-08-16 03:00:32 +03:00
kssenii
b25dfdd6af
Use method which was added for s3 instead
2021-08-02 08:15:21 +00:00
Kseniia Sumarokova
322870acd2
Update IDisk.h
2021-08-02 09:36:44 +03:00
kssenii
f1e96dbc55
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into taiyang-li-disk-reload
2021-07-29 07:53:16 +00:00
Vitaly Baranov
958494b98e
Merge pull request #26377 from vitlibar/encrypted-disk-comments-and-improvements
...
Add comments for encrypted disks; some improvements in code.
2021-07-16 21:24:51 +03:00
Vitaly Baranov
9cc258327e
Add comments for encrypted disks; some improvements in code.
2021-07-16 12:04:25 +03:00
Zhichang Yu
fe5d17680e
Merge remote-tracking branch 'origin/master' into zero_copy_hdfs
2021-07-14 02:12:28 +00:00
Vitaly Baranov
e086e5e384
Merge branch 'master' into alexelex-encryption-1
2021-07-13 11:28:41 +03:00
Zhichang Yu
5047c758f4
fix per review
2021-07-13 07:20:20 +00:00
Zhichang Yu
fbd5eee8a1
hdfs zero copy
2021-07-13 07:19:12 +00:00
Alexey Milovidov
21fb6ddea5
Remove AIO for sequential reads
2021-07-05 23:02:24 +03:00
Latysheva Alexandra
48d3419160
Merge branch 'master' into alexelex-encryption-1
2021-06-18 11:28:08 +06:00
Latysheva Alexandra
1a2cbe9275
Merge branch 'master' into alexelex-encryption-1
2021-06-07 21:18:54 +06:00
Nikolai Kochetov
dbaa6ffc62
Rename ContextConstPtr to ContextPtr.
2021-06-01 15:20:52 +03:00
kssenii
f9088b98de
Some disks update
2021-05-27 00:02:24 +03:00
kssenii
b28157a0df
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-27 00:01:25 +03:00
kssenii
018d52d71f
Directory path
2021-05-15 09:20:26 +03:00
Alexandra
730b9792bc
add parameters DiskEncrypted IDisk::applyNewSettings usage
2021-05-14 21:48:34 +00:00
kssenii
db849eb3e5
Remaining poco
2021-05-14 11:02:17 +03:00
kssenii
b123ec1354
Poco::FileException, Poco::parentPath
2021-05-14 00:20:28 +03:00
kssenii
850b6f02cb
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk
2021-05-11 14:22:30 +00:00
kssenii
9ec92ec514
Fix tests, less manual concatination of paths
2021-05-05 18:39:30 +03:00
kssenii
ee06936596
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-01 17:24:31 +03:00
kssenii
6867ea2c73
Temporary fix
2021-04-30 19:14:04 +03:00
kssenii
c609119daf
Update Disks/*
2021-04-30 18:13:19 +03:00
Pavel Kovalenko
0050dbb75b
Apply disk settings on config reload.
2021-04-29 23:32:19 +03:00
Pavel Kovalenko
63e5f5d3ab
DiskS3 and WriteBufferFromFileDecorator small refactoring.
2021-04-27 11:37:59 +03:00
Pavel Kovalenko
98f8cbbdb2
DiskRestartProxy refactoring.
2021-04-20 21:58:34 +03:00
kssenii
a07d44e438
More common
2021-04-20 11:41:32 +00:00
kssenii
b37fb73468
Continued
2021-04-19 08:14:48 +00:00
