thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-29 21:20:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
77,712 Commits 8,956 Branches 1,767 Tags 1.8 GiB
aa2da98844
Commit Graph

252 Commits

Author SHA1 Message Date
Alexey Milovidov
3cb9cf7242 Merge branch 'master' of github.com:yandex/ClickHouse into async-reads 2021-08-26 01:55:46 +03:00
Nikita Mikhaylov
f99d7d89b8 Added static assert 2021-08-25 21:11:45 +00:00
Nikita Mikhaylov
28d70dae43 Deleted printing exception message 2021-08-25 20:58:53 +00:00
Nikita Mikhaylov
923d6759c0 Fix style 2021-08-25 15:40:56 +00:00
Nikita Mikhaylov
c5ca63c606 Fix performance (probably) 2021-08-25 15:40:56 +00:00
Nikita Mikhaylov
de8aa64e56 Deleted file 2021-08-25 15:40:56 +00:00
Nikita Mikhaylov
b333e7c744 Better 2021-08-25 15:40:56 +00:00
Nikita Mikhaylov
02e097a262 Fix tests 2021-08-25 15:40:56 +00:00
Nikita Mikhaylov
43fb3098ae Deleted some unneded changes 2021-08-25 15:40:56 +00:00
Nikita Mikhaylov
3538f1520b Build fixes after merge 2021-08-25 15:40:56 +00:00
Nikita Mikhaylov
08fbab09b0 Fix some issues 2021-08-25 15:40:56 +00:00
Nikita Mikhaylov
2c09533c83 lower a binary size for compression fuzzers 2021-08-25 15:40:56 +00:00
Nikita Mikhaylov
82a0c9d4df Fix build 2021-08-25 15:40:56 +00:00
Nikita Mikhaylov
ad4966f6d2 better 2021-08-25 15:40:56 +00:00
Nikita Mikhaylov
e63da5969f First blood 2021-08-25 15:40:15 +00:00
Alexey Milovidov
4d9ad3725d Merge branch 'master' into async-reads 2021-08-25 00:45:40 +03:00
Nikita Mikhaylov
80ebc6ccea Done 2021-08-22 15:09:49 +00:00
Nikita Mikhaylov
cfa571cac4
Merge pull request #27895 from nikitamikhaylov/temporary_remove_yaml_fuzzer 
Build fuzzers with clang-tidy
 2021-08-21 16:51:31 +03:00
Nikita Mikhaylov
64821c41d9 Style 2021-08-21 13:00:15 +00:00
Nikita Mikhaylov
3cd689c168 Moved fuzzers to another directory 2021-08-21 02:27:27 +00:00
Nikita Mikhaylov
f72457fa98 Lower the size of the binaries 2021-08-21 02:20:23 +00:00
Nikita Mikhaylov
2272c9896c
Update LZ4_decompress_faster.cpp 2021-08-19 16:53:39 +03:00
Nikita Mikhaylov
1e195cbacf
Update LZ4_decompress_faster.cpp 2021-08-19 14:48:10 +03:00
Nikita Mikhaylov
60dd53784f better 2021-08-16 12:46:59 +00:00
Nikita Mikhaylov
d25d12d7d4 better 2021-08-16 12:30:02 +00:00
Alexey Milovidov
d184b79bba Progress on async reads. 2021-08-16 03:00:32 +03:00
Alexey Milovidov
0cd3f25ba4 Merge remote-tracking branch 'origin/master' into async-reads 2021-08-16 02:41:01 +03:00
Alexey Milovidov
020beb885d Merge branch 'master' into async-reads 2021-08-15 12:08:19 +03:00
alexey-milovidov
86694a2bbb
Update CompressedWriteBuffer.h 2021-08-15 12:04:38 +03:00
Alexey Milovidov
9ae92798d1 Fix stress test in ~CompressedWriteBuffer 2021-08-15 11:44:12 +03:00
Alexey Milovidov
97d921d4da Remove trash 2021-08-15 11:38:16 +03:00
Nikolai Kochetov
a1ec7f75c5 Merge branch 'master' into qoega-fix-access-gtest-in-arcadia 2021-08-10 11:31:47 +03:00
Alexey Milovidov
cea9690327 Merge branch 'master' into async-reads 2021-08-05 23:58:57 +03:00
Yatsishin Ilya
9539ef18d2 fix 2021-08-04 11:55:51 +03:00
Yatsishin Ilya
6e74728714 more sync fixes 2021-08-04 10:58:39 +03:00
Nikita Mikhaylov
6d83eacec4 typo 2021-08-03 12:27:03 +00:00
Nikita Mikhaylov
2aea1c8d4a done 2021-08-03 12:24:16 +00:00
Alexey Milovidov
2a0cba2b9f Merge branch 'master' into async-reads 2021-08-01 01:25:13 +03:00
PHO
6425dd001a
Add a codec AES_128_GCM_SIV for encrypting columns on disk (#19896) 
* Add a codec Encrypted() for encrypting columns on disk

While this is implemented as a compression codec, it does not actually compress data. It instead encrypts data on disk. The key is obtained by executing a user-specified command at the server startup, or if it's not specified the codec refuses to process any data. For now the only supported cipher is 'AES-128-GCM-SIV'.
 2021-07-30 12:12:33 +03:00
Alexey Milovidov
5c3f5cb35a Experiment with asynchronous readers 2021-07-26 03:34:36 +03:00
Alexey Milovidov
21fb6ddea5 Remove AIO for sequential reads 2021-07-05 23:02:24 +03:00
Stas Kelvich
9a84033db5
Fix typo in hardware failure error message 2021-06-22 12:48:15 +03:00
Yuriy Chernyshov
c0cb5387f4 Use zstd/include in ya.make 2021-06-09 23:02:39 +03:00
Alexey Milovidov
8d85145725 Remove experimental compression codecs 2021-06-06 02:26:52 +03:00
Alexey Milovidov
273226de32 Remove string parameter for Density 2021-05-24 06:43:25 +03:00
Alexey Milovidov
4290b48a61 Fix clang-tidy 2021-05-24 06:00:57 +03:00
Alexey Milovidov
5412242908 Fix error 2021-05-24 02:38:46 +03:00
Alexey Milovidov
70d9f5c154 Fix error 2021-05-24 02:36:50 +03:00
Alexey Milovidov
8d2fa6cf50 Allow to build without experimental compression libraries and remove from fasttest 2021-05-24 01:18:12 +03:00
Alexey Milovidov
57a3f132d7 Fix style 2021-05-24 00:48:54 +03:00
Alexey Milovidov
40d4f0678f Remove overload (harmful) 2021-05-23 04:25:06 +03:00
Alexey Milovidov
fdc5bb72f5 Minor modification 2021-05-23 04:14:29 +03:00
Alexey Milovidov
3057bbe831 Remove header files 2021-05-23 04:12:30 +03:00
Alexey Milovidov
deb68b15da Fix bad dependencies in code 2021-05-23 04:03:42 +03:00
Alexey Milovidov
77414b50e6 Remove copy-paste 2021-05-23 03:55:16 +03:00
Alexey Milovidov
1a091c7a17 Fix unbalanced whitespace 2021-05-23 03:32:22 +03:00
Alexey Milovidov
a25edc192c Fix whitespace 2021-05-23 03:31:58 +03:00
Alexey Milovidov
b0df9286f0 Fix whitespace 2021-05-23 03:30:53 +03:00
Alexey Milovidov
ecc2e98265 Fix wrong intent in exception message 2021-05-23 03:30:17 +03:00
Alexey Milovidov
4cfabd2675 Fix style, fix typo and remove extra code 2021-05-23 03:21:48 +03:00
Alexey Milovidov
0da00f6497 Fix style, fix typo and remove extra code 2021-05-23 03:18:24 +03:00
Alexey Milovidov
e330fe4bb5 Fix extra whitespace in exception messages 2021-05-23 03:15:11 +03:00
alexey-milovidov
1ed30f7246
Merge branch 'master' into issue-16775 2021-05-22 17:14:23 +03:00
alesapin
2b62ce9044 Add smoke test for local address 2021-05-18 11:35:51 +03:00
Alexey Milovidov
604daa9581 Fix a bunch of warnings from PVS-Studio 2021-05-08 19:09:17 +03:00
Alexey Milovidov
45dea86395 More fixes for PVS-Studio 2021-05-08 18:35:09 +03:00
Alexey Milovidov
47a4c101b9 Merge branch 'master' into normalize-bigint 2021-05-08 16:41:15 +03:00
mwish
9328ec9c50 [Init] initialize commit 2021-05-08 18:07:39 +08:00
fibersel
f01b53bafb add newline 2021-05-06 16:47:23 +03:00
fibersel
94b159c510 add newlines 2021-05-06 16:34:27 +03:00
fibersel
cb53bbb7b0 add experimental codecs flag, add integration test for experimental codecs 2021-05-06 14:57:22 +03:00
Alexey Milovidov
1fda866881 Merge branch 'master' into normalize-bigint 2021-05-02 21:24:45 +03:00
Maksim Kita
318c4bb80d Add examples folder filter to ya.make.in 2021-04-30 11:25:52 +03:00
Nikita Mikhaylov
9f55424250 move to examples everywhere 2021-04-27 01:51:42 +03:00
Alexey Milovidov
649550c5ab Attempt to normalize big integers 2021-04-25 12:30:43 +03:00
Alexey Milovidov
8f01af62d9 Merge branch 'master' into normalize-bigint 2021-04-25 06:57:44 +03:00
Anton Popov
ea82e7725f
Merge pull request #21562 from CurtizJ/serialization-refactoring-4 
Refactoring of data types serialization
 2021-03-29 16:36:44 +03:00
alexey-milovidov
7ab2890c4d
Merge pull request #22206 from ClickHouse/mmap-cache 
Add cache for mmap IO
 2021-03-29 05:17:55 +03:00
Maksim Kita
459d00f999 Fixed tests 2021-03-28 22:42:34 +03:00
Alexey Milovidov
2a8ac01cdb Rename as suggested by Kita 2021-03-28 22:24:28 +03:00
Maksim Kita
608d37deed CachedCompressedReadBuffer fix cache usage 2021-03-28 21:32:38 +03:00
Alexey Milovidov
50f712e198 Integrate mmap cache to the infrastructure 2021-03-28 04:10:30 +03:00
Alexey Milovidov
0e3571478d Code review changes 2021-03-27 02:42:22 +03:00
Alexey Milovidov
e55f7e6333 Fix error 2021-03-26 02:21:59 +03:00
Alexey Milovidov
ad66c4a916 Fix error 2021-03-26 01:56:24 +03:00
Alexey Milovidov
a8ce138788 Speedup codec NONE 2021-03-25 23:08:47 +03:00
Anton Popov
6a15431be7 Merge remote-tracking branch 'upstream/master' into HEAD 2021-03-25 15:57:35 +03:00
Alexey Milovidov
9ca0566132 Minor modification 2021-03-17 02:08:33 +03:00
Anton Popov
ed42437219 Merge remote-tracking branch 'upstream/master' into HEAD 2021-03-13 01:41:26 +03:00
Yatsishin Ilya
7b69ef92be gcc old cast check failed 2021-03-10 18:04:34 +03:00
Anton Popov
bc417cf54a refactoring of serializations 2021-03-09 17:46:52 +03:00
Yatsishin Ilya
71d745b4ec implicit const conversion 2021-03-09 17:31:54 +03:00
Azat Khuzhin
98e3a99a88 Do not catch exceptions during final flush in writers destructors 
Since this hides real problems, since destructor does final flush and if
it fails, then data will be lost.

One of such examples if MEMORY_LIMIT_EXCEEDED exception, so lock
exceptions from destructors, by using
MemoryTracker::LockExceptionInThread to block these exception, and allow
others (so std::terminate will be called, since this is c++11 with
noexcept for destructors by default).

Here is an example, that leads to empty block in the distributed batch:

    2021.01.21 12:43:18.619739 [ 46468 ] {7bd60d75-ebcb-45d2-874d-260df9a4ddac} <Error> virtual DB::CompressedWriteBuffer::~CompressedWriteBuffer(): Code: 241, e.displayText() = DB::Exception: Memory limit (for user) exceeded: would use 332.07 GiB (attempt to allocate chunk of 4355342 bytes), maximum: 256.00 GiB, Stack trace (when copying this message, always include the lines below):

    0. DB::Exception::Exception<>() @ 0x86f7b88 in /usr/bin/clickhouse
    ...
    4. void DB::PODArrayBase<>::resize<>(unsigned long) @ 0xe9e878d in /usr/bin/clickhouse
    5. DB::CompressedWriteBuffer::nextImpl() @ 0xe9f0296 in /usr/bin/clickhouse
    6. DB::CompressedWriteBuffer::~CompressedWriteBuffer() @ 0xe9f0415 in /usr/bin/clickhouse
    7. DB::DistributedBlockOutputStream::writeToShard() @ 0xf6bed4a in /usr/bin/clickhouse
 2021-02-05 01:31:45 +03:00
Alexey Milovidov
093108bf81 Normalize BigInt implementation 2021-01-27 03:54:57 +03:00
Alexey Milovidov
5f13fdddc0 Remove useless code from BigInt 2021-01-26 21:22:40 +03:00
Alexey Milovidov
cc11e7c2f2 Whitespace 2021-01-25 00:23:06 +03:00
alexey-milovidov
ca825f36f1
Merge pull request #18853 from azat/dist-send-checksums 
Improve checksum checks for async INSERT into Distributed on the sender
 2021-01-15 17:12:54 +03:00
ygrek
8f2a830d83
add zstd long range option (#17184) 
* add zstd long compression option

* tests: add zstd long read-write test

Co-authored-by: Joris Giovannangeli <joris.giovannangeli@ahrefs.com>
Co-authored-by: ip <igor@ahrefs.com>
 2021-01-13 16:22:59 +03:00
Azat Khuzhin
946a126799 Add CheckingCompressedReadBuffer 
Buffer for reading from a compressed file with just checking checksums
of the compressed blocks, without any decompression, so result can be
proxied.
 2021-01-10 21:23:42 +03:00
alexey-milovidov
6be8338584
Update CompressedReadBufferBase.cpp 2021-01-08 22:41:24 +03:00