alexey-milovidov
5215d13437
Merge pull request #5998 from Enmk/double_delta_fix_2
...
Fixed DoubleDelta encoding cases for random Int32 and Int64.
2019-07-16 00:54:22 +03:00
alexey-milovidov
ea54cdbede
Update CompressionCodecDoubleDelta.cpp
2019-07-16 00:53:23 +03:00
Vasily Nemkov
0f4075478e
Fixed DoubleDelta encoding cases for random Int32 and Int64.
2019-07-15 08:17:14 +03:00
Alexey Milovidov
499d798b34
Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType)
2019-07-10 00:37:43 +03:00
Alexey Milovidov
8778b9a1f3
"clickhouse_compression" library is dependent on "typeinfo for DB::IDataType" (at least when building with ubsan)
2019-07-09 04:09:42 +03:00
Alexey Milovidov
52bb292327
Merge branch 'master' into libcxx-as-submodule
2019-07-09 01:58:09 +03:00
Alexey Milovidov
ac20c515ab
Better code in unit tests
2019-07-08 04:58:31 +03:00
Alexey Milovidov
6b9df067d8
Merge branch 'master' into libcxx-as-submodule
2019-07-03 22:34:58 +03:00
alexey-milovidov
7ea33203d7
Merge pull request #5742 from 4ertus2/t64
...
T64 full bit-transpose variant
2019-07-03 01:56:34 +03:00
chertus
d1250e6042
fix build
2019-07-02 15:01:39 +03:00
Vasily Nemkov
c5b2ba2a25
Fixed DoubleDelta codec edge case
...
Casused by mistreating negative double delta value as HUGE unsigned value, crippling compression ratio.
2019-07-02 07:58:03 +03:00
chertus
13fa9a07e5
Merge branch 'master' into t64
2019-07-01 16:40:32 +03:00
chertus
37b7ff7a0a
fix maning, add comment
2019-07-01 16:35:04 +03:00
Alexander Kuzmenkov
0116c10e41
Require explicit type in unalignedStore
...
This is a follow-up to PR #5786 , which fixed a segfault caused by
an unexpected deduced type for unalignedStore. To prevent future errors
of this kind, require a caller to specify the stored type explicitly.
2019-06-28 20:33:14 +03:00
alesapin
cfd8df6568
Fix bug in delta codec caused by genious C++ implicit type conversion and consequent template type deduction
2019-06-28 13:42:36 +03:00
chertus
e681bef71d
T64 full transpose variant
2019-06-25 16:59:33 +03:00
Vasily Nemkov
138087d2e1
Performance tests for Gorilla and DoubleDelta
...
Testing INSERTs and SELECTs on codec combinations:
* DoubleDelta (or Gorilla)
* LZ4
* DD (or G) + LZ4
On 3 types of data:
* sequential
* monotonic
* random.
2019-06-25 13:47:55 +03:00
Vasily Nemkov
e79c3d0e22
Post-PR fixes stage 3
...
maskLowBits()
building for clang
more test cases for codecs.
2019-06-19 13:38:15 +03:00
Vasily Nemkov
81f9055d81
Post-PR fixes #2
...
Fixed style issues and build for clang-7;
64-bit buffer for BitReader and BitWriter;
Fixed overflow and writing more bytes on flushing;
Added maskLowBits() and tests for it.
2019-06-17 21:49:01 +03:00
Vasily Nemkov
0ebb145d32
Post-PR fixes:
...
* BitHelpers.cpp was removed, corresponding code was moved to the header
* BitIO test as GTest-based test binary
* gtest-based unit test for DoubleDelta and Gorilla codecs
* getLeadingZeroBits from SFINAE to consexpr if
* removed couple of unneeded if's
* Fixed sql-test to use one table
2019-06-17 21:39:45 +03:00
Vasily Nemkov
dfd8ff7675
Gorilla column encoding
...
Added Gorilla column encoding for any fixed-width type;
Added tests for Float32 and Float64 values.
2019-06-17 21:39:42 +03:00
Vasily Nemkov
4ae63072d0
DoubleDelta column encoding.
...
Added DoubleDelta column encoding + test cases;
Added BitWriter and BitReader that allow to read data from ReadBuffer
and write data to WriteBuffer bit by bit, up to 64 bits at once;
Added test for BitReader and BitWriter.
2019-06-17 21:38:27 +03:00
chertus
08983b0669
T64 codec optimisation: unroll cycles
2019-06-12 16:03:51 +03:00
chertus
f9abc8194a
make ubsan happy v2
2019-06-12 03:12:38 +03:00
chertus
0c0a1517fb
make ubsan happy & minor perf improvement
2019-06-12 00:32:43 +03:00
chertus
3648889aed
T64 codec: add test for signed & related fixes
2019-06-11 21:25:34 +03:00
chertus
10c720f059
T64 codec: fix getMaxCompressedDataSize and test
2019-06-11 17:14:45 +03:00
chertus
f099ee5680
T64 support signed types (not tested)
2019-06-10 22:14:48 +03:00
chertus
a95e0015dc
fix build and tests
2019-06-07 21:11:50 +03:00
chertus
3007975199
T64 codec concept
2019-06-07 19:12:45 +03:00
Alexey Milovidov
4b604e4656
Better error message on checksum mismatch #5347
2019-05-20 23:46:52 +03:00
Alexey Milovidov
da142a5d5d
Better error message on checksum mismatch #5347
2019-05-20 23:35:43 +03:00
proller
51ca4cbaa4
Build fixes ( #5278 )
2019-05-15 20:19:39 +03:00
Danila Kutenin
0d3ff520c6
Typos
2019-04-30 00:44:17 +03:00
Danila Kutenin
8089759205
Remove bad headers
2019-04-30 00:43:05 +03:00
Danila Kutenin
d38f4cd3a7
Almost empty
2019-04-30 00:36:53 +03:00
Danila Kutenin
436029bf64
No AVX but remain wildcopy 32
2019-04-29 22:30:14 +03:00
Danila Kutenin
f86cf7bd11
Correct cpu dispatch, nounroll for clang
2019-04-26 00:53:22 +03:00
Danila Kutenin
3501f633e4
Cosmetics
2019-04-25 21:35:58 +03:00
Danila Kutenin
5c68881b72
Really faster LZ4 now, cpu dispatch in ClickHouse
2019-04-25 21:34:32 +03:00
Danila Kutenin
71d87a49b2
Merge branch 'master' of https://github.com/yandex/ClickHouse
2019-04-25 19:19:01 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) ( #5091 )
2019-04-24 12:06:28 +03:00
Danila Kutenin
cabcaf673a
Comments
2019-04-21 20:41:45 +03:00
Danila Kutenin
2caf3d39ff
Faster LZ4 decompression because of new release
2019-04-21 20:31:15 +03:00
Danila Kutenin
e914d0d67a
Just update LZ4
2019-04-20 15:47:16 +03:00
Danila Kutenin
c7731b32f1
Try safe version
2019-04-19 15:34:56 +03:00
Danila Kutenin
0d70325fb8
try decompress fast
2019-04-18 16:20:47 +03:00
Danila Kutenin
2c7fed45da
try decompress fast
2019-04-18 14:37:20 +03:00
alesapin
e8079c8ecd
Add empty reads to cache
2019-04-05 15:57:22 +03:00
alesapin
7e1975b0c8
Fix bug with additional seek in cache compressed buffer
2019-04-05 12:42:44 +03:00
