thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-18 04:12:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
34,799 Commits 9,324 Branches 1,783 Tags 2.2 GiB
d1bfacae4b
Commit Graph

148 Commits

Author SHA1 Message Date
Alexey Milovidov
6b9df067d8 Merge branch 'master' into libcxx-as-submodule 2019-07-03 22:34:58 +03:00
alexey-milovidov
7ea33203d7
Merge pull request #5742 from 4ertus2/t64 
T64 full bit-transpose variant
 2019-07-03 01:56:34 +03:00
chertus
d1250e6042 fix build 2019-07-02 15:01:39 +03:00
Vasily Nemkov
c5b2ba2a25 Fixed DoubleDelta codec edge case 
Casused by mistreating negative double delta value as HUGE unsigned value, crippling compression ratio.
 2019-07-02 07:58:03 +03:00
chertus
13fa9a07e5 Merge branch 'master' into t64 2019-07-01 16:40:32 +03:00
chertus
37b7ff7a0a fix maning, add comment 2019-07-01 16:35:04 +03:00
Alexander Kuzmenkov
0116c10e41 Require explicit type in unalignedStore 
This is a follow-up to PR #5786, which fixed a segfault caused by
an unexpected deduced type for unalignedStore. To prevent future errors
of this kind, require a caller to specify the stored type explicitly.
 2019-06-28 20:33:14 +03:00
alesapin
cfd8df6568 Fix bug in delta codec caused by genious C++ implicit type conversion and consequent template type deduction 2019-06-28 13:42:36 +03:00
chertus
e681bef71d T64 full transpose variant 2019-06-25 16:59:33 +03:00
Vasily Nemkov
138087d2e1 Performance tests for Gorilla and DoubleDelta 
Testing INSERTs and SELECTs on codec combinations:
 * DoubleDelta (or Gorilla)
 * LZ4
 * DD (or G) + LZ4
On 3 types of data:
 * sequential
 * monotonic
 * random.
 2019-06-25 13:47:55 +03:00
Vasily Nemkov
e79c3d0e22 Post-PR fixes stage 3 
maskLowBits()
building for clang
more test cases for codecs.
 2019-06-19 13:38:15 +03:00
Vasily Nemkov
81f9055d81 Post-PR fixes #2 
Fixed style issues and build for clang-7;
64-bit buffer for BitReader and BitWriter;
Fixed overflow and writing more bytes on flushing;
Added maskLowBits() and tests for it.
 2019-06-17 21:49:01 +03:00
Vasily Nemkov
0ebb145d32 Post-PR fixes: 
* BitHelpers.cpp was removed, corresponding code was moved to the header
* BitIO test as GTest-based test binary
* gtest-based unit test for DoubleDelta and Gorilla codecs
* getLeadingZeroBits from SFINAE to consexpr if
* removed couple of unneeded if's
* Fixed sql-test to use one table
 2019-06-17 21:39:45 +03:00
Vasily Nemkov
dfd8ff7675 Gorilla column encoding 
Added Gorilla column encoding for any fixed-width type;
Added tests for Float32 and Float64 values.
 2019-06-17 21:39:42 +03:00
Vasily Nemkov
4ae63072d0 DoubleDelta column encoding. 
Added DoubleDelta column encoding + test cases;
Added BitWriter and BitReader that allow to read data from ReadBuffer
and write data to WriteBuffer bit by bit, up to 64 bits at once;
Added test for BitReader and BitWriter.
 2019-06-17 21:38:27 +03:00
chertus
08983b0669 T64 codec optimisation: unroll cycles 2019-06-12 16:03:51 +03:00
chertus
f9abc8194a make ubsan happy v2 2019-06-12 03:12:38 +03:00
chertus
0c0a1517fb make ubsan happy & minor perf improvement 2019-06-12 00:32:43 +03:00
chertus
3648889aed T64 codec: add test for signed & related fixes 2019-06-11 21:25:34 +03:00
chertus
10c720f059 T64 codec: fix getMaxCompressedDataSize and test 2019-06-11 17:14:45 +03:00
chertus
f099ee5680 T64 support signed types (not tested) 2019-06-10 22:14:48 +03:00
chertus
a95e0015dc fix build and tests 2019-06-07 21:11:50 +03:00
chertus
3007975199 T64 codec concept 2019-06-07 19:12:45 +03:00
Alexey Milovidov
4b604e4656 Better error message on checksum mismatch #5347 2019-05-20 23:46:52 +03:00
Alexey Milovidov
da142a5d5d Better error message on checksum mismatch #5347 2019-05-20 23:35:43 +03:00
proller
51ca4cbaa4
Build fixes (#5278) 2019-05-15 20:19:39 +03:00
Danila Kutenin
0d3ff520c6 Typos 2019-04-30 00:44:17 +03:00
Danila Kutenin
8089759205 Remove bad headers 2019-04-30 00:43:05 +03:00
Danila Kutenin
d38f4cd3a7 Almost empty 2019-04-30 00:36:53 +03:00
Danila Kutenin
436029bf64 No AVX but remain wildcopy 32 2019-04-29 22:30:14 +03:00
Danila Kutenin
f86cf7bd11 Correct cpu dispatch, nounroll for clang 2019-04-26 00:53:22 +03:00
Danila Kutenin
3501f633e4 Cosmetics 2019-04-25 21:35:58 +03:00
Danila Kutenin
5c68881b72 Really faster LZ4 now, cpu dispatch in ClickHouse 2019-04-25 21:34:32 +03:00
Danila Kutenin
71d87a49b2 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-04-25 19:19:01 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
Danila Kutenin
cabcaf673a Comments 2019-04-21 20:41:45 +03:00
Danila Kutenin
2caf3d39ff Faster LZ4 decompression because of new release 2019-04-21 20:31:15 +03:00
Danila Kutenin
e914d0d67a Just update LZ4 2019-04-20 15:47:16 +03:00
Danila Kutenin
c7731b32f1 Try safe version 2019-04-19 15:34:56 +03:00
Danila Kutenin
0d70325fb8 try decompress fast 2019-04-18 16:20:47 +03:00
Danila Kutenin
2c7fed45da try decompress fast 2019-04-18 14:37:20 +03:00
alesapin
e8079c8ecd Add empty reads to cache 2019-04-05 15:57:22 +03:00
alesapin
7e1975b0c8 Fix bug with additional seek in cache compressed buffer 2019-04-05 12:42:44 +03:00
alesapin
42a0c2f194 Fix alter modify of codec when column type is not specified 2019-04-02 15:51:31 +03:00
Alexey Milovidov
4cfcdd0f52 Removed useless method #4874 2019-04-01 23:51:32 +03:00
Alexey Milovidov
a2e756287e Whitespaces 2019-03-30 23:52:36 +03:00
Ivan Lezhankin
a3a8b2bbf7 Include IAST_fwd.h for using ASTPtr 2019-03-11 17:01:45 +03:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-11 16:11:22 +03:00
Ivan Lezhankin
a7e838e328 Replace all other casts to method IAST::As<Derived> 
Also remove some redundant methods like IsIdentifier() et. al.
 2019-03-11 15:49:39 +03:00
Alexey Milovidov
880cbbb632 Merge branch 'master' into libcxx-as-submodule 2019-03-11 04:03:13 +03:00
Alexey Milovidov
4af321728a Removed useless line 2019-03-10 18:55:22 +03:00
Alexey Milovidov
ee996c0c99 Fixed excessive whitespace #4467 2019-03-08 16:14:40 +03:00
Ivan Lezhankin
0e325c7a4a Replace const typeid_casts with As<Derived>() method invocations 2019-03-08 12:48:20 +03:00
proller
89014b5480
Build fixes (#4591) 2019-03-05 13:15:47 +03:00
proller
154ea47156 Build fixes (#4582) 
* Fix link in split mode

* clean

* Fix link validate-odbc-connection-string

* Fix includes
 2019-03-04 22:37:50 +03:00
Alexey Milovidov
ba3cb83a84 Removed duplicate includes 2019-02-10 20:12:22 +03:00
alesapin
cb0e77dce6 Fix non initialized codec and wrong size in CacheCompressedReadBuffer 2019-01-29 17:55:57 +03:00
Danila Kutenin
7f4b0f3c04 added powerpc build support 2019-01-23 17:18:19 +03:00
Alexey Milovidov
f7ecfc776b Miscellaneous #4111 2019-01-21 21:04:08 +03:00
Alexey Milovidov
78671d15bd Avoid bad code #4052 2019-01-16 03:52:33 +03:00
alesapin
e33de8133e Unaligned store of the first element 2019-01-15 23:50:57 +03:00
alesapin
361d26c643 Use information about type in Delta codec to choose correct delta size if possible 2019-01-15 17:20:34 +03:00
alesapin
37c78aa3d2 Merge branch 'master' of github.com:yandex/ClickHouse into compression_codec_delta 2019-01-15 16:24:49 +03:00
alesapin
48847441f1 Add spaces in codecs description 2019-01-15 14:06:00 +03:00
alesapin
4089700e6d Fix segfault but don't know why 2019-01-14 18:10:48 +03:00
alesapin
23a53c7e4e Add compression codec delta 2019-01-14 14:55:53 +03:00
alesapin
c8257f6d0b Add compression codec delta and fix naming for parametric codecs 2019-01-14 14:54:40 +03:00
Alexey Milovidov
19f4652959 Fixed bugs found by PVS-Studio 2019-01-09 18:44:20 +03:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
Alexey Milovidov
2fb94dabae Merge branch 'master' of github.com:yandex/ClickHouse into libcxx-as-submodule 2018-12-29 01:55:44 +03:00
proller
7dd6c4947e Fix cyclic lib depend: part 3: clean 2018-12-28 21:31:28 +03:00
proller
300bbdfb43 Fix cyclic lib depend ppart 2: clean 2018-12-28 21:15:26 +03:00
proller
0c78ef8573 Fix cyclic lib depend (make clickhouse_compression lib) 2018-12-28 20:27:53 +03:00
alesapin
89966db3ba Add multiple codecs to compressor 2018-12-26 18:01:26 +03:00
alesapin
4309775fc8 Add coments and fix compression for nested types 2018-12-25 13:04:38 +03:00
alesapin
36fb2d16cd Add test with non default config 2018-12-24 18:50:02 +03:00
alesapin
f2fd1e4da6 Fix style and includes 2018-12-24 17:10:37 +03:00
alesapin
74ea831240 Remove commented codec 2018-12-21 17:06:49 +03:00
alesapin
42b9735760 Add LZ4HC 2018-12-21 17:03:53 +03:00
alesapin
6f7333840a Move header with compression info to another place 2018-12-21 16:25:39 +03:00
alesapin
7c11455bd3 Remove compression settings 2018-12-21 15:17:30 +03:00
alesapin
aee6c0a606 Remove dump code 2018-12-20 20:37:02 +03:00
alesapin
04902c569a Non effective, but working code 2018-12-20 13:27:38 +03:00
alesapin
512fe3c854 Refactoring (sanitizer failure) 2018-12-19 20:20:18 +03:00
alesapin
9b0d47c0c3 Add zstd params validation 2018-12-18 18:00:51 +03:00
alesapin
314fbbd71f Remove some debug output 2018-12-18 17:41:58 +03:00
alesapin
60456eb742 More tests on compression codecs 2018-12-18 17:34:18 +03:00
alesapin
bb4eb06bb6 Fix strange logic 2018-12-18 16:30:22 +03:00
alesapin
fd49cc3c34 Simpliest codec multiple works 2018-12-18 16:08:22 +03:00
alesapin
436845ff7e Debuging codec multiple 2018-12-17 11:31:59 +03:00
alesapin
8a95eb9dc1 More tests for parser 2018-12-14 16:27:35 +03:00
alesapin
96da3195f5 Rewrite strange logic to another strange logic 2018-12-13 20:39:16 +03:00
alesapin
5c823d519f Remove debug 2018-12-13 19:23:06 +03:00
alesapin
d7bc4ae115 Seems like first simpliest working code 2018-12-13 19:21:08 +03:00
alesapin
a492d0f6bf Seems like working parser 2018-12-13 18:26:28 +03:00
alesapin
5c30bd2384 Compilable code 2018-12-13 13:25:11 +03:00
zhang2014
6d0c4eaf89 ISSUES-838 add lz4、none、zstd codec 2018-12-13 12:10:34 +08:00