thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-02 12:32:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
33,475 Commits 9,194 Branches 1,782 Tags 2.2 GiB
8b2938a8fb
Commit Graph

138 Commits

Author SHA1 Message Date
alexey-milovidov
8a4c949295
Merge pull request #8019 from Enmk/gorilla_and_doubledelta_performance 
Gorilla and doubledelta performance
 2020-01-06 12:03:26 +03:00
Vasily Nemkov
08059ac640 Detailed docs with examples on DoubleDelta and Gorilla codecs 2020-01-05 12:33:13 +03:00
alexey-milovidov
42226b1a96
Added setting "min_bytes_to_use_mmap_io" (#8520) 
* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io": better error message

* Added setting "min_bytes_to_use_mmap_io": fixed error
 2020-01-04 08:46:50 +03:00
alexey-milovidov
7183c3a7b0
Update CompressionCodecDoubleDelta.cpp 2019-12-26 19:25:19 +03:00
alexey-milovidov
f7e87f18a4
Update CompressionCodecDoubleDelta.cpp 2019-12-26 19:24:07 +03:00
Vasily Nemkov
d480cfba7e DD decoding: LUT for write spec when reading from BinReader 2019-12-26 06:56:11 +03:00
Alexey Milovidov
7833ee3973 One more check 2019-12-26 06:07:38 +03:00
Alexey Milovidov
5da506b67a Fixed error in compression codecs. 2019-12-19 22:23:49 +03:00
Alexey Milovidov
6d58d85579 Fixed warnings 2019-12-18 08:12:03 +03:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
Vasily Nemkov
5b1a3b24e5 Disabled codec performance tests 
Since those significantly delay unit test execution by generating huge
amount of data used only for performance tests.
Also it makes little sense running those on CI.
 2019-12-05 17:21:26 +03:00
Vasily Nemkov
ae5a4f15d0 Fixed style and compilation error on GCC9 2019-12-05 16:49:56 +03:00
Vasily Nemkov
b49e3eae86 Performance improvement for Gorilla and DoubleDelta: through BitReader and BitWriter 
BitWriter and BitReader are now operating on memory directly rather than via Read/Write buffers.
 2019-12-03 14:45:26 +03:00
Vasily Nemkov
b29ed823ed Performance improvement for DoubleDelta: 
* inlined getDeltaWriteSpec
 * got rid of std::singbit()
 2019-12-03 14:45:26 +03:00
Vasily Nemkov
48abeb6b7c DoubleDelta and Gorilla compatibility and performance test 
To ensure that any future modifications are backward-compatitable with
data stored by clients
 2019-11-29 16:27:25 +03:00
Amos Bird
ad12099642
ubsan fix 2019-11-02 17:00:03 +08:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
Alexander Kuzmenkov
ec2d9a083c Remove excessive includes. 2019-09-30 15:31:14 +03:00
alexey-milovidov
3270ad439a
Update compressed_buffer_fuzz.cpp 2019-09-23 00:18:14 +03:00
alexey-milovidov
8fd66ac4fd
Update compressed_buffer_fuzz.cpp 2019-09-22 15:52:33 +03:00
Eldar Zaitov
b174833bdf Initial fuzzing support with libfuzzer 2019-09-22 13:34:09 +03:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library 
Now the linking time of incremental builds are around 1-2 seconds
 2019-09-11 01:56:01 +08:00
chertus
12084270de fix build 2019-08-26 19:58:40 +03:00
chertus
d17a64c28d fix vulnerabilities 2019-08-26 17:39:49 +03:00
proller
d09c5c871b Build fixes (#6491) 
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
 2019-08-18 01:53:46 +03:00
Alexey Milovidov
c96fa2c080 Fixed build 2019-08-13 01:53:19 +03:00
Alexey Milovidov
6ebd002926 Fixed build 2019-08-13 01:19:20 +03:00
Vasily Nemkov
95a38b9e19 Fixed builds on GCC-9 and Clang-8 2019-08-12 22:43:03 +03:00
Vasily Nemkov
923c6889e8 Fixed Gorilla encoding error on small sequences. 
Added test cases for small sequences;
Refurbished test cases for codecs;
 2019-08-12 07:59:20 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Alexey Milovidov
98ea652ad6 Whitespaces 2019-08-09 18:30:39 +03:00
proller
77bd2624ea Build fixes (#6016) 
* Fix building without submodules

* Fix more gcc9 warnings

* was wrong!
../dbms/src/IO/WriteBufferAIO.cpp:277:54: error: result of comparison 'ssize_t' (aka 'long') > 9223372036854775807 is always false [-Werror,-Wtautological-type-limit-compare]
    if ((static_cast<ssize_t>(flush_buffer.offset()) > std::numeric_limits<off_t>::max()) ||
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

* mimalloc off MI_OVERRIDE

* Fix freebsd build

* Fix shared build

* Fix build in gcc9

* Fix split build

* fix

* fix

* fix

* fix

* clean

* zstd

* Update CMakeLists.txt

* Update Defines.h

* Try fix -Wsign-compare

* Freebsd fix

* Add missing libs

* Fix double-conversion include for copy-headers

* Fix zlib link

* Fix includes for arcadia

* Fix includes for arcadia

* Fix includes for arcadia

* Freebsd fix

* Arcadia fixes

* Update QueryProfiler.cpp

* Freebsd fix

* clean

* 19.11: Fixes for arcadia porting (#6223)

* fix glibc-compatibility

* M_LIBRARY fix

* wip

* Fix

* Fix arm build

* unwind fix

* Update CMakeLists.txt
 2019-08-04 03:19:03 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
alexey-milovidov
5215d13437
Merge pull request #5998 from Enmk/double_delta_fix_2 
Fixed DoubleDelta encoding cases for random Int32 and Int64.
 2019-07-16 00:54:22 +03:00
alexey-milovidov
ea54cdbede
Update CompressionCodecDoubleDelta.cpp 2019-07-16 00:53:23 +03:00
Vasily Nemkov
0f4075478e Fixed DoubleDelta encoding cases for random Int32 and Int64. 2019-07-15 08:17:14 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
Alexey Milovidov
8778b9a1f3 "clickhouse_compression" library is dependent on "typeinfo for DB::IDataType" (at least when building with ubsan) 2019-07-09 04:09:42 +03:00
Alexey Milovidov
52bb292327 Merge branch 'master' into libcxx-as-submodule 2019-07-09 01:58:09 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
6b9df067d8 Merge branch 'master' into libcxx-as-submodule 2019-07-03 22:34:58 +03:00
alexey-milovidov
7ea33203d7
Merge pull request #5742 from 4ertus2/t64 
T64 full bit-transpose variant
 2019-07-03 01:56:34 +03:00
chertus
d1250e6042 fix build 2019-07-02 15:01:39 +03:00
Vasily Nemkov
c5b2ba2a25 Fixed DoubleDelta codec edge case 
Casused by mistreating negative double delta value as HUGE unsigned value, crippling compression ratio.
 2019-07-02 07:58:03 +03:00
chertus
13fa9a07e5 Merge branch 'master' into t64 2019-07-01 16:40:32 +03:00
chertus
37b7ff7a0a fix maning, add comment 2019-07-01 16:35:04 +03:00
Alexander Kuzmenkov
0116c10e41 Require explicit type in unalignedStore 
This is a follow-up to PR #5786, which fixed a segfault caused by
an unexpected deduced type for unalignedStore. To prevent future errors
of this kind, require a caller to specify the stored type explicitly.
 2019-06-28 20:33:14 +03:00
alesapin
cfd8df6568 Fix bug in delta codec caused by genious C++ implicit type conversion and consequent template type deduction 2019-06-28 13:42:36 +03:00
chertus
e681bef71d T64 full transpose variant 2019-06-25 16:59:33 +03:00
Vasily Nemkov
138087d2e1 Performance tests for Gorilla and DoubleDelta 
Testing INSERTs and SELECTs on codec combinations:
 * DoubleDelta (or Gorilla)
 * LZ4
 * DD (or G) + LZ4
On 3 types of data:
 * sequential
 * monotonic
 * random.
 2019-06-25 13:47:55 +03:00