Commit Graph

148 Commits

Author SHA1 Message Date
Pavel Kovalenko
07755ec8f7 Merge branch 'master' into idisk-seekable-readbuffer
# Conflicts:
#	dbms/programs/server/config.xml
2020-01-27 21:45:53 +03:00
Pavel Kovalenko
abfacdaadc SeekableReadBuffer refactoring.
Store size and multiple references for S3 metadata file.
Log engine support for S3.
2020-01-27 21:44:30 +03:00
Alexey Milovidov
5d52261266 Remove useless files 2020-01-26 18:25:58 +03:00
Pradeep Chhetri
4941fdfe4b Fix some spelling mistakes 2020-01-11 17:51:33 +08:00
Alexander Burmak
57517b4ede Replaced deprecated INSTANTIATE_TEST_CASE_P with INSTANTIATE_TEST_SUITE_P 2020-01-10 11:48:24 +03:00
Alexander Burmak
0135835855 Additional release build fix 2020-01-10 10:03:34 +03:00
Alexander Burmak
d23f967148 Fixed release build - v2 2020-01-09 17:18:00 +03:00
Alexander Burmak
6d3828b8f2 Revert "Fixed release build"
This reverts commit 84bc2bd104.
2020-01-09 17:08:31 +03:00
Alexander Burmak
84bc2bd104 Fixed release build 2020-01-09 15:21:49 +03:00
Alexander Burmak
4a9e2399a7 Updated contrib/googletest to v1.10.0 2020-01-09 13:03:24 +03:00
alexey-milovidov
8a4c949295
Merge pull request #8019 from Enmk/gorilla_and_doubledelta_performance
Gorilla and doubledelta performance
2020-01-06 12:03:26 +03:00
Vasily Nemkov
08059ac640 Detailed docs with examples on DoubleDelta and Gorilla codecs 2020-01-05 12:33:13 +03:00
alexey-milovidov
42226b1a96
Added setting "min_bytes_to_use_mmap_io" (#8520)
* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io": better error message

* Added setting "min_bytes_to_use_mmap_io": fixed error
2020-01-04 08:46:50 +03:00
alexey-milovidov
7183c3a7b0
Update CompressionCodecDoubleDelta.cpp 2019-12-26 19:25:19 +03:00
alexey-milovidov
f7e87f18a4
Update CompressionCodecDoubleDelta.cpp 2019-12-26 19:24:07 +03:00
Vasily Nemkov
d480cfba7e DD decoding: LUT for write spec when reading from BinReader 2019-12-26 06:56:11 +03:00
Alexey Milovidov
7833ee3973 One more check 2019-12-26 06:07:38 +03:00
Alexey Milovidov
5da506b67a Fixed error in compression codecs. 2019-12-19 22:23:49 +03:00
Alexey Milovidov
6d58d85579 Fixed warnings 2019-12-18 08:12:03 +03:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
Vasily Nemkov
5b1a3b24e5 Disabled codec performance tests
Since those significantly delay unit test execution by generating huge
amount of data used only for performance tests.
Also it makes little sense running those on CI.
2019-12-05 17:21:26 +03:00
Vasily Nemkov
ae5a4f15d0 Fixed style and compilation error on GCC9 2019-12-05 16:49:56 +03:00
Vasily Nemkov
b49e3eae86 Performance improvement for Gorilla and DoubleDelta: through BitReader and BitWriter
BitWriter and BitReader are now operating on memory directly rather than via Read/Write buffers.
2019-12-03 14:45:26 +03:00
Vasily Nemkov
b29ed823ed Performance improvement for DoubleDelta:
* inlined getDeltaWriteSpec
 * got rid of std::singbit()
2019-12-03 14:45:26 +03:00
Vasily Nemkov
48abeb6b7c DoubleDelta and Gorilla compatibility and performance test
To ensure that any future modifications are backward-compatitable with
data stored by clients
2019-11-29 16:27:25 +03:00
Amos Bird
ad12099642
ubsan fix 2019-11-02 17:00:03 +08:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
Alexander Kuzmenkov
ec2d9a083c Remove excessive includes. 2019-09-30 15:31:14 +03:00
alexey-milovidov
3270ad439a
Update compressed_buffer_fuzz.cpp 2019-09-23 00:18:14 +03:00
alexey-milovidov
8fd66ac4fd
Update compressed_buffer_fuzz.cpp 2019-09-22 15:52:33 +03:00
Eldar Zaitov
b174833bdf Initial fuzzing support with libfuzzer 2019-09-22 13:34:09 +03:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library
Now the linking time of incremental builds are around 1-2 seconds
2019-09-11 01:56:01 +08:00
chertus
12084270de fix build 2019-08-26 19:58:40 +03:00
chertus
d17a64c28d fix vulnerabilities 2019-08-26 17:39:49 +03:00
proller
d09c5c871b Build fixes (#6491)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
Alexey Milovidov
c96fa2c080 Fixed build 2019-08-13 01:53:19 +03:00
Alexey Milovidov
6ebd002926 Fixed build 2019-08-13 01:19:20 +03:00
Vasily Nemkov
95a38b9e19 Fixed builds on GCC-9 and Clang-8 2019-08-12 22:43:03 +03:00
Vasily Nemkov
923c6889e8 Fixed Gorilla encoding error on small sequences.
Added test cases for small sequences;
Refurbished test cases for codecs;
2019-08-12 07:59:20 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Alexey Milovidov
98ea652ad6 Whitespaces 2019-08-09 18:30:39 +03:00
proller
77bd2624ea Build fixes (#6016)
* Fix building without submodules

* Fix more gcc9 warnings

* was wrong!
../dbms/src/IO/WriteBufferAIO.cpp:277:54: error: result of comparison 'ssize_t' (aka 'long') > 9223372036854775807 is always false [-Werror,-Wtautological-type-limit-compare]
    if ((static_cast<ssize_t>(flush_buffer.offset()) > std::numeric_limits<off_t>::max()) ||
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

* mimalloc off MI_OVERRIDE

* Fix freebsd build

* Fix shared build

* Fix build in gcc9

* Fix split build

* fix

* fix

* fix

* fix

* clean

* zstd

* Update CMakeLists.txt

* Update Defines.h

* Try fix -Wsign-compare

* Freebsd fix

* Add missing libs

* Fix double-conversion include for copy-headers

* Fix zlib link

* Fix includes for arcadia

* Fix includes for arcadia

* Fix includes for arcadia

* Freebsd fix

* Arcadia fixes

* Update QueryProfiler.cpp

* Freebsd fix

* clean

* 19.11: Fixes for arcadia porting (#6223)

* fix glibc-compatibility

* M_LIBRARY fix

* wip

* Fix

* Fix arm build

* unwind fix

* Update CMakeLists.txt
2019-08-04 03:19:03 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
alexey-milovidov
5215d13437
Merge pull request #5998 from Enmk/double_delta_fix_2
Fixed DoubleDelta encoding cases for random Int32 and Int64.
2019-07-16 00:54:22 +03:00
alexey-milovidov
ea54cdbede
Update CompressionCodecDoubleDelta.cpp 2019-07-16 00:53:23 +03:00
Vasily Nemkov
0f4075478e Fixed DoubleDelta encoding cases for random Int32 and Int64. 2019-07-15 08:17:14 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
Alexey Milovidov
8778b9a1f3 "clickhouse_compression" library is dependent on "typeinfo for DB::IDataType" (at least when building with ubsan) 2019-07-09 04:09:42 +03:00
Alexey Milovidov
52bb292327 Merge branch 'master' into libcxx-as-submodule 2019-07-09 01:58:09 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00