thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-14 02:12:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,842 Commits 9,330 Branches 1,783 Tags 2.1 GiB
055f21c9b7
Commit Graph

1022 Commits

Author SHA1 Message Date
stavrolia
6055c61e7f wip hdfs 2019-08-19 21:12:50 +03:00
alexey-milovidov
f36d20915b
Merge pull request #6529 from yandex/better-signals 
Better debug-ability of fault signals.
 2019-08-18 16:44:54 +03:00
proller
d09c5c871b Build fixes (#6491) 
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
 2019-08-18 01:53:46 +03:00
Alexey Milovidov
2cd669fa1d Minor improvement 2019-08-17 23:33:50 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
Alexey Milovidov
40a3f77917 Removed duplicate include 2019-08-08 19:01:42 +03:00
alexey-milovidov
99fad0904b
Merge pull request #6314 from infinivision/add_bitmapRange 
added bitmapRange function
 2019-08-08 04:51:48 +03:00
alexey-milovidov
355b1e5594
Merge pull request #6352 from yandex/no_space_left_on_device_message 
Print extra info in exception message for "no space left on device"
 2019-08-07 22:28:38 +03:00
Alexander Tokmakov
5cf183cbe3 fixes after review 2019-08-07 15:55:27 +03:00
Alexander Tokmakov
aefc664819 refactor throwFromErrno 2019-08-06 21:54:06 +03:00
Nikolai Kochetov
599f3ddf6e Merged with master. 2019-08-04 15:35:21 +03:00
proller
77bd2624ea Build fixes (#6016) 
* Fix building without submodules

* Fix more gcc9 warnings

* was wrong!
../dbms/src/IO/WriteBufferAIO.cpp:277:54: error: result of comparison 'ssize_t' (aka 'long') > 9223372036854775807 is always false [-Werror,-Wtautological-type-limit-compare]
    if ((static_cast<ssize_t>(flush_buffer.offset()) > std::numeric_limits<off_t>::max()) ||
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

* mimalloc off MI_OVERRIDE

* Fix freebsd build

* Fix shared build

* Fix build in gcc9

* Fix split build

* fix

* fix

* fix

* fix

* clean

* zstd

* Update CMakeLists.txt

* Update Defines.h

* Try fix -Wsign-compare

* Freebsd fix

* Add missing libs

* Fix double-conversion include for copy-headers

* Fix zlib link

* Fix includes for arcadia

* Fix includes for arcadia

* Fix includes for arcadia

* Freebsd fix

* Arcadia fixes

* Update QueryProfiler.cpp

* Freebsd fix

* clean

* 19.11: Fixes for arcadia porting (#6223)

* fix glibc-compatibility

* M_LIBRARY fix

* wip

* Fix

* Fix arm build

* unwind fix

* Update CMakeLists.txt
 2019-08-04 03:19:03 +03:00
Zhichang Yu
4f146eaa7e added bitmapRange function 2019-08-03 23:07:46 +08:00
alexey-milovidov
e9c2077c71
Merge pull request #6208 from vitlibar/write-buffer-call-next-impl-even-if-zero-offset 
Fix formula for new_size in WriteBufferFromVector(AppendModeTag).
 2019-08-03 06:27:31 +03:00
Nikolai Kochetov
ab914010e1 Remove TSKVRowInputStream. 2019-08-02 19:56:16 +03:00
Vitaly Baranov
d7891ec9cf Fix formula for new_size in WriteBufferFromVector(AppendModeTag). 2019-08-01 15:27:32 +03:00
Alexey Milovidov
f3921ce3e0 Changed boost::filesystem to std::filesystem 2019-08-01 01:37:41 +03:00
Alexey Milovidov
f03df37b57 Fixed error #6195 2019-07-28 20:16:48 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
alexey-milovidov
7219e167d2
Merge pull request #6026 from bopohaa/fix-kafka-unclean-stream 
Clear Kafka's buffer if an invalid message is found.
 2019-07-25 04:30:37 +03:00
Alexander Tokmakov
7e9c3f2022 PeekableReadBufferCheckpoint 2019-07-22 03:12:11 +03:00
Alexander Tokmakov
456a8c4b17 Fix buffer padding 2019-07-22 03:10:13 +03:00
Alexander Tokmakov
23fddc8688 Fixes 2019-07-22 03:09:35 +03:00
Alexander Tokmakov
4d0a6bad5e PeekableReadBuffer 2019-07-22 03:07:55 +03:00
Alexander Tokmakov
f43f7c43a5 Fixes 2019-07-22 02:59:31 +03:00
Alexander Tokmakov
c92a0f3ac5 Fixes 2019-07-22 02:58:39 +03:00
Alexander Tokmakov
892b67492d Checking for suffix, not for eof 2019-07-22 01:03:29 +03:00
Yuriy
fa2dfcd71d better 2019-07-19 21:43:52 +03:00
Weiqing Xu
ec3c5a369d support reading from HA mode HDSF 
the driver libhdfs3 can support HA mode. When the uri doesn't contain
port num, the libhdfs3 will handle it in HA mode, treat the uri as
nameservice name and read the real host and port from configuration file
as the origin Java client.
the default configuration file is hdfs-client.xml in the working
directory, it also can be set in env variable "LIBHDFS3_CONF".
the format of the configuration file is same with hdfs-site.xml.
 2019-07-19 07:32:59 +08:00
Nik
4a30eba32f Fix style check 2019-07-16 22:34:47 +04:00
Nik
922c3eb22e Clear Kafka's buffer if an invalid message is found. 2019-07-16 19:27:42 +04:00
Yuriy
1d6e31be4d merged master 2019-07-16 10:33:25 +03:00
alexey-milovidov
5215d13437
Merge pull request #5998 from Enmk/double_delta_fix_2 
Fixed DoubleDelta encoding cases for random Int32 and Int64.
 2019-07-16 00:54:22 +03:00
Vasily Nemkov
0f4075478e Fixed DoubleDelta encoding cases for random Int32 and Int64. 2019-07-15 08:17:14 +03:00
Yuriy
baa62f2aba style check 2019-07-15 01:53:30 +03:00
Yuriy
0ed77453d3 reading packets in parts 2019-07-15 01:13:56 +03:00
Yuriy
a6bd5bccff tiny fix 2019-07-14 11:27:58 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors 
Processors
 2019-07-11 19:22:02 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
alexey-milovidov
f6df911307
Update HDFSCommon.cpp 2019-07-09 20:35:47 +03:00
akonyaev
54d890b984 add user parsing in HDFS URI (rewrite split boost->std::string) 2019-07-09 17:09:56 +03:00
akonyaev
c0dc8fc9d3 add user parsing in HDFS URI (fixes after review, style fixes) 2019-07-09 16:16:04 +03:00
akonyaev
74b2440f66 add user parsing in HDFS URI 2019-07-09 13:26:06 +03:00
Alexey Milovidov
e07235e294 Addition to prev. revision 2019-07-08 21:55:06 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
03712aabec Add two more warnings from -Weverything 2019-07-08 03:16:39 +03:00
Vitaliy Zakaznikov
a363189dfc Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-01 18:05:14 -04:00
Yuriy
450b20ca89 max_memory_usage support in MySQL wire protocol 2019-07-01 08:58:31 +03:00
alexey-milovidov
6e77fc4abe
Merge pull request #5775 from yandex/lfalloc2mimalloc 
Use mimalloc instead of lfallocator
 2019-06-28 14:48:18 +03:00
fredchenbj
e3b3ca8d0e IO: fix endian portable on macos x 
Signed-off-by: fredchenbj <cfworking@163.com>
 2019-06-28 15:15:56 +08:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
proller
e9a66d427c Fix freebsd build 2019-06-26 23:32:28 +03:00
alexey-milovidov
dca6d2947c
Merge pull request #5600 from Enmk/gorilla_column_encoding 
Gorilla column encoding
 2019-06-26 12:53:12 +03:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Alexey Milovidov
8f77d898f3 Renamed functions for consistency #5704 2019-06-24 17:51:37 +03:00
alexey-milovidov
8e41d89126
Merge pull request #5704 from zhang2014/fix/ISSUES-5697 
ISSUES-5697 fix insert and select query with mysql style identifier
 2019-06-24 17:40:28 +03:00
alexey-milovidov
dacbe9a410
Update WriteHelpers.h 2019-06-24 17:38:58 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
zhang2014
029e2ccf1f some review fixes 2019-06-22 19:10:00 +08:00
zhang2014
b9cb1feb4c some review fixes 2019-06-22 12:40:41 +08:00
zhang2014
1786407621 ISSUES-5697 fix insert and select query with mysql style identifier 2019-06-21 13:51:27 +08:00
eejoin
f3e0c60b89 Flush buffer when WriteBufferFromHDFS's destructor is called 2019-06-19 19:50:34 +08:00
Vasily Nemkov
e79c3d0e22 Post-PR fixes stage 3 
maskLowBits()
building for clang
more test cases for codecs.
 2019-06-19 13:38:15 +03:00
Vasily Nemkov
81f9055d81 Post-PR fixes #2 
Fixed style issues and build for clang-7;
64-bit buffer for BitReader and BitWriter;
Fixed overflow and writing more bytes on flushing;
Added maskLowBits() and tests for it.
 2019-06-17 21:49:01 +03:00
Vasily Nemkov
0ebb145d32 Post-PR fixes: 
* BitHelpers.cpp was removed, corresponding code was moved to the header
* BitIO test as GTest-based test binary
* gtest-based unit test for DoubleDelta and Gorilla codecs
* getLeadingZeroBits from SFINAE to consexpr if
* removed couple of unneeded if's
* Fixed sql-test to use one table
 2019-06-17 21:39:45 +03:00
Vasily Nemkov
dfd8ff7675 Gorilla column encoding 
Added Gorilla column encoding for any fixed-width type;
Added tests for Float32 and Float64 values.
 2019-06-17 21:39:42 +03:00
Vasily Nemkov
4ae63072d0 DoubleDelta column encoding. 
Added DoubleDelta column encoding + test cases;
Added BitWriter and BitReader that allow to read data from ReadBuffer
and write data to WriteBuffer bit by bit, up to 64 bits at once;
Added test for BitReader and BitWriter.
 2019-06-17 21:38:27 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Vitaliy Zakaznikov
117f2d191e Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-13 15:23:20 -04:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
 2019-06-13 13:37:13 +03:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
alesapin
a0e7d183f7
Merge pull request #5534 from yandex/debug_dns_cache 
Fix bug in pooled sessions and host ip change
 2019-06-05 22:37:17 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533) 
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
 2019-06-05 14:52:39 +03:00
Vitaliy Zakaznikov
5f3be8134d * Disallowing writes into LIVE VIEW tables 
* Adding support for watching live views via HTTPHandler
* Small fix to WriteBufferValidUTF8.cpp to propagate next() call
* Updated copyData.cpp to treat block with no rows as
  "flush block"
* Updated PushingToViewsBlockOutputStream.cpp to directly use
  LIVE VIEW output stream instead of calling its write method
 2019-06-05 07:30:29 -04:00
alesapin
07ee60b546 Fix bug with pooled HTTP sessions and host ip change 2019-06-05 12:23:41 +03:00
Anton Yuzhaninov
091b591681 Fix build without Brotli (#5513) (#5521) 2019-06-03 23:27:53 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header 
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
 2019-05-25 20:20:35 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
alexey-milovidov
24b16da9fd
Merge pull request #5235 from vitlibar/improve-new-json-functions 
Improve new json functions
 2019-05-18 12:51:41 +03:00
alexey-milovidov
c2132880f6
Update WriteBufferFromVector.h 2019-05-18 12:43:43 +03:00
Danila Kutenin
0d3422fa8a toValidUTF8 function added 2019-05-17 15:55:21 +03:00
chertus
21cf553f16 extract readDecimalText.h from readFloatText.h 2019-05-16 19:41:10 +03:00
Vitaly Baranov
c93bd31695 Simplify template implementation. 2019-05-16 14:09:22 +03:00
chertus
2739a3f6d0 Merge branch 'master' into nulls 2019-05-16 14:02:12 +03:00
chertus
5f19c0981d add toDecimalOrZero and toDecimalOrNull fuctions 2019-05-15 21:50:35 +03:00
chertus
720f8667e4 fix decimal quoted csv input 2019-05-15 16:51:17 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
Guillaume Tassery
9c295fa524 Don't ask client to send write info byte if the version cannot handle it 2019-05-13 14:18:02 +07:00
Guillaume Tassery
1ae8948177 Merge branch 'master' of https://github.com/yandex/ClickHouse into send_header 2019-05-13 13:35:12 +07:00
Guillaume Tassery
a1ed3f8f6b Add checks for header progress 2019-05-13 12:55:53 +07:00
Guillaume Tassery
2bd3895e40 Rename HTTP header on total_rows to rows_in_set 2019-05-13 11:56:08 +07:00
Guillaume Tassery
1b30f91c42 Return to old implementation of read and write values for progress 2019-05-13 11:48:09 +07:00
Guillaume Tassery
a4c891e529 Typo for progress and summary header 2019-05-10 13:50:48 +07:00
proller
b9385f9620 Disable test in macos 2019-05-08 13:24:50 +03:00
Guillaume Tassery
6dcaadc620 Merge remote-tracking branch 'upstream/master' into send_header 2019-05-06 17:18:41 +07:00
Guillaume Tassery
7d578edc85 Check null values for when we send summary header 2019-05-06 16:09:45 +07:00
Guillaume Tassery
55842dce10 code style 2019-05-06 13:57:48 +07:00
Guillaume Tassery
e0bd16c1f4 Backward compatibility for write progress with old version of server and client 2019-05-06 13:14:37 +07:00
Guillaume Tassery
7b1be6efc4 Clode cleaning and add test for X-ClickHouse-Summary header 2019-04-26 10:46:52 +07:00
Guillaume Tassery
3707f26edf Write number of rows written in a summary instead of progress header 2019-04-26 10:38:39 +07:00
Nikolai Kochetov
d613716dc5 More bytes for DoubleConverter buffer. 2019-04-25 17:32:39 +03:00
Nikolai Kochetov
e9a63de607 More bytes for DoubleConverter buffer. 2019-04-25 17:00:07 +03:00
Guillaume Tassery
ced71ac9fd Send how many rows and bytes were written during the query 2019-04-25 18:25:49 +07:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Guillaume Tassery
7a75003d26 Send X-ClickHouse-Progress header in the end of a query execution 2019-04-19 19:14:10 +07:00
Danila Kutenin
622b2c8472 Enable LFAlloc for MarkCache and UncompressedCache 2019-04-13 15:07:43 +03:00
Alexey Milovidov
36d016d331 Added [[noreturn]] attributes for functions that throw unconditionally 2019-04-10 23:27:14 +03:00
Alexey Milovidov
f37d66bb2e Brotli: additions to #4388 2019-04-10 19:12:31 +03:00
Mikhail Fandyushin
e566d10eee HTTP Accept-Encoding: br; Revert using unbundled brotli library. FCixed using not initialized http respones ostream pointer 2019-04-10 00:59:44 +03:00
Mikhail Fandyushin
7fc9b8c6fb Merge branch 'master' into brotli 2019-04-08 21:07:58 +03:00
alexey-milovidov
27f7f0908f
Merge pull request #4913 from yandex/fix_additional_seek 
Fix bug with additional file processing in cache compressed buffer
 2019-04-07 01:24:50 +03:00
Danila Kutenin
1c030e4ed1 Fix allocations for a while 2019-04-06 23:53:25 +03:00
Danila Kutenin
37d70ac558 MarkCache and UncompressedCache use different allocator to catch segfaults more reliable 2019-04-06 18:27:39 +03:00
alesapin
7e1975b0c8 Fix bug with additional seek in cache compressed buffer 2019-04-05 12:42:44 +03:00
alesapin
5a6c4bf526 Better comment 2019-04-03 17:34:46 +03:00
alesapin
804a7612c2 Add comment 2019-04-03 17:28:39 +03:00
alesapin
bee8d61e26 Fix seek backwards after eof in ReadBufferAIO 2019-04-03 17:24:55 +03:00
Vitaly Baranov
37b904b8f5
Merge pull request #4808 from vitlibar/kafka-with-protobuf-format 
Kafka with protobuf format
 2019-03-30 19:00:57 +03:00
alesapin
2764401d0f Fix exception 'No message received' 2019-03-29 21:10:03 +03:00
Vitaly Baranov
a78e067c70 Allow empty row_delimiter when using Kafka. 2019-03-29 17:38:52 +03:00
proller
e4d45b7e50 Fix test include 2019-03-28 16:10:42 +03:00
Mikhail Fandyushin
c53b303bc2 HTTP Accept-Encoding: br; Added brotli errors codes 2019-03-27 00:32:29 +03:00
Mikhail Fandyushin
4b7ac9e9b4 HTTP Accept-Encoding: br; Fixed review notes 2019-03-26 23:27:34 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
Mikhail Fandyushin
fa9ded92ef HTTP Accept-Encoding: br; Added new line 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
e986d0eae6 HTTP Accept-Encoding: br; Final fixes 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
aeb73a4baf HTTP Accept-Encoding: br; Minor fixes in order to pass tests 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
e6546a4fcc HTTP Accept-Encoding: br; First working prototype of BrotliWriteBuffer; Need to improve 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
8e21b983f7 HTTP Accept-Encoding: br; Using BrotliWrite buffer in WriteBufferFromHttpServerResponse 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
73a9644da2 HTTP Accept-Encoding: br; Expended ZlibCompressionMethod to generic CompressionMethod; Added brotli to CompressionMethod enum 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
2a6e8d7fa1 HTTP Accept-Encoding: br; Added BrotliWriteBuffer interface 2019-03-21 00:04:35 +03:00
proller
cf8001b6a9
Fix includes (#4673) 2019-03-13 16:58:04 +03:00
alexey-milovidov
628ed349c3
Merge pull request #4627 from filimonov/issue4284 
Fix broken progress in 19.3. Introduce total_rows for table function numbers().
 2019-03-09 01:08:45 +03:00
Mikhail Filimonov
5f626dc99e Fix broken progress in 19.3 (regression in 92769a2460) 
Introduce total_rows for table function `numbers()`.

fixes https://github.com/yandex/ClickHouse/issues/4429
resolves https://github.com/yandex/ClickHouse/issues/4284
 2019-03-08 15:36:40 +01:00
Alexey Milovidov
9d89cc0fc1 Debugging PODArray 2019-03-08 06:23:02 +03:00
Alexey Milovidov
e773b6d81d Added a test to build 2019-03-02 04:32:37 +03:00
alexey-milovidov
40d8abbc34
Merge pull request #4523 from yandex/fix_column_description_parse 
Fix column description parse. Now creation of replicated MT table wit…
 2019-02-28 01:18:31 +03:00
Alexey Milovidov
3256b816be Merge branch 'master' of github.com:yandex/ClickHouse 2019-02-27 22:12:17 +03:00
Alexey Milovidov
141d9add39 Fixed error message 2019-02-27 22:12:08 +03:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
alesapin
1909c87885 Fix column description parse. Now creation of replicated MT table with codecs and comments is possible without default 2019-02-27 19:41:51 +03:00
Alexey Milovidov
7179bb32b2 Balance 2019-02-26 15:31:17 +03:00
Alexey Milovidov
c80ad3b578 Removed useless includes 2019-02-26 15:30:36 +03:00
Alexey Milovidov
8e59998dfa Added a comment 2019-02-26 13:53:35 +03:00
Alexey Milovidov
34d480a7f4 Simplified test 2019-02-25 23:29:56 +03:00