Commit Graph

880 Commits

Author SHA1 Message Date
Weiqing Xu
ec3c5a369d support reading from HA mode HDSF
the driver libhdfs3 can support HA mode. When the uri doesn't contain
port num, the libhdfs3 will handle it in HA mode, treat the uri as
nameservice name and read the real host and port from configuration file
as the origin Java client.
the default configuration file is hdfs-client.xml in the working
directory, it also can be set in env variable "LIBHDFS3_CONF".
the format of the configuration file is same with hdfs-site.xml.
2019-07-19 07:32:59 +08:00
alexey-milovidov
5215d13437
Merge pull request #5998 from Enmk/double_delta_fix_2
Fixed DoubleDelta encoding cases for random Int32 and Int64.
2019-07-16 00:54:22 +03:00
Vasily Nemkov
0f4075478e Fixed DoubleDelta encoding cases for random Int32 and Int64. 2019-07-15 08:17:14 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
alexey-milovidov
f6df911307
Update HDFSCommon.cpp 2019-07-09 20:35:47 +03:00
akonyaev
54d890b984 add user parsing in HDFS URI (rewrite split boost->std::string) 2019-07-09 17:09:56 +03:00
akonyaev
c0dc8fc9d3 add user parsing in HDFS URI (fixes after review, style fixes) 2019-07-09 16:16:04 +03:00
akonyaev
74b2440f66 add user parsing in HDFS URI 2019-07-09 13:26:06 +03:00
Alexey Milovidov
e07235e294 Addition to prev. revision 2019-07-08 21:55:06 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
03712aabec Add two more warnings from -Weverything 2019-07-08 03:16:39 +03:00
alexey-milovidov
6e77fc4abe
Merge pull request #5775 from yandex/lfalloc2mimalloc
Use mimalloc instead of lfallocator
2019-06-28 14:48:18 +03:00
fredchenbj
e3b3ca8d0e IO: fix endian portable on macos x
Signed-off-by: fredchenbj <cfworking@163.com>
2019-06-28 15:15:56 +08:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
proller
e9a66d427c Fix freebsd build 2019-06-26 23:32:28 +03:00
alexey-milovidov
dca6d2947c
Merge pull request #5600 from Enmk/gorilla_column_encoding
Gorilla column encoding
2019-06-26 12:53:12 +03:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Alexey Milovidov
8f77d898f3 Renamed functions for consistency #5704 2019-06-24 17:51:37 +03:00
alexey-milovidov
8e41d89126
Merge pull request #5704 from zhang2014/fix/ISSUES-5697
ISSUES-5697 fix insert and select query with mysql style identifier
2019-06-24 17:40:28 +03:00
alexey-milovidov
dacbe9a410
Update WriteHelpers.h 2019-06-24 17:38:58 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
zhang2014
029e2ccf1f some review fixes 2019-06-22 19:10:00 +08:00
zhang2014
b9cb1feb4c some review fixes 2019-06-22 12:40:41 +08:00
zhang2014
1786407621 ISSUES-5697 fix insert and select query with mysql style identifier 2019-06-21 13:51:27 +08:00
eejoin
f3e0c60b89 Flush buffer when WriteBufferFromHDFS's destructor is called 2019-06-19 19:50:34 +08:00
Vasily Nemkov
e79c3d0e22 Post-PR fixes stage 3
maskLowBits()
building for clang
more test cases for codecs.
2019-06-19 13:38:15 +03:00
Vasily Nemkov
81f9055d81 Post-PR fixes #2
Fixed style issues and build for clang-7;
64-bit buffer for BitReader and BitWriter;
Fixed overflow and writing more bytes on flushing;
Added maskLowBits() and tests for it.
2019-06-17 21:49:01 +03:00
Vasily Nemkov
0ebb145d32 Post-PR fixes:
* BitHelpers.cpp was removed, corresponding code was moved to the header
* BitIO test as GTest-based test binary
* gtest-based unit test for DoubleDelta and Gorilla codecs
* getLeadingZeroBits from SFINAE to consexpr if
* removed couple of unneeded if's
* Fixed sql-test to use one table
2019-06-17 21:39:45 +03:00
Vasily Nemkov
dfd8ff7675 Gorilla column encoding
Added Gorilla column encoding for any fixed-width type;
Added tests for Float32 and Float64 values.
2019-06-17 21:39:42 +03:00
Vasily Nemkov
4ae63072d0 DoubleDelta column encoding.
Added DoubleDelta column encoding + test cases;
Added BitWriter and BitReader that allow to read data from ReadBuffer
and write data to WriteBuffer bit by bit, up to 64 bits at once;
Added test for BitReader and BitWriter.
2019-06-17 21:38:27 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
2019-06-13 13:37:13 +03:00
alesapin
a0e7d183f7
Merge pull request #5534 from yandex/debug_dns_cache
Fix bug in pooled sessions and host ip change
2019-06-05 22:37:17 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533)
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
2019-06-05 14:52:39 +03:00
alesapin
07ee60b546 Fix bug with pooled HTTP sessions and host ip change 2019-06-05 12:23:41 +03:00
Anton Yuzhaninov
091b591681 Fix build without Brotli (#5513) (#5521) 2019-06-03 23:27:53 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
2019-05-25 20:20:35 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
alexey-milovidov
24b16da9fd
Merge pull request #5235 from vitlibar/improve-new-json-functions
Improve new json functions
2019-05-18 12:51:41 +03:00
alexey-milovidov
c2132880f6
Update WriteBufferFromVector.h 2019-05-18 12:43:43 +03:00
Danila Kutenin
0d3422fa8a toValidUTF8 function added 2019-05-17 15:55:21 +03:00
chertus
21cf553f16 extract readDecimalText.h from readFloatText.h 2019-05-16 19:41:10 +03:00
Vitaly Baranov
c93bd31695 Simplify template implementation. 2019-05-16 14:09:22 +03:00
chertus
2739a3f6d0 Merge branch 'master' into nulls 2019-05-16 14:02:12 +03:00
chertus
5f19c0981d add toDecimalOrZero and toDecimalOrNull fuctions 2019-05-15 21:50:35 +03:00
chertus
720f8667e4 fix decimal quoted csv input 2019-05-15 16:51:17 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00