Commit Graph

1043 Commits

Author SHA1 Message Date
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
maqroll
ca36e3f861 Attach error to force ip refresh 2019-09-20 12:36:09 +00:00
stavrolia
7309e813bc cleanup hdfs docs 2019-09-20 14:26:00 +03:00
Vladimir Chebotarev
0ee6f6231a Added comments about redirecting requests and got rid of magic values. 2019-09-19 10:33:34 +00:00
Vladimir Chebotarev
12f7361095 Removed unused headers from ReadBufferFromS3.h 2019-09-19 10:25:31 +00:00
Vladimir Chebotarev
a5d6bd9e01 Proper passing of query parameters in initiate multipart upload. 2019-09-19 10:16:39 +00:00
Vladimir Chebotarev
a88d795f0f Proper passing of query parameters in initiate multipart upload. 2019-09-19 10:15:59 +00:00
Vladimir Chebotarev
283e09d2a5 Removed trash logging and fixed query parameters in multipart uploads. 2019-09-19 10:02:45 +00:00
maqroll
952d9449a2 typo 2019-09-18 14:53:45 +00:00
root
8175d4c2d1 style checks
Committer: maqroll <loteroc@gmail.com>
2019-09-18 13:38:17 +00:00
root
ea5480fd72 merge
Committer: maqroll <loteroc@gmail.com>
2019-09-18 13:13:40 +00:00
root
ee311ff03c style checks
Committer: maqroll <jluisoc@gmail.com>
2019-09-18 10:38:00 +00:00
root
392bdd6008 +UpdatableSessionBase
Committer: maqroll <jluisoc@gmail.com>
2019-09-18 08:49:46 +00:00
root
5ec0005400 +UpdatableSessionBase
Committer: maqroll <loteroc@gmail.com>
2019-09-16 17:28:41 +00:00
Ivan Lezhankin
01fdb802d4 Useful changes 2019-09-15 13:35:12 +03:00
akuzm
e765733a26
Merge pull request #6925 from yandex/aku/msan
Some MemorySanitizer fixes
2019-09-13 20:26:48 +03:00
Alexander Kuzmenkov
f4da0399c0 Some MemorySanitizer fixes. 2019-09-13 14:49:29 +03:00
alesapin
02cff38fef Merge with master 2019-09-13 13:58:23 +03:00
Vladimir Chebotarev
1b715069fb Merge fix. 2019-09-12 14:38:53 +00:00
l
2b5a420f49 error: no newline at end of file [-Werror,-Wnewline-eof] 2019-09-12 07:41:16 +02:00
l
dda57fe0f7 Style checks 2019-09-11 23:08:54 +02:00
l
688b0d91a0 Style checks 2019-09-11 22:53:53 +02:00
Alexander Tokmakov
f323476111 Merge branch 'master' into merging_values_with_expressions 2019-09-11 23:31:37 +03:00
l
adb4a58092 Style checks & security considerations added to setting description. 2019-09-11 22:18:22 +02:00
Alexander Tokmakov
29fe481b06 optimize expression template deduction 2019-09-11 22:55:28 +03:00
l
cdbcfc2c90 + Redirect 2019-09-11 18:39:30 +02:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library
Now the linking time of incremental builds are around 1-2 seconds
2019-09-11 01:56:01 +08:00
alesapin
193049293a More comments, more readable code 2019-09-10 14:21:59 +03:00
Alexander Tokmakov
3643ecc9cd parse expressions near the end of buffer correctly 2019-09-09 20:06:22 +03:00
alesapin
ea8e543b1a Add protocol version to cookies 2019-09-06 15:18:56 +03:00
Olga Khvostikova
4129d8cf60
Merge pull request #6092 from yandex/globs-in-file-one-more-attempt
Globs in storage file and HDFS
2019-09-05 23:05:37 +03:00
stavrolia
587a780ba2 Better 2019-09-05 17:42:17 +03:00
Ivan
ab7df6b6dd
Fix kafka tests (#6805)
* Commit offsets more precisely
* Get rid of DelimitedReadBuffer since read buffers don't line up well
* Increase timeouts
2019-09-05 00:25:33 +03:00
Vladimir Chebotarev
c891590709 Added even better warning. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
ab456262d9 Fixed multipart mechanism and added a warning about 10k parts. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
97b7635c8a Minimum block size to configuration. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
395560df1b Fixed multipart uploads and 100-continue. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
fa0de006d0 More style fixes. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
a9153b2fb3 Style fixes. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
96d093f9ad Clang compatibility fixes. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
248e26d59f Attempt to make multipart uploads. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
10a7f80af1 Stubs for multipart uploads. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
dd32c92f2a Minor fixes. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
63164db019 Fixed S3 PUT redirects. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
634f82d0ad Minor fix. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ff69112919 Attempt to make S3 PUT redirects (wip). 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
7236ae0d8d Fixed 411 error when putting to S3. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
0504eb58be Correct S3 PUT requests in WriteBufferFromS3. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
1944ff1a48 POST to PUT, refactoring. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
062db0ec14 Removed templateness of ReadWriteBufferFromS3. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
531460396d POST S3 requests. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
caeacafb76 Fixed GET redirects. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
78f57c5f2a First attempt to make redirects. 2019-09-04 13:39:53 +00:00
Alexey Milovidov
9cf0c780fb Better code 2019-09-03 21:23:13 +03:00
alexey-milovidov
845a612b95
Merge pull request #6773 from infinivision/fix_issue_6575
fix DataTypeAggregateFunction deserialization
2019-09-03 21:19:41 +03:00
Zhichang Yu
9e587fb139 fix DataTypeAggregateFunction deserialization 2019-09-02 20:09:40 +08:00
Alexander Tokmakov
e2928481a3 Merge branch 'master' into merging_template_format 2019-09-02 12:41:34 +03:00
Alexander Tokmakov
cd5d733f75 rewrite unit test with gtest 2019-08-30 22:08:23 +03:00
Alexander Tokmakov
4c744af113 minor style fixes 2019-08-30 20:25:35 +03:00
alexey-milovidov
ce73e17ff6
Merge pull request #6730 from yandex/fallback_o_direct
Fallback from O_DIRECT.
2019-08-30 16:08:19 +03:00
Alexander Tokmakov
d95d53b4e4 better error messages 2019-08-29 22:35:59 +03:00
Alexey Milovidov
a894288fa0 Fallback from O_DIRECT. 2019-08-29 18:48:00 +03:00
Alexander Tokmakov
03c83169bd Merge branch 'master' into merging_template_format 2019-08-29 16:34:25 +03:00
Alexander Tokmakov
d6ca9fee63 unit test for PeekableReadBuffer 2019-08-29 16:30:43 +03:00
Alexey Milovidov
39d50b5144 Remove mimalloc 2019-08-28 22:01:52 +03:00
Weiqing Xu
b7fdfcc797 fix HDFS HA can't work on DEBUG mode
The Describe the bug
when the using HDFS HA nameserivce as the uri, the port will be 0.
hdfsBuilderSetNameNodePort will be called to set the port.
hdfsBuilderSetNameNodePort call asset to check if the port is greater
than 0.
So in Release mode, it works OK. In the Debug mode, the asset will fail.

How to reproduce
when compiler the Clickhouse, use DEBUG mode, it will throw error when
using HDFS HA nameservice url
2019-08-24 17:27:36 +08:00
Alexander Tokmakov
734a0f23a9 Merge branch 'master' into merging_template_format 2019-08-23 15:32:35 +03:00
alex-zaitsev
1e6437e4ee WIP: Fix MacOS build (#6429)
* Fix broken MacOS build

* Fix MacOS build

* Update ReadBufferFromFile.cpp

* Update WriteBufferFromFile.cpp

* Update Elf.h

* Update Elf.h
2019-08-21 03:35:41 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview
Merge LIVE VIEW
2019-08-20 17:13:42 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012)
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
stavrolia
6055c61e7f wip hdfs 2019-08-19 21:12:50 +03:00
alexey-milovidov
f36d20915b
Merge pull request #6529 from yandex/better-signals
Better debug-ability of fault signals.
2019-08-18 16:44:54 +03:00
proller
d09c5c871b Build fixes (#6491)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
Alexey Milovidov
2cd669fa1d Minor improvement 2019-08-17 23:33:50 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
Alexey Milovidov
40a3f77917 Removed duplicate include 2019-08-08 19:01:42 +03:00
alexey-milovidov
99fad0904b
Merge pull request #6314 from infinivision/add_bitmapRange
added bitmapRange function
2019-08-08 04:51:48 +03:00
alexey-milovidov
355b1e5594
Merge pull request #6352 from yandex/no_space_left_on_device_message
Print extra info in exception message for "no space left on device"
2019-08-07 22:28:38 +03:00
Alexander Tokmakov
5cf183cbe3 fixes after review 2019-08-07 15:55:27 +03:00
Alexander Tokmakov
aefc664819 refactor throwFromErrno 2019-08-06 21:54:06 +03:00
Nikolai Kochetov
599f3ddf6e Merged with master. 2019-08-04 15:35:21 +03:00
proller
77bd2624ea Build fixes (#6016)
* Fix building without submodules

* Fix more gcc9 warnings

* was wrong!
../dbms/src/IO/WriteBufferAIO.cpp:277:54: error: result of comparison 'ssize_t' (aka 'long') > 9223372036854775807 is always false [-Werror,-Wtautological-type-limit-compare]
    if ((static_cast<ssize_t>(flush_buffer.offset()) > std::numeric_limits<off_t>::max()) ||
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

* mimalloc off MI_OVERRIDE

* Fix freebsd build

* Fix shared build

* Fix build in gcc9

* Fix split build

* fix

* fix

* fix

* fix

* clean

* zstd

* Update CMakeLists.txt

* Update Defines.h

* Try fix -Wsign-compare

* Freebsd fix

* Add missing libs

* Fix double-conversion include for copy-headers

* Fix zlib link

* Fix includes for arcadia

* Fix includes for arcadia

* Fix includes for arcadia

* Freebsd fix

* Arcadia fixes

* Update QueryProfiler.cpp

* Freebsd fix

* clean

* 19.11: Fixes for arcadia porting (#6223)

* fix glibc-compatibility

* M_LIBRARY fix

* wip

* Fix

* Fix arm build

* unwind fix

* Update CMakeLists.txt
2019-08-04 03:19:03 +03:00
Zhichang Yu
4f146eaa7e added bitmapRange function 2019-08-03 23:07:46 +08:00
alexey-milovidov
e9c2077c71
Merge pull request #6208 from vitlibar/write-buffer-call-next-impl-even-if-zero-offset
Fix formula for new_size in WriteBufferFromVector(AppendModeTag).
2019-08-03 06:27:31 +03:00
Nikolai Kochetov
ab914010e1 Remove TSKVRowInputStream. 2019-08-02 19:56:16 +03:00
Vitaly Baranov
d7891ec9cf Fix formula for new_size in WriteBufferFromVector(AppendModeTag). 2019-08-01 15:27:32 +03:00
Alexey Milovidov
f3921ce3e0 Changed boost::filesystem to std::filesystem 2019-08-01 01:37:41 +03:00
Alexey Milovidov
f03df37b57 Fixed error #6195 2019-07-28 20:16:48 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
alexey-milovidov
7219e167d2
Merge pull request #6026 from bopohaa/fix-kafka-unclean-stream
Clear Kafka's buffer if an invalid message is found.
2019-07-25 04:30:37 +03:00
Alexander Tokmakov
7e9c3f2022 PeekableReadBufferCheckpoint 2019-07-22 03:12:11 +03:00
Alexander Tokmakov
456a8c4b17 Fix buffer padding 2019-07-22 03:10:13 +03:00
Alexander Tokmakov
23fddc8688 Fixes 2019-07-22 03:09:35 +03:00
Alexander Tokmakov
4d0a6bad5e PeekableReadBuffer 2019-07-22 03:07:55 +03:00
Alexander Tokmakov
f43f7c43a5 Fixes 2019-07-22 02:59:31 +03:00
Alexander Tokmakov
c92a0f3ac5 Fixes 2019-07-22 02:58:39 +03:00
Alexander Tokmakov
892b67492d Checking for suffix, not for eof 2019-07-22 01:03:29 +03:00