thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-14 10:22:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,842 Commits 9,328 Branches 1,783 Tags 2.1 GiB
055f21c9b7
Commit Graph

1022 Commits

Author SHA1 Message Date
Guillaume Tassery
7d578edc85 Check null values for when we send summary header 2019-05-06 16:09:45 +07:00
Guillaume Tassery
55842dce10 code style 2019-05-06 13:57:48 +07:00
Guillaume Tassery
e0bd16c1f4 Backward compatibility for write progress with old version of server and client 2019-05-06 13:14:37 +07:00
Guillaume Tassery
7b1be6efc4 Clode cleaning and add test for X-ClickHouse-Summary header 2019-04-26 10:46:52 +07:00
Guillaume Tassery
3707f26edf Write number of rows written in a summary instead of progress header 2019-04-26 10:38:39 +07:00
Nikolai Kochetov
d613716dc5 More bytes for DoubleConverter buffer. 2019-04-25 17:32:39 +03:00
Nikolai Kochetov
e9a63de607 More bytes for DoubleConverter buffer. 2019-04-25 17:00:07 +03:00
Guillaume Tassery
ced71ac9fd Send how many rows and bytes were written during the query 2019-04-25 18:25:49 +07:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Guillaume Tassery
7a75003d26 Send X-ClickHouse-Progress header in the end of a query execution 2019-04-19 19:14:10 +07:00
Danila Kutenin
622b2c8472 Enable LFAlloc for MarkCache and UncompressedCache 2019-04-13 15:07:43 +03:00
Alexey Milovidov
36d016d331 Added [[noreturn]] attributes for functions that throw unconditionally 2019-04-10 23:27:14 +03:00
Alexey Milovidov
f37d66bb2e Brotli: additions to #4388 2019-04-10 19:12:31 +03:00
Mikhail Fandyushin
e566d10eee HTTP Accept-Encoding: br; Revert using unbundled brotli library. FCixed using not initialized http respones ostream pointer 2019-04-10 00:59:44 +03:00
Mikhail Fandyushin
7fc9b8c6fb Merge branch 'master' into brotli 2019-04-08 21:07:58 +03:00
alexey-milovidov
27f7f0908f
Merge pull request #4913 from yandex/fix_additional_seek 
Fix bug with additional file processing in cache compressed buffer
 2019-04-07 01:24:50 +03:00
Danila Kutenin
1c030e4ed1 Fix allocations for a while 2019-04-06 23:53:25 +03:00
Danila Kutenin
37d70ac558 MarkCache and UncompressedCache use different allocator to catch segfaults more reliable 2019-04-06 18:27:39 +03:00
alesapin
7e1975b0c8 Fix bug with additional seek in cache compressed buffer 2019-04-05 12:42:44 +03:00
alesapin
5a6c4bf526 Better comment 2019-04-03 17:34:46 +03:00
alesapin
804a7612c2 Add comment 2019-04-03 17:28:39 +03:00
alesapin
bee8d61e26 Fix seek backwards after eof in ReadBufferAIO 2019-04-03 17:24:55 +03:00
Vitaly Baranov
37b904b8f5
Merge pull request #4808 from vitlibar/kafka-with-protobuf-format 
Kafka with protobuf format
 2019-03-30 19:00:57 +03:00
alesapin
2764401d0f Fix exception 'No message received' 2019-03-29 21:10:03 +03:00
Vitaly Baranov
a78e067c70 Allow empty row_delimiter when using Kafka. 2019-03-29 17:38:52 +03:00
proller
e4d45b7e50 Fix test include 2019-03-28 16:10:42 +03:00
Mikhail Fandyushin
c53b303bc2 HTTP Accept-Encoding: br; Added brotli errors codes 2019-03-27 00:32:29 +03:00
Mikhail Fandyushin
4b7ac9e9b4 HTTP Accept-Encoding: br; Fixed review notes 2019-03-26 23:27:34 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
Mikhail Fandyushin
fa9ded92ef HTTP Accept-Encoding: br; Added new line 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
e986d0eae6 HTTP Accept-Encoding: br; Final fixes 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
aeb73a4baf HTTP Accept-Encoding: br; Minor fixes in order to pass tests 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
e6546a4fcc HTTP Accept-Encoding: br; First working prototype of BrotliWriteBuffer; Need to improve 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
8e21b983f7 HTTP Accept-Encoding: br; Using BrotliWrite buffer in WriteBufferFromHttpServerResponse 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
73a9644da2 HTTP Accept-Encoding: br; Expended ZlibCompressionMethod to generic CompressionMethod; Added brotli to CompressionMethod enum 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
2a6e8d7fa1 HTTP Accept-Encoding: br; Added BrotliWriteBuffer interface 2019-03-21 00:04:35 +03:00
proller
cf8001b6a9
Fix includes (#4673) 2019-03-13 16:58:04 +03:00
alexey-milovidov
628ed349c3
Merge pull request #4627 from filimonov/issue4284 
Fix broken progress in 19.3. Introduce total_rows for table function numbers().
 2019-03-09 01:08:45 +03:00
Mikhail Filimonov
5f626dc99e Fix broken progress in 19.3 (regression in 92769a2460) 
Introduce total_rows for table function `numbers()`.

fixes https://github.com/yandex/ClickHouse/issues/4429
resolves https://github.com/yandex/ClickHouse/issues/4284
 2019-03-08 15:36:40 +01:00
Alexey Milovidov
9d89cc0fc1 Debugging PODArray 2019-03-08 06:23:02 +03:00
Alexey Milovidov
e773b6d81d Added a test to build 2019-03-02 04:32:37 +03:00
alexey-milovidov
40d8abbc34
Merge pull request #4523 from yandex/fix_column_description_parse 
Fix column description parse. Now creation of replicated MT table wit…
 2019-02-28 01:18:31 +03:00
Alexey Milovidov
3256b816be Merge branch 'master' of github.com:yandex/ClickHouse 2019-02-27 22:12:17 +03:00
Alexey Milovidov
141d9add39 Fixed error message 2019-02-27 22:12:08 +03:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
alesapin
1909c87885 Fix column description parse. Now creation of replicated MT table with codecs and comments is possible without default 2019-02-27 19:41:51 +03:00
Alexey Milovidov
7179bb32b2 Balance 2019-02-26 15:31:17 +03:00
Alexey Milovidov
c80ad3b578 Removed useless includes 2019-02-26 15:30:36 +03:00
Alexey Milovidov
8e59998dfa Added a comment 2019-02-26 13:53:35 +03:00
Alexey Milovidov
34d480a7f4 Simplified test 2019-02-25 23:29:56 +03:00
Alexey Milovidov
c85dbe7610 Simplified test 2019-02-25 23:24:54 +03:00
Alexey Milovidov
c11a8d06ba Simplified test 2019-02-25 23:21:05 +03:00
Alexey Milovidov
a73f0ddcbb Added a test that reproduce the bug in gcc 7 2019-02-25 23:17:14 +03:00
Alexey Milovidov
15a7954b70 Removed double whitespace 2019-02-25 02:05:23 +03:00
Alexey Milovidov
0d9c438864 Added a test 2019-02-22 20:16:11 +03:00
Vitaly Baranov
4793ccb3fc Improve performance of ProtobufReader. 2019-02-21 18:49:42 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
proller
fa9e9e57c8 [PATCH] Fixup for "AIOcontextPool: Found io_event with unknown id 0'' error #4434 from urgordeadbeef 2019-02-18 20:30:00 +03:00
proller
263e69e861
Build fixes (FreeBSD port) (#4397) 2019-02-15 14:46:07 +03:00
proller
f5560660be Fix brotli (unbundled, missing, ...) 2019-02-13 18:35:11 +03:00
alesapin
5eb5f631fd
Update BrotliReadBuffer.h 2019-02-12 16:01:14 +03:00
Mikhail
763b3dcf73
Merge branch 'master' into brotli 2019-02-11 23:44:39 +03:00
Mikhail Fandyushin
b01d735421 hide brotli from inerface 2019-02-11 23:42:46 +03:00
Ivan Lezhankin
2bd14117f4 Merge remote-tracking branch 'upstream/master' into issue-2675 2019-02-11 13:57:40 +03:00
alexey-milovidov
4f2b35cb10
Merge pull request #4215 from abyss7/CLICKHOUSE-3729 
Report progress from server-side to keep client connections alive
 2019-02-11 02:07:57 +03:00
alexey-milovidov
0dd618b9ad
Merge pull request #4326 from yandex/duplicate-includes 
Removed duplicate includes
 2019-02-10 22:31:37 +03:00
Alexey Milovidov
e150e62040 Grouped includes (40 of 182) 2019-02-10 20:40:52 +03:00
Alexey Milovidov
ba3cb83a84 Removed duplicate includes 2019-02-10 20:12:22 +03:00
Alexey Milovidov
c603d270f4 Cleanups #4246 2019-02-10 18:17:45 +03:00
Vitaly Baranov
49611e87e9 Fix build and code-style. 2019-02-08 16:36:58 +03:00
urgordeadbeef
f236ec93be Add FreeBSD AIO support. 2019-02-07 21:48:09 +03:00
Ivan Lezhankin
92769a2460 Don't update "arrow" on client-side for nothing 2019-02-07 16:47:16 +03:00
Ivan Lezhankin
018df69d3d Merge remote-tracking branch 'upstream/master' into issue-2675 2019-02-07 15:45:21 +03:00
Mihail Fandyushin
60cd766623 fixed clang build; added new line 2019-02-06 09:05:41 +03:00
Mikhail Fandyushin
1ee18203ae handle brotli errors; working wersion of BrotliReadBuffer 2019-02-06 02:12:31 +03:00
Mikhail Fandyushin
7e9e34bebf WIP: Reading brotli encoded HTTP messages. First-draft-ugly implementation, but its works 2019-02-05 01:15:08 +03:00
proller
a383868442 Remove not used dbms/src/IO/InterserverWriteBuffer.* 2019-02-02 12:03:09 +03:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
alexey-milovidov
f96b8e4ed6
Merge pull request #4005 from vitlibar/add-protobuf-output-format 
Add protobuf output format
 2019-01-24 22:05:23 +03:00
Vitaly Baranov
b1aba679d0 Class WriteBufferFromOwnString now can return StringRef too. 2019-01-24 17:32:01 +03:00
Ivan Lezhankin
862d419f31 Fix losing the next message after a broken one. 2019-01-24 14:58:25 +03:00
Danila Kutenin
784c3e5fda fix of ppc64le definitions 2019-01-23 18:24:14 +03:00
Danila Kutenin
f6e6f99737 fix 2019-01-23 17:26:05 +03:00
Danila Kutenin
7f4b0f3c04 added powerpc build support 2019-01-23 17:18:19 +03:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
alexey-milovidov
9a22185bd6
Update ReadBufferFromHDFS.cpp 2019-01-20 02:51:03 +03:00
alesapin
21f1c4d1ce Better code and tests for bad cases 2019-01-19 23:17:19 +03:00
alesapin
33d5f0c8dd Fix potential null pointer dereference 2019-01-18 21:57:11 +03:00
alesapin
66bd80703e Fix clang warning 2019-01-18 19:17:24 +03:00
alesapin
7c1c6eba8b Wrap hdfsBuilder into unique ptr 2019-01-18 15:48:55 +03:00
alesapin
a139f375c3 Remove copypaste 2019-01-18 14:39:36 +03:00
alesapin
71e58ca001 Fix potential leak in read buffer 2019-01-18 14:01:07 +03:00
alesapin
83c32727dc Remove strange commit 2019-01-18 13:57:00 +03:00
alesapin
2f7b63cf71 Fix review notes 2019-01-18 13:55:03 +03:00
alesapin
07e11577d3 Add write logic and remove strange multifile read logic 2019-01-17 17:10:30 +03:00
alesapin
2d3e08fc74 Refactor ReadBufferFromHDFS 2019-01-17 14:26:29 +03:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
Alexey Milovidov
abcd5a2a49 Attempt to implemnt global thread pool #4018 2019-01-11 22:12:36 +03:00
Alexey Milovidov
4712fd668e Addition to prev. revision 2019-01-09 20:31:30 +03:00
Alexey Milovidov
0dfa553fca Added more warnings from clang's -Weverything, that are available in clang 8 2019-01-07 13:40:58 +03:00
Alexey Milovidov
d3f5be212d Added some warnings from clang's -Weverything 2019-01-05 03:55:47 +03:00
Alexey Milovidov
cf1cacc366 Added some warnings from clang's -Weverything 2019-01-04 16:54:39 +03:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
Alexey Milovidov
051decfb75 Merge branch 'master' of github.com:yandex/ClickHouse 2019-01-02 18:03:56 +03:00
Alexey Milovidov
e33e5150b7 Miscellaneous [#CLICKHOUSE-2] 2019-01-02 09:44:36 +03:00
Amos Bird
df5b735894 Better writeInt 2019-01-01 19:36:50 +08:00
proller
300bbdfb43 Fix cyclic lib depend ppart 2: clean 2018-12-28 21:15:26 +03:00
proller
0c78ef8573 Fix cyclic lib depend (make clickhouse_compression lib) 2018-12-28 20:27:53 +03:00
alexey-milovidov
d16447c3f4
Merge pull request #3899 from yandex/custom_compression_codecs 
Custom compression codecs
 2018-12-28 08:29:09 +03:00
proller
a75d8794ef Merge remote-tracking branch 'upstream/master' into fix10 2018-12-27 21:21:20 +03:00
proller
1a0a879a51 Build fixes 2018-12-27 18:23:37 +03:00
Alexey Milovidov
2e323192a2 Addition to prev. revision #3926 2018-12-27 03:02:11 +03:00
Alexey Milovidov
15a218f951 Fixed UB #3926 2018-12-26 09:03:18 +03:00
Alexey Milovidov
3d3385139b Fixed error #3926 2018-12-26 07:09:24 +03:00
Alexey Milovidov
ee953b4653 Fixed UB (requires performance testing) #3569 2018-12-26 03:31:51 +03:00
alesapin
6e8ed0c942 Merge branch 'master' into custom_compression_codecs 2018-12-25 14:34:19 +03:00
alesapin
c91687f9d7 Small refactoring 2018-12-25 13:35:46 +03:00
Alexey Milovidov
66a0c1691d Added more formats to "parseDateTimeBestEffort" function [#CLICKHOUSE-2] 2018-12-24 21:28:41 +03:00
alesapin
bbdfc77f21
Update CachedCompressedReadBuffer.h 2018-12-24 19:12:25 +03:00
alesapin
6f7333840a Move header with compression info to another place 2018-12-21 16:25:39 +03:00
alesapin
7c11455bd3 Remove compression settings 2018-12-21 15:17:30 +03:00
alesapin
5b23210062 Merge branch 'master' into custom_compression_codecs 2018-12-21 11:57:21 +03:00
Alexey Milovidov
980d6d9e46 Fixed error in "regexpQuoteMeta" function #3826 2018-12-20 21:16:06 +03:00
alesapin
aee6c0a606 Remove dump code 2018-12-20 20:37:02 +03:00
alesapin
512fe3c854 Refactoring (sanitizer failure) 2018-12-19 20:20:18 +03:00
alesapin
5c30bd2384 Compilable code 2018-12-13 13:25:11 +03:00
zhang2014
6d0c4eaf89 ISSUES-838 add lz4、none、zstd codec 2018-12-13 12:10:34 +08:00
alesapin
80b49e4c0a Add integration test, put dependent libs to contrib, slightly refine 
code.
 2018-12-07 14:41:24 +03:00
alesapin
03ce4c5bc5
Merge branch 'master' into master 2018-12-03 13:02:34 +03:00
Alexey Milovidov
2cf627457a Fixed error #3720 2018-12-01 05:38:54 +03:00
Alexey Milovidov
be80b7b188 Added suggestion from Nikolay Kochetov #3720 2018-11-30 22:47:47 +03:00
Alexey Milovidov
35f6fb5ae6 Avoid memory over-allocation when large value of "max_query_size" is specified [#CLICKHOUSE-4169] 2018-11-30 18:36:41 +03:00
proller
dd2371e071 CLICKHOUSE-4137 DictionaryFactory, DictionarySourceFactory (#3653) 
* Split ComplexKeyCacheDictionary to faster compile (part2)

* Dictionaries as lib WIP

* wip

* clean

* Fix build with old capnp

* fix

* wip

* fixes

* fix

* clean

* clean

* clean

* wip

* wip

* wip

* flat

* wip

* cache

* clean

* wip

* faster

* fix style

* fixes

* clean

* clean

* Split CacheDictionary.cpp for faster compile

* fix

* fix

* Less memory usage while compiling

* missing file

* format

* Update registerDictionaries.h

* clean
 2018-11-28 14:37:12 +03:00
Alexey Milovidov
2115c31dda Fixed wrong exception message [#CLICKHOUSE-2] 2018-11-26 20:11:04 +03:00
Alexey Milovidov
c77930fe30 Whitespaces [#CLICKHOUSE-2] 2018-11-26 03:56:50 +03:00
chenxing.xc
ff6e849c0f address review comments | 2018-11-25 12:22:01 +08:00
Alexey Milovidov
141e9799e4 Fixed error with "extractURLParameter" function (read after buffer); improved performance; added support for zero bytes in URLs; renamed Chars_t type [#CLICKHOUSE-2] 2018-11-25 03:08:50 +03:00
Alexey Milovidov
7d6fffff48 More style checks [#CLICKHOUSE-3] 2018-11-24 04:48:06 +03:00
alexey-milovidov
507990d5f2
Merge branch 'master' into master 2018-11-23 23:41:38 +03:00
Alexey Milovidov
dbbacf4f87 Added more style checks [#CLICKHOUSE-3] 2018-11-23 21:52:00 +03:00
alesapin
7f40494330 Enable keep alive only with patched poco 2018-11-23 12:24:59 +03:00
alexey-milovidov
3729c4e532
Update ReadBufferFromHDFS.h 2018-11-23 03:20:33 +03:00
alexey-milovidov
2c2d75cceb
Don't allow exceptions without code (#3645) 
* Don't allow exceptions without code #3633

* Don't allow exceptions without code #3633
 2018-11-23 00:19:58 +03:00
Alexey Milovidov
a5d1fc0ca7 Removed unused constructor #3633 2018-11-22 21:09:17 +03:00
proller
1d40c2c871 Better link and deps (#3631) 
* try fix 1

* Better deps

* fix

* fix

* fix

* Update CMakeLists.txt

* Update CMakeLists.txt

* fix

* fix

* fix

* disable old

* Update find_odbc.cmake
 2018-11-21 22:20:27 +03:00
alexey-milovidov
7a98d55415
Update ReadBufferFromHDFS.h 2018-11-20 21:31:21 +03:00
alesapin
f08e090bda Better uri scheme check and fix in poco submodule 2018-11-20 20:21:32 +03:00
alesapin
01e2137364 CLICKHOUSE-4112: Add keepalive for http connections 2018-11-20 16:15:44 +03:00
chenxing.xc
76843c2dc0 hdfs read support 2018-11-19 16:17:09 +08:00
alexey-milovidov
e7fb653d0c
Update HTTPCommon.cpp 2018-11-19 01:20:36 +03:00
alexey-milovidov
f35d300d33
Update HTTPCommon.cpp 2018-11-19 01:15:42 +03:00
alesapin
2a4a8d180b Try to change stupid naming 2018-11-16 16:33:43 +03:00
alesapin
d4ce674b93 Add http connection pool between replicas 2018-11-16 16:15:17 +03:00
alesapin
bdb473b425 Fix AIO unknown compression method when merge tree has mark to last byte of file 2018-11-06 20:29:31 +03:00
CurtizJ
7963e952f1 rename setting to tcp_keep_alive 2018-10-23 02:02:57 +03:00
CurtizJ
a05aa5448d add setting keep_alive 2018-10-22 21:09:55 +03:00
Alexey Milovidov
681929cbda Attempt to fix performance regression while parsing JSONEachRow #3223 2018-10-10 00:32:15 +03:00
proller
ec11bef633
Build fixes (#3181) 2018-09-28 17:53:20 +03:00
Alexey Milovidov
599ec4c577 Merge branch 'veloman-yunkan-jsoneachrow_import_nested' 2018-09-17 23:36:01 +03:00
Alexey Milovidov
8852660b24 Merge branch 'jsoneachrow_import_nested' of https://github.com/veloman-yunkan/ClickHouse into veloman-yunkan-jsoneachrow_import_nested 2018-09-17 23:26:43 +03:00
alexey-milovidov
006119b81d
Merge pull request #3155 from yandex/fix-float-parsing-with-custom-csv-delimiter 
Fix float parsing with custom csv delimiter
 2018-09-17 22:39:45 +03:00
Alexey Milovidov
c00147f37d Fixed parsing of floats in CSV file with custom delimiter #3142 2018-09-17 21:17:30 +03:00
chertus
7db097a49a support e-notation for decimal input [issue-3135] 2018-09-17 20:07:38 +03:00
proller
d752d5d62d Prepare to new poco, build fixes (#3072) 
* WIp

* fix

* fix

* test

* fix poco netssl find

* clean

* fixes

* wip

* wip

* new poco

* fixes

* Fixes

* wip

*  clean

* clean

*     clean

* clean

* Update HTTPHandlerFactory.h
 2018-09-14 22:48:51 +03:00
Veloman Yunkan
47eb0e28b3 Nested JSON data is mapped to nested table data 2018-09-14 12:15:32 +00:00
chertus
dd5c55df2c decimal sum [CLICKHOUSE-3765] 2018-09-11 21:42:06 +03:00
proller
db13ef96d6 Fix ssl init (#3056) 
* Try to fix ../libs/libglibc-compatibility/glibc-compatibility.c:151: multiple definition of `explicit_bzero'
contrib/ssl/crypto/libcrypto.a(explicit_bzero.c.o):../contrib/ssl/crypto/compat/explicit_bzero.c:16: first defined here

* Fix ssl init

* fix

* noncopyable

* clean
 2018-09-06 21:05:33 +03:00
Alexey Milovidov
2332bf1a50 Code consistency [#CLICKHOUSE-3943] 2018-09-04 22:34:34 +03:00
Alexey Milovidov
d10f9200b9 Consistency of FileOpen event [#CLICKHOUSE-3943] 2018-09-04 22:24:45 +03:00
alexey-milovidov
72c799ad76
Merge pull request #3008 from 4ertus2/decimal 
even more Decimal
 2018-09-03 07:19:33 +03:00
Alexey Milovidov
538edbb8e2 Addition to prev. revision [#CLICKHOUSE-2] 2018-09-02 06:33:48 +03:00
Alexey Milovidov
fc27be314b Avoid temporary nullptr references [#CLICKHOUSE-2] 2018-09-02 06:00:04 +03:00
Alexey Milovidov
f7107f12b4 Merge branch 'master' into extra-warnings 2018-09-02 03:13:36 +03:00
Alexey Milovidov
8eb746b216 Documentation for ProfileEvents (draft) #3010 2018-09-02 02:13:17 +03:00
chertus
fe1e3300b7 remove dirty code [CLICKHOUSE-3765] 2018-08-31 20:36:27 +03:00
alexey-milovidov
a05cdfbb45
Merge branch 'master' into extra-warnings 2018-08-31 03:03:44 +03:00
Alexey Milovidov
5df5df8971 utils/check-style/check-style -n 2018-08-31 00:13:34 +03:00
Alexey Milovidov
06053d9c1f Added comments #2980 2018-08-30 23:12:15 +03:00
alexey-milovidov
e0b1b5ff78
Merge pull request #2980 from amosbird/memcpySmall 
Padding for IO buffers.
 2018-08-30 22:53:47 +03:00
chertus
7bac9698f6 fix build 2018-08-29 16:24:33 +03:00
chertus
a69c936b44 improve field visitors for UUID CLICKHOUSE-3249 2018-08-29 14:58:40 +03:00
Amos Bird
8851fbcab2 Padding for IO buffers. 
Testing data

```
select 'aaaaaaaa','bbbbbbbb','cccccccc','dddddddd','eeeeeeee','ffffffff','gggg','hhh' from numbers(3000000) into outfile '/tmp/test.tsv'
```

Testing command
```
echo "select count() from file('/tmp/test.tsv', CSV, 'a String, b String, c String, d String, e String, f String, g String, h String') where not ignore(e)" | clickhouse-benchmark
```

TSV parser has less overhead than CSV, using it would better unveil the benefits of memcpySmall.

Before
```
QPS: 1.662, RPS: 4985463.906, MiB/s: 603.823, result RPS: 1.662, result MiB/s: 0.000.
0.000%  0.559 sec.
10.000% 0.564 sec.
20.000% 0.568 sec.
30.000% 0.572 sec.
40.000% 0.575 sec.
50.000% 0.581 sec.
60.000% 0.592 sec.
70.000% 0.624 sec.
80.000% 0.639 sec.
90.000% 0.664 sec.
95.000% 0.686 sec.
99.000% 0.711 sec.
99.900% 0.715 sec.
99.990% 0.716 sec.
```

After
```
QPS: 1.861, RPS: 5582303.107, MiB/s: 676.110, result RPS: 1.861, result MiB/s: 0.000.
0.000%  0.510 sec.
10.000% 0.514 sec.
20.000% 0.517 sec.
30.000% 0.521 sec.
40.000% 0.523 sec.
50.000% 0.527 sec.
60.000% 0.530 sec.
70.000% 0.539 sec.
80.000% 0.558 sec.
90.000% 0.584 sec.
95.000% 0.589 sec.
99.000% 0.608 sec.
99.900% 0.655 sec.
99.990% 0.663 sec.
```
 2018-08-29 09:39:44 +08:00
alexey-milovidov
a5d7097c08
Merge pull request #2977 from amosbird/sse2csv 
Enable sse2 for CSV parsing.
 2018-08-29 03:04:17 +03:00
chertus
6a02b18b93 field visitors for UUID CLICKHOUSE-3249 2018-08-28 21:36:41 +03:00
Amos Bird
8d6a26b8df Enable sse2 for CSV parsing. 
Testing data

```
select 'aaaaaaaa,bbbbbbbb,cccccccc,dddddddd,eeeeeeee,ffffffff,gggg,hhh' from numbers(3000000) into outfile '/tmp/test.csv'
```

Testing command
```
echo "select count() from file('/tmp/test.csv', CSV, 'a String, b String, c String, d String, e String, f String, g String, h String') where not ignore(e)" | clickhouse-benchmark

```

Before
```
QPS: 1.317, RPS: 3949749.687, MiB/s: 478.380, result RPS: 1.317, result MiB/s: 0.000.
0.000%  0.704 sec.
10.000% 0.712 sec.
20.000% 0.718 sec.
30.000% 0.726 sec.
40.000% 0.739 sec.
50.000% 0.754 sec.
60.000% 0.770 sec.
70.000% 0.788 sec.
80.000% 0.798 sec.
90.000% 0.815 sec.
95.000% 0.826 sec.
99.000% 0.850 sec.
99.900% 0.857 sec.
99.990% 0.858 sec.
```

After
```
QPS: 1.533, RPS: 4598308.336, MiB/s: 556.932, result RPS: 1.533, result MiB/s: 0.000.
0.000%  0.626 sec.
10.000% 0.635 sec.
20.000% 0.639 sec.
30.000% 0.642 sec.
40.000% 0.643 sec.
50.000% 0.645 sec.
60.000% 0.649 sec.
70.000% 0.652 sec.
80.000% 0.658 sec.
90.000% 0.682 sec.
95.000% 0.710 sec.
99.000% 0.727 sec.
99.900% 0.733 sec.
99.990% 0.734 sec.
```
 2018-08-28 19:46:11 +08:00
Alexey Milovidov
24bd803c07 Whitespaces #2758 2018-08-27 22:06:32 +03:00
Alexey Milovidov
d4ea8bdb88 Merge remote-tracking branch 'origin/master' into extra-warnings 2018-08-27 20:18:39 +03:00
alexey-milovidov
98148d914c
Merge pull request #2958 from blahgeek/skip-json-object 
Skip object fields on json input
 2018-08-27 20:07:32 +03:00
Alexey Milovidov
486d87ebcd Merge remote-tracking branch 'origin/master' into extra-warnings 2018-08-27 20:01:33 +03:00
chertus
ee873c8e9f Merge branch 'master' into decimal 2018-08-27 19:18:48 +03:00
alexey-milovidov
7de0549879
Update ReadHelpers.h 2018-08-27 18:00:08 +03:00
alexey-milovidov
01f01b1ee1
Update ReadHelpers.cpp 2018-08-27 17:54:58 +03:00
BlahGeek
739119d355 skip object fields on json input 2018-08-27 12:01:47 +08:00
Alexey Milovidov
eed804ba94 Enabling extra warnings [#CLICKHOUSE-2] 2018-08-26 15:38:45 +03:00
Alexey Milovidov
281faa1686 Enabling -Wshadow [#CLICKHOUSE-2] 2018-08-26 05:13:41 +03:00
Alexey Milovidov
8a0239b6ad Enabling -Wshadow [#CLICKHOUSE-2] 2018-08-26 05:08:35 +03:00
Alexey Milovidov
a1a70d4a65 Enabling -Wzero-as-null-pointer-constant [#CLICKHOUSE-2] 2018-08-26 04:56:34 +03:00
Alexey Milovidov
44e848856e Enabling -Wunused-exception-parameter [#CLICKHOUSE-2] 2018-08-26 04:33:20 +03:00
Alexey Milovidov
2ce783e016 Merge branch 'read' of https://github.com/amosbird/ClickHouse into amosbird-read 2018-08-26 02:55:22 +03:00
alexey-milovidov
00404a911c
Update VarInt.h 2018-08-26 02:46:18 +03:00
Amos Bird
a589230249 Faster path for varint read. 
clickhouse-benchmark <<< 'select count() from s where not ignore(s);'

before this patch:

```

QPS: 0.732, RPS: 2346562049.608, MiB/s: 22378.560, result RPS: 0.732, result MiB/s: 0.000.
0.000%  1.310 sec.
10.000% 1.321 sec.
20.000% 1.327 sec.
30.000% 1.337 sec.
40.000% 1.343 sec.
50.000% 1.359 sec.
60.000% 1.366 sec.
70.000% 1.381 sec.
80.000% 1.400 sec.
90.000% 1.434 sec.
95.000% 1.448 sec.
99.000% 1.489 sec.
99.900% 1.499 sec.
99.990% 1.500 sec.

```

after this patch:

```
QPS: 0.787, RPS: 2524560389.064, MiB/s: 24076.084, result RPS: 0.787, result MiB/s: 0.000.
0.000%  1.228 sec.
10.000% 1.232 sec.
20.000% 1.235 sec.
30.000% 1.241 sec.
40.000% 1.246 sec.
50.000% 1.256 sec.
60.000% 1.265 sec.
70.000% 1.278 sec.
80.000% 1.296 sec.
90.000% 1.321 sec.
95.000% 1.354 sec.
99.000% 1.421 sec.
99.900% 1.453 sec.
99.990% 1.456 sec.
```

I also tried a SSE2 implementation and it's much slower (50%)
 2018-08-26 02:23:26 +08:00
Amos Bird
9623e59870 Simplify read helpers. 
Use similar APIs like https://en.cppreference.com/w/cpp/string/byte/strstr
 2018-08-26 01:27:28 +08:00
Amos Bird
5f03082af9 Make sure BufferBase is fully swapped. 2018-08-25 19:58:16 +08:00
chertus
54a3c028c5 Merge branch 'master' into decimal 2018-08-24 14:19:41 +03:00
Alexey Milovidov
080b0f7f1f Speed up fuzz tests, part 2 #2924 2018-08-24 10:35:53 +03:00
Alexey Milovidov
a2fefa1617 Speed up fuzz tests, part 2 #2924 2018-08-24 10:30:53 +03:00
Alexey Milovidov
1437e5cbe3 Fix style [#CLICKHOUSE-2] 2018-08-24 03:07:25 +03:00
chertus
1467ca5610 decimal field visitors CLICKHOUSE-3765 2018-08-23 22:11:31 +03:00
proller
b6dabaacb3 Merge remote-tracking branch 'upstream/master' into fix3 2018-08-22 15:22:58 +03:00
Alexey Milovidov
a1d745888d Dummy implementation for non-Linux platforms #2482 2018-08-22 08:56:06 +03:00
Alexey Milovidov
43f1f70c9b Code cleanups #2482 2018-08-22 03:24:55 +03:00
proller
300457da7a fix 2018-08-21 21:35:47 +03:00
proller
fc2925b567 Squashed commit of the following: 
commit 2722e540abfee4a527d716474c4ca582eceeee08
Merge: b4f3af824 aebddd550
Author: proller <proller@github.com>
Date:   Tue Aug 21 18:34:18 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit b4f3af824b88a8b6826583bb483730827574e8ad
Author: proller <proller@github.com>
Date:   Tue Aug 21 17:00:20 2018 +0300

    fix

commit 3a18fa7ded2a7d6b7a0883a1b9c2d6b99360837d
Author: proller <proller@github.com>
Date:   Tue Aug 21 16:57:17 2018 +0300

    fix

commit 5d42220c2cf47e1a86bdc73dbfc24b68f8626891
Author: proller <proller@github.com>
Date:   Tue Aug 21 16:50:21 2018 +0300

    freebsd fixes

commit 7baf4fb5ba4575f79b0d12a9ffaaabd34e1006da
Author: proller <proller@github.com>
Date:   Tue Aug 21 16:17:19 2018 +0300

    fix

commit e1fe707fd765b841a8d0952d91a980128cbf91d0
Author: proller <proller@github.com>
Date:   Tue Aug 21 15:35:21 2018 +0300

    fix

commit 027887c71b3ffa98d9473d50d8c3b79cbf3304ac
Author: proller <proller@github.com>
Date:   Tue Aug 21 15:25:57 2018 +0300

    fix

commit 81af41bfcfff7c02fe4060196cf03c2d2aab416e
Author: proller <proller@github.com>
Date:   Tue Aug 21 15:20:41 2018 +0300

    fix

commit 93d572c85d9c7e331254999a614c3b22b5573b02
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:58:07 2018 +0300

    SPLIT_SHARED

commit dd5b8990d8527d59b1e890943d80c2bf27c613ce
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:52:39 2018 +0300

    fix

commit 4840ca12ab752a38c1ef482e8ec59c5859bb48d7
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:46:31 2018 +0300

    fix

commit abde633beb86f2a0d025d6fcf079965dbd827b92
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:25:32 2018 +0300

    fix

commit 0d94a5476a5ba8ba5e88638d58f2cfbf2b4b662d
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:45:18 2018 +0300

    Travis: try fail on ninja fail

commit c2686f90b68255c2beb0a708804aef404e80a6d2
Merge: 2c3427bbd 2aa7eb463
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:25:15 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 2c3427bbdb861edbb188ed4621e8a05cafaedafb
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:57:24 2018 +0300

    fix

commit 530170c6a81d31dcfa81230e48520383234df4bc
Merge: 9abec162c f6e4ec970
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:57:03 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 9abec162cb2e09bbc2f33cbe80fe76791f6e5a77
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:49:58 2018 +0300

    Apple fixes

commit 36d05e8217440fbc8ae21571b06d4eb6d679d538
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:25:05 2018 +0300

    apple fix

commit aeec3e845e4456e89fbb1b1af6f9f36820a46e33
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:20:06 2018 +0300

    fixes

commit 427961d916a5954981e47d94733996deb2a616ce
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:11:11 2018 +0300

    fix

commit a7dd55ff8f653624c0f3dbcbc54defd3b3ae97af
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:41:53 2018 +0300

    fix

commit 6200e0d315c7a62bae63a8de0fc32f7937770ad2
Merge: 8a541d7e6 21cedbe46
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:35:49 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 8a541d7e64c89e2c16af6c909e0353361153aaa3
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:34:32 2018 +0300

    Do not use poco types

commit fd560f43d048b7e3307c6c6b9c9d9918230014d8
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:20:42 2018 +0300

    Try fix apple build

commit cfb2eba07ac06f19e822d3474341d800b1f98cf1
Merge: 8d2e31c90 5b81fdfc0
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:03:24 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 8d2e31c908be2e99d09e2a9dde2414ab82a5e93c
Author: proller <proller@github.com>
Date:   Mon Aug 20 21:56:06 2018 +0300

    travis: TEST_SERVER_STARTUP_WAIT=10
 2018-08-21 18:56:50 +03:00
Alexey Milovidov
f1ba2f9a33 Try to fix "query in form data" feature while still tracking limits for external tables (try №2) #2482 2018-08-20 05:23:35 +03:00
Alexey Milovidov
1802b00c0b Fixed bad arithmetic; miscellaneous #2482 2018-08-19 07:25:53 +03:00
Alexey Milovidov
acb99b49df Merge branch 'master' into CLICKHOUSE-2910 2018-08-14 23:29:42 +03:00
Alexey Milovidov
979154122f Changed strange name #2846 2018-08-14 22:34:25 +03:00
chertus
21fe103831 fix clang build 2018-08-14 22:16:56 +03:00
chertus
15cdd7b2bd make clang happy 2018-08-14 17:19:58 +03:00
alexey-milovidov
f538bd2113
Merge branch 'master' into decimal 2018-08-13 11:57:42 +03:00
Alexey Milovidov
7e50c88538 Added test case [#CLICKHOUSE-3891] 2018-08-13 07:35:12 +03:00
Alexey Milovidov
36db216abf Preparation for extra warnings [#CLICKHOUSE-2] 2018-08-10 07:02:56 +03:00
Alex Bocharov
e8d4654419 Remove FormatSettings default value for writeJSONString and add tests for output_format_json_escape_forward_slashes. 2018-08-08 02:35:32 +03:00
alexey-milovidov
0a4d07b995 Update WriteHelpers.h 2018-08-08 02:35:32 +03:00
Alex Bocharov
a8818bb8af Add output_format_json_escape_slashes setting - controls escaping slashes for string outputs in JSON output format. 2018-08-08 02:35:32 +03:00
chertus
de68022fc5 rewrite Decimal with own data type 2018-08-07 16:57:28 +03:00
chertus
c590a74981 Merge branch 'master' into decimal 2018-08-06 13:38:18 +03:00
Alexey Milovidov
e523f9a2c8 Fixed names [#CLICKHOUSE-2] 2018-08-05 11:54:57 +03:00
Alexey Milovidov
1b1754e598 Fixed build #2794 2018-08-04 00:13:54 +03:00
chertus
582f76c83b string to decimal, decimal to string, check decimal bounds 2018-07-30 21:10:38 +03:00
chertus
b9fd87eff7 Merge branch 'master' into decimal 2018-07-27 20:31:33 +03:00
alesapin
6abbfbce87 CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol 2018-07-26 18:10:57 +03:00
chertus
c1c149d74b decimal comparisons 2018-07-25 22:38:21 +03:00
chertus
02f016579c decimal (de)serialization (in progress) 2018-07-23 23:19:26 +03:00
chertus
5ec47b4a1c decimal (in progress) 2018-07-20 22:05:07 +03:00
Alexey Milovidov
245b114363 Quote all identifiers when querying external database #2635 2018-07-20 03:04:48 +03:00
Alexey Milovidov
a32c2e14a6 Removed unused method that became incompatible [#CLICKHOUSE-2] 2018-07-18 20:16:04 +03:00
alexey-milovidov
4b31f389b7 Update BufferBase.h 2018-07-17 19:41:41 +03:00
Amos Bird
c3c762cde7 Fast path for stringify float points. 2018-07-17 19:41:41 +03:00
Alexey Milovidov
6ba5b3bd82 Fixed warning [#CLICKHOUSE-2] 2018-07-16 09:09:27 +03:00
Alexey Milovidov
317807f03d Fixed warning [#CLICKHOUSE-2] 2018-07-16 09:08:39 +03:00
Alexey Milovidov
eee02143a8 Implemented more accurate CAST from String to Nullable of Date and DateTime #1322 2018-07-16 03:30:13 +03:00
Alexey Milovidov
297805f719 Implemented toOrZero, toOrNull functions for Date and DateTime arguments (incomplete) #1322 2018-07-16 03:30:13 +03:00
proller
5384504fa2 More information in 'Cannot read all data' errors 2018-07-13 22:06:26 +03:00
alexey-milovidov
53f9ae3cf1 Update CompressedReadBufferBase.cpp 2018-07-13 06:41:18 +03:00
proller
9d0b6bffe4 Better error: Print checksums if they mismatch 2018-07-13 06:41:18 +03:00
Alexey Milovidov
2f4605e7da Fixed build #2627 2018-07-11 15:50:23 +03:00
alexey-milovidov
e0ce1aac56 Update WriteBufferFromOStream.cpp 2018-07-10 23:46:10 +03:00
alexey-milovidov
ba25b84e6d Update WriteBufferFromOStream.cpp 2018-07-10 23:46:10 +03:00
alexey-milovidov
401c48272d Update WriteBufferFromOStream.h 2018-07-10 23:46:10 +03:00