Avogar
2a923f434f
Fix build errors
2020-06-20 01:32:57 +03:00
Avogar
f6ab431f2f
Change String type to Binary
2020-06-19 17:50:44 +03:00
Avogar
07ad947c1d
Add arrays support
2020-06-19 17:21:35 +03:00
Mikhail Filimonov
9609bd9dee
Kafka better states, formats based on PeekableReadBuffer, and other minor fixes.
...
Add formats tests, fixes for JSONCompactEachRowWithNamesAndTypes, TSVWithNamesAndTypes. Some CR fixes
Add sanitizing for kafka_max_block_size and kafka_poll_max_batch_size
2020-06-19 10:49:05 +02:00
Avogar
71b5d267ce
Set compression to None
2020-06-18 21:02:13 +03:00
Avogar
75a66fbba3
Fix errors 2
2020-06-18 15:52:46 +03:00
Avogar
4fd3bcd823
Fix build errors
2020-06-18 03:17:08 +03:00
Avogar
7780a74bd8
Update ORCBlockOutputFormat and add orc include directory in include path
2020-06-17 22:32:11 +03:00
Alexander Tokmakov
3938b051c2
fix type duduction in values format
2020-06-17 16:21:06 +03:00
Avogar
93aee32ae4
Add ORCBlockOutputFormat
2020-06-14 18:35:32 +03:00
Alexander Kuzmenkov
435f53e05a
Improve error messages
...
Also support fmt for exception messages, the same way we use it in
logging macros.
2020-06-04 20:50:29 +03:00
Alexey Milovidov
6fea843d88
Fix Mac OS build
2020-06-02 16:56:03 +03:00
Alexey Milovidov
933644b8e4
Fix clang-tidy
2020-06-02 16:53:34 +03:00
Alexey Milovidov
cd07d61ce7
Updated tests
2020-06-02 05:39:21 +03:00
Alexey Milovidov
d34b1a8791
Merge branch 'master' into improve-performance-of-client-interactive-mode
2020-06-02 04:24:17 +03:00
Alexey Milovidov
c901a657f8
Improvement
2020-06-01 01:17:40 +03:00
Alexey Milovidov
a76bd99e84
Added setting "output_format_pretty_max_value_width"
2020-06-01 01:12:13 +03:00
Alexey Milovidov
2895cfb480
Limit value width in Pretty formats
2020-05-31 22:22:59 +03:00
Alexey Milovidov
25f941020b
Remove namespace pollution
2020-05-31 00:57:37 +03:00
Alexey Milovidov
5aff138956
Preparation for structured logging
2020-05-31 00:35:52 +03:00
MovElb
b4b5c90343
squash
2020-05-30 20:05:05 +03:00
Alexander Kuzmenkov
ac263f921e
Merge remote-tracking branch 'origin/master' into HEAD
2020-05-27 15:51:03 +03:00
Alexander Kuzmenkov
ad93644254
make single if
2020-05-27 15:50:12 +03:00
Alexander Kuzmenkov
c1cfc68cd6
revert accidental changes
2020-05-27 15:46:49 +03:00
Alexander Kuzmenkov
f54c892b49
Update src/Processors/Formats/Impl/ArrowBlockInputFormat.h
2020-05-27 15:41:59 +03:00
Alexander Kuzmenkov
61f833efc1
Update src/Processors/Formats/Impl/ArrowBlockInputFormat.h
2020-05-27 15:41:52 +03:00
Alexander Kuzmenkov
81a5af1938
Update src/Processors/Formats/Impl/ArrowBlockInputFormat.h
2020-05-27 15:41:45 +03:00
hcz
f2e3bcdd15
Improve code style in src and test files of Arrow formats
2020-05-25 10:50:55 +08:00
Alexey Milovidov
7e1813825b
Return old names of macros
2020-05-24 01:24:01 +03:00
Alexey Milovidov
9d2a0d2dd7
Apply all transformations again
2020-05-23 21:59:49 +03:00
Alexey Milovidov
a2ad11897f
Remove duplicate whitespaces (preparation)
2020-05-23 21:53:58 +03:00
Alexey Milovidov
1f13515a65
Make all LOG in single line (preparation)
2020-05-23 21:31:37 +03:00
Alexey Milovidov
ee4ffbc332
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/'
2020-05-23 19:47:56 +03:00
hcz
ab37791134
Fix arrow stream termination
2020-05-21 15:28:10 +08:00
hcz
e11fa03bdd
Add ArrowStream input and output format
2020-05-21 12:07:47 +08:00
Azat Khuzhin
d93b9a57f6
Forward declaration for Context as much as possible.
...
Now after changing Context.h 488 modules will be recompiled instead of 582.
2020-05-21 01:53:18 +03:00
Nikolai Kochetov
4d0503f021
Make IColumn::mutate() static.
2020-05-14 11:30:18 +03:00
Alexey Milovidov
fd26550a70
Remove commented code before merge #10580
2020-05-10 03:41:52 +03:00
Alexey Milovidov
d9257a8682
Merge branch 'arrow-io-format' of https://github.com/FawnD2/ClickHouse into FawnD2-arrow-io-format
2020-05-10 03:26:10 +03:00
Ivan
85d783c247
Poco contrib refactoring ( #10396 )
...
* Remove config_common.h
* Refactor libcpuid contrib
* Remove support for libcpuinfo
* Define USE_CPUID in Arcadia
* Refactor Poco libraries
2020-05-08 17:11:19 +03:00
FawnD2
19022cb670
Remove redundant includes. Style fix
2020-05-05 15:56:54 +03:00
FawnD2
aaf4f4ad61
Add missing Float16 for parquet format
2020-05-05 04:46:04 +03:00
FawnD2
2f8435813c
Remove unused stream
2020-05-04 17:49:13 +03:00
FawnD2
da0a908d27
Remove unused stream
2020-05-04 17:47:09 +03:00
FawnD2
b492e92d41
Remove extra check
2020-05-04 17:32:36 +03:00
FawnD2
182de47012
Use file reader for Arrow format
2020-05-04 17:30:42 +03:00
FawnD2
6d6d04903f
Remove check
2020-05-04 16:33:20 +03:00
FawnD2
a044766d58
Remove check
2020-05-04 16:26:20 +03:00
FawnD2
17450811d4
Move getHeader at the beginning of generate()
2020-05-04 16:19:25 +03:00
FawnD2
83148289d8
Rename arg
2020-05-04 16:01:37 +03:00
FawnD2
7b23844b32
Common order of precompiled checks
2020-05-04 03:58:10 +03:00
FawnD2
02e12215e7
Apply reducing memory usage optimization for seekable files to ORC format
2020-05-04 03:52:28 +03:00
FawnD2
a554177724
Simplify ORC format
2020-05-04 02:23:20 +03:00
FawnD2
112758b99d
Merge branch 'master' into arrow-io-format
2020-05-04 00:53:17 +03:00
FawnD2
2359ba3497
Correct stop condition
2020-05-03 22:59:19 +03:00
FawnD2
6b2e97fd56
Increate total read length while reading
2020-05-03 22:54:28 +03:00
FawnD2
b4898bdd19
Read single batch
2020-05-03 22:49:06 +03:00
FawnD2
a8d914a811
Read full table
2020-05-03 22:22:41 +03:00
FawnD2
b86562b8bc
Style fixes
2020-05-03 21:29:04 +03:00
FawnD2
7cc7a87f9f
Simplify interfaces
2020-05-03 21:12:14 +03:00
FawnD2
a590826fbb
Format settings for Arrow
2020-05-03 15:26:39 +03:00
FawnD2
e5b59616cd
Style fix
2020-05-03 15:25:53 +03:00
Alexey Milovidov
469cdc315b
Added suggestion from @azat #10607
2020-05-03 14:40:37 +03:00
FawnD2
f62f1a5924
Add missed include
2020-05-03 06:08:37 +03:00
FawnD2
6e0b31fb2a
Arrow output format
2020-05-03 05:46:36 +03:00
FawnD2
aeed62d5e7
Remove unused error codes
2020-05-03 04:20:03 +03:00
FawnD2
4d0225f5a9
std::string -> String
2020-05-03 04:15:09 +03:00
FawnD2
f4fe23e3fe
Add ptr wrapper. Fix style
2020-05-03 04:01:05 +03:00
FawnD2
fa1c35753b
Move CH -> Arrow routine converter into separated class
2020-05-03 03:54:39 +03:00
Alexey Milovidov
554e7a0dd2
Preparations
2020-05-02 22:59:07 +03:00
Alexey Milovidov
e6ab4d655b
Fix bad code
2020-05-02 22:54:29 +03:00
Alexey Milovidov
f0e80fec68
Whitespaces
2020-05-02 22:41:01 +03:00
alexey-milovidov
330627f597
Update ArrowBlockInputFormat.h
2020-05-02 22:35:58 +03:00
alexey-milovidov
47e3f83bc8
Update ArrowBlockInputFormat.h
2020-05-02 22:34:34 +03:00
alexey-milovidov
07f824c746
Update ArrowBlockInputFormat.cpp
2020-05-02 22:33:47 +03:00
alexey-milovidov
dfeb76038d
Update ArrowBlockInputFormat.h
2020-05-02 22:32:33 +03:00
alexey-milovidov
fbb280b5ac
Update ArrowBlockInputFormat.cpp
2020-05-02 22:32:21 +03:00
alexey-milovidov
250a44a47f
Merge pull request #10607 from Avogar/json_as_string_format
...
Add JSONAsStringRowInputFormat
2020-05-02 22:17:22 +03:00
Matwey V. Kornilov
d7627fa4fb
Fix capnproto version check for capnp::UnalignedFlatArrayMessageReader
...
capnp::UnalignedFlatArrayMessageReader was introduced in
3aa2b2aa02
(which is a part of 0.7.0 release). Unfortunately,
capnp::UnalignedFlatArrayMessageReader was removed in
3f0fee61c6
(which is a part of 0.8.0 release)
So change CAPNP_VERSION check accordingly.
2020-05-01 22:32:06 +03:00
Avogar
697d5b07ce
Fix build and style errors. Update test.
2020-05-01 19:41:14 +03:00
Avogar
6464a1a902
Add JSONAsStringRowInputFormat
2020-04-30 23:16:09 +03:00
FawnD2
538e6c39da
Arrow input format
2020-04-28 22:52:22 +03:00
alexey-milovidov
436e4e3f5e
Merge pull request #10502 from oandrew/avro-nested2
...
Avro nested fields - support complex types
2020-04-27 13:44:58 +03:00
Andrew Onyshchuk
570be94a48
Use correct type for DateTime64 (ubsan)
2020-04-26 21:10:30 -05:00
alexey-milovidov
c6ae6a7ba8
Merge pull request #10418 from ClickHouse/fix_logical_error_in_diagnostic_info
...
Better diagnostic info in input formats
2020-04-26 20:26:59 +03:00
alexey-milovidov
8820b43606
Merge pull request #10479 from Avogar/markdown_format
...
Markdown format
2020-04-26 03:25:48 +03:00
Andrew Onyshchuk
e7ba75ce98
Avro nested fields - support complex types
2020-04-25 17:42:49 -05:00
Alexander Tokmakov
53dcce55e9
better diagnostic info in input formats
2020-04-24 15:03:48 +03:00
Avogar
778f1aa1e7
Merge branch 'markdown_format' of github.com:avogar/ClickHouse into markdown_format
2020-04-24 14:07:04 +03:00
Avogar
2458da802c
Update MarkdownRowOutputFormat
2020-04-24 14:06:41 +03:00
Alexey Milovidov
03e17405cd
Checkpoint
2020-04-22 10:03:43 +03:00
Alexey Milovidov
603d132d45
Checkpoint
2020-04-22 09:34:20 +03:00
Alexey Milovidov
0a7edce036
Checkpoint
2020-04-22 09:01:33 +03:00
alexey-milovidov
7690c34e5b
Merge pull request #10424 from ClickHouse/tsv-bom-extra-case
...
Allow to parse BOM in TSV if the first column cannot contain BOM in its value
2020-04-22 06:56:43 +03:00
Alexander Kuzmenkov
d1c5e38a21
Merge pull request #10385 from CurtizJ/tuple-literal
...
Parse tuples of tuples as literals
2020-04-22 05:49:14 +03:00
Alexey Milovidov
e8a9c7d518
Allow to parse BOM in TSV if the first column cannot contain BOM in its value
2020-04-22 02:46:42 +03:00
Anton Popov
3ccff833c1
fix ConstantExpressionTemplate with arrays
2020-04-21 15:54:36 +03:00
alexey-milovidov
3d4696d4ef
Update AvroRowInputFormat.cpp
2020-04-20 23:34:48 +03:00
Andrew Onyshchuk
68f2e93443
Fix style
2020-04-18 22:54:22 -05:00
Andrew Onyshchuk
14647ed03b
Add Avro nested fields insert support
2020-04-18 15:46:24 -05:00
alexey-milovidov
d1b72f10d5
Merge pull request #10325 from Avogar/msgpack_format
...
Improve MsgPackRowInputFormat
2020-04-18 14:27:11 +03:00
alexey-milovidov
ef5f83eef8
Update MsgPackRowInputFormat.cpp
2020-04-18 14:26:57 +03:00
Kruglov Pavel
96f4d5b7c6
Fix build error
2020-04-17 23:51:53 +03:00
Kruglov Pavel
0f11526f24
Fix style error
2020-04-17 22:19:03 +03:00
Avogar
b056dbce1c
Improve MsgPackRowInputFormat
2020-04-17 12:35:38 +03:00
alexey-milovidov
17e7d4d88a
Merge pull request #10307 from abyss7/arcadia-4
...
Changes for auto-sync with Arcadia
2020-04-17 05:08:34 +03:00
alexey-milovidov
390bfe9a4c
Merge pull request #10317 from Avogar/markdown_format
...
Markdown format
2020-04-17 05:05:13 +03:00
Kruglov Pavel
2672b71b2d
Delete extra spaces
2020-04-16 23:47:01 +03:00
Avogar
89d787dae3
Add new line at the end of file
2020-04-16 23:14:19 +03:00
Avogar
831c48c514
Add MarkdownRowOutput format
2020-04-16 23:10:42 +03:00
Ivan Lezhankin
e230632645
Changes required for auto-sync with Arcadia
2020-04-16 15:31:57 +03:00
alexey-milovidov
d296e1b6d7
Merge pull request #10216 from Avogar/msgpack_format
...
Update MsgPack format
2020-04-16 00:44:08 +03:00
Avogar
93c322bc30
Fix style error
2020-04-15 02:58:36 +03:00
Avogar
b8061356b0
Update parsing method in MsgPackRowInputFormat
2020-04-15 02:08:55 +03:00
Avogar
e46322fcef
Update MsgPack input format.
2020-04-13 22:33:02 +03:00
Avogar
b9931863ef
Fix FixedString packing
2020-04-13 00:01:17 +03:00
alexey-milovidov
0782052768
Merge pull request #10131 from ClickHouse/fix-extremes-for-processors
...
Fix extremes for processors
2020-04-12 02:31:39 +03:00
Nikolai Kochetov
458c7f516d
Fix extremes for Processors.
2020-04-08 21:50:14 +03:00
Avogar
e635b0e9eb
Fix build error
2020-04-04 20:04:41 +03:00
Avogar
fbc11d3bf9
Move files
2020-04-04 17:04:20 +03:00
Ivan Lezhankin
06446b4f08
dbms/ → src/
2020-04-03 18:14:31 +03:00