Commit Graph

615 Commits

Author SHA1 Message Date
Nikolai Kochetov
9c5ae5f536 Merge branch 'master' into processors-and-storages 2019-10-09 14:12:47 +03:00
Nikolai Kochetov
eb2677c94e Try fix progressbar. 2019-10-09 12:44:24 +03:00
Nikolai Kochetov
ea27918de8 Try fix progressbar. 2019-10-09 12:40:30 +03:00
Nikolai Kochetov
c7bb83262e Fix progress callback for processors pipeline. 2019-10-09 12:33:16 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
Alexander Tokmakov
73aa1d1518 diagnostic info for bad csv delimiters 2019-10-07 19:47:25 +03:00
Alexander Tokmakov
a2c83ac82e add tests 2019-10-07 19:31:30 +03:00
Alexander Tokmakov
32b0b8272c setup csv delimiter in Template format 2019-10-07 19:03:01 +03:00
proller
594c535bd4 Build fixes (#7063)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
2019-10-05 22:25:31 +03:00
Alexander Tokmakov
a90d126b93 support defaults_for_omitted_fields in TSV 2019-10-04 22:44:48 +03:00
Alexander Tokmakov
d936cee836 support null_as_default in most text formats 2019-10-04 22:42:35 +03:00
Nikolai Kochetov
95ec0f7c2d Merged with master. 2019-10-04 20:53:21 +03:00
Nikolai Kochetov
d4f11af817 Update QueryPipeline. 2019-10-04 20:49:14 +03:00
Nikolai Kochetov
23069ca6d0 Progress for MergeTreeSelectProcessor. 2019-10-04 20:50:07 +03:00
Nikolai Kochetov
627d48c19a Added ExecutionSpeedLimits. 2019-10-04 20:49:57 +03:00
Nikolai Kochetov
e48f7faebc Fix MergeTreeRangeReader.
Fix MergeTreeReader.

Fix MergeTreeBaseSelectProcessor.

Better exception message for TreeExecutor.

Added header_without_virtual_columns to MergeTreeBaseSelectProcessor.

Fix MergeTreeReverseSelectProcessor.

Fix MergeTreeDataSelectExecutor.
2019-10-04 20:49:29 +03:00
Nikolai Kochetov
54d32da5a1 Update TreeExecutor. 2019-10-04 20:49:24 +03:00
Nikolai Kochetov
1689576770 Update MergeTreeDataSelectExecutor. 2019-10-04 20:49:14 +03:00
Alexander Tokmakov
ec79e5aa5b refactor null_as_default 2019-10-04 20:19:49 +03:00
tavplubix
d73db7f779
Merge pull request #6781 from ClickHouse/merging_values_with_expressions
Merging Values with expressions
2019-10-04 12:51:22 +03:00
Alexander Kuzmenkov
8e245d4e8c
Merge pull request #7135 from ClickHouse/aku/msan-field
Fix some MemorySanitizer warnings for Fields.
2019-10-03 10:33:44 +03:00
Alexander Tokmakov
a58996817f allow query parameters in Values 2019-10-02 22:54:40 +03:00
Alexander Tokmakov
565c273eaa Merge branch 'master' into merging_values_with_expressions 2019-10-02 20:51:44 +03:00
Alexander Tokmakov
80e5976d10 fixes after review 2019-10-02 20:51:00 +03:00
chertus
3b0d870804 rename function 2019-10-02 15:06:34 +03:00
chertus
c46cc3ff1a refactoring: remove copy-paste 2019-10-01 21:51:33 +03:00
Nikita Mikhaylov
d47d4cd6c1 parallel parsing 2019-10-01 13:48:46 +03:00
Alexander Tokmakov
e267081389 better PeekableReadBuffer interface 2019-09-30 21:21:58 +03:00
Alexander Tokmakov
979f235e38 Merge branch 'master' into merging_values_with_expressions 2019-09-30 18:06:58 +03:00
Alexander Kuzmenkov
ec2d9a083c Remove excessive includes. 2019-09-30 15:31:14 +03:00
alexey-milovidov
e50a874537
Merge pull request #7118 from ClickHouse/improve_template_format
Minor improvements of Template format
2019-09-30 15:00:27 +03:00
Amos Bird
dadc613072 Get rid of malloc symbols in libcommon (#7134) 2019-09-30 14:58:32 +03:00
Ivan
e5a5091556
Revert "Get rid of malloc symbols in libcommon (#7065)" (#7131)
This reverts commit 4cb53093a0.
2019-09-27 16:16:53 +03:00
Amos Bird
4cb53093a0 Get rid of malloc symbols in libcommon (#7065) 2019-09-27 15:19:26 +03:00
tavplubix
c3ed1f38a6
Merge branch 'master' into improve_template_format 2019-09-26 19:19:11 +03:00
Alexander Tokmakov
51ac870540 fix build 2019-09-26 13:49:22 +03:00
Alexander Tokmakov
c31f9c6f9a force inline small functions 2019-09-25 19:08:58 +03:00
Alexander Tokmakov
d642304b1d add CustomSeparated format 2019-09-24 22:56:45 +03:00
Alexander Tokmakov
e197cc8a49 read settings from file 2019-09-24 17:45:04 +03:00
Alexander Kuzmenkov
f3bde19b74 Do not use iterators in find() and emplace() methods of hash tables.
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
2019-09-24 17:44:35 +03:00
Alexander Tokmakov
769d33848b allow specifying column idx in format string 2019-09-23 18:10:48 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
Alexander Tokmakov
447d59bd37 remove unused field 2019-09-23 15:32:49 +03:00
Alexander Tokmakov
0080639f79 Merge branch 'master' into merging_values_with_expressions 2019-09-20 23:26:01 +03:00
Alexander Tokmakov
d353746f2b minor fixes 2019-09-20 22:44:52 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
967e00a8da It works!
if compiled with:

CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
2019-09-20 20:09:22 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole (#6950)
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin
PartialMergeJoin
2019-09-18 16:16:10 +03:00
Ivan Lezhankin
8c356a3830 WIP 2019-09-15 18:20:31 +03:00
Ivan Lezhankin
787c2b8d83 WIP 2019-09-15 13:35:19 +03:00
Alexander Tokmakov
aa10bc99cc improvements 2019-09-13 21:19:14 +03:00
Nikolai Kochetov
1335aa75d7 Added TreeExecutor. 2019-09-13 15:34:05 +03:00
Alexander Tokmakov
2b9a1d6a60 optimize parsing numbers with type check 2019-09-12 23:23:20 +03:00
chertus
bb5287841f make things wrong 2 2019-09-12 21:06:25 +03:00
Nikolai Kochetov
eac45eaf3e More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:57:04 +03:00
Nikolai Kochetov
7a31d967d9 More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:50:51 +03:00
Nikolai Kochetov
ec48361ef0 More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:46:41 +03:00
Nikolai Kochetov
1319168a3a Merge branch 'master' into processors-2 2019-09-12 16:28:51 +03:00
Nikolai Kochetov
9dea55c284 Do not pin sources for non MergeTree tables. 2019-09-12 16:23:24 +03:00
Nikolai Kochetov
1ff30b1621 Update PipelineExecutor. 2019-09-12 16:07:54 +03:00
Nikolai Kochetov
1b906bfeaf Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:22:58 +03:00
Nikolai Kochetov
4ba0ed731f Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:19:54 +03:00
Nikolai Kochetov
d0e84e630a Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:13:34 +03:00
Nikolai Kochetov
7d93d70e94 Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:07:36 +03:00
Alexander Tokmakov
f323476111 Merge branch 'master' into merging_values_with_expressions 2019-09-11 23:31:37 +03:00
Amos Bird
93c0880ca7 Fix non-ssl build. 2019-09-12 04:20:27 +08:00
Alexander Tokmakov
29fe481b06 optimize expression template deduction 2019-09-11 22:55:28 +03:00
Nikolai Kochetov
95abc1f910 Removed dynamic_cast from PipelineExecutor. 2019-09-11 20:06:06 +03:00
Nikolai Kochetov
9916be2800 Small refactor in PipelienExecutor. Added comment in AggregatingTransform. 2019-09-11 19:31:15 +03:00
Nikolai Kochetov
172e4d76d7 Added more comments. 2019-09-11 13:46:41 +03:00
Nikolai Kochetov
8734c8339e Fix race in PipelineExecutor. 2019-09-10 16:12:18 +03:00
Nikolai Kochetov
7b0a6aec05 Fix raice in PipelineExecutor. 2019-09-10 15:14:47 +03:00
Nikolai Kochetov
3646124873 Fix raice in PipelineExecutor. 2019-09-10 14:17:55 +03:00
Nikolai Kochetov
a9d41d580a Fix asan crash in PipelineExecutor. 2019-09-10 12:50:38 +03:00
Nikolai Kochetov
72fea5bf97 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:50:31 +03:00
Nikolai Kochetov
73bda85998 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:45:48 +03:00
Nikolai Kochetov
5165bbd88a Fix asan crash in PipelineExecutor. 2019-09-10 11:03:02 +03:00
proller
54a5b801b7 Build fixes (Orc, ...) (#6835)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)

* wip

* Fix build (orc, ...)

* Missing files

* Try fix

* fix hdfs

* Fix llvm 7.1 find
2019-09-10 00:40:40 +03:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00
Nikolai Kochetov
eeba24b238 Try to fix race in PipelineExecutor. 2019-09-09 20:56:58 +03:00
Nikolai Kochetov
423a5c35e8 Try to fix race in PipelineExecutor. 2019-09-09 20:12:26 +03:00
Nikolai Kochetov
da798142a5 Try to fix race in PipelineExecutor. 2019-09-09 20:10:37 +03:00
Alexander Tokmakov
3643ecc9cd parse expressions near the end of buffer correctly 2019-09-09 20:06:22 +03:00
Nikolai Kochetov
9df1235046 Pin sources to streams in PipelineExecutor. 2019-09-09 19:53:02 +03:00
Nikolai Kochetov
818696a9a7 Pin sources to streams in PipelineExecutor. 2019-09-09 19:29:11 +03:00
Nikolai Kochetov
3a849c3c5f Pin sources to streams in PipelineExecutor. 2019-09-09 18:43:19 +03:00
Nikolai Kochetov
c9cca3ba8b Merged with master 2019-09-09 16:20:30 +03:00
Nikolai Kochetov
04d2f32e17 Check thread is joinable in PipelineExecutor. 2019-09-09 15:09:48 +03:00
Alexander Tokmakov
d78c82a8ae fixes 2019-09-06 22:01:44 +03:00
Nikolai Kochetov
3bd5d84ecc Update PipelineExecutor. 2019-09-06 19:04:18 +03:00
Nikolai Kochetov
32cc3a4bee Revert enumerate streams. 2019-09-06 16:28:49 +03:00
Nikolai Kochetov
52305cefbc Merge branch 'merging-aggregated-processors' into processors-2 2019-09-06 15:21:17 +03:00
Nikolai Kochetov
d10b7d7a2b Added ConvertingAggregatedToChunksTransform. 2019-09-06 15:19:59 +03:00
Olga Khvostikova
f90642ce23
Merge pull request #6610 from CurtizJ/merging_with_ties_and_with_fill
WITH TIES modifier for LIMIT and WITH FILL modifier for ORDER BY. (continuation of #5069)
2019-09-05 22:45:48 +03:00
Alexander Tokmakov
196e357250 revert parsing expression near the end of buffer 2019-09-05 16:55:51 +03:00
Alexander Tokmakov
20770a9745 check if some tests fail 2019-09-04 23:27:13 +03:00
Alexander Tokmakov
52fb9585d4 improvements 2019-09-04 22:59:08 +03:00
Alexander Tokmakov
8936f854be better checking of types of literals 2019-09-04 19:54:20 +03:00
Nikolai Kochetov
30155f92bf Try to enumerate streams again. 2019-09-04 17:16:32 +03:00
Nikolai Kochetov
b98676836e Try to enumerate streams again. 2019-09-04 17:06:41 +03:00
Nikolai Kochetov
b9e26d15de Try to enumerate streams again. 2019-09-04 16:17:50 +03:00
Nikolai Kochetov
3a7e7287c0 Update PipelineExecutor. 2019-09-04 15:34:15 +03:00
Nikolai Kochetov
5246be8a17 Update PipelineExecutor. 2019-09-04 12:37:56 +03:00
CurtizJ
9cfcbd6649 fix bug in FillingBlockInputStream 2019-09-04 01:01:09 +03:00
Nikolai Kochetov
73c052f576 Revert PipelineExecutor changes. 2019-09-03 21:05:44 +03:00
Nikolai Kochetov
5113bd3650 Add task stilling to PipelineExecutor. 2019-09-03 15:06:45 +03:00
Nikolai Kochetov
aa9481e76e Add task stilling to PipelineExecutor. 2019-09-03 14:22:34 +03:00
alexey-milovidov
7847de1947
Merge pull request #6629 from CurtizJ/read-in-order-2
Implement 'read in order' optimization with processors.
2019-09-03 14:21:19 +03:00
Nikolai Kochetov
99476d0039 Add task stilling to PipelineExecutor. 2019-09-03 14:15:37 +03:00
CurtizJ
22badef1a2 Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-03 13:47:18 +03:00
Nikolai Kochetov
e55647eee9 Force add resize befor aggregating transform. 2019-09-03 13:14:13 +03:00
CurtizJ
6d821c4877 fix build 2019-09-03 13:07:31 +03:00
Nikolai Kochetov
702c1b03da Revert to LFStack. 2019-09-03 11:42:26 +03:00
CurtizJ
973b533377 Merge remote-tracking branch 'upstream/master' into read-in-order-2 2019-09-03 00:59:51 +03:00
Nikolai Kochetov
52ca3f2b4c Add stream enumeration to Processors. 2019-09-02 20:01:03 +03:00
Nikolai Kochetov
cfbb3ce6f9 Add stream enumeration to Processors. 2019-09-02 19:58:24 +03:00
Nikolai Kochetov
5352ac9145 Add stream enumeration to Processors. 2019-09-02 19:57:06 +03:00
Nikolai Kochetov
1f70aee2e6 Add stream enumeration to Processors. 2019-09-02 19:55:01 +03:00
Alexander Tokmakov
b9eb992320 Merge branch 'master' into merging_values_with_expressions 2019-09-02 19:54:56 +03:00
Alexander Tokmakov
ec5fbf525d remove ValuesRowInputFormat 2019-09-02 19:33:58 +03:00
Alexander Tokmakov
d31358a280 change ValuesBlockInputStream to ValuesBlockInputFormat 2019-09-02 19:26:22 +03:00
Nikolai Kochetov
88044fdc16 Add stream enumeration to Processors. 2019-09-02 18:49:18 +03:00
CurtizJ
e122d54dcb update comments 2019-09-02 18:22:27 +03:00
Alexey Milovidov
402599a38c Merge branch 'master' into time-zone-configuration 2019-09-02 18:13:54 +03:00
Nikolai Kochetov
52eae3a242 Add stream enumeration to Processors. 2019-09-02 17:55:43 +03:00
alexey-milovidov
a71a1693f0
Merge pull request #6777 from yandex/fix-pvs-warning-in-pipeline-executor
Fix PVS warning in PipelineExecutor.
2019-09-02 17:53:28 +03:00
Nikolai Kochetov
0016d99f5e Add stream enumeration to Processors. 2019-09-02 17:49:05 +03:00
CurtizJ
de5e2b4d6b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-02 17:34:49 +03:00
Alexander Tokmakov
8adf13047b fix build 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
804c911d3f ValuesRowInputStream changed to ValuesBlockInputStream 2019-09-02 17:33:09 +03:00
CurtizJ
da11fb86b7 implement 'with fill' modifier with processors 2019-09-02 17:29:51 +03:00
Nikolai Kochetov
2eecd35d27 Fix PVS warning in PipelineExecutor. 2019-09-02 16:30:51 +03:00
Nikolai Kochetov
bf0c0ed4f1 Merge branch 'master' into processors-2 2019-09-02 16:02:09 +03:00
Nikolai Kochetov
278e33cfa3 Try add LFStack. 2019-09-02 15:48:58 +03:00
Nikolai Kochetov
5005c0006c Try add LFStack. 2019-09-02 15:34:18 +03:00
Nikolai Kochetov
6221a42fcc Comment out all stopwatchs in PipelineExecutor. 2019-09-02 14:02:08 +03:00
Alexander Tokmakov
3da233ef42 fix build 2019-09-02 13:47:06 +03:00
Nikolai Kochetov
300dc80194 Update Aggregator interface. 2019-08-31 11:58:16 +03:00
Alexander Tokmakov
4c744af113 minor style fixes 2019-08-30 20:25:35 +03:00
Alexander Tokmakov
e3982704ea try to fix build 2019-08-30 00:46:36 +03:00
Alexander Tokmakov
d95d53b4e4 better error messages 2019-08-29 22:35:59 +03:00
CurtizJ
a6e43c4119 merging with master 2019-08-29 19:48:02 +03:00
Alexander Tokmakov
03c83169bd Merge branch 'master' into merging_template_format 2019-08-29 16:34:25 +03:00
Alexey Milovidov
eb15c9416a Fixed style 2019-08-28 21:00:40 +03:00
Alexey Milovidov
30cc569845 Avoid initializing DateLUT in static constructors 2019-08-28 20:11:40 +03:00
Alexander Tokmakov
c8096542bf more tests and fixes 2019-08-28 19:46:54 +03:00
Alexey Milovidov
b21fdff77e Merging #6678 2019-08-27 21:59:21 +03:00
Nikolai Kochetov
4cb52cebea Update max_threads for processors. 2019-08-27 21:37:28 +03:00
Alexander Tokmakov
93c672aa0b delete BlockInputStreamFromRowInputStream 2019-08-27 21:29:56 +03:00
CurtizJ
50d870705c limit with ties for processors 2019-08-27 20:48:42 +03:00
Alexander Tokmakov
cf3a8b993b allow skipping fields in TemplateRowInputFormat 2019-08-27 19:53:26 +03:00
Nikolai Kochetov
d958316e58 Enable processors by default. Do not check block srtucture in SourceFromInutStream if not debug. 2019-08-27 11:17:42 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
CurtizJ
fa5aeb757f fix clang build 2019-08-26 20:37:40 +03:00
CurtizJ
4a7459f3b3 cleanup and update comments 2019-08-26 18:25:18 +03:00
CurtizJ
c63eeb8933 add FinishSortingTransform, refactor MergeSortingTransform 2019-08-26 17:54:29 +03:00
Alexander Tokmakov
f9445626d1 better parsing of format string 2019-08-26 16:02:15 +03:00
Alexey Milovidov
6d3250867c Fixed build of tests 2019-08-25 01:08:45 +03:00
Alexander Tokmakov
0136ef9a5f move formats to processors 2019-08-23 22:47:22 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
alexey-milovidov
5c99780b08
Merge pull request #6606 from yandex/processors-2
Enable processors by default.
2019-08-23 02:50:11 +03:00
Nikolai Kochetov
b3f91a717c Use ThreadFromGlobalPool in PipelineExecutor instead of ThreadPool. 2019-08-22 17:38:44 +03:00
Nikolai Kochetov
b93ffdd038 Fix MergingSortedTransform. 2019-08-22 13:16:56 +03:00
Nikolai Kochetov
11f8ec76df Fix CubeTransform. 2019-08-22 12:28:23 +03:00
Nikolai Kochetov
4f38b08481 Fix RollupTransform. 2019-08-22 11:53:34 +03:00
Nikolai Kochetov
8228871821 Fix RollupTransform. 2019-08-22 11:29:29 +03:00
Nikolai Kochetov
c3aaf583a0 Fix RollupTransform. 2019-08-22 11:26:50 +03:00
akonyaev
1683547b2d ADQM-34 fix style 2019-08-22 10:24:04 +03:00
akonyaev
01216e45b6 Merge branch 'master' of https://github.com/yandex/ClickHouse into ADQM-34
# Conflicts:
#	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
2019-08-22 09:40:51 +03:00
akonyaev
321233ddaa ADQM-34 fix hardcode for,at name in ArrowColumnToCHColumn class 2019-08-21 19:39:20 +03:00
Nikolai Kochetov
2e03ac09ec Fix MergingSortedTransform. 2019-08-21 19:38:27 +03:00
Nikolai Kochetov
e68775e3d0 Fix TotalsHavingTransform. 2019-08-21 17:51:32 +03:00
akonyaev
caf0d30a5f ADQM-34 add orc input format 2019-08-21 17:19:47 +03:00
Nikolai Kochetov
fe3221d0e4 Fix SortingAggregatedTransform. 2019-08-21 17:19:18 +03:00
Nikolai Kochetov
c27cada229 Fix ExpressionTransform. 2019-08-21 16:14:23 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Alexey Milovidov
a6b64d6ba0 Parquet: Fix reading boolean columns 2019-08-21 04:00:13 +03:00
Nikolai Kochetov
06bb0af386 Fix build. 2019-08-20 18:03:35 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview
Merge LIVE VIEW
2019-08-20 17:13:42 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012)
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
Alexander Tokmakov
bca580653d fix csv input 2019-08-20 02:09:02 +03:00
proller
d09c5c871b Build fixes (#6491)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
Nikolai Kochetov
e51c48501b Fix arg type forPipelineExecutor::prepareProcessor 2019-08-14 18:28:33 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
2570907f44 Removed useless parameter 2019-08-12 00:45:18 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser
Fixed possible stack overflow in parser
2019-08-10 23:58:54 +03:00
Alexey Milovidov
0a9787c7f3 Fixed possible stack overflow in parser 2019-08-10 19:38:25 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
ed11432f68 Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 19:10:47 +03:00
Nikolai Kochetov
23e2d17d9d Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 18:58:07 +03:00
Nikolai Kochetov
bd8c9733e3 Update MySQLOutputFormat. 2019-08-05 12:35:46 +03:00
Nikolai Kochetov
abc63f8a06 Merged with master. 2019-08-04 15:43:11 +03:00
Nikolai Kochetov
511f3050a6 Update CSVRowInputFormat. 2019-08-04 13:19:51 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Nikolai Kochetov
e5d67cbe61 Remove ProtobufRowOutputStream. 2019-08-02 19:34:20 +03:00
Nikolai Kochetov
5fb548c994 Remove ProtobufRowOutputStream. 2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4 Remove ProtobufRowInputStream. 2019-08-02 19:23:44 +03:00