Commit Graph

535 Commits

Author SHA1 Message Date
Nikolai Kochetov
2b334a4adb Review fixes. 2019-10-21 19:26:29 +03:00
Nikolai Kochetov
2893c35930 Merged with master. 2019-10-21 18:33:44 +03:00
Nikolai Kochetov
f7d2e1b758 Added Pipe class. Updated MergeTreeDataSelectExecutor. 2019-10-21 18:16:08 +03:00
Alexander Kuzmenkov
5e2cc37381
Distinguish Array and Tuple field types when creating from array of Fields. (#7179) 2019-10-18 18:57:05 +03:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Alexander Tokmakov
e9e8d055af null_as_default for Values 2019-10-16 22:55:24 +03:00
Alexander Tokmakov
102cbfd25a fix old bug with default values 2019-10-16 22:27:33 +03:00
Alexander Tokmakov
5f6703130e fixes 2019-10-16 18:28:48 +03:00
Alexander Tokmakov
aa9d29d6ae Merge branch 'master' into formats_improvements 2019-10-16 17:15:13 +03:00
Nikolai Kochetov
5364f76625 Fix build. 2019-10-14 16:50:16 +03:00
Alexander Kuzmenkov
160d8a6416 Ignore non-convertible values at any depth on the right side of IN
operator.

The values that are not convertible to the left argument type can't
match anyway, so it is safe to discard them.
2019-10-14 14:25:03 +03:00
Nikolai Kochetov
7c2575542b Fix build. 2019-10-12 21:52:20 +03:00
Nikolai Kochetov
757488369f Merge branch 'master' into processors-3 2019-10-12 19:24:02 +03:00
Nikolai Kochetov
51bce40d5e
Merge pull request #7284 from ClickHouse/fix-7216
Fix for #7216
2019-10-12 19:20:33 +03:00
Alexander Kuzmenkov
31bd359100
Merge pull request #7231 from ClickHouse/aku/podarray-includes
Include PODArray.h into fewer files.
2019-10-12 15:08:41 +03:00
Nikolai Kochetov
4967bcdbd0 Fix test. 2019-10-11 21:02:34 +03:00
Nikolai Kochetov
2684bd0d5e Fixes for 7216 2019-10-11 20:27:54 +03:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
Vitaly Baranov
18ccb4d64d Move backQuote() and quoteString() to a separate file, use StringRefs. 2019-10-11 00:18:52 +03:00
Nikolai Kochetov
ef14df4632 Added more comments. 2019-10-10 17:16:15 +03:00
Nikolai Kochetov
9c5ae5f536 Merge branch 'master' into processors-and-storages 2019-10-09 14:12:47 +03:00
Nikolai Kochetov
eb2677c94e Try fix progressbar. 2019-10-09 12:44:24 +03:00
Nikolai Kochetov
ea27918de8 Try fix progressbar. 2019-10-09 12:40:30 +03:00
Nikolai Kochetov
c7bb83262e Fix progress callback for processors pipeline. 2019-10-09 12:33:16 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
Alexander Tokmakov
73aa1d1518 diagnostic info for bad csv delimiters 2019-10-07 19:47:25 +03:00
Alexander Tokmakov
a2c83ac82e add tests 2019-10-07 19:31:30 +03:00
Alexander Tokmakov
32b0b8272c setup csv delimiter in Template format 2019-10-07 19:03:01 +03:00
proller
594c535bd4 Build fixes (#7063)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
2019-10-05 22:25:31 +03:00
Alexander Tokmakov
a90d126b93 support defaults_for_omitted_fields in TSV 2019-10-04 22:44:48 +03:00
Alexander Tokmakov
d936cee836 support null_as_default in most text formats 2019-10-04 22:42:35 +03:00
Nikolai Kochetov
95ec0f7c2d Merged with master. 2019-10-04 20:53:21 +03:00
Nikolai Kochetov
d4f11af817 Update QueryPipeline. 2019-10-04 20:49:14 +03:00
Nikolai Kochetov
23069ca6d0 Progress for MergeTreeSelectProcessor. 2019-10-04 20:50:07 +03:00
Nikolai Kochetov
627d48c19a Added ExecutionSpeedLimits. 2019-10-04 20:49:57 +03:00
Nikolai Kochetov
e48f7faebc Fix MergeTreeRangeReader.
Fix MergeTreeReader.

Fix MergeTreeBaseSelectProcessor.

Better exception message for TreeExecutor.

Added header_without_virtual_columns to MergeTreeBaseSelectProcessor.

Fix MergeTreeReverseSelectProcessor.

Fix MergeTreeDataSelectExecutor.
2019-10-04 20:49:29 +03:00
Nikolai Kochetov
54d32da5a1 Update TreeExecutor. 2019-10-04 20:49:24 +03:00
Nikolai Kochetov
1689576770 Update MergeTreeDataSelectExecutor. 2019-10-04 20:49:14 +03:00
Alexander Tokmakov
ec79e5aa5b refactor null_as_default 2019-10-04 20:19:49 +03:00
tavplubix
d73db7f779
Merge pull request #6781 from ClickHouse/merging_values_with_expressions
Merging Values with expressions
2019-10-04 12:51:22 +03:00
Alexander Kuzmenkov
8e245d4e8c
Merge pull request #7135 from ClickHouse/aku/msan-field
Fix some MemorySanitizer warnings for Fields.
2019-10-03 10:33:44 +03:00
Alexander Tokmakov
a58996817f allow query parameters in Values 2019-10-02 22:54:40 +03:00
Alexander Tokmakov
565c273eaa Merge branch 'master' into merging_values_with_expressions 2019-10-02 20:51:44 +03:00
Alexander Tokmakov
80e5976d10 fixes after review 2019-10-02 20:51:00 +03:00
chertus
3b0d870804 rename function 2019-10-02 15:06:34 +03:00
chertus
c46cc3ff1a refactoring: remove copy-paste 2019-10-01 21:51:33 +03:00
Nikita Mikhaylov
d47d4cd6c1 parallel parsing 2019-10-01 13:48:46 +03:00
Alexander Tokmakov
e267081389 better PeekableReadBuffer interface 2019-09-30 21:21:58 +03:00
Alexander Tokmakov
979f235e38 Merge branch 'master' into merging_values_with_expressions 2019-09-30 18:06:58 +03:00
Alexander Kuzmenkov
ec2d9a083c Remove excessive includes. 2019-09-30 15:31:14 +03:00
alexey-milovidov
e50a874537
Merge pull request #7118 from ClickHouse/improve_template_format
Minor improvements of Template format
2019-09-30 15:00:27 +03:00
Amos Bird
dadc613072 Get rid of malloc symbols in libcommon (#7134) 2019-09-30 14:58:32 +03:00
Ivan
e5a5091556
Revert "Get rid of malloc symbols in libcommon (#7065)" (#7131)
This reverts commit 4cb53093a0.
2019-09-27 16:16:53 +03:00
Amos Bird
4cb53093a0 Get rid of malloc symbols in libcommon (#7065) 2019-09-27 15:19:26 +03:00
tavplubix
c3ed1f38a6
Merge branch 'master' into improve_template_format 2019-09-26 19:19:11 +03:00
Alexander Tokmakov
51ac870540 fix build 2019-09-26 13:49:22 +03:00
Alexander Tokmakov
c31f9c6f9a force inline small functions 2019-09-25 19:08:58 +03:00
Alexander Tokmakov
d642304b1d add CustomSeparated format 2019-09-24 22:56:45 +03:00
Alexander Tokmakov
e197cc8a49 read settings from file 2019-09-24 17:45:04 +03:00
Alexander Kuzmenkov
f3bde19b74 Do not use iterators in find() and emplace() methods of hash tables.
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
2019-09-24 17:44:35 +03:00
Alexander Tokmakov
769d33848b allow specifying column idx in format string 2019-09-23 18:10:48 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
Alexander Tokmakov
447d59bd37 remove unused field 2019-09-23 15:32:49 +03:00
Alexander Tokmakov
0080639f79 Merge branch 'master' into merging_values_with_expressions 2019-09-20 23:26:01 +03:00
Alexander Tokmakov
d353746f2b minor fixes 2019-09-20 22:44:52 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
967e00a8da It works!
if compiled with:

CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
2019-09-20 20:09:22 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole (#6950)
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin
PartialMergeJoin
2019-09-18 16:16:10 +03:00
Ivan Lezhankin
8c356a3830 WIP 2019-09-15 18:20:31 +03:00
Ivan Lezhankin
787c2b8d83 WIP 2019-09-15 13:35:19 +03:00
Alexander Tokmakov
aa10bc99cc improvements 2019-09-13 21:19:14 +03:00
Nikolai Kochetov
1335aa75d7 Added TreeExecutor. 2019-09-13 15:34:05 +03:00
Alexander Tokmakov
2b9a1d6a60 optimize parsing numbers with type check 2019-09-12 23:23:20 +03:00
chertus
bb5287841f make things wrong 2 2019-09-12 21:06:25 +03:00
Nikolai Kochetov
eac45eaf3e More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:57:04 +03:00
Nikolai Kochetov
7a31d967d9 More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:50:51 +03:00
Nikolai Kochetov
ec48361ef0 More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:46:41 +03:00
Nikolai Kochetov
1319168a3a Merge branch 'master' into processors-2 2019-09-12 16:28:51 +03:00
Nikolai Kochetov
9dea55c284 Do not pin sources for non MergeTree tables. 2019-09-12 16:23:24 +03:00
Nikolai Kochetov
1ff30b1621 Update PipelineExecutor. 2019-09-12 16:07:54 +03:00
Nikolai Kochetov
1b906bfeaf Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:22:58 +03:00
Nikolai Kochetov
4ba0ed731f Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:19:54 +03:00
Nikolai Kochetov
d0e84e630a Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:13:34 +03:00
Nikolai Kochetov
7d93d70e94 Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:07:36 +03:00
Alexander Tokmakov
f323476111 Merge branch 'master' into merging_values_with_expressions 2019-09-11 23:31:37 +03:00
Amos Bird
93c0880ca7 Fix non-ssl build. 2019-09-12 04:20:27 +08:00
Alexander Tokmakov
29fe481b06 optimize expression template deduction 2019-09-11 22:55:28 +03:00
Nikolai Kochetov
95abc1f910 Removed dynamic_cast from PipelineExecutor. 2019-09-11 20:06:06 +03:00
Nikolai Kochetov
9916be2800 Small refactor in PipelienExecutor. Added comment in AggregatingTransform. 2019-09-11 19:31:15 +03:00
Nikolai Kochetov
172e4d76d7 Added more comments. 2019-09-11 13:46:41 +03:00
Nikolai Kochetov
8734c8339e Fix race in PipelineExecutor. 2019-09-10 16:12:18 +03:00
Nikolai Kochetov
7b0a6aec05 Fix raice in PipelineExecutor. 2019-09-10 15:14:47 +03:00
Nikolai Kochetov
3646124873 Fix raice in PipelineExecutor. 2019-09-10 14:17:55 +03:00
Nikolai Kochetov
a9d41d580a Fix asan crash in PipelineExecutor. 2019-09-10 12:50:38 +03:00
Nikolai Kochetov
72fea5bf97 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:50:31 +03:00
Nikolai Kochetov
73bda85998 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:45:48 +03:00
Nikolai Kochetov
5165bbd88a Fix asan crash in PipelineExecutor. 2019-09-10 11:03:02 +03:00
proller
54a5b801b7 Build fixes (Orc, ...) (#6835)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)

* wip

* Fix build (orc, ...)

* Missing files

* Try fix

* fix hdfs

* Fix llvm 7.1 find
2019-09-10 00:40:40 +03:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00