Alexander Kuzmenkov
233212ac68
Merge pull request #7531 from amosbird/getkeymapped
...
Unify hash tables interface (separated for review)
2019-11-06 13:49:39 +03:00
Nikolai Kochetov
055f21c9b7
Less wrappers for procesors pipeline.
2019-11-05 20:33:03 +03:00
Amos Bird
fbfbe161ec
Unify hash tables interface.
2019-11-06 00:08:04 +08:00
Nikita Mikhaylov
0d3a05ce3b
remove logging + fix for PrettySpace + overrided readSuffix and readPrefix
2019-11-05 15:58:32 +03:00
Nikolai Kochetov
a0e9f9fdcf
Skip empty totals in SourceFromInputStream.
2019-11-05 15:50:47 +03:00
Nikita Mikhaylov
817b52314e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing
2019-11-05 12:32:26 +03:00
alexey-milovidov
ada6ee4137
Merge pull request #7591 from ClickHouse/one-more-attempt-djvu-bugfix
...
One more attempt of bugfix of infinite loop in pretty space format
2019-11-02 23:40:53 +03:00
proller
6a573b4092
Allow to use mysql format without ssl - try2 with mysql interface split ( #7524 )
...
* Allow use mysql format without ssl
* fix
* fix
* fix
* Also disable poco's optional libraries
* clean
* fix
* fix
* Requested changes
* clean
* Requested fixes
* Update MySQLHandler.cpp
2019-11-02 13:20:46 +03:00
stavrolia
e58aa4e579
One more attempt of bugfix of infinite loop in pretty space format
2019-11-02 11:53:35 +03:00
stavrolia
d503c38cac
Revert "Merge pull request #7587 from ClickHouse/fix-nonsignificant-djvu-bug"
...
This reverts commit 102a76ab47
, reversing
changes made to dea9220e3c
.
2019-11-02 03:23:27 +03:00
stavrolia
89d8e6de93
Fix
2019-11-02 02:39:43 +03:00
Nikita Mikhaylov
3c57b8e9c2
test
2019-11-01 21:59:54 +03:00
Nikolai Kochetov
1f7a798c97
Add flag to set that set is created.
2019-11-01 13:58:29 +03:00
Nikita Mikhaylov
9d8bbeb473
bad fix for PrettyCompact
2019-10-31 17:31:19 +03:00
Nikita Mikhaylov
b691cc744c
comments and checks
2019-10-30 18:49:10 +03:00
Nikita Mikhaylov
682b9df17f
remove SharedReadBuffer + remove lambdas
2019-10-25 15:28:24 +03:00
Nikolai Kochetov
9abab40512
Added more comments.
2019-10-23 06:45:43 +03:00
Nikita Mikhaylov
34d8ade4a0
Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing
2019-10-22 15:56:51 +03:00
Nikolai Kochetov
dad1e397e2
Fix build.
2019-10-22 02:51:36 +03:00
Nikolai Kochetov
e7ba48ee84
Fix build.
2019-10-22 02:49:44 +03:00
Nikolai Kochetov
2b334a4adb
Review fixes.
2019-10-21 19:26:29 +03:00
Nikolai Kochetov
2893c35930
Merged with master.
2019-10-21 18:33:44 +03:00
Nikolai Kochetov
f7d2e1b758
Added Pipe class. Updated MergeTreeDataSelectExecutor.
2019-10-21 18:16:08 +03:00
Alexander Kuzmenkov
5e2cc37381
Distinguish Array and Tuple field types when creating from array of Fields. ( #7179 )
2019-10-18 18:57:05 +03:00
tavplubix
0046b9f137
Wait for jobs to finish on exception (fixes rare segfaults) ( #7350 )
2019-10-17 17:41:27 +03:00
Alexander Tokmakov
e9e8d055af
null_as_default for Values
2019-10-16 22:55:24 +03:00
Alexander Tokmakov
102cbfd25a
fix old bug with default values
2019-10-16 22:27:33 +03:00
Alexander Tokmakov
5f6703130e
fixes
2019-10-16 18:28:48 +03:00
Alexander Tokmakov
aa9d29d6ae
Merge branch 'master' into formats_improvements
2019-10-16 17:15:13 +03:00
Nikolai Kochetov
5364f76625
Fix build.
2019-10-14 16:50:16 +03:00
Alexander Kuzmenkov
160d8a6416
Ignore non-convertible values at any depth on the right side of IN
...
operator.
The values that are not convertible to the left argument type can't
match anyway, so it is safe to discard them.
2019-10-14 14:25:03 +03:00
Nikolai Kochetov
7c2575542b
Fix build.
2019-10-12 21:52:20 +03:00
Nikolai Kochetov
757488369f
Merge branch 'master' into processors-3
2019-10-12 19:24:02 +03:00
Nikolai Kochetov
51bce40d5e
Merge pull request #7284 from ClickHouse/fix-7216
...
Fix for #7216
2019-10-12 19:20:33 +03:00
Alexander Kuzmenkov
31bd359100
Merge pull request #7231 from ClickHouse/aku/podarray-includes
...
Include PODArray.h into fewer files.
2019-10-12 15:08:41 +03:00
Nikolai Kochetov
4967bcdbd0
Fix test.
2019-10-11 21:02:34 +03:00
Nikolai Kochetov
2684bd0d5e
Fixes for 7216
2019-10-11 20:27:54 +03:00
Alexander Kuzmenkov
8a1d57bddb
Include PODArray.h into fewer files.
2019-10-11 14:28:16 +03:00
Vitaly Baranov
18ccb4d64d
Move backQuote() and quoteString() to a separate file, use StringRefs.
2019-10-11 00:18:52 +03:00
Nikolai Kochetov
ef14df4632
Added more comments.
2019-10-10 17:16:15 +03:00
Nikolai Kochetov
9c5ae5f536
Merge branch 'master' into processors-and-storages
2019-10-09 14:12:47 +03:00
Nikolai Kochetov
eb2677c94e
Try fix progressbar.
2019-10-09 12:44:24 +03:00
Nikolai Kochetov
ea27918de8
Try fix progressbar.
2019-10-09 12:40:30 +03:00
Nikolai Kochetov
c7bb83262e
Fix progress callback for processors pipeline.
2019-10-09 12:33:16 +03:00
Alexander Kuzmenkov
2b30f2696c
Include Field.h in less files.
2019-10-08 16:23:24 +03:00
Alexander Tokmakov
73aa1d1518
diagnostic info for bad csv delimiters
2019-10-07 19:47:25 +03:00
Alexander Tokmakov
a2c83ac82e
add tests
2019-10-07 19:31:30 +03:00
Alexander Tokmakov
32b0b8272c
setup csv delimiter in Template format
2019-10-07 19:03:01 +03:00
proller
594c535bd4
Build fixes ( #7063 )
...
* Build fixes
* fix
* Fix
* fix
* Fix install(export..
* Freebsd fixes
* Freebsd fixes
* Fix warning
* fix
* More PRIVATE linking
* Fix review
* Timmy
* fix
* fix
2019-10-05 22:25:31 +03:00
Alexander Tokmakov
a90d126b93
support defaults_for_omitted_fields in TSV
2019-10-04 22:44:48 +03:00
Alexander Tokmakov
d936cee836
support null_as_default in most text formats
2019-10-04 22:42:35 +03:00
Nikolai Kochetov
95ec0f7c2d
Merged with master.
2019-10-04 20:53:21 +03:00
Nikolai Kochetov
d4f11af817
Update QueryPipeline.
2019-10-04 20:49:14 +03:00
Nikolai Kochetov
23069ca6d0
Progress for MergeTreeSelectProcessor.
2019-10-04 20:50:07 +03:00
Nikolai Kochetov
627d48c19a
Added ExecutionSpeedLimits.
2019-10-04 20:49:57 +03:00
Nikolai Kochetov
e48f7faebc
Fix MergeTreeRangeReader.
...
Fix MergeTreeReader.
Fix MergeTreeBaseSelectProcessor.
Better exception message for TreeExecutor.
Added header_without_virtual_columns to MergeTreeBaseSelectProcessor.
Fix MergeTreeReverseSelectProcessor.
Fix MergeTreeDataSelectExecutor.
2019-10-04 20:49:29 +03:00
Nikolai Kochetov
54d32da5a1
Update TreeExecutor.
2019-10-04 20:49:24 +03:00
Nikolai Kochetov
1689576770
Update MergeTreeDataSelectExecutor.
2019-10-04 20:49:14 +03:00
Alexander Tokmakov
ec79e5aa5b
refactor null_as_default
2019-10-04 20:19:49 +03:00
tavplubix
d73db7f779
Merge pull request #6781 from ClickHouse/merging_values_with_expressions
...
Merging Values with expressions
2019-10-04 12:51:22 +03:00
Alexander Kuzmenkov
8e245d4e8c
Merge pull request #7135 from ClickHouse/aku/msan-field
...
Fix some MemorySanitizer warnings for Fields.
2019-10-03 10:33:44 +03:00
Alexander Tokmakov
a58996817f
allow query parameters in Values
2019-10-02 22:54:40 +03:00
Alexander Tokmakov
565c273eaa
Merge branch 'master' into merging_values_with_expressions
2019-10-02 20:51:44 +03:00
Alexander Tokmakov
80e5976d10
fixes after review
2019-10-02 20:51:00 +03:00
chertus
3b0d870804
rename function
2019-10-02 15:06:34 +03:00
chertus
c46cc3ff1a
refactoring: remove copy-paste
2019-10-01 21:51:33 +03:00
Nikita Mikhaylov
d47d4cd6c1
parallel parsing
2019-10-01 13:48:46 +03:00
Alexander Tokmakov
e267081389
better PeekableReadBuffer interface
2019-09-30 21:21:58 +03:00
Alexander Tokmakov
979f235e38
Merge branch 'master' into merging_values_with_expressions
2019-09-30 18:06:58 +03:00
Alexander Kuzmenkov
ec2d9a083c
Remove excessive includes.
2019-09-30 15:31:14 +03:00
alexey-milovidov
e50a874537
Merge pull request #7118 from ClickHouse/improve_template_format
...
Minor improvements of Template format
2019-09-30 15:00:27 +03:00
Amos Bird
dadc613072
Get rid of malloc symbols in libcommon ( #7134 )
2019-09-30 14:58:32 +03:00
Ivan
e5a5091556
Revert "Get rid of malloc symbols in libcommon ( #7065 )" ( #7131 )
...
This reverts commit 4cb53093a0
.
2019-09-27 16:16:53 +03:00
Amos Bird
4cb53093a0
Get rid of malloc symbols in libcommon ( #7065 )
2019-09-27 15:19:26 +03:00
tavplubix
c3ed1f38a6
Merge branch 'master' into improve_template_format
2019-09-26 19:19:11 +03:00
Alexander Tokmakov
51ac870540
fix build
2019-09-26 13:49:22 +03:00
Alexander Tokmakov
c31f9c6f9a
force inline small functions
2019-09-25 19:08:58 +03:00
Alexander Tokmakov
d642304b1d
add CustomSeparated format
2019-09-24 22:56:45 +03:00
Alexander Tokmakov
e197cc8a49
read settings from file
2019-09-24 17:45:04 +03:00
Alexander Kuzmenkov
f3bde19b74
Do not use iterators in find() and emplace() methods of hash tables.
...
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
2019-09-24 17:44:35 +03:00
Alexander Tokmakov
769d33848b
allow specifying column idx in format string
2019-09-23 18:10:48 +03:00
Ivan Lezhankin
4b143c3e0f
Merge remote-tracking branch 'upstream/master' into issue-6459
2019-09-23 16:07:19 +03:00
Alexander Tokmakov
447d59bd37
remove unused field
2019-09-23 15:32:49 +03:00
Alexander Tokmakov
0080639f79
Merge branch 'master' into merging_values_with_expressions
2019-09-20 23:26:01 +03:00
Alexander Tokmakov
d353746f2b
minor fixes
2019-09-20 22:44:52 +03:00
Ivan Lezhankin
9e46118edd
Merge remote-tracking branch 'upstream/master' into issue-6459
2019-09-20 21:25:55 +03:00
Ivan Lezhankin
967e00a8da
It works!
...
if compiled with:
CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
2019-09-20 20:09:22 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole ( #6950 )
...
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin
...
PartialMergeJoin
2019-09-18 16:16:10 +03:00
Ivan Lezhankin
8c356a3830
WIP
2019-09-15 18:20:31 +03:00
Ivan Lezhankin
787c2b8d83
WIP
2019-09-15 13:35:19 +03:00
Alexander Tokmakov
aa10bc99cc
improvements
2019-09-13 21:19:14 +03:00
Nikolai Kochetov
1335aa75d7
Added TreeExecutor.
2019-09-13 15:34:05 +03:00
Alexander Tokmakov
2b9a1d6a60
optimize parsing numbers with type check
2019-09-12 23:23:20 +03:00
chertus
bb5287841f
make things wrong 2
2019-09-12 21:06:25 +03:00
Nikolai Kochetov
eac45eaf3e
More priority to pinned tasks in PipelineExecutor.
2019-09-12 17:57:04 +03:00
Nikolai Kochetov
7a31d967d9
More priority to pinned tasks in PipelineExecutor.
2019-09-12 17:50:51 +03:00
Nikolai Kochetov
ec48361ef0
More priority to pinned tasks in PipelineExecutor.
2019-09-12 17:46:41 +03:00
Nikolai Kochetov
1319168a3a
Merge branch 'master' into processors-2
2019-09-12 16:28:51 +03:00
Nikolai Kochetov
9dea55c284
Do not pin sources for non MergeTree tables.
2019-09-12 16:23:24 +03:00
Nikolai Kochetov
1ff30b1621
Update PipelineExecutor.
2019-09-12 16:07:54 +03:00
Nikolai Kochetov
1b906bfeaf
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:22:58 +03:00
Nikolai Kochetov
4ba0ed731f
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:19:54 +03:00
Nikolai Kochetov
d0e84e630a
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:13:34 +03:00
Nikolai Kochetov
7d93d70e94
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:07:36 +03:00
Alexander Tokmakov
f323476111
Merge branch 'master' into merging_values_with_expressions
2019-09-11 23:31:37 +03:00
Amos Bird
93c0880ca7
Fix non-ssl build.
2019-09-12 04:20:27 +08:00
Alexander Tokmakov
29fe481b06
optimize expression template deduction
2019-09-11 22:55:28 +03:00
Nikolai Kochetov
95abc1f910
Removed dynamic_cast from PipelineExecutor.
2019-09-11 20:06:06 +03:00
Nikolai Kochetov
9916be2800
Small refactor in PipelienExecutor. Added comment in AggregatingTransform.
2019-09-11 19:31:15 +03:00
Nikolai Kochetov
172e4d76d7
Added more comments.
2019-09-11 13:46:41 +03:00
Nikolai Kochetov
8734c8339e
Fix race in PipelineExecutor.
2019-09-10 16:12:18 +03:00
Nikolai Kochetov
7b0a6aec05
Fix raice in PipelineExecutor.
2019-09-10 15:14:47 +03:00
Nikolai Kochetov
3646124873
Fix raice in PipelineExecutor.
2019-09-10 14:17:55 +03:00
Nikolai Kochetov
a9d41d580a
Fix asan crash in PipelineExecutor.
2019-09-10 12:50:38 +03:00
Nikolai Kochetov
72fea5bf97
Added ThreadsQueue to PipelineExecutor.
2019-09-10 11:50:31 +03:00
Nikolai Kochetov
73bda85998
Added ThreadsQueue to PipelineExecutor.
2019-09-10 11:45:48 +03:00
Nikolai Kochetov
5165bbd88a
Fix asan crash in PipelineExecutor.
2019-09-10 11:03:02 +03:00
proller
54a5b801b7
Build fixes (Orc, ...) ( #6835 )
...
* Fix build
* cmake: fix cpuinfo
* Fix includes after processors merge
Conflicts:
dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp
* Fix build in gcc8
* fix test link
* fix test link
* Fix test link
* link fix
* Fix includes after processors merge 2
Conflicts:
dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
* Fix includes after processors merge 3
* link fix
* Fix likely/unlikely conflict with cython
* Fix conflict with protobuf/stubs/atomicops.h
* remove unlikely.h
* Fix macos build (do not use timer_t)
* wip
* Fix build (orc, ...)
* Missing files
* Try fix
* fix hdfs
* Fix llvm 7.1 find
2019-09-10 00:40:40 +03:00
chertus
1b313eedfa
MergeJoin in progress
2019-09-09 22:43:37 +03:00
Nikolai Kochetov
eeba24b238
Try to fix race in PipelineExecutor.
2019-09-09 20:56:58 +03:00
Nikolai Kochetov
423a5c35e8
Try to fix race in PipelineExecutor.
2019-09-09 20:12:26 +03:00
Nikolai Kochetov
da798142a5
Try to fix race in PipelineExecutor.
2019-09-09 20:10:37 +03:00
Alexander Tokmakov
3643ecc9cd
parse expressions near the end of buffer correctly
2019-09-09 20:06:22 +03:00
Nikolai Kochetov
9df1235046
Pin sources to streams in PipelineExecutor.
2019-09-09 19:53:02 +03:00
Nikolai Kochetov
818696a9a7
Pin sources to streams in PipelineExecutor.
2019-09-09 19:29:11 +03:00
Nikolai Kochetov
3a849c3c5f
Pin sources to streams in PipelineExecutor.
2019-09-09 18:43:19 +03:00
Nikolai Kochetov
c9cca3ba8b
Merged with master
2019-09-09 16:20:30 +03:00
Nikolai Kochetov
04d2f32e17
Check thread is joinable in PipelineExecutor.
2019-09-09 15:09:48 +03:00
Alexander Tokmakov
d78c82a8ae
fixes
2019-09-06 22:01:44 +03:00
Nikolai Kochetov
3bd5d84ecc
Update PipelineExecutor.
2019-09-06 19:04:18 +03:00
Nikolai Kochetov
32cc3a4bee
Revert enumerate streams.
2019-09-06 16:28:49 +03:00
Nikolai Kochetov
52305cefbc
Merge branch 'merging-aggregated-processors' into processors-2
2019-09-06 15:21:17 +03:00
Nikolai Kochetov
d10b7d7a2b
Added ConvertingAggregatedToChunksTransform.
2019-09-06 15:19:59 +03:00
Olga Khvostikova
f90642ce23
Merge pull request #6610 from CurtizJ/merging_with_ties_and_with_fill
...
WITH TIES modifier for LIMIT and WITH FILL modifier for ORDER BY. (continuation of #5069 )
2019-09-05 22:45:48 +03:00
Alexander Tokmakov
196e357250
revert parsing expression near the end of buffer
2019-09-05 16:55:51 +03:00
Alexander Tokmakov
20770a9745
check if some tests fail
2019-09-04 23:27:13 +03:00
Alexander Tokmakov
52fb9585d4
improvements
2019-09-04 22:59:08 +03:00
Alexander Tokmakov
8936f854be
better checking of types of literals
2019-09-04 19:54:20 +03:00
Nikolai Kochetov
30155f92bf
Try to enumerate streams again.
2019-09-04 17:16:32 +03:00
Nikolai Kochetov
b98676836e
Try to enumerate streams again.
2019-09-04 17:06:41 +03:00
Nikolai Kochetov
b9e26d15de
Try to enumerate streams again.
2019-09-04 16:17:50 +03:00
Nikolai Kochetov
3a7e7287c0
Update PipelineExecutor.
2019-09-04 15:34:15 +03:00
Nikolai Kochetov
5246be8a17
Update PipelineExecutor.
2019-09-04 12:37:56 +03:00
CurtizJ
9cfcbd6649
fix bug in FillingBlockInputStream
2019-09-04 01:01:09 +03:00
Nikolai Kochetov
73c052f576
Revert PipelineExecutor changes.
2019-09-03 21:05:44 +03:00
Nikolai Kochetov
5113bd3650
Add task stilling to PipelineExecutor.
2019-09-03 15:06:45 +03:00
Nikolai Kochetov
aa9481e76e
Add task stilling to PipelineExecutor.
2019-09-03 14:22:34 +03:00
alexey-milovidov
7847de1947
Merge pull request #6629 from CurtizJ/read-in-order-2
...
Implement 'read in order' optimization with processors.
2019-09-03 14:21:19 +03:00
Nikolai Kochetov
99476d0039
Add task stilling to PipelineExecutor.
2019-09-03 14:15:37 +03:00