alexey-milovidov
e50a874537
Merge pull request #7118 from ClickHouse/improve_template_format
...
Minor improvements of Template format
2019-09-30 15:00:27 +03:00
Amos Bird
dadc613072
Get rid of malloc symbols in libcommon ( #7134 )
2019-09-30 14:58:32 +03:00
Ivan
e5a5091556
Revert "Get rid of malloc symbols in libcommon ( #7065 )" ( #7131 )
...
This reverts commit 4cb53093a0
.
2019-09-27 16:16:53 +03:00
Amos Bird
4cb53093a0
Get rid of malloc symbols in libcommon ( #7065 )
2019-09-27 15:19:26 +03:00
tavplubix
c3ed1f38a6
Merge branch 'master' into improve_template_format
2019-09-26 19:19:11 +03:00
Alexander Tokmakov
51ac870540
fix build
2019-09-26 13:49:22 +03:00
Alexander Tokmakov
c31f9c6f9a
force inline small functions
2019-09-25 19:08:58 +03:00
Alexander Tokmakov
d642304b1d
add CustomSeparated format
2019-09-24 22:56:45 +03:00
Alexander Tokmakov
e197cc8a49
read settings from file
2019-09-24 17:45:04 +03:00
Alexander Kuzmenkov
f3bde19b74
Do not use iterators in find() and emplace() methods of hash tables.
...
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
2019-09-24 17:44:35 +03:00
Alexander Tokmakov
769d33848b
allow specifying column idx in format string
2019-09-23 18:10:48 +03:00
Ivan Lezhankin
4b143c3e0f
Merge remote-tracking branch 'upstream/master' into issue-6459
2019-09-23 16:07:19 +03:00
Alexander Tokmakov
447d59bd37
remove unused field
2019-09-23 15:32:49 +03:00
Alexander Tokmakov
0080639f79
Merge branch 'master' into merging_values_with_expressions
2019-09-20 23:26:01 +03:00
Alexander Tokmakov
d353746f2b
minor fixes
2019-09-20 22:44:52 +03:00
Ivan Lezhankin
9e46118edd
Merge remote-tracking branch 'upstream/master' into issue-6459
2019-09-20 21:25:55 +03:00
Ivan Lezhankin
967e00a8da
It works!
...
if compiled with:
CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
2019-09-20 20:09:22 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole ( #6950 )
...
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin
...
PartialMergeJoin
2019-09-18 16:16:10 +03:00
Ivan Lezhankin
8c356a3830
WIP
2019-09-15 18:20:31 +03:00
Ivan Lezhankin
787c2b8d83
WIP
2019-09-15 13:35:19 +03:00
Alexander Tokmakov
aa10bc99cc
improvements
2019-09-13 21:19:14 +03:00
Nikolai Kochetov
1335aa75d7
Added TreeExecutor.
2019-09-13 15:34:05 +03:00
Alexander Tokmakov
2b9a1d6a60
optimize parsing numbers with type check
2019-09-12 23:23:20 +03:00
chertus
bb5287841f
make things wrong 2
2019-09-12 21:06:25 +03:00
Nikolai Kochetov
eac45eaf3e
More priority to pinned tasks in PipelineExecutor.
2019-09-12 17:57:04 +03:00
Nikolai Kochetov
7a31d967d9
More priority to pinned tasks in PipelineExecutor.
2019-09-12 17:50:51 +03:00
Nikolai Kochetov
ec48361ef0
More priority to pinned tasks in PipelineExecutor.
2019-09-12 17:46:41 +03:00
Nikolai Kochetov
1319168a3a
Merge branch 'master' into processors-2
2019-09-12 16:28:51 +03:00
Nikolai Kochetov
9dea55c284
Do not pin sources for non MergeTree tables.
2019-09-12 16:23:24 +03:00
Nikolai Kochetov
1ff30b1621
Update PipelineExecutor.
2019-09-12 16:07:54 +03:00
Nikolai Kochetov
1b906bfeaf
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:22:58 +03:00
Nikolai Kochetov
4ba0ed731f
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:19:54 +03:00
Nikolai Kochetov
d0e84e630a
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:13:34 +03:00
Nikolai Kochetov
7d93d70e94
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:07:36 +03:00
Alexander Tokmakov
f323476111
Merge branch 'master' into merging_values_with_expressions
2019-09-11 23:31:37 +03:00
Amos Bird
93c0880ca7
Fix non-ssl build.
2019-09-12 04:20:27 +08:00
Alexander Tokmakov
29fe481b06
optimize expression template deduction
2019-09-11 22:55:28 +03:00
Nikolai Kochetov
95abc1f910
Removed dynamic_cast from PipelineExecutor.
2019-09-11 20:06:06 +03:00
Nikolai Kochetov
9916be2800
Small refactor in PipelienExecutor. Added comment in AggregatingTransform.
2019-09-11 19:31:15 +03:00
Nikolai Kochetov
172e4d76d7
Added more comments.
2019-09-11 13:46:41 +03:00
Nikolai Kochetov
8734c8339e
Fix race in PipelineExecutor.
2019-09-10 16:12:18 +03:00
Nikolai Kochetov
7b0a6aec05
Fix raice in PipelineExecutor.
2019-09-10 15:14:47 +03:00
Nikolai Kochetov
3646124873
Fix raice in PipelineExecutor.
2019-09-10 14:17:55 +03:00
Nikolai Kochetov
a9d41d580a
Fix asan crash in PipelineExecutor.
2019-09-10 12:50:38 +03:00
Nikolai Kochetov
72fea5bf97
Added ThreadsQueue to PipelineExecutor.
2019-09-10 11:50:31 +03:00
Nikolai Kochetov
73bda85998
Added ThreadsQueue to PipelineExecutor.
2019-09-10 11:45:48 +03:00
Nikolai Kochetov
5165bbd88a
Fix asan crash in PipelineExecutor.
2019-09-10 11:03:02 +03:00
proller
54a5b801b7
Build fixes (Orc, ...) ( #6835 )
...
* Fix build
* cmake: fix cpuinfo
* Fix includes after processors merge
Conflicts:
dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp
* Fix build in gcc8
* fix test link
* fix test link
* Fix test link
* link fix
* Fix includes after processors merge 2
Conflicts:
dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
* Fix includes after processors merge 3
* link fix
* Fix likely/unlikely conflict with cython
* Fix conflict with protobuf/stubs/atomicops.h
* remove unlikely.h
* Fix macos build (do not use timer_t)
* wip
* Fix build (orc, ...)
* Missing files
* Try fix
* fix hdfs
* Fix llvm 7.1 find
2019-09-10 00:40:40 +03:00
chertus
1b313eedfa
MergeJoin in progress
2019-09-09 22:43:37 +03:00
Nikolai Kochetov
eeba24b238
Try to fix race in PipelineExecutor.
2019-09-09 20:56:58 +03:00
Nikolai Kochetov
423a5c35e8
Try to fix race in PipelineExecutor.
2019-09-09 20:12:26 +03:00
Nikolai Kochetov
da798142a5
Try to fix race in PipelineExecutor.
2019-09-09 20:10:37 +03:00
Alexander Tokmakov
3643ecc9cd
parse expressions near the end of buffer correctly
2019-09-09 20:06:22 +03:00
Nikolai Kochetov
9df1235046
Pin sources to streams in PipelineExecutor.
2019-09-09 19:53:02 +03:00
Nikolai Kochetov
818696a9a7
Pin sources to streams in PipelineExecutor.
2019-09-09 19:29:11 +03:00
Nikolai Kochetov
3a849c3c5f
Pin sources to streams in PipelineExecutor.
2019-09-09 18:43:19 +03:00
Nikolai Kochetov
c9cca3ba8b
Merged with master
2019-09-09 16:20:30 +03:00
Nikolai Kochetov
04d2f32e17
Check thread is joinable in PipelineExecutor.
2019-09-09 15:09:48 +03:00
Alexander Tokmakov
d78c82a8ae
fixes
2019-09-06 22:01:44 +03:00
Nikolai Kochetov
3bd5d84ecc
Update PipelineExecutor.
2019-09-06 19:04:18 +03:00
Nikolai Kochetov
32cc3a4bee
Revert enumerate streams.
2019-09-06 16:28:49 +03:00
Nikolai Kochetov
52305cefbc
Merge branch 'merging-aggregated-processors' into processors-2
2019-09-06 15:21:17 +03:00
Nikolai Kochetov
d10b7d7a2b
Added ConvertingAggregatedToChunksTransform.
2019-09-06 15:19:59 +03:00
Olga Khvostikova
f90642ce23
Merge pull request #6610 from CurtizJ/merging_with_ties_and_with_fill
...
WITH TIES modifier for LIMIT and WITH FILL modifier for ORDER BY. (continuation of #5069 )
2019-09-05 22:45:48 +03:00
Alexander Tokmakov
196e357250
revert parsing expression near the end of buffer
2019-09-05 16:55:51 +03:00
Alexander Tokmakov
20770a9745
check if some tests fail
2019-09-04 23:27:13 +03:00
Alexander Tokmakov
52fb9585d4
improvements
2019-09-04 22:59:08 +03:00
Alexander Tokmakov
8936f854be
better checking of types of literals
2019-09-04 19:54:20 +03:00
Nikolai Kochetov
30155f92bf
Try to enumerate streams again.
2019-09-04 17:16:32 +03:00
Nikolai Kochetov
b98676836e
Try to enumerate streams again.
2019-09-04 17:06:41 +03:00
Nikolai Kochetov
b9e26d15de
Try to enumerate streams again.
2019-09-04 16:17:50 +03:00
Nikolai Kochetov
3a7e7287c0
Update PipelineExecutor.
2019-09-04 15:34:15 +03:00
Nikolai Kochetov
5246be8a17
Update PipelineExecutor.
2019-09-04 12:37:56 +03:00
CurtizJ
9cfcbd6649
fix bug in FillingBlockInputStream
2019-09-04 01:01:09 +03:00
Nikolai Kochetov
73c052f576
Revert PipelineExecutor changes.
2019-09-03 21:05:44 +03:00
Nikolai Kochetov
5113bd3650
Add task stilling to PipelineExecutor.
2019-09-03 15:06:45 +03:00
Nikolai Kochetov
aa9481e76e
Add task stilling to PipelineExecutor.
2019-09-03 14:22:34 +03:00
alexey-milovidov
7847de1947
Merge pull request #6629 from CurtizJ/read-in-order-2
...
Implement 'read in order' optimization with processors.
2019-09-03 14:21:19 +03:00
Nikolai Kochetov
99476d0039
Add task stilling to PipelineExecutor.
2019-09-03 14:15:37 +03:00
CurtizJ
22badef1a2
Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill
2019-09-03 13:47:18 +03:00
Nikolai Kochetov
e55647eee9
Force add resize befor aggregating transform.
2019-09-03 13:14:13 +03:00
CurtizJ
6d821c4877
fix build
2019-09-03 13:07:31 +03:00
Nikolai Kochetov
702c1b03da
Revert to LFStack.
2019-09-03 11:42:26 +03:00
CurtizJ
973b533377
Merge remote-tracking branch 'upstream/master' into read-in-order-2
2019-09-03 00:59:51 +03:00
Nikolai Kochetov
52ca3f2b4c
Add stream enumeration to Processors.
2019-09-02 20:01:03 +03:00
Nikolai Kochetov
cfbb3ce6f9
Add stream enumeration to Processors.
2019-09-02 19:58:24 +03:00
Nikolai Kochetov
5352ac9145
Add stream enumeration to Processors.
2019-09-02 19:57:06 +03:00
Nikolai Kochetov
1f70aee2e6
Add stream enumeration to Processors.
2019-09-02 19:55:01 +03:00
Alexander Tokmakov
b9eb992320
Merge branch 'master' into merging_values_with_expressions
2019-09-02 19:54:56 +03:00
Alexander Tokmakov
ec5fbf525d
remove ValuesRowInputFormat
2019-09-02 19:33:58 +03:00
Alexander Tokmakov
d31358a280
change ValuesBlockInputStream to ValuesBlockInputFormat
2019-09-02 19:26:22 +03:00
Nikolai Kochetov
88044fdc16
Add stream enumeration to Processors.
2019-09-02 18:49:18 +03:00
CurtizJ
e122d54dcb
update comments
2019-09-02 18:22:27 +03:00
Alexey Milovidov
402599a38c
Merge branch 'master' into time-zone-configuration
2019-09-02 18:13:54 +03:00
Nikolai Kochetov
52eae3a242
Add stream enumeration to Processors.
2019-09-02 17:55:43 +03:00
alexey-milovidov
a71a1693f0
Merge pull request #6777 from yandex/fix-pvs-warning-in-pipeline-executor
...
Fix PVS warning in PipelineExecutor.
2019-09-02 17:53:28 +03:00
Nikolai Kochetov
0016d99f5e
Add stream enumeration to Processors.
2019-09-02 17:49:05 +03:00
CurtizJ
de5e2b4d6b
Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill
2019-09-02 17:34:49 +03:00
Alexander Tokmakov
8adf13047b
fix build
2019-09-02 17:33:10 +03:00
Alexander Tokmakov
804c911d3f
ValuesRowInputStream changed to ValuesBlockInputStream
2019-09-02 17:33:09 +03:00
CurtizJ
da11fb86b7
implement 'with fill' modifier with processors
2019-09-02 17:29:51 +03:00
Nikolai Kochetov
2eecd35d27
Fix PVS warning in PipelineExecutor.
2019-09-02 16:30:51 +03:00
Nikolai Kochetov
bf0c0ed4f1
Merge branch 'master' into processors-2
2019-09-02 16:02:09 +03:00
Nikolai Kochetov
278e33cfa3
Try add LFStack.
2019-09-02 15:48:58 +03:00
Nikolai Kochetov
5005c0006c
Try add LFStack.
2019-09-02 15:34:18 +03:00
Nikolai Kochetov
6221a42fcc
Comment out all stopwatchs in PipelineExecutor.
2019-09-02 14:02:08 +03:00
Alexander Tokmakov
3da233ef42
fix build
2019-09-02 13:47:06 +03:00
Nikolai Kochetov
300dc80194
Update Aggregator interface.
2019-08-31 11:58:16 +03:00
Alexander Tokmakov
4c744af113
minor style fixes
2019-08-30 20:25:35 +03:00
Alexander Tokmakov
e3982704ea
try to fix build
2019-08-30 00:46:36 +03:00
Alexander Tokmakov
d95d53b4e4
better error messages
2019-08-29 22:35:59 +03:00
CurtizJ
a6e43c4119
merging with master
2019-08-29 19:48:02 +03:00
Alexander Tokmakov
03c83169bd
Merge branch 'master' into merging_template_format
2019-08-29 16:34:25 +03:00
Alexey Milovidov
eb15c9416a
Fixed style
2019-08-28 21:00:40 +03:00
Alexey Milovidov
30cc569845
Avoid initializing DateLUT in static constructors
2019-08-28 20:11:40 +03:00
Alexander Tokmakov
c8096542bf
more tests and fixes
2019-08-28 19:46:54 +03:00
Alexey Milovidov
b21fdff77e
Merging #6678
2019-08-27 21:59:21 +03:00
Nikolai Kochetov
4cb52cebea
Update max_threads for processors.
2019-08-27 21:37:28 +03:00
Alexander Tokmakov
93c672aa0b
delete BlockInputStreamFromRowInputStream
2019-08-27 21:29:56 +03:00
CurtizJ
50d870705c
limit with ties for processors
2019-08-27 20:48:42 +03:00
Alexander Tokmakov
cf3a8b993b
allow skipping fields in TemplateRowInputFormat
2019-08-27 19:53:26 +03:00
Nikolai Kochetov
d958316e58
Enable processors by default. Do not check block srtucture in SourceFromInutStream if not debug.
2019-08-27 11:17:42 +03:00
Weiqing Xu
2fbcd607f3
check free space when use external sort/aggerator
2019-08-27 08:23:07 +08:00
CurtizJ
fa5aeb757f
fix clang build
2019-08-26 20:37:40 +03:00
CurtizJ
4a7459f3b3
cleanup and update comments
2019-08-26 18:25:18 +03:00
CurtizJ
c63eeb8933
add FinishSortingTransform, refactor MergeSortingTransform
2019-08-26 17:54:29 +03:00
Alexander Tokmakov
f9445626d1
better parsing of format string
2019-08-26 16:02:15 +03:00
Alexey Milovidov
6d3250867c
Fixed build of tests
2019-08-25 01:08:45 +03:00
Alexander Tokmakov
0136ef9a5f
move formats to processors
2019-08-23 22:47:22 +03:00
Alexey Milovidov
b42f85e16b
Added a check for double whitespaces
2019-08-23 21:30:04 +03:00
alexey-milovidov
5c99780b08
Merge pull request #6606 from yandex/processors-2
...
Enable processors by default.
2019-08-23 02:50:11 +03:00
Nikolai Kochetov
b3f91a717c
Use ThreadFromGlobalPool in PipelineExecutor instead of ThreadPool.
2019-08-22 17:38:44 +03:00
Nikolai Kochetov
b93ffdd038
Fix MergingSortedTransform.
2019-08-22 13:16:56 +03:00
Nikolai Kochetov
11f8ec76df
Fix CubeTransform.
2019-08-22 12:28:23 +03:00
Nikolai Kochetov
4f38b08481
Fix RollupTransform.
2019-08-22 11:53:34 +03:00
Nikolai Kochetov
8228871821
Fix RollupTransform.
2019-08-22 11:29:29 +03:00
Nikolai Kochetov
c3aaf583a0
Fix RollupTransform.
2019-08-22 11:26:50 +03:00
akonyaev
1683547b2d
ADQM-34 fix style
2019-08-22 10:24:04 +03:00
akonyaev
01216e45b6
Merge branch 'master' of https://github.com/yandex/ClickHouse into ADQM-34
...
# Conflicts:
# dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
2019-08-22 09:40:51 +03:00
akonyaev
321233ddaa
ADQM-34 fix hardcode for,at name in ArrowColumnToCHColumn class
2019-08-21 19:39:20 +03:00
Nikolai Kochetov
2e03ac09ec
Fix MergingSortedTransform.
2019-08-21 19:38:27 +03:00
Nikolai Kochetov
e68775e3d0
Fix TotalsHavingTransform.
2019-08-21 17:51:32 +03:00
akonyaev
caf0d30a5f
ADQM-34 add orc input format
2019-08-21 17:19:47 +03:00
Nikolai Kochetov
fe3221d0e4
Fix SortingAggregatedTransform.
2019-08-21 17:19:18 +03:00
Nikolai Kochetov
c27cada229
Fix ExpressionTransform.
2019-08-21 16:14:23 +03:00
Alexey Milovidov
8966520801
Added "assert_cast" function as a replacement for static_cast for columns
2019-08-21 05:28:04 +03:00
Alexey Milovidov
a6b64d6ba0
Parquet: Fix reading boolean columns
2019-08-21 04:00:13 +03:00
Nikolai Kochetov
06bb0af386
Fix build.
2019-08-20 18:03:35 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview
...
Merge LIVE VIEW
2019-08-20 17:13:42 +03:00