Commit Graph

11783 Commits

Author SHA1 Message Date
proller
5328251ff1
Fix build without protobuf, gtest, cppkafka (#4152) 2019-01-25 23:02:03 +03:00
Léo Ercolanelli
e1d6017120 use sumMapWithOverflow in SummingSortedBlockInputStream 2019-01-25 20:36:18 +01:00
Léo Ercolanelli
038a48bb38 sumMap: implement sumMapWithOverflow 2019-01-25 20:35:53 +01:00
proller
6964fb47ff BUILD_DETERMINISTIC 2019-01-25 22:29:01 +03:00
Alexey Milovidov
253ac93459 Addition to prev. revision #4150 2019-01-25 21:44:30 +03:00
alexey-milovidov
8124ee50e8
Merge pull request #4153 from amosbird/joingetfix
Better joinGet.
2019-01-25 20:47:53 +03:00
alexey-milovidov
c07dbee50d
Merge pull request #4148 from vitlibar/master
Use more IO/WriteHelpers.h functions in the class ProtobufSimpleWriter, rename variant=>varint.
2019-01-25 19:22:31 +03:00
chertus
9539467b59 hotfix 2019-01-25 18:48:53 +03:00
chertus
091efcda95 add IdentifierSemantic and PredicateExpressionsOptimizer refactoring 2019-01-25 18:42:24 +03:00
Amos Bird
d8eba7e71b Better joinGet. 2019-01-25 23:38:13 +08:00
Léo Ercolanelli
a78282b834 IDataType.h: remove trailing whitespace 2019-01-25 15:42:44 +01:00
Léo Ercolanelli
57104f81da rename widen to promote for IDataType 2019-01-25 15:16:23 +01:00
Vitaly Baranov
ed1136e49e Use more IO/WriteHelpers.h functions in the class ProtobufSimpleWriter,
rename variant=>varint.
2019-01-25 17:15:44 +03:00
Alexey Milovidov
468f8b4cfb Addition to prev. revision #4150 2019-01-25 17:08:01 +03:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Léo Ercolanelli
0d6094a3ea sumMap: return types less prone to oveflows
It used to be that sumMap would return the same type as the values
columns. If columns of Array(UInt8) were to be given, that would really
easily cause oveflow. It now uses `getWidenDataType` (and ultimately
`NearestFieldType`) in order to define the result type.
2019-01-25 14:29:45 +01:00
Léo Ercolanelli
d9195cda99 implement getWidenType() on IDataType
This is essentially to help implementing the `getReturnType` of
aggregation function susceptible to provoque overflow (such as
`sumMap`).
2019-01-25 14:25:25 +01:00
chertus
a0fafefc96 minor change - add Aliases.h 2019-01-25 14:43:19 +03:00
alexey-milovidov
20970154d8
Merge pull request #4141 from 4ertus2/ast
JOIN with USING: do not duplicate columns
2019-01-25 03:22:43 +03:00
alexey-milovidov
2626a2614c
Merge pull request #4145 from yandex/fix-fuzz-test-in-ubsan-quantile-weighted
Fix fuzz test in ubsan: added parameter type check for quantile*Weighted.
2019-01-25 02:45:07 +03:00
Alexey Milovidov
ef50601b5c Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /g' 2019-01-25 02:01:56 +03:00
Alexey Milovidov
5ccc42fd96 Revert "Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /'"
This reverts commit a28f0acf09.
2019-01-25 01:59:45 +03:00
Alexey Milovidov
304c7b0386 Style #4005 2019-01-24 22:50:16 +03:00
Alexey Milovidov
a28f0acf09 Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /' 2019-01-24 22:49:36 +03:00
Alexey Milovidov
854817c232 Fixed -Wshadow-field #4005 2019-01-24 22:37:32 +03:00
Alexey Milovidov
04fa827e4b Style 2019-01-24 22:21:47 +03:00
alexey-milovidov
f96b8e4ed6
Merge pull request #4005 from vitlibar/add-protobuf-output-format
Add protobuf output format
2019-01-24 22:05:23 +03:00
Alexey Milovidov
ffd18163de Fixed fuzz test in UBSan: added parameter check for quantile*Weighted function 2019-01-24 21:33:57 +03:00
alexey-milovidov
fbefc99fb1
Merge pull request #4129 from ercolanelli-leo/sumMapFiltered
implement sumMapFiltered
2019-01-24 21:27:03 +03:00
alexey-milovidov
18f1266dab
Merge pull request #4099 from yandex/mutations-fix-in
Get rid of IAST::range
2019-01-24 20:29:13 +03:00
Alexey Milovidov
0e59fe0b46 Renamed setting and variables #3973 2019-01-24 20:12:05 +03:00
chertus
ccd9bd0877 fix build 2019-01-24 18:06:15 +03:00
Vitaly Baranov
2886f42c0e Implemented a new block output stream using protobuf output format. 2019-01-24 17:54:57 +03:00
Vitaly Baranov
c241a4ea6d Added function serializeProtobuf() to each data type. 2019-01-24 17:54:57 +03:00
Vitaly Baranov
1e7a231c56 Implemented main class for writing protobufs. 2019-01-24 17:54:52 +03:00
Vitaly Baranov
42d9d4e81d Implemented storage for parsed protobuf schemas. 2019-01-24 17:32:10 +03:00
Vitaly Baranov
28e9837819 Implemented utility class for writing protobufs. 2019-01-24 17:32:01 +03:00
Vitaly Baranov
b1aba679d0 Class WriteBufferFromOwnString now can return StringRef too. 2019-01-24 17:32:01 +03:00
Vitaly Baranov
ec37ef5a89 No escaping for the format schema file's name anymore,
added an utility class for parsing and checking the format schema.
2019-01-24 17:31:41 +03:00
chertus
cbbf04204b JOIN with USING: do not duplicate columns 2019-01-24 17:22:58 +03:00
Léo Ercolanelli
ba1f1c7460 sumMapFiltered: use an unordered_set 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
90afad8c00 sumMapFiltered: improve error reporting on parameter type mismatch 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
a8647761ce sumMapFiltered: fix dangling reference 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
22f7bd03b9 sumMapFiltered: use CRTP instead of virtual for keepKey 2019-01-24 09:02:17 +01:00
Léo Ercolanelli
efb1cb0528 sumMapFiltered: remove this-> in constructor 2019-01-24 08:58:57 +01:00
alexey-milovidov
f13d094a4e
Merge pull request #3973 from amosbird/join_overwrite
Add join_overwrite settings for StorageJoin.
2019-01-24 02:05:13 +03:00
alexey-milovidov
e6e404ae58
Merge pull request #4133 from abyss7/refactor-block_input_stream
Merge `IBlockInputStream` and `IProfilingBlockInputStream` into one
2019-01-24 01:14:34 +03:00
Vitaly Baranov
67fca7e029 Add support for settings 'format_schema' in an output query.
This fixes syntax error when executing 'SELECT ... FORMAT ... SETTINGS format_schema=...'
2019-01-23 22:23:37 +03:00
Danila Kutenin
784c3e5fda fix of ppc64le definitions 2019-01-23 18:24:14 +03:00
Ivan Lezhankin
05ab15cc84 Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
Danila Kutenin
f6e6f99737 fix 2019-01-23 17:26:05 +03:00
Léo Ercolanelli
8ad1a55f3b implement sumMapFiltered 2019-01-23 15:23:04 +01:00
Danila Kutenin
7f4b0f3c04 added powerpc build support 2019-01-23 17:18:19 +03:00
Alexey Zatelepin
b623d4302c add clone() calls when copying ASTs from stored mutation commands (just in case) #4058 2019-01-23 16:27:01 +03:00
Alexey Zatelepin
da0f555484 speedup calculation of ASTLiteral hash a bit #4058 2019-01-23 16:20:03 +03:00
Alexey Zatelepin
370c8c4e54 Merge branch 'master' into mutations-fix-in
Conflicts:
	dbms/src/Parsers/IAST.h
2019-01-23 14:47:53 +03:00
Alexey Zatelepin
f3b4292fc6 add data types to the prepared_sets key for literals #4058 2019-01-23 14:20:01 +03:00
Alexey Zatelepin
5154814bf9 try to get rid of IAST::range #4058 2019-01-23 14:19:22 +03:00
Nikita Vasilev
296ad9163c fix 2019-01-23 12:10:52 +03:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
Nikita Vasilev
d8f3bf7882 refactoring 2019-01-22 22:43:52 +03:00
chertus
f54ed4a2e3 do not revisit ArrayJoin identifiers 2019-01-22 21:02:53 +03:00
chertus
97199b9712 fix ArrayJoin columns calculation 2019-01-22 20:36:08 +03:00
Nikita Vasilev
d47cd4825d Merge remote-tracking branch 'upstream/master' into nikvas0/index 2019-01-22 19:02:20 +03:00
Nikita Vasilev
9ee50da8b6 refactor 2019-01-22 18:58:11 +03:00
chertus
1d0bee7dee fix collecting required columns in lambda 2019-01-21 22:56:11 +03:00
Alexey Milovidov
c70e8cc5f0 Miscellaneous #3726 2019-01-21 22:45:26 +03:00
alexey-milovidov
b41fa8e7af
Merge pull request #3726 from zhang2014/feature/use_cluster_pool
Use cluster connections pool in DirectoryMonitor
2019-01-21 22:33:19 +03:00
Alexey Milovidov
f7ecfc776b Miscellaneous #4111 2019-01-21 21:04:08 +03:00
alexey-milovidov
09b991b47c
Merge pull request #4111 from yandex/compression_codecs_log_storages
Compression codecs log storages
2019-01-21 20:59:56 +03:00
Nikita Vasilev
51830221bd refactoring 2019-01-21 20:54:27 +03:00
Nikita Vasilev
08adef7027 rename 2019-01-21 20:17:21 +03:00
Alexey Milovidov
47139adc5b Merge branch 'master' into test-hint-fix 2019-01-21 18:28:23 +03:00
Nikita Vasilev
2a76e86338 Merge branch 'nikvas0/index' into nikvas0/parse_index 2019-01-21 17:54:13 +03:00
Nikita Vasilev
03cf70e960 Merge remote-tracking branch 'upstream/master' into nikvas0/index 2019-01-21 17:52:38 +03:00
Nikita Vasilev
f0a0dbbf5a fixed bug with replMT indices storing in zk 2019-01-21 17:47:47 +03:00
alesapin
88c413fbe2 Remove accidental change 2019-01-21 17:03:34 +03:00
alesapin
34fb1c89f1 Add ability to choose codecs for storage log and tiny log 2019-01-21 17:00:06 +03:00
Nikita Vasilev
506f2c41c8 fixed MT alter 2019-01-21 16:51:42 +03:00
Alexey Milovidov
ac0060079a Fixed warnings in SpecializedAggregator 2019-01-21 16:13:20 +03:00
Nikita Vasilev
c32d1983a0 go to indicesDescr 2019-01-21 12:47:35 +03:00
Nikita Vasilev
977b1e20d0 moved indices 2019-01-20 23:03:17 +03:00
Nikita Vasilev
3f5447f471 go to IndicesDescr 2019-01-20 21:43:49 +03:00
Nikita Vasilev
093b94ae38 basic IndicesDescription 2019-01-20 20:49:53 +03:00
Nikita Vasilev
d6545177fb fix err 2019-01-20 18:50:11 +03:00
Nikita Vasilev
9120bebe56 fixed printing 2019-01-20 18:02:19 +03:00
Nikita Vasilev
cf377b9828 fixed parsing 2019-01-20 14:40:58 +03:00
Nikita Vasilev
5e626be07f fix 2019-01-20 14:34:13 +03:00
Nikita Vasilev
13a4fb2756 replaced columns 2019-01-20 14:03:21 +03:00
Nikita Vasilev
bc0e4facc8 fix comments 2019-01-20 12:33:29 +03:00
Nikita Vasilev
8152bc40d5 fix 2019-01-20 12:24:31 +03:00
Nikita Vasilev
4bf0ac886b added useful parsers and ast classes 2019-01-20 12:19:34 +03:00
Nikita Vasilev
4a19523698 Merge remote-tracking branch 'upstream/master' into nikvas0/index 2019-01-20 10:14:06 +03:00
alexey-milovidov
ee23f6997d
Merge pull request #4084 from yandex/storage_hdfs_improvements
Storage hdfs write and refactoring
2019-01-20 02:51:39 +03:00
alexey-milovidov
9a22185bd6
Update ReadBufferFromHDFS.cpp 2019-01-20 02:51:03 +03:00
Alexey Milovidov
c7b95b5175 Miscellaneous changes for PVS-Studio 2019-01-20 02:27:52 +03:00
alesapin
21f1c4d1ce Better code and tests for bad cases 2019-01-19 23:17:19 +03:00
alesapin
33d5f0c8dd Fix potential null pointer dereference 2019-01-18 21:57:11 +03:00
alexey-milovidov
3c6263e89e
Merge pull request #4094 from abyss7/issue-2675
Add setting to Kafka Engine to control number of parsing errors
2019-01-18 21:46:52 +03:00
alesapin
66bd80703e Fix clang warning 2019-01-18 19:17:24 +03:00