Commit Graph

11680 Commits

Author SHA1 Message Date
alexey-milovidov
c07dbee50d
Merge pull request #4148 from vitlibar/master
Use more IO/WriteHelpers.h functions in the class ProtobufSimpleWriter, rename variant=>varint.
2019-01-25 19:22:31 +03:00
chertus
9539467b59 hotfix 2019-01-25 18:48:53 +03:00
chertus
091efcda95 add IdentifierSemantic and PredicateExpressionsOptimizer refactoring 2019-01-25 18:42:24 +03:00
Amos Bird
d8eba7e71b Better joinGet. 2019-01-25 23:38:13 +08:00
Léo Ercolanelli
a78282b834 IDataType.h: remove trailing whitespace 2019-01-25 15:42:44 +01:00
Léo Ercolanelli
57104f81da rename widen to promote for IDataType 2019-01-25 15:16:23 +01:00
Vitaly Baranov
ed1136e49e Use more IO/WriteHelpers.h functions in the class ProtobufSimpleWriter,
rename variant=>varint.
2019-01-25 17:15:44 +03:00
Alexey Milovidov
468f8b4cfb Addition to prev. revision #4150 2019-01-25 17:08:01 +03:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Léo Ercolanelli
0d6094a3ea sumMap: return types less prone to oveflows
It used to be that sumMap would return the same type as the values
columns. If columns of Array(UInt8) were to be given, that would really
easily cause oveflow. It now uses `getWidenDataType` (and ultimately
`NearestFieldType`) in order to define the result type.
2019-01-25 14:29:45 +01:00
Léo Ercolanelli
d9195cda99 implement getWidenType() on IDataType
This is essentially to help implementing the `getReturnType` of
aggregation function susceptible to provoque overflow (such as
`sumMap`).
2019-01-25 14:25:25 +01:00
chertus
a0fafefc96 minor change - add Aliases.h 2019-01-25 14:43:19 +03:00
alexey-milovidov
20970154d8
Merge pull request #4141 from 4ertus2/ast
JOIN with USING: do not duplicate columns
2019-01-25 03:22:43 +03:00
alexey-milovidov
2626a2614c
Merge pull request #4145 from yandex/fix-fuzz-test-in-ubsan-quantile-weighted
Fix fuzz test in ubsan: added parameter type check for quantile*Weighted.
2019-01-25 02:45:07 +03:00
Alexey Milovidov
ef50601b5c Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /g' 2019-01-25 02:01:56 +03:00
Alexey Milovidov
5ccc42fd96 Revert "Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /'"
This reverts commit a28f0acf09.
2019-01-25 01:59:45 +03:00
Alexey Milovidov
304c7b0386 Style #4005 2019-01-24 22:50:16 +03:00
Alexey Milovidov
a28f0acf09 Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /' 2019-01-24 22:49:36 +03:00
Alexey Milovidov
854817c232 Fixed -Wshadow-field #4005 2019-01-24 22:37:32 +03:00
Alexey Milovidov
04fa827e4b Style 2019-01-24 22:21:47 +03:00
alexey-milovidov
f96b8e4ed6
Merge pull request #4005 from vitlibar/add-protobuf-output-format
Add protobuf output format
2019-01-24 22:05:23 +03:00
Alexey Milovidov
ffd18163de Fixed fuzz test in UBSan: added parameter check for quantile*Weighted function 2019-01-24 21:33:57 +03:00
alexey-milovidov
fbefc99fb1
Merge pull request #4129 from ercolanelli-leo/sumMapFiltered
implement sumMapFiltered
2019-01-24 21:27:03 +03:00
alexey-milovidov
18f1266dab
Merge pull request #4099 from yandex/mutations-fix-in
Get rid of IAST::range
2019-01-24 20:29:13 +03:00
Alexey Milovidov
0e59fe0b46 Renamed setting and variables #3973 2019-01-24 20:12:05 +03:00
chertus
ccd9bd0877 fix build 2019-01-24 18:06:15 +03:00
Vitaly Baranov
2886f42c0e Implemented a new block output stream using protobuf output format. 2019-01-24 17:54:57 +03:00
Vitaly Baranov
c241a4ea6d Added function serializeProtobuf() to each data type. 2019-01-24 17:54:57 +03:00
Vitaly Baranov
1e7a231c56 Implemented main class for writing protobufs. 2019-01-24 17:54:52 +03:00
Vitaly Baranov
42d9d4e81d Implemented storage for parsed protobuf schemas. 2019-01-24 17:32:10 +03:00
Vitaly Baranov
28e9837819 Implemented utility class for writing protobufs. 2019-01-24 17:32:01 +03:00
Vitaly Baranov
b1aba679d0 Class WriteBufferFromOwnString now can return StringRef too. 2019-01-24 17:32:01 +03:00
Vitaly Baranov
ec37ef5a89 No escaping for the format schema file's name anymore,
added an utility class for parsing and checking the format schema.
2019-01-24 17:31:41 +03:00
chertus
cbbf04204b JOIN with USING: do not duplicate columns 2019-01-24 17:22:58 +03:00
Léo Ercolanelli
ba1f1c7460 sumMapFiltered: use an unordered_set 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
90afad8c00 sumMapFiltered: improve error reporting on parameter type mismatch 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
a8647761ce sumMapFiltered: fix dangling reference 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
22f7bd03b9 sumMapFiltered: use CRTP instead of virtual for keepKey 2019-01-24 09:02:17 +01:00
Léo Ercolanelli
efb1cb0528 sumMapFiltered: remove this-> in constructor 2019-01-24 08:58:57 +01:00
alexey-milovidov
f13d094a4e
Merge pull request #3973 from amosbird/join_overwrite
Add join_overwrite settings for StorageJoin.
2019-01-24 02:05:13 +03:00
alexey-milovidov
e6e404ae58
Merge pull request #4133 from abyss7/refactor-block_input_stream
Merge `IBlockInputStream` and `IProfilingBlockInputStream` into one
2019-01-24 01:14:34 +03:00
Vitaly Baranov
67fca7e029 Add support for settings 'format_schema' in an output query.
This fixes syntax error when executing 'SELECT ... FORMAT ... SETTINGS format_schema=...'
2019-01-23 22:23:37 +03:00
Danila Kutenin
784c3e5fda fix of ppc64le definitions 2019-01-23 18:24:14 +03:00
Ivan Lezhankin
05ab15cc84 Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
Danila Kutenin
f6e6f99737 fix 2019-01-23 17:26:05 +03:00
Léo Ercolanelli
8ad1a55f3b implement sumMapFiltered 2019-01-23 15:23:04 +01:00
Danila Kutenin
7f4b0f3c04 added powerpc build support 2019-01-23 17:18:19 +03:00
Alexey Zatelepin
b623d4302c add clone() calls when copying ASTs from stored mutation commands (just in case) #4058 2019-01-23 16:27:01 +03:00
Alexey Zatelepin
da0f555484 speedup calculation of ASTLiteral hash a bit #4058 2019-01-23 16:20:03 +03:00
Alexey Zatelepin
370c8c4e54 Merge branch 'master' into mutations-fix-in
Conflicts:
	dbms/src/Parsers/IAST.h
2019-01-23 14:47:53 +03:00
Alexey Zatelepin
f3b4292fc6 add data types to the prepared_sets key for literals #4058 2019-01-23 14:20:01 +03:00
Alexey Zatelepin
5154814bf9 try to get rid of IAST::range #4058 2019-01-23 14:19:22 +03:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
chertus
f54ed4a2e3 do not revisit ArrayJoin identifiers 2019-01-22 21:02:53 +03:00
chertus
97199b9712 fix ArrayJoin columns calculation 2019-01-22 20:36:08 +03:00
chertus
1d0bee7dee fix collecting required columns in lambda 2019-01-21 22:56:11 +03:00
Alexey Milovidov
c70e8cc5f0 Miscellaneous #3726 2019-01-21 22:45:26 +03:00
alexey-milovidov
b41fa8e7af
Merge pull request #3726 from zhang2014/feature/use_cluster_pool
Use cluster connections pool in DirectoryMonitor
2019-01-21 22:33:19 +03:00
Alexey Milovidov
f7ecfc776b Miscellaneous #4111 2019-01-21 21:04:08 +03:00
alexey-milovidov
09b991b47c
Merge pull request #4111 from yandex/compression_codecs_log_storages
Compression codecs log storages
2019-01-21 20:59:56 +03:00
Alexey Milovidov
47139adc5b Merge branch 'master' into test-hint-fix 2019-01-21 18:28:23 +03:00
alesapin
88c413fbe2 Remove accidental change 2019-01-21 17:03:34 +03:00
alesapin
34fb1c89f1 Add ability to choose codecs for storage log and tiny log 2019-01-21 17:00:06 +03:00
Alexey Milovidov
ac0060079a Fixed warnings in SpecializedAggregator 2019-01-21 16:13:20 +03:00
alexey-milovidov
ee23f6997d
Merge pull request #4084 from yandex/storage_hdfs_improvements
Storage hdfs write and refactoring
2019-01-20 02:51:39 +03:00
alexey-milovidov
9a22185bd6
Update ReadBufferFromHDFS.cpp 2019-01-20 02:51:03 +03:00
Alexey Milovidov
c7b95b5175 Miscellaneous changes for PVS-Studio 2019-01-20 02:27:52 +03:00
alesapin
21f1c4d1ce Better code and tests for bad cases 2019-01-19 23:17:19 +03:00
alesapin
33d5f0c8dd Fix potential null pointer dereference 2019-01-18 21:57:11 +03:00
alexey-milovidov
3c6263e89e
Merge pull request #4094 from abyss7/issue-2675
Add setting to Kafka Engine to control number of parsing errors
2019-01-18 21:46:52 +03:00
alesapin
66bd80703e Fix clang warning 2019-01-18 19:17:24 +03:00
Boris Granveaud
f1a7f60165 new functions filesystemAvailable, filesystemFree and filesystemCapacity 2019-01-18 16:44:53 +01:00
Ivan Lezhankin
5f74094edb Fix a setting description. 2019-01-18 16:15:36 +03:00
alesapin
7c1c6eba8b Wrap hdfsBuilder into unique ptr 2019-01-18 15:48:55 +03:00
Ivan Lezhankin
89ffb577b1 Implement additional Kafka engine setting for allowed parsing errors 2019-01-18 15:48:38 +03:00
alesapin
a139f375c3 Remove copypaste 2019-01-18 14:39:36 +03:00
alesapin
71e58ca001 Fix potential leak in read buffer 2019-01-18 14:01:07 +03:00
alesapin
83c32727dc Remove strange commit 2019-01-18 13:57:00 +03:00
alesapin
2f7b63cf71 Fix review notes 2019-01-18 13:55:03 +03:00
zhang2014
998591b30d fix build failure 2019-01-18 10:31:28 +08:00
alexey-milovidov
3d4bd7cbf8
Merge branch 'master' into feature/use_cluster_pool 2019-01-18 01:02:39 +03:00
alexey-milovidov
7beb25eaaf
Merge pull request #4087 from 4ertus2/joins
child free ASTIdentifier
2019-01-18 00:51:08 +03:00
alexey-milovidov
908015aa4b
Merge pull request #4088 from proller/fix14
CLICKHOUSE-4257 remoteSecure
2019-01-18 00:48:55 +03:00
Alexey Milovidov
a7c468da8e Merge remote-tracking branch 'origin/master' into global-thread-pool 2019-01-17 21:57:01 +03:00
Alexey Milovidov
c3aae60aed Trying to understand the code #4063 2019-01-17 21:49:56 +03:00
proller
e778a5eeca Fix port secelt 2019-01-17 21:49:01 +03:00
proller
f2bbac6523 CLICKHOUSE-4257 remoteSecure 2019-01-17 20:55:44 +03:00
chertus
5289c1337e child free ASTIdentifier 2019-01-17 20:01:48 +03:00
alesapin
b6ad3cf148 Remove shadow variable warning 2019-01-17 19:15:51 +03:00
Alexey Zatelepin
addc9a43b0 remove unused IAST field 2019-01-17 18:52:29 +03:00
Alexey Milovidov
736e1e2d71 Fixed build #4063 2019-01-17 18:21:21 +03:00
Alexey Milovidov
303c3cc043 Merge branch 'master' of https://github.com/Miniwoffer/ClickHouse into Miniwoffer-master 2019-01-17 18:04:06 +03:00
Alexey Milovidov
178302cc5d Miscellaneous #3960 2019-01-17 17:45:02 +03:00
alesapin
07e11577d3 Add write logic and remove strange multifile read logic 2019-01-17 17:10:30 +03:00
alexey-milovidov
0ec1fdef04
Merge pull request #3960 from yandex/zk-columns-compact-storage
Compact storage of the part header in ZooKeeper
2019-01-17 17:05:01 +03:00
alesapin
2d3e08fc74 Refactor ReadBufferFromHDFS 2019-01-17 14:26:29 +03:00
alexey-milovidov
b50fa22606
Merge pull request #4077 from 4ertus2/joins
Some more ASTIdentifier refactoring
2019-01-17 00:58:36 +03:00
chertus
394e8b0378 minor improvements and fix 2019-01-16 21:38:19 +03:00
chertus
6a79a03a9e minor improvements 2019-01-16 21:38:19 +03:00
chertus
738080c73f minor improvements 2019-01-16 21:38:19 +03:00