Commit Graph

11741 Commits

Author SHA1 Message Date
alexey-milovidov
4b8cf83de7
Merge pull request #4151 from ercolanelli-leo/fix/sumMap-overflow
Fix/sum map overflow
2019-01-27 21:11:51 +03:00
alexey-milovidov
ba8fcfd32b
Merge pull request #4158 from vitlibar/add-support-for-absolute-format-schema-paths
Add support for absolute format schema paths.
2019-01-27 21:07:00 +03:00
Vitaly Baranov
e9721c9548 Add support for absolute format schema paths. 2019-01-27 12:15:32 +03:00
Alexey Milovidov
ef51f126b4 Removed extraordinarily bad code in StorageFile #2150 2019-01-27 03:38:30 +03:00
proller
9230fe9917 Merge remote-tracking branch 'upstream/master' into fix10 2019-01-25 23:10:38 +03:00
proller
5328251ff1
Fix build without protobuf, gtest, cppkafka (#4152) 2019-01-25 23:02:03 +03:00
Léo Ercolanelli
e1d6017120 use sumMapWithOverflow in SummingSortedBlockInputStream 2019-01-25 20:36:18 +01:00
Léo Ercolanelli
038a48bb38 sumMap: implement sumMapWithOverflow 2019-01-25 20:35:53 +01:00
proller
6964fb47ff BUILD_DETERMINISTIC 2019-01-25 22:29:01 +03:00
Alexey Milovidov
253ac93459 Addition to prev. revision #4150 2019-01-25 21:44:30 +03:00
alexey-milovidov
8124ee50e8
Merge pull request #4153 from amosbird/joingetfix
Better joinGet.
2019-01-25 20:47:53 +03:00
alexey-milovidov
c07dbee50d
Merge pull request #4148 from vitlibar/master
Use more IO/WriteHelpers.h functions in the class ProtobufSimpleWriter, rename variant=>varint.
2019-01-25 19:22:31 +03:00
chertus
9539467b59 hotfix 2019-01-25 18:48:53 +03:00
chertus
091efcda95 add IdentifierSemantic and PredicateExpressionsOptimizer refactoring 2019-01-25 18:42:24 +03:00
Amos Bird
d8eba7e71b Better joinGet. 2019-01-25 23:38:13 +08:00
Léo Ercolanelli
a78282b834 IDataType.h: remove trailing whitespace 2019-01-25 15:42:44 +01:00
Léo Ercolanelli
57104f81da rename widen to promote for IDataType 2019-01-25 15:16:23 +01:00
Vitaly Baranov
ed1136e49e Use more IO/WriteHelpers.h functions in the class ProtobufSimpleWriter,
rename variant=>varint.
2019-01-25 17:15:44 +03:00
Alexey Milovidov
468f8b4cfb Addition to prev. revision #4150 2019-01-25 17:08:01 +03:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Léo Ercolanelli
0d6094a3ea sumMap: return types less prone to oveflows
It used to be that sumMap would return the same type as the values
columns. If columns of Array(UInt8) were to be given, that would really
easily cause oveflow. It now uses `getWidenDataType` (and ultimately
`NearestFieldType`) in order to define the result type.
2019-01-25 14:29:45 +01:00
Léo Ercolanelli
d9195cda99 implement getWidenType() on IDataType
This is essentially to help implementing the `getReturnType` of
aggregation function susceptible to provoque overflow (such as
`sumMap`).
2019-01-25 14:25:25 +01:00
chertus
a0fafefc96 minor change - add Aliases.h 2019-01-25 14:43:19 +03:00
alexey-milovidov
20970154d8
Merge pull request #4141 from 4ertus2/ast
JOIN with USING: do not duplicate columns
2019-01-25 03:22:43 +03:00
alexey-milovidov
2626a2614c
Merge pull request #4145 from yandex/fix-fuzz-test-in-ubsan-quantile-weighted
Fix fuzz test in ubsan: added parameter type check for quantile*Weighted.
2019-01-25 02:45:07 +03:00
Alexey Milovidov
ef50601b5c Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /g' 2019-01-25 02:01:56 +03:00
Alexey Milovidov
5ccc42fd96 Revert "Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /'"
This reverts commit a28f0acf09.
2019-01-25 01:59:45 +03:00
Alexey Milovidov
304c7b0386 Style #4005 2019-01-24 22:50:16 +03:00
Alexey Milovidov
a28f0acf09 Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /' 2019-01-24 22:49:36 +03:00
Alexey Milovidov
854817c232 Fixed -Wshadow-field #4005 2019-01-24 22:37:32 +03:00
Alexey Milovidov
04fa827e4b Style 2019-01-24 22:21:47 +03:00
alexey-milovidov
f96b8e4ed6
Merge pull request #4005 from vitlibar/add-protobuf-output-format
Add protobuf output format
2019-01-24 22:05:23 +03:00
Alexey Milovidov
ffd18163de Fixed fuzz test in UBSan: added parameter check for quantile*Weighted function 2019-01-24 21:33:57 +03:00
alexey-milovidov
fbefc99fb1
Merge pull request #4129 from ercolanelli-leo/sumMapFiltered
implement sumMapFiltered
2019-01-24 21:27:03 +03:00
alexey-milovidov
18f1266dab
Merge pull request #4099 from yandex/mutations-fix-in
Get rid of IAST::range
2019-01-24 20:29:13 +03:00
Alexey Milovidov
0e59fe0b46 Renamed setting and variables #3973 2019-01-24 20:12:05 +03:00
chertus
ccd9bd0877 fix build 2019-01-24 18:06:15 +03:00
Vitaly Baranov
2886f42c0e Implemented a new block output stream using protobuf output format. 2019-01-24 17:54:57 +03:00
Vitaly Baranov
c241a4ea6d Added function serializeProtobuf() to each data type. 2019-01-24 17:54:57 +03:00
Vitaly Baranov
1e7a231c56 Implemented main class for writing protobufs. 2019-01-24 17:54:52 +03:00
Vitaly Baranov
42d9d4e81d Implemented storage for parsed protobuf schemas. 2019-01-24 17:32:10 +03:00
Vitaly Baranov
28e9837819 Implemented utility class for writing protobufs. 2019-01-24 17:32:01 +03:00
Vitaly Baranov
b1aba679d0 Class WriteBufferFromOwnString now can return StringRef too. 2019-01-24 17:32:01 +03:00
Vitaly Baranov
ec37ef5a89 No escaping for the format schema file's name anymore,
added an utility class for parsing and checking the format schema.
2019-01-24 17:31:41 +03:00
chertus
cbbf04204b JOIN with USING: do not duplicate columns 2019-01-24 17:22:58 +03:00
Léo Ercolanelli
ba1f1c7460 sumMapFiltered: use an unordered_set 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
90afad8c00 sumMapFiltered: improve error reporting on parameter type mismatch 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
a8647761ce sumMapFiltered: fix dangling reference 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
22f7bd03b9 sumMapFiltered: use CRTP instead of virtual for keepKey 2019-01-24 09:02:17 +01:00
Léo Ercolanelli
efb1cb0528 sumMapFiltered: remove this-> in constructor 2019-01-24 08:58:57 +01:00
alexey-milovidov
f13d094a4e
Merge pull request #3973 from amosbird/join_overwrite
Add join_overwrite settings for StorageJoin.
2019-01-24 02:05:13 +03:00
alexey-milovidov
e6e404ae58
Merge pull request #4133 from abyss7/refactor-block_input_stream
Merge `IBlockInputStream` and `IProfilingBlockInputStream` into one
2019-01-24 01:14:34 +03:00
Vitaly Baranov
67fca7e029 Add support for settings 'format_schema' in an output query.
This fixes syntax error when executing 'SELECT ... FORMAT ... SETTINGS format_schema=...'
2019-01-23 22:23:37 +03:00
Danila Kutenin
784c3e5fda fix of ppc64le definitions 2019-01-23 18:24:14 +03:00
Ivan Lezhankin
05ab15cc84 Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
Danila Kutenin
f6e6f99737 fix 2019-01-23 17:26:05 +03:00
Léo Ercolanelli
8ad1a55f3b implement sumMapFiltered 2019-01-23 15:23:04 +01:00
Danila Kutenin
7f4b0f3c04 added powerpc build support 2019-01-23 17:18:19 +03:00
Alexey Zatelepin
b623d4302c add clone() calls when copying ASTs from stored mutation commands (just in case) #4058 2019-01-23 16:27:01 +03:00
Alexey Zatelepin
da0f555484 speedup calculation of ASTLiteral hash a bit #4058 2019-01-23 16:20:03 +03:00
Alexey Zatelepin
370c8c4e54 Merge branch 'master' into mutations-fix-in
Conflicts:
	dbms/src/Parsers/IAST.h
2019-01-23 14:47:53 +03:00
Alexey Zatelepin
f3b4292fc6 add data types to the prepared_sets key for literals #4058 2019-01-23 14:20:01 +03:00
Alexey Zatelepin
5154814bf9 try to get rid of IAST::range #4058 2019-01-23 14:19:22 +03:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
chertus
f54ed4a2e3 do not revisit ArrayJoin identifiers 2019-01-22 21:02:53 +03:00
chertus
97199b9712 fix ArrayJoin columns calculation 2019-01-22 20:36:08 +03:00
chertus
1d0bee7dee fix collecting required columns in lambda 2019-01-21 22:56:11 +03:00
Alexey Milovidov
c70e8cc5f0 Miscellaneous #3726 2019-01-21 22:45:26 +03:00
alexey-milovidov
b41fa8e7af
Merge pull request #3726 from zhang2014/feature/use_cluster_pool
Use cluster connections pool in DirectoryMonitor
2019-01-21 22:33:19 +03:00
Alexey Milovidov
f7ecfc776b Miscellaneous #4111 2019-01-21 21:04:08 +03:00
alexey-milovidov
09b991b47c
Merge pull request #4111 from yandex/compression_codecs_log_storages
Compression codecs log storages
2019-01-21 20:59:56 +03:00
Alexey Milovidov
47139adc5b Merge branch 'master' into test-hint-fix 2019-01-21 18:28:23 +03:00
alesapin
88c413fbe2 Remove accidental change 2019-01-21 17:03:34 +03:00
alesapin
34fb1c89f1 Add ability to choose codecs for storage log and tiny log 2019-01-21 17:00:06 +03:00
Alexey Milovidov
ac0060079a Fixed warnings in SpecializedAggregator 2019-01-21 16:13:20 +03:00
alexey-milovidov
ee23f6997d
Merge pull request #4084 from yandex/storage_hdfs_improvements
Storage hdfs write and refactoring
2019-01-20 02:51:39 +03:00
alexey-milovidov
9a22185bd6
Update ReadBufferFromHDFS.cpp 2019-01-20 02:51:03 +03:00
Alexey Milovidov
c7b95b5175 Miscellaneous changes for PVS-Studio 2019-01-20 02:27:52 +03:00
alesapin
21f1c4d1ce Better code and tests for bad cases 2019-01-19 23:17:19 +03:00
alesapin
33d5f0c8dd Fix potential null pointer dereference 2019-01-18 21:57:11 +03:00
alexey-milovidov
3c6263e89e
Merge pull request #4094 from abyss7/issue-2675
Add setting to Kafka Engine to control number of parsing errors
2019-01-18 21:46:52 +03:00
alesapin
66bd80703e Fix clang warning 2019-01-18 19:17:24 +03:00
Boris Granveaud
f1a7f60165 new functions filesystemAvailable, filesystemFree and filesystemCapacity 2019-01-18 16:44:53 +01:00
Ivan Lezhankin
5f74094edb Fix a setting description. 2019-01-18 16:15:36 +03:00
alesapin
7c1c6eba8b Wrap hdfsBuilder into unique ptr 2019-01-18 15:48:55 +03:00
Ivan Lezhankin
89ffb577b1 Implement additional Kafka engine setting for allowed parsing errors 2019-01-18 15:48:38 +03:00
alesapin
a139f375c3 Remove copypaste 2019-01-18 14:39:36 +03:00
alesapin
71e58ca001 Fix potential leak in read buffer 2019-01-18 14:01:07 +03:00
alesapin
83c32727dc Remove strange commit 2019-01-18 13:57:00 +03:00
alesapin
2f7b63cf71 Fix review notes 2019-01-18 13:55:03 +03:00
zhang2014
998591b30d fix build failure 2019-01-18 10:31:28 +08:00
alexey-milovidov
3d4bd7cbf8
Merge branch 'master' into feature/use_cluster_pool 2019-01-18 01:02:39 +03:00
alexey-milovidov
7beb25eaaf
Merge pull request #4087 from 4ertus2/joins
child free ASTIdentifier
2019-01-18 00:51:08 +03:00
alexey-milovidov
908015aa4b
Merge pull request #4088 from proller/fix14
CLICKHOUSE-4257 remoteSecure
2019-01-18 00:48:55 +03:00
Alexey Milovidov
a7c468da8e Merge remote-tracking branch 'origin/master' into global-thread-pool 2019-01-17 21:57:01 +03:00
Alexey Milovidov
c3aae60aed Trying to understand the code #4063 2019-01-17 21:49:56 +03:00
proller
e778a5eeca Fix port secelt 2019-01-17 21:49:01 +03:00
proller
f2bbac6523 CLICKHOUSE-4257 remoteSecure 2019-01-17 20:55:44 +03:00
chertus
5289c1337e child free ASTIdentifier 2019-01-17 20:01:48 +03:00
alesapin
b6ad3cf148 Remove shadow variable warning 2019-01-17 19:15:51 +03:00
Alexey Zatelepin
addc9a43b0 remove unused IAST field 2019-01-17 18:52:29 +03:00
Alexey Milovidov
736e1e2d71 Fixed build #4063 2019-01-17 18:21:21 +03:00
Alexey Milovidov
303c3cc043 Merge branch 'master' of https://github.com/Miniwoffer/ClickHouse into Miniwoffer-master 2019-01-17 18:04:06 +03:00
Alexey Milovidov
178302cc5d Miscellaneous #3960 2019-01-17 17:45:02 +03:00
alesapin
07e11577d3 Add write logic and remove strange multifile read logic 2019-01-17 17:10:30 +03:00
alexey-milovidov
0ec1fdef04
Merge pull request #3960 from yandex/zk-columns-compact-storage
Compact storage of the part header in ZooKeeper
2019-01-17 17:05:01 +03:00
alesapin
2d3e08fc74 Refactor ReadBufferFromHDFS 2019-01-17 14:26:29 +03:00
alexey-milovidov
b50fa22606
Merge pull request #4077 from 4ertus2/joins
Some more ASTIdentifier refactoring
2019-01-17 00:58:36 +03:00
chertus
394e8b0378 minor improvements and fix 2019-01-16 21:38:19 +03:00
chertus
6a79a03a9e minor improvements 2019-01-16 21:38:19 +03:00
chertus
738080c73f minor improvements 2019-01-16 21:38:19 +03:00
chertus
8bb35ac987 minor changes 2019-01-16 21:38:19 +03:00
Danila Kutenin
45882dc048 Merge branch 'danlark1-master' 2019-01-16 20:46:51 +03:00
Danila Kutenin
4f29102e7f Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-01-16 20:44:21 +03:00
Danila Kutenin
12bcff48ee Miscellaneous and some optimizations 2019-01-16 20:41:08 +03:00
Alexey Milovidov
61a59956b3 Indentation #4004 2019-01-16 20:25:06 +03:00
Alexey Zatelepin
be6a8d6118 fix clang build 2019-01-16 19:42:02 +03:00
Alexey Milovidov
23fbf18555 Merge branch 'sequence-max-iterations' of https://github.com/ercolanelli-leo/ClickHouse into ercolanelli-leo-sequence-max-iterations 2019-01-16 19:37:51 +03:00
Léo Ercolanelli
043ef82468 fix style in AggregateFunctionSequenceMatch.h 2019-01-16 17:20:29 +01:00
Alexey Milovidov
bf2ca149c9 Merge branch 'sequence-max-iterations' of https://github.com/ercolanelli-leo/ClickHouse into ercolanelli-leo-sequence-max-iterations 2019-01-16 18:22:35 +03:00
Alexey Zatelepin
0f8e5f8522 Merge branch 'master' into zk-columns-compact-storage
Conflicts:
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2019-01-16 17:45:16 +03:00
Danila Kutenin
1badabdcd0 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-01-16 17:06:38 +03:00
Alexey Milovidov
7d03804d06 Miscellaneous #4053 2019-01-16 16:57:11 +03:00
Alexey Milovidov
0817ff0d58 Merge branch 'master' of https://github.com/danlark1/ClickHouse into danlark1-master 2019-01-16 16:28:28 +03:00
alexey-milovidov
eeac860e0a
Update CapnProtoRowInputStream.cpp 2019-01-16 16:14:54 +03:00
alexey-milovidov
fb68929b10
Update CapnProtoRowInputStream.cpp 2019-01-16 16:14:34 +03:00
Léo Ercolanelli
6048a83462 add comment to sequenceMatch's DFA implementation 2019-01-16 10:39:35 +01:00
Léo Ercolanelli
04651503d6 sequence: implement DFA matching algorithm 2019-01-16 10:39:35 +01:00
Alexey Milovidov
78671d15bd Avoid bad code #4052 2019-01-16 03:52:33 +03:00
Alexey Milovidov
e8871bc211 Added a check #3837 2019-01-16 03:26:15 +03:00
alesapin
e33de8133e Unaligned store of the first element 2019-01-15 23:50:57 +03:00
Danila Kutenin
ce90ad32d1 some style 2019-01-15 19:26:14 +03:00
alesapin
361d26c643 Use information about type in Delta codec to choose correct delta size if possible 2019-01-15 17:20:34 +03:00
alesapin
37c78aa3d2 Merge branch 'master' of github.com:yandex/ClickHouse into compression_codec_delta 2019-01-15 16:24:49 +03:00
Danila Kutenin
43965c1703 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-01-15 16:19:15 +03:00
alesapin
4714bb5f68
Merge pull request #4054 from yandex/compression_codec_alter
Compression codec alter
2019-01-15 16:18:33 +03:00
alesapin
8315c540d4 Merge branch 'master' into compression_codec_delta 2019-01-15 15:45:02 +03:00
chertus
a5d8858ee2 minor ASTIdentifier changes 2019-01-15 15:28:17 +03:00
alesapin
48847441f1 Add spaces in codecs description 2019-01-15 14:06:00 +03:00
alesapin
694f746798 Merge branch 'master' into compression_codec_alter 2019-01-15 13:52:45 +03:00
Odin Hultgren Van Der Horst
3ff868917e Changed tabs to spaces 2019-01-15 09:41:48 +01:00
Odin Hultgren Van Der Horst
3378bf58f5 Comments and changes to parent check
- Added some comments.
 - Immplemented a recurisve parent check so fields with parents by
the same name but grandparents with diffrent names dont cause problems
2019-01-15 09:27:38 +01:00
Odin Hultgren Van Der Horst
8bff8d4e2d Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-01-15 08:13:51 +01:00
alexey-milovidov
27a0c37d77
Update Join.h 2019-01-15 00:41:35 +03:00
alexey-milovidov
64c31a6ad7
Update Join.h 2019-01-15 00:40:42 +03:00
alexey-milovidov
8a401e491a
Update Join.cpp 2019-01-15 00:40:02 +03:00
alexey-milovidov
bcc54d1606
Merge pull request #4025 from abyss7/fix-kafka
Update Kafka libraries
2019-01-15 00:23:20 +03:00
alexey-milovidov
8a251753be
Merge pull request #4056 from 4ertus2/ast
Helpers for ASTIdentifier (based on 'QueryNormalizer refactoring' changes)
2019-01-15 00:22:54 +03:00
alexey-milovidov
d727689ca4
Merge pull request #4031 from 4ertus2/joins
QueryNormalizer refactoring
2019-01-15 00:22:23 +03:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00