Commit Graph

11782 Commits

Author SHA1 Message Date
chertus
866c2b2e78 move required right keys calculation to Join.cpp 2019-01-30 18:51:39 +03:00
Alexey Milovidov
18e512d069 Merge branch 'master' into dictionaries-user-profile 2019-01-30 18:18:20 +03:00
Alexey Zatelepin
063366307f fix build 2019-01-30 18:03:43 +03:00
proller
0e863fff1e Fix rethrowing exception #4188 2019-01-30 17:06:42 +03:00
Alexey Milovidov
73a6209eba Merge branch 'master' into split-odbc-bridge 2019-01-30 17:01:06 +03:00
Alexey Milovidov
2eb861c143 Reverted part of changes #4188 2019-01-30 16:57:44 +03:00
Alexey Zatelepin
8957e73681 a tool to convert an old month-partition part to the custom-partitioned format [#CLICKHOUSE-4231] 2019-01-30 16:51:39 +03:00
chertus
d6450bc488 Refactoring: extract SubqueryForSet to own files 2019-01-30 15:01:00 +03:00
proller
1cfec66165 Merge remote-tracking branch 'upstream/master' into fix14 2019-01-30 13:01:45 +03:00
proller
dc34e8998c Better fix 2019-01-30 13:01:01 +03:00
zhang2014
3af26ca070 ISSUES-3885 better test & fix isStateful bug 2019-01-30 12:49:00 +08:00
zhang2014
ddbd384f32 ISSUES-3885 mark stateful function & do not optimize their predicate 2019-01-30 12:04:28 +08:00
alesapin
95db9b4d76 Merge master 2019-01-29 23:17:52 +03:00
Alexey Milovidov
b57ec0543f Setting user when doing in-process loading of dictionaries (incomplete) 2019-01-29 22:05:32 +03:00
alexey-milovidov
fd5ab9ed2e
Merge pull request #4055 from yandex/fix-group-by-array-low-cardibality-arguments
Fix group by array low cardinality arguments
2019-01-29 21:32:45 +03:00
Alexey Milovidov
0b0960e28f Fixed "Attempt to attach to nullptr thread group" when reloading dictionaries 2019-01-29 20:24:54 +03:00
alesapin
4f97c291e6 Always run clickhouse-odbc-bridge; Integration tests now able to run odbc-bridge from separate binary; add symlink to clickhouse-odbc-bridge in dbms/programs folder; 2019-01-29 20:17:31 +03:00
proller
4942e024b1 4177 4156 : Fix crash on dictionary reload if dictionary not available 2019-01-29 19:36:50 +03:00
Nikolai Kochetov
21242ad658 Added tests. Restored recursiveRemoveLowCardinality interface. 2019-01-29 18:44:02 +03:00
alesapin
cb0e77dce6 Fix non initialized codec and wrong size in CacheCompressedReadBuffer 2019-01-29 17:55:57 +03:00
chertus
9c6f71bb7e fix inner and left join with duplicates [issue-4108] 2019-01-29 15:38:53 +03:00
Nikolai Kochetov
2c2932e185 Merged with master 2019-01-29 15:25:19 +03:00
Nikolai Kochetov
5d29562302 Fix build. 2019-01-29 13:56:44 +03:00
Alexey Milovidov
27b08a7f22 Merge branch 'master' into fixed-clickhouse-localhost-dictionaries 2019-01-29 13:45:06 +03:00
alexey-milovidov
aa06005a32
Merge pull request #4179 from yandex/avoid-overflow-in-function-sleep
Fixed possible overflow in function "sleep" (found by fuzz test with UBSan)
2019-01-29 13:44:39 +03:00
Alexey Milovidov
c792191831 Fixed possible overflow in function "sleep" (found by fuzz test with UBSan) #4166 2019-01-29 13:42:45 +03:00
proller
343b31af66 More link with Threads::Threads 2019-01-28 21:21:20 +03:00
Alexey Milovidov
9b2a5c3dec Merge branch 'master' into split-odbc-bridge 2019-01-28 18:15:18 +03:00
proller
2ab3138eb6 Merge remote-tracking branch 'upstream/master' into fix10 2019-01-28 17:01:06 +03:00
proller
2eee2d97df Update contrib/libmetrohash 2019-01-28 17:00:50 +03:00
Alexey Milovidov
bc4944eed2 Fixed optimization of loading of ClickHouse dictionaries via localhost #1529 2019-01-28 16:26:10 +03:00
proller
403d36a7f4 Fix 2019-01-28 16:24:55 +03:00
proller
a874945e0e Use cpuinfo if cpuid not available 2019-01-28 16:16:08 +03:00
proller
22549cc43b Merge remote-tracking branch 'upstream/master' into fix10 2019-01-28 15:44:25 +03:00
Alexey Milovidov
4e3d9a0f15 Merge branch 'master' of github.com:yandex/ClickHouse into global-thread-pool 2019-01-28 14:20:24 +03:00
alexey-milovidov
032ed27c27
Merge pull request #4154 from 4ertus2/joins
Add IdentifierSemantic and PredicateExpressionsOptimizer refactoring
2019-01-28 01:47:57 +03:00
alexey-milovidov
4b8cf83de7
Merge pull request #4151 from ercolanelli-leo/fix/sumMap-overflow
Fix/sum map overflow
2019-01-27 21:11:51 +03:00
alexey-milovidov
ba8fcfd32b
Merge pull request #4158 from vitlibar/add-support-for-absolute-format-schema-paths
Add support for absolute format schema paths.
2019-01-27 21:07:00 +03:00
Vitaly Baranov
e9721c9548 Add support for absolute format schema paths. 2019-01-27 12:15:32 +03:00
Alexey Milovidov
ef51f126b4 Removed extraordinarily bad code in StorageFile #2150 2019-01-27 03:38:30 +03:00
proller
9230fe9917 Merge remote-tracking branch 'upstream/master' into fix10 2019-01-25 23:10:38 +03:00
proller
5328251ff1
Fix build without protobuf, gtest, cppkafka (#4152) 2019-01-25 23:02:03 +03:00
Léo Ercolanelli
e1d6017120 use sumMapWithOverflow in SummingSortedBlockInputStream 2019-01-25 20:36:18 +01:00
Léo Ercolanelli
038a48bb38 sumMap: implement sumMapWithOverflow 2019-01-25 20:35:53 +01:00
proller
6964fb47ff BUILD_DETERMINISTIC 2019-01-25 22:29:01 +03:00
Alexey Milovidov
253ac93459 Addition to prev. revision #4150 2019-01-25 21:44:30 +03:00
alexey-milovidov
8124ee50e8
Merge pull request #4153 from amosbird/joingetfix
Better joinGet.
2019-01-25 20:47:53 +03:00
alexey-milovidov
c07dbee50d
Merge pull request #4148 from vitlibar/master
Use more IO/WriteHelpers.h functions in the class ProtobufSimpleWriter, rename variant=>varint.
2019-01-25 19:22:31 +03:00
chertus
9539467b59 hotfix 2019-01-25 18:48:53 +03:00
chertus
091efcda95 add IdentifierSemantic and PredicateExpressionsOptimizer refactoring 2019-01-25 18:42:24 +03:00
Amos Bird
d8eba7e71b Better joinGet. 2019-01-25 23:38:13 +08:00
Léo Ercolanelli
a78282b834 IDataType.h: remove trailing whitespace 2019-01-25 15:42:44 +01:00
Léo Ercolanelli
57104f81da rename widen to promote for IDataType 2019-01-25 15:16:23 +01:00
Vitaly Baranov
ed1136e49e Use more IO/WriteHelpers.h functions in the class ProtobufSimpleWriter,
rename variant=>varint.
2019-01-25 17:15:44 +03:00
Alexey Milovidov
468f8b4cfb Addition to prev. revision #4150 2019-01-25 17:08:01 +03:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Léo Ercolanelli
0d6094a3ea sumMap: return types less prone to oveflows
It used to be that sumMap would return the same type as the values
columns. If columns of Array(UInt8) were to be given, that would really
easily cause oveflow. It now uses `getWidenDataType` (and ultimately
`NearestFieldType`) in order to define the result type.
2019-01-25 14:29:45 +01:00
Léo Ercolanelli
d9195cda99 implement getWidenType() on IDataType
This is essentially to help implementing the `getReturnType` of
aggregation function susceptible to provoque overflow (such as
`sumMap`).
2019-01-25 14:25:25 +01:00
chertus
a0fafefc96 minor change - add Aliases.h 2019-01-25 14:43:19 +03:00
alexey-milovidov
20970154d8
Merge pull request #4141 from 4ertus2/ast
JOIN with USING: do not duplicate columns
2019-01-25 03:22:43 +03:00
alexey-milovidov
2626a2614c
Merge pull request #4145 from yandex/fix-fuzz-test-in-ubsan-quantile-weighted
Fix fuzz test in ubsan: added parameter type check for quantile*Weighted.
2019-01-25 02:45:07 +03:00
Alexey Milovidov
ef50601b5c Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /g' 2019-01-25 02:01:56 +03:00
Alexey Milovidov
5ccc42fd96 Revert "Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /'"
This reverts commit a28f0acf09.
2019-01-25 01:59:45 +03:00
Alexey Milovidov
304c7b0386 Style #4005 2019-01-24 22:50:16 +03:00
Alexey Milovidov
a28f0acf09 Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /' 2019-01-24 22:49:36 +03:00
Alexey Milovidov
854817c232 Fixed -Wshadow-field #4005 2019-01-24 22:37:32 +03:00
Alexey Milovidov
04fa827e4b Style 2019-01-24 22:21:47 +03:00
alexey-milovidov
f96b8e4ed6
Merge pull request #4005 from vitlibar/add-protobuf-output-format
Add protobuf output format
2019-01-24 22:05:23 +03:00
Alexey Milovidov
ffd18163de Fixed fuzz test in UBSan: added parameter check for quantile*Weighted function 2019-01-24 21:33:57 +03:00
alexey-milovidov
fbefc99fb1
Merge pull request #4129 from ercolanelli-leo/sumMapFiltered
implement sumMapFiltered
2019-01-24 21:27:03 +03:00
alexey-milovidov
18f1266dab
Merge pull request #4099 from yandex/mutations-fix-in
Get rid of IAST::range
2019-01-24 20:29:13 +03:00
Alexey Milovidov
0e59fe0b46 Renamed setting and variables #3973 2019-01-24 20:12:05 +03:00
chertus
ccd9bd0877 fix build 2019-01-24 18:06:15 +03:00
Nikolai Kochetov
f7b9059dad Merged with master 2019-01-24 18:06:11 +03:00
Nikolai Kochetov
5f1007a8df Refactor Join. 2019-01-24 17:56:04 +03:00
Vitaly Baranov
2886f42c0e Implemented a new block output stream using protobuf output format. 2019-01-24 17:54:57 +03:00
Vitaly Baranov
c241a4ea6d Added function serializeProtobuf() to each data type. 2019-01-24 17:54:57 +03:00
Vitaly Baranov
1e7a231c56 Implemented main class for writing protobufs. 2019-01-24 17:54:52 +03:00
Vitaly Baranov
42d9d4e81d Implemented storage for parsed protobuf schemas. 2019-01-24 17:32:10 +03:00
Vitaly Baranov
28e9837819 Implemented utility class for writing protobufs. 2019-01-24 17:32:01 +03:00
Vitaly Baranov
b1aba679d0 Class WriteBufferFromOwnString now can return StringRef too. 2019-01-24 17:32:01 +03:00
Vitaly Baranov
ec37ef5a89 No escaping for the format schema file's name anymore,
added an utility class for parsing and checking the format schema.
2019-01-24 17:31:41 +03:00
chertus
cbbf04204b JOIN with USING: do not duplicate columns 2019-01-24 17:22:58 +03:00
Léo Ercolanelli
ba1f1c7460 sumMapFiltered: use an unordered_set 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
90afad8c00 sumMapFiltered: improve error reporting on parameter type mismatch 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
a8647761ce sumMapFiltered: fix dangling reference 2019-01-24 13:32:30 +01:00
Léo Ercolanelli
22f7bd03b9 sumMapFiltered: use CRTP instead of virtual for keepKey 2019-01-24 09:02:17 +01:00
Léo Ercolanelli
efb1cb0528 sumMapFiltered: remove this-> in constructor 2019-01-24 08:58:57 +01:00
alexey-milovidov
f13d094a4e
Merge pull request #3973 from amosbird/join_overwrite
Add join_overwrite settings for StorageJoin.
2019-01-24 02:05:13 +03:00
alexey-milovidov
e6e404ae58
Merge pull request #4133 from abyss7/refactor-block_input_stream
Merge `IBlockInputStream` and `IProfilingBlockInputStream` into one
2019-01-24 01:14:34 +03:00
Vitaly Baranov
67fca7e029 Add support for settings 'format_schema' in an output query.
This fixes syntax error when executing 'SELECT ... FORMAT ... SETTINGS format_schema=...'
2019-01-23 22:23:37 +03:00
Danila Kutenin
784c3e5fda fix of ppc64le definitions 2019-01-23 18:24:14 +03:00
Ivan Lezhankin
05ab15cc84 Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
Danila Kutenin
f6e6f99737 fix 2019-01-23 17:26:05 +03:00
Léo Ercolanelli
8ad1a55f3b implement sumMapFiltered 2019-01-23 15:23:04 +01:00
Danila Kutenin
7f4b0f3c04 added powerpc build support 2019-01-23 17:18:19 +03:00
Alexey Zatelepin
b623d4302c add clone() calls when copying ASTs from stored mutation commands (just in case) #4058 2019-01-23 16:27:01 +03:00
Alexey Zatelepin
da0f555484 speedup calculation of ASTLiteral hash a bit #4058 2019-01-23 16:20:03 +03:00
Alexey Zatelepin
370c8c4e54 Merge branch 'master' into mutations-fix-in
Conflicts:
	dbms/src/Parsers/IAST.h
2019-01-23 14:47:53 +03:00
Alexey Zatelepin
f3b4292fc6 add data types to the prepared_sets key for literals #4058 2019-01-23 14:20:01 +03:00
Alexey Zatelepin
5154814bf9 try to get rid of IAST::range #4058 2019-01-23 14:19:22 +03:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
chertus
f54ed4a2e3 do not revisit ArrayJoin identifiers 2019-01-22 21:02:53 +03:00
chertus
97199b9712 fix ArrayJoin columns calculation 2019-01-22 20:36:08 +03:00
chertus
1d0bee7dee fix collecting required columns in lambda 2019-01-21 22:56:11 +03:00
Alexey Milovidov
c70e8cc5f0 Miscellaneous #3726 2019-01-21 22:45:26 +03:00
alexey-milovidov
b41fa8e7af
Merge pull request #3726 from zhang2014/feature/use_cluster_pool
Use cluster connections pool in DirectoryMonitor
2019-01-21 22:33:19 +03:00
Alexey Milovidov
f7ecfc776b Miscellaneous #4111 2019-01-21 21:04:08 +03:00
alexey-milovidov
09b991b47c
Merge pull request #4111 from yandex/compression_codecs_log_storages
Compression codecs log storages
2019-01-21 20:59:56 +03:00
Alexey Milovidov
47139adc5b Merge branch 'master' into test-hint-fix 2019-01-21 18:28:23 +03:00
alesapin
88c413fbe2 Remove accidental change 2019-01-21 17:03:34 +03:00
alesapin
34fb1c89f1 Add ability to choose codecs for storage log and tiny log 2019-01-21 17:00:06 +03:00
Alexey Milovidov
ac0060079a Fixed warnings in SpecializedAggregator 2019-01-21 16:13:20 +03:00
Nikolai Kochetov
e8aa41b6ac Merge branch 'master' into unified-sets 2019-01-21 13:40:47 +03:00
Nikolai Kochetov
6fce028b56 Refactor ColumnsHashing. 2019-01-21 13:39:53 +03:00
Nikolai Kochetov
d207498573 Added ColumnsHashing 2019-01-21 13:39:24 +03:00
alexey-milovidov
ee23f6997d
Merge pull request #4084 from yandex/storage_hdfs_improvements
Storage hdfs write and refactoring
2019-01-20 02:51:39 +03:00
alexey-milovidov
9a22185bd6
Update ReadBufferFromHDFS.cpp 2019-01-20 02:51:03 +03:00
Alexey Milovidov
c7b95b5175 Miscellaneous changes for PVS-Studio 2019-01-20 02:27:52 +03:00
alesapin
21f1c4d1ce Better code and tests for bad cases 2019-01-19 23:17:19 +03:00
alesapin
33d5f0c8dd Fix potential null pointer dereference 2019-01-18 21:57:11 +03:00
alexey-milovidov
3c6263e89e
Merge pull request #4094 from abyss7/issue-2675
Add setting to Kafka Engine to control number of parsing errors
2019-01-18 21:46:52 +03:00
alesapin
66bd80703e Fix clang warning 2019-01-18 19:17:24 +03:00
Boris Granveaud
f1a7f60165 new functions filesystemAvailable, filesystemFree and filesystemCapacity 2019-01-18 16:44:53 +01:00
Ivan Lezhankin
5f74094edb Fix a setting description. 2019-01-18 16:15:36 +03:00
alesapin
7c1c6eba8b Wrap hdfsBuilder into unique ptr 2019-01-18 15:48:55 +03:00
Ivan Lezhankin
89ffb577b1 Implement additional Kafka engine setting for allowed parsing errors 2019-01-18 15:48:38 +03:00
alesapin
a139f375c3 Remove copypaste 2019-01-18 14:39:36 +03:00
alesapin
71e58ca001 Fix potential leak in read buffer 2019-01-18 14:01:07 +03:00
alesapin
83c32727dc Remove strange commit 2019-01-18 13:57:00 +03:00
alesapin
2f7b63cf71 Fix review notes 2019-01-18 13:55:03 +03:00
zhang2014
998591b30d fix build failure 2019-01-18 10:31:28 +08:00
alexey-milovidov
3d4bd7cbf8
Merge branch 'master' into feature/use_cluster_pool 2019-01-18 01:02:39 +03:00
alexey-milovidov
7beb25eaaf
Merge pull request #4087 from 4ertus2/joins
child free ASTIdentifier
2019-01-18 00:51:08 +03:00
alexey-milovidov
908015aa4b
Merge pull request #4088 from proller/fix14
CLICKHOUSE-4257 remoteSecure
2019-01-18 00:48:55 +03:00
Alexey Milovidov
a7c468da8e Merge remote-tracking branch 'origin/master' into global-thread-pool 2019-01-17 21:57:01 +03:00
Alexey Milovidov
c3aae60aed Trying to understand the code #4063 2019-01-17 21:49:56 +03:00
proller
e778a5eeca Fix port secelt 2019-01-17 21:49:01 +03:00
proller
f2bbac6523 CLICKHOUSE-4257 remoteSecure 2019-01-17 20:55:44 +03:00
chertus
5289c1337e child free ASTIdentifier 2019-01-17 20:01:48 +03:00
alesapin
b6ad3cf148 Remove shadow variable warning 2019-01-17 19:15:51 +03:00
Alexey Zatelepin
addc9a43b0 remove unused IAST field 2019-01-17 18:52:29 +03:00
Alexey Milovidov
736e1e2d71 Fixed build #4063 2019-01-17 18:21:21 +03:00
Alexey Milovidov
303c3cc043 Merge branch 'master' of https://github.com/Miniwoffer/ClickHouse into Miniwoffer-master 2019-01-17 18:04:06 +03:00
Alexey Milovidov
178302cc5d Miscellaneous #3960 2019-01-17 17:45:02 +03:00
alesapin
07e11577d3 Add write logic and remove strange multifile read logic 2019-01-17 17:10:30 +03:00
alexey-milovidov
0ec1fdef04
Merge pull request #3960 from yandex/zk-columns-compact-storage
Compact storage of the part header in ZooKeeper
2019-01-17 17:05:01 +03:00
alesapin
2d3e08fc74 Refactor ReadBufferFromHDFS 2019-01-17 14:26:29 +03:00
alexey-milovidov
b50fa22606
Merge pull request #4077 from 4ertus2/joins
Some more ASTIdentifier refactoring
2019-01-17 00:58:36 +03:00
chertus
394e8b0378 minor improvements and fix 2019-01-16 21:38:19 +03:00