Commit Graph

16395 Commits

Author SHA1 Message Date
Nikolai Kochetov
630872837e Skip null columns while checknig num rows. 2019-09-23 22:26:04 +03:00
Alexey Milovidov
11e7ea51e9 Fixed compatibility for distributed queries between 19.14 and earlier versions #7068 2019-09-23 22:22:28 +03:00
alexey-milovidov
faf6e06f56
Update ReadWriteBufferFromHTTP.h 2019-09-23 21:16:34 +03:00
alexey-milovidov
e7b675a301
Update ReadWriteBufferFromHTTP.cpp 2019-09-23 21:15:21 +03:00
Alexey Milovidov
8407ee17c6 Reverted unrelated modification 2019-09-23 21:06:32 +03:00
Alexey Milovidov
89f27de705 Merge branch 'master' into ucasFL-master 2019-09-23 21:05:29 +03:00
Alexey Milovidov
8579c26efb Changed repository URL 2019-09-23 19:18:19 +03:00
millb
bd29efdbbe New hex function release
Bugs and tests fixed
2019-09-23 18:47:34 +03:00
Olga Khvostikova
a6296b2eb0
Merge branch 'master' into yet-another-minor-changes-and-docs-for-hdfs 2019-09-23 18:16:01 +03:00
stavrolia
fbe3270dfb need to mention... 2019-09-23 17:50:33 +03:00
Ivan Lezhankin
ce2fb6d3d1 Fix build 2019-09-23 17:46:01 +03:00
chertus
016f3b0a45 fix partial merge join with totals 2019-09-23 17:37:42 +03:00
Nikolai Kochetov
61b583ccb9 Fix size of constant columns in case of execution function over LowCardinality without allowed defaults. 2019-09-23 17:19:02 +03:00
alexey-milovidov
3ae715cafb
Merge pull request #7048 from ClickHouse/merge-s3
Merging s3: minor changes after #5596
2019-09-23 16:38:18 +03:00
Nikolai Kochetov
f15bc77778 Fix size of constant columns in case of execution function over LowCardinality without allowed defaults. 2019-09-23 16:36:20 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
Vladimir Chebotarev
f8c0fef919 Attempt to make table-level setting s3_min_upload_part_size. 2019-09-23 12:41:59 +00:00
maqroll
e99a87b5b7 update assertResponseIsOk 2019-09-23 08:53:09 +00:00
maqroll
a6e7519f9d Merge remote-tracking branch 'upstream/master' 2019-09-23 07:55:07 +00:00
Vladimir Chebotarev
c45e7dc747 Many parts warning and a comment about that. 2019-09-23 07:42:02 +00:00
Alexey Milovidov
7948b0bb7e Minor modifications 2019-09-23 02:56:44 +03:00
Alexey Milovidov
80849e0fd7 Fixed bad log messages 2019-09-23 02:49:26 +03:00
Alexey Milovidov
2585cde3d0 Added safety threshold 2019-09-23 02:49:15 +03:00
Alexey Milovidov
48f28bce6a Fixed bad error message 2019-09-23 02:37:13 +03:00
Alexey Milovidov
454b83fcd3 Merging function 'repeat' 2019-09-23 02:30:13 +03:00
Alexey Milovidov
52272eeea9 Merge branch 'master' of https://github.com/ucasFL/ClickHouse into ucasFL-master 2019-09-23 02:04:18 +03:00
alexey-milovidov
61b02598d7
Update repeat.cpp 2019-09-23 02:02:03 +03:00
alexey-milovidov
0dc4b1793d
Merge pull request #7036 from infinivision/fix_bitmapMax_doc
fix bitmapMin and bitmapMax doc
2019-09-23 01:49:04 +03:00
Alexey Milovidov
bdea16e308 Merging S3: Moved S3 settings to <s3> in config to correspond to <merge_tree> and <kafka> 2019-09-23 01:44:10 +03:00
alexey-milovidov
fac04ea640
Merge pull request #7042 from kyprizel/master
Initial fuzzing support with libfuzzer
2019-09-23 01:31:44 +03:00
Alexey Milovidov
c03857b2ae Merging S3: part 2 2019-09-23 01:13:42 +03:00
Alexey Milovidov
6fb9565091 Merging S3: removed useless headers 2019-09-23 01:06:22 +03:00
alexey-milovidov
2054f80623
Merge pull request #5596 from excitoon-favorites/table_function_s3
s3 table function and storage
2019-09-23 00:53:06 +03:00
alexey-milovidov
3270ad439a
Update compressed_buffer_fuzz.cpp 2019-09-23 00:18:14 +03:00
alexey-milovidov
6fa234cea4
Merge pull request #6894 from azat-archive/hashed-dict-memory-usage-v2
[RFC] Add sparsehash support for hashed dictionary (to reduce memory usage)
2019-09-22 15:55:36 +03:00
alexey-milovidov
8fd66ac4fd
Update compressed_buffer_fuzz.cpp 2019-09-22 15:52:33 +03:00
Vladimir Chebotarev
64d49e4565 Minor review fixes. 2019-09-22 10:42:47 +00:00
Eldar Zaitov
b174833bdf Initial fuzzing support with libfuzzer 2019-09-22 13:34:09 +03:00
Azat Khuzhin
52f14c1ead
Update HashedDictionary.cpp (fixed rename in return type for SFINAE) 2019-09-22 10:39:50 +03:00
fenglv
4465fdb8bf Add test
fix

fix

fix
2019-09-22 14:25:43 +08:00
alexey-milovidov
5970aafd9a
Merge pull request #7032 from azat-archive/distributed-directory-monitor-SIGSEGV
Avoid SIGSEGV on batch send failure (file with index XX is absent)
2019-09-22 05:12:55 +03:00
alexey-milovidov
a12cffee91
Update HashedDictionary.h 2019-09-22 05:11:08 +03:00
alexey-milovidov
ab9a7be45a
Comments are the must. 2019-09-22 05:09:40 +03:00
alexey-milovidov
9afea6f0b3
Update HashedDictionary.cpp 2019-09-22 05:04:49 +03:00
alexey-milovidov
67e02b4ea0
Merge pull request #6957 from infinivision/add_bitmapSubsetLimit
added bitmapSubsetLimit
2019-09-22 04:58:44 +03:00
alexey-milovidov
6020ba187e
Update AggregateFunctionGroupBitmapData.h 2019-09-22 04:58:21 +03:00
alexey-milovidov
816ac1ca8d
Merge pull request #7037 from silviucpp/silviu-fix-osx
Fix osx build
2019-09-22 04:53:36 +03:00
alexey-milovidov
d446205eec
Update QueryProfiler.cpp 2019-09-22 04:53:19 +03:00
Silviu Caragea
5a14d97587 Fix linking when __ELF__ is not defined 2019-09-22 01:04:17 +03:00
Silviu Caragea
1fbd2fb6a8 Fix osx build 2019-09-21 21:30:01 +03:00
Zhichang Yu
ab7ecd84a1 fix bitmapMin and bitmapMax doc 2019-09-21 23:34:44 +08:00
alesapin
4575b6e4ff
Merge pull request #7031 from yandex/rename-storage-policy-name
Renamed "storage_policy_name" to "storage_policy"
2019-09-21 17:03:19 +03:00
Azat Khuzhin
420089c301
Add new dictionary layout (sparse_hashed) that is more memory efficient
With this new layout, sparsehash will be used over default HashMap,
sparsehash is more memory efficient but it is also slower.

So in a nutshell:
- HashMap uses ~2x more memory then sparse_hash_map
- HashMap ~2-2.5x faster then sparse_hash_map
(tested on lots of input, and the most close to production was
dictionary with 600KK hashes and UInt16 as value)

TODO:
- fix allocated memory calculation
- getBufferSizeInBytes/getBufferSizeInCells interface
- benchmarks

v0: replace HashMap with google::sparse_hash_map
v2: use google::sparse_hash_map only when <sparse> isset to true
v3: replace attributes with different layout
v4: use ch hash over std::hash
2019-09-21 02:22:40 +03:00
Azat Khuzhin
b22b65dd29
Avoid SIGSEGV on batch send failure (file with index XX is absent)
In case of the following error:
  Failed to send batch: file with index 23742 is absent

NULL dereference will occur for the "remote".
2019-09-21 02:22:25 +03:00
alexey-milovidov
f8d19f6bf3
Merge pull request #6968 from azat-archive/create_as_skip_indices
[RFC] Introduce create_as_skip_indices
2019-09-20 23:53:49 +03:00
alexey-milovidov
1dc58dcb15
Update InterpreterCreateQuery.cpp 2019-09-20 23:53:14 +03:00
alexey-milovidov
c3e0f1c9d3
Merge pull request #7020 from amosbird/check_settings
Outline methods to get needed instantiations.
2019-09-20 23:46:45 +03:00
alexey-milovidov
2432a68009
Merge pull request #7022 from 4ertus2/bugs
Fix "Unknown identifier" in ORDER BY and GROUP BY with Multiple Joins
2019-09-20 23:45:51 +03:00
alexey-milovidov
3f500aad4b
Merge pull request #6976 from sfod/issue-3571
Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without agg…
2019-09-20 23:39:00 +03:00
Alexey Milovidov
42b739550b Renamed "storage_policy_name" to "storage_policy" 2019-09-20 23:35:50 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
8cb0e58bc7 Fix build for all targets 2019-09-20 21:13:51 +03:00
alexey-milovidov
123b8cb43c
Merge pull request #6990 from Akazz/timeout_for_sync_replica_cmd
Fixed timeout mechanism for SYNC REPLICA command + simplified related code
2019-09-20 20:32:51 +03:00
alexey-milovidov
aabd6906f2
Merge pull request #6982 from 4ertus2/mjoin
PartialMergeJoin bugfixes
2019-09-20 20:19:00 +03:00
Ivan Lezhankin
967e00a8da It works!
if compiled with:

CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
2019-09-20 20:09:22 +03:00
millb
88adbb72d9 Fixed Function Hex for Float32 and Float64 2019-09-20 19:21:05 +03:00
chertus
7726130303 fix multiple joins aliasing for order by and group by 2019-09-20 19:01:19 +03:00
Amos Bird
b64bab29ed Outline methods to get needed instantiations. 2019-09-20 22:45:25 +08:00
maqroll
ca36e3f861 Attach error to force ip refresh 2019-09-20 12:36:09 +00:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole (#6950)
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
stavrolia
7309e813bc cleanup hdfs docs 2019-09-20 14:26:00 +03:00
Alexander Kazakov
2d807368e1 Adjusted timings in test + more verbose diagnostics 2019-09-20 00:20:58 +03:00
Azat Khuzhin
b2a3db1048
Ignore indices for CREATE TABLE .. AS .. if storage do not support them 2019-09-19 23:55:38 +03:00
chertus
0bc345fdc0 MergeJoin compare nullables 2019-09-19 20:09:59 +03:00
fenglv
2062bedaf0 Add repeat function 2019-09-20 00:46:41 +08:00
chertus
da14951ecd implement MergeJoin.joinTotals() 2019-09-19 17:53:03 +03:00
alesapin
b289d7e6a5 Fix system contributors generating script 2019-09-19 17:41:49 +03:00
Akazz
4ae3db45c6 Fixed timeout reading in SYNC REPLICA 2019-09-19 14:04:57 +03:00
Vladimir Chebotarev
0ee6f6231a Added comments about redirecting requests and got rid of magic values. 2019-09-19 10:33:34 +00:00
Vladimir Chebotarev
12f7361095 Removed unused headers from ReadBufferFromS3.h 2019-09-19 10:25:31 +00:00
Vladimir Chebotarev
a5d6bd9e01 Proper passing of query parameters in initiate multipart upload. 2019-09-19 10:16:39 +00:00
Vladimir Chebotarev
a88d795f0f Proper passing of query parameters in initiate multipart upload. 2019-09-19 10:15:59 +00:00
Vladimir Chebotarev
283e09d2a5 Removed trash logging and fixed query parameters in multipart uploads. 2019-09-19 10:02:45 +00:00
maqroll
3765084358 Proper ReadWriteBufferFromHTTP constructor args 2019-09-19 07:33:54 +00:00
Zhichang Yu
0dc3866c36 added bitmapSubsetLimit 2019-09-19 10:15:36 +08:00
alexey-milovidov
1fe79ad43c
Merge pull request #6941 from dimarub2000/enums_in_section
IN with Enums numeric values
2019-09-19 02:24:34 +03:00
alexey-milovidov
9c675e50bb
Merge pull request #6963 from nicelulu/issue_6616
optimize limit 1,0 and test.
2019-09-19 02:23:56 +03:00
alexey-milovidov
01a1920e9b
Merge pull request #6970 from infinivision/add_bitmapMin_bitmapMax
added bitmapMin and bitmapMax
2019-09-19 02:01:16 +03:00
alexey-milovidov
1327e71d80
Changed C-style cast to constructor-style cast. 2019-09-19 02:01:06 +03:00
alexey-milovidov
7325f4a77b
Merge pull request #6974 from yandex/aku/mmap-linux
Use MAP_POPULATE only on Linux.
2019-09-19 01:58:40 +03:00
alexey-milovidov
bc1ecb0be5
Merge pull request #6951 from yandex/aku/alloc-continue
Make the quadratic Arena::allocContinue less bad.
2019-09-19 01:57:26 +03:00
chertus
b8b6197288 partial_merge_join settings affects LEFT and INNER JOINs only 2019-09-18 22:12:53 +03:00
chertus
08a28d2dc2 fix pm join bug (wrong right equal range copy) 2019-09-18 21:44:44 +03:00
chertus
194e49e751 fix UB in MergeJoinCursor 2019-09-18 19:46:00 +03:00
maqroll
952d9449a2 typo 2019-09-18 14:53:45 +00:00
root
8175d4c2d1 style checks
Committer: maqroll <loteroc@gmail.com>
2019-09-18 13:38:17 +00:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin
PartialMergeJoin
2019-09-18 16:16:10 +03:00
root
ea5480fd72 merge
Committer: maqroll <loteroc@gmail.com>
2019-09-18 13:13:40 +00:00
sfod
0bad4b4a05 Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without aggregate functions 2019-09-18 16:08:51 +03:00
chertus
dd46c08e90 move JoinCommon funcs out of IJoin.h/cpp 2019-09-18 15:46:57 +03:00