Alexey Milovidov
c03857b2ae
Merging S3: part 2
2019-09-23 01:13:42 +03:00
Alexey Milovidov
6fb9565091
Merging S3: removed useless headers
2019-09-23 01:06:22 +03:00
alexey-milovidov
2054f80623
Merge pull request #5596 from excitoon-favorites/table_function_s3
...
s3 table function and storage
2019-09-23 00:53:06 +03:00
alexey-milovidov
6fa234cea4
Merge pull request #6894 from azat-archive/hashed-dict-memory-usage-v2
...
[RFC] Add sparsehash support for hashed dictionary (to reduce memory usage)
2019-09-22 15:55:36 +03:00
Vladimir Chebotarev
4608da1344
Minor tests improvement.
2019-09-22 11:03:02 +00:00
Vladimir Chebotarev
64d49e4565
Minor review fixes.
2019-09-22 10:42:47 +00:00
Azat Khuzhin
52f14c1ead
Update HashedDictionary.cpp (fixed rename in return type for SFINAE)
2019-09-22 10:39:50 +03:00
alexey-milovidov
5970aafd9a
Merge pull request #7032 from azat-archive/distributed-directory-monitor-SIGSEGV
...
Avoid SIGSEGV on batch send failure (file with index XX is absent)
2019-09-22 05:12:55 +03:00
alexey-milovidov
a12cffee91
Update HashedDictionary.h
2019-09-22 05:11:08 +03:00
alexey-milovidov
ab9a7be45a
Comments are the must.
2019-09-22 05:09:40 +03:00
alexey-milovidov
9afea6f0b3
Update HashedDictionary.cpp
2019-09-22 05:04:49 +03:00
alexey-milovidov
67e02b4ea0
Merge pull request #6957 from infinivision/add_bitmapSubsetLimit
...
added bitmapSubsetLimit
2019-09-22 04:58:44 +03:00
alexey-milovidov
6020ba187e
Update AggregateFunctionGroupBitmapData.h
2019-09-22 04:58:21 +03:00
alexey-milovidov
816ac1ca8d
Merge pull request #7037 from silviucpp/silviu-fix-osx
...
Fix osx build
2019-09-22 04:53:36 +03:00
alexey-milovidov
d446205eec
Update QueryProfiler.cpp
2019-09-22 04:53:19 +03:00
Silviu Caragea
5a14d97587
Fix linking when __ELF__ is not defined
2019-09-22 01:04:17 +03:00
Silviu Caragea
1fbd2fb6a8
Fix osx build
2019-09-21 21:30:01 +03:00
alesapin
4575b6e4ff
Merge pull request #7031 from yandex/rename-storage-policy-name
...
Renamed "storage_policy_name" to "storage_policy"
2019-09-21 17:03:19 +03:00
Azat Khuzhin
420089c301
Add new dictionary layout (sparse_hashed) that is more memory efficient
...
With this new layout, sparsehash will be used over default HashMap,
sparsehash is more memory efficient but it is also slower.
So in a nutshell:
- HashMap uses ~2x more memory then sparse_hash_map
- HashMap ~2-2.5x faster then sparse_hash_map
(tested on lots of input, and the most close to production was
dictionary with 600KK hashes and UInt16 as value)
TODO:
- fix allocated memory calculation
- getBufferSizeInBytes/getBufferSizeInCells interface
- benchmarks
v0: replace HashMap with google::sparse_hash_map
v2: use google::sparse_hash_map only when <sparse> isset to true
v3: replace attributes with different layout
v4: use ch hash over std::hash
2019-09-21 02:22:40 +03:00
Azat Khuzhin
b22b65dd29
Avoid SIGSEGV on batch send failure (file with index XX is absent)
...
In case of the following error:
Failed to send batch: file with index 23742 is absent
NULL dereference will occur for the "remote".
2019-09-21 02:22:25 +03:00
alexey-milovidov
f8d19f6bf3
Merge pull request #6968 from azat-archive/create_as_skip_indices
...
[RFC] Introduce create_as_skip_indices
2019-09-20 23:53:49 +03:00
alexey-milovidov
1dc58dcb15
Update InterpreterCreateQuery.cpp
2019-09-20 23:53:14 +03:00
alexey-milovidov
c3e0f1c9d3
Merge pull request #7020 from amosbird/check_settings
...
Outline methods to get needed instantiations.
2019-09-20 23:46:45 +03:00
alexey-milovidov
2432a68009
Merge pull request #7022 from 4ertus2/bugs
...
Fix "Unknown identifier" in ORDER BY and GROUP BY with Multiple Joins
2019-09-20 23:45:51 +03:00
alexey-milovidov
3f500aad4b
Merge pull request #6976 from sfod/issue-3571
...
Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without agg…
2019-09-20 23:39:00 +03:00
Alexey Milovidov
42b739550b
Renamed "storage_policy_name" to "storage_policy"
2019-09-20 23:35:50 +03:00
alexey-milovidov
5314088648
Merge pull request #6980 from filimonov/huge_pk_performance_test
...
Adding performance test for huge pk (issue #6924 )
2019-09-20 23:29:56 +03:00
alexey-milovidov
123b8cb43c
Merge pull request #6990 from Akazz/timeout_for_sync_replica_cmd
...
Fixed timeout mechanism for SYNC REPLICA command + simplified related code
2019-09-20 20:32:51 +03:00
alexey-milovidov
aabd6906f2
Merge pull request #6982 from 4ertus2/mjoin
...
PartialMergeJoin bugfixes
2019-09-20 20:19:00 +03:00
chertus
7726130303
fix multiple joins aliasing for order by and group by
2019-09-20 19:01:19 +03:00
Amos Bird
b64bab29ed
Outline methods to get needed instantiations.
2019-09-20 22:45:25 +08:00
sfod
bc9bcfdb7e
Fix tests which use WITH TOTALS without aggregation
2019-09-20 17:42:30 +03:00
sfod
bf2654e093
Use sql file to test changes
2019-09-20 17:39:26 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole ( #6950 )
...
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
Alexander Kazakov
2d807368e1
Adjusted timings in test + more verbose diagnostics
2019-09-20 00:20:58 +03:00
Azat Khuzhin
b2a3db1048
Ignore indices for CREATE TABLE .. AS .. if storage do not support them
2019-09-19 23:55:38 +03:00
chertus
0bc345fdc0
MergeJoin compare nullables
2019-09-19 20:09:59 +03:00
chertus
da14951ecd
implement MergeJoin.joinTotals()
2019-09-19 17:53:03 +03:00
Alexander Kazakov
90c9d83fa5
Added missing newline at the EOF
2019-09-19 17:48:08 +03:00
alesapin
b289d7e6a5
Fix system contributors generating script
2019-09-19 17:41:49 +03:00
Alexander Kazakov
7a0f7a57e2
Chmod +x for test!!!
2019-09-19 15:48:18 +03:00
Akazz
4ae3db45c6
Fixed timeout reading in SYNC REPLICA
2019-09-19 14:04:57 +03:00
Vladimir Chebotarev
0ee6f6231a
Added comments about redirecting requests and got rid of magic values.
2019-09-19 10:33:34 +00:00
Vladimir Chebotarev
12f7361095
Removed unused headers from ReadBufferFromS3.h
2019-09-19 10:25:31 +00:00
Vladimir Chebotarev
a5d6bd9e01
Proper passing of query parameters in initiate multipart upload.
2019-09-19 10:16:39 +00:00
Vladimir Chebotarev
a88d795f0f
Proper passing of query parameters in initiate multipart upload.
2019-09-19 10:15:59 +00:00
Vladimir Chebotarev
283e09d2a5
Removed trash logging and fixed query parameters in multipart uploads.
2019-09-19 10:02:45 +00:00
Akazz
787a646680
Added a test to challenge timeout mechanism in SYNC REPLICA command
2019-09-19 13:00:44 +03:00
Vladimir Chebotarev
bd1ce56797
Tests decomposition.
2019-09-19 09:34:33 +00:00
Zhichang Yu
0dc3866c36
added bitmapSubsetLimit
2019-09-19 10:15:36 +08:00