Azat Khuzhin
420089c301
Add new dictionary layout (sparse_hashed) that is more memory efficient
...
With this new layout, sparsehash will be used over default HashMap,
sparsehash is more memory efficient but it is also slower.
So in a nutshell:
- HashMap uses ~2x more memory then sparse_hash_map
- HashMap ~2-2.5x faster then sparse_hash_map
(tested on lots of input, and the most close to production was
dictionary with 600KK hashes and UInt16 as value)
TODO:
- fix allocated memory calculation
- getBufferSizeInBytes/getBufferSizeInCells interface
- benchmarks
v0: replace HashMap with google::sparse_hash_map
v2: use google::sparse_hash_map only when <sparse> isset to true
v3: replace attributes with different layout
v4: use ch hash over std::hash
2019-09-21 02:22:40 +03:00
Azat Khuzhin
b22b65dd29
Avoid SIGSEGV on batch send failure (file with index XX is absent)
...
In case of the following error:
Failed to send batch: file with index 23742 is absent
NULL dereference will occur for the "remote".
2019-09-21 02:22:25 +03:00
alexey-milovidov
f8d19f6bf3
Merge pull request #6968 from azat-archive/create_as_skip_indices
...
[RFC] Introduce create_as_skip_indices
2019-09-20 23:53:49 +03:00
alexey-milovidov
1dc58dcb15
Update InterpreterCreateQuery.cpp
2019-09-20 23:53:14 +03:00
alexey-milovidov
c3e0f1c9d3
Merge pull request #7020 from amosbird/check_settings
...
Outline methods to get needed instantiations.
2019-09-20 23:46:45 +03:00
alexey-milovidov
2432a68009
Merge pull request #7022 from 4ertus2/bugs
...
Fix "Unknown identifier" in ORDER BY and GROUP BY with Multiple Joins
2019-09-20 23:45:51 +03:00
alexey-milovidov
3f500aad4b
Merge pull request #6976 from sfod/issue-3571
...
Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without agg…
2019-09-20 23:39:00 +03:00
Alexey Milovidov
42b739550b
Renamed "storage_policy_name" to "storage_policy"
2019-09-20 23:35:50 +03:00
alexey-milovidov
5314088648
Merge pull request #6980 from filimonov/huge_pk_performance_test
...
Adding performance test for huge pk (issue #6924 )
2019-09-20 23:29:56 +03:00
alexey-milovidov
626057e687
Merge pull request #6983 from azat-archive/build--ld.gold
...
Use ld.gold over gold (the former available in more environments)
2019-09-20 23:29:25 +03:00
Alexander Tokmakov
0080639f79
Merge branch 'master' into merging_values_with_expressions
2019-09-20 23:26:01 +03:00
alexey-milovidov
078eab157b
Merge pull request #7030 from yandex/changelog-19.11.9.52-19.11.10.54-19.11.11.57
...
Changelog for 19.11.9.52 19.11.10.54 19.11.11.57
2019-09-20 23:20:03 +03:00
Nikolai Kochetov
b1f19a50d4
Update CHANGELOG.md
2019-09-20 23:16:55 +03:00
alesapin
f2f9f585e4
Better check in shared binary build
2019-09-20 23:15:42 +03:00
alesapin
d0ef26e1b8
Better shared binary build
2019-09-20 22:57:09 +03:00
Alexander Tokmakov
2c7384ff39
add performance test
2019-09-20 22:45:26 +03:00
Alexander Tokmakov
d353746f2b
minor fixes
2019-09-20 22:44:52 +03:00
Nikolai Kochetov
367c073cd9
Merge pull request #7029 from yandex/changelog-19.13.5.44
...
Changelog for 19.13.5.44
2019-09-20 22:02:35 +03:00
Nikolai Kochetov
5b189d3828
Update CHANGELOG.md
2019-09-20 21:48:19 +03:00
Ivan Lezhankin
9e46118edd
Merge remote-tracking branch 'upstream/master' into issue-6459
2019-09-20 21:25:55 +03:00
Ivan Lezhankin
8cb0e58bc7
Fix build for all targets
2019-09-20 21:13:51 +03:00
alexey-milovidov
5d9c011f89
Merge pull request #7027 from yandex/changelog-19.13.4.32
...
Changelog 19.13.4.32
2019-09-20 20:38:48 +03:00
Nikolai Kochetov
589a3c9743
Update CHANGELOG.md
2019-09-20 20:34:40 +03:00
alexey-milovidov
123b8cb43c
Merge pull request #6990 from Akazz/timeout_for_sync_replica_cmd
...
Fixed timeout mechanism for SYNC REPLICA command + simplified related code
2019-09-20 20:32:51 +03:00
alexey-milovidov
aabd6906f2
Merge pull request #6982 from 4ertus2/mjoin
...
PartialMergeJoin bugfixes
2019-09-20 20:19:00 +03:00
Ivan Lezhankin
967e00a8da
It works!
...
if compiled with:
CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
2019-09-20 20:09:22 +03:00
Nikolai Kochetov
1848dfc7ff
Merge pull request #7023 from yandex/changelog-19.14.6.12
...
Changelog-19.14.6.12
2019-09-20 19:57:05 +03:00
millb
4f24512ba4
Test added.
2019-09-20 19:40:06 +03:00
alesapin
8783798b99
Move so libraries to output directory in binary build image
2019-09-20 19:29:06 +03:00
Nikolai Kochetov
26e2a574b4
Update CHANGELOG.md
2019-09-20 19:21:48 +03:00
millb
88adbb72d9
Fixed Function Hex for Float32 and Float64
2019-09-20 19:21:05 +03:00
Nikolai Kochetov
9eb0f8c536
Update CHANGELOG.md
2019-09-20 19:13:40 +03:00
chertus
7726130303
fix multiple joins aliasing for order by and group by
2019-09-20 19:01:19 +03:00
Amos Bird
b64bab29ed
Outline methods to get needed instantiations.
2019-09-20 22:45:25 +08:00
sfod
bc9bcfdb7e
Fix tests which use WITH TOTALS without aggregation
2019-09-20 17:42:30 +03:00
sfod
bf2654e093
Use sql file to test changes
2019-09-20 17:39:26 +03:00
maqroll
ca36e3f861
Attach error to force ip refresh
2019-09-20 12:36:09 +00:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole ( #6950 )
...
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
stavrolia
7309e813bc
cleanup hdfs docs
2019-09-20 14:26:00 +03:00
dependabot[bot]
ef75a45fef
Bump pyyaml from 3.12 to 5.1 in /docs/tools ( #7004 )
...
Bumps [pyyaml](https://github.com/yaml/pyyaml ) from 3.12 to 5.1.
- [Release notes](https://github.com/yaml/pyyaml/releases )
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES )
- [Commits](https://github.com/yaml/pyyaml/compare/3.12...5.1 )
Signed-off-by: dependabot[bot] <support@github.com>
2019-09-20 12:12:35 +03:00
dependabot[bot]
e07ff38b84
Bump urllib3 from 1.23 to 1.24.2 in /docs/tools ( #7003 )
...
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 1.23 to 1.24.2.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/master/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/1.23...1.24.2 )
Signed-off-by: dependabot[bot] <support@github.com>
2019-09-20 12:12:21 +03:00
Alexander Kazakov
2d807368e1
Adjusted timings in test + more verbose diagnostics
2019-09-20 00:20:58 +03:00
Azat Khuzhin
b2a3db1048
Ignore indices for CREATE TABLE .. AS .. if storage do not support them
2019-09-19 23:55:38 +03:00
Ivan
5526f33a5e
Implement auto-labelling for the backporting script ( #7001 )
2019-09-19 21:01:47 +03:00
chertus
0bc345fdc0
MergeJoin compare nullables
2019-09-19 20:09:59 +03:00
fenglv
2062bedaf0
Add repeat function
2019-09-20 00:46:41 +08:00
chertus
da14951ecd
implement MergeJoin.joinTotals()
2019-09-19 17:53:03 +03:00
Alexander Kazakov
90c9d83fa5
Added missing newline at the EOF
2019-09-19 17:48:08 +03:00
alesapin
b289d7e6a5
Fix system contributors generating script
2019-09-19 17:41:49 +03:00
Azat Khuzhin
b30dee621b
Search for ld.gold (since it is more common then just "gold")
2019-09-19 16:41:29 +03:00