chertus
e5a9633132
Join.cpp refactoring
2019-03-19 19:53:36 +03:00
chertus
09a3b24cbc
join kind helpers
2019-03-11 14:14:09 +03:00
alexey-milovidov
695a2dc35f
Merge pull request #4552 from 4ertus2/bugs
...
Fix crash on JOIN with array or tuple
2019-03-01 18:49:22 +03:00
chertus
83503df56a
fix crach on JOIN with array or tuple
2019-03-01 18:32:32 +03:00
Amos Bird
26ab5dd7a7
A Proper lookup table that uses HashTable's API
...
This is the first step of allowing heterogeneous cells in hash tables.
performance test results are
```
1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>
ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124
ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998
ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130
ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191
ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279
ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441
ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564
ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378
ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157
ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041
```
2019-03-01 16:47:13 +08:00
chertus
3218f5003f
fix full/right join different number of columns
2019-02-12 15:11:45 +03:00
Alexey Milovidov
58a6accee5
Updated test #4246
2019-02-10 19:55:12 +03:00
alexey-milovidov
2686f64233
Merge pull request #4128 from yandex/unified-sets
...
Unified sets
2019-02-06 20:40:11 +03:00
chertus
396d4fb921
hotfix for duplicates in JOIN ON #4271
2019-02-05 19:58:57 +03:00
Nikolai Kochetov
a249fc7788
Do nut use Arena in ColumnsHashing for string in functions arrayUniq and arrayEnumerate.
2019-02-05 14:14:09 +03:00
Nikolai Kochetov
8db4116464
Update HashMethodHashed.
2019-02-05 13:55:08 +03:00
Nikolai Kochetov
6a729e59ba
Merged with master.
2019-02-01 11:36:57 +03:00
alexey-milovidov
bd62e2d85d
Merge pull request #4184 from 4ertus2/joins
...
Fix JOIN with duplicates [issue-4108]
2019-02-01 01:35:37 +03:00
chertus
26b2526a3b
fix right & full join with dups (complex join on still affected)
2019-01-31 21:10:16 +03:00
chertus
866c2b2e78
move required right keys calculation to Join.cpp
2019-01-30 18:51:39 +03:00
alexey-milovidov
fd5ab9ed2e
Merge pull request #4055 from yandex/fix-group-by-array-low-cardibality-arguments
...
Fix group by array low cardinality arguments
2019-01-29 21:32:45 +03:00
Nikolai Kochetov
21242ad658
Added tests. Restored recursiveRemoveLowCardinality interface.
2019-01-29 18:44:02 +03:00
chertus
9c6f71bb7e
fix inner and left join with duplicates [issue-4108]
2019-01-29 15:38:53 +03:00
Nikolai Kochetov
2c2932e185
Merged with master
2019-01-29 15:25:19 +03:00
Nikolai Kochetov
5d29562302
Fix build.
2019-01-29 13:56:44 +03:00
Alexey Milovidov
0e59fe0b46
Renamed setting and variables #3973
2019-01-24 20:12:05 +03:00
Nikolai Kochetov
f7b9059dad
Merged with master
2019-01-24 18:06:11 +03:00
Nikolai Kochetov
5f1007a8df
Refactor Join.
2019-01-24 17:56:04 +03:00
alexey-milovidov
f13d094a4e
Merge pull request #3973 from amosbird/join_overwrite
...
Add join_overwrite settings for StorageJoin.
2019-01-24 02:05:13 +03:00
Ivan Lezhankin
05ab15cc84
Merge IBlockInputStream and IProfilingBlockInputStream into one
2019-01-23 17:48:50 +03:00
alexey-milovidov
8a401e491a
Update Join.cpp
2019-01-15 00:40:02 +03:00
Nikolai Kochetov
5a50a4fe21
Fix aggregate function low cardinality array argument. #4038
2019-01-14 21:17:55 +03:00
Amos Bird
8ea4d7987b
Add join_overwrite settings for StorageJoin.
...
This makes using StorageJoin as dictionary more flexible.
2019-01-07 01:23:26 +08:00
Alexey Milovidov
06a8c3f02d
Added some warnings from clang's -Weverything
2019-01-05 06:33:22 +03:00
Alexey Milovidov
1d4701b0bc
Added some warnings from clang's -Weverything
2019-01-04 15:10:00 +03:00
Alexey Milovidov
cfc1e207ab
Fixed UB #3926
2018-12-26 02:27:52 +03:00
Alexey Milovidov
a8f09809f5
Simplified logic with "IColumn::convertToFullColumnIfConst" (suggested by Amos Bird) [#CLICKHOUSE-2]
2018-12-21 19:00:07 +03:00
alexey-milovidov
7af621f6f7
Merge pull request #3728 from amosbird/join
...
Versatile StorageJoin
2018-12-10 23:16:53 +03:00
Nikolai Kochetov
e4fd13f237
Remove LowCardinaity for joined keys.
2018-12-10 13:23:45 +03:00
Nikolai Kochetov
61cd6fe2d3
Remove LowCardinaity for joined keys.
2018-12-10 13:21:32 +03:00
Amos Bird
65b654a1b6
Versatile StorageJoin
...
This commit does the following:
1. StorageJoin with simple keys now supports reading
2. StorageJoin can be created with Join settings applied. Syntax is
similar to MergeTree and Kafka
3. Left Any StorageJoin with one simple key can be used as a
dictionary-like structure by function joinGet.
Examples are listed in the related test file.
2018-12-02 16:49:39 +08:00
Amos Bird
d092d35fa9
NonJoinedStream[ALL] bypasses max_block_size
2018-11-30 22:59:17 +08:00
Nikolai Kochetov
c470cf1e26
Fix joined keys from right column with left join. [#CLICKHOUSE-3994]
2018-10-02 21:16:47 +03:00
alexey-milovidov
f22b12b698
Update Join.cpp
2018-08-30 22:52:28 +03:00
proller
81960a2690
CLICKHOUSE-3940 Fix crash on join
2018-08-30 18:44:30 +03:00
Nikolai Kochetov
bc054f2247
Fix tests. [#CLICKHOUSE-3761]
2018-07-30 22:40:43 +03:00
Nikolai Kochetov
7d9ebae2c2
Better comments.
2018-07-27 20:11:56 +03:00
Nikolai Kochetov
5058d1a345
Added columns from join on key of right table if they have different name from left block key in merged block. [#CLICKHOUSE-3761]
2018-07-27 19:01:48 +03:00
Alexey Milovidov
ca52d96e09
Insignificant changes for PVS-Studio [#CLICKHOUSE-3]
2018-06-04 22:22:27 +03:00
Alexey Milovidov
f5adbceed2
Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2]
2018-06-03 23:39:06 +03:00
Alexey Milovidov
5ff433b670
Merged Limits to Settings [#CLICKHOUSE-2021]
2018-03-11 03:15:26 +03:00
Alexey Milovidov
72aac966b1
Fixed error with order of columns in FULL JOIN that may lead to segfault [#CLICKHOUSE-2]
2018-02-21 11:16:01 +03:00
Alexey Milovidov
bb05235608
Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2]
2018-02-20 00:01:46 +03:00
Alexey Milovidov
afe09d3138
Removed unused code [#CLICKHOUSE-2]
2018-02-18 06:46:18 +03:00
Alexey Milovidov
754a4296df
Header in every stream: fixed non-deterministic test [#CLICKHOUSE-2]
2018-02-18 06:23:48 +03:00
