thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-23 00:40:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
31,192 Commits 9,035 Branches 1,770 Tags 1.9 GiB
b347d8607e
Commit Graph

31192 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Azat Khuzhin
c2fa7ffcd3 Drop note about "estimation error for large sets will be large" 
Since error is not that large, especially for uniqCombined64():

rows     error     uniqCombined64()/rows
- 1e7    0.00219   (1.0021969)
- 1e8    0.00096   (0.99903523)
- 2e8    0.50200   (1.005022735)
- 1e9    0.99944   (0.999435738)
- 1e10   0.01399   (0.9998568925)
- 1e11   0.09800   (1.00097891658)
- 1e12   0.29800   (0.997024870685)
- 1e13   0.62200   (1.0062169910992)
- 1e14   0.06200   (1.00062143604171)
 2019-10-10 02:03:14 +03:00
alexey-milovidov
d1eb9b197b
Merge pull request #7250 from nikvas0/nikvas0/ldb-doc-fix 
Fix docs for Lazy database
 2019-10-10 01:52:40 +03:00
alesapin
777ba2e47e Remove some code 2019-10-10 00:31:29 +03:00
alesapin
9f0b3e5bbf Update dockerfiles 2019-10-09 23:33:23 +03:00
Nikita Vasilev
05147f2a85 fix 2019-10-09 23:26:36 +03:00
Alexey Milovidov
3fbac60328 Added a test 2019-10-09 23:16:17 +03:00
Alexey Milovidov
e65b57369e transformQueryForExternalDatabase: fixed constant folding for Date and DateTime 2019-10-09 23:13:34 +03:00
alesapin
fae3f85a0f Refactor parser create query 2019-10-09 23:09:10 +03:00
Alexey Milovidov
b302fec362 Fixed bad code in transformQueryForExternalDatabase 2019-10-09 22:58:50 +03:00
Nikita Vasilev
82616b954b fix 2019-10-09 22:19:50 +03:00
alexey-milovidov
2a94198445
Update mysql.md 2019-10-09 21:28:22 +03:00
alexey-milovidov
94f093829d
Update mysql.md 2019-10-09 21:28:01 +03:00
alexey-milovidov
689411abe0
Merge pull request #7222 from azat/uniqCombined64 
[RFC] Introduce uniqCombined64() to get sane results for cardinality > UINT_MAX
 2019-10-09 20:29:56 +03:00
alexey-milovidov
0555749096
Update reference.md 2019-10-09 20:29:12 +03:00
alexey-milovidov
6d31c3e730
Update reference.md 2019-10-09 20:28:15 +03:00
alexey-milovidov
6cd3e9a458
Update AggregateFunctionUniqCombined.h 2019-10-09 20:26:01 +03:00
alexey-milovidov
81a9c81ba7
Merge pull request #7236 from azat/uniqCombined-memory-usage 
Do not use more then 98K of memory for uniqCombined*
 2019-10-09 20:19:30 +03:00
alexey-milovidov
e3861e0e88
Merge pull request #7242 from azat/sparse_hashed-name 
Return SparseHashed name (system.dictionaries:type) for the sparse_hashed layout
 2019-10-09 20:12:24 +03:00
alexey-milovidov
f3e1ba8ecd
Merge pull request #7243 from vinity/master 
Grammatical mistake
 2019-10-09 20:11:19 +03:00
Nikolai Kochetov
dea89cfc11 Disable processors by default. 2019-10-09 19:42:13 +03:00
alexey-milovidov
01e08a23c2
Merge pull request #7240 from ClickHouse/function-get-macro 
Added function `getMacro`
 2019-10-09 15:28:54 +03:00
Alexander Kuzmenkov
1965c612ab Fix sorting in clickhouse-test. 2019-10-09 14:56:51 +03:00
Ivan Lezhankin
340705f1ca Fix backporting script 
Rename yandex → ClickHouse
 2019-10-09 14:37:20 +03:00
Ivan Blinkov
1a2b5f6175
Remove link to (almost) past meetup 2019-10-09 14:36:55 +03:00
Nikolai Kochetov
9c5ae5f536 Merge branch 'master' into processors-and-storages 2019-10-09 14:12:47 +03:00
Alexander Kuzmenkov
89ebd4885f Fix test filtering in clickhouse-test. 2019-10-09 13:51:59 +03:00
alesapin
ef0b2f5936
Merge pull request #7209 from ClickHouse/dictionaries_ddl_parser 
Dictionaries ddl parser
 2019-10-09 12:51:08 +03:00
Nikolai Kochetov
eb2677c94e Try fix progressbar. 2019-10-09 12:44:24 +03:00
Nikolai Kochetov
ea27918de8 Try fix progressbar. 2019-10-09 12:40:30 +03:00
Nikolai Kochetov
c7bb83262e Fix progress callback for processors pipeline. 2019-10-09 12:33:16 +03:00
vinity
e0aa30fa43
Grammatical mistake 2019-10-09 14:30:04 +05:30
Azat Khuzhin
0ff823b574 Return SparseHashed name (system.dictionaries:type) for the sparse_hashed layout 
Due to tons of rebasing this bit had been forgotten.

Refs: 420089c301 ("Add new dictionary layout (sparse_hashed) that is more memory efficient")
 2019-10-09 11:11:41 +03:00
alexey-milovidov
9b2e025918
Merge pull request #7234 from ClickHouse/aku/null-field-serialization 
Serialize Null Fields correctly in DataTypeNullable.
 2019-10-09 04:30:37 +03:00
alexey-milovidov
c200c38409
Merge pull request #7205 from amosbird/debfix 
Make sure dh_clean not touch potential source files.
 2019-10-09 04:29:55 +03:00
Alexey Milovidov
6d2a79e832 Added a test 2019-10-09 04:18:12 +03:00
Alexey Milovidov
552e4b4be2 Added example config with macros for tests 2019-10-09 04:16:34 +03:00
Alexey Milovidov
a19f6513ce Added example config with macros 2019-10-09 04:15:23 +03:00
Alexey Milovidov
9f8d562543 Add function "getMacro" #7239 2019-10-09 04:14:57 +03:00
Azat Khuzhin
e373862c83 Do not use more then 98K of memory for uniqCombined* 
uniqCombined() uses hashtable for medium cardinality, and since
HashTable resize by the power of 2 (well actually HashTableGrower grows
double by the power of 2, hence HashTableGrower::increaseSize() should
be overwritten to change this), with 1<<13 (default for uniqCombined)
and UInt64 HashValueType, the HashTable will takes:

  getBufferSizeInBytes() == 131072

While it should be not greater then sizeof(HLL) ~= 98K, so reduce the
maximum cardinality for hashtable to 1<<12 with UInt64 HashValueType and
to 1<13 with UInt32, overwrite HashTableGrower::increaseSize() and cover
this using max_memory_usage.

Refs: https://github.com/ClickHouse/ClickHouse/pull/7221#issuecomment-539672742

v2: cover uniqCombined() with non-default K
 2019-10-09 02:39:23 +03:00
alexey-milovidov
e6b9f9c70b
Update CHANGELOG.md 2019-10-09 02:15:51 +03:00
Amos Bird
56aa191ca5 Make sure dh_clean not touch source files 2019-10-09 04:34:21 +08:00
alexey-milovidov
4c1f0177b6
Merge pull request #7109 from infinivision/aggBitmapAnd 
added groupBitmapAnd, groupBitmapOr, groupBitmapXor
 2019-10-08 22:51:46 +03:00
alexey-milovidov
5c2d478543
Merge pull request #7212 from ClickHouse/aku/field-includes 
Include Field.h and FieldVisitor.h into fewer files.
 2019-10-08 22:40:30 +03:00
alesapin
5296be18f3 Fix desc table query 2019-10-08 22:39:20 +03:00
alexey-milovidov
b9aa5d812d
Merge pull request #7171 from nikvas0/nikvas0/lazy_db 
Lazy Database
 2019-10-08 22:15:55 +03:00
alexey-milovidov
e846aea5c8
Update lazy.md 2019-10-08 22:15:30 +03:00
Azat Khuzhin
f46c5a47c0 Introduce uniqCombined64() to get sane results for cardinality > UINT_MAX 
By default uniqCombined() uses 32-bit hash for all types except String,
so this means that you cannot use uniqCombined() with i.e UInt64 and
cardinality > UINT_MAX, although you can use uniqCombined(toString())
and this will lead to 64-bit hash, but will not have good performance.

So uniqCombined64() had been introduced to fix this.

Requires: #7213
 2019-10-08 21:59:35 +03:00
alexey-milovidov
ddc2299901
Update 01016_null_part_minmax.sql 2019-10-08 21:52:48 +03:00
alexey-milovidov
d8b3db65f7
Merge pull request #7213 from azat/fix-uniqCombined-approximation 
Fix uniqCombined() result for >UINT_MAX values (return UInt64 to avoid overflow)
 2019-10-08 21:45:23 +03:00
alexey-milovidov
e619304b2c
Merge pull request #7216 from ClickHouse/nicelulu-issue-6615 
Merging "Optimize empty IN subquery and empty INNER/RIGHT JOIN"
 2019-10-08 21:36:57 +03:00