thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-21 15:12:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,701 Commits 9,143 Branches 1,778 Tags 2.1 GiB
1eb44c6837
Commit Graph

30701 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Vitaly Baranov
12d1d87d64 Move authentication code to a separate class. 2019-10-11 00:18:52 +03:00
Nikolai Kochetov
a15d8f36d5
Merge pull request #7270 from azat/uniqCombined-memory-usage-tests-fixes 
uniqCombined memory usage tests fixes
 2019-10-10 23:53:55 +03:00
alesapin
2a5713e6e4 Compilable code 2019-10-10 23:47:47 +03:00
Nikolai Kochetov
0ce86e1f8f Disable memory tracker for exception stack. 2019-10-10 21:55:16 +03:00
Azat Khuzhin
e25bdc8d25 tests/00212_shard_aggregate_function_uniq: adjust values for uniqCombined(12)(String) 
In e373862c83 the maxium size for HashTable in
CombinedCardinalityEstimator had been reduced for power of 2 for String
(since otherwise the size of the hashtable becames bigger then the
sizeof HLL).

Refs: https://github.com/ClickHouse/ClickHouse/pull/7236#issuecomment-540496270
Fixes: e373862c83 ("Do not use more then 98K of memory for uniqCombined*")
 2019-10-10 21:47:51 +03:00
Azat Khuzhin
eb7d4797e3 tests/00212_shard_aggregate_function_uniq: break into sections 2019-10-10 21:47:51 +03:00
Azat Khuzhin
495d1de46f clickhouse-test: introduce -U/--unified option (pass to diff(1)) 2019-10-10 21:47:51 +03:00
alexey-milovidov
9c1c596146
Merge pull request #7252 from ClickHouse/fix-bad-code-in-transform-query-for-external-database 
Fix bad code in transforming query for external database.
 2019-10-10 21:10:36 +03:00
Nikolai Kochetov
f011c1020e Disable memory tracker for exception stack. 2019-10-10 20:37:34 +03:00
alesapin
67fc3347c2 Preparing databases for dictionaries 2019-10-10 20:33:01 +03:00
Nikolai Kochetov
742b948156 Disable memory tracker for exception stack. 2019-10-10 19:30:33 +03:00
Alexander Kazakov
03c7b7ff8d
Prevent from using non-deterministic functions in mutations of replicated tables (#7247) 
* Added isDeterministic() to IFunctionBuilder i-face
* A test for non-deterministic mutations
* In MutationsInterpreter::validate() ensure deterministic functions
* Adjusted nondeterministic mutation tests
* Moved around some code in MutationsInterpreter::validate()
* Dropped unnecessary check in findFirstNonDeterministicFuncName()
* Corrections to IFunction{Base,Builder} interface
 2019-10-10 17:38:08 +03:00
Mikhail Korotov
12768ddf45
Merge pull request #1 from ClickHouse/master 
refresh
 2019-10-10 17:21:28 +03:00
alesapin
0769f80f4e Fix path to config in docker images 2019-10-10 13:26:57 +03:00
alesapin
51c8188903
Merge pull request #7253 from ClickHouse/dictionaries_ddl_parser 
Refactor parser create query
 2019-10-10 11:34:21 +03:00
Azat Khuzhin
c2fa7ffcd3 Drop note about "estimation error for large sets will be large" 
Since error is not that large, especially for uniqCombined64():

rows     error     uniqCombined64()/rows
- 1e7    0.00219   (1.0021969)
- 1e8    0.00096   (0.99903523)
- 2e8    0.50200   (1.005022735)
- 1e9    0.99944   (0.999435738)
- 1e10   0.01399   (0.9998568925)
- 1e11   0.09800   (1.00097891658)
- 1e12   0.29800   (0.997024870685)
- 1e13   0.62200   (1.0062169910992)
- 1e14   0.06200   (1.00062143604171)
 2019-10-10 02:03:14 +03:00
alexey-milovidov
d1eb9b197b
Merge pull request #7250 from nikvas0/nikvas0/ldb-doc-fix 
Fix docs for Lazy database
 2019-10-10 01:52:40 +03:00
alesapin
777ba2e47e Remove some code 2019-10-10 00:31:29 +03:00
alesapin
9f0b3e5bbf Update dockerfiles 2019-10-09 23:33:23 +03:00
Nikita Vasilev
05147f2a85 fix 2019-10-09 23:26:36 +03:00
Alexey Milovidov
3fbac60328 Added a test 2019-10-09 23:16:17 +03:00
Alexey Milovidov
e65b57369e transformQueryForExternalDatabase: fixed constant folding for Date and DateTime 2019-10-09 23:13:34 +03:00
alesapin
fae3f85a0f Refactor parser create query 2019-10-09 23:09:10 +03:00
Alexey Milovidov
b302fec362 Fixed bad code in transformQueryForExternalDatabase 2019-10-09 22:58:50 +03:00
Nikita Vasilev
82616b954b fix 2019-10-09 22:19:50 +03:00
alexey-milovidov
2a94198445
Update mysql.md 2019-10-09 21:28:22 +03:00
alexey-milovidov
94f093829d
Update mysql.md 2019-10-09 21:28:01 +03:00
alexey-milovidov
689411abe0
Merge pull request #7222 from azat/uniqCombined64 
[RFC] Introduce uniqCombined64() to get sane results for cardinality > UINT_MAX
 2019-10-09 20:29:56 +03:00
alexey-milovidov
0555749096
Update reference.md 2019-10-09 20:29:12 +03:00
alexey-milovidov
6d31c3e730
Update reference.md 2019-10-09 20:28:15 +03:00
alexey-milovidov
6cd3e9a458
Update AggregateFunctionUniqCombined.h 2019-10-09 20:26:01 +03:00
alexey-milovidov
81a9c81ba7
Merge pull request #7236 from azat/uniqCombined-memory-usage 
Do not use more then 98K of memory for uniqCombined*
 2019-10-09 20:19:30 +03:00
alexey-milovidov
e3861e0e88
Merge pull request #7242 from azat/sparse_hashed-name 
Return SparseHashed name (system.dictionaries:type) for the sparse_hashed layout
 2019-10-09 20:12:24 +03:00
alexey-milovidov
f3e1ba8ecd
Merge pull request #7243 from vinity/master 
Grammatical mistake
 2019-10-09 20:11:19 +03:00
alexey-milovidov
01e08a23c2
Merge pull request #7240 from ClickHouse/function-get-macro 
Added function `getMacro`
 2019-10-09 15:28:54 +03:00
Alexander Kuzmenkov
1965c612ab Fix sorting in clickhouse-test. 2019-10-09 14:56:51 +03:00
Ivan Lezhankin
340705f1ca Fix backporting script 
Rename yandex → ClickHouse
 2019-10-09 14:37:20 +03:00
Ivan Blinkov
1a2b5f6175
Remove link to (almost) past meetup 2019-10-09 14:36:55 +03:00
Alexander Kuzmenkov
89ebd4885f Fix test filtering in clickhouse-test. 2019-10-09 13:51:59 +03:00
alesapin
ef0b2f5936
Merge pull request #7209 from ClickHouse/dictionaries_ddl_parser 
Dictionaries ddl parser
 2019-10-09 12:51:08 +03:00
vinity
e0aa30fa43
Grammatical mistake 2019-10-09 14:30:04 +05:30
Azat Khuzhin
0ff823b574 Return SparseHashed name (system.dictionaries:type) for the sparse_hashed layout 
Due to tons of rebasing this bit had been forgotten.

Refs: 420089c301 ("Add new dictionary layout (sparse_hashed) that is more memory efficient")
 2019-10-09 11:11:41 +03:00
alexey-milovidov
9b2e025918
Merge pull request #7234 from ClickHouse/aku/null-field-serialization 
Serialize Null Fields correctly in DataTypeNullable.
 2019-10-09 04:30:37 +03:00
alexey-milovidov
c200c38409
Merge pull request #7205 from amosbird/debfix 
Make sure dh_clean not touch potential source files.
 2019-10-09 04:29:55 +03:00
Alexey Milovidov
6d2a79e832 Added a test 2019-10-09 04:18:12 +03:00
Alexey Milovidov
552e4b4be2 Added example config with macros for tests 2019-10-09 04:16:34 +03:00
Alexey Milovidov
a19f6513ce Added example config with macros 2019-10-09 04:15:23 +03:00
Alexey Milovidov
9f8d562543 Add function "getMacro" #7239 2019-10-09 04:14:57 +03:00
Azat Khuzhin
e373862c83 Do not use more then 98K of memory for uniqCombined* 
uniqCombined() uses hashtable for medium cardinality, and since
HashTable resize by the power of 2 (well actually HashTableGrower grows
double by the power of 2, hence HashTableGrower::increaseSize() should
be overwritten to change this), with 1<<13 (default for uniqCombined)
and UInt64 HashValueType, the HashTable will takes:

  getBufferSizeInBytes() == 131072

While it should be not greater then sizeof(HLL) ~= 98K, so reduce the
maximum cardinality for hashtable to 1<<12 with UInt64 HashValueType and
to 1<13 with UInt32, overwrite HashTableGrower::increaseSize() and cover
this using max_memory_usage.

Refs: https://github.com/ClickHouse/ClickHouse/pull/7221#issuecomment-539672742

v2: cover uniqCombined() with non-default K
 2019-10-09 02:39:23 +03:00
alexey-milovidov
e6b9f9c70b
Update CHANGELOG.md 2019-10-09 02:15:51 +03:00