Guillaume Tassery
88491abd7b
add tests
2019-10-11 12:42:25 +02:00
Nikolai Kochetov
48bfcab428
Add ability to specify arguments to client in functional tests.
2019-10-11 13:30:32 +03:00
Nikolai Kochetov
a15d8f36d5
Merge pull request #7270 from azat/uniqCombined-memory-usage-tests-fixes
...
uniqCombined memory usage tests fixes
2019-10-10 23:53:55 +03:00
Azat Khuzhin
e25bdc8d25
tests/00212_shard_aggregate_function_uniq: adjust values for uniqCombined(12)(String)
...
In e373862c83
the maxium size for HashTable in
CombinedCardinalityEstimator had been reduced for power of 2 for String
(since otherwise the size of the hashtable becames bigger then the
sizeof HLL).
Refs: https://github.com/ClickHouse/ClickHouse/pull/7236#issuecomment-540496270
Fixes: e373862c83
("Do not use more then 98K of memory for uniqCombined*")
2019-10-10 21:47:51 +03:00
Azat Khuzhin
eb7d4797e3
tests/00212_shard_aggregate_function_uniq: break into sections
2019-10-10 21:47:51 +03:00
Azat Khuzhin
495d1de46f
clickhouse-test: introduce -U/--unified option (pass to diff(1))
2019-10-10 21:47:51 +03:00
Alexander Kazakov
03c7b7ff8d
Prevent from using non-deterministic functions in mutations of replicated tables ( #7247 )
...
* Added isDeterministic() to IFunctionBuilder i-face
* A test for non-deterministic mutations
* In MutationsInterpreter::validate() ensure deterministic functions
* Adjusted nondeterministic mutation tests
* Moved around some code in MutationsInterpreter::validate()
* Dropped unnecessary check in findFirstNonDeterministicFuncName()
* Corrections to IFunction{Base,Builder} interface
2019-10-10 17:38:08 +03:00
alexey-milovidov
689411abe0
Merge pull request #7222 from azat/uniqCombined64
...
[RFC] Introduce uniqCombined64() to get sane results for cardinality > UINT_MAX
2019-10-09 20:29:56 +03:00
alexey-milovidov
81a9c81ba7
Merge pull request #7236 from azat/uniqCombined-memory-usage
...
Do not use more then 98K of memory for uniqCombined*
2019-10-09 20:19:30 +03:00
alexey-milovidov
01e08a23c2
Merge pull request #7240 from ClickHouse/function-get-macro
...
Added function `getMacro`
2019-10-09 15:28:54 +03:00
Alexander Kuzmenkov
1965c612ab
Fix sorting in clickhouse-test.
2019-10-09 14:56:51 +03:00
Alexander Kuzmenkov
89ebd4885f
Fix test filtering in clickhouse-test.
2019-10-09 13:51:59 +03:00
alexey-milovidov
9b2e025918
Merge pull request #7234 from ClickHouse/aku/null-field-serialization
...
Serialize Null Fields correctly in DataTypeNullable.
2019-10-09 04:30:37 +03:00
Alexey Milovidov
6d2a79e832
Added a test
2019-10-09 04:18:12 +03:00
Alexey Milovidov
552e4b4be2
Added example config with macros for tests
2019-10-09 04:16:34 +03:00
Azat Khuzhin
e373862c83
Do not use more then 98K of memory for uniqCombined*
...
uniqCombined() uses hashtable for medium cardinality, and since
HashTable resize by the power of 2 (well actually HashTableGrower grows
double by the power of 2, hence HashTableGrower::increaseSize() should
be overwritten to change this), with 1<<13 (default for uniqCombined)
and UInt64 HashValueType, the HashTable will takes:
getBufferSizeInBytes() == 131072
While it should be not greater then sizeof(HLL) ~= 98K, so reduce the
maximum cardinality for hashtable to 1<<12 with UInt64 HashValueType and
to 1<13 with UInt32, overwrite HashTableGrower::increaseSize() and cover
this using max_memory_usage.
Refs: https://github.com/ClickHouse/ClickHouse/pull/7221#issuecomment-539672742
v2: cover uniqCombined() with non-default K
2019-10-09 02:39:23 +03:00
alexey-milovidov
4c1f0177b6
Merge pull request #7109 from infinivision/aggBitmapAnd
...
added groupBitmapAnd, groupBitmapOr, groupBitmapXor
2019-10-08 22:51:46 +03:00
alexey-milovidov
b9aa5d812d
Merge pull request #7171 from nikvas0/nikvas0/lazy_db
...
Lazy Database
2019-10-08 22:15:55 +03:00
Azat Khuzhin
f46c5a47c0
Introduce uniqCombined64() to get sane results for cardinality > UINT_MAX
...
By default uniqCombined() uses 32-bit hash for all types except String,
so this means that you cannot use uniqCombined() with i.e UInt64 and
cardinality > UINT_MAX, although you can use uniqCombined(toString())
and this will lead to 64-bit hash, but will not have good performance.
So uniqCombined64() had been introduced to fix this.
Requires: #7213
2019-10-08 21:59:35 +03:00
alexey-milovidov
ddc2299901
Update 01016_null_part_minmax.sql
2019-10-08 21:52:48 +03:00
alexey-milovidov
e619304b2c
Merge pull request #7216 from ClickHouse/nicelulu-issue-6615
...
Merging "Optimize empty IN subquery and empty INNER/RIGHT JOIN"
2019-10-08 21:36:57 +03:00
Alexander Kuzmenkov
a5b1496fe9
Serialize Null Fields correctly in DataTypeNullable.
2019-10-08 21:21:24 +03:00
Alexander Kuzmenkov
46f5115601
Accept many test name regexes in clickhouse-test.
...
Sometimes it is more convenient to supply space-separated test names
without having to concatenate them into one regex with pipes.
2019-10-08 14:32:03 +03:00
Vasilyev Nikita
030aa1cf10
fix
2019-10-08 11:10:55 +03:00
Alexey Milovidov
15bba8b498
Updated test
2019-10-07 22:16:45 +03:00
alexey-milovidov
bcc4e3f0ba
Merge branch 'master' into issue-6615
2019-10-07 22:12:25 +03:00
Alexander Tokmakov
a2c83ac82e
add tests
2019-10-07 19:31:30 +03:00
alexey-milovidov
d096119529
Merge pull request #7156 from ClickHouse/fix-header-for-now
...
Fix header for function 'now'
2019-10-05 22:35:23 +03:00
alexey-milovidov
bb8414bdeb
Merge pull request #7201 from vzakaznikov/enabling_again_live_view_tests
...
A quick fix to resolve crash in LIVE VIEW table and re-enabling all LIVE VIEW tests.
2019-10-05 20:47:34 +03:00
Vitaliy Zakaznikov
6b8e61737a
* Fixing crash in LIVE VIEW
...
* Re-enabling all LIVE VIEW tests
2019-10-05 08:05:24 -04:00
alexey-milovidov
9c2f3ba41a
Merge pull request #6984 from achimbab/pr_bf
...
Made bloom_filter type of index supporting arrays
2019-10-04 18:08:42 +03:00
tavplubix
d73db7f779
Merge pull request #6781 from ClickHouse/merging_values_with_expressions
...
Merging Values with expressions
2019-10-04 12:51:22 +03:00
Nikolai Kochetov
90472293fd
Added test with function randConstant.
2019-10-04 12:22:07 +03:00
alesapin
4e83f65089
Fix bug with segmentation fault in ATTACH PART query
2019-10-03 21:07:47 +03:00
Vasilyev Nikita
d6490892a7
fix metadata time
2019-10-03 17:18:17 +03:00
Guillaume Tassery
f54c90ccce
Merge branch 'master' of github.com:PerformanceVision/ClickHouse into move_partition
2019-10-03 10:24:39 +02:00
Alexander Tokmakov
a58996817f
allow query parameters in Values
2019-10-02 22:54:40 +03:00
Alexander Tokmakov
565c273eaa
Merge branch 'master' into merging_values_with_expressions
2019-10-02 20:51:44 +03:00
Alexander Tokmakov
80e5976d10
fixes after review
2019-10-02 20:51:00 +03:00
Vasilyev Nikita
136b1665a3
test rename
2019-10-02 16:06:57 +03:00
Vitaliy Zakaznikov
ffe8931cda
Revert "Merge pull request #6770 from yandex/temporary-remove-live-view-tests"
...
This reverts commit 6cf5327269
, reversing
changes made to 4155771106
.
2019-10-02 06:52:40 -04:00
Vasilyev Nikita
45ecff99a1
upd test
2019-10-02 09:31:23 +03:00
Artem Zuikov
48ab9afce6
Merge pull request #7122 from 4ertus2/mjoin
...
Squash left-hand blocks in partial merge join (optimization)
2019-10-01 17:23:10 +03:00
Vasilyev Nikita
71a2002417
test with sleep
2019-10-01 16:57:58 +03:00
Vasilyev Nikita
c5087219c4
test
2019-10-01 16:53:55 +03:00
Alexander Tokmakov
979f235e38
Merge branch 'master' into merging_values_with_expressions
2019-09-30 18:06:58 +03:00
chertus
5212d43ae4
simplify pmj settings
2019-09-30 17:36:45 +03:00
alexey-milovidov
e50a874537
Merge pull request #7118 from ClickHouse/improve_template_format
...
Minor improvements of Template format
2019-09-30 15:00:27 +03:00
alexey-milovidov
42c9ea9aa3
Merge pull request #7092 from PerformanceVision/acl_file_storage
...
Let the choice to write credential for HTTP source on external dictionaries
2019-09-30 13:20:33 +03:00
Alexander Kazakov
2f355d716a
Corrections to tests 00992/00993:mutations to be deterministic
2019-09-27 16:38:40 +03:00
chertus
baaf0a7c5b
partial_merge_join_optimisations -> partial_merge_join_optimizations
2019-09-27 15:25:02 +03:00
root
0189945ad8
Optimize empty IN subquery and empty INNER/RIGHT JOIN.
2019-09-27 19:06:20 +08:00
Guillaume Tassery
b1182cdc3d
uupdate tests
2019-09-27 05:15:03 +02:00
Zhichang Yu
8945714c27
added groupBitmapAnd, groupBitmapOr, groupBitmapXor
2019-09-27 10:21:07 +08:00
Alexander Tokmakov
004455a029
fixes
2019-09-27 00:40:14 +03:00
alexey-milovidov
a2fc7e2e9e
Merge pull request #7093 from millb/merges_counter_metric
...
Add merge metric
2019-09-26 21:49:43 +03:00
tavplubix
c3ed1f38a6
Merge branch 'master' into improve_template_format
2019-09-26 19:19:11 +03:00
millb
ea013cf1a2
Fixed test
2019-09-26 17:44:04 +03:00
millb
259be751ee
Fixed metric name.
...
Add metric description.
Add test.
2019-09-26 15:06:52 +03:00
Guillaume Tassery
7c93ef1706
Add integration tests for auth on HTTP external dictionaries
2019-09-26 12:28:56 +02:00
Alexey Milovidov
ff07ffbbae
Merge branch 'merging_redis' of https://github.com/CurtizJ/ClickHouse into CurtizJ-merging_redis
2019-09-25 02:27:05 +03:00
alexey-milovidov
64e889d872
Merge pull request #7070 from 4ertus2/mjoin
...
PartialMergeJoin optimisation (skip not intersected blocks)
2019-09-25 02:24:42 +03:00
Alexander Tokmakov
d642304b1d
add CustomSeparated format
2019-09-24 22:56:45 +03:00
chertus
0467229eff
fix all left partial merge join on block borders
2019-09-24 21:21:57 +03:00
alexey-milovidov
bc9667d881
Merge pull request #7085 from ClickHouse/merge-s3
...
Merge s3
2019-09-24 17:51:57 +03:00
Alexander Tokmakov
e197cc8a49
read settings from file
2019-09-24 17:45:04 +03:00
Vladimir Chebotarev
c051f42384
Fixes.
2019-09-24 10:58:42 +00:00
alexey-milovidov
56bd02cf3a
Merge pull request #7016 from ClickHouse/yet-another-minor-changes-and-docs-for-hdfs
...
Cleanup hdfs docs (instead of #6876 for #5371 )
2019-09-24 02:23:59 +03:00
alexey-milovidov
e2cc551b22
Merge pull request #6914 from maqroll/master
...
+ Redirect URL Storage
2019-09-24 02:07:06 +03:00
alexey-milovidov
c4c936c685
Merge pull request #7049 from ClickHouse/ucasFL-master
...
Merging function "repeat"
2019-09-23 22:52:38 +03:00
alexey-milovidov
e24d882326
Merge pull request #7024 from millb/master
...
Fixed Function Hex for Float32 and Float64
2019-09-23 22:52:19 +03:00
Alexey Milovidov
89f27de705
Merge branch 'master' into ucasFL-master
2019-09-23 21:05:29 +03:00
Alexey Milovidov
8579c26efb
Changed repository URL
2019-09-23 19:18:19 +03:00
millb
bd29efdbbe
New hex function release
...
Bugs and tests fixed
2019-09-23 18:47:34 +03:00
Olga Khvostikova
a6296b2eb0
Merge branch 'master' into yet-another-minor-changes-and-docs-for-hdfs
2019-09-23 18:16:01 +03:00
Alexander Tokmakov
769d33848b
allow specifying column idx in format string
2019-09-23 18:10:48 +03:00
chertus
9261d9d970
stabilize tests (add order by)
2019-09-23 16:55:04 +03:00
Vladimir Chebotarev
f8c0fef919
Attempt to make table-level setting s3_min_upload_part_size
.
2019-09-23 12:41:59 +00:00
Alexander Tokmakov
89280c0ca8
fix tests
2019-09-23 13:45:26 +03:00
maqroll
a6e7519f9d
Merge remote-tracking branch 'upstream/master'
2019-09-23 07:55:07 +00:00
maqroll
e1613d0704
+ integration test
2019-09-23 07:27:49 +00:00
philip.han
3c40bb86ae
Clean up a test table in bloom_filter_test
2019-09-23 15:45:57 +09:00
philip.han
833b188b88
Fix a result of bloom_filter_test
2019-09-23 15:24:53 +09:00
philip.han
315fcc6ef6
Add a testcase that checks nested array type of bloom_filter
2019-09-23 12:41:23 +09:00
Alexey Milovidov
e6f1fdc011
Added another test
2019-09-23 02:56:27 +03:00
Alexey Milovidov
69c79c31bb
Merging function 'repeat': improved test
2019-09-23 02:31:33 +03:00
Alexey Milovidov
454b83fcd3
Merging function 'repeat'
2019-09-23 02:30:13 +03:00
Alexey Milovidov
52272eeea9
Merge branch 'master' of https://github.com/ucasFL/ClickHouse into ucasFL-master
2019-09-23 02:04:18 +03:00
Alexey Milovidov
bdea16e308
Merging S3: Moved S3 settings to <s3> in config to correspond to <merge_tree> and <kafka>
2019-09-23 01:44:10 +03:00
alexey-milovidov
2054f80623
Merge pull request #5596 from excitoon-favorites/table_function_s3
...
s3 table function and storage
2019-09-23 00:53:06 +03:00
alexey-milovidov
6fa234cea4
Merge pull request #6894 from azat-archive/hashed-dict-memory-usage-v2
...
[RFC] Add sparsehash support for hashed dictionary (to reduce memory usage)
2019-09-22 15:55:36 +03:00
Vladimir Chebotarev
4608da1344
Minor tests improvement.
2019-09-22 11:03:02 +00:00
Vladimir Chebotarev
64d49e4565
Minor review fixes.
2019-09-22 10:42:47 +00:00
fenglv
4465fdb8bf
Add test
...
fix
fix
fix
2019-09-22 14:25:43 +08:00
alexey-milovidov
67e02b4ea0
Merge pull request #6957 from infinivision/add_bitmapSubsetLimit
...
added bitmapSubsetLimit
2019-09-22 04:58:44 +03:00
alesapin
4575b6e4ff
Merge pull request #7031 from yandex/rename-storage-policy-name
...
Renamed "storage_policy_name" to "storage_policy"
2019-09-21 17:03:19 +03:00
Azat Khuzhin
420089c301
Add new dictionary layout (sparse_hashed) that is more memory efficient
...
With this new layout, sparsehash will be used over default HashMap,
sparsehash is more memory efficient but it is also slower.
So in a nutshell:
- HashMap uses ~2x more memory then sparse_hash_map
- HashMap ~2-2.5x faster then sparse_hash_map
(tested on lots of input, and the most close to production was
dictionary with 600KK hashes and UInt16 as value)
TODO:
- fix allocated memory calculation
- getBufferSizeInBytes/getBufferSizeInCells interface
- benchmarks
v0: replace HashMap with google::sparse_hash_map
v2: use google::sparse_hash_map only when <sparse> isset to true
v3: replace attributes with different layout
v4: use ch hash over std::hash
2019-09-21 02:22:40 +03:00
alexey-milovidov
f8d19f6bf3
Merge pull request #6968 from azat-archive/create_as_skip_indices
...
[RFC] Introduce create_as_skip_indices
2019-09-20 23:53:49 +03:00
alexey-milovidov
2432a68009
Merge pull request #7022 from 4ertus2/bugs
...
Fix "Unknown identifier" in ORDER BY and GROUP BY with Multiple Joins
2019-09-20 23:45:51 +03:00
alexey-milovidov
3f500aad4b
Merge pull request #6976 from sfod/issue-3571
...
Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without agg…
2019-09-20 23:39:00 +03:00