Commit Graph

5102 Commits

Author SHA1 Message Date
millb
259be751ee Fixed metric name.
Add metric description.
Add test.
2019-09-26 15:06:52 +03:00
Guillaume Tassery
7c93ef1706 Add integration tests for auth on HTTP external dictionaries 2019-09-26 12:28:56 +02:00
Alexey Milovidov
ff07ffbbae Merge branch 'merging_redis' of https://github.com/CurtizJ/ClickHouse into CurtizJ-merging_redis 2019-09-25 02:27:05 +03:00
alexey-milovidov
64e889d872
Merge pull request #7070 from 4ertus2/mjoin
PartialMergeJoin optimisation (skip not intersected blocks)
2019-09-25 02:24:42 +03:00
Alexander Tokmakov
d642304b1d add CustomSeparated format 2019-09-24 22:56:45 +03:00
chertus
0467229eff fix all left partial merge join on block borders 2019-09-24 21:21:57 +03:00
alexey-milovidov
bc9667d881
Merge pull request #7085 from ClickHouse/merge-s3
Merge s3
2019-09-24 17:51:57 +03:00
Alexander Tokmakov
e197cc8a49 read settings from file 2019-09-24 17:45:04 +03:00
Vladimir Chebotarev
c051f42384 Fixes. 2019-09-24 10:58:42 +00:00
alexey-milovidov
56bd02cf3a
Merge pull request #7016 from ClickHouse/yet-another-minor-changes-and-docs-for-hdfs
Cleanup hdfs docs (instead of #6876 for  #5371)
2019-09-24 02:23:59 +03:00
alexey-milovidov
e2cc551b22
Merge pull request #6914 from maqroll/master
+ Redirect URL Storage
2019-09-24 02:07:06 +03:00
alexey-milovidov
c4c936c685
Merge pull request #7049 from ClickHouse/ucasFL-master
Merging function "repeat"
2019-09-23 22:52:38 +03:00
alexey-milovidov
e24d882326
Merge pull request #7024 from millb/master
Fixed Function Hex for Float32 and Float64
2019-09-23 22:52:19 +03:00
Alexey Milovidov
89f27de705 Merge branch 'master' into ucasFL-master 2019-09-23 21:05:29 +03:00
Alexey Milovidov
8579c26efb Changed repository URL 2019-09-23 19:18:19 +03:00
millb
bd29efdbbe New hex function release
Bugs and tests fixed
2019-09-23 18:47:34 +03:00
Olga Khvostikova
a6296b2eb0
Merge branch 'master' into yet-another-minor-changes-and-docs-for-hdfs 2019-09-23 18:16:01 +03:00
Alexander Tokmakov
769d33848b allow specifying column idx in format string 2019-09-23 18:10:48 +03:00
chertus
9261d9d970 stabilize tests (add order by) 2019-09-23 16:55:04 +03:00
Vladimir Chebotarev
f8c0fef919 Attempt to make table-level setting s3_min_upload_part_size. 2019-09-23 12:41:59 +00:00
Alexander Tokmakov
89280c0ca8 fix tests 2019-09-23 13:45:26 +03:00
maqroll
a6e7519f9d Merge remote-tracking branch 'upstream/master' 2019-09-23 07:55:07 +00:00
maqroll
e1613d0704 + integration test 2019-09-23 07:27:49 +00:00
philip.han
3c40bb86ae Clean up a test table in bloom_filter_test 2019-09-23 15:45:57 +09:00
philip.han
833b188b88 Fix a result of bloom_filter_test 2019-09-23 15:24:53 +09:00
philip.han
315fcc6ef6 Add a testcase that checks nested array type of bloom_filter 2019-09-23 12:41:23 +09:00
Alexey Milovidov
e6f1fdc011 Added another test 2019-09-23 02:56:27 +03:00
Alexey Milovidov
69c79c31bb Merging function 'repeat': improved test 2019-09-23 02:31:33 +03:00
Alexey Milovidov
454b83fcd3 Merging function 'repeat' 2019-09-23 02:30:13 +03:00
Alexey Milovidov
52272eeea9 Merge branch 'master' of https://github.com/ucasFL/ClickHouse into ucasFL-master 2019-09-23 02:04:18 +03:00
Alexey Milovidov
bdea16e308 Merging S3: Moved S3 settings to <s3> in config to correspond to <merge_tree> and <kafka> 2019-09-23 01:44:10 +03:00
alexey-milovidov
2054f80623
Merge pull request #5596 from excitoon-favorites/table_function_s3
s3 table function and storage
2019-09-23 00:53:06 +03:00
alexey-milovidov
6fa234cea4
Merge pull request #6894 from azat-archive/hashed-dict-memory-usage-v2
[RFC] Add sparsehash support for hashed dictionary (to reduce memory usage)
2019-09-22 15:55:36 +03:00
Vladimir Chebotarev
4608da1344 Minor tests improvement. 2019-09-22 11:03:02 +00:00
Vladimir Chebotarev
64d49e4565 Minor review fixes. 2019-09-22 10:42:47 +00:00
fenglv
4465fdb8bf Add test
fix

fix

fix
2019-09-22 14:25:43 +08:00
alexey-milovidov
67e02b4ea0
Merge pull request #6957 from infinivision/add_bitmapSubsetLimit
added bitmapSubsetLimit
2019-09-22 04:58:44 +03:00
alesapin
4575b6e4ff
Merge pull request #7031 from yandex/rename-storage-policy-name
Renamed "storage_policy_name" to "storage_policy"
2019-09-21 17:03:19 +03:00
Azat Khuzhin
420089c301
Add new dictionary layout (sparse_hashed) that is more memory efficient
With this new layout, sparsehash will be used over default HashMap,
sparsehash is more memory efficient but it is also slower.

So in a nutshell:
- HashMap uses ~2x more memory then sparse_hash_map
- HashMap ~2-2.5x faster then sparse_hash_map
(tested on lots of input, and the most close to production was
dictionary with 600KK hashes and UInt16 as value)

TODO:
- fix allocated memory calculation
- getBufferSizeInBytes/getBufferSizeInCells interface
- benchmarks

v0: replace HashMap with google::sparse_hash_map
v2: use google::sparse_hash_map only when <sparse> isset to true
v3: replace attributes with different layout
v4: use ch hash over std::hash
2019-09-21 02:22:40 +03:00
alexey-milovidov
f8d19f6bf3
Merge pull request #6968 from azat-archive/create_as_skip_indices
[RFC] Introduce create_as_skip_indices
2019-09-20 23:53:49 +03:00
alexey-milovidov
2432a68009
Merge pull request #7022 from 4ertus2/bugs
Fix "Unknown identifier" in ORDER BY and GROUP BY with Multiple Joins
2019-09-20 23:45:51 +03:00
alexey-milovidov
3f500aad4b
Merge pull request #6976 from sfod/issue-3571
Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without agg…
2019-09-20 23:39:00 +03:00
Alexey Milovidov
42b739550b Renamed "storage_policy_name" to "storage_policy" 2019-09-20 23:35:50 +03:00
alexey-milovidov
5314088648
Merge pull request #6980 from filimonov/huge_pk_performance_test
Adding performance test for huge pk (issue #6924)
2019-09-20 23:29:56 +03:00
Alexander Tokmakov
0080639f79 Merge branch 'master' into merging_values_with_expressions 2019-09-20 23:26:01 +03:00
Alexander Tokmakov
2c7384ff39 add performance test 2019-09-20 22:45:26 +03:00
alexey-milovidov
123b8cb43c
Merge pull request #6990 from Akazz/timeout_for_sync_replica_cmd
Fixed timeout mechanism for SYNC REPLICA command + simplified related code
2019-09-20 20:32:51 +03:00
alexey-milovidov
aabd6906f2
Merge pull request #6982 from 4ertus2/mjoin
PartialMergeJoin bugfixes
2019-09-20 20:19:00 +03:00
millb
4f24512ba4 Test added. 2019-09-20 19:40:06 +03:00
chertus
7726130303 fix multiple joins aliasing for order by and group by 2019-09-20 19:01:19 +03:00
sfod
bc9bcfdb7e Fix tests which use WITH TOTALS without aggregation 2019-09-20 17:42:30 +03:00
sfod
bf2654e093 Use sql file to test changes 2019-09-20 17:39:26 +03:00
stavrolia
7309e813bc cleanup hdfs docs 2019-09-20 14:26:00 +03:00
Alexander Kazakov
2d807368e1 Adjusted timings in test + more verbose diagnostics 2019-09-20 00:20:58 +03:00
Azat Khuzhin
b2a3db1048
Ignore indices for CREATE TABLE .. AS .. if storage do not support them 2019-09-19 23:55:38 +03:00
chertus
da14951ecd implement MergeJoin.joinTotals() 2019-09-19 17:53:03 +03:00
Alexander Kazakov
90c9d83fa5 Added missing newline at the EOF 2019-09-19 17:48:08 +03:00
Alexander Kazakov
7a0f7a57e2 Chmod +x for test!!! 2019-09-19 15:48:18 +03:00
Akazz
787a646680 Added a test to challenge timeout mechanism in SYNC REPLICA command 2019-09-19 13:00:44 +03:00
Vladimir Chebotarev
bd1ce56797 Tests decomposition. 2019-09-19 09:34:33 +00:00
Zhichang Yu
0dc3866c36 added bitmapSubsetLimit 2019-09-19 10:15:36 +08:00
alexey-milovidov
1fe79ad43c
Merge pull request #6941 from dimarub2000/enums_in_section
IN with Enums numeric values
2019-09-19 02:24:34 +03:00
alexey-milovidov
9c675e50bb
Merge pull request #6963 from nicelulu/issue_6616
optimize limit 1,0 and test.
2019-09-19 02:23:56 +03:00
alexey-milovidov
01a1920e9b
Merge pull request #6970 from infinivision/add_bitmapMin_bitmapMax
added bitmapMin and bitmapMax
2019-09-19 02:01:16 +03:00
alexey-milovidov
bc1ecb0be5
Merge pull request #6951 from yandex/aku/alloc-continue
Make the quadratic Arena::allocContinue less bad.
2019-09-19 01:57:26 +03:00
alexey-milovidov
d7681d0239
Merge pull request #6977 from Akazz/minor_fixes_in_tests-2
Reworked flapping test - 00715_fetch_merged_or_mutated_part_zookeeper
2019-09-19 01:54:27 +03:00
alexey-milovidov
db470be077
Update merge_tree_huge_pk.xml 2019-09-18 23:07:23 +03:00
chertus
08a28d2dc2 fix pm join bug (wrong right equal range copy) 2019-09-18 21:44:44 +03:00
chertus
38a73fb551 add simple perf test for partial merge join 2019-09-18 20:04:10 +03:00
Mikhail Filimonov
67e1cf9b73 Adding performance test for huge pk (issue #6924) 2019-09-18 17:35:45 +02:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin
PartialMergeJoin
2019-09-18 16:16:10 +03:00
Akazz
aa8ef05955 Reworked test 00715_fetch_merged_or_mutated_part_zookeeper 2019-09-18 16:14:56 +03:00
sfod
0bad4b4a05 Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without aggregate functions 2019-09-18 16:08:51 +03:00
Alexander Kuzmenkov
e1898ca89a Make the quadratic Arena::allocContinue less bad.
Scenarios that use Arena::allocContinue may waste quadratically many
memory and perform quadratically many copying, when the memory range
size reaches Arena's linear allocation threshold. To alleviate this,
make sure that the next memory chunk allocated by allocContinue is at
least linear_growth_threshold bytes bigger than the previous one, so
that we don't reallocate and copy that often.
2019-09-18 15:04:56 +03:00
CurtizJ
651f5b0e9f merging with master 2019-09-18 13:21:10 +03:00
CurtizJ
79a08ef8ea Merge remote-tracking branch 'upstream/master' into merging_redis 2019-09-18 12:58:22 +03:00
philip.han
ff30f4d890 Add testcases for Arrays in bloom_filter index 2019-09-18 18:32:46 +09:00
Zhichang Yu
460ccb04a2 added bitmapMin and bitmapMax 2019-09-18 16:56:12 +08:00
alexey-milovidov
03014fe920
Merge pull request #6944 from malkfilipp/add-limit-clause-to-show-queries
Add LIMIT clause to SHOW queries
2019-09-18 02:07:45 +03:00
root
f4b7cae998 optimize limit 1,0 and test. 2019-09-18 02:55:59 +08:00
chertus
2b3a4b0650 support const and LC columns in partial merge-join 2019-09-17 21:53:52 +03:00
chertus
58fad78980 support MergeJoin nullable convertion (right side) 2019-09-17 19:55:11 +03:00
CurtizJ
4df1f1bb9a better integration test for redis dictionary (but still bad) 2019-09-17 16:35:19 +03:00
malkfilipp
aab95fd517 Bump the test number 2019-09-17 15:41:25 +03:00
akuzm
75dc7d331e
Merge pull request #6937 from amosbird/ubmemfix
In hash tables, properly initialize zero key cell.
2019-09-17 14:57:38 +03:00
chertus
da5d35b34e partial merge join (minimal tested version) 2019-09-16 22:31:22 +03:00
Amos Bird
1cf47da60d ubsan/memsan fix. 2019-09-16 21:20:17 +08:00
malkfilipp
ed42b94af7 Add tests 2019-09-15 19:08:26 +03:00
alexey-milovidov
831eebe4dc
Merge pull request #6934 from abyss7/CLICKHOUSE-4643
Name temporary external table with existing subquery alias
2019-09-15 09:46:10 +03:00
Vladimir Chebotarev
d53872c300 Tests improvement. 2019-09-14 07:44:46 +00:00
Ivan
66d6e0cbb3 Update 01009_global_array_join_names.reference 2019-09-14 01:03:44 +03:00
Ivan
8fcf490bd9
Update 01009_global_array_join_names.reference 2019-09-14 00:58:39 +03:00
Ivan
33e6681c90
Update 01009_global_array_join_names.sql 2019-09-13 23:00:28 +03:00
Dmitry Rubashkin
57eef84322 DROP 2019-09-13 22:09:00 +03:00
Dmitry Rubashkin
ea3f80460c Tests. 2019-09-13 22:07:22 +03:00
alexey-milovidov
10e274213d
Merge pull request #6930 from filimonov/performance_test_lowcard_arr
performance test for lowcardinality array
2019-09-13 20:01:57 +03:00
Ivan
d697f4a1d1
Update 01009_global_array_join_names.sql 2019-09-13 19:07:54 +03:00
Ivan
add919e922
Update 01009_global_array_join_names.sql 2019-09-13 17:44:04 +03:00
Vladimir Chebotarev
4406ad1061 Tests fix. 2019-09-13 13:53:17 +00:00
Vladimir Chebotarev
2cddcebc31 Moved server to clickhouse instance in test. 2019-09-13 13:17:58 +00:00