thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 21:51:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
32,796 Commits 9,131 Branches 1,778 Tags 2 GiB
4b81715ad8
Commit Graph

4248 Commits

Author SHA1 Message Date
Nikita Mikhaylov
a3f3a333e2 better test 2019-12-05 12:55:06 +03:00
Nikita Mikhaylov
9d005d1565 true changes 2019-12-05 12:50:42 +03:00
Vitaly Baranov
2cc78413ed
Merge pull request #7914 from azat/dist-send-extra-checksum 
Add checksum for extra info/query in distributed sends
 2019-12-05 11:43:08 +03:00
alesapin
a524e82a7f
Merge pull request #8029 from ClickHouse/fix_dict_partially_update_failover 
Fix external dictionaries failover, when they have invalidate_query.
 2019-12-05 11:12:17 +03:00
chertus
d3d2e39955 fix SEMI RIGHT JOIN 2019-12-04 23:23:07 +03:00
Azat Khuzhin
3a72e1c12a Add checksum for extra info/query in distributed sends 
This extras includes:
- server revision
- query settings
- query

Otherwise the code can try to interpret data, and got for instance
std::length_error exception, which is not catched (to mark the part as
broken). Also this will protect from the corruptions on disk.

And add a simple test, since dbms/tests/integration/test_insert_into_distributed too complex.

Also simplify the code by using readStringBinary() over
readVarUInt()+b.readStrict() (this also gains additional checks that
string is not bigger then 1GB).

Refs: #4852 (8ef7f3589a)
v2: avoid ABI breakage (suggested by @vitlibar)
v3: minor code fixes (suggested by @vitlibar) and as a consequence clang-8 build fix
v4: drop DBMS_MIN_REVISION_WITH_EXTRAS_CHECKSUM_IN_DIST_BATCH and also
    revert some renames to make the patch cleaner
 2019-12-04 22:54:38 +03:00
alesapin
172bbb1a2f Fix flappy test, because dictionaries are loaded lazily 2019-12-04 21:30:47 +03:00
alesapin
3128b62f0e Create dictionary if not exists 2019-12-04 18:11:36 +03:00
alesapin
a41764cccc Reload dictionary with invalidate query if it has exception 2019-12-04 17:45:56 +03:00
alesapin
ce05cea192 Add sleep for test 2019-12-04 17:22:49 +03:00
alesapin
711fb5e667 Added tests for external dictionary invalidate query failover 2019-12-04 16:53:05 +03:00
alesapin
ace44e0717 Add test for incorrect settings 2019-12-04 12:34:05 +03:00
alexey-milovidov
f09c29a2b6
Merge pull request #7992 from ClickHouse/excitoon-favorites-s3auth 
Merging #7623
 2019-12-03 15:21:12 +03:00
alexey-milovidov
0c904f1484
Merge pull request #7721 from 4ertus2/decimal 
Basic GatherUtils support for Decimals
 2019-12-03 05:15:38 +03:00
alexey-milovidov
0734d4695b
Merge pull request #7724 from 4ertus2/some 
Missing array functions for Decimals
 2019-12-03 05:14:33 +03:00
alexey-milovidov
812df3aef3
Merge pull request #7755 from nikitamikhaylov/storage_set 
Using the Set engine happen Exception: Method read is not supported by storage Set
 2019-12-03 05:09:47 +03:00
alexey-milovidov
f1d75d9722
Update 01030_storage_set_supports_read.sql 2019-12-03 05:09:33 +03:00
alexey-milovidov
f5e88f8cd5
Merge pull request #7307 from ClickHouse/new-branch-for-new-geodist 
Speed up greatCircleDistance function with test
 2019-12-03 04:34:35 +03:00
alexey-milovidov
edede563c9
Merge pull request #7747 from hczhcz/patch-1113 
Fix empty array handling in arraySplit
 2019-12-03 04:00:31 +03:00
Alexey Milovidov
d70b73f033 Merge branch 's3auth' of https://github.com/excitoon-favorites/ClickHouse into excitoon-favorites-s3auth 2019-12-03 03:06:01 +03:00
Alexey Milovidov
9d099bde8e Merge branch 'master' into fix_check_table_with_empty_pk 2019-12-03 02:36:21 +03:00
alexey-milovidov
3355492f02
Merge pull request #7983 from ClickHouse/fix_dictionary_lifetime 
Fix bug with minimal dictionary lifetime equals zero
 2019-12-03 02:32:38 +03:00
Alexey Milovidov
166e9e414c Fixed bad test 2019-12-03 02:26:15 +03:00
Alexey Milovidov
07d7fd413f Fixed bad test 2019-12-03 02:25:08 +03:00
Alexey Milovidov
272715cb71 Merge branch 'lc_empty_part_bug' of https://github.com/filimonov/ClickHouse into filimonov-lc_empty_part_bug 2019-12-03 01:58:41 +03:00
alexey-milovidov
bd72b570a3
Update 01035_lc_empty_part_bug.sql 2019-12-03 01:56:37 +03:00
chertus
a179c5025f Merge branch 'master' into joins 2019-12-02 21:08:39 +03:00
chertus
5ce65546e9 semi & anti join 2019-12-02 21:08:04 +03:00
Mikhail Filimonov
5228f5f2eb Test case for altering to LowCardinality when data part is empty 2019-12-02 16:11:28 +01:00
alesapin
7410d17892 Fix bug with minimal dictionary lifetime equals zero 2019-12-02 16:05:43 +03:00
Vitaly Baranov
b2685a3710
Merge pull request #7727 from kekekekule/master 
Added lifetime to system.dictionaries #6820
 2019-12-02 15:15:44 +03:00
alesapin
a4ca30b5fd Fix bug in check table for tables without primary key 2019-12-02 13:30:04 +03:00
alesapin
af85eb8f80
Merge pull request #7916 from azat/dict-avoid-RELOAD-on-CREATE-DATABASE 
Do not reload *all* dictionaries on CREATE DATABASE
 2019-12-02 11:50:44 +03:00
Vladimir Chebotarev
03ec61fff3 Fixed 01030_storage_s3_syntax stateless test. 2019-12-01 15:35:04 +03:00
Артем Стрельцов
95124e910a Fixed test for lifetime 2019-12-01 03:40:59 +03:00
Vasily Nemkov
70512f8289 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-30 21:49:15 +03:00
Nikolay Degterinsky
b0eabb690b Test added 2019-11-29 21:46:26 +03:00
Vladimir Chebotarev
ecaa98e4e4 Allowed to use constant TTL expressions, updated tests. 2019-11-27 13:11:17 +03:00
Vladimir Chebotarev
fa79b7cf7d Updated test checking that constant TTL expression works. 2019-11-27 13:11:17 +03:00
Nikolai Kochetov
4f79476511
Merge pull request #7929 from ClickHouse/fix-union-with-diff-columns 
Fix union with diff columns
 2019-11-26 19:40:45 +03:00
Nikita Mikhaylov
a4189b85e2 done 2019-11-26 17:57:33 +03:00
Olga Khvostikova
4d6214d33e
Merge pull request #7908 from CurtizJ/enum_conversion 
Fix enum conversion in native format for backward compatibility.
 2019-11-26 17:53:47 +03:00
Nikolai Kochetov
c161a486f1 Added test. 2019-11-26 15:07:07 +03:00
Olga Khvostikova
0f517648b1
Merge pull request #7722 from ClickHouse/java-hash-non-bmp 
Added a test of javaHashUTF16LE for non BMP code points
 2019-11-26 13:30:18 +03:00
Olga Khvostikova
47e499d71b
Merge pull request #7833 from excitoon-favorites/detachedparts 
Added disk info to `system.detached_parts`
 2019-11-26 11:56:50 +03:00
Azat Khuzhin
4530adee76 Do not reload *all* dictionaries on CREATE DATABASE 
This ignores any lifetime, while dictionaries can be quite big.

Fixes: c7cd911305 ("Merge pull request #7360")
Refs: https://github.com/ClickHouse/ClickHouse/pull/7360#discussion_r345207682
 2019-11-26 10:33:25 +03:00
alexey-milovidov
18a70ba70e
Merge pull request #7911 from ClickHouse/prewhere_alias 
Fix reading empty set with prewhere dependent on alias column.
 2019-11-26 09:38:47 +03:00
alexey-milovidov
fed4d56df8
Merge pull request #7913 from ClickHouse/prewhere_max_parallel_replicas 
Fix prewhere with max_parallel_replicas.
 2019-11-26 09:29:49 +03:00
alexey-milovidov
23f848993d
Update 01034_prewhere_max_parallel_replicas.sql 2019-11-26 09:27:25 +03:00
Nikolai Kochetov
867fded9fd Fix prewhere with max_parallel_replicas. 2019-11-25 21:29:02 +03:00
Nikolai Kochetov
f90a8cebfd Add test with remote, final and max_parallel_replicas. 2019-11-25 18:44:15 +03:00
Nikolai Kochetov
1a0f17cb2c Fix reading empty set with prewhere dependent on alias column. 2019-11-25 17:33:54 +03:00
CurtizJ
c223281d5d fix enum coversion in native format for backward compatibility 2019-11-25 17:06:44 +03:00
Nikolai Kochetov
6587a87267 Added test with sample and final. 2019-11-25 16:09:44 +03:00
Andrei Bodrov
b676a292d4 avgWeighted 2019-11-23 10:48:22 +03:00
Nikita Mikhaylov
728ede25f9
Merge pull request #7840 from apbodrov/read_write_gzip 
Gzip read/write to file/s3/url/hdfs
 2019-11-22 11:48:58 +03:00
Nikita Mikhaylov
762d295ab0
Merge pull request #7780 from ClickHouse/aku/parallel-parsing 
Merging parallel format parsing
 2019-11-22 01:54:47 +03:00
Vasily Nemkov
824b1016b8 Updated 00927_asof_join_other_types.reference 2019-11-21 07:47:15 +03:00
Alexander Tokmakov
61783e1e17 fix bytes count in PeekableReadBuffer 2019-11-21 01:04:57 +03:00
Vasily Nemkov
23e9a582f2 Fixed using DecimalX and DateTime64 with ASOF JOIN 
With tests
 2019-11-20 12:00:10 +03:00
Nikita Mikhaylov
e0e551c61d Merge branch 'master' of github.com:ClickHouse/ClickHouse into storage_set 2019-11-19 19:12:33 +03:00
Nikita Mikhaylov
02b0101fc8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into limit_with_ties 2019-11-19 18:00:16 +03:00
Nikita Mikhaylov
b9ad1fc79a better 2019-11-19 17:29:52 +03:00
Nikita Mikhaylov
37b8497747 add more tests 2019-11-19 17:28:57 +03:00
Alexander Kuzmenkov
7e5731d64e Merge remote-tracking branch 'origin/master' into HEAD 2019-11-19 16:15:47 +03:00
Andrei Bodrov
8cbc52e711 add gzip read/write to file/s3/url/hdfs 2019-11-19 15:46:07 +03:00
Mikhail Korotov
e66cd371c8 Merge branch 'hashes_from_values_of_UUID_type' of https://github.com/millb/ClickHouse into hashes_from_values_of_UUID_type 2019-11-19 14:42:20 +03:00
Mikhail Korotov
79714e7678 Merge branch 'master' into hashes_from_values_of_UUID_type 2019-11-19 14:40:59 +03:00
Vladimir Chebotarev
67d2703d30 Fixed tests to support disk name in system.detached_parts. 2019-11-19 14:29:52 +03:00
alexey-milovidov
3735a7e210
Merge pull request #7758 from 4ertus2/ast 
Check if table has qualified column
 2019-11-18 01:37:48 +03:00
alexey-milovidov
4dd66385b5
Merge pull request #7789 from zhang2014/fix/ISSUES-7784 
ISSUES-7784 disabled predicate optimize for WITH FILL expression
 2019-11-17 23:36:42 +03:00
Nikolai Kochetov
5cc14e6d66
Merge pull request #7777 from ClickHouse/fix-array-intersect-overflow 
Fix array intersect overflow
 2019-11-16 18:43:16 +03:00
zhang2014
15b20e0b96 ISSUES-7784 disabled predicate optimize for WITH FILL expression 2019-11-15 22:10:36 +08:00
Nikita Mikhaylov
797820a993
empty commit 2019-11-15 15:44:09 +03:00
Nikita Mikhaylov
b380f8d53c bug test added 2019-11-15 14:30:19 +03:00
Alexander Kuzmenkov
7f34c0089c Merge remote-tracking branch 'origin/master' into HEAD 2019-11-14 18:53:36 +03:00
Nikolai Kochetov
fa6ec1a39d Update tests. 2019-11-14 16:40:07 +03:00
chertus
8286bbf913 Merge branch 'master' into joins 2019-11-14 16:16:52 +03:00
Mikhail Korotov
df3310e670
Update 01032_cityHash64_for_decimal.sql 2019-11-13 18:18:01 +03:00
Mikhail Korotov
96c0392b3f
Update 01032_cityHash64_for_UUID.sql 2019-11-13 18:17:42 +03:00
Mikhail Korotov
2e0af1a8a6 Added tests 2019-11-13 18:16:26 +03:00
chertus
d70904d7ee better column to table matching: check if table has qualified column 2019-11-13 18:00:21 +03:00
CurtizJ
f6b601cb9c fix order by with pk optimization 2019-11-13 17:57:45 +03:00
Nikita Mikhaylov
7c33041fad added usage top n and limit by together 2019-11-13 17:26:51 +03:00
Nikita Mikhaylov
c8bfa6db59 done 2019-11-13 15:43:55 +03:00
hcz
08f8bbf52e Update tests 2019-11-13 11:00:08 +08:00
chertus
a8a283ffdc add missing array functions for Decimals 2019-11-11 23:46:36 +03:00
Alexey Milovidov
7cd8831eb8 Added a test of javaHashUTF16LE for non BMP code points 2019-11-11 21:55:53 +03:00
Nikolai Kochetov
28b195a0f1
Merge pull request #7672 from ClickHouse/processors-4-tmp 
Processors 4
 2019-11-11 21:22:06 +03:00
chertus
8321deefac Merge branch 'master' into joins 2019-11-11 20:54:45 +03:00
chertus
03933a1039 gather utils for Decimals (no scale checks) 2019-11-11 19:18:37 +03:00
alesapin
c71e874a8c
Merge pull request #7709 from ClickHouse/fix_storage_odbc_parsing 
Fix use of destroyed variable captured in lambda for storage XDBC
 2019-11-11 15:39:54 +03:00
Alexey Milovidov
013435bded Updated test #7703 2019-11-11 11:55:07 +03:00
alesapin
c74538153f Fix use of destroyed variable captured in lambda 2019-11-11 11:40:00 +03:00
Vasily Nemkov
07041d45c9 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-11 09:19:13 +03:00
Vasily Nemkov
96809d0c77 Fixed test to not fail under UB-sanitizer + extra negative test case for toDateTime64 2019-11-11 08:34:33 +03:00
Alexey Milovidov
f47415b7fa Allowed non-constant negative "size" argument for function "substring" 2019-11-11 04:45:03 +03:00
Nikolai Kochetov
86894c9570 Updated test. 2019-11-09 00:37:33 +03:00
Nikolai Kochetov
032e8c8aff Try fix test. 2019-11-08 20:44:55 +03:00
chertus
ac1b6f71ca update tests 2019-11-08 13:49:14 +03:00
alesapin
40a5cf4bb9 Forbidden to use column name more than once in insert query. 2019-11-08 12:57:32 +03:00
alexey-milovidov
0fefebae1b
Merge pull request #7518 from sundy-li/improve_range 
Improve range
 2019-11-08 00:59:05 +03:00
alexey-milovidov
034d6ce729
Merge pull request #7355 from millb/decimal_hex_function 
Decimal hex function
 2019-11-08 00:56:59 +03:00
alexey-milovidov
7f01fd13b3
Merge pull request #7624 from azat/_shard_num 
[RFC] Add _shard_num virtual column for the Distributed engine
 2019-11-08 00:55:41 +03:00
chertus
b8d464aa03 new consistent ANY JOIN (LEFT, INNER, RIGHT) 2019-11-08 00:32:44 +03:00
Vasily Nemkov
93afa6f2f3 Fixed 00921_datetime64_compatibility.python test case 
Running it correctly so test runner does not report failure on intended exceptions.
 2019-11-07 13:59:34 +03:00
alesapin
4f6fa013e5 Merge branch 'master' into fix_scope_of_interpreter_select_query_in_mutations 2019-11-07 11:18:35 +03:00
alesapin
8152fc3c15
Merge pull request #7601 from azat/view-query-sigsegv 
Fix scope of the InterpreterSelectQuery for views with query
 2019-11-07 11:07:28 +03:00
alexey-milovidov
31aff291e6
Merge pull request #7651 from achimbab/javaHashUTF16LE 
Implemented javaHashUTF16LE()
 2019-11-06 22:58:48 +03:00
Azat Khuzhin
0677ae048c Wrap _shard_num with toUInt32 for simpler JOIN with system.clusters.shard_num 2019-11-06 21:02:42 +03:00
Azat Khuzhin
f58f1517e0 Regression test for InterpreterSelectQuery scope in PushingToViewsBlockOutputStream 
It is too complex, so I'm not sure that it is worth it.
 2019-11-06 20:39:23 +03:00
alesapin
8c7deaa70d More safier, but still ugly mutations interpreter 2019-11-06 20:28:03 +03:00
Nikita Mikhaylov
5a399c78dc better 2019-11-06 17:18:28 +03:00
Mikhail Korotov
29747b5511 Merge branch 'decimal_hex_function' of https://github.com/millb/ClickHouse into decimal_hex_function 2019-11-06 16:11:27 +03:00
Azat Khuzhin
81aeff2d2a Add _shard_num virtual column for the Distributed engine 
With JOIN from system.clusters one can figure out from which server data
came.

TODO:
- optimization to avoid communicating with unrelated shards (for queries
  like "AND _shard_num = n")
- fix aliases (see tests with serverError expected)

v0: AddingConstColumnBlockInputStream
v2: VirtualColumnUtils::rewriteEntityInAst
v3: fix remote(Distributed) by appending _shard_num only if has been requested
 2019-11-06 15:26:12 +03:00
philip.han
68a82f78b4 Implemented javaHashUTF16LE() 2019-11-06 19:46:37 +09:00
alexey-milovidov
33edb0929b
Merge pull request #7641 from 4ertus2/joins 
Support RIGHT | FULL JOIN with expressions in ON section
 2019-11-06 11:17:52 +03:00
millb
5c478dfe02 Merge branch 'master' into decimal_hex_function 2019-11-06 09:43:30 +03:00
alexey-milovidov
687be5f7af
Merge pull request #7618 from excitoon-favorites/looks-like-wrong-copy-paste 
Fixed exception in case of using 1 argument while defining S3, URL and HDFS storages
 2019-11-06 02:11:38 +03:00
chertus
950e95c178 support JOIN ON expression 2019-11-05 23:22:20 +03:00
alexey-milovidov
56c89349d3
Merge pull request #7639 from CurtizJ/final_mark_without_primary_key 
Fix final mark with empty primary key.
 2019-11-05 22:53:52 +03:00
alexey-milovidov
8fc84e93ff
Merge pull request #7635 from ClickHouse/fix_concat_return_data_type 
Now concat always return string column
 2019-11-05 21:39:48 +03:00
alexey-milovidov
40a8216294
Merge pull request #7625 from ClickHouse/array-compact-improve 
Improvement of arrayCompact function.
 2019-11-05 21:39:06 +03:00
alexey-milovidov
eb6add45ea
Merge pull request #7626 from ClickHouse/char-test-utf8 
Added a test for function "char" that proves that it's applicable for non-ASCII.
 2019-11-05 21:38:37 +03:00
Alexey Milovidov
c6ac30e450 Added another test case by Sundy-Li request 2019-11-05 21:38:16 +03:00
CurtizJ
c958662c6e add test for empty primaty key 2019-11-05 21:21:49 +03:00
Nikita Mikhaylov
424d2234c8 test 2019-11-05 20:38:06 +03:00
Vasily Nemkov
5150a3e586 Simplified and renamed basic DateTime64 test. 2019-11-05 16:40:23 +03:00
alesapin
2d7ae27232 Now concat always return string column 2019-11-05 16:23:09 +03:00
Nikita Mikhaylov
817b52314e Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-11-05 12:32:26 +03:00
alexey-milovidov
6a871f579f
Merge pull request #7598 from infinivision/bitmap_replace 
added bitmapTransform
 2019-11-05 02:23:50 +03:00
Alexey Milovidov
4f83b56c14 Added another test case 2019-11-05 01:47:46 +03:00
Vladimir Chebotarev
8556b2cee3 Added tests to check that ClickHouse don't crash on insufficient arguments of S3, URL and HDFS storages. 2019-11-05 01:47:26 +03:00
Alexey Milovidov
0a3b7068fd Added a test for function "char" 2019-11-05 01:45:51 +03:00
alexey-milovidov
7d2a16ee39
Merge pull request #7486 from sundy-li/char_function 
functions: add char function
 2019-11-05 01:40:18 +03:00
Alexey Milovidov
92824e14e7 Added a test 2019-11-05 01:18:59 +03:00
alexey-milovidov
fbed472018
Update 00076_ip_coding_functions.sql 2019-11-05 00:53:35 +03:00
Vasily Nemkov
c6eb0fcff7 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-04 17:06:22 +03:00
alexey-milovidov
81e33ca817
Merge pull request #7586 from 4ertus2/joins 
Rewrite NonJoinedBlockInputStream
 2019-11-04 14:49:47 +03:00
Zhichang Yu
da2d05802c added bitmapTransform 2019-11-04 14:55:31 +08:00
alexey-milovidov
a8d6843723
Merge pull request #7599 from azat/__getScalar-fix 
Check column for __getScalar() (avoids assertion)
 2019-11-04 02:28:42 +03:00
Azat Khuzhin
920572915e Add regression test for the __getScalar() 2019-11-04 00:31:10 +03:00
alexey-milovidov
d9c02b652f
Merge pull request #7594 from amosbird/fix20 
early constant folding improvement
 2019-11-04 00:30:16 +03:00
chertus
d4e1468022 fix Join.saved_block_sample columns' nullability 2019-11-03 22:33:59 +03:00
Amos Bird
f0b3c1f7c7
early constant folding improvement 2019-11-03 21:17:46 +08:00
alexey-milovidov
d08bfbd3e1
Merge pull request #7328 from Joeywzr/arrayCompact 
implement arrayCompact
 2019-11-03 01:07:19 +03:00
alexey-milovidov
fa0274e223
Merge pull request #7380 from hczhcz/patch-1018 
Add function arrayFill and arrayReverseFill
 2019-11-03 01:06:41 +03:00
alexey-milovidov
dea9220e3c
Merge pull request #7542 from hczhcz/patch-1030 
Fix "create as select" parsing
 2019-11-02 00:58:09 +03:00
alexey-milovidov
ad01f7b1ac
Merge pull request #7552 from azat/do-not-account-memory-for-Buffer-in-max_memory_usage 
[RFC] Do not account memory for Buffer engine in max_memory_usage limit
 2019-11-02 00:57:24 +03:00
alexey-milovidov
dda93e2275
Merge pull request #7561 from ClickHouse/achimbab-master 
Merge for #7363
 2019-11-02 00:57:13 +03:00