thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-24 00:22:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
33,758 Commits 9,167 Branches 1,781 Tags 2.1 GiB
cffca47129
Commit Graph

4464 Commits

Author SHA1 Message Date
alesapin
af7b8f9274
Merge pull request #8051 from ClickHouse/fix_collations_behaviour 
Fix several bugs with collations.
 2019-12-08 11:10:23 +03:00
alesapin
5b828a6cbf Better test 2019-12-07 01:25:14 +03:00
alesapin
3881a85c39 Review fixes 2019-12-07 01:22:12 +03:00
Mikhail Korotov
f63fe65e53 Simple tests added 2019-12-06 20:23:41 +03:00
Mikhail Korotov
cb05dee547 Merge branch 'master' into hashes_from_values_of_UUID_type 2019-12-06 18:24:41 +03:00
Vitaliy Zakaznikov
f7b4768642 Adding more live view tests. 2019-12-06 15:19:21 +01:00
Vitaliy Zakaznikov
191afb11b0 Fixing dbms/tests/queries/0_stateless/00973_live_view_with_subquery_select_join.sql 2019-12-06 14:01:17 +01:00
Vitaliy Zakaznikov
16d6674c00 Adding test case from https://github.com/ClickHouse/ClickHouse/issues/7773. 2019-12-06 13:57:28 +01:00
Vitaliy Zakaznikov
590a1f7b87 Updating tests to use a column alias in addition to the table alias. 2019-12-06 13:34:52 +01:00
Vitaliy Zakaznikov
435ce84939 Setting table alias when replacing subquery with a table. 
Adding extra tests that use table aliases.
 2019-12-06 13:31:08 +01:00
Nikita Mikhaylov
34d20a0ef4
updating test after resolving conflicts 2019-12-06 13:17:51 +03:00
Nikita Mikhaylov
6fc5248a27
Merge branch 'master' into limit_with_ties 2019-12-06 13:16:54 +03:00
alesapin
de6cd490ef
Merge pull request #8037 from vitlibar/system-reload-dictionary-causes-complete-reloading 
SYSTEM RELOAD DICTIONARY reloads a dictionary completely
 2019-12-06 12:55:41 +03:00
Vitaly Baranov
2133492598
Merge pull request #7257 from vitlibar/RBAC-2 
RBAC-2
 2019-12-06 03:19:39 +03:00
Vitaliy Zakaznikov
32fe9ea9d5 Fixing issue with support for nested subqueries. 
Adding additional live view with subquery tests.
 2019-12-05 22:42:00 +01:00
Nikita Mikhaylov
88027947a1
update test after resolving conflicts 2019-12-05 21:59:30 +03:00
Nikita Mikhaylov
4946409a78
Merge branch 'master' into limit_with_ties 2019-12-05 21:58:47 +03:00
Nikita Mikhaylov
de2d996063
Merge pull request #7786 from nikitamikhaylov/incorrect_count 
Incorrect count() with condition query result for SummingMergeTree.
 2019-12-05 21:56:54 +03:00
Nikita Mikhaylov
5e60e0661f
delete useless reference 2019-12-05 21:54:18 +03:00
Nikita Mikhaylov
826a675974
delete useless reference 2019-12-05 21:53:44 +03:00
Nikita Mikhaylov
7783475aaa
delete useless test 2019-12-05 21:53:26 +03:00
alesapin
6afafef86c
Merge pull request #8047 from ClickHouse/fix_check_query_again 
Fix bug in checkDataPart
 2019-12-05 21:31:36 +03:00
Vitaly Baranov
6306e2ab91 Add DCL to manage quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
4d784d6f44 Add test. 2019-12-05 20:07:33 +03:00
alesapin
772bb0b70b Fix collation locales 2019-12-05 18:35:09 +03:00
alesapin
227d0ba9d6 Add one more test 2019-12-05 15:39:02 +03:00
alesapin
cd43debd79 Test with non adaptive parts 2019-12-05 15:18:18 +03:00
alesapin
ee46a73d25 Fix bug in checkDataPart when last granule has same number of rows as in .mrk file 2019-12-05 15:01:36 +03:00
Vitaliy Zakaznikov
e20793b2dc Merge remote-tracking branch 'origin/master' into live_view_support_for_subquery 2019-12-05 06:54:04 -05:00
Nikolai Kochetov
26e415736a
Merge pull request #7665 from 4ertus2/joins 
New ANY, SEMI, ANTI JOIN (HashJoin only)
 2019-12-05 14:38:20 +03:00
Mikhail Korotov
88e37020e0 JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes (#7841) 
* Research commit

* Created Output EachRow Format

* Fixed bugs

* Created output format JSONCompactEachRowWithNamesAndTypes without totals

* Fixed bugs

* Fixed bugs

* Totals for JSONCompactEachRowWithNamesAndTypes

* Deleted needless debug

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Tests added

* Input Format for JSONCompactEachRow

* Fixed bugs for JSONCompactEachRow Input format

* Fixed bugs for JSONCompactEachRowRowInputFormat.cpp

* JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes united

* Created input format for both formats

* fixed bugs

* fixed bugs

* Working commit

* Working commit

* Working commit

* Working commit

* tests

* Working commit

* Final tests

* Performance tests added
 2019-12-05 13:13:40 +03:00
Nikita Mikhaylov
a3f3a333e2 better test 2019-12-05 12:55:06 +03:00
Nikita Mikhaylov
9d005d1565 true changes 2019-12-05 12:50:42 +03:00
Vitaly Baranov
2cc78413ed
Merge pull request #7914 from azat/dist-send-extra-checksum 
Add checksum for extra info/query in distributed sends
 2019-12-05 11:43:08 +03:00
alesapin
a524e82a7f
Merge pull request #8029 from ClickHouse/fix_dict_partially_update_failover 
Fix external dictionaries failover, when they have invalidate_query.
 2019-12-05 11:12:17 +03:00
chertus
d3d2e39955 fix SEMI RIGHT JOIN 2019-12-04 23:23:07 +03:00
Azat Khuzhin
3a72e1c12a Add checksum for extra info/query in distributed sends 
This extras includes:
- server revision
- query settings
- query

Otherwise the code can try to interpret data, and got for instance
std::length_error exception, which is not catched (to mark the part as
broken). Also this will protect from the corruptions on disk.

And add a simple test, since dbms/tests/integration/test_insert_into_distributed too complex.

Also simplify the code by using readStringBinary() over
readVarUInt()+b.readStrict() (this also gains additional checks that
string is not bigger then 1GB).

Refs: #4852 (8ef7f3589a)
v2: avoid ABI breakage (suggested by @vitlibar)
v3: minor code fixes (suggested by @vitlibar) and as a consequence clang-8 build fix
v4: drop DBMS_MIN_REVISION_WITH_EXTRAS_CHECKSUM_IN_DIST_BATCH and also
    revert some renames to make the patch cleaner
 2019-12-04 22:54:38 +03:00
alesapin
172bbb1a2f Fix flappy test, because dictionaries are loaded lazily 2019-12-04 21:30:47 +03:00
alesapin
3128b62f0e Create dictionary if not exists 2019-12-04 18:11:36 +03:00
alesapin
a41764cccc Reload dictionary with invalidate query if it has exception 2019-12-04 17:45:56 +03:00
alesapin
ce05cea192 Add sleep for test 2019-12-04 17:22:49 +03:00
alesapin
711fb5e667 Added tests for external dictionary invalidate query failover 2019-12-04 16:53:05 +03:00
alesapin
ace44e0717 Add test for incorrect settings 2019-12-04 12:34:05 +03:00
alexey-milovidov
f09c29a2b6
Merge pull request #7992 from ClickHouse/excitoon-favorites-s3auth 
Merging #7623
 2019-12-03 15:21:12 +03:00
alexey-milovidov
0c904f1484
Merge pull request #7721 from 4ertus2/decimal 
Basic GatherUtils support for Decimals
 2019-12-03 05:15:38 +03:00
alexey-milovidov
0734d4695b
Merge pull request #7724 from 4ertus2/some 
Missing array functions for Decimals
 2019-12-03 05:14:33 +03:00
alexey-milovidov
812df3aef3
Merge pull request #7755 from nikitamikhaylov/storage_set 
Using the Set engine happen Exception: Method read is not supported by storage Set
 2019-12-03 05:09:47 +03:00
alexey-milovidov
f1d75d9722
Update 01030_storage_set_supports_read.sql 2019-12-03 05:09:33 +03:00
Alexey Milovidov
0da80b3c7b Merge branch 'master' of github.com:yandex/ClickHouse into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 04:35:42 +03:00
alexey-milovidov
f5e88f8cd5
Merge pull request #7307 from ClickHouse/new-branch-for-new-geodist 
Speed up greatCircleDistance function with test
 2019-12-03 04:34:35 +03:00
Alexey Milovidov
eef44d3fc5 Merge branch 'master' into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 04:31:08 +03:00
alexey-milovidov
edede563c9
Merge pull request #7747 from hczhcz/patch-1113 
Fix empty array handling in arraySplit
 2019-12-03 04:00:31 +03:00
Alexey Milovidov
d70b73f033 Merge branch 's3auth' of https://github.com/excitoon-favorites/ClickHouse into excitoon-favorites-s3auth 2019-12-03 03:06:01 +03:00
Alexey Milovidov
9d099bde8e Merge branch 'master' into fix_check_table_with_empty_pk 2019-12-03 02:36:21 +03:00
alexey-milovidov
3355492f02
Merge pull request #7983 from ClickHouse/fix_dictionary_lifetime 
Fix bug with minimal dictionary lifetime equals zero
 2019-12-03 02:32:38 +03:00
Alexey Milovidov
166e9e414c Fixed bad test 2019-12-03 02:26:15 +03:00
Alexey Milovidov
07d7fd413f Fixed bad test 2019-12-03 02:25:08 +03:00
Alexey Milovidov
272715cb71 Merge branch 'lc_empty_part_bug' of https://github.com/filimonov/ClickHouse into filimonov-lc_empty_part_bug 2019-12-03 01:58:41 +03:00
alexey-milovidov
bd72b570a3
Update 01035_lc_empty_part_bug.sql 2019-12-03 01:56:37 +03:00
Alexey Milovidov
034ef665f1 Merge branch 'master' of github.com:yandex/ClickHouse into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 00:36:31 +03:00
chertus
a179c5025f Merge branch 'master' into joins 2019-12-02 21:08:39 +03:00
chertus
5ce65546e9 semi & anti join 2019-12-02 21:08:04 +03:00
Mikhail Filimonov
5228f5f2eb Test case for altering to LowCardinality when data part is empty 2019-12-02 16:11:28 +01:00
alesapin
7410d17892 Fix bug with minimal dictionary lifetime equals zero 2019-12-02 16:05:43 +03:00
Vitaly Baranov
b2685a3710
Merge pull request #7727 from kekekekule/master 
Added lifetime to system.dictionaries #6820
 2019-12-02 15:15:44 +03:00
alesapin
a4ca30b5fd Fix bug in check table for tables without primary key 2019-12-02 13:30:04 +03:00
alesapin
af85eb8f80
Merge pull request #7916 from azat/dict-avoid-RELOAD-on-CREATE-DATABASE 
Do not reload *all* dictionaries on CREATE DATABASE
 2019-12-02 11:50:44 +03:00
Vladimir Chebotarev
03ec61fff3 Fixed 01030_storage_s3_syntax stateless test. 2019-12-01 15:35:04 +03:00
Артем Стрельцов
95124e910a Fixed test for lifetime 2019-12-01 03:40:59 +03:00
Alexey Milovidov
8916b8f2e6 Make data skipping indices non-experimental. Make settings about data skipping indices, multiple JOINs and CROSS to INNER JOIN conversion obsolete, 2019-11-30 23:41:02 +03:00
Vasily Nemkov
70512f8289 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-30 21:49:15 +03:00
Nikolay Degterinsky
b0eabb690b Test added 2019-11-29 21:46:26 +03:00
Vladimir Chebotarev
ecaa98e4e4 Allowed to use constant TTL expressions, updated tests. 2019-11-27 13:11:17 +03:00
Vladimir Chebotarev
fa79b7cf7d Updated test checking that constant TTL expression works. 2019-11-27 13:11:17 +03:00
Nikolai Kochetov
4f79476511
Merge pull request #7929 from ClickHouse/fix-union-with-diff-columns 
Fix union with diff columns
 2019-11-26 19:40:45 +03:00
Nikita Mikhaylov
a4189b85e2 done 2019-11-26 17:57:33 +03:00
Olga Khvostikova
4d6214d33e
Merge pull request #7908 from CurtizJ/enum_conversion 
Fix enum conversion in native format for backward compatibility.
 2019-11-26 17:53:47 +03:00
Nikolai Kochetov
c161a486f1 Added test. 2019-11-26 15:07:07 +03:00
Olga Khvostikova
0f517648b1
Merge pull request #7722 from ClickHouse/java-hash-non-bmp 
Added a test of javaHashUTF16LE for non BMP code points
 2019-11-26 13:30:18 +03:00
Olga Khvostikova
47e499d71b
Merge pull request #7833 from excitoon-favorites/detachedparts 
Added disk info to `system.detached_parts`
 2019-11-26 11:56:50 +03:00
Azat Khuzhin
4530adee76 Do not reload *all* dictionaries on CREATE DATABASE 
This ignores any lifetime, while dictionaries can be quite big.

Fixes: c7cd911305 ("Merge pull request #7360")
Refs: https://github.com/ClickHouse/ClickHouse/pull/7360#discussion_r345207682
 2019-11-26 10:33:25 +03:00
alexey-milovidov
18a70ba70e
Merge pull request #7911 from ClickHouse/prewhere_alias 
Fix reading empty set with prewhere dependent on alias column.
 2019-11-26 09:38:47 +03:00
alexey-milovidov
fed4d56df8
Merge pull request #7913 from ClickHouse/prewhere_max_parallel_replicas 
Fix prewhere with max_parallel_replicas.
 2019-11-26 09:29:49 +03:00
alexey-milovidov
23f848993d
Update 01034_prewhere_max_parallel_replicas.sql 2019-11-26 09:27:25 +03:00
Nikolai Kochetov
867fded9fd Fix prewhere with max_parallel_replicas. 2019-11-25 21:29:02 +03:00
Nikolai Kochetov
f90a8cebfd Add test with remote, final and max_parallel_replicas. 2019-11-25 18:44:15 +03:00
Nikolai Kochetov
1a0f17cb2c Fix reading empty set with prewhere dependent on alias column. 2019-11-25 17:33:54 +03:00
CurtizJ
c223281d5d fix enum coversion in native format for backward compatibility 2019-11-25 17:06:44 +03:00
Nikolai Kochetov
6587a87267 Added test with sample and final. 2019-11-25 16:09:44 +03:00
Andrei Bodrov
b676a292d4 avgWeighted 2019-11-23 10:48:22 +03:00
Nikita Mikhaylov
728ede25f9
Merge pull request #7840 from apbodrov/read_write_gzip 
Gzip read/write to file/s3/url/hdfs
 2019-11-22 11:48:58 +03:00
Nikita Mikhaylov
762d295ab0
Merge pull request #7780 from ClickHouse/aku/parallel-parsing 
Merging parallel format parsing
 2019-11-22 01:54:47 +03:00
Vasily Nemkov
824b1016b8 Updated 00927_asof_join_other_types.reference 2019-11-21 07:47:15 +03:00
Alexander Tokmakov
61783e1e17 fix bytes count in PeekableReadBuffer 2019-11-21 01:04:57 +03:00
Vasily Nemkov
23e9a582f2 Fixed using DecimalX and DateTime64 with ASOF JOIN 
With tests
 2019-11-20 12:00:10 +03:00
Nikita Mikhaylov
e0e551c61d Merge branch 'master' of github.com:ClickHouse/ClickHouse into storage_set 2019-11-19 19:12:33 +03:00
Nikita Mikhaylov
02b0101fc8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into limit_with_ties 2019-11-19 18:00:16 +03:00
Nikita Mikhaylov
b9ad1fc79a better 2019-11-19 17:29:52 +03:00
Nikita Mikhaylov
37b8497747 add more tests 2019-11-19 17:28:57 +03:00
Alexander Kuzmenkov
7e5731d64e Merge remote-tracking branch 'origin/master' into HEAD 2019-11-19 16:15:47 +03:00
Andrei Bodrov
8cbc52e711 add gzip read/write to file/s3/url/hdfs 2019-11-19 15:46:07 +03:00
Mikhail Korotov
e66cd371c8 Merge branch 'hashes_from_values_of_UUID_type' of https://github.com/millb/ClickHouse into hashes_from_values_of_UUID_type 2019-11-19 14:42:20 +03:00
Mikhail Korotov
79714e7678 Merge branch 'master' into hashes_from_values_of_UUID_type 2019-11-19 14:40:59 +03:00
Vladimir Chebotarev
67d2703d30 Fixed tests to support disk name in system.detached_parts. 2019-11-19 14:29:52 +03:00
Amos Bird
9af0c00053
Optimize PREWHERE 
So that it's never worse than WHERE.
 2019-11-18 22:59:03 +08:00
alexey-milovidov
3735a7e210
Merge pull request #7758 from 4ertus2/ast 
Check if table has qualified column
 2019-11-18 01:37:48 +03:00
alexey-milovidov
4dd66385b5
Merge pull request #7789 from zhang2014/fix/ISSUES-7784 
ISSUES-7784 disabled predicate optimize for WITH FILL expression
 2019-11-17 23:36:42 +03:00
Nikolai Kochetov
5cc14e6d66
Merge pull request #7777 from ClickHouse/fix-array-intersect-overflow 
Fix array intersect overflow
 2019-11-16 18:43:16 +03:00
Vitaliy Zakaznikov
b05c009d77 Adding a simple test for LV with a subquery. 2019-11-15 15:50:57 +01:00
zhang2014
15b20e0b96 ISSUES-7784 disabled predicate optimize for WITH FILL expression 2019-11-15 22:10:36 +08:00
Nikita Mikhaylov
797820a993
empty commit 2019-11-15 15:44:09 +03:00
Nikita Mikhaylov
b380f8d53c bug test added 2019-11-15 14:30:19 +03:00
Alexander Kuzmenkov
7f34c0089c Merge remote-tracking branch 'origin/master' into HEAD 2019-11-14 18:53:36 +03:00
Nikolai Kochetov
fa6ec1a39d Update tests. 2019-11-14 16:40:07 +03:00
chertus
8286bbf913 Merge branch 'master' into joins 2019-11-14 16:16:52 +03:00
Mikhail Korotov
df3310e670
Update 01032_cityHash64_for_decimal.sql 2019-11-13 18:18:01 +03:00
Mikhail Korotov
96c0392b3f
Update 01032_cityHash64_for_UUID.sql 2019-11-13 18:17:42 +03:00
Mikhail Korotov
2e0af1a8a6 Added tests 2019-11-13 18:16:26 +03:00
chertus
d70904d7ee better column to table matching: check if table has qualified column 2019-11-13 18:00:21 +03:00
CurtizJ
f6b601cb9c fix order by with pk optimization 2019-11-13 17:57:45 +03:00
Nikita Mikhaylov
7c33041fad added usage top n and limit by together 2019-11-13 17:26:51 +03:00
Nikita Mikhaylov
c8bfa6db59 done 2019-11-13 15:43:55 +03:00
hcz
08f8bbf52e Update tests 2019-11-13 11:00:08 +08:00
chertus
a8a283ffdc add missing array functions for Decimals 2019-11-11 23:46:36 +03:00
Alexey Milovidov
7cd8831eb8 Added a test of javaHashUTF16LE for non BMP code points 2019-11-11 21:55:53 +03:00
Nikolai Kochetov
28b195a0f1
Merge pull request #7672 from ClickHouse/processors-4-tmp 
Processors 4
 2019-11-11 21:22:06 +03:00
chertus
8321deefac Merge branch 'master' into joins 2019-11-11 20:54:45 +03:00
chertus
03933a1039 gather utils for Decimals (no scale checks) 2019-11-11 19:18:37 +03:00
alesapin
c71e874a8c
Merge pull request #7709 from ClickHouse/fix_storage_odbc_parsing 
Fix use of destroyed variable captured in lambda for storage XDBC
 2019-11-11 15:39:54 +03:00
Alexey Milovidov
013435bded Updated test #7703 2019-11-11 11:55:07 +03:00
alesapin
c74538153f Fix use of destroyed variable captured in lambda 2019-11-11 11:40:00 +03:00
Vasily Nemkov
07041d45c9 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-11 09:19:13 +03:00
Vasily Nemkov
96809d0c77 Fixed test to not fail under UB-sanitizer + extra negative test case for toDateTime64 2019-11-11 08:34:33 +03:00
Alexey Milovidov
f47415b7fa Allowed non-constant negative "size" argument for function "substring" 2019-11-11 04:45:03 +03:00
Nikolai Kochetov
86894c9570 Updated test. 2019-11-09 00:37:33 +03:00
Nikolai Kochetov
032e8c8aff Try fix test. 2019-11-08 20:44:55 +03:00
chertus
ac1b6f71ca update tests 2019-11-08 13:49:14 +03:00
alesapin
40a5cf4bb9 Forbidden to use column name more than once in insert query. 2019-11-08 12:57:32 +03:00
alexey-milovidov
0fefebae1b
Merge pull request #7518 from sundy-li/improve_range 
Improve range
 2019-11-08 00:59:05 +03:00
alexey-milovidov
034d6ce729
Merge pull request #7355 from millb/decimal_hex_function 
Decimal hex function
 2019-11-08 00:56:59 +03:00
alexey-milovidov
7f01fd13b3
Merge pull request #7624 from azat/_shard_num 
[RFC] Add _shard_num virtual column for the Distributed engine
 2019-11-08 00:55:41 +03:00
alexey-milovidov
a2e79cc427
Merge pull request #7574 from ClickHouse/processors-4 
Fix tests for processors
 2019-11-08 00:46:30 +03:00
chertus
b8d464aa03 new consistent ANY JOIN (LEFT, INNER, RIGHT) 2019-11-08 00:32:44 +03:00
Vasily Nemkov
93afa6f2f3 Fixed 00921_datetime64_compatibility.python test case 
Running it correctly so test runner does not report failure on intended exceptions.
 2019-11-07 13:59:34 +03:00
alesapin
4f6fa013e5 Merge branch 'master' into fix_scope_of_interpreter_select_query_in_mutations 2019-11-07 11:18:35 +03:00
alesapin
8152fc3c15
Merge pull request #7601 from azat/view-query-sigsegv 
Fix scope of the InterpreterSelectQuery for views with query
 2019-11-07 11:07:28 +03:00
alexey-milovidov
31aff291e6
Merge pull request #7651 from achimbab/javaHashUTF16LE 
Implemented javaHashUTF16LE()
 2019-11-06 22:58:48 +03:00
Nikolai Kochetov
da07018a1a Update memory limit for external aggregation test. 2019-11-06 21:11:06 +03:00
Azat Khuzhin
0677ae048c Wrap _shard_num with toUInt32 for simpler JOIN with system.clusters.shard_num 2019-11-06 21:02:42 +03:00
Azat Khuzhin
f58f1517e0 Regression test for InterpreterSelectQuery scope in PushingToViewsBlockOutputStream 
It is too complex, so I'm not sure that it is worth it.
 2019-11-06 20:39:23 +03:00
alesapin
8c7deaa70d More safier, but still ugly mutations interpreter 2019-11-06 20:28:03 +03:00
Nikolai Kochetov
3f8cc216a8 Update memory limit for external aggregation test. 2019-11-06 19:50:19 +03:00
Nikita Mikhaylov
5a399c78dc better 2019-11-06 17:18:28 +03:00
Mikhail Korotov
29747b5511 Merge branch 'decimal_hex_function' of https://github.com/millb/ClickHouse into decimal_hex_function 2019-11-06 16:11:27 +03:00
Azat Khuzhin
81aeff2d2a Add _shard_num virtual column for the Distributed engine 
With JOIN from system.clusters one can figure out from which server data
came.

TODO:
- optimization to avoid communicating with unrelated shards (for queries
  like "AND _shard_num = n")
- fix aliases (see tests with serverError expected)

v0: AddingConstColumnBlockInputStream
v2: VirtualColumnUtils::rewriteEntityInAst
v3: fix remote(Distributed) by appending _shard_num only if has been requested
 2019-11-06 15:26:12 +03:00
philip.han
68a82f78b4 Implemented javaHashUTF16LE() 2019-11-06 19:46:37 +09:00
alexey-milovidov
33edb0929b
Merge pull request #7641 from 4ertus2/joins 
Support RIGHT | FULL JOIN with expressions in ON section
 2019-11-06 11:17:52 +03:00
millb
5c478dfe02 Merge branch 'master' into decimal_hex_function 2019-11-06 09:43:30 +03:00
alexey-milovidov
687be5f7af
Merge pull request #7618 from excitoon-favorites/looks-like-wrong-copy-paste 
Fixed exception in case of using 1 argument while defining S3, URL and HDFS storages
 2019-11-06 02:11:38 +03:00
chertus
950e95c178 support JOIN ON expression 2019-11-05 23:22:20 +03:00
alexey-milovidov
56c89349d3
Merge pull request #7639 from CurtizJ/final_mark_without_primary_key 
Fix final mark with empty primary key.
 2019-11-05 22:53:52 +03:00
alexey-milovidov
8fc84e93ff
Merge pull request #7635 from ClickHouse/fix_concat_return_data_type 
Now concat always return string column
 2019-11-05 21:39:48 +03:00
alexey-milovidov
40a8216294
Merge pull request #7625 from ClickHouse/array-compact-improve 
Improvement of arrayCompact function.
 2019-11-05 21:39:06 +03:00
alexey-milovidov
eb6add45ea
Merge pull request #7626 from ClickHouse/char-test-utf8 
Added a test for function "char" that proves that it's applicable for non-ASCII.
 2019-11-05 21:38:37 +03:00
Alexey Milovidov
c6ac30e450 Added another test case by Sundy-Li request 2019-11-05 21:38:16 +03:00
CurtizJ
c958662c6e add test for empty primaty key 2019-11-05 21:21:49 +03:00
Nikita Mikhaylov
424d2234c8 test 2019-11-05 20:38:06 +03:00
Vasily Nemkov
5150a3e586 Simplified and renamed basic DateTime64 test. 2019-11-05 16:40:23 +03:00
alesapin
2d7ae27232 Now concat always return string column 2019-11-05 16:23:09 +03:00
Nikita Mikhaylov
817b52314e Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-11-05 12:32:26 +03:00
alexey-milovidov
6a871f579f
Merge pull request #7598 from infinivision/bitmap_replace 
added bitmapTransform
 2019-11-05 02:23:50 +03:00
Alexey Milovidov
4f83b56c14 Added another test case 2019-11-05 01:47:46 +03:00
Vladimir Chebotarev
8556b2cee3 Added tests to check that ClickHouse don't crash on insufficient arguments of S3, URL and HDFS storages. 2019-11-05 01:47:26 +03:00
Alexey Milovidov
0a3b7068fd Added a test for function "char" 2019-11-05 01:45:51 +03:00
alexey-milovidov
7d2a16ee39
Merge pull request #7486 from sundy-li/char_function 
functions: add char function
 2019-11-05 01:40:18 +03:00
Alexey Milovidov
92824e14e7 Added a test 2019-11-05 01:18:59 +03:00
alexey-milovidov
fbed472018
Update 00076_ip_coding_functions.sql 2019-11-05 00:53:35 +03:00
Vasily Nemkov
c6eb0fcff7 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-04 17:06:22 +03:00
alexey-milovidov
81e33ca817
Merge pull request #7586 from 4ertus2/joins 
Rewrite NonJoinedBlockInputStream
 2019-11-04 14:49:47 +03:00
Zhichang Yu
da2d05802c added bitmapTransform 2019-11-04 14:55:31 +08:00
alexey-milovidov
a8d6843723
Merge pull request #7599 from azat/__getScalar-fix 
Check column for __getScalar() (avoids assertion)
 2019-11-04 02:28:42 +03:00
Azat Khuzhin
920572915e Add regression test for the __getScalar() 2019-11-04 00:31:10 +03:00
alexey-milovidov
d9c02b652f
Merge pull request #7594 from amosbird/fix20 
early constant folding improvement
 2019-11-04 00:30:16 +03:00
chertus
d4e1468022 fix Join.saved_block_sample columns' nullability 2019-11-03 22:33:59 +03:00
Amos Bird
f0b3c1f7c7
early constant folding improvement 2019-11-03 21:17:46 +08:00
alexey-milovidov
d08bfbd3e1
Merge pull request #7328 from Joeywzr/arrayCompact 
implement arrayCompact
 2019-11-03 01:07:19 +03:00
alexey-milovidov
fa0274e223
Merge pull request #7380 from hczhcz/patch-1018 
Add function arrayFill and arrayReverseFill
 2019-11-03 01:06:41 +03:00
alexey-milovidov
dea9220e3c
Merge pull request #7542 from hczhcz/patch-1030 
Fix "create as select" parsing
 2019-11-02 00:58:09 +03:00
alexey-milovidov
ad01f7b1ac
Merge pull request #7552 from azat/do-not-account-memory-for-Buffer-in-max_memory_usage 
[RFC] Do not account memory for Buffer engine in max_memory_usage limit
 2019-11-02 00:57:24 +03:00
alexey-milovidov
dda93e2275
Merge pull request #7561 from ClickHouse/achimbab-master 
Merge for #7363
 2019-11-02 00:57:13 +03:00
chertus
334b91f351 revrite NonJoinedBlockInputStream (in progress) 2019-11-01 20:41:07 +03:00
alexey-milovidov
4081b0be90
Merge pull request #7497 from amosbird/countopt 
Early constant folding.
 2019-11-01 16:54:02 +03:00
Amos Bird
5333258e7e
Complement to tuple parser 2019-11-01 10:48:15 +08:00
Azat Khuzhin
dbe45800d9 Do not account memory for Buffer engine in max_memory_usage limit 
Since background flush will not be accounted there, and it can be too
tricky to calclulate this limit, in case you have multiple materialized
views with Buffer engine.

v2: test adjustment
 2019-10-31 22:26:50 +03:00
Amos Bird
e04cdd4ebb
Early constant folding. 2019-10-31 23:54:32 +08:00
Amos Bird
4aff9a20c6
Better parser 2019-10-31 23:22:48 +08:00
alexey-milovidov
417c008700
Update 01021_create_as_select.sql 2019-10-31 11:29:30 +03:00
Vasily Nemkov
947cfa6056 Simplified formatDateTime test case: removed format directives that produce '\n' and '\t' chars. 2019-10-31 11:27:48 +03:00
hcz
4c7a54113d Add tests 2019-10-31 11:33:23 +08:00
alexey-milovidov
0d2a2c332f
Merge pull request #7366 from achimbab/fixbug_inop 
Made IN operator support Array(LowCardinality(Nullable(String)))
 2019-10-31 00:26:22 +03:00
alexey-milovidov
bb75c7469a
Merge pull request #7545 from ClickHouse/fix_only_tuple_columns 
Fix only tuple columns in table.
 2019-10-30 23:34:23 +03:00
alexey-milovidov
ddb58eeb8b
Merge pull request #7510 from amosbird/smartcount 
Instant count() for MergeTree
 2019-10-30 20:42:00 +03:00
alesapin
7f4e982d13 Add tests 2019-10-30 17:51:30 +03:00
chertus
deb2406b30 fix JOIN right table keys nullability 2019-10-29 22:39:42 +03:00
Nikita Mikhaylov
08f1930e76 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-10-29 20:04:32 +03:00
Amos Bird
1eb44c6837
Add missing tests 2019-10-29 22:26:43 +08:00
Amos Bird
2c75a51d4f
Instant count() for MergeTree 
Use (Replicated)MergeTree's metadata to do trivial count()
 2019-10-29 17:45:47 +08:00
sundy-li
00389a67a0 add more tests 2019-10-29 14:55:59 +08:00
sundy-li
dbd3227e5a fixup partial const column 2019-10-29 11:51:27 +08:00
Alexander Kuzmenkov
6e2af3db41
Merge pull request #7480 from azat/crc-v3 
Add CRC32IEEE()/CRC64() support
 2019-10-28 16:16:37 +03:00
Nikita Mikhaylov
756a10707d Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-10-28 13:51:52 +03:00
sundy-li
538b77c123 functions: add char function as mysql behavior 2019-10-28 10:44:56 +08:00
Nikolai Kochetov
43c8d13de6
Merge pull request #7496 from amosbird/fix15 
Fix HAVING without GROUP BY
 2019-10-28 02:44:24 +03:00
Amos Bird
77bdfb3350
Fix HAVING without GROUP BY 2019-10-27 22:10:54 +08:00
Nikita Mikhaylov
4fe0dda453 add cancel test 2019-10-25 21:03:38 +03:00
Azat Khuzhin
2d2e738085 Add CRC32IEEE()/CRC64() support 
zlib's implementation uses CRC-32-IEEE 802.3 polynomial (0xedb88320) but
with starting value 0xffffffff, so introduce another crc32
implementation - CRC32IEEE that has starting value - 0

Also add CRC64 with ECMA polynomial.

v2: s/crc*_data./crc*_data./ to avoid conflicts with other crc32.h in contrib
v3: join with existing CRC32()
 2019-10-25 15:52:41 +03:00
Nikita Mikhaylov
60ee52cb8d remove unrelated changes in tests 2019-10-25 15:28:52 +03:00
alesapin
04ca163518 Merge branch 'master' into dictionaries_ddl_loader 2019-10-25 10:58:04 +03:00
chertus
f2028e901d review related changes 2019-10-24 16:04:50 +03:00
chertus
12cd21f3c3 Merge branch 'master' into ast 2019-10-24 15:20:09 +03:00
Vasily Nemkov
adc28a5aed CLI args to the test to filter what functions and types are checked 
with minor simplification to the test code
 2019-10-24 13:48:42 +03:00
Alexander Kuzmenkov
29052b6a37
Merge pull request #7377 from azat/INSERT-Distributed-MATERIALIZED-cols 
* Fix INSERT into Distributed non local node with MATERIALIZED columns

Previous patch e527def18a ("Fix INSERT
into Distributed() table with MATERIALIZED column") fixes it only for
cases when the node is local, i.e. direct insert.

This patch address the problem when the node is not local
(`is_local == false`), by erasing materialized columns on INSERT into
Distributed.

And this patch fixes two cases, depends on `insert_distributed_sync`
setting:

- `insert_distributed_sync=0`

    ```
    Not found column value in block. There are only columns: date. Stack trace:

    2. 0x7ffff7be92e0 DB::Exception::Exception() dbms/src/Common/Exception.h:27
    3. 0x7fffec5d6cf6 DB::Block::getByName(...) dbms/src/Core/Block.cpp:187
    4. 0x7fffec2fe067 DB::NativeBlockInputStream::readImpl() dbms/src/DataStreams/NativeBlockInputStream.cpp:159
    5. 0x7fffec2d223f DB::IBlockInputStream::read() dbms/src/DataStreams/IBlockInputStream.cpp:61
    6. 0x7ffff7c6d40d DB::TCPHandler::receiveData() dbms/programs/server/TCPHandler.cpp:971
    7. 0x7ffff7c6cc1d DB::TCPHandler::receivePacket() dbms/programs/server/TCPHandler.cpp:855
    8. 0x7ffff7c6a1ef DB::TCPHandler::readDataNext(unsigned long const&, int const&) dbms/programs/server/TCPHandler.cpp:406
    9. 0x7ffff7c6a41b DB::TCPHandler::readData(DB::Settings const&) dbms/programs/server/TCPHandler.cpp:437
    10. 0x7ffff7c6a5d9 DB::TCPHandler::processInsertQuery(DB::Settings const&) dbms/programs/server/TCPHandler.cpp:464
    11. 0x7ffff7c687b5 DB::TCPHandler::runImpl() dbms/programs/server/TCPHandler.cpp:257
    ```

- `insert_distributed_sync=1`

    ```
    2019.10.18 13:23:22.114578 [ 44 ] {a78f669f-0b08-4337-abf8-d31e958f6d12} <Error> executeQuery: Code: 171, e.displayText() = DB::Exception: Block structure mismatch in RemoteBlockOutputStream stream: different number of columns:
    date Date UInt16(size = 1), value Date UInt16(size = 1)
    date Date UInt16(size = 0): Insertion status:
    Wrote 1 blocks and 0 rows on shard 0 replica 0, 127.0.0.1:59000 (average 0 ms per block)
    Wrote 0 blocks and 0 rows on shard 1 replica 0, 127.0.0.2:59000 (average 2 ms per block)
     (version 19.16.1.1) (from [::1]:3624) (in query: INSERT INTO distributed_00952 VALUES ), Stack trace:

    2. 0x7ffff7be92e0 DB::Exception::Exception() dbms/src/Common/Exception.h:27
    3. 0x7fffec5da4e9 DB::checkBlockStructure<void>(...)::{...}::operator()(...) const dbms/src/Core/Block.cpp:460
    4. 0x7fffec5da671 void DB::checkBlockStructure<void>(...) dbms/src/Core/Block.cpp:467
    5. 0x7fffec5d8d58 DB::assertBlocksHaveEqualStructure(...) dbms/src/Core/Block.cpp:515
    6. 0x7fffec326630 DB::RemoteBlockOutputStream::write(DB::Block const&) dbms/src/DataStreams/RemoteBlockOutputStream.cpp:68
    7. 0x7fffe98bd154 DB::DistributedBlockOutputStream::runWritingJob(DB::DistributedBlockOutputStream::JobReplica&, DB::Block const&)::{lambda()#1}::operator()() const dbms/src/Storages/Distributed/DistributedBlockOutputStream.cpp:280
    <snip>
    ````

Fixes: #7365
Fixes: #5429
Refs: #6891

* Cover INSERT into Distributed with MATERIALIZED columns and !is_local node

I guess that adding new cluster into server-test.xml is not required,
but it won't harm.

* Update DistributedBlockOutputStream.cpp
 2019-10-24 12:35:09 +03:00
alesapin
a6199b7e69 Merge with master 2019-10-24 12:33:40 +03:00
Vasily Nemkov
d6ff36c760 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-10-24 07:52:50 +03:00
Azat Khuzhin
80cf86f100 Cover INSERT into Distributed with MATERIALIZED columns and !is_local node 
I guess that adding new cluster into server-test.xml is not required,
but it won't harm.
 2019-10-23 21:55:08 +03:00
Artem Zuikov
bb1c1d0ed9
Merge pull request #7431 from arenadata/master 
fix aggregation (avg and quantiles) over empty decimal columns.
 2019-10-23 20:28:35 +03:00
alesapin
c3519ff376 Better check of dictionary lifetime for updates 2019-10-23 16:02:40 +03:00
akonyaev
7426542b8b up precision for avg result to max of type 2019-10-23 11:22:51 +03:00
alexey-milovidov
ffc2e4e149
Merge pull request #7396 from nvartolomei/nv/mv-extra-columns 
Test materialized view pushing extra columns
 2019-10-23 07:30:53 +03:00
akonyaev
6d0dbf7e95 add test returned datatype from quantile and median result for empty decimal data 2019-10-22 18:51:34 +03:00
akonyaev
71dd3a303e fix result type for avg aggregation 2019-10-22 18:31:56 +03:00
Nikita Mikhaylov
34d8ade4a0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-10-22 15:56:51 +03:00
akonyaev
dc7c4c1b9a add tests for aggregation over empty decimal table 2019-10-22 15:30:00 +03:00
Alexander Kuzmenkov
be4618dd05
Merge pull request #7339 from amosbird/f10 
Fix preciseExp10
 2019-10-22 12:00:53 +03:00
Vasily Nemkov
aa0de4a0c8 Minor non-functional test fixes. 2019-10-22 10:45:00 +03:00
Vitaly Baranov
f611fd4dfa
Merge pull request #7293 from Vdimir/feature/isvalidjson-5910 
Add function isValidJSON
 2019-10-21 21:24:18 +03:00
alesapin
83dbfe9634 New tests and fixes for them 2019-10-21 20:09:41 +03:00
Amos Bird
a860ee7891
Fix preciseExp10 2019-10-22 00:05:57 +08:00
Vasily Nemkov
aa6ea037f4 Minor fixes to the tests 2019-10-21 17:04:01 +03:00
chertus
4f0859a5fa Merge branch 'master' into ast 2019-10-21 15:08:05 +03:00
Vasily Nemkov
f1a438ca63 Tests for DateTime64 2019-10-21 14:46:38 +03:00
chertus
0d708569e3 fix test result (disabled push down) 2019-10-21 14:31:16 +03:00
stavrolia
fdaacb5645 Fix test 2019-10-21 12:37:50 +03:00
alesapin
26c87e46c9 Merge branch 'master' into dictionaries_ddl_loader 2019-10-21 11:46:49 +03:00
alesapin
35e66d6696 Merge with master 2019-10-21 11:46:11 +03:00
millb
2a183c3d07 Merge branch 'master' into decimal_hex_function 2019-10-21 11:13:51 +03:00
hcz
79a27ece1a Flip the condition column in arrayFill 2019-10-21 11:19:11 +08:00
alexey-milovidov
61125e536b
Update 01019_materialized_view_select_extra_columns.sql 2019-10-20 17:59:26 +03:00
Nicolae Vartolomei
b0f2f23a38 Test materialized view pushing extra columns 
This test exists to prevent unintended changes to existing behaviour.

Although this behaviour might not be ideal it is can be exploited for 0-downtime changes to materialized views.

Step 1: Add new column to source table.
Step 2: Create new view reading source column.
Step 3: Swap views using `RENAME TABLE`.
Step 4: Add new column to destination table as well.
 2019-10-20 10:26:44 +01:00
alexey-milovidov
52bfa9927c
Merge pull request #7384 from ClickHouse/fix_ub_in_system_parts 
Fix UB in StoragesInfoStream
 2019-10-19 09:59:39 +03:00