Commit Graph

25063 Commits

Author SHA1 Message Date
Alexey Milovidov
bafc5aa7b7 Added performance test for sumMap 2020-02-01 02:01:02 +03:00
alexey-milovidov
8253134739
Merge pull request #8935 from millb/CRLF_in_CSV_2
CRLF in CSV output format
2020-02-01 01:52:44 +03:00
alexey-milovidov
45497b4ed6
Merge pull request #8940 from ClickHouse/show-tables-not-like
Fixed ridiculous bug #8727
2020-02-01 01:44:51 +03:00
Alexey Milovidov
9701b006af Merge branch 'master' of github.com:yandex/ClickHouse 2020-01-31 23:24:30 +03:00
Alexey Milovidov
ef0a6000e4 Add test 2020-01-31 23:24:18 +03:00
alexey-milovidov
d20bae03fb
Merge pull request #8908 from azat/fixes
Tiny fixes
2020-01-31 23:22:30 +03:00
alexey-milovidov
41fb856da2
Merge pull request #8933 from bgiard/summing_merge_tree_strings
String keys in SummingMergeTree maps
2020-01-31 23:20:46 +03:00
Alexey Milovidov
b6761d31f3 Added range check to function h3EdgeLengthM 2020-01-31 23:16:46 +03:00
Alexey Milovidov
6f0114910f Added test #8727 2020-01-31 21:43:29 +03:00
Alexey Milovidov
1b24968b48 Fixed ridiculous bug #8727 2020-01-31 21:42:08 +03:00
Mikhail Korotov
c1bb0d953c fixed test 2020-01-31 21:31:51 +03:00
Mikhail Korotov
92889d846f solved conflict 2020-01-31 21:29:30 +03:00
Mikhail Korotov
f170a19eb3 Test style fixed 2020-01-31 21:25:21 +03:00
Nico Mandery
23c9902433 h3 hierarchical functions and string conversion 2020-01-31 18:49:17 +01:00
Vitaly Baranov
caeed69fe0 Change access rights dynamically when users.xml is edited. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
10c912dab2 Rewrite the User class to be controlled by AccessControlManager. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
168002376b Remove old access rights checking code. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
a5a2fe1260 Change test '00305_http_and_readonly' because DROP TABLE IF EXISTS now works in readonly mode in case the table doesn't exist. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
2aa58193c8 Check access rights via new interface. 2020-01-31 20:27:28 +03:00
Vitaly Baranov
9e910222da Add interfaces to check access rights. 2020-01-31 19:23:33 +03:00
Vitaly Baranov
6a8a69fd0c Use the generic class ext::scope_guard for subscriptions in IAccessStorage instead of a special class. 2020-01-31 19:23:33 +03:00
tavplubix
d43d84e71d
Merge pull request #8899 from achulkov2/issue-8864_show_create_table_bad_error_message
Issue 8864 show create table bad error message
2020-01-31 19:10:21 +03:00
alexey-milovidov
c2c5b81b70
Merge pull request #8851 from excitoon-favorites/globss3
Added globs/wildcards for s3
2020-01-31 18:56:06 +03:00
alexey-milovidov
9eb01b16fd
Merge pull request #8913 from nvartolomei/nv/alter-mv-replace-v20.1
ALTER <materialized view name> MODIFY QUERY <select_query>
2020-01-31 18:44:32 +03:00
alexey-milovidov
10dbe61089
Update 01019_alter_materialized_view_query.sql 2020-01-31 18:43:32 +03:00
Mikhail Korotov
0147f171ad
Update 01073_crlf_in_output_csv_format.sh 2020-01-31 18:10:46 +03:00
Mikhail Korotov
757247cbd5 tests fixed 2020-01-31 18:06:31 +03:00
Mikhail Korotov
182b2a626c test added 2020-01-31 18:01:37 +03:00
Baudouin Giard
fbbf026277 String keys in SummingMergeTree maps
Accept String or FixedString data types as key for maps in the
SummingMergeTree now that sumMap supports these two types (introduced in
bc0fbd688a).

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-01-31 14:37:28 +00:00
chertus
71d2050000 rename ANY INNER to SEMI JOIN for partial merge join 2020-01-31 17:29:49 +03:00
millb
0f5e43ec51 Attempt 2020-01-31 16:02:53 +03:00
Vitaly Baranov
035740f708
Merge pull request #8907 from vitlibar/drop-temporary-table-removes-only-temporary
DROP TEMPORARY TABLE now drops only temporary table.
2020-01-31 14:48:24 +03:00
proller
56a1fd9903 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-31 14:08:08 +03:00
Pavel Kovalenko
e615f72749 Fixed DiskTest 2020-01-31 12:05:41 +03:00
Nikolai Kochetov
c5289212ca
Merge pull request #8902 from ClickHouse/storage-buffer-processors
Storage buffer processors
2020-01-31 10:46:16 +03:00
Alexey Milovidov
51f55b3eed Added test 2020-01-31 05:07:02 +03:00
Alexey Milovidov
54f1cea22c Merge branch 'master' into alter-partition-dont-allow-strange-expressions 2020-01-31 04:35:33 +03:00
alexey-milovidov
0f800b2e73
Merge pull request #8910 from PerformanceVision/jit_nullable
Unexpected column in LLVMExecutableFunction when we use Nullable type when we use the JIT
2020-01-31 04:32:10 +03:00
Alexey Milovidov
26e328c7e2 Minor modifications for #8860 2020-01-31 04:10:12 +03:00
alexey-milovidov
dedf513aa3
Merge pull request #8860 from Avogar/json_each_row
Allow data in square brackets in JSONEachRowFormat.
2020-01-31 04:06:27 +03:00
alexey-milovidov
d76d55335e
Merge pull request #8914 from bgiard/range_reader
Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink
2020-01-31 03:57:52 +03:00
alexey-milovidov
5d3c62cd52
Merge pull request #8917 from filimonov/kafka_fixes_part2
Kafka fixes part2
2020-01-31 03:55:46 +03:00
proller
bec5289477 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-31 02:42:07 +03:00
Vitaly Baranov
8492b02511 Add test. 2020-01-31 02:37:40 +03:00
alexey-milovidov
835a435347
Merge pull request #8903 from bgiard/sum_map_strings
Add support of String and FixedString keys for sumMap
2020-01-31 01:02:16 +03:00
Mikhail Filimonov
a6e3265960 Kafka proper rebalances processing, controlled assignment, faster tests 2020-01-30 20:30:45 +01:00
Pavel Kovalenko
52db32fd5d Fixed reading from StorageLog table. 2020-01-30 22:30:42 +03:00
Pavel Kovalenko
9efda05839 StorageLog test with DiskLocal and DiskMemory. 2020-01-30 22:29:30 +03:00
proller
402b8608e1 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-30 19:47:01 +03:00
proller
e6ec39bf20 Fix gcc8 2020-01-30 19:46:36 +03:00
Nikolai Kochetov
a039deed2d Update TreeExecutorBlockInputStream. 2020-01-30 19:17:46 +03:00
alexey-milovidov
8f75797801
Merge pull request #8906 from zlobober/key_conditions
Extend KeyCondition interface so that it returns BoolMask.
2020-01-30 18:52:47 +03:00
Baudouin Giard
9216c5761c Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink
It looks like most times the original number of rows per granule is
pretty much consistent across all granules, except for the last one,
however there seems to be cases (Issue #7713) where that's not the case.

The only way I have to reproduce the crash involves using proprietary
data, and unfortunately I haven't been able to come up with a test case
that would highlight the problem - just like the person who opened issue
7713. I can't share my dataset.

Reading the code, it looks pretty obvious to me here - unless I'm
missing something, that the intention here is to copy the corresponding
granules to one another so it makes sense to index
rows_per_granule_original with the same variable as rows_per_granule.

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-01-30 15:40:48 +00:00
proller
cd0e9217da Merge remote-tracking branch 'upstream/master' into fix27 2020-01-30 18:11:22 +03:00
Nicolae Vartolomei
fd42d1ee87 ALTER <materialized view name> MODIFY QUERY <select_query>
Trying to resurrect https://github.com/ClickHouse/ClickHouse/pull/7533.
I'd like to get this PR in if we have an agreement on syntax and general
direction, after that I'll rebase actual alter functionality from above mentioned PR.
2020-01-30 14:12:49 +00:00
Avogar
75fe61251b Add test for data in square brackets in JSONEachRow. 2020-01-30 17:03:07 +03:00
Avogar
c5b0b6ba29 Merge branch 'master' of github.com:yandex/ClickHouse into json_each_row 2020-01-30 16:43:32 +03:00
Avogar
e219fc1e68 Change method of parsing data in square brackets by adding parsing stages. 2020-01-30 15:05:27 +03:00
Guillaume Tassery
c18fb015ac Merge branch 'master' of github.com:ClickHouse/ClickHouse into jit_nullable 2020-01-30 12:31:36 +01:00
Guillaume Tassery
be45e1b3b6 cosmetic 2020-01-30 12:31:21 +01:00
Guillaume Tassery
7d3c677921 Accept nullable for JIT function 2020-01-30 12:31:21 +01:00
Guillaume Tassery
a0e91fc9f6 Accept nullable values when we use the JIT feature 2020-01-30 12:31:21 +01:00
Nikolai Kochetov
3c4fe4f20e Fix StorageBuffer/ 2020-01-30 13:30:48 +03:00
Nikolai Kochetov
00546498b6 Fix StorageBuffer/ 2020-01-30 13:26:25 +03:00
Nikolai Kochetov
9eb97e6db2 Fix StorageBuffer/ 2020-01-30 13:22:59 +03:00
Nikolai Kochetov
5fd9db4370 Fix BufferSource. 2020-01-30 10:32:54 +03:00
Nikolai Kochetov
a5b016eb61 Fix BufferSource. 2020-01-30 10:28:49 +03:00
Nikolai Kochetov
ab5c4bed3a
Merge pull request #8823 from ClickHouse/storage-system-processors
Processors and system storages.
2020-01-30 10:22:31 +03:00
millb
f7ab01b746 Merge branch 'Prohibition_secondary_index_with_old_format_merge_tree' of https://github.com/millb/ClickHouse into Prohibition_secondary_index_with_old_format_merge_tree 2020-01-30 10:13:52 +03:00
millb
7e1a23d910 fixed 2020-01-30 10:13:09 +03:00
Vladimir Chebotarev
9706374066 Fixed error messages. 2020-01-30 09:17:55 +03:00
Azat Khuzhin
ca8d9ac7f8 Fix error message for force_optimize_skip_unused_shards 2020-01-30 09:01:54 +03:00
Azat Khuzhin
c6d95e9dfd Rename tables to match the test number for 01071_force_optimize_skip_unused_shards 2020-01-30 09:01:45 +03:00
Vitaly Baranov
e37eda3bdf DROP TEMPORARY TABLE now drops only a temporary table. 2020-01-30 02:41:22 +03:00
Maxim Akhmedov
fa16149e1a Fix style checks. 2020-01-30 02:36:39 +03:00
Maxim Akhmedov
2d3321e003 Extend KeyCondition interface so that it returns BoolMask. 2020-01-30 00:40:22 +03:00
Alexander Kuzmenkov
09b8f34370
Merge pull request #8896 from ClickHouse/aku/enum-wrong-value
Report BAD_ARGUMENTS for a wrong user-supplied enum value.
2020-01-30 00:25:17 +03:00
Ubuntu
bc0fbd688a Make sumMap accept String keys
Adapt sumMap to accept an array of strings as the key column. This is useful when we do not want or cannot make the keys be numbers.

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-01-29 19:38:41 +00:00
achulkov2
0bece0c43e Fix error with consecutive detach and attach 2020-01-29 21:45:03 +03:00
Nikolai Kochetov
d1bc3513a2 Fix build. 2020-01-29 21:22:09 +03:00
Nikolai Kochetov
0c4f6eaca9 Fix build. 2020-01-29 21:18:12 +03:00
Nikolai Kochetov
84a392402f Processors reading for StorageBuffer. 2020-01-29 21:14:40 +03:00
Nikolai Kochetov
bded6e5cff Added holded contexts and storages to Pipe. 2020-01-29 19:59:11 +03:00
alexey-milovidov
b567907431
Merge pull request #8868 from amosbird/countoptfix
Fix `MakeSet` in Group By
2020-01-29 19:53:41 +03:00
Nikolai Kochetov
e7a29b24e5 Added table locks to Pipe. 2020-01-29 18:55:13 +03:00
Nikolai Kochetov
6cb86cef24 Added AddingMissedTransform. 2020-01-29 18:35:43 +03:00
Nikolai Kochetov
81d4fd9579 Add prepared pipe to InterpreterSelectQuery. 2020-01-29 18:04:46 +03:00
achulkov2
cdfffd343d Fix unreachable check 2020-01-29 17:57:22 +03:00
Nikolai Kochetov
162a2cb2f4 update SourceFromSingleChunk 2020-01-29 17:32:38 +03:00
Alexander Kuzmenkov
975f042dc0 Report BAD_ARGUMENTS for a wrong user-supplied enum value.
Before we reported LOGICAL_ERROR that is incorrect.
2020-01-29 17:17:34 +03:00
achulkov2
61ff06be70 Experimenting 2020-01-29 16:12:11 +03:00
alexey-milovidov
f65b75ce5a
Merge pull request #8874 from abyss7/issue-6964
Initialize query profiler for all threads in a group
2020-01-29 15:41:59 +03:00
Nikolai Kochetov
74d1eb90df Automatically call progress for SourceWithProgress. 2020-01-29 13:26:08 +03:00
Nikolai Kochetov
57100fc962 Merge branch 'master' into storage-system-processors 2020-01-29 13:17:18 +03:00
Nikolai Kochetov
8ce6040306
Merge pull request #7796 from ClickHouse/processors-4.3
Processors and system.numbers
2020-01-29 13:11:13 +03:00
Guillaume Tassery
79b4b48528 cosmetic 2020-01-29 11:09:27 +01:00
Guillaume Tassery
0f348eb121 add tests 2020-01-29 11:02:10 +01:00
Guillaume Tassery
da67f408a3 Fix out of bounds error when we have a constant 2020-01-29 11:01:42 +01:00
alesapin
9b822e926a
Merge pull request #8882 from CurtizJ/fix-integration-test
Fix integration test 'prefer_localhost_replica'.
2020-01-29 11:34:39 +03:00
alesapin
abe9ce8774
Merge pull request #8884 from azat/client-suggest-merge_tree_settings
Add system.merge_tree_settings into clickhouse-client suggest
2020-01-29 11:26:24 +03:00
alexey-milovidov
2f9dd8e80f
Merge pull request #8877 from ClickHouse/aku/trace-readability
Reformat stack traces for readability.
2020-01-29 02:19:18 +03:00
alexey-milovidov
bcab6e7ac1
Merge pull request #8880 from ClickHouse/Akazz-clickhouse-test-patch-1
A followup to #8858: fixed awk invokation in hung queries check
2020-01-29 02:14:43 +03:00
Amos Bird
b650f1563a
Fix MakeSet in Group By 2020-01-29 04:49:39 +08:00
Azat Khuzhin
60d63081da Fix min_marks_for_seek for the data skipping indexes 2020-01-28 23:10:06 +03:00
Azat Khuzhin
3aeea41369 Add system.merge_tree_settings into clickhouse-client suggest 2020-01-28 22:25:43 +03:00
alexey-milovidov
e2860f8525
Merge pull request #8883 from ClickHouse/fix-storage-file-too-many-open-files
Updated internal testing script.
2020-01-28 22:21:58 +03:00
Alexey Milovidov
569e1ff666 Update testing script 2020-01-28 22:17:30 +03:00
alexey-milovidov
30c11474c8
Merge pull request #8834 from zlobober/comparable_nulls
Make NULLs comparable to everything.
2020-01-28 21:58:59 +03:00
CurtizJ
3144e81cb5 fix test prefer_localhost_replica 2020-01-28 21:54:25 +03:00
Alexander Kazakov
cebeae0055 Fixed awk invokation in hung queries check 2020-01-28 20:21:57 +03:00
Alexey Milovidov
3a5de8b874 Update script for CHYT 2020-01-28 19:59:32 +03:00
Nikolai Kochetov
196bb81a6e Update TreeExecutor. 2020-01-28 19:59:28 +03:00
Pavel Kovalenko
e0cd6b1073 Formatting issues. 2020-01-28 19:09:24 +03:00
Pavel Kovalenko
efeb9e92be StorageLog Gtest 2020-01-28 19:08:30 +03:00
Alexander Kuzmenkov
37daed2830 Reformat stack traces for readability. 2020-01-28 17:42:58 +03:00
Mikhail Filimonov
dc43728dea Test showing the problem with partial commit of polled batch + fix 2020-01-28 15:21:36 +01:00
Ding Xiang Fei
55b81c97e6 Set signal before rethrowing exception (#8736)
* set signal before rethrowing exception
* Add comment
2020-01-28 16:47:47 +03:00
Pavel Kovalenko
856592e26b Comments fixed. 2020-01-28 16:46:02 +03:00
Pavel Kovalenko
a12c318f35 Optimize includes. 2020-01-28 16:38:46 +03:00
Mikhail Filimonov
5dafccf410 Test for flushing by time and by block size (+fix), one extra test for virual columns 2020-01-28 14:24:37 +01:00
Nikolai Kochetov
fea33f8b60 Add processlist to PipelineExecutor. Throw exception if query was killed. 2020-01-28 16:16:02 +03:00
Pavel Kovalenko
0572f96656 Formatting issues. 2020-01-28 16:15:47 +03:00
Pavel Kovalenko
baa3c8e55b Formatting issues. 2020-01-28 16:05:37 +03:00
Pavel Kovalenko
3eb59d1ed3 Formatting issues. 2020-01-28 16:01:08 +03:00
Nikolai Kochetov
5a8a367228 Add processlist to PipelineExecutor. Throw exception if query was killed. 2020-01-28 15:59:34 +03:00
Pavel Kovalenko
d4707ca911 Seek reworking. 2020-01-28 15:48:01 +03:00
Pavel Kovalenko
861ddbcadd DiskS3 Metadata refactoring. 2020-01-28 15:46:39 +03:00
Maxim Akhmedov
65356ea893 And one more fix. 2020-01-28 15:33:25 +03:00
Maxim Akhmedov
ead37dc294 Fix comparison between decimal field and null. 2020-01-28 15:31:17 +03:00
Ivan Lezhankin
27986b6658 Revert "Merge pull request #8831 from ClickHouse/revert-8820-issue-6964"
This reverts commit a21d3712eb, reversing
changes made to 667e9ed6d4.
2020-01-28 15:01:45 +03:00
Ivan Lezhankin
a592049ca3 Merge remote-tracking branch 'upstream/master' into issue-6964 2020-01-28 15:01:33 +03:00
Ivan Lezhankin
06f5a274ec Fix initialization of QueryProfiler with regard to query context. 2020-01-28 14:59:06 +03:00
Nikolai Kochetov
a19c8b3d37 Update LimitTransform. 2020-01-28 14:50:22 +03:00
alesapin
e27a3170bc Less flaps in tests 2020-01-28 13:58:37 +03:00
alexey-milovidov
1f90d2f078
Merge pull request #8866 from achulkov2/issue-8865_unnamed_tuples_should_not_be_flattened
Issue 8865 unnamed tuples should not be flattened
2020-01-28 12:32:58 +03:00
alexey-milovidov
45dce57a8c
Merge pull request #8830 from zlobober/storage_properties
Explicitly specify storage features
2020-01-28 01:49:53 +03:00
alexey-milovidov
74786e3584
Merge pull request #8858 from ClickHouse/Akazz-clickhouse-test-patch-1
In clickhouse-test: Updated check for hung queries
2020-01-28 01:45:32 +03:00
alexey-milovidov
acc5fad41a
Merge pull request #8848 from ClickHouse/fix-pipeline-dump
Do not dump pipeline in exception message.
2020-01-28 01:44:23 +03:00
alexey-milovidov
7795c9c889
Merge pull request #8861 from ClickHouse/fix-storage-file-too-many-open-files
Fix StorageFile too many open files error
2020-01-28 01:35:39 +03:00
Vladimir Chebotarev
f98de4e098 Added tests for _file and _path in S3 storage. 2020-01-28 01:09:21 +03:00
Vladimir Chebotarev
11a5cab7bd Added some tests. 2020-01-28 00:44:18 +03:00
Andrei Chulkov
7395c0eadc Rename columns to avoid ambiguity with sql 2020-01-28 00:09:38 +03:00
Andrei Chulkov
d8f7383fd7 Add test 2020-01-28 00:04:46 +03:00
achulkov2
b7c9075e53 Stop flattening unnamed nested tuples 2020-01-27 23:26:39 +03:00
Vladimir Chebotarev
533011a5f5 Minor review and style fixes. 2020-01-27 23:08:43 +03:00
Pavel Kovalenko
cb3693f071 Formatting issues. 2020-01-27 22:51:48 +03:00
alexey-milovidov
75ebebde4f
Merge pull request #8845 from ClickHouse/client-vertical-fix
Fixed ugly error with vertical format in Client
2020-01-27 22:36:12 +03:00
Pavel Kovalenko
699a031c7f Code style issues. 2020-01-27 22:27:52 +03:00
Pavel Kovalenko
47e7c8d474 Formatting issues. 2020-01-27 22:17:22 +03:00
Pavel Kovalenko
0df5f89a47 Minor formatting. 2020-01-27 22:01:18 +03:00