Commit Graph

25243 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
189a6e65c5
boop 2020-02-05 23:07:39 +03:00
CurtizJ
db47ef923c fix prewhere 2020-02-05 19:42:27 +03:00
achulkov2
0ae0e03d52 Address latest comments 2020-02-05 19:38:03 +03:00
alesapin
1923930379 Fix mutations finalization task 2020-02-05 19:30:02 +03:00
Alexander Kuzmenkov
3368af109e
Explicit values are more conspicuous. 2020-02-05 18:08:54 +03:00
Alexander Kuzmenkov
64576c6a7a Less flappy performance test queries 2020-02-05 17:49:19 +03:00
chertus
af84814e51 fix for T64 data incompatibility 2020-02-05 17:25:33 +03:00
Slach
23b787c0d6 actualize description of system.metrics.TCPConnection
add system.metrics.MySQLConnection

Signed-off-by: Slach <bloodjazman@gmail.com>
2020-02-05 19:06:46 +05:00
Ivan Lezhankin
a5ccc72656 Merge remote-tracking branch 'upstream/master' into memory-profiler 2020-02-05 16:52:49 +03:00
Alexander Kuzmenkov
64bcb78812 use proper length 2020-02-05 13:24:24 +03:00
Artem Zuikov
8c23840cc8
ExpressionActions refactoring: extract ArrayJoinAction class (#8998)
refactoring: extract ArrayJoinAction class
2020-02-05 13:12:19 +03:00
Mikhail Filimonov
babd3ca34e Fixing test build, more review fixes 2020-02-05 08:05:55 +01:00
Mikhail Filimonov
cf35392433 Test for producer with _timestamp and _key 2020-02-04 23:12:26 +01:00
Mikhail Filimonov
8c736e6c9f After review fixes 2020-02-04 22:19:34 +01:00
Alexander Kuzmenkov
7b898ec871 style 2020-02-04 16:31:15 +03:00
Guillaume Tassery
a79a9cf078 Merge branch 'master' of github.com:ClickHouse/ClickHouse into select_constants 2020-02-04 05:09:12 +01:00
Alexander Kuzmenkov
cbcb7895e4 Avoid extra copying when demangling names. 2020-02-03 22:51:26 +03:00
Nikolai Kochetov
ed71fb347e Update SelectStreamFactory. 2020-02-03 21:14:26 +03:00
Nikolai Kochetov
bc757f6b24 Processors support for StorageS3 reading. 2020-02-03 21:01:41 +03:00
Nikolai Kochetov
71f746e01a Update SelectStreamFactory. 2020-02-03 20:55:06 +03:00
Ivan Lezhankin
634d3bedd3 Attempt to fix 2020-02-03 20:06:59 +03:00
Nikolai Kochetov
a832a630d8 Update TreeExecutor. 2020-02-03 18:35:35 +03:00
Nikolai Kochetov
30586111a6 fix totals port for pipe. 2020-02-03 17:50:19 +03:00
Nikolai Kochetov
32aa100938 fix totals port for pipe. 2020-02-03 17:28:30 +03:00
Ivan Lezhankin
88095b636e Merge remote-tracking branch 'upstream/master' into memory-profiler 2020-02-03 16:21:21 +03:00
alexey-milovidov
e24926d16e
Merge pull request #8952 from azat/getSerializedSize
Add blockSerializedSize() function (size on disk without compression)
2020-02-03 15:46:26 +03:00
alexey-milovidov
59ef2b2009
Merge pull request #8963 from millb/CRLF_in_TSV
CRLF in TSV output format
2020-02-03 15:44:59 +03:00
alexey-milovidov
5689bef818
Merge pull request #8967 from CurtizJ/attach-if-not-exists
Fix query 'ATTACH TABLE IF NOT EXISTS'
2020-02-03 15:41:57 +03:00
Nikolai Kochetov
a029e49438 Processors support for StorageNull reading. 2020-02-03 14:23:52 +03:00
Nikolai Kochetov
eae2ce194d Processors support for StorageNull reading. 2020-02-03 14:22:21 +03:00
Nikolai Kochetov
fde86203a7 Fix StorageJoin 2020-02-03 13:42:20 +03:00
CurtizJ
a5b5cb2e94 fix query 'ATTACH TABLE IF NOT EXISTS' 2020-02-03 13:38:09 +03:00
Mikhail Filimonov
24ff635435 draft implementation, wip 2020-02-03 11:02:52 +01:00
Guillaume Tassery
4189a0d70b Merge branch 'master' of github.com:ClickHouse/ClickHouse into select_constants 2020-02-03 10:46:37 +01:00
Azat Khuzhin
e89ceae61a Add blockSerializedSize() function (size on disk without compression)
Sometimes it is useful to know how much does this data will take on
disk, with blockSerializedSize() you can know this (although without
compression).

This can be a major knowledge for various aggregation functions that
tracking some state (i.e. uniqCombined).
2020-02-03 11:26:40 +03:00
Azat Khuzhin
f979ce31ca Add NullWriteBuffer 2020-02-03 11:26:04 +03:00
Mikhail Korotov
a8c9385346 Test added 2020-02-03 10:57:52 +03:00
millb
0d91aff981 Code added 2020-02-03 10:40:12 +03:00
alexey-milovidov
c793f30873
Merge pull request #8954 from ClickHouse/os-thread-id
Use OS thread id everywhere instead of internal thread number.
2020-02-03 03:57:35 +03:00
Alexey Milovidov
e1e69771a0 Fixed error in JSONEachRow 2020-02-03 03:04:08 +03:00
Andrew Onyshchuk
15bad674a0 Add AvroConfluent integration test 2020-02-02 18:02:19 -06:00
alexey-milovidov
baf218b431
Merge pull request #8932 from 4ertus2/debt
Rename ANY INNER to SEMI JOIN for partial merge join
2020-02-03 01:53:52 +03:00
Alexey Milovidov
afbb3fca46 Added a test from Vasily Nemkov #8813 2020-02-03 00:11:49 +03:00
Alexey Milovidov
1aedbb3806 Merge branch 'master' of github.com:yandex/ClickHouse 2020-02-03 00:04:36 +03:00
alexey-milovidov
bf4887a33d
Merge pull request #8822 from millb/Prohibition_secondary_index_with_old_format_merge_tree
Prohibition secondary index with old syntax merge tree
2020-02-03 00:04:04 +03:00
alexey-milovidov
d1bfacae4b
Merge pull request #8953 from oandrew/avro-fixes-confluent
AvroConfluent fixes
2020-02-03 00:00:24 +03:00
Alexey Milovidov
1463764199 Removed useless code (found by PVS Studio) 2020-02-02 23:59:18 +03:00
Alexey Milovidov
d7a6951344 Updated test #8938 2020-02-02 23:26:55 +03:00
alexey-milovidov
9e0b40bf09
Revert "Build fixes" 2020-02-02 23:21:49 +03:00
Alexey Milovidov
fc17853c5a Added missing range check to function h3HexAreaM2 #8938 2020-02-02 23:13:06 +03:00
Alexey Milovidov
d11f3cb78f Changed thread_id to UInt64 to support more OS 2020-02-02 23:01:13 +03:00
Alexey Milovidov
5feb40cb6f Updated test 2020-02-02 22:49:53 +03:00
alexey-milovidov
d213f5beae
Update h3EdgeLengthM.cpp 2020-02-02 19:22:59 +03:00
chertus
d2e8b24970 better compatibility in EngineJoin 2020-02-02 19:12:48 +03:00
chertus
8c371ed75f syntax ANY INNER to SEMI LEFT JOIN rewrite 2020-02-02 17:07:50 +03:00
proller
96cfd0b6c2 Merge remote-tracking branch 'upstream/master' into fix27 2020-02-02 14:55:15 +03:00
Andrew Onyshchuk
b236f7a3ae Do not rethrow Poco exception 2020-02-01 22:06:20 -06:00
Alexey Milovidov
39b31907b5 Rename function #7477 2020-02-02 05:35:47 +03:00
Alexey Milovidov
f9eb4e79f6 Using OS tid everywhere #7477 2020-02-02 05:28:14 +03:00
alexey-milovidov
c1535e10d4
Merge pull request #8813 from CurtizJ/merging-in-arrays
Merging #5342 (IN with function result).
2020-02-02 04:33:54 +03:00
alexey-milovidov
ef2346b0fa
Update ActionsVisitor.cpp 2020-02-02 04:33:13 +03:00
alexey-milovidov
3a1e3f612e
Merge branch 'master' into idisk-seekable-readbuffer 2020-02-02 03:54:50 +03:00
Andrew Onyshchuk
927e572d39 AvroConfluent bugfixes 2020-02-01 18:53:11 -06:00
alexey-milovidov
185d11ad72
Merge pull request #8938 from nmandery/h3-hierarchy-master
implement more functions of the H3 library
2020-02-02 03:41:01 +03:00
alexey-milovidov
46583b2c60
Merge pull request #8835 from ClickHouse/alter-partition-dont-allow-strange-expressions
Don't allow strange expressions in ALTER ... PARTITION query
2020-02-02 03:36:59 +03:00
alexey-milovidov
eeacc97d2f
Merge pull request #8852 from vitlibar/RBAC-4
RBAC-4
2020-02-02 03:35:31 +03:00
alexey-milovidov
dbf998cc30
Merge pull request #8947 from ClickHouse/sum-map-add-perf-test
Added performance test for sumMap
2020-02-02 03:35:04 +03:00
alexey-milovidov
4fcf041383
Merge pull request #8945 from ClickHouse/h3-range-check
Added range check to function h3EdgeLengthM
2020-02-02 03:34:05 +03:00
alexey-milovidov
df44bfa771
Merge pull request #8950 from Alex-Burmak/s3_min_upload_part_size
Support of s3_min_upload_part_size setting in DiskS3
2020-02-02 03:33:50 +03:00
alexey-milovidov
b4b30202b1
Merge pull request #8949 from oandrew/avro-fixes
Avro format improvements
2020-02-02 03:33:20 +03:00
Andrew Onyshchuk
16d4990088 Get rid of SkipFnHolder 2020-02-01 11:13:50 -06:00
Vitaly Baranov
63079c40c2 Optimize access checking. 2020-02-01 17:31:25 +03:00
Alexander Burmak
0c0ad54366 Support of s3_min_upload_part_size setting in DiskS3 2020-02-01 12:28:04 +03:00
Andrew Onyshchuk
b84d5c2139 Add support for references 2020-01-31 22:13:12 -06:00
Andrew Onyshchuk
1b308142d6 Support for AVRO_FIXED inserted into String 2020-01-31 18:11:51 -06:00
Alexey Milovidov
bafc5aa7b7 Added performance test for sumMap 2020-02-01 02:01:02 +03:00
alexey-milovidov
8253134739
Merge pull request #8935 from millb/CRLF_in_CSV_2
CRLF in CSV output format
2020-02-01 01:52:44 +03:00
alexey-milovidov
45497b4ed6
Merge pull request #8940 from ClickHouse/show-tables-not-like
Fixed ridiculous bug #8727
2020-02-01 01:44:51 +03:00
Alexey Milovidov
9701b006af Merge branch 'master' of github.com:yandex/ClickHouse 2020-01-31 23:24:30 +03:00
Alexey Milovidov
ef0a6000e4 Add test 2020-01-31 23:24:18 +03:00
alexey-milovidov
d20bae03fb
Merge pull request #8908 from azat/fixes
Tiny fixes
2020-01-31 23:22:30 +03:00
alexey-milovidov
41fb856da2
Merge pull request #8933 from bgiard/summing_merge_tree_strings
String keys in SummingMergeTree maps
2020-01-31 23:20:46 +03:00
Alexey Milovidov
b6761d31f3 Added range check to function h3EdgeLengthM 2020-01-31 23:16:46 +03:00
Alexey Milovidov
6f0114910f Added test #8727 2020-01-31 21:43:29 +03:00
Alexey Milovidov
1b24968b48 Fixed ridiculous bug #8727 2020-01-31 21:42:08 +03:00
Mikhail Korotov
c1bb0d953c fixed test 2020-01-31 21:31:51 +03:00
Mikhail Korotov
92889d846f solved conflict 2020-01-31 21:29:30 +03:00
Mikhail Korotov
f170a19eb3 Test style fixed 2020-01-31 21:25:21 +03:00
Nico Mandery
23c9902433 h3 hierarchical functions and string conversion 2020-01-31 18:49:17 +01:00
Vitaly Baranov
caeed69fe0 Change access rights dynamically when users.xml is edited. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
10c912dab2 Rewrite the User class to be controlled by AccessControlManager. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
168002376b Remove old access rights checking code. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
a5a2fe1260 Change test '00305_http_and_readonly' because DROP TABLE IF EXISTS now works in readonly mode in case the table doesn't exist. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
2aa58193c8 Check access rights via new interface. 2020-01-31 20:27:28 +03:00
Nikolai Kochetov
cef9db809f Processors support for StorageMySQL reading. 2020-01-31 19:46:27 +03:00
Nikolai Kochetov
dd888f59a7 Fix MemorySource. 2020-01-31 19:36:57 +03:00
Nikolai Kochetov
edd2477ca7 Processors support for StorageMerge reading. 2020-01-31 19:32:00 +03:00
Nikolai Kochetov
dbffabfd46 Processors support for StorageMerge reading. 2020-01-31 19:31:08 +03:00
Nikolai Kochetov
7bedce40ea Processors support for StorageMerge reading. 2020-01-31 19:29:40 +03:00
Vitaly Baranov
9e910222da Add interfaces to check access rights. 2020-01-31 19:23:33 +03:00
Vitaly Baranov
6a8a69fd0c Use the generic class ext::scope_guard for subscriptions in IAccessStorage instead of a special class. 2020-01-31 19:23:33 +03:00
tavplubix
d43d84e71d
Merge pull request #8899 from achulkov2/issue-8864_show_create_table_bad_error_message
Issue 8864 show create table bad error message
2020-01-31 19:10:21 +03:00
alexey-milovidov
c2c5b81b70
Merge pull request #8851 from excitoon-favorites/globss3
Added globs/wildcards for s3
2020-01-31 18:56:06 +03:00
alexey-milovidov
9eb01b16fd
Merge pull request #8913 from nvartolomei/nv/alter-mv-replace-v20.1
ALTER <materialized view name> MODIFY QUERY <select_query>
2020-01-31 18:44:32 +03:00
alexey-milovidov
10dbe61089
Update 01019_alter_materialized_view_query.sql 2020-01-31 18:43:32 +03:00
Nikolai Kochetov
dc96e6d1cf Processors support for StorageMemory reading. 2020-01-31 18:26:10 +03:00
Nikolai Kochetov
fc7839716f Processors support for StorageMaterializedView reading. 2020-01-31 18:16:06 +03:00
Mikhail Korotov
0147f171ad
Update 01073_crlf_in_output_csv_format.sh 2020-01-31 18:10:46 +03:00
Nikolai Kochetov
046ff34525 Processors support for StorageLog reading. 2020-01-31 18:10:10 +03:00
Mikhail Korotov
757247cbd5 tests fixed 2020-01-31 18:06:31 +03:00
Mikhail Korotov
182b2a626c test added 2020-01-31 18:01:37 +03:00
Nikolai Kochetov
384e68d745 Processors support for StorageJoin reading. 2020-01-31 17:51:09 +03:00
Baudouin Giard
fbbf026277 String keys in SummingMergeTree maps
Accept String or FixedString data types as key for maps in the
SummingMergeTree now that sumMap supports these two types (introduced in
bc0fbd688a).

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-01-31 14:37:28 +00:00
chertus
71d2050000 rename ANY INNER to SEMI JOIN for partial merge join 2020-01-31 17:29:49 +03:00
Nikolai Kochetov
f9db37ebf7 Processors support for StorageInput reading. 2020-01-31 17:26:51 +03:00
Nikolai Kochetov
6870132713 Processors support for StorageHDFS reading. 2020-01-31 17:06:43 +03:00
Nikolai Kochetov
2d1f06a49f Processors support for StorageFile reading. 2020-01-31 16:12:11 +03:00
millb
0f5e43ec51 Attempt 2020-01-31 16:02:53 +03:00
Vitaly Baranov
035740f708
Merge pull request #8907 from vitlibar/drop-temporary-table-removes-only-temporary
DROP TEMPORARY TABLE now drops only temporary table.
2020-01-31 14:48:24 +03:00
proller
56a1fd9903 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-31 14:08:08 +03:00
Pavel Kovalenko
e615f72749 Fixed DiskTest 2020-01-31 12:05:41 +03:00
Nikolai Kochetov
0157de021a Processors support for StorageDistributed reading. 2020-01-31 11:54:57 +03:00
Nikolai Kochetov
240f1e3e96 Processors support for StorageDictionary. 2020-01-31 11:14:20 +03:00
Nikolai Kochetov
c5289212ca
Merge pull request #8902 from ClickHouse/storage-buffer-processors
Storage buffer processors
2020-01-31 10:46:16 +03:00
Alexey Milovidov
51f55b3eed Added test 2020-01-31 05:07:02 +03:00
Alexey Milovidov
54f1cea22c Merge branch 'master' into alter-partition-dont-allow-strange-expressions 2020-01-31 04:35:33 +03:00
alexey-milovidov
0f800b2e73
Merge pull request #8910 from PerformanceVision/jit_nullable
Unexpected column in LLVMExecutableFunction when we use Nullable type when we use the JIT
2020-01-31 04:32:10 +03:00
Alexey Milovidov
26e328c7e2 Minor modifications for #8860 2020-01-31 04:10:12 +03:00
alexey-milovidov
dedf513aa3
Merge pull request #8860 from Avogar/json_each_row
Allow data in square brackets in JSONEachRowFormat.
2020-01-31 04:06:27 +03:00
alexey-milovidov
d76d55335e
Merge pull request #8914 from bgiard/range_reader
Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink
2020-01-31 03:57:52 +03:00
alexey-milovidov
5d3c62cd52
Merge pull request #8917 from filimonov/kafka_fixes_part2
Kafka fixes part2
2020-01-31 03:55:46 +03:00
proller
bec5289477 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-31 02:42:07 +03:00
Vitaly Baranov
8492b02511 Add test. 2020-01-31 02:37:40 +03:00
alexey-milovidov
835a435347
Merge pull request #8903 from bgiard/sum_map_strings
Add support of String and FixedString keys for sumMap
2020-01-31 01:02:16 +03:00
Mikhail Filimonov
a6e3265960 Kafka proper rebalances processing, controlled assignment, faster tests 2020-01-30 20:30:45 +01:00
Pavel Kovalenko
52db32fd5d Fixed reading from StorageLog table. 2020-01-30 22:30:42 +03:00
Pavel Kovalenko
9efda05839 StorageLog test with DiskLocal and DiskMemory. 2020-01-30 22:29:30 +03:00
proller
402b8608e1 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-30 19:47:01 +03:00
proller
e6ec39bf20 Fix gcc8 2020-01-30 19:46:36 +03:00
achulkov2
1f97500756 Address comment 2020-01-30 19:41:58 +03:00
achulkov2
0482ab8eaa Address comment 2020-01-30 19:35:33 +03:00
Nikolai Kochetov
a039deed2d Update TreeExecutorBlockInputStream. 2020-01-30 19:17:46 +03:00
alexey-milovidov
8f75797801
Merge pull request #8906 from zlobober/key_conditions
Extend KeyCondition interface so that it returns BoolMask.
2020-01-30 18:52:47 +03:00
Baudouin Giard
9216c5761c Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink
It looks like most times the original number of rows per granule is
pretty much consistent across all granules, except for the last one,
however there seems to be cases (Issue #7713) where that's not the case.

The only way I have to reproduce the crash involves using proprietary
data, and unfortunately I haven't been able to come up with a test case
that would highlight the problem - just like the person who opened issue
7713. I can't share my dataset.

Reading the code, it looks pretty obvious to me here - unless I'm
missing something, that the intention here is to copy the corresponding
granules to one another so it makes sense to index
rows_per_granule_original with the same variable as rows_per_granule.

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-01-30 15:40:48 +00:00
achulkov2
68cf5104e1 Fix types 2020-01-30 18:17:20 +03:00
proller
cd0e9217da Merge remote-tracking branch 'upstream/master' into fix27 2020-01-30 18:11:22 +03:00
achulkov2
07699df1e8 Address comments 2020-01-30 17:59:16 +03:00
Ivan Lezhankin
a42c5b4076 Initialize TraceCollector before setting signal handlers 2020-01-30 17:31:01 +03:00
Nicolae Vartolomei
fd42d1ee87 ALTER <materialized view name> MODIFY QUERY <select_query>
Trying to resurrect https://github.com/ClickHouse/ClickHouse/pull/7533.
I'd like to get this PR in if we have an agreement on syntax and general
direction, after that I'll rebase actual alter functionality from above mentioned PR.
2020-01-30 14:12:49 +00:00
Avogar
75fe61251b Add test for data in square brackets in JSONEachRow. 2020-01-30 17:03:07 +03:00