Commit Graph

25729 Commits

Author SHA1 Message Date
Anton Popov
9dc7577d15
Merge pull request #9038 from CurtizJ/fix-range-reader
Add test for #8914
2020-02-07 03:47:51 +03:00
Vitaly Baranov
7ebcd4b290
Merge pull request #8875 from vitlibar/RBAC-5
RBAC-5.1
2020-02-07 03:40:15 +03:00
Artem Zuikov
31948a063a
Trying to fix early constant folding (#9010)
add setting to disable early constant folding
2020-02-07 03:05:51 +03:00
Artem Zuikov
31a3f3b48b
revert TypeIndex, another fix for T64 (#9033) 2020-02-07 03:04:25 +03:00
Alexander Kuzmenkov
070ebb6bb6
boop 2020-02-07 01:42:19 +03:00
CurtizJ
cdcaef9349 add test for #8914 2020-02-06 21:57:18 +03:00
Alexander Tokmakov
acef7fc5bd add test 2020-02-06 20:23:05 +03:00
CurtizJ
2780250d05 better code near data part writer 2020-02-06 18:32:00 +03:00
Vitaly Baranov
02262e3b6e Add one more test. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
d2ff1e5dd4 Implement partial revokes. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
3706b9d92a Add tests. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
421120b997 Implement SQL queries to manipulate users and grants. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
c604ce1ca5 Add access_with_grant_option to User. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
c9f2713cc4 Remove getting user by name from Context. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
08c6061bdf Add user_id to Context. 2020-02-06 18:12:54 +03:00
Vitaly Baranov
fb3b755599 Fix granting and revoking access rights. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
328d3a8b08 Add token type '@'. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
291b7c277a Move some part of the Authentication class to header to allow using in the parser. 2020-02-06 18:12:48 +03:00
proller
d69785915e Merge remote-tracking branch 'upstream/master' into fix27 2020-02-06 17:19:30 +03:00
Alexander Kuzmenkov
3df25af15f
Merge pull request #8780 from ClickHouse/aku/msan-final
Suppress the last two MemorySanitizer failures
2020-02-06 16:34:55 +03:00
Alexander Kuzmenkov
ed90f6167c
Update msan_suppressions.txt 2020-02-06 16:34:11 +03:00
Alexander Kuzmenkov
3fb8dcae55 less flappy 2020-02-06 16:11:02 +03:00
Vitaly Baranov
1e8f04b571 Add to class AllowedClientHost support for like pattern and for removing. 2020-02-06 15:25:32 +03:00
Alexander Kuzmenkov
d9073f27b7 Revert "Merge pull request #9025 from ClickHouse/revert-8303-cache-dictionary"
This reverts commit 24bdad3768, reversing
changes made to dad4f03a8f.
2020-02-06 15:18:19 +03:00
Alexander Kuzmenkov
7f9bab3fc5
Merge pull request #8985 from ClickHouse/aku/demangle-faster
Avoid extra copying when demangling names.
2020-02-06 14:57:56 +03:00
Alexander Kuzmenkov
115c89f057 less slow 2020-02-06 14:51:22 +03:00
Nicolae Vartolomei
949b498d37 Always wait for all background INSERTs to finish to catch stuck queries 2020-02-06 11:44:15 +00:00
Nicolae Vartolomei
0939a9460f Modify Materialized View query 2020-02-06 08:57:54 +00:00
Vasily Nemkov
9b64a963c4 Fixed buffer overflow on decoding small sequences with Gorilla and DoubleDelta
* When decoding 0 items with Gorilla
* When decoding 1 or 0 items with DoubleDelta
2020-02-06 16:37:21 +08:00
alesapin
29a26a87b4 Merge pull request #9022 from ClickHouse/mutations_parts_to_do_fix
Fix mutations finalization task
2020-02-06 11:26:13 +03:00
alesapin
790ef52aef
Merge pull request #9024 from CurtizJ/fix-range-reader
Fix prewhere optimization.
2020-02-06 11:25:59 +03:00
zhang2014
784230b7a8 ISSUES-8971 fix non from 2020-02-06 08:30:14 +08:00
Alexander Tokmakov
180b5d409d fix poco secure sockets timeouts 2020-02-05 23:45:16 +03:00
Alexander Kuzmenkov
189a6e65c5
boop 2020-02-05 23:07:39 +03:00
CurtizJ
db47ef923c fix prewhere 2020-02-05 19:42:27 +03:00
achulkov2
0ae0e03d52 Address latest comments 2020-02-05 19:38:03 +03:00
alesapin
1923930379 Fix mutations finalization task 2020-02-05 19:30:02 +03:00
Alexander Kuzmenkov
3368af109e
Explicit values are more conspicuous. 2020-02-05 18:08:54 +03:00
Alexander Kuzmenkov
64576c6a7a Less flappy performance test queries 2020-02-05 17:49:19 +03:00
chertus
af84814e51 fix for T64 data incompatibility 2020-02-05 17:25:33 +03:00
Slach
23b787c0d6 actualize description of system.metrics.TCPConnection
add system.metrics.MySQLConnection

Signed-off-by: Slach <bloodjazman@gmail.com>
2020-02-05 19:06:46 +05:00
Ivan Lezhankin
a5ccc72656 Merge remote-tracking branch 'upstream/master' into memory-profiler 2020-02-05 16:52:49 +03:00
zhang2014
370615de93 ISSUES-8971 add test for predicate optimizer & view 2020-02-05 19:44:18 +08:00
zhang2014
16bb4e975d ISSUES-8971 support explain & view storage 2020-02-05 19:40:18 +08:00
Alexander Kuzmenkov
64bcb78812 use proper length 2020-02-05 13:24:24 +03:00
Artem Zuikov
8c23840cc8
ExpressionActions refactoring: extract ArrayJoinAction class (#8998)
refactoring: extract ArrayJoinAction class
2020-02-05 13:12:19 +03:00
zhang2014
b9443c98fe ISSUES-8971 fix view with predicate optimizer 2020-02-05 16:00:06 +08:00
Mikhail Filimonov
babd3ca34e Fixing test build, more review fixes 2020-02-05 08:05:55 +01:00
Mikhail Filimonov
cf35392433 Test for producer with _timestamp and _key 2020-02-04 23:12:26 +01:00
Mikhail Filimonov
8c736e6c9f After review fixes 2020-02-04 22:19:34 +01:00
CurtizJ
2f9f5dfc7a better initialization of MergedBlockOutputStream 2020-02-04 19:15:28 +03:00
Alexander Kuzmenkov
7b898ec871 style 2020-02-04 16:31:15 +03:00
CurtizJ
31c39c8137 fix mutations 2020-02-04 15:11:32 +03:00
Mikhail Korotov
ad77771b9a Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-04 12:05:47 +03:00
Guillaume Tassery
a79a9cf078 Merge branch 'master' of github.com:ClickHouse/ClickHouse into select_constants 2020-02-04 05:09:12 +01:00
Alexander Kuzmenkov
cbcb7895e4 Avoid extra copying when demangling names. 2020-02-03 22:51:26 +03:00
Nikolai Kochetov
ed71fb347e Update SelectStreamFactory. 2020-02-03 21:14:26 +03:00
Nikolai Kochetov
bc757f6b24 Processors support for StorageS3 reading. 2020-02-03 21:01:41 +03:00
Nikolai Kochetov
71f746e01a Update SelectStreamFactory. 2020-02-03 20:55:06 +03:00
Ivan Lezhankin
634d3bedd3 Attempt to fix 2020-02-03 20:06:59 +03:00
proller
bce3ec2a29 Revert "Revert "Build fixes""
This reverts commit 9e0b40bf09.
2020-02-03 19:46:17 +03:00
CurtizJ
1785b27ae5 fix build 2020-02-03 19:37:00 +03:00
millb
cb7dc72c4b Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-03 19:04:16 +03:00
millb
663e944b33 Attempt 2020-02-03 19:03:42 +03:00
CurtizJ
a0635ed390 better marks reading 2020-02-03 19:02:54 +03:00
Nikolai Kochetov
a832a630d8 Update TreeExecutor. 2020-02-03 18:35:35 +03:00
Nikolai Kochetov
30586111a6 fix totals port for pipe. 2020-02-03 17:50:19 +03:00
Nikolai Kochetov
32aa100938 fix totals port for pipe. 2020-02-03 17:28:30 +03:00
Ivan Lezhankin
88095b636e Merge remote-tracking branch 'upstream/master' into memory-profiler 2020-02-03 16:21:21 +03:00
Mikhail Korotov
e0eb2f5428
Update Cluster.cpp 2020-02-03 16:18:00 +03:00
alexey-milovidov
e24926d16e
Merge pull request #8952 from azat/getSerializedSize
Add blockSerializedSize() function (size on disk without compression)
2020-02-03 15:46:26 +03:00
alexey-milovidov
59ef2b2009
Merge pull request #8963 from millb/CRLF_in_TSV
CRLF in TSV output format
2020-02-03 15:44:59 +03:00
alexey-milovidov
5689bef818
Merge pull request #8967 from CurtizJ/attach-if-not-exists
Fix query 'ATTACH TABLE IF NOT EXISTS'
2020-02-03 15:41:57 +03:00
CurtizJ
257bb3b599 add comments near DataPart code 2020-02-03 15:08:40 +03:00
Nikolai Kochetov
a029e49438 Processors support for StorageNull reading. 2020-02-03 14:23:52 +03:00
Nikolai Kochetov
eae2ce194d Processors support for StorageNull reading. 2020-02-03 14:22:21 +03:00
CurtizJ
2d7ff400ed Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-02-03 13:46:00 +03:00
Nikolai Kochetov
fde86203a7 Fix StorageJoin 2020-02-03 13:42:20 +03:00
CurtizJ
a5b5cb2e94 fix query 'ATTACH TABLE IF NOT EXISTS' 2020-02-03 13:38:09 +03:00
Mikhail Korotov
bf3caa0373 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password 2020-02-03 13:08:20 +03:00
Mikhail Filimonov
24ff635435 draft implementation, wip 2020-02-03 11:02:52 +01:00
Guillaume Tassery
4189a0d70b Merge branch 'master' of github.com:ClickHouse/ClickHouse into select_constants 2020-02-03 10:46:37 +01:00
Azat Khuzhin
e89ceae61a Add blockSerializedSize() function (size on disk without compression)
Sometimes it is useful to know how much does this data will take on
disk, with blockSerializedSize() you can know this (although without
compression).

This can be a major knowledge for various aggregation functions that
tracking some state (i.e. uniqCombined).
2020-02-03 11:26:40 +03:00
Azat Khuzhin
f979ce31ca Add NullWriteBuffer 2020-02-03 11:26:04 +03:00
Mikhail Korotov
a8c9385346 Test added 2020-02-03 10:57:52 +03:00
millb
0d91aff981 Code added 2020-02-03 10:40:12 +03:00
alexey-milovidov
c793f30873
Merge pull request #8954 from ClickHouse/os-thread-id
Use OS thread id everywhere instead of internal thread number.
2020-02-03 03:57:35 +03:00
Alexey Milovidov
e1e69771a0 Fixed error in JSONEachRow 2020-02-03 03:04:08 +03:00
Andrew Onyshchuk
15bad674a0 Add AvroConfluent integration test 2020-02-02 18:02:19 -06:00
alexey-milovidov
baf218b431
Merge pull request #8932 from 4ertus2/debt
Rename ANY INNER to SEMI JOIN for partial merge join
2020-02-03 01:53:52 +03:00
Alexey Milovidov
afbb3fca46 Added a test from Vasily Nemkov #8813 2020-02-03 00:11:49 +03:00
Alexey Milovidov
1aedbb3806 Merge branch 'master' of github.com:yandex/ClickHouse 2020-02-03 00:04:36 +03:00
alexey-milovidov
bf4887a33d
Merge pull request #8822 from millb/Prohibition_secondary_index_with_old_format_merge_tree
Prohibition secondary index with old syntax merge tree
2020-02-03 00:04:04 +03:00
alexey-milovidov
d1bfacae4b
Merge pull request #8953 from oandrew/avro-fixes-confluent
AvroConfluent fixes
2020-02-03 00:00:24 +03:00
Alexey Milovidov
1463764199 Removed useless code (found by PVS Studio) 2020-02-02 23:59:18 +03:00
Alexey Milovidov
d7a6951344 Updated test #8938 2020-02-02 23:26:55 +03:00
alexey-milovidov
9e0b40bf09
Revert "Build fixes" 2020-02-02 23:21:49 +03:00
Alexey Milovidov
fc17853c5a Added missing range check to function h3HexAreaM2 #8938 2020-02-02 23:13:06 +03:00
Alexey Milovidov
d11f3cb78f Changed thread_id to UInt64 to support more OS 2020-02-02 23:01:13 +03:00
Alexey Milovidov
5feb40cb6f Updated test 2020-02-02 22:49:53 +03:00
alexey-milovidov
d213f5beae
Update h3EdgeLengthM.cpp 2020-02-02 19:22:59 +03:00
chertus
d2e8b24970 better compatibility in EngineJoin 2020-02-02 19:12:48 +03:00
chertus
8c371ed75f syntax ANY INNER to SEMI LEFT JOIN rewrite 2020-02-02 17:07:50 +03:00
proller
96cfd0b6c2 Merge remote-tracking branch 'upstream/master' into fix27 2020-02-02 14:55:15 +03:00
Andrew Onyshchuk
b236f7a3ae Do not rethrow Poco exception 2020-02-01 22:06:20 -06:00
alexey-milovidov
55c5bdbace
Trigger CI 2020-02-02 05:49:36 +03:00
Alexey Milovidov
39b31907b5 Rename function #7477 2020-02-02 05:35:47 +03:00
Alexey Milovidov
f9eb4e79f6 Using OS tid everywhere #7477 2020-02-02 05:28:14 +03:00
alexey-milovidov
c1535e10d4
Merge pull request #8813 from CurtizJ/merging-in-arrays
Merging #5342 (IN with function result).
2020-02-02 04:33:54 +03:00
alexey-milovidov
ef2346b0fa
Update ActionsVisitor.cpp 2020-02-02 04:33:13 +03:00
alexey-milovidov
3a1e3f612e
Merge branch 'master' into idisk-seekable-readbuffer 2020-02-02 03:54:50 +03:00
Andrew Onyshchuk
927e572d39 AvroConfluent bugfixes 2020-02-01 18:53:11 -06:00
alexey-milovidov
185d11ad72
Merge pull request #8938 from nmandery/h3-hierarchy-master
implement more functions of the H3 library
2020-02-02 03:41:01 +03:00
alexey-milovidov
46583b2c60
Merge pull request #8835 from ClickHouse/alter-partition-dont-allow-strange-expressions
Don't allow strange expressions in ALTER ... PARTITION query
2020-02-02 03:36:59 +03:00
alexey-milovidov
eeacc97d2f
Merge pull request #8852 from vitlibar/RBAC-4
RBAC-4
2020-02-02 03:35:31 +03:00
alexey-milovidov
dbf998cc30
Merge pull request #8947 from ClickHouse/sum-map-add-perf-test
Added performance test for sumMap
2020-02-02 03:35:04 +03:00
alexey-milovidov
4fcf041383
Merge pull request #8945 from ClickHouse/h3-range-check
Added range check to function h3EdgeLengthM
2020-02-02 03:34:05 +03:00
alexey-milovidov
df44bfa771
Merge pull request #8950 from Alex-Burmak/s3_min_upload_part_size
Support of s3_min_upload_part_size setting in DiskS3
2020-02-02 03:33:50 +03:00
alexey-milovidov
b4b30202b1
Merge pull request #8949 from oandrew/avro-fixes
Avro format improvements
2020-02-02 03:33:20 +03:00
Andrew Onyshchuk
16d4990088 Get rid of SkipFnHolder 2020-02-01 11:13:50 -06:00
Vitaly Baranov
63079c40c2 Optimize access checking. 2020-02-01 17:31:25 +03:00
Alexander Burmak
0c0ad54366 Support of s3_min_upload_part_size setting in DiskS3 2020-02-01 12:28:04 +03:00
Andrew Onyshchuk
b84d5c2139 Add support for references 2020-01-31 22:13:12 -06:00
Andrew Onyshchuk
1b308142d6 Support for AVRO_FIXED inserted into String 2020-01-31 18:11:51 -06:00
Alexey Milovidov
bafc5aa7b7 Added performance test for sumMap 2020-02-01 02:01:02 +03:00
alexey-milovidov
8253134739
Merge pull request #8935 from millb/CRLF_in_CSV_2
CRLF in CSV output format
2020-02-01 01:52:44 +03:00
alexey-milovidov
45497b4ed6
Merge pull request #8940 from ClickHouse/show-tables-not-like
Fixed ridiculous bug #8727
2020-02-01 01:44:51 +03:00
Alexey Milovidov
9701b006af Merge branch 'master' of github.com:yandex/ClickHouse 2020-01-31 23:24:30 +03:00
Alexey Milovidov
ef0a6000e4 Add test 2020-01-31 23:24:18 +03:00
alexey-milovidov
d20bae03fb
Merge pull request #8908 from azat/fixes
Tiny fixes
2020-01-31 23:22:30 +03:00
alexey-milovidov
41fb856da2
Merge pull request #8933 from bgiard/summing_merge_tree_strings
String keys in SummingMergeTree maps
2020-01-31 23:20:46 +03:00
Alexey Milovidov
b6761d31f3 Added range check to function h3EdgeLengthM 2020-01-31 23:16:46 +03:00
Alexey Milovidov
6f0114910f Added test #8727 2020-01-31 21:43:29 +03:00
Alexey Milovidov
1b24968b48 Fixed ridiculous bug #8727 2020-01-31 21:42:08 +03:00
Mikhail Korotov
c1bb0d953c fixed test 2020-01-31 21:31:51 +03:00
Mikhail Korotov
92889d846f solved conflict 2020-01-31 21:29:30 +03:00
Mikhail Korotov
f170a19eb3 Test style fixed 2020-01-31 21:25:21 +03:00
Nico Mandery
23c9902433 h3 hierarchical functions and string conversion 2020-01-31 18:49:17 +01:00
Vitaly Baranov
caeed69fe0 Change access rights dynamically when users.xml is edited. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
10c912dab2 Rewrite the User class to be controlled by AccessControlManager. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
168002376b Remove old access rights checking code. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
a5a2fe1260 Change test '00305_http_and_readonly' because DROP TABLE IF EXISTS now works in readonly mode in case the table doesn't exist. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
2aa58193c8 Check access rights via new interface. 2020-01-31 20:27:28 +03:00
Nikolai Kochetov
cef9db809f Processors support for StorageMySQL reading. 2020-01-31 19:46:27 +03:00
Nikolai Kochetov
dd888f59a7 Fix MemorySource. 2020-01-31 19:36:57 +03:00
Nikolai Kochetov
edd2477ca7 Processors support for StorageMerge reading. 2020-01-31 19:32:00 +03:00
Nikolai Kochetov
dbffabfd46 Processors support for StorageMerge reading. 2020-01-31 19:31:08 +03:00
Nikolai Kochetov
7bedce40ea Processors support for StorageMerge reading. 2020-01-31 19:29:40 +03:00
Vitaly Baranov
9e910222da Add interfaces to check access rights. 2020-01-31 19:23:33 +03:00
Vitaly Baranov
6a8a69fd0c Use the generic class ext::scope_guard for subscriptions in IAccessStorage instead of a special class. 2020-01-31 19:23:33 +03:00
tavplubix
d43d84e71d
Merge pull request #8899 from achulkov2/issue-8864_show_create_table_bad_error_message
Issue 8864 show create table bad error message
2020-01-31 19:10:21 +03:00
alexey-milovidov
c2c5b81b70
Merge pull request #8851 from excitoon-favorites/globss3
Added globs/wildcards for s3
2020-01-31 18:56:06 +03:00
alexey-milovidov
9eb01b16fd
Merge pull request #8913 from nvartolomei/nv/alter-mv-replace-v20.1
ALTER <materialized view name> MODIFY QUERY <select_query>
2020-01-31 18:44:32 +03:00
alexey-milovidov
10dbe61089
Update 01019_alter_materialized_view_query.sql 2020-01-31 18:43:32 +03:00
Nikolai Kochetov
dc96e6d1cf Processors support for StorageMemory reading. 2020-01-31 18:26:10 +03:00
Nikolai Kochetov
fc7839716f Processors support for StorageMaterializedView reading. 2020-01-31 18:16:06 +03:00
Mikhail Korotov
0147f171ad
Update 01073_crlf_in_output_csv_format.sh 2020-01-31 18:10:46 +03:00
Nikolai Kochetov
046ff34525 Processors support for StorageLog reading. 2020-01-31 18:10:10 +03:00
Mikhail Korotov
757247cbd5 tests fixed 2020-01-31 18:06:31 +03:00
Mikhail Korotov
182b2a626c test added 2020-01-31 18:01:37 +03:00
Nikolai Kochetov
384e68d745 Processors support for StorageJoin reading. 2020-01-31 17:51:09 +03:00
Baudouin Giard
fbbf026277 String keys in SummingMergeTree maps
Accept String or FixedString data types as key for maps in the
SummingMergeTree now that sumMap supports these two types (introduced in
bc0fbd688a).

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-01-31 14:37:28 +00:00
chertus
71d2050000 rename ANY INNER to SEMI JOIN for partial merge join 2020-01-31 17:29:49 +03:00
Nikolai Kochetov
f9db37ebf7 Processors support for StorageInput reading. 2020-01-31 17:26:51 +03:00
Nikolai Kochetov
6870132713 Processors support for StorageHDFS reading. 2020-01-31 17:06:43 +03:00
Nikolai Kochetov
2d1f06a49f Processors support for StorageFile reading. 2020-01-31 16:12:11 +03:00
millb
0f5e43ec51 Attempt 2020-01-31 16:02:53 +03:00
Vitaly Baranov
035740f708
Merge pull request #8907 from vitlibar/drop-temporary-table-removes-only-temporary
DROP TEMPORARY TABLE now drops only temporary table.
2020-01-31 14:48:24 +03:00
Mikhail Korotov
14acdffb0e
Update DirectoryMonitor.cpp 2020-01-31 14:29:21 +03:00
Mikhail Korotov
5c5b76d2b0
Update DirectoryMonitor.cpp 2020-01-31 14:28:39 +03:00
millb
d05642575d fixed 2020-01-31 14:16:46 +03:00
proller
56a1fd9903 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-31 14:08:08 +03:00
millb
2dab300ad4 attempt 2020-01-31 13:49:10 +03:00
millb
613b7314f6 fixed bugs 2020-01-31 12:29:28 +03:00
millb
165afabdd2 second attempt 2020-01-31 12:22:30 +03:00
Pavel Kovalenko
e615f72749 Fixed DiskTest 2020-01-31 12:05:41 +03:00
Nikolai Kochetov
0157de021a Processors support for StorageDistributed reading. 2020-01-31 11:54:57 +03:00
Nikolai Kochetov
240f1e3e96 Processors support for StorageDictionary. 2020-01-31 11:14:20 +03:00
Nikolai Kochetov
c5289212ca
Merge pull request #8902 from ClickHouse/storage-buffer-processors
Storage buffer processors
2020-01-31 10:46:16 +03:00
Alexey Milovidov
51f55b3eed Added test 2020-01-31 05:07:02 +03:00
Alexey Milovidov
54f1cea22c Merge branch 'master' into alter-partition-dont-allow-strange-expressions 2020-01-31 04:35:33 +03:00
alexey-milovidov
0f800b2e73
Merge pull request #8910 from PerformanceVision/jit_nullable
Unexpected column in LLVMExecutableFunction when we use Nullable type when we use the JIT
2020-01-31 04:32:10 +03:00
Alexey Milovidov
26e328c7e2 Minor modifications for #8860 2020-01-31 04:10:12 +03:00
alexey-milovidov
dedf513aa3
Merge pull request #8860 from Avogar/json_each_row
Allow data in square brackets in JSONEachRowFormat.
2020-01-31 04:06:27 +03:00
alexey-milovidov
d76d55335e
Merge pull request #8914 from bgiard/range_reader
Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink
2020-01-31 03:57:52 +03:00
alexey-milovidov
5d3c62cd52
Merge pull request #8917 from filimonov/kafka_fixes_part2
Kafka fixes part2
2020-01-31 03:55:46 +03:00
proller
bec5289477 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-31 02:42:07 +03:00
Vitaly Baranov
8492b02511 Add test. 2020-01-31 02:37:40 +03:00
alexey-milovidov
835a435347
Merge pull request #8903 from bgiard/sum_map_strings
Add support of String and FixedString keys for sumMap
2020-01-31 01:02:16 +03:00
Mikhail Filimonov
a6e3265960 Kafka proper rebalances processing, controlled assignment, faster tests 2020-01-30 20:30:45 +01:00
Pavel Kovalenko
52db32fd5d Fixed reading from StorageLog table. 2020-01-30 22:30:42 +03:00
Pavel Kovalenko
9efda05839 StorageLog test with DiskLocal and DiskMemory. 2020-01-30 22:29:30 +03:00
proller
402b8608e1 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-30 19:47:01 +03:00
proller
e6ec39bf20 Fix gcc8 2020-01-30 19:46:36 +03:00
achulkov2
1f97500756 Address comment 2020-01-30 19:41:58 +03:00
achulkov2
0482ab8eaa Address comment 2020-01-30 19:35:33 +03:00
Nikolai Kochetov
a039deed2d Update TreeExecutorBlockInputStream. 2020-01-30 19:17:46 +03:00
alexey-milovidov
8f75797801
Merge pull request #8906 from zlobober/key_conditions
Extend KeyCondition interface so that it returns BoolMask.
2020-01-30 18:52:47 +03:00
Baudouin Giard
9216c5761c Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink
It looks like most times the original number of rows per granule is
pretty much consistent across all granules, except for the last one,
however there seems to be cases (Issue #7713) where that's not the case.

The only way I have to reproduce the crash involves using proprietary
data, and unfortunately I haven't been able to come up with a test case
that would highlight the problem - just like the person who opened issue
7713. I can't share my dataset.

Reading the code, it looks pretty obvious to me here - unless I'm
missing something, that the intention here is to copy the corresponding
granules to one another so it makes sense to index
rows_per_granule_original with the same variable as rows_per_granule.

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-01-30 15:40:48 +00:00
achulkov2
68cf5104e1 Fix types 2020-01-30 18:17:20 +03:00
proller
cd0e9217da Merge remote-tracking branch 'upstream/master' into fix27 2020-01-30 18:11:22 +03:00
achulkov2
07699df1e8 Address comments 2020-01-30 17:59:16 +03:00
Ivan Lezhankin
a42c5b4076 Initialize TraceCollector before setting signal handlers 2020-01-30 17:31:01 +03:00
Nicolae Vartolomei
fd42d1ee87 ALTER <materialized view name> MODIFY QUERY <select_query>
Trying to resurrect https://github.com/ClickHouse/ClickHouse/pull/7533.
I'd like to get this PR in if we have an agreement on syntax and general
direction, after that I'll rebase actual alter functionality from above mentioned PR.
2020-01-30 14:12:49 +00:00
Avogar
75fe61251b Add test for data in square brackets in JSONEachRow. 2020-01-30 17:03:07 +03:00
Avogar
c5b0b6ba29 Merge branch 'master' of github.com:yandex/ClickHouse into json_each_row 2020-01-30 16:43:32 +03:00
Avogar
e219fc1e68 Change method of parsing data in square brackets by adding parsing stages. 2020-01-30 15:05:27 +03:00
Ivan Lezhankin
d36f082094 Merge remote-tracking branch 'upstream/master' into memory-profiler 2020-01-30 14:36:59 +03:00
Guillaume Tassery
c18fb015ac Merge branch 'master' of github.com:ClickHouse/ClickHouse into jit_nullable 2020-01-30 12:31:36 +01:00
Guillaume Tassery
be45e1b3b6 cosmetic 2020-01-30 12:31:21 +01:00
Guillaume Tassery
7d3c677921 Accept nullable for JIT function 2020-01-30 12:31:21 +01:00
Guillaume Tassery
a0e91fc9f6 Accept nullable values when we use the JIT feature 2020-01-30 12:31:21 +01:00
millb
236f461420 attempt 2020-01-30 14:15:43 +03:00
Nikolai Kochetov
3c4fe4f20e Fix StorageBuffer/ 2020-01-30 13:30:48 +03:00
Nikolai Kochetov
00546498b6 Fix StorageBuffer/ 2020-01-30 13:26:25 +03:00
Nikolai Kochetov
9eb97e6db2 Fix StorageBuffer/ 2020-01-30 13:22:59 +03:00
Vladimir Chebotarev
4b2eff8551 Added passing ttl info between replicas. 2020-01-30 13:21:40 +03:00
Nikolai Kochetov
5fd9db4370 Fix BufferSource. 2020-01-30 10:32:54 +03:00
Nikolai Kochetov
a5b016eb61 Fix BufferSource. 2020-01-30 10:28:49 +03:00
Nikolai Kochetov
ab5c4bed3a
Merge pull request #8823 from ClickHouse/storage-system-processors
Processors and system storages.
2020-01-30 10:22:31 +03:00
millb
f7ab01b746 Merge branch 'Prohibition_secondary_index_with_old_format_merge_tree' of https://github.com/millb/ClickHouse into Prohibition_secondary_index_with_old_format_merge_tree 2020-01-30 10:13:52 +03:00
millb
7e1a23d910 fixed 2020-01-30 10:13:09 +03:00
Vladimir Chebotarev
9706374066 Fixed error messages. 2020-01-30 09:17:55 +03:00
Azat Khuzhin
ca8d9ac7f8 Fix error message for force_optimize_skip_unused_shards 2020-01-30 09:01:54 +03:00
Azat Khuzhin
c6d95e9dfd Rename tables to match the test number for 01071_force_optimize_skip_unused_shards 2020-01-30 09:01:45 +03:00
Vitaly Baranov
e37eda3bdf DROP TEMPORARY TABLE now drops only a temporary table. 2020-01-30 02:41:22 +03:00
Maxim Akhmedov
fa16149e1a Fix style checks. 2020-01-30 02:36:39 +03:00
Maxim Akhmedov
2d3321e003 Extend KeyCondition interface so that it returns BoolMask. 2020-01-30 00:40:22 +03:00
Alexander Kuzmenkov
09b8f34370
Merge pull request #8896 from ClickHouse/aku/enum-wrong-value
Report BAD_ARGUMENTS for a wrong user-supplied enum value.
2020-01-30 00:25:17 +03:00
Ubuntu
bc0fbd688a Make sumMap accept String keys
Adapt sumMap to accept an array of strings as the key column. This is useful when we do not want or cannot make the keys be numbers.

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-01-29 19:38:41 +00:00
achulkov2
0bece0c43e Fix error with consecutive detach and attach 2020-01-29 21:45:03 +03:00
Nikolai Kochetov
d1bc3513a2 Fix build. 2020-01-29 21:22:09 +03:00
Nikolai Kochetov
0c4f6eaca9 Fix build. 2020-01-29 21:18:12 +03:00
Nikolai Kochetov
84a392402f Processors reading for StorageBuffer. 2020-01-29 21:14:40 +03:00
Nikolai Kochetov
bded6e5cff Added holded contexts and storages to Pipe. 2020-01-29 19:59:11 +03:00
alexey-milovidov
b567907431
Merge pull request #8868 from amosbird/countoptfix
Fix `MakeSet` in Group By
2020-01-29 19:53:41 +03:00
Ivan Lezhankin
56f6199b11 Try to simplify TraceCollector initialization.
It allows to workaround first call inside signal handler
2020-01-29 19:34:55 +03:00
Nikolai Kochetov
e7a29b24e5 Added table locks to Pipe. 2020-01-29 18:55:13 +03:00
Nikolai Kochetov
6cb86cef24 Added AddingMissedTransform. 2020-01-29 18:35:43 +03:00
Nikolai Kochetov
81d4fd9579 Add prepared pipe to InterpreterSelectQuery. 2020-01-29 18:04:46 +03:00
achulkov2
cdfffd343d Fix unreachable check 2020-01-29 17:57:22 +03:00
Nikolai Kochetov
162a2cb2f4 update SourceFromSingleChunk 2020-01-29 17:32:38 +03:00
Alexander Kuzmenkov
975f042dc0 Report BAD_ARGUMENTS for a wrong user-supplied enum value.
Before we reported LOGICAL_ERROR that is incorrect.
2020-01-29 17:17:34 +03:00
achulkov2
61ff06be70 Experimenting 2020-01-29 16:12:11 +03:00
alexey-milovidov
f65b75ce5a
Merge pull request #8874 from abyss7/issue-6964
Initialize query profiler for all threads in a group
2020-01-29 15:41:59 +03:00
Nikolai Kochetov
74d1eb90df Automatically call progress for SourceWithProgress. 2020-01-29 13:26:08 +03:00
Nikolai Kochetov
57100fc962 Merge branch 'master' into storage-system-processors 2020-01-29 13:17:18 +03:00
Nikolai Kochetov
8ce6040306
Merge pull request #7796 from ClickHouse/processors-4.3
Processors and system.numbers
2020-01-29 13:11:13 +03:00
Guillaume Tassery
79b4b48528 cosmetic 2020-01-29 11:09:27 +01:00
Guillaume Tassery
0f348eb121 add tests 2020-01-29 11:02:10 +01:00
Guillaume Tassery
da67f408a3 Fix out of bounds error when we have a constant 2020-01-29 11:01:42 +01:00
alesapin
9b822e926a
Merge pull request #8882 from CurtizJ/fix-integration-test
Fix integration test 'prefer_localhost_replica'.
2020-01-29 11:34:39 +03:00
alesapin
abe9ce8774
Merge pull request #8884 from azat/client-suggest-merge_tree_settings
Add system.merge_tree_settings into clickhouse-client suggest
2020-01-29 11:26:24 +03:00
alexey-milovidov
2f9dd8e80f
Merge pull request #8877 from ClickHouse/aku/trace-readability
Reformat stack traces for readability.
2020-01-29 02:19:18 +03:00
alexey-milovidov
bcab6e7ac1
Merge pull request #8880 from ClickHouse/Akazz-clickhouse-test-patch-1
A followup to #8858: fixed awk invokation in hung queries check
2020-01-29 02:14:43 +03:00
Amos Bird
b650f1563a
Fix MakeSet in Group By 2020-01-29 04:49:39 +08:00
Azat Khuzhin
60d63081da Fix min_marks_for_seek for the data skipping indexes 2020-01-28 23:10:06 +03:00
Azat Khuzhin
3aeea41369 Add system.merge_tree_settings into clickhouse-client suggest 2020-01-28 22:25:43 +03:00
alexey-milovidov
e2860f8525
Merge pull request #8883 from ClickHouse/fix-storage-file-too-many-open-files
Updated internal testing script.
2020-01-28 22:21:58 +03:00
Alexey Milovidov
569e1ff666 Update testing script 2020-01-28 22:17:30 +03:00
alexey-milovidov
30c11474c8
Merge pull request #8834 from zlobober/comparable_nulls
Make NULLs comparable to everything.
2020-01-28 21:58:59 +03:00
CurtizJ
3144e81cb5 fix test prefer_localhost_replica 2020-01-28 21:54:25 +03:00
Alexander Kazakov
cebeae0055 Fixed awk invokation in hung queries check 2020-01-28 20:21:57 +03:00
Alexey Milovidov
3a5de8b874 Update script for CHYT 2020-01-28 19:59:32 +03:00
Nikolai Kochetov
196bb81a6e Update TreeExecutor. 2020-01-28 19:59:28 +03:00
Pavel Kovalenko
e0cd6b1073 Formatting issues. 2020-01-28 19:09:24 +03:00
Pavel Kovalenko
efeb9e92be StorageLog Gtest 2020-01-28 19:08:30 +03:00
Ivan Lezhankin
df0a3ce221 Merge remote-tracking branch 'upstream/master' into memory-profiler 2020-01-28 18:34:19 +03:00
Ivan Lezhankin
354ceeda80 Fix TSan tests 2020-01-28 18:30:49 +03:00
Alexander Kuzmenkov
37daed2830 Reformat stack traces for readability. 2020-01-28 17:42:58 +03:00
Mikhail Filimonov
dc43728dea Test showing the problem with partial commit of polled batch + fix 2020-01-28 15:21:36 +01:00
achulkov2
34eee12d47 Fix style check 2020-01-28 17:21:02 +03:00
Ding Xiang Fei
55b81c97e6 Set signal before rethrowing exception (#8736)
* set signal before rethrowing exception
* Add comment
2020-01-28 16:47:47 +03:00
Pavel Kovalenko
856592e26b Comments fixed. 2020-01-28 16:46:02 +03:00
Pavel Kovalenko
a12c318f35 Optimize includes. 2020-01-28 16:38:46 +03:00
Andrei Chulkov
5f2ed57c49 Add some comments & new tests for different input types 2020-01-28 16:25:55 +03:00
Mikhail Filimonov
5dafccf410 Test for flushing by time and by block size (+fix), one extra test for virual columns 2020-01-28 14:24:37 +01:00
Nikolai Kochetov
fea33f8b60 Add processlist to PipelineExecutor. Throw exception if query was killed. 2020-01-28 16:16:02 +03:00
Pavel Kovalenko
0572f96656 Formatting issues. 2020-01-28 16:15:47 +03:00
Pavel Kovalenko
baa3c8e55b Formatting issues. 2020-01-28 16:05:37 +03:00
Pavel Kovalenko
3eb59d1ed3 Formatting issues. 2020-01-28 16:01:08 +03:00
Nikolai Kochetov
5a8a367228 Add processlist to PipelineExecutor. Throw exception if query was killed. 2020-01-28 15:59:34 +03:00
Pavel Kovalenko
d4707ca911 Seek reworking. 2020-01-28 15:48:01 +03:00
Pavel Kovalenko
861ddbcadd DiskS3 Metadata refactoring. 2020-01-28 15:46:39 +03:00
Maxim Akhmedov
65356ea893 And one more fix. 2020-01-28 15:33:25 +03:00
Maxim Akhmedov
ead37dc294 Fix comparison between decimal field and null. 2020-01-28 15:31:17 +03:00
Ivan Lezhankin
eb5e577f14 Use memory tracker on query level. 2020-01-28 15:31:10 +03:00
Andrei Chulkov
d2e4f4e778 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into polygon-dict-basic-interface-improvements 2020-01-28 15:06:36 +03:00
Ivan Lezhankin
27986b6658 Revert "Merge pull request #8831 from ClickHouse/revert-8820-issue-6964"
This reverts commit a21d3712eb, reversing
changes made to 667e9ed6d4.
2020-01-28 15:01:45 +03:00
Ivan Lezhankin
a592049ca3 Merge remote-tracking branch 'upstream/master' into issue-6964 2020-01-28 15:01:33 +03:00
Ivan Lezhankin
06f5a274ec Fix initialization of QueryProfiler with regard to query context. 2020-01-28 14:59:06 +03:00
Nikolai Kochetov
a19c8b3d37 Update LimitTransform. 2020-01-28 14:50:22 +03:00
alesapin
e27a3170bc Less flaps in tests 2020-01-28 13:58:37 +03:00
alexey-milovidov
1f90d2f078
Merge pull request #8866 from achulkov2/issue-8865_unnamed_tuples_should_not_be_flattened
Issue 8865 unnamed tuples should not be flattened
2020-01-28 12:32:58 +03:00
alexey-milovidov
45dce57a8c
Merge pull request #8830 from zlobober/storage_properties
Explicitly specify storage features
2020-01-28 01:49:53 +03:00
alexey-milovidov
74786e3584
Merge pull request #8858 from ClickHouse/Akazz-clickhouse-test-patch-1
In clickhouse-test: Updated check for hung queries
2020-01-28 01:45:32 +03:00
alexey-milovidov
acc5fad41a
Merge pull request #8848 from ClickHouse/fix-pipeline-dump
Do not dump pipeline in exception message.
2020-01-28 01:44:23 +03:00
alexey-milovidov
7795c9c889
Merge pull request #8861 from ClickHouse/fix-storage-file-too-many-open-files
Fix StorageFile too many open files error
2020-01-28 01:35:39 +03:00
Vladimir Chebotarev
f98de4e098 Added tests for _file and _path in S3 storage. 2020-01-28 01:09:21 +03:00
Vladimir Chebotarev
11a5cab7bd Added some tests. 2020-01-28 00:44:18 +03:00
Andrei Chulkov
7395c0eadc Rename columns to avoid ambiguity with sql 2020-01-28 00:09:38 +03:00
Andrei Chulkov
d8f7383fd7 Add test 2020-01-28 00:04:46 +03:00
Andrei Chulkov
33339e6347 tmp 2020-01-27 23:28:20 +03:00
achulkov2
b7c9075e53 Stop flattening unnamed nested tuples 2020-01-27 23:26:39 +03:00
Vladimir Chebotarev
533011a5f5 Minor review and style fixes. 2020-01-27 23:08:43 +03:00
Pavel Kovalenko
cb3693f071 Formatting issues. 2020-01-27 22:51:48 +03:00
alexey-milovidov
75ebebde4f
Merge pull request #8845 from ClickHouse/client-vertical-fix
Fixed ugly error with vertical format in Client
2020-01-27 22:36:12 +03:00
Pavel Kovalenko
699a031c7f Code style issues. 2020-01-27 22:27:52 +03:00
Pavel Kovalenko
47e7c8d474 Formatting issues. 2020-01-27 22:17:22 +03:00
Pavel Kovalenko
0df5f89a47 Minor formatting. 2020-01-27 22:01:18 +03:00
Pavel Kovalenko
6501ca735b Minor formatting. 2020-01-27 21:59:52 +03:00
Pavel Kovalenko
07755ec8f7 Merge branch 'master' into idisk-seekable-readbuffer
# Conflicts:
#	dbms/programs/server/config.xml
2020-01-27 21:45:53 +03:00
Pavel Kovalenko
abfacdaadc SeekableReadBuffer refactoring.
Store size and multiple references for S3 metadata file.
Log engine support for S3.
2020-01-27 21:44:30 +03:00
Maxim Akhmedov
2e9538f768 Another fix for tests. Better handling of MV. 2020-01-27 21:28:37 +03:00
Alexey Milovidov
390745cc81 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:26:58 +03:00
Alexey Milovidov
1ce32211cf Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:25:54 +03:00
Alexey Milovidov
59ef3c8034 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:13:02 +03:00
Nikolai Kochetov
d34cf8a5bb Fix build. 2020-01-27 21:12:27 +03:00
Avogar
e8dc8bc0ec Allow data in square brackets in JSONEachRowFormat. 2020-01-27 21:09:36 +03:00
Nikolai Kochetov
f94eb7a0ff Update ISource. 2020-01-27 21:09:20 +03:00
Alexander Kazakov
6b355aa273 Moved around some logic of hung_check detector 2020-01-27 21:04:12 +03:00
Alexander Kazakov
c6c3c4347b Keep stderr when collecting stacktraces 2020-01-27 20:47:05 +03:00
Nikolai Kochetov
733df795a3 Fix IBlockInputStream 2020-01-27 20:12:55 +03:00
achulkov2
e30956d05a Rewrite some code and try new input methods 1.0 2020-01-27 20:08:29 +03:00
Alexey Milovidov
a1f05d3a56 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 20:06:32 +03:00
Nikolai Kochetov
43455d79b4 Add time limit to SourceWithProgress. 2020-01-27 19:58:25 +03:00
Alexander Kazakov
0106040a2f
In clickhouse-test: Updated check for hung queries 2020-01-27 19:51:48 +03:00
Nikolai Kochetov
45741eb03a Add cancell to SourceFromInputStream. 2020-01-27 19:16:06 +03:00
Nikolai Kochetov
6a656e8ee8 Add cancell to SourceFromInputStream. 2020-01-27 19:03:55 +03:00
proller
936c357e05 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-27 17:54:43 +03:00
Nikolai Kochetov
902b977d9d Add cancell to SourceFromInputStream. 2020-01-27 17:39:14 +03:00
Nikolai Kochetov
73ee23c1d8 Add cancell to SourceFromInputStream. 2020-01-27 17:31:40 +03:00
Maxim Akhmedov
af7e66f0da Make NULLs comparable to everything. 2020-01-27 17:28:57 +03:00
Maxim Akhmedov
675d0f549f Add replication and deduplication properties. 2020-01-27 17:14:49 +03:00
Maxim Akhmedov
419f2c2c2b Fix segmentation fault. 2020-01-27 16:04:01 +03:00
Nikolai Kochetov
ef268d7016 Fix TablesBlockSource. 2020-01-27 16:00:18 +03:00
Alexey Milovidov
205c0f7fbb Added comment 2020-01-27 15:43:28 +03:00
alexey-milovidov
4613615b4a
Merge pull request #8850 from excitoon-favorites/fixcolumns
Fixed `StorageInput::StorageInput` a little bit
2020-01-27 15:26:10 +03:00
CurtizJ
a5d9975e37 better checking if table has TTL 2020-01-27 14:53:50 +03:00
Nikolai Kochetov
a9c09b88c3 Update ISource 2020-01-27 13:59:54 +03:00
chertus
0886bfb9bc fix test 2020-01-27 13:57:31 +03:00
Vladimir Chebotarev
18804407aa Properly added _file and _path columns. 2020-01-27 13:22:49 +03:00
Vladimir Chebotarev
3d0d31f62a Fixed StorageInput::StorageInput a little bit. 2020-01-27 13:19:14 +03:00
Nikolai Kochetov
2c025a8bd1 Add progress. 2020-01-27 13:05:57 +03:00
Nikolai Kochetov
77cefbbd42 Do not dump pipeline in exception message. 2020-01-27 12:14:01 +03:00
alexey-milovidov
9ba383cf46
Merge pull request #8843 from ClickHouse/remove-useless-files
Remove useless files
2020-01-26 22:06:27 +03:00
alexey-milovidov
581b20748e
Trigger CI 2020-01-26 21:55:12 +03:00
Alexey Milovidov
47178f1413 Update test 2020-01-26 21:53:24 +03:00
alexey-milovidov
2787960ba2
Merge pull request #8793 from ClickHouse/fix-null-format-for-processors
Update ConvertingAggregatedToChunksTransform.
2020-01-26 21:51:00 +03:00
alexey-milovidov
994192080d
Merge pull request #8837 from ClickHouse/query-profiler-workaround-google-cloud-runner
Added workaround for Google Cloud Run
2020-01-26 21:46:16 +03:00
Alexey Milovidov
87ee9ac099 Fixed ugly error in Client 2020-01-26 21:43:44 +03:00
Alexey Milovidov
5d52261266 Remove useless files 2020-01-26 18:25:58 +03:00
Vladimir Chebotarev
a7d05211c5 Added _file and _path columns. 2020-01-26 17:05:51 +03:00
Alexey Milovidov
4d13f020cd Removed obsolete setting from test 2020-01-26 16:36:37 +03:00
Vladimir Chebotarev
61e80e4872 Attempt to add S3 globbing to StorageS3::read. 2020-01-26 16:12:15 +03:00
Vladimir Chebotarev
d2ccbcfb32 Attempt to add S3 globbing function. 2020-01-26 16:03:47 +03:00
alexey-milovidov
056aba49ff
Update QueryProfiler.cpp 2020-01-26 14:27:12 +03:00
alexey-milovidov
9602e67050
Update QueryProfiler.cpp 2020-01-26 14:25:28 +03:00
Alexey Milovidov
2acb71337f Added workaround for Google Cloud Runner 2020-01-26 14:19:04 +03:00
Nikolai Kochetov
679e38e336 Added comments. 2020-01-26 10:52:34 +03:00
alexey-milovidov
066b4e745c
Merge pull request #8402 from excitoon-favorites/atomicdelete
"Atomically" remove parts on destroy.
2020-01-26 04:08:13 +03:00
alexey-milovidov
97a75dd8c9
Merge pull request #8786 from millb/X-ClickHouse-Exception-Code
X-ClickHouse-Exception-Code in HTTP Header
2020-01-26 03:43:38 +03:00
Alexey Milovidov
940804ee6d Don't allow strange expressions in ALTER ... PARTITION query 2020-01-26 03:22:34 +03:00
alexey-milovidov
2df93a6d21
Merge pull request #8756 from azat/distributed_storage_configuration
Multiple disks/volumes for storing data for send in Distributed engine
2020-01-26 02:19:28 +03:00
Maxim Akhmedov
382eed249f Fix style issue. 2020-01-26 00:33:32 +03:00
Vladimir Chebotarev
ca2d381743 Prettier removal of part data on destroy. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
b35a6d1ce3 Got rid of ugly relative paths while deleting on destroy. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
fdef1d6935 Increased some timeouts in test_multiple_disks and test_ttl_move. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
2d749630b7 Fixed temporary path for part being erased. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
3f11569d94 "Atomically" remove parts on destroy. 2020-01-26 00:27:46 +03:00
alexey-milovidov
49c77c65f2
Update Settings.h 2020-01-26 00:04:34 +03:00
alexey-milovidov
196ed889b9
Merge branch 'master' into joins 2020-01-26 00:03:56 +03:00
alexey-milovidov
9814831c8f
Merge pull request #8827 from zlobober/disable_mmap
Allow disabling mmapping
2020-01-25 23:42:04 +03:00
Maxim Akhmedov
338bd3e919 Remove commented line. 2020-01-25 23:39:53 +03:00
alexey-milovidov
9f3bbea6eb
Merge pull request #8806 from ClickHouse/vzakaznikov-issue_7878_3
Reworking fix for issue 7878 (version 4)
2020-01-25 23:39:49 +03:00
alexey-milovidov
aff87dbd82
Update AggregatingTransform.cpp 2020-01-25 23:36:25 +03:00
alexey-milovidov
328dc523c5
Update AggregatingTransform.cpp 2020-01-25 23:36:12 +03:00
alexey-milovidov
ab172eb0bd
Revert "Initialize query profiler for all threads in a group" 2020-01-25 23:34:22 +03:00
Maxim Akhmedov
d6f72dc2ce Specify supported features for each storage engine, expose them via system.table_engines table, properly check feature support in storage factory. 2020-01-25 22:44:52 +03:00
Maxim Akhmedov
2f12866bc2 Introduce macro for disabling allocator mmapping. 2020-01-25 22:17:18 +03:00
Alexey Milovidov
667e9ed6d4 Added example to config.xml and fixed formatting after previous committers #8794 2020-01-25 21:47:02 +03:00
alexey-milovidov
1bf614b3a2
Trigger tests. 2020-01-25 21:39:50 +03:00
alexey-milovidov
1630e88c81
Merge pull request #8820 from abyss7/issue-6964
Initialize query profiler for all threads in a group
2020-01-25 21:33:46 +03:00
Azat Khuzhin
5c641b7485 Cover storage_configuration for Distributed engine 2020-01-25 20:52:31 +03:00
Azat Khuzhin
e5a43d2751 Add ability to use multiple disks/volumes for Distributed engine
Now Distributed() has gain the 5-th argument -- policy name (for storing
data to send):

  CREATE TABLE foo (key Int) Engine=Distributed(test_shard_localhost, currentDatabase(), some_table, key%2, 'default');
2020-01-25 20:52:31 +03:00
alexey-milovidov
dc90d42e1e
Merge pull request #8305 from ClickHouse/Vxider-parallel-insert
Vxider parallel insert
2020-01-25 20:30:50 +03:00
alexey-milovidov
2a6b628db9
Merge pull request #8794 from zlobober/custom_query_log_engine
Make system log engine customizable via config.
2020-01-25 17:38:50 +03:00
alexey-milovidov
df4f0c7379
Merge pull request #8805 from azat/force_optimize_skip_unused_shards
force_optimize_skip_unused_shards setting to throw if skipping is not possible
2020-01-25 17:37:59 +03:00
alexey-milovidov
cf2cd05906
Merge pull request #8824 from ClickHouse/fix_loading_live_view
Fix LiveView dependencies
2020-01-25 17:37:29 +03:00
alexey-milovidov
43230c9e5a
Merge pull request #8809 from azat/text_log.level
Add text_log.level to limit entries that goes to system.text_log table
2020-01-25 17:28:35 +03:00
Alexey Milovidov
bf59e09901 Fixed style check 2020-01-25 16:18:17 +03:00
Azat Khuzhin
3c6ce640b0 Cover text_log.level 2020-01-25 14:04:56 +03:00
Azat Khuzhin
6a73cf2381 Add text_log.level to limit entries that goes to system.text_log table
v2: use INT_MAX as default (since 0 is none)
2020-01-25 14:04:49 +03:00
alexey-milovidov
2627e34ddf
Merge pull request #8808 from zlobober/weak_check_stack_size
Make checkStackSize symbol weak.
2020-01-25 03:10:41 +03:00
alexey-milovidov
8bde8e5e14
Update checkStackSize.cpp 2020-01-25 03:10:09 +03:00
alexey-milovidov
095f666677
Update checkStackSize.cpp 2020-01-25 03:06:13 +03:00
alexey-milovidov
eeeaa3243e
Update Defines.h 2020-01-25 03:05:43 +03:00
alexey-milovidov
85237ad27d
Merge pull request #8819 from ClickHouse/add_test_for_constraints
Add test for constraints
2020-01-25 02:56:47 +03:00
Alexander Tokmakov
f9cfc6be3a fix LiveView dependencies 2020-01-25 01:51:23 +03:00
CurtizJ
c1624f0d9d strict field casts while making sets 2020-01-25 00:36:28 +03:00
Alexey Milovidov
43be567512 Added two internal testing scripts [#CLICKHOUSE-4774] 2020-01-24 23:17:34 +03:00
Nikolai Kochetov
302d6b55ca Fix build. 2020-01-24 21:33:47 +03:00
Nikolai Kochetov
7385d3f643 Processors for StorageSystemTables. 2020-01-24 21:25:21 +03:00
Nikolai Kochetov
d53aa80d83 Processors for StorageSystemStoragePolicies. 2020-01-24 21:17:02 +03:00
Azat Khuzhin
6939ffeabf force_optimize_skip_unused_shards setting to throw if skipping is not possible 2020-01-24 21:15:40 +03:00
Azat Khuzhin
c0ba5ed06b Update link to the poco logging levels 2020-01-24 21:13:28 +03:00
Nikolai Kochetov
16106a03c6 Processors for StorageSystemReplicas. 2020-01-24 21:13:17 +03:00
Nikolai Kochetov
0e6362ef7f Processors for StorageSystemPartsBase. 2020-01-24 21:01:21 +03:00
Nikolai Kochetov
9a223a05a5 Processors for StorageSystemOne. 2020-01-24 20:57:27 +03:00
Nikolai Kochetov
ffa3b3c665 Processors for StorageSystemDisks and StorageSystemDetachedParts. 2020-01-24 20:49:14 +03:00
Nikolai Kochetov
f8bf32e99a Added more comments. 2020-01-24 20:35:17 +03:00
Mikhail Korotov
aeb9557edf tests added 2020-01-24 20:04:42 +03:00
Nikolai Kochetov
be0bf9e6f6 Added more comments. 2020-01-24 20:04:41 +03:00
Mikhail Korotov
9e5a88ec89 Merge branch 'Prohibition_secondary_index_with_old_format_merge_tree' of https://github.com/millb/ClickHouse into Prohibition_secondary_index_with_old_format_merge_tree 2020-01-24 19:48:17 +03:00
millb
3299db778b changes applied 2020-01-24 19:47:05 +03:00
Nikolai Kochetov
c3d0c26659 Processors for SystemColumns. 2020-01-24 19:13:46 +03:00
Nikolai Kochetov
dc49635ed4 Processors for IStorageSystemOneBlock. 2020-01-24 18:42:31 +03:00
Ivan Lezhankin
09b39b78e4 Remove obsolete pointer for trace collector in context. 2020-01-24 18:40:08 +03:00
Nikolai Kochetov
61154da744 Processors for IStorageSystemOneBlock. 2020-01-24 18:32:17 +03:00
chertus
a9d0d74720 remove bad MergeJoin optimization 2020-01-24 18:28:40 +03:00
Nikolai Kochetov
cab636cb62 Merged with master. 2020-01-24 18:10:24 +03:00
Ivan Lezhankin
9d30f3c876 Initialize query profiler for all threads in a group 2020-01-24 17:47:38 +03:00
alesapin
47f8679810 Add test for constraints 2020-01-24 17:28:10 +03:00
alexey-milovidov
b3d34da57b
Merge pull request #8072 from millb/suffix_in_settings_value
Parsing suffix for settings values
2020-01-24 17:15:25 +03:00
Mikhail Korotov
474e16fadb
Update 01071_http_header_exception_code.sh 2020-01-24 17:11:13 +03:00
Mikhail Korotov
b9b1dd5cdd tests fixed 2020-01-24 17:08:56 +03:00
Mikhail Korotov
800f8adfee
Update 01071_http_header_exception_code.sh 2020-01-24 14:29:03 +03:00
Mikhail Korotov
79fe132f58
Update 01071_http_header_exception_code.sh 2020-01-24 14:23:49 +03:00
chertus
dbb42e07d8 rename function 2020-01-24 14:19:34 +03:00
Mikhail Korotov
046717fd3f
Update ReadHelpers.h 2020-01-24 13:56:27 +03:00
millb
4480ed5b14 Comments fixed 2020-01-24 13:54:24 +03:00
CurtizJ
14f0b9e137 add query 'ALTER ... MATERIALIZE TTL' 2020-01-24 13:53:14 +03:00
Anton Popov
9fe94ca5f7
fix confusing logic (addition to #8800) 2020-01-24 13:47:19 +03:00
alesapin
95fbef59c9 Fix prometheus test 2020-01-24 12:16:34 +03:00
Nikolai Kochetov
0bfc267f4b Try to fix tests. 2020-01-24 12:09:47 +03:00
alesapin
32783b3cea Fix integration test 2020-01-24 11:55:36 +03:00
Nikolai Kochetov
0b43bd53a4 fix 01019_materialized_view_select_extra_columns 2020-01-24 10:48:22 +03:00
Nikolai Kochetov
d161799b57 Merge branch 'master' into fix-null-format-for-processors 2020-01-24 10:38:19 +03:00
Nikolai Kochetov
b55ae23bb9
Merge pull request #8797 from ClickHouse/fix-null-format-for-processors-2
Skip blocks for Null format with processors.
2020-01-24 10:34:13 +03:00
Alexey Milovidov
b1fcea78b8 Merge branch 'fix-paren' 2020-01-24 07:05:32 +03:00
Alexey Milovidov
3a5c7370b2 Addition to prev. revision #8811 2020-01-24 07:05:15 +03:00
alexey-milovidov
2105c02e85
Merge pull request #8811 from ClickHouse/fix-paren
Fixed bug with parentheses
2020-01-24 07:04:13 +03:00
alexey-milovidov
de32863f73
Merge pull request #8791 from excitoon-favorites/fixdestructeddatapart
Fixed bug with `MergeTreeReadPool`
2020-01-24 06:37:18 +03:00
alexey-milovidov
105b61b2af
Merge pull request #8800 from CurtizJ/fix-alter-with-ttl
Fix alters if there is set TTL for table.
2020-01-24 06:30:45 +03:00
alexey-milovidov
528d231a6b
Merge pull request #8750 from azat/temporary_data_configuration
Multiple paths (disks/volumes) for storing temporary data support
2020-01-24 06:21:52 +03:00
alexey-milovidov
5c9393df97
Merge pull request #8717 from ClickHouse/oandrew-avro
Merging Avro format.
2020-01-24 06:14:09 +03:00
Alexey Milovidov
12d980259e Fixed bug with parentheses 2020-01-24 05:38:03 +03:00
CurtizJ
d8331d9dcb fix in operator with constant arrays 2020-01-24 03:48:40 +03:00
alexey-milovidov
ab162170d2
Merge pull request #8799 from millb/query_log
Fixed 01070_exception_code_in_query_log_table test
2020-01-24 02:30:53 +03:00
Maxim Akhmedov
af54c378ce Make checkStackSize symbol weak. 2020-01-23 23:30:40 +03:00
alexey-milovidov
c698132cca
Merge pull request #8769 from traceon/format-name-http-header
Set X-ClickHouse-Format HTTP response header to the format name
2020-01-23 22:23:26 +03:00
alexey-milovidov
761a3e56a5
Update SystemLog.cpp 2020-01-23 22:21:57 +03:00
Alexey Milovidov
680da3d7ed Merge remote-tracking branch 'origin/master' into oandrew-avro 2020-01-23 22:08:08 +03:00
chertus
d38bf7b4b2 add test 2020-01-23 21:32:16 +03:00
alexey-milovidov
119c7a9670
Update SystemLog.cpp 2020-01-23 21:28:37 +03:00
Nikolai Kochetov
5a8932488d Romve commented code. 2020-01-23 21:02:13 +03:00
Nikolai Kochetov
50f66433e0 Update PushingToViewsBlockOutputStream 2020-01-23 20:51:43 +03:00
Azat Khuzhin
c9cc1ef516 Cover tmp_policy 2020-01-23 20:31:19 +03:00
Azat Khuzhin
88bfb788a9 Add ability to use multiple disks/volumes for temporary data
This patch adds <tmp_policy> config directive, that will define the
policy to use for storing temporary files, if it is not set (default)
the <tmp_path> will be used.

Also tmp_policy has some limitations:
- move_factor              is ignored
- keep_free_space_bytes    is ignored
- max_data_part_size_bytes is ignored
- must have exactly one volume
2020-01-23 20:31:01 +03:00
Nikolai Kochetov
9635c8d5c5 Update PushingToViewsBlockOutputStream 2020-01-23 20:11:49 +03:00
Nikolai Kochetov
7d4d063f38 Try to remove some code. 2020-01-23 18:53:58 +03:00
chertus
3571cdb4b5 correct row limit for many right blocks case 2020-01-23 18:47:49 +03:00
Nikolai Kochetov
25ea3d83e2 Merge branch 'issue_7878_2' of https://github.com/vzakaznikov/ClickHouse into vzakaznikov-issue_7878_2 2020-01-23 18:45:24 +03:00
Nikolai Kochetov
4a4de82648 Merged with master 2020-01-23 18:44:26 +03:00
alexey-milovidov
f563d7f4b3
Merge pull request #8801 from vitlibar/fix-race-system-reload-all-dictionaries
Fix race when executing SYSTEM RELOAD ALL DICTIONARIES.
2020-01-23 18:10:17 +03:00
Nikolai Kochetov
405f9f0696 Fix LazyOutput. 2020-01-23 17:58:50 +03:00
alesapin
1fa6adacbe
Merge pull request #8790 from ClickHouse/disable_flappy_tests
Disable some flappy tests
2020-01-23 17:41:17 +03:00
Mikhail Korotov
c05652067e
Update HTTPHandler.cpp 2020-01-23 16:40:16 +03:00
Mikhail Korotov
276d1c233e
Update 01071_http_header_exception_code.sh 2020-01-23 16:38:55 +03:00
Vitaly Baranov
6a6ec36d63 Fix race when executing SYSTEM RELOAD ALL DICTIONARIES. 2020-01-23 16:35:12 +03:00
CurtizJ
5162ece940 Merge branch 'function_result_with_operator_in' of https://github.com/Enmk/ClickHouse into merging-in-arrays 2020-01-23 16:24:43 +03:00
CurtizJ
1764ba5219 test for alter with ttl 2020-01-23 16:11:06 +03:00
CurtizJ
b5d8baee71 fix alters if ttl is set 2020-01-23 16:04:06 +03:00
Nikolai Kochetov
b3e33b8330 Enable block skip for null format in processors pipeline. 2020-01-23 15:59:01 +03:00
Nikolai Kochetov
f85e7ca36d Enable block skip for null format in processors pipeline. 2020-01-23 15:53:32 +03:00
millb
c441c2fc9c tests fixed 2020-01-23 15:47:13 +03:00
alexey-milovidov
39e34e0339
Merge pull request #8795 from abyss7/replxx
Restore support for \G suffix
2020-01-23 15:37:04 +03:00
Nikolai Kochetov
b6a819c5d8 Fix ConvertingAggregatedToChunksTransform. 2020-01-23 14:45:12 +03:00
Nikolai Kochetov
bceb084512 Fix ConvertingAggregatedToChunksTransform. 2020-01-23 14:44:43 +03:00
Vitaliy Zakaznikov
024dce32d8 Fixing NameOrDefault mode in ConvertingBlockInputStream. 2020-01-23 12:40:27 +01:00
Nikolai Kochetov
8839defb63 Fix ConvertingAggregatedToChunksTransform. 2020-01-23 14:39:42 +03:00
Maxim Akhmedov
86a7f1d97b Make system log engine customizable via config. 2020-01-23 14:22:06 +03:00
Ivan Lezhankin
bfdab88efb Restore \G suffix support 2020-01-23 14:18:47 +03:00
Vladimir Chebotarev
a362664cc1 Better handling of per_part_columns_lock. 2020-01-23 13:08:35 +03:00
Nikolai Kochetov
f431b10e38 Update TCPHandler. 2020-01-23 13:04:18 +03:00
Ivan Lezhankin
a982309cff Fix client hanging on quit 2020-01-23 12:42:58 +03:00
alesapin
e6958c0e49 Disable some flappy tests 2020-01-23 12:01:55 +03:00
Nikolai Kochetov
0e906b29e1
Merge pull request #8783 from ClickHouse/loop-math-perf
Math perftest.
2020-01-23 11:53:30 +03:00
Ivan
b80e3dcd46
Refactoring of replxx (#8748) 2020-01-23 11:18:19 +03:00
alexey-milovidov
2e849490bc
Merge pull request #8770 from millb/query_log
Created column exception_code in query_log table
2020-01-23 06:01:48 +03:00
Alexey Milovidov
64baafd245 Updated Avro test 2020-01-23 05:51:49 +03:00
Alexey Milovidov
d853cffe61 Returned back DateTime64 2020-01-23 05:44:22 +03:00
Alexey Milovidov
9a8211cbff Added Avro roundtrip test 2020-01-23 05:39:58 +03:00
Alexey Milovidov
fb89ffdbb3 Added comments 2020-01-23 05:12:11 +03:00
Alexey Milovidov
35726ac2dd Fixed error in Avro format 2020-01-23 05:03:53 +03:00
Alexey Milovidov
a75ce4477b Fixed error in Avro format 2020-01-23 05:01:58 +03:00
Alexey Milovidov
9f0230d4ba Addition to prev. revision 2020-01-23 04:09:17 +03:00
Alexey Milovidov
fde33ddc47 Addition to prev. revision 2020-01-23 04:06:53 +03:00
Alexey Milovidov
39565eb0b0 Addition to prev. revision 2020-01-23 04:03:32 +03:00
Alexey Milovidov
0c18bcf415 Addition to prev. revision 2020-01-23 03:41:37 +03:00