Commit Graph

25334 Commits

Author SHA1 Message Date
Mikhail Korotov
12c9fbe44d Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-12 17:12:18 +03:00
millb
c4b45ddff8 fixed tests 2020-02-12 17:11:03 +03:00
Alexander Kuzmenkov
48a98773c9
Update general_purpose_hashes_on_UUID.xml 2020-02-12 15:39:44 +03:00
Ivan
bef233f450
Add simple memory profiler (#8765)
* Add new trace type to system.trace_log table

* [WIP]

* Add settings for soft limit raising.

* Remove unused diff

* Remove unused diff

* Some renames

* Fix client hanging on quit

* Remove obsolete pointer for trace collector in context.

* Use memory tracker on query level.

* Fix TSan tests

* Try to simplify TraceCollector initialization.

It allows to workaround first call inside signal handler

* Initialize TraceCollector before setting signal handlers

* Attempt to fix

* Fix Int64 → UInt64 for |size|

* Explicitly reset global TraceCollector instance.
2020-02-12 15:37:40 +03:00
Guillaume Tassery
4ea8cfb1e1 cosmetic 2020-02-12 12:45:31 +01:00
Guillaume Tassery
46bffd0564 add tests 2020-02-12 12:08:14 +01:00
proller
4c3b8649e3 Merge remote-tracking branch 'upstream/master' into fix27 2020-02-12 13:59:14 +03:00
Guillaume Tassery
b9954f6785 Merge branch 'master' of github.com:ClickHouse/ClickHouse into bit_on_bitset 2020-02-12 11:35:07 +01:00
Guillaume Tassery
e5b048ab51 Can use bit(And|Or|Xor) using a bitset set as a FixedString 2020-02-12 11:33:43 +01:00
Mikhail Korotov
43d4838849 Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-12 13:13:50 +03:00
millb
6abeabc1f2 fixed bugs 2020-02-12 13:13:11 +03:00
Mikhail Korotov
5bd74b464d Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-12 13:08:10 +03:00
millb
92fc1a9b2b fixed bugs 2020-02-12 13:06:09 +03:00
Mikhail Korotov
01b03f9b1f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password 2020-02-12 11:43:52 +03:00
Alexander Kuzmenkov
f88bf5595c
Update cpu_synthetic.xml 2020-02-11 22:21:08 +03:00
Alexander Kuzmenkov
5dcca60d98
Update general_purpose_hashes_on_UUID.xml 2020-02-11 22:18:40 +03:00
Alexander Kuzmenkov
413cb601dd
Merge pull request #8969 from filimonov/kafka_producer_with_key_and_timestamp
key and timestamp in Kafka producer
2020-02-11 22:03:37 +03:00
Ivan
1f4ba36cbc
Fix some tests to support pytest with query tests (#9062) 2020-02-11 21:05:08 +03:00
Ilya Yatsishin
5b4b04e13b
Merge pull request #9050 from CurtizJ/fix-range-reader
Fix order of ranges in MergeTreeDataSelectExecutor
2020-02-11 18:31:34 +03:00
Ivan Lezhankin
5644fa8c41 Explicitly reset global TraceCollector instance. 2020-02-11 18:16:53 +03:00
sundy-li
9ad7f3f0e1 Update tests 2020-02-11 22:52:09 +08:00
sundy
250475557d Show Queries more like MySQL 2020-02-11 19:36:12 +08:00
Mikhail Korotov
f8db74fca6 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password 2020-02-11 13:51:37 +03:00
alexey-milovidov
306ee519df
Merge pull request #9073 from mator/patch-1
Update config.xml
2020-02-11 13:50:51 +03:00
Artem Zuikov
840d4c5f4a
Merge pull request #9067 from 4ertus2/some
Refactoring: actualize ExpressionAnalyzer public interface
2020-02-11 13:48:56 +03:00
Anatoly Pugachev
138d3800cf
Update config.xml
correct HTTP 404 link
2020-02-11 13:33:38 +03:00
Nikolai Kochetov
42692ad07b Fix typeo in ExternalModelsLoader. 2020-02-11 08:32:27 +03:00
chertus
b4ea4ca654 actualize ExpressionAnalyzer public interface 2020-02-10 22:55:13 +03:00
Alexander Kuzmenkov
f9a7a32852 less flappy 2020-02-10 21:38:53 +03:00
CurtizJ
90a121cc1e remove useless line 2020-02-10 19:34:47 +03:00
CurtizJ
852772364e replace std::vector to std::deque for MarkRanges 2020-02-10 19:04:24 +03:00
Artem Zuikov
bd6d9a427b
Some InterpreterSelectQuery refactoring (#9035)
move ExpressionActionsChain logic out of InterpreterSelectQuery
2020-02-10 18:50:12 +03:00
Ivan Lezhankin
cc63739837 Fix Int64 → UInt64 for |size| 2020-02-10 18:24:26 +03:00
Alexander Kuzmenkov
d59a9a7ded less flappy 2020-02-10 15:54:16 +03:00
Alexander Kuzmenkov
17de1b7519
Merge pull request #9018 from ClickHouse/aku/flappy-perf
Less flappy performance test queries
2020-02-10 15:52:42 +03:00
alesapin
2734347cc0 More verbose logging in flacky test 2020-02-10 12:16:15 +03:00
tavplubix
4543177931 Merge pull request #9048 from ClickHouse/fix_mutation_order
Fix primary.idx corruption after delete mutation
2020-02-09 19:21:23 +03:00
Alexander Kuzmenkov
2b683f6fc9 boop 2020-02-09 17:15:29 +03:00
Alexander Kuzmenkov
dae3811e25
Merge pull request #9015 from Slach/master
Track the number of MySQL connections
2020-02-09 17:01:01 +03:00
alesapin
19de74d5bd Remove redundant lock 2020-02-09 11:52:42 +03:00
alesapin
2dca542d2e Correctly accuire lock 2020-02-09 11:42:15 +03:00
Andrew Onyshchuk
9d35b8b6ea Use correct implementation for reinterpretAsFixedString 2020-02-08 19:23:09 -06:00
alesapin
5a96eaf0e8 Add missed locks for ReplicatedMergeTree alter 2020-02-08 16:39:44 +03:00
CurtizJ
b9fc9b4569 fix order of ranges in MergeTreeDataSelectExecutor 2020-02-08 00:07:18 +03:00
Alexander Kuzmenkov
ae0044efe8
Update ConfigProcessor.cpp 2020-02-07 22:37:24 +03:00
Alexander Kuzmenkov
b125e6b393 Log which configuration files we loaded. 2020-02-07 22:32:49 +03:00
Alexander Kuzmenkov
75920565c9 Improve flush performance in SystemLog
It started having problems under heavy workloads such as saving all
memory allocations to trace_log table. To improve that, stop popping
entries one by one from the log queue, and actually stop using the queue
completely, because we don't use most of its methods or its backpressure
feature. Just keep a vector of messages and flush it to disk
periodically.
2020-02-07 22:32:49 +03:00
Ivan
1b55150701
Add row-level filter support to Distributed engine (#8926)
* Add tests
* Implement support for initial user on remote side.
2020-02-07 22:31:09 +03:00
Alexander Kuzmenkov
a380c21649
Update general_purpose_hashes.xml 2020-02-07 22:01:13 +03:00
tavplubix
7cd87125c7
Merge pull request #9026 from ClickHouse/fix_poco_ssl_timeouts
Fix poco secure sockets timeouts
2020-02-07 21:46:12 +03:00
tavplubix
c6a8e4d67e
Merge pull request #8958 from ClickHouse/json-each-row-array-fix
Fixed error in JSONEachRow when data is in array.
2020-02-07 21:44:21 +03:00
tavplubix
21fdc52456
Update JSONEachRowRowInputFormat.cpp 2020-02-07 21:43:49 +03:00
alesapin
f9d70e741f
Merge pull request #9047 from ClickHouse/fix_unit_tests
Fix unit tests
2020-02-07 21:30:09 +03:00
Nikita Mikhaylov
1324f3946e
Merge pull request #8988 from nvartolomei/nv/alter-mv-modify-query
Modify Materialized View query
2020-02-07 21:28:27 +03:00
alesapin
dea937ad84 Don't use ORDER BY for empty key 2020-02-07 20:10:24 +03:00
alesapin
c3f24aa075 Fix test and improve run 2020-02-07 19:01:20 +03:00
Ivan Lezhankin
abb1220cb3 Merge branch 'master' into memory-profiler 2020-02-07 18:16:41 +03:00
alesapin
7aa71bb1dd
Merge pull request #8957 from oandrew/avro-fixes-confluent
AvroConfluent integration test
2020-02-07 16:59:37 +03:00
alesapin
1ada6e663c Missed change 2020-02-07 16:56:57 +03:00
alesapin
f3a35998e1 Fix primary.idx corruption after delete mutation 2020-02-07 16:54:17 +03:00
tavplubix
092ed1df15
Update JSONEachRowRowInputFormat.cpp 2020-02-07 16:38:37 +03:00
Alexander Tokmakov
16a3bed290 Merge branch 'master' into fix_poco_ssl_timeouts 2020-02-07 16:36:45 +03:00
Alexander Tokmakov
5fba5f97dd update submodule 2020-02-07 16:35:15 +03:00
Alexander Tokmakov
47ad022a1f disable parallel parsing for JSON in square brackets 2020-02-07 16:16:51 +03:00
Alexander Tokmakov
5956f7400f Replace ParsingStage with readPrefix() and readSuffix() 2020-02-07 14:28:05 +03:00
Anton Popov
3e8179108b
Merge pull request #8892 from PerformanceVision/select_constants
DB::Exception: Parameters are out of bound when we have a constant on the SELECT clause
2020-02-07 14:05:16 +03:00
alesapin
dcfe6524e5 Fix unit tests 2020-02-07 12:51:48 +03:00
alesapin
f4467aaa65
Merge pull request #9028 from Enmk/Gorilla_and_DoubleDelta_buffer_overflow_fix
Fixed buffer overflow on decoding small sequences with Gorilla and DoubleDelta
2020-02-07 11:40:08 +03:00
Slach
8251695383 change system.metrics.MySQLConnection description after review
Signed-off-by: Slach <bloodjazman@gmail.com>
2020-02-07 08:12:00 +05:00
Slach
1bff5578b6 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2020-02-07 08:03:45 +05:00
Anton Popov
9dc7577d15
Merge pull request #9038 from CurtizJ/fix-range-reader
Add test for #8914
2020-02-07 03:47:51 +03:00
Vitaly Baranov
7ebcd4b290
Merge pull request #8875 from vitlibar/RBAC-5
RBAC-5.1
2020-02-07 03:40:15 +03:00
Artem Zuikov
31948a063a
Trying to fix early constant folding (#9010)
add setting to disable early constant folding
2020-02-07 03:05:51 +03:00
Artem Zuikov
31a3f3b48b
revert TypeIndex, another fix for T64 (#9033) 2020-02-07 03:04:25 +03:00
Alexander Kuzmenkov
070ebb6bb6
boop 2020-02-07 01:42:19 +03:00
CurtizJ
cdcaef9349 add test for #8914 2020-02-06 21:57:18 +03:00
Alexander Tokmakov
acef7fc5bd add test 2020-02-06 20:23:05 +03:00
Vitaly Baranov
02262e3b6e Add one more test. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
d2ff1e5dd4 Implement partial revokes. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
3706b9d92a Add tests. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
421120b997 Implement SQL queries to manipulate users and grants. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
c604ce1ca5 Add access_with_grant_option to User. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
c9f2713cc4 Remove getting user by name from Context. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
08c6061bdf Add user_id to Context. 2020-02-06 18:12:54 +03:00
Vitaly Baranov
fb3b755599 Fix granting and revoking access rights. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
328d3a8b08 Add token type '@'. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
291b7c277a Move some part of the Authentication class to header to allow using in the parser. 2020-02-06 18:12:48 +03:00
proller
d69785915e Merge remote-tracking branch 'upstream/master' into fix27 2020-02-06 17:19:30 +03:00
Alexander Kuzmenkov
3df25af15f
Merge pull request #8780 from ClickHouse/aku/msan-final
Suppress the last two MemorySanitizer failures
2020-02-06 16:34:55 +03:00
Alexander Kuzmenkov
ed90f6167c
Update msan_suppressions.txt 2020-02-06 16:34:11 +03:00
Alexander Kuzmenkov
3fb8dcae55 less flappy 2020-02-06 16:11:02 +03:00
Vitaly Baranov
1e8f04b571 Add to class AllowedClientHost support for like pattern and for removing. 2020-02-06 15:25:32 +03:00
Alexander Kuzmenkov
d9073f27b7 Revert "Merge pull request #9025 from ClickHouse/revert-8303-cache-dictionary"
This reverts commit 24bdad3768, reversing
changes made to dad4f03a8f.
2020-02-06 15:18:19 +03:00
Alexander Kuzmenkov
7f9bab3fc5
Merge pull request #8985 from ClickHouse/aku/demangle-faster
Avoid extra copying when demangling names.
2020-02-06 14:57:56 +03:00
Alexander Kuzmenkov
115c89f057 less slow 2020-02-06 14:51:22 +03:00
Nicolae Vartolomei
949b498d37 Always wait for all background INSERTs to finish to catch stuck queries 2020-02-06 11:44:15 +00:00
Nicolae Vartolomei
0939a9460f Modify Materialized View query 2020-02-06 08:57:54 +00:00
Vasily Nemkov
9b64a963c4 Fixed buffer overflow on decoding small sequences with Gorilla and DoubleDelta
* When decoding 0 items with Gorilla
* When decoding 1 or 0 items with DoubleDelta
2020-02-06 16:37:21 +08:00
alesapin
29a26a87b4 Merge pull request #9022 from ClickHouse/mutations_parts_to_do_fix
Fix mutations finalization task
2020-02-06 11:26:13 +03:00
alesapin
790ef52aef
Merge pull request #9024 from CurtizJ/fix-range-reader
Fix prewhere optimization.
2020-02-06 11:25:59 +03:00
Alexander Tokmakov
180b5d409d fix poco secure sockets timeouts 2020-02-05 23:45:16 +03:00
Alexander Kuzmenkov
189a6e65c5
boop 2020-02-05 23:07:39 +03:00
CurtizJ
db47ef923c fix prewhere 2020-02-05 19:42:27 +03:00
achulkov2
0ae0e03d52 Address latest comments 2020-02-05 19:38:03 +03:00
alesapin
1923930379 Fix mutations finalization task 2020-02-05 19:30:02 +03:00
Alexander Kuzmenkov
3368af109e
Explicit values are more conspicuous. 2020-02-05 18:08:54 +03:00
Alexander Kuzmenkov
64576c6a7a Less flappy performance test queries 2020-02-05 17:49:19 +03:00
chertus
af84814e51 fix for T64 data incompatibility 2020-02-05 17:25:33 +03:00
Slach
23b787c0d6 actualize description of system.metrics.TCPConnection
add system.metrics.MySQLConnection

Signed-off-by: Slach <bloodjazman@gmail.com>
2020-02-05 19:06:46 +05:00
Ivan Lezhankin
a5ccc72656 Merge remote-tracking branch 'upstream/master' into memory-profiler 2020-02-05 16:52:49 +03:00
Alexander Kuzmenkov
64bcb78812 use proper length 2020-02-05 13:24:24 +03:00
Artem Zuikov
8c23840cc8
ExpressionActions refactoring: extract ArrayJoinAction class (#8998)
refactoring: extract ArrayJoinAction class
2020-02-05 13:12:19 +03:00
Mikhail Filimonov
babd3ca34e Fixing test build, more review fixes 2020-02-05 08:05:55 +01:00
Mikhail Filimonov
cf35392433 Test for producer with _timestamp and _key 2020-02-04 23:12:26 +01:00
Mikhail Filimonov
8c736e6c9f After review fixes 2020-02-04 22:19:34 +01:00
Alexander Kuzmenkov
7b898ec871 style 2020-02-04 16:31:15 +03:00
Mikhail Korotov
ad77771b9a Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-04 12:05:47 +03:00
Guillaume Tassery
a79a9cf078 Merge branch 'master' of github.com:ClickHouse/ClickHouse into select_constants 2020-02-04 05:09:12 +01:00
Alexander Kuzmenkov
cbcb7895e4 Avoid extra copying when demangling names. 2020-02-03 22:51:26 +03:00
Ivan Lezhankin
634d3bedd3 Attempt to fix 2020-02-03 20:06:59 +03:00
proller
bce3ec2a29 Revert "Revert "Build fixes""
This reverts commit 9e0b40bf09.
2020-02-03 19:46:17 +03:00
millb
cb7dc72c4b Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-03 19:04:16 +03:00
millb
663e944b33 Attempt 2020-02-03 19:03:42 +03:00
Ivan Lezhankin
88095b636e Merge remote-tracking branch 'upstream/master' into memory-profiler 2020-02-03 16:21:21 +03:00
Mikhail Korotov
e0eb2f5428
Update Cluster.cpp 2020-02-03 16:18:00 +03:00
alexey-milovidov
e24926d16e
Merge pull request #8952 from azat/getSerializedSize
Add blockSerializedSize() function (size on disk without compression)
2020-02-03 15:46:26 +03:00
alexey-milovidov
59ef2b2009
Merge pull request #8963 from millb/CRLF_in_TSV
CRLF in TSV output format
2020-02-03 15:44:59 +03:00
alexey-milovidov
5689bef818
Merge pull request #8967 from CurtizJ/attach-if-not-exists
Fix query 'ATTACH TABLE IF NOT EXISTS'
2020-02-03 15:41:57 +03:00
CurtizJ
a5b5cb2e94 fix query 'ATTACH TABLE IF NOT EXISTS' 2020-02-03 13:38:09 +03:00
Mikhail Korotov
bf3caa0373 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password 2020-02-03 13:08:20 +03:00
Mikhail Filimonov
24ff635435 draft implementation, wip 2020-02-03 11:02:52 +01:00
Guillaume Tassery
4189a0d70b Merge branch 'master' of github.com:ClickHouse/ClickHouse into select_constants 2020-02-03 10:46:37 +01:00
Azat Khuzhin
e89ceae61a Add blockSerializedSize() function (size on disk without compression)
Sometimes it is useful to know how much does this data will take on
disk, with blockSerializedSize() you can know this (although without
compression).

This can be a major knowledge for various aggregation functions that
tracking some state (i.e. uniqCombined).
2020-02-03 11:26:40 +03:00
Azat Khuzhin
f979ce31ca Add NullWriteBuffer 2020-02-03 11:26:04 +03:00
Mikhail Korotov
a8c9385346 Test added 2020-02-03 10:57:52 +03:00
millb
0d91aff981 Code added 2020-02-03 10:40:12 +03:00
alexey-milovidov
c793f30873
Merge pull request #8954 from ClickHouse/os-thread-id
Use OS thread id everywhere instead of internal thread number.
2020-02-03 03:57:35 +03:00
Alexey Milovidov
e1e69771a0 Fixed error in JSONEachRow 2020-02-03 03:04:08 +03:00
Andrew Onyshchuk
15bad674a0 Add AvroConfluent integration test 2020-02-02 18:02:19 -06:00
alexey-milovidov
baf218b431
Merge pull request #8932 from 4ertus2/debt
Rename ANY INNER to SEMI JOIN for partial merge join
2020-02-03 01:53:52 +03:00
Alexey Milovidov
afbb3fca46 Added a test from Vasily Nemkov #8813 2020-02-03 00:11:49 +03:00
Alexey Milovidov
1aedbb3806 Merge branch 'master' of github.com:yandex/ClickHouse 2020-02-03 00:04:36 +03:00
alexey-milovidov
bf4887a33d
Merge pull request #8822 from millb/Prohibition_secondary_index_with_old_format_merge_tree
Prohibition secondary index with old syntax merge tree
2020-02-03 00:04:04 +03:00
alexey-milovidov
d1bfacae4b
Merge pull request #8953 from oandrew/avro-fixes-confluent
AvroConfluent fixes
2020-02-03 00:00:24 +03:00
Alexey Milovidov
1463764199 Removed useless code (found by PVS Studio) 2020-02-02 23:59:18 +03:00
Alexey Milovidov
d7a6951344 Updated test #8938 2020-02-02 23:26:55 +03:00
alexey-milovidov
9e0b40bf09
Revert "Build fixes" 2020-02-02 23:21:49 +03:00
Alexey Milovidov
fc17853c5a Added missing range check to function h3HexAreaM2 #8938 2020-02-02 23:13:06 +03:00
Alexey Milovidov
d11f3cb78f Changed thread_id to UInt64 to support more OS 2020-02-02 23:01:13 +03:00
Alexey Milovidov
5feb40cb6f Updated test 2020-02-02 22:49:53 +03:00