thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-21 17:20:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
32,533 Commits 8,942 Branches 1,766 Tags 2 GiB
d498e14ff8
Commit Graph

23424 Commits

Author SHA1 Message Date
Alexey Milovidov
1e3b9af66f Added clarifications 2019-12-09 20:25:16 +03:00
Alexey Milovidov
2db25df706 Merge branch 'master' into geodist-less-wrong 2019-12-09 18:42:37 +03:00
Nikolai Kochetov
fd62c09a8b Update FunctionCapture and FunctionExpression. 2019-12-09 17:36:47 +03:00
Alexander Burmak
5a93441445 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-09 17:18:47 +03:00
alesapin
85aac386aa Missed commit 2019-12-09 17:06:28 +03:00
alesapin
642ce2d751 Fix escaping and add string expressions support 2019-12-09 17:05:58 +03:00
Nikolai Kochetov
18bfa684a2 Rename IFunction.h to IFunctionImpl.h in functions implementations. 2019-12-09 16:12:54 +03:00
Pavel Kovalenko
ba59991912 AWS SDK integration - added new lines at the end of files. 2019-12-09 15:36:06 +03:00
Pavel Kovalenko
971c48e1cf AWS SDK integration - fixed test with remote host filter. 2019-12-09 15:05:16 +03:00
Pavel Kovalenko
94e9638006 AWS SDK integration added url checking. 2019-12-09 13:58:57 +03:00
alexey-milovidov
9106b2854a
Merge pull request #8084 from azat/read-temporary-tables-on-failure 
Read temporary tables on failure to avoid interpreting that bits as query
 2019-12-09 13:49:09 +03:00
Alexander Burmak
f27d462986 Minor amendments 2019-12-09 08:47:12 +03:00
alexey-milovidov
d051a03794
Merge pull request #8042 from excitoon-favorites/gmtime 
Removed `localtime` from `HTTPDictionarySource::getUpdateFieldAndDate…
 2019-12-09 04:57:18 +03:00
alexey-milovidov
79215bd029
Merge pull request #8025 from excitoon/patch-2 
Added `-D LINKER_NAME=lld` to instruction to sanitizers.
 2019-12-09 04:56:17 +03:00
alexey-milovidov
4aa6b61859
Update sanitizers.md 2019-12-09 04:55:58 +03:00
alexey-milovidov
624be3679b
Merge branch 'master' into mysql 2019-12-09 04:53:30 +03:00
alexey-milovidov
0d278b414c
Merge pull request #8046 from amosbird/interpose 
Interpose malloc symbols entirely.
 2019-12-09 04:33:49 +03:00
alexey-milovidov
abb823af7f
Merge pull request #8079 from yurriy/mysql-types-test 
Fixed Float64 conversion in MySQL protocol
 2019-12-09 04:32:22 +03:00
alexey-milovidov
a3c6402e8b
Added perf test for collations (#8087) 2019-12-09 04:23:58 +03:00
Alexey Milovidov
b5e05d761b Whitespace 2019-12-09 04:15:42 +03:00
Alexey Milovidov
9399b39070 Fixes 2019-12-09 04:09:03 +03:00
Alexey Milovidov
41a6eedadc Added comment 2019-12-09 04:02:09 +03:00
Alexey Milovidov
c6cc5770cc Merge branch 'geodist-less-wrong' of github.com:yandex/ClickHouse into geodist-less-wrong 2019-12-09 03:20:45 +03:00
Alexey Milovidov
2afdb4f6a8 Added a test 2019-12-09 03:20:34 +03:00
Alexey Milovidov
fb908eae0a Fixed comments 2019-12-09 03:02:50 +03:00
Alexey Milovidov
b977aa3cdf Fixed error 2019-12-09 02:59:25 +03:00
Alexey Milovidov
c738d92411 Maybe better memory layout 2019-12-09 02:55:56 +03:00
Alexey Milovidov
171bb14614 Addition to prev. revision 2019-12-09 02:41:34 +03:00
Alexey Milovidov
1835087291 Added function geoDistance and returned the old behaviour of greatCircleDistance 2019-12-09 02:40:53 +03:00
Alexey Milovidov
109542c445 Small improvements 2019-12-09 02:09:05 +03:00
Alexey Milovidov
09df6a0c00 Small improvements 2019-12-09 02:02:44 +03:00
Alexey Milovidov
f7320e50b7 Renamed variables 2019-12-09 02:00:34 +03:00
Alexey Milovidov
a04ed4883d Added comments 2019-12-09 01:44:17 +03:00
Alexey Milovidov
4f3e7427e8 Fixed error in perf test 2019-12-09 01:41:45 +03:00
Alexey Milovidov
19f05c4594 Removed too strict type check 2019-12-09 01:09:32 +03:00
Alexey Milovidov
3d71cb0596 Make the code of greatCircleDistance less wrong 2019-12-09 00:59:41 +03:00
Alexey Milovidov
eca601239f Removed a test with typo in its name 2019-12-09 00:37:04 +03:00
Nikolai Kochetov
a73eb4292b Functions refactor part 1. 2019-12-09 00:06:37 +03:00
alexey-milovidov
7e8b177a3b
Merge pull request #8077 from nvartolomei/nv/system-query-parser 
Fix SYSTEM query parser suggestions
 2019-12-09 00:04:14 +03:00
alexey-milovidov
cf194edfaf
Merge pull request #8016 from filimonov/kafka_fixes 
Kafka fixes
 2019-12-09 00:03:36 +03:00
alexey-milovidov
ee7d675f86
Update KafkaBlockInputStream.cpp 2019-12-09 00:03:09 +03:00
alexey-milovidov
a7f5ac7099
Merge pull request #8081 from errx/master 
Added new function JSONExtractArrayRaw
 2019-12-08 23:52:56 +03:00
alexey-milovidov
21a7a53491
Update FunctionsJSON.h 2019-12-08 23:48:34 +03:00
alexey-milovidov
16754bfff5
Merge pull request #8043 from excitoon-favorites/systemmergespaths 
Added information about paths to `system.merges`.
 2019-12-08 23:30:39 +03:00
Azat Khuzhin
7b4fcc5fc5 Read temporary tables on failure to avoid interpreting that bits as query 
Before this patch if the query failes (due to "Too many simultaneous
queries" for example) it will not read external tables info, and the
next request will interpret them as the query beginning at got:

  DB::Exception: Unknown packet 11861 from client

v2: reordering in the executeQuery() is not enough, since the query
    can fail in other places, before, i.e. quotas
v3: I cannot make non-intergration test (since there is no ability to
    receive "Unknown packet" via client, only from the server log),
    hence added one
 2019-12-08 23:26:43 +03:00
Alexander Burmak
edd11abad1 Addressed code review comments 2019-12-08 19:47:51 +03:00
Oleg Matrokhin
8ea7cab7e4 simplify expression 2019-12-08 18:07:06 +03:00
Oleg Matrokhin
2cab90b9f4 fmt 2019-12-08 17:36:31 +03:00
Oleg Matrokhin
36303a82f7 add tests 2019-12-08 17:24:37 +03:00
Alexander Burmak
8104395dd2 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-08 11:45:18 +03:00
alesapin
af7b8f9274
Merge pull request #8051 from ClickHouse/fix_collations_behaviour 
Fix several bugs with collations.
 2019-12-08 11:10:23 +03:00
Yuriy
e0796261aa mysql protocol: fixed Float32 conversion and added types test 2019-12-08 08:40:08 +03:00
Oleg Matrokhin
10cf9e5b9f implement new function 2019-12-08 03:18:24 +03:00
Nicolae Vartolomei
f5e764eba1 Fix SYSTEM query parser suggestions 2019-12-07 23:05:57 +00:00
Vladimir Chebotarev
984e81876a Fixed Clang build. 2019-12-07 22:30:37 +03:00
Vladimir Chebotarev
bb0de2509a Fixed test_system_merges/test.py::test_mutation_simple[replicated] test. 2019-12-07 22:23:25 +03:00
Vladimir Chebotarev
c60493fe72 Fixed test_system_merges/test.py::test_merge_simple[replicated] test. 2019-12-07 22:02:01 +03:00
alesapin
2fffe2802f Review fixes 2019-12-07 16:13:14 +03:00
Vladimir Chebotarev
ed2ec2d15d Fixed test_system_merges to correctly check replicated node set. 2019-12-07 13:35:13 +03:00
Vladimir Chebotarev
1513e5a854 Added replicated tests for system.merges. 2019-12-07 13:15:01 +03:00
Vladimir Chebotarev
1fbfb50fba Fixed updating result_part_path while merging and mutating. 2019-12-07 12:54:05 +03:00
Vladimir Chebotarev
b64b2cff09 Added simple non-replicated tests for system.merges. 2019-12-07 11:40:49 +03:00
alesapin
b9591a8bb4 Fix variable scope 2019-12-07 11:17:01 +03:00
Vladimir Chebotarev
05a05b5fb6 Fixed result_part_part of a mutation. 2019-12-07 11:10:08 +03:00
alesapin
5b828a6cbf Better test 2019-12-07 01:25:14 +03:00
alesapin
3881a85c39 Review fixes 2019-12-07 01:22:12 +03:00
alexey-milovidov
56b2ec8b4a
Merge pull request #7693 from millb/hashes_from_values_of_UUID_type 
Created cityHash for decimal and UUID types.
 2019-12-07 00:30:28 +03:00
alexey-milovidov
113ddb2588
Update FunctionsHashing.h 2019-12-06 22:21:22 +03:00
alexey-milovidov
1c1351d644
Update FunctionsHashing.h 2019-12-06 22:19:19 +03:00
alexey-milovidov
e0aa12717b
Update FunctionsHashing.h 2019-12-06 22:18:47 +03:00
alexey-milovidov
bef3a0d2d2
Merge pull request #8071 from azat/Connection-sendCancel-SIGSEGV 
Avoid null dereference after "Unknown packet X from server"
 2019-12-06 22:15:18 +03:00
alexey-milovidov
36203721de
Update Connection.cpp 2019-12-06 22:14:27 +03:00
millb
6799feaba6 Merge branch 'hashes_from_values_of_UUID_type' of github.com:millb/ClickHouse into hashes_from_values_of_UUID_type 2019-12-06 22:08:40 +03:00
millb
b13cd85613 Applied the required changes 2019-12-06 22:08:21 +03:00
Azat Khuzhin
e4209d6a3f Avoid null dereference after "Unknown packet X from server" 
stracktrace:
  ...
  2  DB::WriteBuffer::nextIfAtEnd (this=0x0) at ../dbms/src/IO/WriteBuffer.h:66
  3  DB::writeVarUInt (ostr=..., x=3) at ../dbms/src/IO/VarInt.h:191
  4  DB::Connection::sendCancel (this=0x7f0b7f5e5610) at ../dbms/src/Client/Connection.cpp:444
  5  0x0000561738d0b565 in DB::MultiplexedConnections::sendCancel (this=0x7f0c9b0173e0) at ../dbms/src/Client/MultiplexedConnections.cpp:174
  6  0x00005617387d22df in DB::RemoteBlockInputStream::tryCancel (this=0x7f0cc45f9810, reason=<optimized out>) at /usr/include/c++/9/bits/unique_ptr.h:352
  7  0x00005617387d2a37 in DB::RemoteBlockInputStream::cancel (this=<optimized out>, kill=false) at ../dbms/src/DataStreams/RemoteBlockInputStream.cpp:121
  8  0x000056173891f10c in DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::cancel (this=0x7f0c370ec168, kill=kill@entry=false)
  9  0x000056173892cfce in DB::UnionBlockInputStream::cancel (kill=false, this=<optimized out>) at ../dbms/src/DataStreams/UnionBlockInputStream.h:99
  10 DB::UnionBlockInputStream::Handler::onException (this=0x7f0c370ec160, exception=...) at ../dbms/src/DataStreams/UnionBlockInputStream.h:240
  11 DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread (this=0x7f0c370ec168, thread_group=..., thread_num=<optimized out>)
      at ../dbms/src/DataStreams/ParallelInputsProcessor.h:217

And in onException frame there is:
  (gdb) p ((DB::Exception *)exception._M_exception_object)._msg._M_dataplus._M_p
  $6 = (...) 0x7f0c9b1e7a40 "Unknown packet 9 from server HOSTNAME:PORT"

And on "Unknown packet" there is disconnect() before, see default in
switch statement at Connection::receivePacket().
 2019-12-06 21:55:17 +03:00
Mikhail Korotov
688ca7bfde performance test added 2019-12-06 21:10:03 +03:00
Mikhail Korotov
f63fe65e53 Simple tests added 2019-12-06 20:23:41 +03:00
Mikhail Korotov
3528555174
Update FunctionsHashing.h 2019-12-06 19:33:37 +03:00
Amos Bird
971770a040
Interpose malloc symbols entirely. 2019-12-07 00:32:00 +08:00
Mikhail Korotov
5a1ad17736
Update FunctionsHashing.h 2019-12-06 19:30:46 +03:00
millb
c801845185 Applied the required changes 2019-12-06 19:27:45 +03:00
millb
e3426e39e8 Fixed bugs 2019-12-06 18:43:50 +03:00
Pavel Kovalenko
6b8d599956 AWS SDK integration formatting issues. 2019-12-06 18:42:55 +03:00
Vxider
47f8d9713a build fix 2019-12-06 23:35:23 +08:00
millb
41008c9cca Merge branch 'master' into hashes_from_values_of_UUID_type 2019-12-06 18:22:06 +03:00
millb
56c7e53bdc Changes applied 2019-12-06 18:21:58 +03:00
Pavel Kovalenko
621d3dd2d1 AWS SDK integration formatting issues. 2019-12-06 18:14:39 +03:00
Pavel Kovalenko
dbcc06cc80 Removed CH docker image building in tests. 2019-12-06 17:57:43 +03:00
Pavel Kovalenko
81b4b1a538 AWS SDK added doc. 2019-12-06 17:54:20 +03:00
Pavel Kovalenko
c840fdefc0 Merge branch 'master' into aws-s3-sdk-integration 
# Conflicts:
#	dbms/src/Common/ErrorCodes.cpp
#	dbms/src/IO/ReadBufferFromS3.cpp
#	dbms/src/IO/ReadBufferFromS3.h
#	dbms/src/IO/WriteBufferFromS3.cpp
#	dbms/src/IO/WriteBufferFromS3.h
#	dbms/src/Storages/StorageS3.cpp
 2019-12-06 17:52:29 +03:00
Pavel Kovalenko
52b26b1376 AWS SDK formatting issues. 2019-12-06 17:48:56 +03:00
alexey-milovidov
3d279499d0
Merge pull request #7632 from hczhcz/patch-2 
Allow relative user_files_path
 2019-12-06 17:44:18 +03:00
Pavel Kovalenko
a9dfefd37f AWS SDK integration rework. 2019-12-06 17:37:21 +03:00
robot-clickhouse
6d56509109 Auto version update to [19.19.1.1] [54430] 2019-12-06 17:22:00 +03:00
robot-clickhouse
114db61c84 Auto version update to [19.18.1.1805] [54429] 2019-12-06 17:21:25 +03:00
Nikolai Kochetov
a73975d6a3
Merge pull request #8063 from Akazz/tests/better_server_pid_detection 
Improved getting ClickHouse server pid in clickhouse-test
 2019-12-06 16:26:47 +03:00
Vitaly Baranov
8bd9709d1d
Merge pull request #8044 from vitlibar/simplify-format-of-header-of-distributed-send 
Simplify format of the header of data sent to a shard in a distributed query.
 2019-12-06 15:46:00 +03:00
Mikhail Filimonov
4e4957e052 returning allowNext() to the proper position 2019-12-06 12:22:36 +01:00
Alexander Kazakov
faedac0b95 Rewrite command line for getting server pid 2019-12-06 13:58:46 +03:00
Nikita Mikhaylov
34d20a0ef4
updating test after resolving conflicts 2019-12-06 13:17:51 +03:00
Nikita Mikhaylov
6fc5248a27
Merge branch 'master' into limit_with_ties 2019-12-06 13:16:54 +03:00
alesapin
de6cd490ef
Merge pull request #8037 from vitlibar/system-reload-dictionary-causes-complete-reloading 
SYSTEM RELOAD DICTIONARY reloads a dictionary completely
 2019-12-06 12:55:41 +03:00
Yuriy
5237e3c059 better exception text 2019-12-06 04:42:12 +03:00
Yuriy
6c8e2d8b85 fixed getting double SHA1 in mysql_native_password auth plugin 2019-12-06 04:35:49 +03:00
Yuriy
e91d4722a4 fixed occasional federated server test failures 2019-12-06 04:35:49 +03:00
Vitaly Baranov
2133492598
Merge pull request #7257 from vitlibar/RBAC-2 
RBAC-2
 2019-12-06 03:19:39 +03:00
Mikhail Filimonov
7d760a964d Fix for timestamp & style 2019-12-05 22:21:15 +01:00
Nikita Mikhaylov
46478db2f8 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2019-12-05 22:09:15 +03:00
Nikita Mikhaylov
88027947a1
update test after resolving conflicts 2019-12-05 21:59:30 +03:00
Nikita Mikhaylov
4946409a78
Merge branch 'master' into limit_with_ties 2019-12-05 21:58:47 +03:00
Nikita Mikhaylov
de2d996063
Merge pull request #7786 from nikitamikhaylov/incorrect_count 
Incorrect count() with condition query result for SummingMergeTree.
 2019-12-05 21:56:54 +03:00
Nikita Mikhaylov
5e60e0661f
delete useless reference 2019-12-05 21:54:18 +03:00
Nikita Mikhaylov
826a675974
delete useless reference 2019-12-05 21:53:44 +03:00
Nikita Mikhaylov
7783475aaa
delete useless test 2019-12-05 21:53:26 +03:00
alesapin
6afafef86c
Merge pull request #8047 from ClickHouse/fix_check_query_again 
Fix bug in checkDataPart
 2019-12-05 21:31:36 +03:00
Vitaly Baranov
6306e2ab91 Add DCL to manage quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
8035af3a79 Make Field::getScaleMultiplier() inline to allow using FieldVisitorConvertToNumber 
in the "clickhouse_parsers" library.
 2019-12-05 21:03:57 +03:00
Vitaly Baranov
3e6619c076 Move IntervalKind-related functions to a separate file. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
ae29628779 Add an integration test for quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
38fa1af5ca Disable quota consumptions for the system queries and for selecting 
from the `system.quota` and `system.quotas` tables.
 2019-12-05 21:03:57 +03:00
Vitaly Baranov
d9b1a733fc Add table system.quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
55a05e5643 Add functions currentQuota() and currentQuotaKey(). 2019-12-05 21:03:57 +03:00
Vitaly Baranov
0e21673271 Rework Quota based on IAccessEntity. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
c733e5b50b Add functions for writing std::chrono to string. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
7db6c60bb1 Add AccessControlManager and an interface for the storage. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
44f3ab5f96 Extend typeid_cast() for shared_ptr. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
4d784d6f44 Add test. 2019-12-05 20:07:33 +03:00
Vitaly Baranov
9b44848179 SYSTEM RELOAD DICTIONARY now reloads a dictionary with update_field completely. 2019-12-05 19:45:05 +03:00
alesapin
772bb0b70b Fix collation locales 2019-12-05 18:35:09 +03:00
Nikita Mikhaylov
4f74974492 fixed warning unique_lock 2019-12-05 17:34:35 +03:00
alesapin
227d0ba9d6 Add one more test 2019-12-05 15:39:02 +03:00
alesapin
cd43debd79 Test with non adaptive parts 2019-12-05 15:18:18 +03:00
alesapin
ee46a73d25 Fix bug in checkDataPart when last granule has same number of rows as in .mrk file 2019-12-05 15:01:36 +03:00
chertus
852e891499 better comment 2019-12-05 15:01:34 +03:00
Nikolai Kochetov
26e415736a
Merge pull request #7665 from 4ertus2/joins 
New ANY, SEMI, ANTI JOIN (HashJoin only)
 2019-12-05 14:38:20 +03:00
Nikolai Kochetov
86ff01d3aa
Merge pull request #7988 from ClickHouse/processors-4.4 
Better updated ports check in processors
 2019-12-05 13:54:40 +03:00
Vitaly Baranov
133675a86a Simplify format of the header of data sending to a shard in a distributed query. 2019-12-05 13:34:25 +03:00
Mikhail Korotov
88e37020e0 JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes (#7841) 
* Research commit

* Created Output EachRow Format

* Fixed bugs

* Created output format JSONCompactEachRowWithNamesAndTypes without totals

* Fixed bugs

* Fixed bugs

* Totals for JSONCompactEachRowWithNamesAndTypes

* Deleted needless debug

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Tests added

* Input Format for JSONCompactEachRow

* Fixed bugs for JSONCompactEachRow Input format

* Fixed bugs for JSONCompactEachRowRowInputFormat.cpp

* JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes united

* Created input format for both formats

* fixed bugs

* fixed bugs

* Working commit

* Working commit

* Working commit

* Working commit

* tests

* Working commit

* Final tests

* Performance tests added
 2019-12-05 13:13:40 +03:00
Vladimir Chebotarev
73b0315b2f Added information about lld to instruction to sanitizers. 2019-12-05 13:08:34 +03:00
Vladimir Chebotarev
b9db05e1fd Revert "Added -D LINKER_NAME=lld to instruction to sanitizers." 
This reverts commit c5a30d39a0.
 2019-12-05 13:04:53 +03:00
Vladimir Chebotarev
60077e2311 Revert "Minor typo was fixed." 
This reverts commit e436bf140c.
 2019-12-05 13:04:47 +03:00
Nikita Mikhaylov
a3f3a333e2 better test 2019-12-05 12:55:06 +03:00
Nikita Mikhaylov
b6413d4a04 better 2019-12-05 12:52:49 +03:00
Nikita Mikhaylov
9d005d1565 true changes 2019-12-05 12:50:42 +03:00
Vladimir Chebotarev
7c7562987d Removed is_move from system.merges. 2019-12-05 12:31:45 +03:00
hcz
8a464995e7 Fix 2019-12-05 17:22:00 +08:00
Vladimir Chebotarev
3c35b3db60 Removed localtime from HTTPDictionarySource::getUpdateFieldAndDate(). 2019-12-05 12:18:51 +03:00
Vitaly Baranov
2cc78413ed
Merge pull request #7914 from azat/dist-send-extra-checksum 
Add checksum for extra info/query in distributed sends
 2019-12-05 11:43:08 +03:00
alesapin
a524e82a7f
Merge pull request #8029 from ClickHouse/fix_dict_partially_update_failover 
Fix external dictionaries failover, when they have invalidate_query.
 2019-12-05 11:12:17 +03:00
Yuriy Baranov
1df4250b2f
Update MySQLHandler.cpp 2019-12-05 04:52:48 +03:00
Yuriy Baranov
67d72f35b9
Update Authentication.cpp 2019-12-05 03:35:52 +03:00
Yuriy
9a222c6a2a compare with proper variable 2019-12-05 03:23:12 +03:00
Yuriy
4b170ae769 fixed compilation error 2019-12-05 03:19:36 +03:00
Yuriy
564b58d2f6 using mysql_native_password for passwordless users 2019-12-05 02:37:11 +03:00
Yuriy
9d0a0d0db0 fixed type 2019-12-05 02:32:17 +03:00
Yuriy
dbe7dc1185 using SHA1 MySQL auth plugin for plaintext passwords 2019-12-05 02:30:06 +03:00
chertus
d3d2e39955 fix SEMI RIGHT JOIN 2019-12-04 23:23:07 +03:00
Azat Khuzhin
3a72e1c12a Add checksum for extra info/query in distributed sends 
This extras includes:
- server revision
- query settings
- query

Otherwise the code can try to interpret data, and got for instance
std::length_error exception, which is not catched (to mark the part as
broken). Also this will protect from the corruptions on disk.

And add a simple test, since dbms/tests/integration/test_insert_into_distributed too complex.

Also simplify the code by using readStringBinary() over
readVarUInt()+b.readStrict() (this also gains additional checks that
string is not bigger then 1GB).

Refs: #4852 (8ef7f3589a)
v2: avoid ABI breakage (suggested by @vitlibar)
v3: minor code fixes (suggested by @vitlibar) and as a consequence clang-8 build fix
v4: drop DBMS_MIN_REVISION_WITH_EXTRAS_CHECKSUM_IN_DIST_BATCH and also
    revert some renames to make the patch cleaner
 2019-12-04 22:54:38 +03:00
alesapin
172bbb1a2f Fix flappy test, because dictionaries are loaded lazily 2019-12-04 21:30:47 +03:00
alesapin
cfa1b37fd6
Merge pull request #8032 from ClickHouse/ddl_dictionaries_if_not_exists 
Create dictionary if not exists
 2019-12-04 21:28:05 +03:00
Nikolai Kochetov
715d7a6455 Disable processors by default. 2019-12-04 20:24:53 +03:00
alesapin
7b8443710d Better code 2019-12-04 19:20:24 +03:00
alesapin
40c6966223 Don't check dictionary modification if it's already have an exception. 2019-12-04 18:23:18 +03:00
alesapin
2592e44eef
Merge pull request #8028 from ClickHouse/fix_libc_compatibility_of_odbc_bridge 
Fix unintendent dependency from GLIBC 2.16 in clickhouse-odbc-bridge
 2019-12-04 18:15:26 +03:00
alesapin
3128b62f0e Create dictionary if not exists 2019-12-04 18:11:36 +03:00
alesapin
a41764cccc Reload dictionary with invalidate query if it has exception 2019-12-04 17:45:56 +03:00
alesapin
ce05cea192 Add sleep for test 2019-12-04 17:22:49 +03:00
alesapin
711fb5e667 Added tests for external dictionary invalidate query failover 2019-12-04 16:53:05 +03:00
Nikolai Kochetov
3ac103f21c Fix the number of rows in MergingSortedTransform. 2019-12-04 16:45:42 +03:00
alesapin
516876becb Fix unintendent dependency from GLIBC 2.16 in clickhouse-odbc-bridge 2019-12-04 15:39:09 +03:00
Nikolai Kochetov
901a6b4627 Style fix. 2019-12-04 12:56:08 +03:00
Nikolai Kochetov
efe1616fda Fix optimization for 'WHERE column in (empty set)' case. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
81b5b17828 Fix pvs studio varning. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
fa98587c19 Init update_info in port. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4337fc20b5 Enable processors by default. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
8524a75580 Check once if filter column can be always false in filter transform. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
9465183408 Add info about affected ports after prepare. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4f2f474fde Add info about affected ports to IProcessor::prepare 2019-12-04 12:55:01 +03:00
alesapin
eb17d51dd4 Remove unused function 2019-12-04 12:49:54 +03:00
alesapin
d1d3bac744 Better 2019-12-04 12:48:08 +03:00
Vladimir Chebotarev
e436bf140c
Minor typo was fixed. 2019-12-04 12:47:51 +03:00
Vladimir Chebotarev
c5a30d39a0
Added -D LINKER_NAME=lld to instruction to sanitizers. 2019-12-04 12:46:39 +03:00
alesapin
ace44e0717 Add test for incorrect settings 2019-12-04 12:34:05 +03:00
alesapin
9e5f13e7af Merge branch 'fix_metric_suffix_in_settings_value' of https://github.com/millb/ClickHouse into millb-fix_metric_suffix_in_settings_value 2019-12-04 12:22:29 +03:00
alesapin
8877129d60
Merge pull request #8012 from ClickHouse/millb-url_engine_problem 
Merging [#7154]
 2019-12-04 12:13:15 +03:00
VDimir
29312f5153 Revert "Metric names in prometheus-friendly snake_case format" 
This reverts commit 2ddb801d0b.
 2019-12-04 07:54:09 +00:00
Mikhail Filimonov
34275626de Fix for https://github.com/ClickHouse/ClickHouse/issues/8003 : old producers do not write timestamp, but column still should have enough rows 2019-12-03 23:03:43 +01:00
Mikhail Filimonov
3de3ba336a Fix Native format in Kafka 2019-12-03 22:12:47 +01:00
Mikhail Filimonov
6e426592a7 Make the formats like RowBinaryWithNamesAndTypes work in Kafka & do not try to parse buffer when it at eof 2019-12-03 22:03:22 +01:00
alesapin
fa4728d44f Fix style 2019-12-03 20:57:00 +03:00
alesapin
f0e9715f10 Fix test 2019-12-03 20:36:02 +03:00
Nikolai Kochetov
7b3c56990d
Merge pull request #8005 from ClickHouse/add-more-checks-to-chunk 
Add forgotten rows number check to chunk constructor.
 2019-12-03 20:26:19 +03:00
alesapin
2a43daec5c Buildable code 2019-12-03 20:15:16 +03:00
alesapin
20e4e92c49 Fix some conflicts 2019-12-03 19:32:41 +03:00
Pavel Kovalenko
a9e2327ec0 AWS S3 SDK integration. 2019-12-03 19:23:24 +03:00
alexey-milovidov
8cb5402179
Merge pull request #8006 from CurtizJ/and_perftest 
Add perf test for function 'and'.
 2019-12-03 19:06:26 +03:00
Alexander Burmak
21623c3308 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-03 18:16:19 +03:00
chertus
3829df0e7b fix comment 2019-12-03 17:38:13 +03:00
chertus
e160d35e54 more Join.addJoinedBlock() refactoring 2019-12-03 17:30:51 +03:00
Nikolai Kochetov
31d5c66867 Fix num rows in IRowInputFormat 2019-12-03 16:43:40 +03:00
Alexander Burmak
108c792fd9 Fixed typos in ExternalLoader.h and CrossToInnerJoinVisitor.cpp 2019-12-03 16:39:42 +03:00
chertus
46b27e4dd1 perf: move heavy addJoinedBlock() operations out of lock 2019-12-03 16:31:52 +03:00
CurtizJ
828f3ac3b2 add perf test for function and 2019-12-03 16:28:07 +03:00
chertus
3dc6ef421e perf: do not make row filter if not needed 2019-12-03 15:55:20 +03:00
alesapin
54088db46a
Merge pull request #8001 from ClickHouse/add_time_to_func_tests 
Added argument --print-time to tests.
 2019-12-03 15:38:11 +03:00
alexey-milovidov
1b2297bcee
Merge pull request #7999 from litao91/typo_fix 
Fix a minor typo on formatting UNION ALL AST
 2019-12-03 15:29:49 +03:00
alexey-milovidov
aadf7c689c
Merge pull request #7993 from ClickHouse/merge-great-circle-distance 
Merging #7307
 2019-12-03 15:23:38 +03:00
alexey-milovidov
f09c29a2b6
Merge pull request #7992 from ClickHouse/excitoon-favorites-s3auth 
Merging #7623
 2019-12-03 15:21:12 +03:00
Vasily Nemkov
37832c9497 Removed code duplication and cleaned up headers mess a bit 2019-12-03 15:14:07 +03:00
Nikolai Kochetov
448d755a3b Add forgotten rows number check to chunk constructor. 2019-12-03 14:56:51 +03:00
Nikolai Kochetov
f2ff3b3ddd Added argument --print-time to tests. 2019-12-03 12:59:41 +03:00
litao91
d9607c50fe
Fix a minor typo on formatting UNION ALL AST 2019-12-03 16:58:00 +08:00
Alexey Milovidov
40b0f12755 Removed tons of garbage from "greatCircleDistance" function. But algorithm is still unclear. 2019-12-03 05:25:23 +03:00
alexey-milovidov
0c904f1484
Merge pull request #7721 from 4ertus2/decimal 
Basic GatherUtils support for Decimals
 2019-12-03 05:15:38 +03:00
alexey-milovidov
0734d4695b
Merge pull request #7724 from 4ertus2/some 
Missing array functions for Decimals
 2019-12-03 05:14:33 +03:00
alexey-milovidov
812df3aef3
Merge pull request #7755 from nikitamikhaylov/storage_set 
Using the Set engine happen Exception: Method read is not supported by storage Set
 2019-12-03 05:09:47 +03:00
alexey-milovidov
f1d75d9722
Update 01030_storage_set_supports_read.sql 2019-12-03 05:09:33 +03:00
alexey-milovidov
ef66c453c4
Update ExpressionAnalyzer.h 2019-12-03 05:09:05 +03:00
alexey-milovidov
cdaa913d1f
Update ExpressionAnalyzer.h 2019-12-03 05:08:41 +03:00
alexey-milovidov
4159e77e1a
Merge pull request #7835 from filimonov/fix_redis_builds 
Fix build with Poco Redis
 2019-12-03 05:06:51 +03:00
Alexey Milovidov
2474cdfa09 Removed tons of garbage from "greatCircleDistance" function. But algorithm is still unclear. 2019-12-03 04:55:46 +03:00
alexey-milovidov
f5e88f8cd5
Merge pull request #7307 from ClickHouse/new-branch-for-new-geodist 
Speed up greatCircleDistance function with test
 2019-12-03 04:34:35 +03:00
alexey-milovidov
dbc95e27be
Update greatCircleDistance.cpp 2019-12-03 04:33:36 +03:00
Alexey Milovidov
49d25e06a8 Added a test 2019-12-03 04:29:19 +03:00
Alexey Milovidov
93ef18501f Added a test 2019-12-03 04:27:48 +03:00
Alexey Milovidov
199a209c82 Added a test 2019-12-03 04:23:17 +03:00
Alexey Milovidov
8fa05a212b Fixed bug in #7623 2019-12-03 04:22:25 +03:00
alexey-milovidov
839cfd1f4b
Update ProfileEvents.cpp 2019-12-03 04:17:37 +03:00
alexey-milovidov
30029e5800
Update ProfileEvents.cpp 2019-12-03 04:16:53 +03:00
alexey-milovidov
4183266a02
Update CurrentMetrics.cpp 2019-12-03 04:15:56 +03:00
alexey-milovidov
937386a7c9
Update Server.cpp 2019-12-03 04:14:01 +03:00
alexey-milovidov
edede563c9
Merge pull request #7747 from hczhcz/patch-1113 
Fix empty array handling in arraySplit
 2019-12-03 04:00:31 +03:00
alexey-milovidov
87adf355e8
Merge pull request #7935 from filimonov/kafka_perf 
[wip] attempt to improve kafka parsing performance
 2019-12-03 03:52:40 +03:00
alexey-milovidov
b6edda194f
Update KafkaBlockInputStream.cpp 2019-12-03 03:52:02 +03:00
alexey-milovidov
6fdfdcfd4e
Update ValuesBlockInputFormat.cpp 2019-12-03 03:51:10 +03:00
alexey-milovidov
4d65ad4034
Update ValuesBlockInputFormat.cpp 2019-12-03 03:50:50 +03:00
alexey-milovidov
4a69082fbb
Update ProtobufRowInputFormat.h 2019-12-03 03:49:50 +03:00
alexey-milovidov
a7521b97f9
Update IInputFormat.cpp 2019-12-03 03:49:05 +03:00
Alexey Milovidov
d70b73f033 Merge branch 's3auth' of https://github.com/excitoon-favorites/ClickHouse into excitoon-favorites-s3auth 2019-12-03 03:06:01 +03:00
alexey-milovidov
fe05565cec
Update StorageS3.cpp 2019-12-03 03:03:44 +03:00
Alexey Milovidov
fc174dce6e More simple 2019-12-03 02:50:53 +03:00
Alexey Milovidov
9d099bde8e Merge branch 'master' into fix_check_table_with_empty_pk 2019-12-03 02:36:21 +03:00
alexey-milovidov
3355492f02
Merge pull request #7983 from ClickHouse/fix_dictionary_lifetime 
Fix bug with minimal dictionary lifetime equals zero
 2019-12-03 02:32:38 +03:00
Alexey Milovidov
254d203a61 Reverted bad modifications 2019-12-03 02:28:51 +03:00
Alexey Milovidov
e86047bd72 Merge branch 'sigrtmin' of https://github.com/abyss7/ClickHouse into abyss7-sigrtmin 2019-12-03 02:27:53 +03:00
alexey-milovidov
7af2dc34d2
Merge pull request #7990 from ClickHouse/filimonov-lc_empty_part_bug 
Merging #7985
 2019-12-03 02:26:44 +03:00
Alexey Milovidov
166e9e414c Fixed bad test 2019-12-03 02:26:15 +03:00
Alexey Milovidov
07d7fd413f Fixed bad test 2019-12-03 02:25:08 +03:00
alexey-milovidov
e44dc0a6c8
Merge pull request #7981 from ClickHouse/fix_number_of_streams_for_storages_with_globs 
Limit number of streams for read from StorageFile and StorageHDFS
 2019-12-03 02:23:10 +03:00
alexey-milovidov
43c47bdb55
Merge pull request #7717 from MaxFedotov/support_mysql_federated 
support clickhouse as mysql federated server
 2019-12-03 02:21:35 +03:00