Commit Graph

23111 Commits

Author SHA1 Message Date
Yuriy
6c8e2d8b85 fixed getting double SHA1 in mysql_native_password auth plugin 2019-12-06 04:35:49 +03:00
Yuriy
e91d4722a4 fixed occasional federated server test failures 2019-12-06 04:35:49 +03:00
Vitaly Baranov
2133492598
Merge pull request #7257 from vitlibar/RBAC-2
RBAC-2
2019-12-06 03:19:39 +03:00
Mikhail Filimonov
7d760a964d Fix for timestamp & style 2019-12-05 22:21:15 +01:00
Nikita Mikhaylov
46478db2f8 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2019-12-05 22:09:15 +03:00
Nikita Mikhaylov
88027947a1
update test after resolving conflicts 2019-12-05 21:59:30 +03:00
Nikita Mikhaylov
4946409a78
Merge branch 'master' into limit_with_ties 2019-12-05 21:58:47 +03:00
Nikita Mikhaylov
de2d996063
Merge pull request #7786 from nikitamikhaylov/incorrect_count
Incorrect count() with condition query result for SummingMergeTree.
2019-12-05 21:56:54 +03:00
Nikita Mikhaylov
5e60e0661f
delete useless reference 2019-12-05 21:54:18 +03:00
Nikita Mikhaylov
826a675974
delete useless reference 2019-12-05 21:53:44 +03:00
Nikita Mikhaylov
7783475aaa
delete useless test 2019-12-05 21:53:26 +03:00
alesapin
6afafef86c
Merge pull request #8047 from ClickHouse/fix_check_query_again
Fix bug in checkDataPart
2019-12-05 21:31:36 +03:00
Vitaly Baranov
6306e2ab91 Add DCL to manage quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
8035af3a79 Make Field::getScaleMultiplier() inline to allow using FieldVisitorConvertToNumber
in the "clickhouse_parsers" library.
2019-12-05 21:03:57 +03:00
Vitaly Baranov
3e6619c076 Move IntervalKind-related functions to a separate file. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
ae29628779 Add an integration test for quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
38fa1af5ca Disable quota consumptions for the system queries and for selecting
from the `system.quota` and `system.quotas` tables.
2019-12-05 21:03:57 +03:00
Vitaly Baranov
d9b1a733fc Add table system.quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
55a05e5643 Add functions currentQuota() and currentQuotaKey(). 2019-12-05 21:03:57 +03:00
Vitaly Baranov
0e21673271 Rework Quota based on IAccessEntity. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
c733e5b50b Add functions for writing std::chrono to string. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
7db6c60bb1 Add AccessControlManager and an interface for the storage. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
44f3ab5f96 Extend typeid_cast() for shared_ptr. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
4d784d6f44 Add test. 2019-12-05 20:07:33 +03:00
Vitaly Baranov
9b44848179 SYSTEM RELOAD DICTIONARY now reloads a dictionary with update_field completely. 2019-12-05 19:45:05 +03:00
alesapin
772bb0b70b Fix collation locales 2019-12-05 18:35:09 +03:00
Nikita Mikhaylov
4f74974492 fixed warning unique_lock 2019-12-05 17:34:35 +03:00
alesapin
227d0ba9d6 Add one more test 2019-12-05 15:39:02 +03:00
alesapin
cd43debd79 Test with non adaptive parts 2019-12-05 15:18:18 +03:00
alesapin
ee46a73d25 Fix bug in checkDataPart when last granule has same number of rows as in .mrk file 2019-12-05 15:01:36 +03:00
chertus
852e891499 better comment 2019-12-05 15:01:34 +03:00
Nikolai Kochetov
26e415736a
Merge pull request #7665 from 4ertus2/joins
New ANY, SEMI, ANTI JOIN (HashJoin only)
2019-12-05 14:38:20 +03:00
Nikolai Kochetov
86ff01d3aa
Merge pull request #7988 from ClickHouse/processors-4.4
Better updated ports check in processors
2019-12-05 13:54:40 +03:00
Vitaly Baranov
133675a86a Simplify format of the header of data sending to a shard in a distributed query. 2019-12-05 13:34:25 +03:00
Mikhail Korotov
88e37020e0 JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes (#7841)
* Research commit

* Created Output EachRow Format

* Fixed bugs

* Created output format JSONCompactEachRowWithNamesAndTypes without totals

* Fixed bugs

* Fixed bugs

* Totals for JSONCompactEachRowWithNamesAndTypes

* Deleted needless debug

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Tests added

* Input Format for JSONCompactEachRow

* Fixed bugs for JSONCompactEachRow Input format

* Fixed bugs for JSONCompactEachRowRowInputFormat.cpp

* JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes united

* Created input format for both formats

* fixed bugs

* fixed bugs

* Working commit

* Working commit

* Working commit

* Working commit

* tests

* Working commit

* Final tests

* Performance tests added
2019-12-05 13:13:40 +03:00
Vladimir Chebotarev
73b0315b2f Added information about lld to instruction to sanitizers. 2019-12-05 13:08:34 +03:00
Vladimir Chebotarev
b9db05e1fd Revert "Added -D LINKER_NAME=lld to instruction to sanitizers."
This reverts commit c5a30d39a0.
2019-12-05 13:04:53 +03:00
Vladimir Chebotarev
60077e2311 Revert "Minor typo was fixed."
This reverts commit e436bf140c.
2019-12-05 13:04:47 +03:00
Nikita Mikhaylov
a3f3a333e2 better test 2019-12-05 12:55:06 +03:00
Nikita Mikhaylov
b6413d4a04 better 2019-12-05 12:52:49 +03:00
Nikita Mikhaylov
9d005d1565 true changes 2019-12-05 12:50:42 +03:00
Vladimir Chebotarev
7c7562987d Removed is_move from system.merges. 2019-12-05 12:31:45 +03:00
hcz
8a464995e7 Fix 2019-12-05 17:22:00 +08:00
Vladimir Chebotarev
3c35b3db60 Removed localtime from HTTPDictionarySource::getUpdateFieldAndDate(). 2019-12-05 12:18:51 +03:00
Vitaly Baranov
2cc78413ed
Merge pull request #7914 from azat/dist-send-extra-checksum
Add checksum for extra info/query in distributed sends
2019-12-05 11:43:08 +03:00
alesapin
a524e82a7f
Merge pull request #8029 from ClickHouse/fix_dict_partially_update_failover
Fix external dictionaries failover, when they have invalidate_query.
2019-12-05 11:12:17 +03:00
Yuriy Baranov
1df4250b2f
Update MySQLHandler.cpp 2019-12-05 04:52:48 +03:00
Yuriy Baranov
67d72f35b9
Update Authentication.cpp 2019-12-05 03:35:52 +03:00
Yuriy
9a222c6a2a compare with proper variable 2019-12-05 03:23:12 +03:00
Yuriy
4b170ae769 fixed compilation error 2019-12-05 03:19:36 +03:00
Yuriy
564b58d2f6 using mysql_native_password for passwordless users 2019-12-05 02:37:11 +03:00
Yuriy
9d0a0d0db0 fixed type 2019-12-05 02:32:17 +03:00
Yuriy
dbe7dc1185 using SHA1 MySQL auth plugin for plaintext passwords 2019-12-05 02:30:06 +03:00
chertus
d3d2e39955 fix SEMI RIGHT JOIN 2019-12-04 23:23:07 +03:00
Azat Khuzhin
3a72e1c12a Add checksum for extra info/query in distributed sends
This extras includes:
- server revision
- query settings
- query

Otherwise the code can try to interpret data, and got for instance
std::length_error exception, which is not catched (to mark the part as
broken). Also this will protect from the corruptions on disk.

And add a simple test, since dbms/tests/integration/test_insert_into_distributed too complex.

Also simplify the code by using readStringBinary() over
readVarUInt()+b.readStrict() (this also gains additional checks that
string is not bigger then 1GB).

Refs: #4852 (8ef7f3589a)
v2: avoid ABI breakage (suggested by @vitlibar)
v3: minor code fixes (suggested by @vitlibar) and as a consequence clang-8 build fix
v4: drop DBMS_MIN_REVISION_WITH_EXTRAS_CHECKSUM_IN_DIST_BATCH and also
    revert some renames to make the patch cleaner
2019-12-04 22:54:38 +03:00
alesapin
172bbb1a2f Fix flappy test, because dictionaries are loaded lazily 2019-12-04 21:30:47 +03:00
alesapin
cfa1b37fd6
Merge pull request #8032 from ClickHouse/ddl_dictionaries_if_not_exists
Create dictionary if not exists
2019-12-04 21:28:05 +03:00
Nikolai Kochetov
715d7a6455 Disable processors by default. 2019-12-04 20:24:53 +03:00
alesapin
7b8443710d Better code 2019-12-04 19:20:24 +03:00
alesapin
40c6966223 Don't check dictionary modification if it's already have an exception. 2019-12-04 18:23:18 +03:00
alesapin
2592e44eef
Merge pull request #8028 from ClickHouse/fix_libc_compatibility_of_odbc_bridge
Fix unintendent dependency from GLIBC 2.16 in clickhouse-odbc-bridge
2019-12-04 18:15:26 +03:00
alesapin
3128b62f0e Create dictionary if not exists 2019-12-04 18:11:36 +03:00
alesapin
a41764cccc Reload dictionary with invalidate query if it has exception 2019-12-04 17:45:56 +03:00
alesapin
ce05cea192 Add sleep for test 2019-12-04 17:22:49 +03:00
alesapin
711fb5e667 Added tests for external dictionary invalidate query failover 2019-12-04 16:53:05 +03:00
Nikolai Kochetov
3ac103f21c Fix the number of rows in MergingSortedTransform. 2019-12-04 16:45:42 +03:00
alesapin
516876becb Fix unintendent dependency from GLIBC 2.16 in clickhouse-odbc-bridge 2019-12-04 15:39:09 +03:00
Nikolai Kochetov
901a6b4627 Style fix. 2019-12-04 12:56:08 +03:00
Nikolai Kochetov
efe1616fda Fix optimization for 'WHERE column in (empty set)' case. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
81b5b17828 Fix pvs studio varning. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
fa98587c19 Init update_info in port. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4337fc20b5 Enable processors by default. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
8524a75580 Check once if filter column can be always false in filter transform. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
9465183408 Add info about affected ports after prepare. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4f2f474fde Add info about affected ports to IProcessor::prepare 2019-12-04 12:55:01 +03:00
alesapin
eb17d51dd4 Remove unused function 2019-12-04 12:49:54 +03:00
alesapin
d1d3bac744 Better 2019-12-04 12:48:08 +03:00
Vladimir Chebotarev
e436bf140c
Minor typo was fixed. 2019-12-04 12:47:51 +03:00
Vladimir Chebotarev
c5a30d39a0
Added -D LINKER_NAME=lld to instruction to sanitizers. 2019-12-04 12:46:39 +03:00
alesapin
ace44e0717 Add test for incorrect settings 2019-12-04 12:34:05 +03:00
alesapin
9e5f13e7af Merge branch 'fix_metric_suffix_in_settings_value' of https://github.com/millb/ClickHouse into millb-fix_metric_suffix_in_settings_value 2019-12-04 12:22:29 +03:00
alesapin
8877129d60
Merge pull request #8012 from ClickHouse/millb-url_engine_problem
Merging [#7154]
2019-12-04 12:13:15 +03:00
Mikhail Filimonov
34275626de Fix for https://github.com/ClickHouse/ClickHouse/issues/8003 : old producers do not write timestamp, but column still should have enough rows 2019-12-03 23:03:43 +01:00
Mikhail Filimonov
3de3ba336a Fix Native format in Kafka 2019-12-03 22:12:47 +01:00
Mikhail Filimonov
6e426592a7 Make the formats like RowBinaryWithNamesAndTypes work in Kafka & do not try to parse buffer when it at eof 2019-12-03 22:03:22 +01:00
alesapin
fa4728d44f Fix style 2019-12-03 20:57:00 +03:00
alesapin
f0e9715f10 Fix test 2019-12-03 20:36:02 +03:00
Nikolai Kochetov
7b3c56990d
Merge pull request #8005 from ClickHouse/add-more-checks-to-chunk
Add forgotten rows number check to chunk constructor.
2019-12-03 20:26:19 +03:00
alesapin
2a43daec5c Buildable code 2019-12-03 20:15:16 +03:00
alesapin
20e4e92c49 Fix some conflicts 2019-12-03 19:32:41 +03:00
alexey-milovidov
8cb5402179
Merge pull request #8006 from CurtizJ/and_perftest
Add perf test for function 'and'.
2019-12-03 19:06:26 +03:00
chertus
3829df0e7b fix comment 2019-12-03 17:38:13 +03:00
chertus
e160d35e54 more Join.addJoinedBlock() refactoring 2019-12-03 17:30:51 +03:00
Nikolai Kochetov
31d5c66867 Fix num rows in IRowInputFormat 2019-12-03 16:43:40 +03:00
Alexander Burmak
108c792fd9 Fixed typos in ExternalLoader.h and CrossToInnerJoinVisitor.cpp 2019-12-03 16:39:42 +03:00
chertus
46b27e4dd1 perf: move heavy addJoinedBlock() operations out of lock 2019-12-03 16:31:52 +03:00
CurtizJ
828f3ac3b2 add perf test for function and 2019-12-03 16:28:07 +03:00
chertus
3dc6ef421e perf: do not make row filter if not needed 2019-12-03 15:55:20 +03:00
alesapin
54088db46a
Merge pull request #8001 from ClickHouse/add_time_to_func_tests
Added argument --print-time to tests.
2019-12-03 15:38:11 +03:00
alexey-milovidov
1b2297bcee
Merge pull request #7999 from litao91/typo_fix
Fix a minor typo on formatting UNION ALL AST
2019-12-03 15:29:49 +03:00
alexey-milovidov
aadf7c689c
Merge pull request #7993 from ClickHouse/merge-great-circle-distance
Merging #7307
2019-12-03 15:23:38 +03:00
alexey-milovidov
f09c29a2b6
Merge pull request #7992 from ClickHouse/excitoon-favorites-s3auth
Merging #7623
2019-12-03 15:21:12 +03:00
Nikolai Kochetov
448d755a3b Add forgotten rows number check to chunk constructor. 2019-12-03 14:56:51 +03:00
Nikolai Kochetov
f2ff3b3ddd Added argument --print-time to tests. 2019-12-03 12:59:41 +03:00
litao91
d9607c50fe
Fix a minor typo on formatting UNION ALL AST 2019-12-03 16:58:00 +08:00
Alexey Milovidov
40b0f12755 Removed tons of garbage from "greatCircleDistance" function. But algorithm is still unclear. 2019-12-03 05:25:23 +03:00
alexey-milovidov
0c904f1484
Merge pull request #7721 from 4ertus2/decimal
Basic GatherUtils support for Decimals
2019-12-03 05:15:38 +03:00
alexey-milovidov
0734d4695b
Merge pull request #7724 from 4ertus2/some
Missing array functions for Decimals
2019-12-03 05:14:33 +03:00
alexey-milovidov
812df3aef3
Merge pull request #7755 from nikitamikhaylov/storage_set
Using the Set engine happen Exception: Method read is not supported by storage Set
2019-12-03 05:09:47 +03:00
alexey-milovidov
f1d75d9722
Update 01030_storage_set_supports_read.sql 2019-12-03 05:09:33 +03:00
alexey-milovidov
ef66c453c4
Update ExpressionAnalyzer.h 2019-12-03 05:09:05 +03:00
alexey-milovidov
cdaa913d1f
Update ExpressionAnalyzer.h 2019-12-03 05:08:41 +03:00
alexey-milovidov
4159e77e1a
Merge pull request #7835 from filimonov/fix_redis_builds
Fix build with Poco Redis
2019-12-03 05:06:51 +03:00
Alexey Milovidov
2474cdfa09 Removed tons of garbage from "greatCircleDistance" function. But algorithm is still unclear. 2019-12-03 04:55:46 +03:00
alexey-milovidov
f5e88f8cd5
Merge pull request #7307 from ClickHouse/new-branch-for-new-geodist
Speed up greatCircleDistance function with test
2019-12-03 04:34:35 +03:00
alexey-milovidov
dbc95e27be
Update greatCircleDistance.cpp 2019-12-03 04:33:36 +03:00
Alexey Milovidov
49d25e06a8 Added a test 2019-12-03 04:29:19 +03:00
Alexey Milovidov
93ef18501f Added a test 2019-12-03 04:27:48 +03:00
Alexey Milovidov
199a209c82 Added a test 2019-12-03 04:23:17 +03:00
Alexey Milovidov
8fa05a212b Fixed bug in #7623 2019-12-03 04:22:25 +03:00
alexey-milovidov
edede563c9
Merge pull request #7747 from hczhcz/patch-1113
Fix empty array handling in arraySplit
2019-12-03 04:00:31 +03:00
alexey-milovidov
87adf355e8
Merge pull request #7935 from filimonov/kafka_perf
[wip] attempt to improve kafka parsing performance
2019-12-03 03:52:40 +03:00
alexey-milovidov
b6edda194f
Update KafkaBlockInputStream.cpp 2019-12-03 03:52:02 +03:00
alexey-milovidov
6fdfdcfd4e
Update ValuesBlockInputFormat.cpp 2019-12-03 03:51:10 +03:00
alexey-milovidov
4d65ad4034
Update ValuesBlockInputFormat.cpp 2019-12-03 03:50:50 +03:00
alexey-milovidov
4a69082fbb
Update ProtobufRowInputFormat.h 2019-12-03 03:49:50 +03:00
alexey-milovidov
a7521b97f9
Update IInputFormat.cpp 2019-12-03 03:49:05 +03:00
Alexey Milovidov
d70b73f033 Merge branch 's3auth' of https://github.com/excitoon-favorites/ClickHouse into excitoon-favorites-s3auth 2019-12-03 03:06:01 +03:00
alexey-milovidov
fe05565cec
Update StorageS3.cpp 2019-12-03 03:03:44 +03:00
Alexey Milovidov
fc174dce6e More simple 2019-12-03 02:50:53 +03:00
Alexey Milovidov
9d099bde8e Merge branch 'master' into fix_check_table_with_empty_pk 2019-12-03 02:36:21 +03:00
alexey-milovidov
3355492f02
Merge pull request #7983 from ClickHouse/fix_dictionary_lifetime
Fix bug with minimal dictionary lifetime equals zero
2019-12-03 02:32:38 +03:00
Alexey Milovidov
254d203a61 Reverted bad modifications 2019-12-03 02:28:51 +03:00
Alexey Milovidov
e86047bd72 Merge branch 'sigrtmin' of https://github.com/abyss7/ClickHouse into abyss7-sigrtmin 2019-12-03 02:27:53 +03:00
alexey-milovidov
7af2dc34d2
Merge pull request #7990 from ClickHouse/filimonov-lc_empty_part_bug
Merging #7985
2019-12-03 02:26:44 +03:00
Alexey Milovidov
166e9e414c Fixed bad test 2019-12-03 02:26:15 +03:00
Alexey Milovidov
07d7fd413f Fixed bad test 2019-12-03 02:25:08 +03:00
alexey-milovidov
e44dc0a6c8
Merge pull request #7981 from ClickHouse/fix_number_of_streams_for_storages_with_globs
Limit number of streams for read from StorageFile and StorageHDFS
2019-12-03 02:23:10 +03:00
alexey-milovidov
43c47bdb55
Merge pull request #7717 from MaxFedotov/support_mysql_federated
support clickhouse as mysql federated server
2019-12-03 02:21:35 +03:00
alexey-milovidov
972156066d
Update MySQLHandler.cpp 2019-12-03 02:20:58 +03:00
alexey-milovidov
b08446a8c5
Update MySQLHandler.cpp 2019-12-03 02:18:19 +03:00
Alexey Milovidov
58c40dc234 Merge branch 'master' of github.com:yandex/ClickHouse into filimonov-lc_empty_part_bug 2019-12-03 02:14:35 +03:00
alexey-milovidov
41f1224d59
Merge pull request #7987 from achulkov2/dict-small-refactoring
Very small code refactoring for external dictionaries
2019-12-03 02:13:31 +03:00
alexey-milovidov
8338be47dd
Merge pull request #7975 from yurriy/mysql-protocol-text
Support more column types in MySQL compatibility server
2019-12-03 02:08:24 +03:00
Alexey Milovidov
272715cb71 Merge branch 'lc_empty_part_bug' of https://github.com/filimonov/ClickHouse into filimonov-lc_empty_part_bug 2019-12-03 01:58:41 +03:00
alexey-milovidov
bd72b570a3
Update 01035_lc_empty_part_bug.sql 2019-12-03 01:56:37 +03:00
chertus
a179c5025f Merge branch 'master' into joins 2019-12-02 21:08:39 +03:00
chertus
5ce65546e9 semi & anti join 2019-12-02 21:08:04 +03:00
Ivan Lezhankin
2118b33d9a Replace SIGRTMIN with SIGTSTP 2019-12-02 20:29:19 +03:00
achulkov2
6c6db598b1 Very small refactoring for external dictionaries 2019-12-02 18:59:45 +03:00