Commit Graph

252 Commits

Author SHA1 Message Date
Azat Khuzhin
365b5207b7 Add log_queries_min_type to filter which entries will be written to query_log
Can be used to write into query_log only failed queries (i.e. on memory
exceeded error), by using:

  set log_queries_min_type='EXCEPTION_WHILE_PROCESSING'
2020-04-12 10:46:36 +03:00
BohuTANG
e7f399f652 MySQLHandler: max_allowed_packet returned by default when server setup with select variables 2020-04-12 13:37:39 +08:00
alexey-milovidov
b888c867b3
Merge pull request #10026 from CurtizJ/speedup-index
Improve performance of index analysis with monotonic functions [2].
2020-04-12 06:37:26 +03:00
Alexey Milovidov
ca5172cc63 Merging #10094 2020-04-12 06:25:47 +03:00
Alexey Milovidov
c64aa011ba Merge branch 'jgon' of https://github.com/amosbird/ClickHouse into amosbird-jgon 2020-04-12 06:21:00 +03:00
alexey-milovidov
791d2bc91e
Merge pull request #10198 from ClickHouse/add-function-is-constant
Add function "isConstant"
2020-04-12 05:44:22 +03:00
alexey-milovidov
0cc91b9cab
Merge pull request #10196 from azat/Distributed-GLOBAL-IN
Allow literals for GLOBAL IN
2020-04-12 04:39:32 +03:00
Alexey Milovidov
754967bde6 Add function "isConstant" 2020-04-12 04:24:00 +03:00
alexey-milovidov
78316f027a
Merge pull request #10195 from ClickHouse/fix-array-join-prewhere
Fix move-to-prewhere optimization in presense of arrayJoin functions.
2020-04-12 03:53:55 +03:00
alexey-milovidov
9203db0ad5
Merge pull request #10140 from BohuTANG/20200409_bug_fix_mysql_handshake_scramble
Fix scramble issue for native mysql-connector-java(JDBC)
2020-04-12 03:53:19 +03:00
Alexey Milovidov
dec3e0f986 Make least and greatest functions case insensitive for compatibility with MySQL 2020-04-12 03:38:25 +03:00
Alexey Milovidov
c5c1a8def7 Added a test from Andrey #2641 2020-04-12 03:03:15 +03:00
Azat Khuzhin
194dcc01fb Allow literals for GLOBAL IN 2020-04-12 02:48:55 +03:00
alexey-milovidov
0782052768
Merge pull request #10131 from ClickHouse/fix-extremes-for-processors
Fix extremes for processors
2020-04-12 02:31:39 +03:00
alexey-milovidov
f5fc3b1e71
Merge pull request #10085 from achimbab/transform_null_in
transform_null_in option to test NULL values at the IN-Operator.
2020-04-12 02:01:54 +03:00
alexey-milovidov
30ec2a3ce2
Merge pull request #10179 from vzakaznikov/live_view_over_distributed
Initial support for live view tables over distributed
2020-04-12 01:41:42 +03:00
Alexey Milovidov
29189d4276 Also add stateless test to illustrate the issue more clear 2020-04-12 01:33:16 +03:00
Azat Khuzhin
a332d8b01e Cover GLOBAL IN for Distributed over Distributed 2020-04-12 01:22:29 +03:00
Alexey Milovidov
cf483b7ecc Added a test 2020-04-12 01:14:55 +03:00
Azat Khuzhin
85448f4b13 Add test from the #2610 (closes: #2610) 2020-04-12 00:46:54 +03:00
alexey-milovidov
00d8e7eefb
Merge branch 'master' into transform_null_in 2020-04-11 23:15:54 +03:00
alexey-milovidov
a4969d89f9
Merge pull request #10164 from azat/system.tables-superfluous-dict-reload
Avoid superfluous dictionaries load
2020-04-11 23:05:56 +03:00
alexey-milovidov
cd979d7997
Merge pull request #10130 from CurtizJ/polymorphic-parts
Fix some kinds of alters with compact parts
2020-04-11 23:02:48 +03:00
alexey-milovidov
a7ecacc8b0
Merge pull request #10186 from filimonov/setting_allow_nondeterministic_mutations
allow_nondeterministic_mutations
2020-04-11 22:56:06 +03:00
alexey-milovidov
5e36a65d0c
Merge pull request #10172 from ClickHouse/fix_odbc_roundtrip
Fix odbc round trip test
2020-04-11 22:55:24 +03:00
alexey-milovidov
3b85ef27a4
Merge pull request #10173 from ClickHouse/fix_url_engine
Add retries to 00646_url_engine test
2020-04-11 22:53:26 +03:00
Vitaly Baranov
18fbd968ba
Merge pull request #10165 from azat/drop-dictionary-as-table
Do not break DROP DICTIONARY with DROP TABLE
2020-04-11 14:49:41 +03:00
Azat Khuzhin
55a143d1a5 Avoid superfluous dictionaries load (system.tables, SHOW CREATE TABLE)
This patch avoids loading dictionaries for:
- SELECT * FROM system.tables (used by clickhouse-client for completion)
- SHOW CREATE TABLE some_dict

But the dictionary will still be loaded on:
- SHOW CREATE TABLE some_dict (from the database with Dictionary engine)
2020-04-11 13:26:41 +03:00
Azat Khuzhin
e0c972448e Cover SHOW CREATE TABLE from database with Dictionary ENGINE 2020-04-11 13:26:19 +03:00
Mikhail Filimonov
2f5b4b0f9b Added ability to relax the restriction on non-deterministic functions usage in mutations with allow_nondeterministic_mutations setting. 2020-04-10 22:01:10 +02:00
Azat Khuzhin
5b3c635200 Do not break DROP DICTIONARY after DROP TABLE executed on dictionary 2020-04-10 21:10:32 +03:00
Vitaly Baranov
ca634f603a Revert resetting the settings to their defaults after each query in TCPHandler. 2020-04-10 21:09:59 +03:00
Vitaliy Zakaznikov
7d076d7f3d Removing comments. 2020-04-10 14:09:28 -04:00
Vitaliy Zakaznikov
16c10851d3 Adding more tests to test_distributed_over_live_view.
Updating test_live_view_over_distributed to be more robust.
2020-04-10 13:47:47 -04:00
Vitaliy Zakaznikov
c37ba8243d Starting to add test_distributed_over_live_view tests. 2020-04-10 13:01:10 -04:00
Vitaliy Zakaznikov
442446fbfa Adding some live view over distributed stateless tests. 2020-04-10 12:04:25 -04:00
Anton Popov
9b6f7af7f6 add tests for ALTER CLEAR COLUMN/INDEX with compact parts 2020-04-10 18:26:40 +03:00
Vitaliy Zakaznikov
201c65f49b Adding test_live_view_over_distributed integration test. 2020-04-10 11:23:04 -04:00
Vitaly Baranov
274a5311fc
Merge pull request #10153 from vitlibar/enable-access-management-in-stateless-tests-3
Enable access management in stateless tests #3.
2020-04-10 17:40:20 +03:00
tavplubix
5e860ddb04
fix 01098_temporary_and_external_tables 2020-04-10 17:09:47 +03:00
alesapin
27eaea184a Add small timeout 2020-04-10 17:03:42 +03:00
alesapin
9d81f89648 Add sleep to test 2020-04-10 16:51:09 +03:00
alesapin
88657cfbe1 Add retries to test 2020-04-10 15:14:27 +03:00
alesapin
9b0640a3b5 Fix odbc round trip test 2020-04-10 14:29:56 +03:00
Artem Zuikov
ba50519af8 workaround for function resolver 2020-04-10 13:28:44 +03:00
Azat Khuzhin
888baad565 tests/queries/0_stateless/01056_create_table_as: drop dictionary at start 2020-04-10 10:38:43 +03:00
philip.han
7fa5afecb4 Support transform_null_in option for StorageSet 2020-04-10 14:42:36 +09:00
philip.han
c6bf39d7a9 Fix 01231_operator_null_in.reference 2020-04-10 14:02:55 +09:00
philip.han
c39e3a51ad Fix Set::insertFromBlockImplCase() 2020-04-10 12:30:54 +09:00
BohuTANG
87cc8de8e2 Merge remote-tracking branch 'ck/master' into 20200409_bug_fix_mysql_handshake_scramble 2020-04-10 11:10:41 +08:00
alexey-milovidov
4a73fe7477
Merge pull request #9889 from Avogar/msgpack_format
Msgpack format
2020-04-10 00:07:10 +03:00
alexey-milovidov
a85d35f31c
Merge pull request #10049 from azat/show-create-table-multiline
Make SHOW CREATE TABLE multiline
2020-04-09 23:30:56 +03:00
Anton Popov
76cf9b7f03 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-04-09 20:16:45 +03:00
Vitaly Baranov
20d935566f Enable access management in stateless tests #3. 2020-04-09 19:12:55 +03:00
Pavel Kovalenko
ee36750482 Set storage policy explicitly in MergeTree over S3 tests. 2020-04-09 18:36:13 +03:00
Vitaly Baranov
12336a9ece Use "CREATE USER HOST REGEXP" instead of "CREATE USER HOST NAME REGEXP". 2020-04-09 10:22:51 +03:00
Vitaly Baranov
4d93577791 PREWHERE can be used now by user without row filtering. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
d548c7e381 Simplify DCL for creating quotas. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
23ac1ee87c readonly user now can execute SHOW CREATE for access entities. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
c97d12a19c Enable access management by default for all integration tests. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
36a5b57ac4 Use "CREATE SETTINGS PROFILE name SETTINGS INHERIT parent" instead of "CREATE SETTINGS PROFILE name SETTINGS PROFILE parent". 2020-04-09 10:22:51 +03:00
Nikolai Kochetov
e28e5b24e9 Update test. 2020-04-09 09:29:38 +03:00
BohuTANG
691fe42586 Merge remote-tracking branch 'ck/master' into 20200409_bug_fix_mysql_handshake_scramble 2020-04-09 10:59:04 +08:00
BohuTANG
17256e0f1e add java client integation tests 2020-04-09 10:53:40 +08:00
alexey-milovidov
6ff4c3aa16
Merge pull request #10135 from azat/distributed-insert-converting
Convert blocks if structure does not match on INSERT into Distributed()
2020-04-09 05:51:36 +03:00
Alexey Milovidov
5314b277af Fixed test 2020-04-09 05:50:37 +03:00
Konstantin Lebedev
b666f60af8 Optional secured communication between ClickHouse and Zookeeper 2020-04-09 01:40:54 +03:00
BohuTANG
f48fdda678
Enhanced compatibility with native mysql-connector-java(JDBC) (#10021)
* Skip the `/* comments */ SELECT @@variables ...` from mysql-connector-java setup for MySQL Handler #9336

mysql-connector setup query:
/* mysql-connector-java-5.1.38 ( Revision: ${revinfo.commit} ) */SELECT  @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_connection, @@character_set_results AS character_set_results, @@character_set_server AS character_set_server, @@init_connect AS init_connect, @@interactive_timeout AS interactive_timeout...

ClickHouse side Error:
{} <Error> executeQuery: Code: 62, e.displayText() = DB::Exception: Syntax error: failed at position 74: @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_conn. Expected one of: CAST, NULL...

Client side Exception:
java.sql.SQLException: Syntax error: failed at position 74: @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_conn. Expected one of: CAST...

* add repalce 'SHOW VARIABLES' for mysql-connector-java-5.1.34 #9336

* Add java client(JDBC) integration test to test_mysql_protocol

* shift out java tests from dbms

* Update MySQLHandler.cpp

* Update MySQLHandler.cpp

* test_mysql_protocol: add Test.java exit code 1 when expection

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2020-04-09 00:52:19 +03:00
Azat Khuzhin
6d85207bfb Convert blocks if structure does not match on INSERT into Distributed()
Follow-up for: #10105
2020-04-08 23:46:01 +03:00
Alexey Milovidov
5e336ba063 Added another test #10077 2020-04-08 23:33:40 +03:00
alexey-milovidov
db4270b60c
Merge pull request #10077 from zhang2014/fix/ISSUES-10056
ISSUES-10056 support identifier argument for MySQL Database engine
2020-04-08 22:59:09 +03:00
alexey-milovidov
0372a6119a
Merge pull request #10110 from amosbird/tsm
more monotonicity for toString()
2020-04-08 22:55:04 +03:00
alexey-milovidov
9a00eca1c5
Merge pull request #10121 from ClickHouse/fix_adaptive_granularity_compatibility
Fix adaptive granularity compatibility
2020-04-08 22:50:09 +03:00
Nikolai Kochetov
b9f73a9f77 Added test. 2020-04-08 21:50:13 +03:00
Pavel Kovalenko
0ea0daa194 Merge remote-tracking branch 'origin/master' into replicated-merge-tree-s3 2020-04-08 21:47:17 +03:00
Azat Khuzhin
824255f603 Update tests for multiline SHOW CREATE
The following has been used for this:

    git grep '^CREATE' tests/queries/**.reference | cut -d: -f1 | sort -u | xargs -n1 -i sh -c 'show-create-rewrite.py < {} | sponge {}'

show-create-rewrite.py is available here:

    https://gist.github.com/azat/916b98b5ddf9573f7dc9a4dce33b59b5

And for 00998_constraints_all_tables test FORMAT TSVRaw I simply drop.
2020-04-08 20:54:22 +03:00
Nikolai Kochetov
3b4682d179 Updated 01232_preparing_sets_race_condition. 2020-04-08 20:46:48 +03:00
zhang2014
9eb96b87db ISSUES-10056 reused evaluateConstantExpressionOrIdentifierAsLiteral 2020-04-09 01:31:28 +08:00
zhang2014
9ed708b902 ISSUES-10056 add some check and support identifier argument for MySQL Database Engine 2020-04-09 01:31:27 +08:00
Anton Popov
ae2a05d414 add test with 'ALTER MODIFY' and compact parts 2020-04-08 19:34:14 +03:00
Pavel Kovalenko
eca6caa8db Integration tests for MergeTree over S3 code cleanup. 2020-04-08 15:48:16 +03:00
Amos Bird
f1cb928737
more monotonicity for toString() 2020-04-08 20:13:44 +08:00
Pavel Kovalenko
89fe81ed62 Integration test for ReplicatedMergeTree over S3 fixes. 2020-04-08 14:56:31 +03:00
Pavel Kovalenko
bc349a563a Merge branch 'master' into replicated-merge-tree-s3 2020-04-08 13:53:30 +03:00
Pavel Kovalenko
4ec77fee8b Integration test for ReplicatedMergeTree over S3. 2020-04-08 13:53:17 +03:00
alesapin
ded306f016 Fix adaptive granularity compatibility 2020-04-08 12:51:04 +03:00
Amos Bird
0b5cc80580
joinGetOrNull 2020-04-08 11:01:08 +08:00
alexey-milovidov
6d80ab1eed
Merge pull request #9811 from vitlibar/RBAC-8
RBAC-8
2020-04-08 05:47:55 +03:00
alexey-milovidov
dd333460d6
Merge pull request #10068 from ClickHouse/fix_check_table_with_index
Fix bug with uncompressed checksums in CHECK TABLE query
2020-04-08 05:37:18 +03:00
alexey-milovidov
dad892e9d4
Merge pull request #10105 from azat/distributed-insert-types-differs
Fix SIGSEGV on INSERT into Distributed on different struct with underlying
2020-04-08 05:36:02 +03:00
Anton Popov
cbdc3ef214 Merge remote-tracking branch 'upstream/master' into speedup-index 2020-04-08 04:15:48 +03:00
alexey-milovidov
09a397a68f
Merge pull request #9997 from azat/dist-on-dist-fixes
Fix Distributed-over-Distributed with one only shard in nested table
2020-04-08 03:45:29 +03:00
alexey-milovidov
a29393821d
Merge pull request #10099 from ClickHouse/fix-9826
Fix 9826
2020-04-08 02:41:11 +03:00
Azat Khuzhin
b2fa9d8750 Fix SIGSEGV on INSERT into Distributed on different struct with underlying 2020-04-08 02:35:31 +03:00
alexey-milovidov
c079fd7f1b
Merge pull request #10064 from ClickHouse/small_fixes_in_dict_parser
Small fixes in dictionaries DDL parser
2020-04-08 02:22:20 +03:00
alexey-milovidov
491f4b2c60
Merge pull request #10071 from ClickHouse/add_conversion_stream
Add converting stream to localhost clickhouse dict
2020-04-08 02:13:17 +03:00
alexey-milovidov
d20dfea6ed
Merge pull request #10095 from ClickHouse/fix_replica_start_from_old_version
Fix replicated tables startup when updating from old version
2020-04-08 02:11:12 +03:00
alexey-milovidov
115dd1b5fe
Merge pull request #9989 from ClickHouse/globs-in-paths-leading-zeros
Fix behaviour of globs in filepath with leading zeros
2020-04-08 00:49:27 +03:00
Anton Popov
a1d9d8e65e
Merge pull request #10086 from CurtizJ/polymorphic-parts
Add check with enabled polymorphic parts.
2020-04-08 00:24:50 +03:00
Vitaly Baranov
42b8ed3ec6 Implement "ON CLUSTER" clause for access control SQL. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
d0af31bbcf Use ALTER USER DROP HOST instead of ALTER USER REMOVE HOST for consistency. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
bc3e2cb48c Add the option "access_control_path" to server config. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
d064ddfe13 Disable MemoryAccessStorage. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
b71ff6160a Add the "access_management" option to users.xml which enables a user to manage access rights.
The option is turned off by default.
2020-04-07 23:31:54 +03:00
Vitaly Baranov
b4d7ef390c Rename some access types: add ALTER and SYSTEM prefixes. 2020-04-07 23:20:38 +03:00
Vitaly Baranov
e5d8f05251 Rename sql command "CREATE POLICY" -> "CREATE ROW POLICY", "CREATE POLICY" is now an alias. 2020-04-07 23:20:38 +03:00
Nikolai Kochetov
6f3b700097 Added test. 2020-04-07 20:59:13 +03:00
alesapin
82a87bc0d2 Fix replicated tables startup when updating from old version 2020-04-07 18:28:29 +03:00
Olga Khvostikova
834e458f26 Fix behaviour of globs in filepath with leading zeros 2020-04-07 16:46:12 +03:00
alesapin
0d7cff2b25 Merge branch 'master' into fix_check_table_with_index 2020-04-07 16:36:09 +03:00
alesapin
33c2587213 Merge branch 'master' into add_conversion_stream 2020-04-07 16:35:40 +03:00
alesapin
06f135ee8d Merge branch 'master' into small_fixes_in_dict_parser 2020-04-07 16:35:16 +03:00
alesapin
f1e0f15556
Merge pull request #9948 from ClickHouse/alter_rename_column
Alter rename column
2020-04-07 15:28:00 +03:00
alesapin
9bc0ab2eed Merge branch 'master' into small_fixes_in_dict_parser 2020-04-07 14:59:08 +03:00
alesapin
d0bed6b204 Merge branch 'master' into fix_check_table_with_index 2020-04-07 14:58:45 +03:00
alesapin
5f3bcf198b Merge branch 'master' into add_conversion_stream 2020-04-07 14:57:58 +03:00
Anton Popov
592093b749 add check with polymorphic parts 2020-04-07 14:48:23 +03:00
philip.han
53b5dade5e Implement transform_null_in 2020-04-07 20:08:13 +09:00
Alexander Kuzmenkov
0642619afe
Merge pull request #9992 from ClickHouse/aku/fix-tests-for-random-order
Fix some tests for random execution order
2020-04-06 23:33:56 +03:00
alesapin
107c5b7860
Merge pull request #10063 from ClickHouse/fix-GroupingAggregatedTransform-single-level
Fix GroupingAggregatedTransform for single-level aggregation. Add test.
2020-04-06 22:13:15 +03:00
alesapin
04e3e3179c Add converting stream to localhost clickhouse dict 2020-04-06 22:09:39 +03:00
Vitaly Baranov
2296472195 Enable access management in stateless tests. 2020-04-06 21:55:25 +03:00
alesapin
f0124ffc2b Fix runner script 2020-04-06 21:30:51 +03:00
Nikolai Kochetov
4fd5ef8bad Review fixes. 2020-04-06 21:05:45 +03:00
alesapin
c17fa34fa5 Fix bug with uncompressed checksums in CHECK TABLE query 2020-04-06 20:00:29 +03:00
Artem Zuikov
174136a1e0
inflating cross join (#10029) 2020-04-06 16:39:57 +03:00
alesapin
848678d656 Now layout type for dictionaries DDL with no arguments can be written without brackets 2020-04-06 14:02:17 +03:00
Anton Popov
79024d73a2 improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
Nikolai Kochetov
0117c194c5 Fix GroupingAggregatedTransform for single-level aggregation. Add test. 2020-04-06 13:33:59 +03:00
alesapin
1cb072d58a Merge branch 'master' into alter_rename_column 2020-04-06 11:40:27 +03:00
Avogar
fbc11d3bf9 Move files 2020-04-04 17:04:20 +03:00
Azat Khuzhin
1777e2fd6b Regression for Distributed-over-Distributed when nested table has only one shard 2020-04-04 13:47:34 +03:00
Vasily Nemkov
b441e8a408 Integration test for Distributed over Distributed (from #8640) 2020-04-04 13:47:34 +03:00
Alexander Kuzmenkov
49bc33ed34
Update 01073_attach_if_not_exists.sql 2020-04-03 18:59:59 +03:00
Alexander Kuzmenkov
9d5ece27c7
Merge pull request #10025 from ClickHouse/aku/shm-trailing-zeros
Support trailing zero bytes in string hash map
2020-04-03 18:16:52 +03:00
alesapin
3b498c603b Fix stupid bug in parser 2020-04-03 15:26:57 +03:00
alesapin
a027b33195 Better test 2020-04-03 14:19:17 +03:00
alesapin
f3e3df4593 Better test 2020-04-03 14:15:43 +03:00
Alexander Kuzmenkov
7a1d40507a fix more tests 2020-04-03 12:55:22 +03:00
alesapin
763669f3dc Better test and correct access rights 2020-04-03 12:53:31 +03:00
alesapin
4902346f86 Merge branch 'master' into alter_rename_column 2020-04-03 12:00:15 +03:00
Alexander Kuzmenkov
cd88b5380c Performance comparison fixes 2020-04-02 21:44:58 +03:00
alesapin
9e49d7c8cb One more test for indices 2020-04-02 21:31:27 +03:00
alesapin
0606b7e4df Renames for compact parts 2020-04-02 21:24:11 +03:00
Alexander Kuzmenkov
cd76ba3c19 Support trailing zero bytes in string hash map. 2020-04-02 20:19:57 +03:00
Alexander Kuzmenkov
f98d38baaf Merge remote-tracking branch 'origin/master' into HEAD 2020-04-02 20:03:20 +03:00
alesapin
5b133dd1ce Add default columns alter 2020-04-02 19:11:10 +03:00
alesapin
93907f0985 Fix reference and move files 2020-04-02 13:09:44 +03:00
Ivan Lezhankin
3b716b07ba Fix broken links 2020-04-02 12:10:09 +03:00
alesapin
918e145ea5 Fix integration test 2020-04-02 11:51:21 +03:00