Commit Graph

9658 Commits

Author SHA1 Message Date
alexey-milovidov
6ff4c3aa16
Merge pull request #10135 from azat/distributed-insert-converting
Convert blocks if structure does not match on INSERT into Distributed()
2020-04-09 05:51:36 +03:00
Alexey Milovidov
5314b277af Fixed test 2020-04-09 05:50:37 +03:00
Alexander Tokmakov
140cd88c20 fixes 2020-04-09 02:59:39 +03:00
Konstantin Lebedev
b666f60af8 Optional secured communication between ClickHouse and Zookeeper 2020-04-09 01:40:54 +03:00
BohuTANG
f48fdda678
Enhanced compatibility with native mysql-connector-java(JDBC) (#10021)
* Skip the `/* comments */ SELECT @@variables ...` from mysql-connector-java setup for MySQL Handler #9336

mysql-connector setup query:
/* mysql-connector-java-5.1.38 ( Revision: ${revinfo.commit} ) */SELECT  @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_connection, @@character_set_results AS character_set_results, @@character_set_server AS character_set_server, @@init_connect AS init_connect, @@interactive_timeout AS interactive_timeout...

ClickHouse side Error:
{} <Error> executeQuery: Code: 62, e.displayText() = DB::Exception: Syntax error: failed at position 74: @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_conn. Expected one of: CAST, NULL...

Client side Exception:
java.sql.SQLException: Syntax error: failed at position 74: @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_conn. Expected one of: CAST...

* add repalce 'SHOW VARIABLES' for mysql-connector-java-5.1.34 #9336

* Add java client(JDBC) integration test to test_mysql_protocol

* shift out java tests from dbms

* Update MySQLHandler.cpp

* Update MySQLHandler.cpp

* test_mysql_protocol: add Test.java exit code 1 when expection

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2020-04-09 00:52:19 +03:00
Артем Стрельцов
c0051d9cd9 fixed bug with ClickHouseDictionarySource & test for all sources added 2020-04-09 00:48:00 +03:00
Azat Khuzhin
6d85207bfb Convert blocks if structure does not match on INSERT into Distributed()
Follow-up for: #10105
2020-04-08 23:46:01 +03:00
Alexey Milovidov
5e336ba063 Added another test #10077 2020-04-08 23:33:40 +03:00
alexey-milovidov
db4270b60c
Merge pull request #10077 from zhang2014/fix/ISSUES-10056
ISSUES-10056 support identifier argument for MySQL Database engine
2020-04-08 22:59:09 +03:00
alexey-milovidov
0372a6119a
Merge pull request #10110 from amosbird/tsm
more monotonicity for toString()
2020-04-08 22:55:04 +03:00
alexey-milovidov
9a00eca1c5
Merge pull request #10121 from ClickHouse/fix_adaptive_granularity_compatibility
Fix adaptive granularity compatibility
2020-04-08 22:50:09 +03:00
Alexander Tokmakov
dd1590830b Merge branch 'master' into database_atomic 2020-04-08 22:00:46 +03:00
Nikolai Kochetov
b9f73a9f77 Added test. 2020-04-08 21:50:13 +03:00
Pavel Kovalenko
0ea0daa194 Merge remote-tracking branch 'origin/master' into replicated-merge-tree-s3 2020-04-08 21:47:17 +03:00
Azat Khuzhin
824255f603 Update tests for multiline SHOW CREATE
The following has been used for this:

    git grep '^CREATE' tests/queries/**.reference | cut -d: -f1 | sort -u | xargs -n1 -i sh -c 'show-create-rewrite.py < {} | sponge {}'

show-create-rewrite.py is available here:

    https://gist.github.com/azat/916b98b5ddf9573f7dc9a4dce33b59b5

And for 00998_constraints_all_tables test FORMAT TSVRaw I simply drop.
2020-04-08 20:54:22 +03:00
Nikolai Kochetov
3b4682d179 Updated 01232_preparing_sets_race_condition. 2020-04-08 20:46:48 +03:00
zhang2014
9eb96b87db ISSUES-10056 reused evaluateConstantExpressionOrIdentifierAsLiteral 2020-04-09 01:31:28 +08:00
zhang2014
9ed708b902 ISSUES-10056 add some check and support identifier argument for MySQL Database Engine 2020-04-09 01:31:27 +08:00
Anton Popov
ae2a05d414 add test with 'ALTER MODIFY' and compact parts 2020-04-08 19:34:14 +03:00
Pavel Kovalenko
eca6caa8db Integration tests for MergeTree over S3 code cleanup. 2020-04-08 15:48:16 +03:00
Amos Bird
f1cb928737
more monotonicity for toString() 2020-04-08 20:13:44 +08:00
Pavel Kovalenko
89fe81ed62 Integration test for ReplicatedMergeTree over S3 fixes. 2020-04-08 14:56:31 +03:00
Pavel Kovalenko
bc349a563a Merge branch 'master' into replicated-merge-tree-s3 2020-04-08 13:53:30 +03:00
Pavel Kovalenko
4ec77fee8b Integration test for ReplicatedMergeTree over S3. 2020-04-08 13:53:17 +03:00
Ivan Lezhankin
cef057f150 Fix test 2020-04-08 12:59:51 +03:00
alesapin
ded306f016 Fix adaptive granularity compatibility 2020-04-08 12:51:04 +03:00
Ivan Lezhankin
e6bd496269 Merge branch 'master' into pytest 2020-04-08 06:15:05 +03:00
Amos Bird
0b5cc80580
joinGetOrNull 2020-04-08 11:01:08 +08:00
alexey-milovidov
6d80ab1eed
Merge pull request #9811 from vitlibar/RBAC-8
RBAC-8
2020-04-08 05:47:55 +03:00
alexey-milovidov
dd333460d6
Merge pull request #10068 from ClickHouse/fix_check_table_with_index
Fix bug with uncompressed checksums in CHECK TABLE query
2020-04-08 05:37:18 +03:00
alexey-milovidov
dad892e9d4
Merge pull request #10105 from azat/distributed-insert-types-differs
Fix SIGSEGV on INSERT into Distributed on different struct with underlying
2020-04-08 05:36:02 +03:00
Anton Popov
cbdc3ef214 Merge remote-tracking branch 'upstream/master' into speedup-index 2020-04-08 04:15:48 +03:00
Alexander Tokmakov
135197aa75 fixes 2020-04-08 04:02:00 +03:00
alexey-milovidov
09a397a68f
Merge pull request #9997 from azat/dist-on-dist-fixes
Fix Distributed-over-Distributed with one only shard in nested table
2020-04-08 03:45:29 +03:00
alexey-milovidov
a29393821d
Merge pull request #10099 from ClickHouse/fix-9826
Fix 9826
2020-04-08 02:41:11 +03:00
Azat Khuzhin
b2fa9d8750 Fix SIGSEGV on INSERT into Distributed on different struct with underlying 2020-04-08 02:35:31 +03:00
alexey-milovidov
c079fd7f1b
Merge pull request #10064 from ClickHouse/small_fixes_in_dict_parser
Small fixes in dictionaries DDL parser
2020-04-08 02:22:20 +03:00
alexey-milovidov
491f4b2c60
Merge pull request #10071 from ClickHouse/add_conversion_stream
Add converting stream to localhost clickhouse dict
2020-04-08 02:13:17 +03:00
alexey-milovidov
d20dfea6ed
Merge pull request #10095 from ClickHouse/fix_replica_start_from_old_version
Fix replicated tables startup when updating from old version
2020-04-08 02:11:12 +03:00
alexey-milovidov
115dd1b5fe
Merge pull request #9989 from ClickHouse/globs-in-paths-leading-zeros
Fix behaviour of globs in filepath with leading zeros
2020-04-08 00:49:27 +03:00
Anton Popov
a1d9d8e65e
Merge pull request #10086 from CurtizJ/polymorphic-parts
Add check with enabled polymorphic parts.
2020-04-08 00:24:50 +03:00
Vitaly Baranov
42b8ed3ec6 Implement "ON CLUSTER" clause for access control SQL. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
d0af31bbcf Use ALTER USER DROP HOST instead of ALTER USER REMOVE HOST for consistency. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
bc3e2cb48c Add the option "access_control_path" to server config. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
d064ddfe13 Disable MemoryAccessStorage. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
b71ff6160a Add the "access_management" option to users.xml which enables a user to manage access rights.
The option is turned off by default.
2020-04-07 23:31:54 +03:00
Vitaly Baranov
b4d7ef390c Rename some access types: add ALTER and SYSTEM prefixes. 2020-04-07 23:20:38 +03:00
Vitaly Baranov
e5d8f05251 Rename sql command "CREATE POLICY" -> "CREATE ROW POLICY", "CREATE POLICY" is now an alias. 2020-04-07 23:20:38 +03:00
Nikolai Kochetov
6f3b700097 Added test. 2020-04-07 20:59:13 +03:00
alesapin
82a87bc0d2 Fix replicated tables startup when updating from old version 2020-04-07 18:28:29 +03:00
Olga Khvostikova
834e458f26 Fix behaviour of globs in filepath with leading zeros 2020-04-07 16:46:12 +03:00
alesapin
0d7cff2b25 Merge branch 'master' into fix_check_table_with_index 2020-04-07 16:36:09 +03:00
alesapin
33c2587213 Merge branch 'master' into add_conversion_stream 2020-04-07 16:35:40 +03:00
alesapin
06f135ee8d Merge branch 'master' into small_fixes_in_dict_parser 2020-04-07 16:35:16 +03:00
Nikita Mikhaylov
626856deff Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-07 15:40:55 +03:00
alesapin
f1e0f15556
Merge pull request #9948 from ClickHouse/alter_rename_column
Alter rename column
2020-04-07 15:28:00 +03:00
alesapin
9bc0ab2eed Merge branch 'master' into small_fixes_in_dict_parser 2020-04-07 14:59:08 +03:00
alesapin
d0bed6b204 Merge branch 'master' into fix_check_table_with_index 2020-04-07 14:58:45 +03:00
alesapin
5f3bcf198b Merge branch 'master' into add_conversion_stream 2020-04-07 14:57:58 +03:00
Anton Popov
592093b749 add check with polymorphic parts 2020-04-07 14:48:23 +03:00
philip.han
53b5dade5e Implement transform_null_in 2020-04-07 20:08:13 +09:00
Nikita Mikhaylov
70c0646942 Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-07 13:42:48 +03:00
Alexander Tokmakov
a2101c9b1c better code 2020-04-07 02:22:44 +03:00
Nikita Mikhaylov
0c0eff36d1 move 2020-04-06 23:34:04 +03:00
Alexander Kuzmenkov
0642619afe
Merge pull request #9992 from ClickHouse/aku/fix-tests-for-random-order
Fix some tests for random execution order
2020-04-06 23:33:56 +03:00
alesapin
107c5b7860
Merge pull request #10063 from ClickHouse/fix-GroupingAggregatedTransform-single-level
Fix GroupingAggregatedTransform for single-level aggregation. Add test.
2020-04-06 22:13:15 +03:00
alesapin
04e3e3179c Add converting stream to localhost clickhouse dict 2020-04-06 22:09:39 +03:00
Vitaly Baranov
2296472195 Enable access management in stateless tests. 2020-04-06 21:55:25 +03:00
alesapin
f0124ffc2b Fix runner script 2020-04-06 21:30:51 +03:00
Nikolai Kochetov
4fd5ef8bad Review fixes. 2020-04-06 21:05:45 +03:00
alesapin
c17fa34fa5 Fix bug with uncompressed checksums in CHECK TABLE query 2020-04-06 20:00:29 +03:00
Artem Zuikov
174136a1e0
inflating cross join (#10029) 2020-04-06 16:39:57 +03:00
Alexander Tokmakov
08bae4668d Merge branch 'master' into database_atomic 2020-04-06 16:18:07 +03:00
alesapin
848678d656 Now layout type for dictionaries DDL with no arguments can be written without brackets 2020-04-06 14:02:17 +03:00
Anton Popov
79024d73a2 improve performance of index analysis with monotonic functions 2020-04-06 13:37:34 +03:00
Nikolai Kochetov
0117c194c5 Fix GroupingAggregatedTransform for single-level aggregation. Add test. 2020-04-06 13:33:59 +03:00
alesapin
1cb072d58a Merge branch 'master' into alter_rename_column 2020-04-06 11:40:27 +03:00
Ivan Lezhankin
a25b2815aa Merge branch 'master' into pytest 2020-04-04 19:51:52 +03:00
Avogar
fbc11d3bf9 Move files 2020-04-04 17:04:20 +03:00
Azat Khuzhin
1777e2fd6b Regression for Distributed-over-Distributed when nested table has only one shard 2020-04-04 13:47:34 +03:00
Vasily Nemkov
b441e8a408 Integration test for Distributed over Distributed (from #8640) 2020-04-04 13:47:34 +03:00
Alexander Tokmakov
c080e6c969 resolve table uuid another way 2020-04-04 02:37:58 +03:00
Alexander Kuzmenkov
49bc33ed34
Update 01073_attach_if_not_exists.sql 2020-04-03 18:59:59 +03:00
Alexander Kuzmenkov
9d5ece27c7
Merge pull request #10025 from ClickHouse/aku/shm-trailing-zeros
Support trailing zero bytes in string hash map
2020-04-03 18:16:52 +03:00
Ivan Lezhankin
ade3e026fa Some fixes 2020-04-03 16:54:11 +03:00
alesapin
3b498c603b Fix stupid bug in parser 2020-04-03 15:26:57 +03:00
alesapin
a027b33195 Better test 2020-04-03 14:19:17 +03:00
alesapin
f3e3df4593 Better test 2020-04-03 14:15:43 +03:00
Alexander Kuzmenkov
7a1d40507a fix more tests 2020-04-03 12:55:22 +03:00
alesapin
763669f3dc Better test and correct access rights 2020-04-03 12:53:31 +03:00
alesapin
4902346f86 Merge branch 'master' into alter_rename_column 2020-04-03 12:00:15 +03:00
Alexander Tokmakov
9c67d2716e Merge branch 'master' into database_atomic 2020-04-03 03:19:11 +03:00
Alexander Kuzmenkov
cd88b5380c Performance comparison fixes 2020-04-02 21:44:58 +03:00
alesapin
9e49d7c8cb One more test for indices 2020-04-02 21:31:27 +03:00
alesapin
0606b7e4df Renames for compact parts 2020-04-02 21:24:11 +03:00
Alexander Kuzmenkov
cd76ba3c19 Support trailing zero bytes in string hash map. 2020-04-02 20:19:57 +03:00
Alexander Kuzmenkov
f98d38baaf Merge remote-tracking branch 'origin/master' into HEAD 2020-04-02 20:03:20 +03:00
alesapin
5b133dd1ce Add default columns alter 2020-04-02 19:11:10 +03:00
alesapin
93907f0985 Fix reference and move files 2020-04-02 13:09:44 +03:00
Ivan Lezhankin
3b716b07ba Fix broken links 2020-04-02 12:10:09 +03:00
alesapin
918e145ea5 Fix integration test 2020-04-02 11:51:21 +03:00
Ivan Lezhankin
c0a595355a Move more dbms/tests to top-level 2020-04-02 03:32:39 +03:00
Ivan
97f2a2213e
Move all folders inside /dbms one level up (#9974)
* Move some code outside dbms/src folder
* Fix paths
2020-04-02 02:51:21 +03:00
Azat Khuzhin
22bedec33e Add 01683_dist_INSERT_block_structure_mismatch into arcadia_skip_list 2020-02-03 08:05:00 +03:00
Azat Khuzhin
5070b8a76a Update test_insert_distributed_async_send for recent block conversion changes
After the implicit conversion had been added, String and
Nullable(String) successfully converted, let's use UInt64 over
Nullable(String).
2021-02-02 21:38:29 +03:00
Azat Khuzhin
edd79e3faf Suppress warnings in 01457_create_as_table_function_structure 2021-02-02 10:16:41 +03:00
Azat Khuzhin
594c6b0dd4 Suppress warnings in 00967_insert_into_distributed_different_types 2021-02-02 10:16:41 +03:00
Azat Khuzhin
f53c9a6b25 Fix "Block structure mismatch" for INSERT into Distributed
Add missing conversion (via ConvertingBlockInputStream) for INSERT into
remote nodes (for sync insert, async insert and async batch insert),
like for local nodes (in DistributedBlockOutputStream::writeBlockConverted).

This is required when the structure of the Distributed table differs
from the structure of the local table.

And also add a warning message, to highlight this in logs (since this
works slower).

Fixes: #19888
2021-02-02 10:16:41 +03:00