thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-27 18:12:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
115,814 Commits 9,188 Branches 1,782 Tags 2.1 GiB
1d8013074d
Commit Graph

6505 Commits

Author SHA1 Message Date
alexey-milovidov
f8195a577c
Merge pull request #10744 from Jokser/s3-proxy-resolver 
S3 with proxy resolver
 2020-05-14 02:19:10 +03:00
Azat Khuzhin
de1d529e86 Cover nearest_hostname in test_insert_distributed_load_balancing 2020-05-14 01:50:56 +03:00
Alexander Tokmakov
b1ed51df6e add simple test 2020-05-13 22:47:35 +03:00
Vitaly Baranov
5b84121d81 Improve system tables for quotas. Remove function currentQuota(). 2020-05-13 19:40:48 +03:00
Vitaly Baranov
e64e2ebdf6 Improve system table for row policies. Remove function currentRowPolicies(). 2020-05-13 19:40:48 +03:00
Vitaly Baranov
9a89a04c1f Improve TSV class in test tools: now it can get a table as a list of lists. 2020-05-13 19:40:48 +03:00
Vitaly Baranov
dd8b29b4fb Use enum Type instead of std::type_index to represent the type of IAccessEntity. 
This change simplifies handling of access entities in access storages.
 2020-05-13 19:40:48 +03:00
alesapin
774f9fccc5
Update test.py 2020-05-13 18:25:55 +03:00
Anton Popov
d13a11b421 fix backward compatibility with tuples and distributed 2020-05-13 17:14:05 +03:00
alesapin
1c4564d9ed Simplify rename tests 2020-05-13 15:56:32 +03:00
alesapin
352c402cf2 Merge branch 'add_alter_rename_column_to_distributed' of https://github.com/vzakaznikov/ClickHouse into vzakaznikov-add_alter_rename_column_to_distributed 2020-05-13 14:14:23 +03:00
Azat Khuzhin
0ea3411137 Add integration test for load balancing for Distributed INSERT 2020-05-13 02:51:17 +03:00
alesapin
35a9a203f1
Update test.py 2020-05-12 18:01:43 +03:00
Артем Стрельцов
10f6817fdd added new layout to integration test 2020-05-12 18:00:08 +03:00
Vitaliy Zakaznikov
3505ccc2fc Increasing zookeeper_session_timeout setting to 15 sec. 2020-05-11 20:27:19 +02:00
Vitaliy Zakaznikov
1efc372c0c Fixing test_rename_with_parallel_select. 2020-05-11 20:09:45 +02:00
alexey-milovidov
ddc84163a7
Merge pull request #10486 from azat/dist-send-on-INSERT 
Fix distributed send that are scheduled by INSERT query
 2020-05-11 06:28:35 +03:00
Vitaliy Zakaznikov
089371ddfb Reverting test so that it can pass. 2020-05-08 14:48:24 +02:00
Vitaliy Zakaznikov
dd5dd5de32 Updating test_rename_with_parallel_ttl_move to check if parts got moves. 
Adding renaming of the time column used inside the TTL expression after insert.
 2020-05-08 13:35:50 +02:00
Pavel Kovalenko
5cc0927874 Add comment explaining protocol for proxy resolver configuration. 2020-05-08 14:07:26 +03:00
Pavel Kovalenko
8602f7b47c Minor updates in proxy resolver parameters naming. 2020-05-08 13:58:56 +03:00
Pavel Kovalenko
6165c2aa99 Add possibility to use proxy resolver in DiskS3. 2020-05-08 13:53:12 +03:00
Vitaliy Zakaznikov
eb3c6ca0d8 Adding configuration files. 2020-05-08 12:36:37 +02:00
Vitaliy Zakaznikov
65f139f374 Adding more integration tests for alter rename column. 2020-05-07 21:00:17 +02:00
Vitaliy Zakaznikov
abe28968f4 Adding tests. 2020-05-07 15:50:42 +02:00
alexey-milovidov
eeac7aa313
Merge pull request #10622 from kekekekule/layout_direct 
Add direct layout for dictionaries
 2020-05-07 01:05:29 +03:00
Артем Стрельцов
b2993c314c fixes relevant to review 2020-05-07 00:59:31 +03:00
alexey-milovidov
4df7dd8c2b
Merge pull request #10656 from azat/kafka-consumer-hang 
Kafka cleanup
 2020-05-07 00:20:31 +03:00
Anton Popov
387041a97e Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-05-06 19:22:07 +03:00
Anton Popov
4878c91d07 in-memory parts: better restore from wal 2020-05-06 14:57:38 +03:00
Артем Стрельцов
1428188e21 fixed test for direct layout & fixed data load for FileDictionarySource 2020-05-06 03:52:13 +03:00
Azat Khuzhin
7ab0c3493c Add integration test for kafka consumer hang 
This test triggers heartbeat failrues which leads to
REBALANCE_IN_PROGRESS which causes hang.
 2020-05-04 18:46:30 +03:00
Alexey Milovidov
7ddad8cc01 Fix integration test 2020-05-04 17:51:29 +03:00
Azat Khuzhin
fc5f0bfe52 Enable librdkafka debugging in test_storage_kafka 2020-05-04 17:23:09 +03:00
Azat Khuzhin
12871bf26e Drop resolved TODO from test_storage_kafka 2020-05-04 17:23:09 +03:00
Nikolay Degterinsky
a3e557a5d2 documentation is added & added 'direct' layout into integragion test 2020-05-03 15:55:22 +03:00
Azat Khuzhin
14fccf572f Fix false-positive failures of the test_distributed_storage_configuration 
After first INSERT for disk2 there should not be created any per-shard
directory, so find(1) should report an error, like:

  find: '/disk2/data/test/dist_foo/default@127%2E0%2E0%2E2:9000': No such file or directory"

But sometimes output can be fixed, and output of wc(1) will goes first
and python's int() will parse it and not fail, but if find(1) stderr
will goes first the int() will fail to parse.

And here is an example of such mixing:

  $ docker run --name alpine --rm -it alpine top
  $ docker exec alpine sh -c 'echo foo >&2 | wc -c'
  foo
  0
  $ docker exec alpine sh -c 'echo foo >&2 | wc -c'
  0
  foo
 2020-05-03 14:48:00 +03:00
Azat Khuzhin
0a75dc626b Add some comments int test_distributed_storage_configuration 2020-05-03 14:46:44 +03:00
alexey-milovidov
a235533d5f
Merge pull request #10576 from Jokser/s3-with-dynamic-proxies 
S3 with dynamic proxy configuration
 2020-05-03 01:25:13 +03:00
alexey-milovidov
d38ea6fc1c
Merge pull request #10608 from ClickHouse/fix_drop_dns_cache 
Improve DROP DNS CACHE
 2020-05-02 22:10:58 +03:00
Alexander Tokmakov
9ca144cab9 drop access cache on DROP DNS CACHE 2020-05-01 01:29:47 +03:00
Anton Popov
aa723d245f Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-04-30 18:27:39 +03:00
alesapin
15e8f37839
Merge pull request #10531 from CurtizJ/polymorphic-parts-2 
Fix index corruption in merges with compact parts.
 2020-04-30 12:15:25 +03:00
Anton Popov
42997bce86 im-memory parts: replication 2020-04-29 20:14:49 +03:00
Pavel Kovalenko
e5e84960ea S3 with proxy integration test and fixes. 2020-04-29 11:40:29 +03:00
Anton Popov
1789d6fa82 add a test just in case 2020-04-29 02:07:11 +03:00
tavplubix
11c3493676
Merge pull request #10547 from ClickHouse/zhang2014/feature/ISSUES-5436 
Merging #7572
 2020-04-28 12:40:48 +03:00
Alexander Tokmakov
5a1d22a363 remove redundant configs from test 2020-04-28 02:05:15 +03:00
Alexander Tokmakov
e72a484beb minor fixes 2020-04-28 02:05:15 +03:00
Anton Popov
eaf80c5f18 add integration test for compact parts 2020-04-27 16:37:05 +03:00
zhang2014
81230944a4 ISSUES-5436 add integration test 2020-04-27 18:49:32 +08:00
Alexander Tokmakov
04d6b59ac0 Merge branch 'master' into database_atomic 2020-04-23 17:31:37 +03:00
zhang2014
0070f75218 ISSUES-5436 fix integration test failure & add test 2020-04-23 17:11:20 +08:00
alexey-milovidov
829a7a551c
Merge pull request #10446 from CurtizJ/fix-mysql-test 
Fix mysql integration test
 2020-04-23 00:25:25 +03:00
Nikita Mikhaylov
3cf2016867
Merge pull request #10188 from nikitamikhaylov/quorum_bug 
insert_quorum vs drop partition or ttl
 2020-04-23 00:11:57 +04:00
Anton Popov
47213ebfe1 fix mysql test 2020-04-22 23:09:07 +03:00
Nikita Mikhaylov
f1ee08778f
Merge pull request #10414 from nikitamikhaylov/copier-sample-offset 
cluster copier with sample offset
 2020-04-22 20:31:17 +04:00
Alexander Tokmakov
fefbbd37df Merge branch 'master' into database_atomic 2020-04-22 17:02:30 +03:00
Nikita Mikhaylov
1d5d6582a0 fix test 2020-04-22 14:35:18 +03:00
alexey-milovidov
7065a8ba9c
Merge pull request #10422 from azat/fallback_to_stale_replicas-over-skip_unavailable_shards 
Prefer fallback_to_stale_replicas over skip_unavailable_shards
 2020-04-22 09:20:25 +03:00
Azat Khuzhin
e0f58b1ca1 Cover fallback_to_stale_replicas in conjunction with skip_unavailable_shards 2020-04-22 01:47:22 +03:00
Nikita Mikhaylov
15de7e4fa7 first try 2020-04-21 20:37:40 +03:00
alesapin
dec2e65aa5 Add test for alter on cluster 2020-04-21 16:47:00 +03:00
Ilya Yatsishin
82b0f31e37
Merge pull request #10335 from qoega/move_docker_to_docker 
Move integration tests docker files to docker/ directory.
 2020-04-21 15:10:42 +03:00
Nikita Mikhaylov
2173bcf28e Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-21 14:35:06 +03:00
alexey-milovidov
4ecc86beca
Merge pull request #9950 from ClickHouse/aku/literal-columns 
Create unique columns for literals
 2020-04-21 02:30:17 +03:00
tavplubix
1a067484c8
Merge pull request #10137 from kekekekule/direct_queries 
Add custom settings support for certain dictionary sources
 2020-04-21 01:21:32 +03:00
alexey-milovidov
ab922d44d5
Merge pull request #10379 from ClickHouse/only_fetch_repliac 
Add setting always_fetch_merged_part
 2020-04-21 00:07:00 +03:00
alexey-milovidov
69b6f135e7
Merge pull request #10382 from excitoon-favorites/altercodec 
Allowed to alter column in non-modifying data mode when the same type is specified
 2020-04-20 22:54:53 +03:00
Alexander Kuzmenkov
da7eeb31d0
Update test.py 2020-04-20 22:37:50 +03:00
alesapin
e1fa39d801 fix test 2020-04-20 18:17:34 +03:00
Alexander Kuzmenkov
672c952d39
Update test.py 2020-04-20 17:44:21 +03:00
Vladimir Chebotarev
82985ff594 Allowed to alter column in non-modifying data mode when the same type is specified. 2020-04-20 14:15:06 +03:00
Alexander Tokmakov
b29bddac12 Merge branch 'master' into database_atomic 2020-04-20 14:09:09 +03:00
alesapin
1bc84ec8b4 Fix comments 2020-04-20 13:56:23 +03:00
alesapin
8767ea7efa Add setting which restrict replica to merge parts by itself and always prefer dowloading from other replicas. 2020-04-20 13:53:29 +03:00
alexey-milovidov
e2d85501fe
Merge pull request #10366 from ClickHouse/fix-test-insert-batching 
Fix flacky integration test
 2020-04-20 10:53:38 +03:00
Alexey Milovidov
e06dc573b4 Fix flacky integration test 2020-04-20 06:15:29 +03:00
Alexey Milovidov
99667a38c3 Added a test from Svyatoslav Tkhon Il Pak @DeifyTheGod #9642 2020-04-19 22:56:34 +03:00
zhang2014
8105a9bbe0 ISSUES-5436 fix review suggestions 2020-04-20 02:26:06 +08:00
tai
dafba9d66a ISSUES-5436 add integration test for custom http 2020-04-20 02:25:43 +08:00
alexey-milovidov
aac7cc7330
Merge pull request #10126 from Jokser/replicated-merge-tree-s3 
Support ReplicatedMergeTree over S3
 2020-04-18 16:13:04 +03:00
alexey-milovidov
bdc8dfe04b
Added a change from @azat in #10277 2020-04-18 14:48:51 +03:00
Vitaly Baranov
b9ea0a33a7 Fix flaky test test_settings_constraints_distributed. 2020-04-18 11:23:11 +03:00
Артем Стрельцов
948efff076 Merge branch 'master' of github.com:yandex/ClickHouse into direct_queries 2020-04-17 23:11:10 +03:00
Yatsishin Ilya
a0ce15befd Move integration tests docker files to docker/ directory. Rename image -> runner. 2020-04-17 19:01:16 +03:00
Yatsishin Ilya
f2136bc286 improvements 2020-04-17 11:42:51 +03:00
Nikita Mikhaylov
9a80eb6e47 Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-16 21:47:34 +03:00
alesapin
9bf8f00c3d Fix test 2020-04-15 20:52:05 +03:00
alexey-milovidov
2a48b0ecd7
Merge pull request #10184 from xzkostyan/feature-zookeeper-ssl 
Optional secured communication between ClickHouse and Zookeeper
 2020-04-15 07:09:14 +03:00
Nikita Mikhaylov
91011bc700
bump 2020-04-15 03:04:12 +04:00
Nikita Mikhaylov
89dc40d492
Update test.py 2020-04-14 21:05:10 +03:00
Yatsishin Ilya
dcec80e6dd update README in intergration 2020-04-14 10:15:02 +03:00
Yatsishin Ilya
51567df6e6 output call duration in junit report 2020-04-14 10:15:01 +03:00
Yatsishin Ilya
e5be0c1059 fix integration/test_distributed_ddl/test_replicated_alter 2020-04-14 10:15:01 +03:00
Nikita Mikhaylov
89f80a6353
Merge branch 'master' into quorum_bug 2020-04-13 23:25:55 +04:00
Alexander Tokmakov
6c0d9723e0 Merge branch 'master' into database_atomic 2020-04-13 18:47:47 +03:00
Nikita Mikhaylov
441bb13d4a better 2020-04-13 18:21:05 +03:00
Nikita Mikhaylov
d5c055ab03 remove logs 2020-04-13 15:13:13 +03:00
Pavel Kovalenko
46c0b65c95 Minor fix in MergeTree over S3 tests. 2020-04-13 12:20:38 +03:00
Konstantin Lebedev
df28eca407 Add test for communication between ClickHouse and Zookeeper over SSL 2020-04-13 10:49:16 +03:00
Konstantin Lebedev
eaba5c6c73 Remove mutable defaults from helpers/cluster.py 2020-04-12 17:36:48 +03:00
Alexander Tokmakov
5e6d4b9449 Merge branch 'master' into database_atomic 2020-04-12 16:35:44 +03:00
BohuTANG
e7f399f652 MySQLHandler: max_allowed_packet returned by default when server setup with select variables 2020-04-12 13:37:39 +08:00
alexey-milovidov
9203db0ad5
Merge pull request #10140 from BohuTANG/20200409_bug_fix_mysql_handshake_scramble 
Fix scramble issue for native mysql-connector-java(JDBC)
 2020-04-12 03:53:19 +03:00
alexey-milovidov
30ec2a3ce2
Merge pull request #10179 from vzakaznikov/live_view_over_distributed 
Initial support for live view tables over distributed
 2020-04-12 01:41:42 +03:00
Nikita Mikhaylov
a8d72d01c3 mvp fix 2020-04-11 00:29:54 +03:00
Vitaly Baranov
ca634f603a Revert resetting the settings to their defaults after each query in TCPHandler. 2020-04-10 21:09:59 +03:00
Vitaliy Zakaznikov
7d076d7f3d Removing comments. 2020-04-10 14:09:28 -04:00
Vitaliy Zakaznikov
16c10851d3 Adding more tests to test_distributed_over_live_view. 
Updating test_live_view_over_distributed to be more robust.
 2020-04-10 13:47:47 -04:00
Vitaliy Zakaznikov
c37ba8243d Starting to add test_distributed_over_live_view tests. 2020-04-10 13:01:10 -04:00
Артем Стрельцов
758500893e fixed test 2020-04-10 19:09:44 +03:00
Vitaliy Zakaznikov
201c65f49b Adding test_live_view_over_distributed integration test. 2020-04-10 11:23:04 -04:00
Alexander Tokmakov
033d7f9b32 Merge branch 'master' into database_atomic 2020-04-10 17:12:09 +03:00
BohuTANG
87cc8de8e2 Merge remote-tracking branch 'ck/master' into 20200409_bug_fix_mysql_handshake_scramble 2020-04-10 11:10:41 +08:00
Alexander Tokmakov
a6d0aacd53 fix test 2020-04-09 21:02:27 +03:00
Pavel Kovalenko
ee36750482 Set storage policy explicitly in MergeTree over S3 tests. 2020-04-09 18:36:13 +03:00
Артем Стрельцов
5a70a77c4a Merge branch 'master' into direct_queries 2020-04-09 17:29:37 +03:00
Vitaly Baranov
4d93577791 PREWHERE can be used now by user without row filtering. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
d548c7e381 Simplify DCL for creating quotas. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
23ac1ee87c readonly user now can execute SHOW CREATE for access entities. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
c97d12a19c Enable access management by default for all integration tests. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
36a5b57ac4 Use "CREATE SETTINGS PROFILE name SETTINGS INHERIT parent" instead of "CREATE SETTINGS PROFILE name SETTINGS PROFILE parent". 2020-04-09 10:22:51 +03:00
BohuTANG
17256e0f1e add java client integation tests 2020-04-09 10:53:40 +08:00
Konstantin Lebedev
b666f60af8 Optional secured communication between ClickHouse and Zookeeper 2020-04-09 01:40:54 +03:00
BohuTANG
f48fdda678
Enhanced compatibility with native mysql-connector-java(JDBC) (#10021) 
* Skip the `/* comments */ SELECT @@variables ...` from mysql-connector-java setup for MySQL Handler #9336

mysql-connector setup query:
/* mysql-connector-java-5.1.38 ( Revision: ${revinfo.commit} ) */SELECT  @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_connection, @@character_set_results AS character_set_results, @@character_set_server AS character_set_server, @@init_connect AS init_connect, @@interactive_timeout AS interactive_timeout...

ClickHouse side Error:
{} <Error> executeQuery: Code: 62, e.displayText() = DB::Exception: Syntax error: failed at position 74: @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_conn. Expected one of: CAST, NULL...

Client side Exception:
java.sql.SQLException: Syntax error: failed at position 74: @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_conn. Expected one of: CAST...

* add repalce 'SHOW VARIABLES' for mysql-connector-java-5.1.34 #9336

* Add java client(JDBC) integration test to test_mysql_protocol

* shift out java tests from dbms

* Update MySQLHandler.cpp

* Update MySQLHandler.cpp

* test_mysql_protocol: add Test.java exit code 1 when expection

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
 2020-04-09 00:52:19 +03:00
Артем Стрельцов
c0051d9cd9 fixed bug with ClickHouseDictionarySource & test for all sources added 2020-04-09 00:48:00 +03:00
alexey-milovidov
db4270b60c
Merge pull request #10077 from zhang2014/fix/ISSUES-10056 
ISSUES-10056 support identifier argument for MySQL Database engine
 2020-04-08 22:59:09 +03:00
Alexander Tokmakov
dd1590830b Merge branch 'master' into database_atomic 2020-04-08 22:00:46 +03:00
zhang2014
9eb96b87db ISSUES-10056 reused evaluateConstantExpressionOrIdentifierAsLiteral 2020-04-09 01:31:28 +08:00
zhang2014
9ed708b902 ISSUES-10056 add some check and support identifier argument for MySQL Database Engine 2020-04-09 01:31:27 +08:00
Pavel Kovalenko
eca6caa8db Integration tests for MergeTree over S3 code cleanup. 2020-04-08 15:48:16 +03:00
Pavel Kovalenko
89fe81ed62 Integration test for ReplicatedMergeTree over S3 fixes. 2020-04-08 14:56:31 +03:00
Pavel Kovalenko
bc349a563a Merge branch 'master' into replicated-merge-tree-s3 2020-04-08 13:53:30 +03:00
Pavel Kovalenko
4ec77fee8b Integration test for ReplicatedMergeTree over S3. 2020-04-08 13:53:17 +03:00
alesapin
ded306f016 Fix adaptive granularity compatibility 2020-04-08 12:51:04 +03:00
alexey-milovidov
6d80ab1eed
Merge pull request #9811 from vitlibar/RBAC-8 
RBAC-8
 2020-04-08 05:47:55 +03:00
Alexander Tokmakov
135197aa75 fixes 2020-04-08 04:02:00 +03:00
alexey-milovidov
09a397a68f
Merge pull request #9997 from azat/dist-on-dist-fixes 
Fix Distributed-over-Distributed with one only shard in nested table
 2020-04-08 03:45:29 +03:00
alexey-milovidov
d20dfea6ed
Merge pull request #10095 from ClickHouse/fix_replica_start_from_old_version 
Fix replicated tables startup when updating from old version
 2020-04-08 02:11:12 +03:00
Vitaly Baranov
42b8ed3ec6 Implement "ON CLUSTER" clause for access control SQL. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
bc3e2cb48c Add the option "access_control_path" to server config. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
b71ff6160a Add the "access_management" option to users.xml which enables a user to manage access rights. 
The option is turned off by default.
 2020-04-07 23:31:54 +03:00
Vitaly Baranov
e5d8f05251 Rename sql command "CREATE POLICY" -> "CREATE ROW POLICY", "CREATE POLICY" is now an alias. 2020-04-07 23:20:38 +03:00
alesapin
82a87bc0d2 Fix replicated tables startup when updating from old version 2020-04-07 18:28:29 +03:00
Olga Khvostikova
834e458f26 Fix behaviour of globs in filepath with leading zeros 2020-04-07 16:46:12 +03:00
Nikita Mikhaylov
0c0eff36d1 move 2020-04-06 23:34:04 +03:00
alesapin
f0124ffc2b Fix runner script 2020-04-06 21:30:51 +03:00
Alexander Tokmakov
08bae4668d Merge branch 'master' into database_atomic 2020-04-06 16:18:07 +03:00
Vasily Nemkov
b441e8a408 Integration test for Distributed over Distributed (from #8640) 2020-04-04 13:47:34 +03:00
Alexander Tokmakov
9c67d2716e Merge branch 'master' into database_atomic 2020-04-03 03:19:11 +03:00
alesapin
918e145ea5 Fix integration test 2020-04-02 11:51:21 +03:00
Ivan Lezhankin
c0a595355a Move more dbms/tests to top-level 2020-04-02 03:32:39 +03:00
Ivan
97f2a2213e
Move all folders inside /dbms one level up (#9974) 
* Move some code outside dbms/src folder
* Fix paths
 2020-04-02 02:51:21 +03:00
Azat Khuzhin
5070b8a76a Update test_insert_distributed_async_send for recent block conversion changes 
After the implicit conversion had been added, String and
Nullable(String) successfully converted, let's use UInt64 over
Nullable(String).
 2021-02-02 21:38:29 +03:00