Commit Graph

225 Commits

Author SHA1 Message Date
alexey-milovidov
7ee35f102d
Merge pull request #10867 from azat/dist-INSERT-load-balancing
Respect prefer_localhost_replica/load_balancing on INSERT into Distributed
2020-05-17 11:11:35 +03:00
alexey-milovidov
5297d1e86a
Merge pull request #10928 from vitlibar/check-access-once-for-dictget
dictGet() checks access once
2020-05-17 09:27:59 +03:00
alexey-milovidov
a3346e9331
Merge pull request #10912 from ClickHouse/static-mutate
Static mutate
2020-05-17 09:05:35 +03:00
alexey-milovidov
0fd0711b51
Merge pull request #10910 from filimonov/kafka_drop_hang_fix
Fix for the hang during deletion of engine=Kafka
2020-05-17 07:13:54 +03:00
alesapin
d0b56a4c7d
Merge pull request #10887 from ClickHouse/vzakaznikov-add_alter_rename_column_to_distributed
Vzakaznikov add alter rename column to distributed
2020-05-16 12:54:32 +03:00
Nikolai Kochetov
c957154fef
Merge pull request #10952 from ClickHouse/fix-distributed-queries-incompatibility-19.16-20.1
Fix incompatibility of two-level aggregation between 19.16 and 20.1
2020-05-16 10:17:15 +03:00
tavplubix
cc4ddfd89e
Merge pull request #10901 from ClickHouse/merging_10554
Merging #10554
2020-05-15 23:23:02 +03:00
Mikhail Filimonov
791f3a6c90 Merge branch 'kafka_drop_hang_fix' of github.com:filimonov/ClickHouse into kafka_drop_hang_fix 2020-05-15 22:20:45 +02:00
Mikhail Filimonov
405cce2c53 Another variant of fix. It looks like we do not need destructor at all 2020-05-15 22:19:21 +02:00
Nikolai Kochetov
fb38c2a30b
Remove experimental_use_processors setting, part 1. (#10924)
Remove experimental_use_processors setting, part 1.
2020-05-15 22:28:10 +03:00
Nikolai Kochetov
7d6ac4a87b Added test. 2020-05-15 22:21:30 +03:00
Nikolai Kochetov
c4a07812f7 Try fix build. 2020-05-15 18:48:19 +03:00
alesapin
6fb9a19a40 Ignore some tests 2020-05-15 17:33:50 +03:00
Anton Popov
11b4bc7189
Merge pull request #10889 from CurtizJ/tuple-literal
Fix backward compatibility with tuples and distributed.
2020-05-15 15:39:03 +03:00
Vitaly Baranov
d92ac9ea47
Merge branch 'master' into RBAC-10 2020-05-15 14:12:43 +03:00
Артем Стрельцов
be731ad62e Merge branch 'master' of github.com:yandex/ClickHouse into complex_key_direct 2020-05-15 12:01:09 +03:00
Vitaly Baranov
201c88f64f Get dictionary and check access rights only once per each call of any function reading external dictionaries. 2020-05-15 03:14:14 +03:00
Alexander Tokmakov
6a496ce9dc better test 2020-05-15 00:51:21 +03:00
Anton Popov
4c0cbc78a9 trigger CI 2020-05-14 23:44:52 +03:00
Alexander Kuzmenkov
99d50063f3 Support MongoDB URI 2020-05-14 14:36:49 +03:00
Vitaly Baranov
c30587196a Add system tables for users, roles and grants. 2020-05-14 14:12:20 +03:00
Vitaly Baranov
a14f322723 Add system tables for settings profiles. 2020-05-14 14:12:15 +03:00
filimonov
f97c14f7be
bit better comment 2020-05-14 12:18:17 +02:00
Mikhail Filimonov
6499d702f9 After review fixes 2020-05-14 12:15:38 +02:00
Mikhail Filimonov
a1013f1e71 Fix for the hang during deletion of engine=Kafka 2020-05-14 10:38:02 +02:00
Azat Khuzhin
dac0b7d1f5 Create table with the same load_balancing policy in test_insert_distributed_load_balancing 2020-05-14 03:29:03 +03:00
alexey-milovidov
f8195a577c
Merge pull request #10744 from Jokser/s3-proxy-resolver
S3 with proxy resolver
2020-05-14 02:19:10 +03:00
Azat Khuzhin
de1d529e86 Cover nearest_hostname in test_insert_distributed_load_balancing 2020-05-14 01:50:56 +03:00
Alexander Tokmakov
b1ed51df6e add simple test 2020-05-13 22:47:35 +03:00
Vitaly Baranov
5b84121d81 Improve system tables for quotas. Remove function currentQuota(). 2020-05-13 19:40:48 +03:00
Vitaly Baranov
e64e2ebdf6 Improve system table for row policies. Remove function currentRowPolicies(). 2020-05-13 19:40:48 +03:00
Vitaly Baranov
9a89a04c1f Improve TSV class in test tools: now it can get a table as a list of lists. 2020-05-13 19:40:48 +03:00
Vitaly Baranov
dd8b29b4fb Use enum Type instead of std::type_index to represent the type of IAccessEntity.
This change simplifies handling of access entities in access storages.
2020-05-13 19:40:48 +03:00
alesapin
774f9fccc5
Update test.py 2020-05-13 18:25:55 +03:00
Anton Popov
d13a11b421 fix backward compatibility with tuples and distributed 2020-05-13 17:14:05 +03:00
alesapin
1c4564d9ed Simplify rename tests 2020-05-13 15:56:32 +03:00
alesapin
352c402cf2 Merge branch 'add_alter_rename_column_to_distributed' of https://github.com/vzakaznikov/ClickHouse into vzakaznikov-add_alter_rename_column_to_distributed 2020-05-13 14:14:23 +03:00
Azat Khuzhin
0ea3411137 Add integration test for load balancing for Distributed INSERT 2020-05-13 02:51:17 +03:00
alesapin
35a9a203f1
Update test.py 2020-05-12 18:01:43 +03:00
Артем Стрельцов
10f6817fdd added new layout to integration test 2020-05-12 18:00:08 +03:00
Vitaliy Zakaznikov
3505ccc2fc Increasing zookeeper_session_timeout setting to 15 sec. 2020-05-11 20:27:19 +02:00
Vitaliy Zakaznikov
1efc372c0c Fixing test_rename_with_parallel_select. 2020-05-11 20:09:45 +02:00
alexey-milovidov
ddc84163a7
Merge pull request #10486 from azat/dist-send-on-INSERT
Fix distributed send that are scheduled by INSERT query
2020-05-11 06:28:35 +03:00
Vitaliy Zakaznikov
089371ddfb Reverting test so that it can pass. 2020-05-08 14:48:24 +02:00
Vitaliy Zakaznikov
dd5dd5de32 Updating test_rename_with_parallel_ttl_move to check if parts got moves.
Adding renaming of the time column used inside the TTL expression after insert.
2020-05-08 13:35:50 +02:00
Pavel Kovalenko
5cc0927874 Add comment explaining protocol for proxy resolver configuration. 2020-05-08 14:07:26 +03:00
Pavel Kovalenko
8602f7b47c Minor updates in proxy resolver parameters naming. 2020-05-08 13:58:56 +03:00
Pavel Kovalenko
6165c2aa99 Add possibility to use proxy resolver in DiskS3. 2020-05-08 13:53:12 +03:00
Vitaliy Zakaznikov
eb3c6ca0d8 Adding configuration files. 2020-05-08 12:36:37 +02:00
Vitaliy Zakaznikov
65f139f374 Adding more integration tests for alter rename column. 2020-05-07 21:00:17 +02:00
Vitaliy Zakaznikov
abe28968f4 Adding tests. 2020-05-07 15:50:42 +02:00
alexey-milovidov
eeac7aa313
Merge pull request #10622 from kekekekule/layout_direct
Add direct layout for dictionaries
2020-05-07 01:05:29 +03:00
Артем Стрельцов
b2993c314c fixes relevant to review 2020-05-07 00:59:31 +03:00
alexey-milovidov
4df7dd8c2b
Merge pull request #10656 from azat/kafka-consumer-hang
Kafka cleanup
2020-05-07 00:20:31 +03:00
Артем Стрельцов
1428188e21 fixed test for direct layout & fixed data load for FileDictionarySource 2020-05-06 03:52:13 +03:00
Azat Khuzhin
7ab0c3493c Add integration test for kafka consumer hang
This test triggers heartbeat failrues which leads to
REBALANCE_IN_PROGRESS which causes hang.
2020-05-04 18:46:30 +03:00
Alexey Milovidov
7ddad8cc01 Fix integration test 2020-05-04 17:51:29 +03:00
Azat Khuzhin
fc5f0bfe52 Enable librdkafka debugging in test_storage_kafka 2020-05-04 17:23:09 +03:00
Azat Khuzhin
12871bf26e Drop resolved TODO from test_storage_kafka 2020-05-04 17:23:09 +03:00
Nikolay Degterinsky
a3e557a5d2 documentation is added & added 'direct' layout into integragion test 2020-05-03 15:55:22 +03:00
Azat Khuzhin
14fccf572f Fix false-positive failures of the test_distributed_storage_configuration
After first INSERT for disk2 there should not be created any per-shard
directory, so find(1) should report an error, like:

  find: '/disk2/data/test/dist_foo/default@127%2E0%2E0%2E2:9000': No such file or directory"

But sometimes output can be fixed, and output of wc(1) will goes first
and python's int() will parse it and not fail, but if find(1) stderr
will goes first the int() will fail to parse.

And here is an example of such mixing:

  $ docker run --name alpine --rm -it alpine top
  $ docker exec alpine sh -c 'echo foo >&2 | wc -c'
  foo
  0
  $ docker exec alpine sh -c 'echo foo >&2 | wc -c'
  0
  foo
2020-05-03 14:48:00 +03:00
Azat Khuzhin
0a75dc626b Add some comments int test_distributed_storage_configuration 2020-05-03 14:46:44 +03:00
alexey-milovidov
a235533d5f
Merge pull request #10576 from Jokser/s3-with-dynamic-proxies
S3 with dynamic proxy configuration
2020-05-03 01:25:13 +03:00
alexey-milovidov
d38ea6fc1c
Merge pull request #10608 from ClickHouse/fix_drop_dns_cache
Improve DROP DNS CACHE
2020-05-02 22:10:58 +03:00
Alexander Tokmakov
9ca144cab9 drop access cache on DROP DNS CACHE 2020-05-01 01:29:47 +03:00
alesapin
15e8f37839
Merge pull request #10531 from CurtizJ/polymorphic-parts-2
Fix index corruption in merges with compact parts.
2020-04-30 12:15:25 +03:00
Pavel Kovalenko
e5e84960ea S3 with proxy integration test and fixes. 2020-04-29 11:40:29 +03:00
tavplubix
11c3493676
Merge pull request #10547 from ClickHouse/zhang2014/feature/ISSUES-5436
Merging #7572
2020-04-28 12:40:48 +03:00
Alexander Tokmakov
5a1d22a363 remove redundant configs from test 2020-04-28 02:05:15 +03:00
Alexander Tokmakov
e72a484beb minor fixes 2020-04-28 02:05:15 +03:00
Anton Popov
eaf80c5f18 add integration test for compact parts 2020-04-27 16:37:05 +03:00
zhang2014
81230944a4 ISSUES-5436 add integration test 2020-04-27 18:49:32 +08:00
Alexander Tokmakov
04d6b59ac0 Merge branch 'master' into database_atomic 2020-04-23 17:31:37 +03:00
zhang2014
0070f75218 ISSUES-5436 fix integration test failure & add test 2020-04-23 17:11:20 +08:00
alexey-milovidov
829a7a551c
Merge pull request #10446 from CurtizJ/fix-mysql-test
Fix mysql integration test
2020-04-23 00:25:25 +03:00
Nikita Mikhaylov
3cf2016867
Merge pull request #10188 from nikitamikhaylov/quorum_bug
insert_quorum vs drop partition or ttl
2020-04-23 00:11:57 +04:00
Anton Popov
47213ebfe1 fix mysql test 2020-04-22 23:09:07 +03:00
Nikita Mikhaylov
f1ee08778f
Merge pull request #10414 from nikitamikhaylov/copier-sample-offset
cluster copier with sample offset
2020-04-22 20:31:17 +04:00
Alexander Tokmakov
fefbbd37df Merge branch 'master' into database_atomic 2020-04-22 17:02:30 +03:00
Nikita Mikhaylov
1d5d6582a0 fix test 2020-04-22 14:35:18 +03:00
alexey-milovidov
7065a8ba9c
Merge pull request #10422 from azat/fallback_to_stale_replicas-over-skip_unavailable_shards
Prefer fallback_to_stale_replicas over skip_unavailable_shards
2020-04-22 09:20:25 +03:00
Azat Khuzhin
e0f58b1ca1 Cover fallback_to_stale_replicas in conjunction with skip_unavailable_shards 2020-04-22 01:47:22 +03:00
Nikita Mikhaylov
15de7e4fa7 first try 2020-04-21 20:37:40 +03:00
alesapin
dec2e65aa5 Add test for alter on cluster 2020-04-21 16:47:00 +03:00
Ilya Yatsishin
82b0f31e37
Merge pull request #10335 from qoega/move_docker_to_docker
Move integration tests docker files to docker/ directory.
2020-04-21 15:10:42 +03:00
Nikita Mikhaylov
2173bcf28e Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-21 14:35:06 +03:00
alexey-milovidov
4ecc86beca
Merge pull request #9950 from ClickHouse/aku/literal-columns
Create unique columns for literals
2020-04-21 02:30:17 +03:00
tavplubix
1a067484c8
Merge pull request #10137 from kekekekule/direct_queries
Add custom settings support for certain dictionary sources
2020-04-21 01:21:32 +03:00
alexey-milovidov
ab922d44d5
Merge pull request #10379 from ClickHouse/only_fetch_repliac
Add setting always_fetch_merged_part
2020-04-21 00:07:00 +03:00
alexey-milovidov
69b6f135e7
Merge pull request #10382 from excitoon-favorites/altercodec
Allowed to alter column in non-modifying data mode when the same type is specified
2020-04-20 22:54:53 +03:00
Alexander Kuzmenkov
da7eeb31d0
Update test.py 2020-04-20 22:37:50 +03:00
alesapin
e1fa39d801 fix test 2020-04-20 18:17:34 +03:00
Alexander Kuzmenkov
672c952d39
Update test.py 2020-04-20 17:44:21 +03:00
Vladimir Chebotarev
82985ff594 Allowed to alter column in non-modifying data mode when the same type is specified. 2020-04-20 14:15:06 +03:00
Alexander Tokmakov
b29bddac12 Merge branch 'master' into database_atomic 2020-04-20 14:09:09 +03:00
alesapin
1bc84ec8b4 Fix comments 2020-04-20 13:56:23 +03:00
alesapin
8767ea7efa Add setting which restrict replica to merge parts by itself and always prefer dowloading from other replicas. 2020-04-20 13:53:29 +03:00
alexey-milovidov
e2d85501fe
Merge pull request #10366 from ClickHouse/fix-test-insert-batching
Fix flacky integration test
2020-04-20 10:53:38 +03:00
Alexey Milovidov
e06dc573b4 Fix flacky integration test 2020-04-20 06:15:29 +03:00
Alexey Milovidov
99667a38c3 Added a test from Svyatoslav Tkhon Il Pak @DeifyTheGod #9642 2020-04-19 22:56:34 +03:00