Commit Graph

848 Commits

Author SHA1 Message Date
Ilya Golshtein
2d5c31d588 test_storage_kerberized_kafka cleanup + negative test 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
alexey-milovidov
2886b38c03
Merge branch 'master' into fix_test_distributed_over_live_view2 2020-09-17 13:06:39 +03:00
Nikolai Kochetov
339521fadb
Update test.py 2020-09-17 11:48:27 +03:00
sundy-li
544b2cb20d add configChanged method for zookeeper
fix logic error && skip reload testkeeper
2020-09-17 13:33:45 +08:00
Vitaliy Zakaznikov
bf9feb6865 Removing usage of time.sleep in tests/integration/test_distributed_over_live_view/test.py 2020-09-16 22:07:58 -04:00
Anton Popov
8e9828d2ff Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
alexey-milovidov
84b210f93e
Merge pull request #14864 from bharatnc/ncb/format-integration-tests
Format and cleanup imports form all *.py integration test files
2020-09-16 20:40:57 +03:00
alesapin
e173658422 Fix integration test 2020-09-16 19:53:58 +03:00
alesapin
d9057eb2c1
Merge pull request #14855 from ClickHouse/fix_flaky_test_6
Flaky tests fixes
2020-09-16 09:47:51 +03:00
bharatnc
b75963d370 Format and optimize imports in integration test files
This PR formats all the `*.py` files found under the `tests/integration`
folder. It also reorders the imports and cleans up a bunch of unused
imports.

The formatting also takes care of other things like wrapping lines and
fixing spaces and indents such that the tests look more readable.
2020-09-15 23:10:54 -07:00
alexey-milovidov
7fb0291c09
Merge pull request #14854 from zhang2014/fix/ISSUES-14809
ISSUES-14809 fix MaterializeMySQL empty transaction unstable test case
2020-09-16 00:44:51 +03:00
alesapin
3b34345abb Less flaky tests 2020-09-15 18:42:46 +03:00
Vitaly Baranov
74d5b43fe6
Merge pull request #14828 from vitlibar/change-columns-of-system-user-directories
Add 'params' column to system.user_directories table.
2020-09-15 18:25:50 +03:00
alesapin
6130cd7365 More stable test_no_ttl_merges_in_busy_pool 2020-09-15 17:53:55 +03:00
zhang2014
1c659de8b1 ISSUES-14809 fix MaterializeMySQL empty transaction test failure 2020-09-15 22:44:18 +08:00
Anton Popov
3e855daefd Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-15 15:31:29 +03:00
Anton Popov
f725f8deee fix more tests 2020-09-15 02:14:14 +03:00
Vitaly Baranov
0f53b449fd Add 'params' column to system.user_directories table. 2020-09-15 01:51:53 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3]
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
2020-09-15 01:36:28 +03:00
Azat Khuzhin
2fce2b21a8 Use pytest.raises(match=) in test_allowed_client_hosts
Since pytest.raises() produces excinfo not exception, hence at least
str(excinfo.value) should be used to match the exception message.
2020-09-15 01:36:28 +03:00
alesapin
58f4e5f967
Merge pull request #14755 from vitlibar/fix-permission-denied-in-integration-tests
Fix access denied on opening file /var/lib/clickhouse/status in integration tests.
2020-09-14 22:08:21 +03:00
Anton Popov
ac9ba23bdf fix more tests 2020-09-14 15:49:04 +03:00
alesapin
0c04f4d008
Update cluster.py 2020-09-14 10:01:20 +03:00
Vitaly Baranov
421eeeccef Add the section user_directories to the default config. 2020-09-12 23:04:28 +03:00
alexey-milovidov
c2f762e20a
Merge pull request #14748 from vitlibar/skip-access-storages-with-same-path
Skip access storages with same path while reading the main config.
2020-09-12 14:20:02 +03:00
alesapin
2c6567eb88
Merge pull request #14745 from kssenii/fix-rabbit-tests-crash
Fix crashes in RabbitMQ tests
2020-09-12 09:53:14 +03:00
Vitaly Baranov
1e849f2975 Fix permission denied on opening file /var/lib/clickhouse/status in integration tests. 2020-09-12 03:18:18 +03:00
Azat Khuzhin
9c7f3a9a74 Add test_distributed_ddl_parallel 2020-09-12 02:33:17 +03:00
Vitaly Baranov
e2c2a679ef Skip access storages with same path while reading the main config. 2020-09-12 01:34:46 +03:00
alesapin
36019596c1 Disable flaky test 2020-09-11 20:08:23 +03:00
alesapin
2c4047b280 Revert accident changes 2020-09-11 20:07:00 +03:00
alesapin
c0dafb0283 Disable test 2020-09-11 20:04:55 +03:00
kssenii
31dbfd07e2 remove tests crash reason 2020-09-11 16:16:24 +00:00
Nikita Mikhaylov
468089a4cd
Merge pull request #14514 from bharatnc/ncb/event_time_microseconds_metric_logs
add event_time_microseconds field to asynchronous_metric_log & metric_log system tables
2020-09-11 16:14:00 +04:00
zhang2014
7ff7ee6aac ISSUES-4006 try fix integration test 2020-09-11 15:37:14 +08:00
Anton Popov
fa6d88b3b2 fix more tests 2020-09-10 21:43:02 +03:00
Anton Popov
6031e6bae9 fix tests 2020-09-10 20:09:19 +03:00
tavplubix
4581e3a18a
Merge pull request #14563 from bharatnc/ncb/zk-conn-fail-do-cleanup
ReplicatedMergeTree - cleanup data directory after Zookeeper exceptions
2020-09-10 19:19:57 +03:00
bharatnc
397ebdb855 remove sleep from unit test 2020-09-10 08:55:39 -07:00
Alexander Tokmakov
20b3823770 do not remove directory on attach 2020-09-10 13:21:13 +03:00
zhang2014
5b3e9eaaf0 Merge branch 'master' into fix/datetime 2020-09-10 17:26:26 +08:00
zhang2014
338b69201d ISSUES-4006 add test decimal when dump stage 2020-09-10 17:20:28 +08:00
bharatnc
31b0bd481c Integration tests - more accurate tests 2020-09-10 00:35:25 -07:00
bharatnc
05a80518a1 Merge remote-tracking branch 'upstream/master' into ncb/event_time_microseconds_metric_logs 2020-09-09 17:58:29 -07:00
bharatnc
2ad63d2b4d AsynchronousMetricLog - refactor integration test 2020-09-09 17:56:21 -07:00
bharatnc
0a3f7d0fcc AsynchronousMetricsLog - add improved tests
This adds integration tests to test the asynchronous_metric_log table
for event_time_microseconds field.

Asynchronous metrics are updated once every 60s, so this setting needs
to be overridden for having those metrics available in time so that the
tests can run. So the `asynchronous_metric_update_period_s` setting is
being overriden to be 2s.
2020-09-09 17:50:39 -07:00
Alexander Tokmakov
dee1fefeb4 add more tests 2020-09-09 20:39:49 +03:00
alesapin
cdb72add35
Merge pull request #14619 from ClickHouse/better_copy_dir
Better recursive database copy in integration tests
2020-09-09 19:38:55 +03:00
bharatnc
fe6d6f16ea Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-09 09:25:34 -07:00
bharatnc
d1d3af7501 StorageReplicatedMergeTree - more improvements to integration test 2020-09-09 09:24:18 -07:00
zhang2014
6ed3f7fb86 ISSUES-4006 try fix integration test failure when mysql 5.7 2020-09-09 23:42:03 +08:00
zhang2014
094897fe69 Merge branch 'master' into fix/datetime 2020-09-09 23:37:54 +08:00
alesapin
bd14c79b0b
Merge pull request #14494 from ClickHouse/recompression_in_background
Recompression TTL
2020-09-09 17:46:01 +03:00
Vasily Nemkov
3973a17530
MySql datatypes dateTime64 and decimal (#11512) 2020-09-09 15:18:02 +03:00
alesapin
98f19a5d50 Better permissions 2020-09-09 14:29:53 +03:00
alesapin
f5bef34be6 Fix configs for test_default_database_on_cluster 2020-09-09 14:28:59 +03:00
alesapin
150d8d4e79 Better recursive copy in integration tests 2020-09-09 14:11:59 +03:00
Winter Zhang
3d1d64ec60
Fix currentDatabase function cannot be used in ON CLUSTER ddl query. (#14211) 2020-09-09 12:58:59 +03:00
alesapin
485b104898 Use max ttl and add introspection to system parts about recompression 2020-09-09 12:15:42 +03:00
alesapin
a696cf12f6 Merge branch 'master' into recompression_in_background 2020-09-09 10:12:03 +03:00
alesapin
9548d69792
Merge pull request #14581 from ClickHouse/fix_flaky_test_3
Add retries to several integration tests
2020-09-09 10:04:37 +03:00
bharatnc
f37814b367 Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-08 23:45:20 -07:00
bharatnc
48bf65d63d StorageReplicatedMergeTree - improve integration test 2020-09-08 23:45:04 -07:00
Winter Zhang
62ef728b2f
ISSUES-4006 try fix test failure 2020-09-09 10:52:14 +08:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
Anton Popov
53572b3783 add gitkeep 2020-09-08 19:37:16 +03:00
alesapin
f0f7f2b5d2 Merge branch 'master' into recompression_in_background 2020-09-08 15:43:37 +03:00
alesapin
6ad91d1018
Merge pull request #14490 from ClickHouse/control_ttl_merges_in_pool
Control ttl merges in pool
2020-09-08 15:42:20 +03:00
Ilya Yatsishin
37236e5923
Merge pull request #14553 from ClickHouse/fix-flacky-test-11
Handle host/network is unreachable in integration tests
2020-09-08 14:45:00 +03:00
alesapin
6e591d5dea Better retries 2020-09-08 14:20:35 +03:00
alesapin
cdfca04b42 Missed break 2020-09-08 14:07:41 +03:00
alesapin
43c17ff79e Add retries to test 2020-09-08 14:02:44 +03:00
alesapin
4364bff3bc
Merge pull request #12761 from kssenii/rabbitmq-improvements
RabbitMQ improvements
2020-09-08 09:38:25 +03:00
bharatnc
806334a642 StorageReplicatedMergeTree - add integration tests that test dir cleanup
This adds a integration test that tests if table directory is cleaned
up after a ZooKeeper connection failure for ReplicatedMergeTree tables.
2020-09-07 22:32:01 -07:00
Winter Zhang
18b4c5997d
Merge branch 'master' into fix/datetime 2020-09-08 11:32:48 +08:00
zhang2014
a150b1345b ISSUES-4006 add integration test 2020-09-08 11:29:18 +08:00
zhang2014
05bd0b7c28 ISSUES-4006 add integration test 2020-09-08 02:36:28 +08:00
alexey-milovidov
e1104135c8
Merge pull request #13939 from fastio/master
Multithreading implementation of Kafka engine
2020-09-07 20:12:06 +03:00
Alexey Milovidov
829049de2f Handle host/network is unreachable in integration tests 2020-09-07 19:43:35 +03:00
kssenii
40c8290dde Tiny fixes, better tests 2020-09-07 14:48:50 +00:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
alesapin
17650e803f Tiny improvements 2020-09-07 14:08:53 +03:00
alesapin
4ce975c512 Merge branch 'master' into kssenii-rabbitmq-improvements 2020-09-07 11:36:08 +03:00
alesapin
9703494f32 Less debug prints 2020-09-07 11:25:14 +03:00
alesapin
7f301eab63 Merge branch 'master' into recompression_in_background 2020-09-07 09:31:16 +03:00
Peng Jian
77420c82ea Add test case for Kafka engine with kafka_thread_per_consumer enabled. 2020-09-06 11:17:19 +08:00
alexey-milovidov
c4861155f7
Merge pull request #14498 from ClickHouse/add_retries_to_host_ip_change
Add retries to integration test_host_ip_change
2020-09-05 07:03:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
alesapin
3095c167ea Add retries 2020-09-04 18:22:43 +03:00
alesapin
de911aaabe Merge branch 'master' into recompression_in_background 2020-09-04 17:21:27 +03:00
alesapin
21de2f54f6 Fix tests 2020-09-04 17:13:57 +03:00
Nikolai Kochetov
40768593c3
Merge pull request #14469 from BohuTANG/mysql_set_@@var
Support MySQL handler 'set @@xx' settting
2020-09-04 14:18:57 +03:00
alesapin
4079636f81 Merge 2020-09-04 13:52:51 +03:00
alesapin
82c56349a5 Some comments 2020-09-04 13:08:09 +03:00
BohuTANG
c094ff7eca ISSUES-9336 support MySQL handler 'set @@xx' settting 2020-09-04 12:51:15 +08:00
Ilya Yatsishin
5ada30df96
Merge branch 'master' into integration-explicit-configs 2020-09-03 20:43:01 +03:00
Kseniia Sumarokova
4b7c303eaf
Merge branch 'master' into rabbitmq-improvements 2020-09-03 17:26:04 +03:00
alesapin
e48e4309b2 Better names 2020-09-03 16:29:18 +03:00
alesapin
5ccf78ccff Simplier test 2020-09-03 16:08:45 +03:00