ClickHouse/tests/integration
2021-06-27 22:52:24 +03:00
..
helpers Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
test_access_control_on_cluster Add retries to test_access_control_on_cluster 2021-02-09 18:37:33 +03:00
test_adaptive_granularity Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_adaptive_granularity_different_settings Remove obtrusive tests 2020-12-22 18:42:18 +08:00
test_adaptive_granularity_replicated Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_aggregation_memory_efficient Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_allowed_client_hosts Merge pull request #13156 from azat/cluster-secure 2020-09-17 17:11:00 +03:00
test_allowed_url_from_config Added test for S3 table function. 2021-02-08 09:22:00 +03:00
test_alter_codec Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_alter_on_mixed_type_cluster Remove cluster type check during alter 2020-10-16 14:59:58 +03:00
test_alter_settings_on_cluster Fix test 2021-01-07 11:31:23 +08:00
test_always_fetch_merged Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_asynchronous_metric_log_table Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_atomic_drop_table enable more tests 2020-09-22 17:29:09 +03:00
test_attach_without_checksums Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_attach_without_fetching Try fix flaky test 2021-04-03 13:25:40 +03:00
test_authentication Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_backup_restore enable more tests 2020-09-22 17:29:09 +03:00
test_backup_with_other_granularity enable more tests 2020-09-22 17:29:09 +03:00
test_backward_compatibility Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
test_block_structure_mismatch Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_broken_part_during_merge Finished the test draft for ATTACH PARTITION, 2021-03-01 16:42:31 +03:00
test_buffer_profile Cover buffer_profile config directive 2021-02-10 22:44:26 +03:00
test_catboost_model_config_reload Skip CatBoost tests under MSan 2021-04-25 05:25:46 +03:00
test_catboost_model_first_evaluate Skip CatBoost tests under MSan 2021-04-25 05:25:46 +03:00
test_catboost_model_reload Skip CatBoost tests under MSan 2021-04-25 05:25:46 +03:00
test_check_table Fix test and add logical error 2021-01-27 21:54:05 +03:00
test_cleanup_dir_after_bad_zk_conn Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_cluster_all_replicas Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_cluster_copier add test 2021-04-01 17:14:54 +03:00
test_compression_codec_read Fix compression codec read for empty files 2021-01-15 12:04:23 +03:00
test_compression_nested_columns More tests 2020-09-22 16:16:42 +03:00
test_concurrent_queries_for_all_users_restriction Add max_concurrent_queries_for_all_users setting 2020-10-19 15:51:28 +01:00
test_concurrent_queries_for_user_restriction Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_concurrent_ttl_merges fix 2021-01-26 19:33:37 +03:00
test_config_corresponding_root Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_config_substitutions Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_config_xml_full Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
test_config_xml_main Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
test_config_xml_yaml_mix Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
test_config_yaml_full Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
test_config_yaml_main Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
test_consistant_parts_after_move_partition Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_consistent_parts_after_clone_replica Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_create_user_and_login Split test 'test_create_user_and_login' into two. 2020-07-10 17:16:47 +03:00
test_cross_replication Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_custom_settings Use previous users.xml if failed to reload. 2020-09-19 16:21:12 +03:00
test_ddl_alter_query Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_ddl_worker_non_leader Remove accident changes 2020-11-16 15:49:08 +03:00
test_default_compression_codec Add test for already working code 2020-12-23 14:53:49 +03:00
test_default_database_on_cluster Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_default_role Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_delayed_replica_failover Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_dictionaries_access Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionaries_all_layouts_separate_sources add stable sort for tests 2021-02-09 18:48:33 +03:00
test_dictionaries_complex_key_cache_string SSDCacheDictionary remove max_stored_keys option 2021-03-18 12:55:17 +03:00
test_dictionaries_ddl Fixed integration tests 2021-04-26 13:52:41 +03:00
test_dictionaries_dependency Fixed integration test 2021-04-26 23:35:56 +03:00
test_dictionaries_dependency_xml test_dictionaries_dependency_xml: decrease dictionaries lifetime 2021-02-02 22:04:32 +03:00
test_dictionaries_mysql Fix race condition in MySQL pool 2020-10-08 18:50:09 +03:00
test_dictionaries_null_value Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionaries_postgresql Table schema for dict 2021-05-09 15:42:54 +00:00
test_dictionaries_redis add support of cache layout for redis dictionaries with complex key 2020-10-14 22:57:07 +03:00
test_dictionaries_select_all Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_dictionaries_update_and_reload Fix flaky test 2021-03-26 18:14:42 +03:00
test_dictionaries_update_field Integration test increase wait before dictionary update 2021-05-05 23:39:40 +03:00
test_dictionary_allow_read_expired_keys rename back config 2020-11-18 16:38:14 +03:00
test_dictionary_custom_settings Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_dictionary_ddl_on_cluster Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_disabled_mysql_server Trigger CI 2020-10-28 22:44:37 +03:00
test_disk_access_storage Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_disk_types Fix typos reported by codespell 2020-10-27 12:04:03 +01:00
test_distributed_backward_compatability Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_distributed_ddl Fix integration test 2021-05-10 17:45:37 +03:00
test_distributed_ddl_on_cross_replication Fix integration test 2021-05-11 01:54:52 +03:00
test_distributed_ddl_parallel Improve test_distributed_ddl_parallel to cover more cases 2021-02-28 05:45:40 +03:00
test_distributed_ddl_password Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_distributed_format Set use_compact_format_in_distributed_parts_names=0 for some integration tests 2020-11-06 21:02:44 +03:00
test_distributed_inter_server_secret Fix more tests 2021-03-26 18:30:35 +03:00
test_distributed_load_balancing Minor fixes 2021-02-17 20:44:11 +03:00
test_distributed_over_distributed Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_distributed_queries_stress Add stress test for distributed queries 2021-03-26 01:04:48 +03:00
test_distributed_respect_user_timeouts Refactor 4.0 2021-02-21 17:03:24 +03:00
test_distributed_storage_configuration Set use_compact_format_in_distributed_parts_names=0 for some integration tests 2020-11-06 21:02:44 +03:00
test_distributed_system_query Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_drop_replica fix 2021-03-18 19:59:51 +03:00
test_enabling_access_management Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_extreme_deduplication Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_fetch_partition_from_auxiliary_zookeeper fix some docs 2021-04-14 21:15:53 +08:00
test_fetch_partition_should_reset_mutation Fix flaky test 2021-01-13 10:19:43 +03:00
test_fetch_partition_with_outdated_parts add integration test 2020-11-01 16:02:09 +08:00
test_filesystem_layout enable more tests 2020-09-22 17:29:09 +03:00
test_force_deduplication Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_force_drop_table make force_drop_table work with materialized view 2021-02-17 17:23:07 +03:00
test_format_avro_confluent Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_format_schema_on_server Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_freeze_table Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_globs_in_filepath Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_grant_and_revoke Add a new clause GRANTEES to commands CREATE USER and ALTER USER. 2021-03-14 19:12:42 +03:00
test_graphite_merge_tree Add check for growing age AND precision in rollup config 2021-03-06 18:35:53 +01:00
test_grpc_protocol print stderr of failed subprocess 2021-01-22 17:27:23 +03:00
test_grpc_protocol_ssl print stderr of failed subprocess 2021-01-22 17:27:23 +03:00
test_hedged_requests Fix test_secure_socket and remove redundant settings in hedged tests 2021-04-19 11:46:42 +03:00
test_hedged_requests_parallel Fix test_secure_socket and remove redundant settings in hedged tests 2021-04-19 11:46:42 +03:00
test_host_ip_change Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_http_and_readonly Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_http_handlers_config Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_https_replication Add missed file 2020-10-09 14:20:54 +03:00
test_inherit_multiple_profiles Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_input_format_parallel_parsing_memory_tracking Increase asynchronous_metrics_update_period_s to avoid syncing MemoryTracking with RSS 2020-10-30 22:02:02 +03:00
test_insert_distributed_async_extra_dirs Add a test for malformed directores for Distributed async INSERT 2021-02-15 21:00:50 +03:00
test_insert_distributed_async_send Update test_insert_distributed_async_send for recent block conversion changes 2021-02-02 21:38:29 +03:00
test_insert_distributed_load_balancing Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_insert_into_distributed Fix test_insert_into_distributed flaps 2021-05-05 21:18:43 +03:00
test_insert_into_distributed_sync_async Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_insert_into_distributed_through_materialized_view Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_jbod_balancer Speedup test 2021-05-18 14:46:45 +03:00
test_join_set_family_s3 Use IDisk in Set and Join storages 2020-12-16 14:58:44 +03:00
test_keeper_back_to_back Remove unused file 2021-03-29 12:16:58 +03:00
test_keeper_internal_secure Simplier config 2021-04-12 15:40:01 +03:00
test_keeper_multinode_blocade_leader Remove unused file 2021-03-29 12:16:58 +03:00
test_keeper_multinode_simple Remove unused file 2021-03-29 12:16:58 +03:00
test_keeper_persistent_log Remove unused file 2021-03-29 12:16:58 +03:00
test_keeper_persistent_log_multinode Remove unused file 2021-03-29 12:16:58 +03:00
test_keeper_restore_from_snapshot Remove unused file 2021-03-29 12:16:58 +03:00
test_keeper_secure_client Add SSL to keeper (both client and internal) 2021-04-12 15:25:52 +03:00
test_keeper_snapshots Remove unused file 2021-03-29 12:16:58 +03:00
test_keeper_snapshots_multinode Remove unused file 2021-03-29 12:16:58 +03:00
test_library_bridge Skip integration test for library bridge under MSan 2021-04-27 07:02:59 +03:00
test_limited_replicated_fetches Fix lost comment 2021-04-12 11:07:28 +03:00
test_log_family_s3 Use s3 disk explicitly for log tables in test_log_family_s3. 2020-12-12 16:44:19 +03:00
test_logs_level Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_match_process_uid_against_data_owner Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_materialize_mysql_database Try fix MySQL 8.0 address already in use 2021-04-22 11:04:30 +08:00
test_max_http_connections_for_replication Fix one more test 2021-03-26 18:37:26 +03:00
test_MemoryTracking Disable syncing MemoryTracking with RSS for test_MemoryTracking 2020-10-24 02:33:16 +03:00
test_merge_table_over_distributed Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_merge_tree_empty_parts fix removing of empty parts in tables with old syntax 2020-12-29 20:16:57 +03:00
test_merge_tree_s3 Apply disk settings on config reload. 2021-04-29 23:32:19 +03:00
test_merge_tree_s3_failover Better tests fix. 2021-05-13 08:46:16 +03:00
test_merge_tree_s3_restore Speedup test_merge_tree_s3_restore using 'SYSTEM RESTART DISK s3' 2021-04-21 14:31:09 +03:00
test_merge_tree_s3_with_cache fix more tests 2020-09-14 15:49:04 +03:00
test_multiple_disks Revert changes in test_multiple_disks 2021-01-30 11:26:31 +01:00
test_mutations_hardlinks Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_mutations_in_partitions_of_merge_tree ALTER UPDATE/DELETE ... IN PARTITION with partition pruning in ReplicatedMergeTree (#13403) 2020-11-10 13:23:46 +03:00
test_mutations_with_merge_tree Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_mysql_database_engine Remove unknown columns from joined table in where for queries to external database engines 2021-03-11 20:53:29 +03:00
test_mysql_protocol Fix test 2021-04-01 23:12:08 +00:00
test_no_local_metadata_node Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_non_default_compression Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_odbc_interaction Disable test_odbc_interaction for MSan build 2021-04-28 11:39:55 +03:00
test_old_versions Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_on_cluster_timeouts Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_optimize_on_insert Add missing tests 2021-03-15 12:01:26 +03:00
test_part_log_table Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_part_moves_between_shards Fix lazy test 2021-05-18 11:03:38 +03:00
test_part_uuid Use JSON metadata in WAL 2020-11-20 13:49:17 +00:00
test_partition Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_parts_delete_zookeeper Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_passing_max_partitions_to_read_remotely Correctly override default settings remotely 2021-01-08 12:28:09 +08:00
test_polymorphic_parts Better tests 2021-05-15 15:33:01 +03:00
test_postgresql_database_engine Fix incorrect getCreateTableQueryImpl with multidim arrays 2021-01-10 09:00:35 +00:00
test_postgresql_protocol print stderr of failed subprocess 2021-01-22 17:27:23 +03:00
test_profile_events_s3 Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_prometheus_endpoint Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_query_deduplication Part movement between shards 2021-04-27 14:20:12 +01:00
test_quorum_inserts Update integration test 2020-12-17 22:42:15 +03:00
test_quorum_inserts_parallel Fix flaky tests 2020-10-09 10:19:17 +03:00
test_quota Fix flaky tests. 2021-03-30 19:19:35 +03:00
test_random_inserts Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_range_hashed_dictionary_types Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_read_temporary_tables_on_failure test_read_temporary_tables_on_failure: increase timeout to avoid false-positive 2021-02-02 22:04:45 +03:00
test_recompression_ttl Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_recovery_replica update metadata on replica recovery 2021-04-28 20:49:27 +03:00
test_redirect_url_storage Fix checks 2021-04-21 19:53:38 +00:00
test_relative_filepath Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_reload_auxiliary_zookeepers Update test.py 2021-02-19 22:32:50 +03:00
test_reload_clusters_config add init file 2021-03-14 02:34:32 +03:00
test_reload_max_table_size_to_drop Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_reload_zookeeper Fix redundant zookeeper reconnect and possibility of multiple zookeeper session for a single ClickHouse server 2021-02-26 22:05:25 +03:00
test_reloading_settings_from_users_xml Use previous users.xml if failed to reload. 2020-09-19 16:21:12 +03:00
test_reloading_storage_configuration Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_remote_prewhere Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_rename_column Even more lightweight test 2021-05-19 13:47:24 +03:00
test_replace_partition Tiny "machine" cleanup of test_replace_partition 2021-03-12 21:10:16 +03:00
test_replica_can_become_leader Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_replicated_database fix 2021-03-17 17:29:24 +03:00
test_replicated_fetches_timeouts Improve replicated fetches timeouts test and make it 3x faster 2021-02-08 21:19:32 +00:00
test_replicated_merge_tree_config Update test.py 2020-09-17 11:48:27 +03:00
test_replicated_merge_tree_s3 S3 zero copy replication: fix tests 2020-10-23 15:00:01 +03:00
test_replicated_merge_tree_s3_zero_copy S3 zero copy replication: fix tests 2020-10-23 15:00:01 +03:00
test_replicated_merge_tree_with_auxiliary_zookeepers add test case 2021-02-25 14:19:58 +08:00
test_replicated_mutations Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_replicated_parse_zk_metadata Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_replicating_constants Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_replication_credentials Small improvements 2021-04-07 16:52:11 +03:00
test_replication_without_zookeeper Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_role Enable rbac tests with thread sanitizer. 2020-10-13 01:03:51 +03:00
test_row_policy Fix flaky tests. 2021-03-30 19:19:35 +03:00
test_s3_cluster better renaming 2021-04-13 22:39:43 +03:00
test_s3_with_https Use S3 multi object delete 2020-09-28 11:47:04 +03:00
test_s3_with_proxy Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into multi_delete_in_s3 2020-09-28 12:00:34 +03:00
test_s3_zero_copy_replication Fix flapping tests test_s3_zero_copy_replication, test_s3_zero_copy_on_hybrid_storage 2021-04-16 13:23:38 +03:00
test_secure_socket Fix test_secure_socket and remove redundant settings in hedged tests 2021-04-19 11:46:42 +03:00
test_select_access_rights Remove projection type ast 2021-05-11 18:12:29 +08:00
test_send_crash_reports Skip CatBoost tests under MSan 2021-04-25 05:25:46 +03:00
test_send_request_to_leader_replica Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_server_initialization Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_settings_constraints Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_settings_constraints_distributed Fix test 2020-11-27 14:26:42 +03:00
test_settings_profile Fix integration test 2021-02-14 04:34:42 +03:00
test_storage_hdfs Merge branch 'master' into fix-hdfs-virtual-columns 2021-04-20 22:01:32 +03:00
test_storage_kafka Try to stabilize flapping test 2021-05-13 16:03:32 +02:00
test_storage_kerberized_hdfs HDFS test had a clash with 9000 ClickHouse port. 2021-02-02 12:08:47 +03:00
test_storage_kerberized_kafka add sleep 2021-01-29 19:16:10 +03:00
test_storage_mongodb Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_storage_mysql modify settings name to external_xxx and rewrite Storage MySQL max_block_size 2021-04-19 10:51:50 +08:00
test_storage_postgresql New impl 2021-05-06 00:52:59 +00:00
test_storage_rabbitmq Some change 2021-06-27 22:52:24 +03:00
test_storage_s3 Fix tests II. 2021-05-13 08:46:16 +03:00
test_system_clusters_actual_information Delete unused users.xml 2021-03-26 18:16:15 +03:00
test_system_ddl_worker_queue few more changes and simplification to integration test 2021-01-07 11:10:41 -08:00
test_system_flush_logs add missing __init__.py 2020-10-28 13:22:10 +03:00
test_system_merges Fix test_system_merges by using mutations_sync=1 2021-02-11 22:46:56 +03:00
test_system_metrics Update test 2020-10-15 22:01:18 +03:00
test_system_queries save 2020-11-17 16:59:12 +03:00
test_system_replicated_fetches Try to make test_dir.tar smaller 2021-01-29 17:57:52 +01:00
test_table_functions_access_rights Fix access rights required for the merge() table function. 2020-12-17 12:29:07 +03:00
test_text_log_level Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_timezone_config Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_tmp_policy Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_ttl_move Fix flaky test_ttl_move 2020-12-04 21:27:50 +03:00
test_ttl_replicated Better tests 2021-05-15 15:33:01 +03:00
test_union_header Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_user_directories Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_user_ip_restrictions Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_user_zero_database_access Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
test_version_update_after_mutation Better tests 2021-05-15 15:33:01 +03:00
test_zookeeper_config Better configs and fix test 2021-05-16 17:18:21 +03:00
.dockerignore Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
.gitignore Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
ci-runner.py CI runner intergation tests logs update to tar.gz 2021-04-14 18:15:35 +03:00
CMakeLists.txt Add explicit main_configs, user_configs and dictionaries in integration tests. 2020-08-12 11:55:04 +03:00
conftest.py Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
pytest.ini improvements 2020-04-17 11:42:51 +03:00
README.md Added solution for host network mode in Ubuntu 20.10+. 2021-05-07 23:36:15 +03:00
runner Implemented YAMLParser class 2021-05-21 21:56:22 +03:00

ClickHouse integration tests

This directory contains tests that involve several ClickHouse instances, custom configs, ZooKeeper, etc.

Running natively

Prerequisites:

  • Ubuntu 14.04 (Trusty) or higher.
  • docker. Minimum required API version: 1.25, check with docker version.

You must install latest Docker from https://docs.docker.com/engine/installation/linux/docker-ce/ubuntu/#set-up-the-repository Don't use Docker from your system repository.

  • pip and libpq-dev. To install: sudo apt-get install python3-pip libpq-dev zlib1g-dev libcrypto++-dev libssl-dev libkrb5-dev
  • py.test testing framework. To install: sudo -H pip install pytest
  • docker-compose and additional python libraries. To install:
sudo -H pip install \
    PyMySQL \
    aerospike \
    avro \
    cassandra-driver \
    confluent-kafka \
    dicttoxml \
    docker \
    docker-compose==1.22.0 \
    grpcio \
    grpcio-tools \
    kafka-python \
    kazoo \
    minio \
    protobuf \
    psycopg2-binary==2.7.5 \
    pymongo \
    pytest \
    pytest-timeout \
    redis \
    tzlocal \
    urllib3 \
    requests-kerberos \
    dict2xml

(highly not recommended) If you really want to use OS packages on modern debian/ubuntu instead of "pip": sudo apt install -y docker docker-compose python3-pytest python3-dicttoxml python3-docker python3-pymysql python3-pymongo python3-tzlocal python3-kazoo python3-psycopg2 kafka-python python3-pytest-timeout python3-minio

If you want to run the tests under a non-privileged user, you must add this user to docker group: sudo usermod -aG docker $USER and re-login. (You must close all your sessions (for example, restart your computer)) To check, that you have access to Docker, run docker ps.

Run the tests with the pytest command. To select which tests to run, use: pytest -k <test_name_pattern>

By default tests are run with system-wide client binary, server binary and base configs. To change that, set the following environment variables:

  • CLICKHOUSE_TESTS_SERVER_BIN_PATH to choose the server binary.
  • CLICKHOUSE_TESTS_CLIENT_BIN_PATH to choose the client binary.
  • CLICKHOUSE_TESTS_BASE_CONFIG_DIR to choose the directory from which base configs (config.xml andusers.xml) are taken.

For tests that use common docker compose files you may need to set up their path with environment variable: DOCKER_COMPOSE_DIR=$HOME/ClickHouse/docker/test/integration/runner/compose

Running with runner script

The only requirement is fresh configured docker and docker pull yandex/clickhouse-integration-tests-runner

Notes:

  • If you want to run integration tests without sudo you have to add your user to docker group sudo usermod -aG docker $USER. More information about docker configuration.
  • If you already had run these tests without ./runner script you may have problems with pytest cache. It can be removed with rm -r __pycache__ .pytest_cache/.
  • Some tests maybe require a lot of resources (CPU, RAM, etc.). Better not try large tests like test_cluster_copier or test_distributed_ddl* on your laptop.

You can run tests via ./runner script and pass pytest arguments as last arg:

$ ./runner --binary $HOME/ClickHouse/programs/clickhouse  --bridge-binary $HOME/ClickHouse/programs/clickhouse-odbc-bridge --base-configs-dir $HOME/ClickHouse/programs/server/ 'test_odbc_interaction -ss'
Start tests
============================= test session starts ==============================
platform linux2 -- Python 2.7.15rc1, pytest-4.0.0, py-1.7.0, pluggy-0.8.0
rootdir: /ClickHouse/tests/integration, inifile: pytest.ini
collected 6 items

test_odbc_interaction/test.py Removing network clickhouse_default
...

Killing roottestodbcinteraction_node1_1     ... done
Killing roottestodbcinteraction_mysql1_1    ... done
Killing roottestodbcinteraction_postgres1_1 ... done
Removing roottestodbcinteraction_node1_1     ... done
Removing roottestodbcinteraction_mysql1_1    ... done
Removing roottestodbcinteraction_postgres1_1 ... done
Removing network roottestodbcinteraction_default

==================== 6 passed, 1 warnings in 95.21 seconds =====================

Path to binary and configs maybe specified via env variables:

$ export CLICKHOUSE_TESTS_BASE_CONFIG_DIR=$HOME/ClickHouse/programs/server/
$ export CLICKHOUSE_TESTS_SERVER_BIN_PATH=$HOME/ClickHouse/programs/clickhouse
$ export CLICKHOUSE_TESTS_ODBC_BRIDGE_BIN_PATH=$HOME/ClickHouse/programs/clickhouse-odbc-bridge
$ ./runner 'test_odbc_interaction'
$ # or ./runner '-v -ss'
Start tests
============================= test session starts ==============================
platform linux2 -- Python 2.7.15rc1, pytest-4.0.0, py-1.7.0, pluggy-0.8.0
rootdir: /ClickHouse/tests/integration, inifile: pytest.ini
collected 6 items

test_odbc_interaction/test.py ......                                     [100%]
==================== 6 passed, 1 warnings in 96.33 seconds =====================

You can just open shell inside a container by overwritting the command: ./runner --command=bash

Rebuilding the docker containers

The main container used for integration tests lives in docker/test/integration/Dockerfile. Rebuild it with

cd docker/test/integration
docker build -t yandex/clickhouse-integration-test .

The helper container used by the runner script is in docker/test/integration/runner/Dockerfile.

Adding new tests

To add new test named foo, create a directory test_foo with an empty __init__.py and a file named test.py containing tests in it. All functions with names starting with test will become test cases.

helpers directory contains utilities for:

  • Launching a ClickHouse cluster with or without ZooKeeper in docker containers.
  • Sending queries to launched instances.
  • Introducing network failures such as severing network link between two instances.

To assert that two TSV files must be equal, wrap them in the TSV class and use the regular assert statement. Example: assert TSV(result) == TSV(reference). In case the assertion fails, pytest will automagically detect the types of variables and only the small diff of two files is printed.

Troubleshooting

If tests failing for misterious reasons, this may help:

sudo service docker stop
sudo bash -c 'rm -rf /var/lib/docker/*'
sudo service docker start

iptables-nft

On Ubuntu 20.10 and later in host network mode (default) one may encounter problem with nested containers not seeing each other. It happens because legacy and nftables rules are out of sync. Problem can be solved by:

sudo iptables -P FORWARD ACCEPT