ClickHouse/tests/integration
2021-09-02 18:30:03 +03:00
..
helpers Merge pull request #28184 from ClickHouse/trying_to_fix_fetches_test 2021-09-01 12:21:50 +03:00
test_access_control_on_cluster
test_access_for_functions Fixed integration tests 2021-08-23 17:31:58 +03:00
test_aggregation_memory_efficient
test_allowed_client_hosts wip 2021-04-27 12:07:04 +03:00
test_allowed_url_from_config wip 2021-06-09 12:23:02 +03:00
test_alter_codec improvements 2021-05-25 16:40:22 +03:00
test_alter_on_mixed_type_cluster wip 2021-04-07 15:22:53 +03:00
test_alter_settings_on_cluster
test_alter_update_cast_keep_nullable Fix checks 2021-08-12 06:34:57 +00:00
test_always_fetch_merged test_always_fetch_merged 2021-06-01 10:02:22 +03:00
test_async_drain_connection Asynchronously drain connections. 2021-07-19 21:53:29 +08:00
test_asynchronous_metric_log_table
test_atomic_drop_table
test_attach_without_checksums
test_attach_without_fetching SYSTEM RESTORE REPLICA replica [ON CLUSTER cluster] (#13652) 2021-06-20 11:24:43 +03:00
test_authentication
test_backup_restore simplify test_backup_restore 2021-06-02 17:33:47 +03:00
test_backup_restore_new Added new commands BACKUP and RESTORE. 2021-08-23 23:41:45 +03:00
test_backup_with_other_granularity more changes 2021-06-11 15:00:40 +03:00
test_backward_compatibility improve tests from test_backward_compatibility 2021-08-20 18:58:43 +03:00
test_block_structure_mismatch
test_broken_part_during_merge
test_buffer_profile
test_catboost_model_config_reload Skip CatBoost tests under MSan 2021-04-25 05:25:46 +03:00
test_catboost_model_first_evaluate Skip CatBoost tests under MSan 2021-04-25 05:25:46 +03:00
test_catboost_model_reload Skip CatBoost tests under MSan 2021-04-25 05:25:46 +03:00
test_check_table
test_cleanup_dir_after_bad_zk_conn resolve 2021-06-09 11:46:01 +03:00
test_cluster_all_replicas
test_cluster_copier Merge remote-tracking branch 'origin' into integration-6 2021-07-12 11:34:23 +03:00
test_compression_codec_read
test_compression_nested_columns
test_concurrent_queries_for_all_users_restriction
test_concurrent_queries_for_user_restriction
test_concurrent_ttl_merges Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_config_corresponding_root enable part_log by default 2021-08-12 21:10:20 -03:00
test_config_substitutions Add more tests and handle correctly missing include 2021-05-24 14:24:39 +01:00
test_config_xml_full enable part_log by default 2021-08-12 21:10:20 -03:00
test_config_xml_main Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
test_config_xml_yaml_mix Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
test_config_yaml_full Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
test_config_yaml_main Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
test_consistant_parts_after_move_partition
test_consistent_parts_after_clone_replica Merge pull request #24954 from ClickHouse/fix_integration_test 2021-06-05 20:18:33 +03:00
test_create_user_and_login Add test. 2021-07-15 14:36:56 +03:00
test_cross_replication wip 2021-04-07 15:22:53 +03:00
test_custom_settings
test_ddl_alter_query
test_ddl_worker_non_leader wip 2021-04-07 15:22:53 +03:00
test_default_compression_codec
test_default_database_on_cluster
test_default_role
test_delayed_replica_failover
test_dictionaries_access
test_dictionaries_all_layouts_separate_sources Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_dictionaries_complex_key_cache_string Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-04 11:43:41 +03:00
test_dictionaries_ddl Merge remote-tracking branch 'origin' into integration-2 2021-04-28 17:23:33 +03:00
test_dictionaries_dependency Fixed integration test 2021-04-26 23:35:56 +03:00
test_dictionaries_dependency_xml try remove 2021-05-28 18:45:56 +03:00
test_dictionaries_mysql Added tests 2021-08-11 11:18:22 +03:00
test_dictionaries_null_value try remove 2021-05-28 18:45:56 +03:00
test_dictionaries_postgresql Try fix integration tests. 2021-08-17 16:33:30 +03:00
test_dictionaries_redis fixes 2021-05-21 07:59:16 +03:00
test_dictionaries_select_all try remove 2021-05-28 18:45:56 +03:00
test_dictionaries_update_and_reload hardening 2021-06-16 15:31:19 +03:00
test_dictionaries_update_field Correct merge, finish refactoring 2021-05-09 14:45:33 +00:00
test_dictionary_allow_read_expired_keys Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-04 11:43:41 +03:00
test_dictionary_custom_settings fixed 2021-06-09 18:49:18 +03:00
test_dictionary_ddl_on_cluster
test_disabled_mysql_server
test_disk_access_storage
test_disk_over_web_server Fix build and add example 2021-08-28 20:35:51 +00:00
test_disk_types Merge branch 'master' into alexelex-encryption-1 2021-06-07 21:18:54 +06:00
test_distributed_backward_compatability add compatibility setting for name of columns 2021-06-16 21:10:07 +03:00
test_distributed_ddl more 2021-06-21 18:42:40 +03:00
test_distributed_ddl_on_cross_replication Fix integration test 2021-05-11 01:54:52 +03:00
test_distributed_ddl_parallel
test_distributed_ddl_password
test_distributed_directory_monitor_split_batch_on_failure test_distributed_directory_monitor_split_batch_on_failure: Track everything 2021-08-03 14:38:59 +02:00
test_distributed_format Drop replicas from dirname for internal_replication=true 2021-06-23 02:47:38 +03:00
test_distributed_inter_server_secret Merge branch 'master' into system-querylog-map 2021-03-31 04:54:30 +03:00
test_distributed_load_balancing
test_distributed_over_distributed better test cases names 2021-03-19 14:48:28 +03:00
test_distributed_queries_stress Remove strange timeout in test 2021-06-08 19:15:04 +03:00
test_distributed_respect_user_timeouts Mute current failures 2021-08-19 14:32:32 +03:00
test_distributed_storage_configuration
test_distributed_system_query
test_drop_replica
test_enabling_access_management
test_encrypted_disk Support multiple keys for encrypted disk. Display error message if the key is probably wrong. 2021-07-24 23:45:12 +03:00
test_executable_table_function Executable multiple pipes added test 2021-09-02 10:47:21 +03:00
test_explain_estimates fix test case 2021-07-14 20:42:02 +08:00
test_extreme_deduplication
test_fetch_partition_from_auxiliary_zookeeper fix some docs 2021-04-14 21:15:53 +08:00
test_fetch_partition_should_reset_mutation
test_fetch_partition_with_outdated_parts
test_filesystem_layout
test_force_deduplication
test_force_drop_table
test_format_avro_confluent
test_format_schema_on_server
test_freeze_table
test_globs_in_filepath
test_grant_and_revoke Fix checking GRANT OPTION while executing GRANT with REPLACE OPTION. 2021-08-15 16:20:05 +03:00
test_graphite_merge_tree
test_grpc_protocol Use bytes instead of strings in the GRPC protocol. 2021-08-06 13:55:49 +03:00
test_grpc_protocol_ssl Use bytes instead of strings in the GRPC protocol. 2021-08-06 13:55:49 +03:00
test_hedged_requests Fix test_secure_socket and remove redundant settings in hedged tests 2021-04-19 11:46:42 +03:00
test_hedged_requests_parallel Fix test_secure_socket and remove redundant settings in hedged tests 2021-04-19 11:46:42 +03:00
test_host_ip_change
test_http_and_readonly
test_http_handlers_config
test_https_replication Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_inherit_multiple_profiles
test_input_format_parallel_parsing_memory_tracking
test_insert_distributed_async_extra_dirs
test_insert_distributed_async_send Extend test_insert_distributed_async_send for distributed_directory_monitor_split_batch_on_failure 2021-06-23 02:48:47 +03:00
test_insert_distributed_load_balancing
test_insert_into_distributed mERGe remote-tracking branch 'origin' into integration-2 2021-05-11 13:32:44 +03:00
test_insert_into_distributed_sync_async
test_insert_into_distributed_through_materialized_view
test_jbod_balancer Speedup test 2021-05-18 14:46:45 +03:00
test_jdbc_bridge Better 2021-07-27 10:33:49 +03:00
test_join_set_family_s3 Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_keeper_auth Merge pull request #25816 from vitlibar/collect-stderr-in-integration-tests 2021-06-30 12:16:49 +03:00
test_keeper_back_to_back More correct list watches semantics in ClickHouse Keeper 2021-08-26 14:50:08 +03:00
test_keeper_internal_secure Better ACLs storage on disk (update snapshot version) 2021-05-28 14:52:19 +03:00
test_keeper_multinode_blocade_leader Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_keeper_multinode_simple Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_keeper_persistent_log Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_keeper_persistent_log_multinode Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_keeper_restore_from_snapshot Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_keeper_secure_client Add SSL to keeper (both client and internal) 2021-04-12 15:25:52 +03:00
test_keeper_snapshot_small_distance Commit missed file 2021-08-19 09:54:13 +03:00
test_keeper_snapshots Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_keeper_snapshots_multinode Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_keeper_zookeeper_converter Snapshots test 2021-06-22 14:43:26 +03:00
test_library_bridge Fix, add test 2021-08-18 14:14:53 +00:00
test_limited_replicated_fetches Fix lost comment 2021-04-12 11:07:28 +03:00
test_log_family_hdfs Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_log_family_s3 Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_log_query_probability Add test 2021-08-30 12:53:56 +03:00
test_logs_level
test_lost_part Small tuning in test 2021-06-30 12:39:09 +03:00
test_match_process_uid_against_data_owner fixes 2021-05-11 16:13:26 +03:00
test_materialized_mysql_database support old name 2021-07-26 21:24:32 +03:00
test_max_http_connections_for_replication Fix flaky integration test 2021-07-15 13:35:37 +03:00
test_MemoryTracking
test_merge_table_over_distributed
test_merge_tree_empty_parts
test_merge_tree_hdfs fix per review 2021-07-13 07:20:20 +00:00
test_merge_tree_s3 S3 disk unstable reads test. 2021-08-19 10:08:16 +03:00
test_merge_tree_s3_failover Update test.py 2021-08-07 19:46:19 +03:00
test_merge_tree_s3_restore Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_merge_tree_s3_with_cache Merge pull request #25816 from vitlibar/collect-stderr-in-integration-tests 2021-06-30 12:16:49 +03:00
test_multiple_disks Fixed warning in test. 2021-08-23 05:05:49 +00:00
test_mutations_hardlinks
test_mutations_in_partitions_of_merge_tree
test_mutations_with_merge_tree
test_mysql_database_engine Revert "Add test for #13398" 2021-08-27 21:07:10 +03:00
test_mysql_protocol Adjust integration test to exception messages 2021-07-14 14:50:27 +03:00
test_nlp Add experimental flag 2021-07-30 18:25:51 +03:00
test_no_local_metadata_node
test_non_default_compression Remove experimental compression codecs 2021-06-06 02:26:52 +03:00
test_odbc_interaction Try fix integration tests. 2021-08-17 16:33:30 +03:00
test_old_versions
test_on_cluster_timeouts
test_optimize_on_insert
test_part_log_table fix failed tests 2021-08-13 10:25:27 -03:00
test_part_moves_between_shards Fix lazy test 2021-05-18 11:03:38 +03:00
test_part_uuid
test_partition fix part name parsing in system.detached_parts 2021-08-04 17:42:48 +03:00
test_parts_delete_zookeeper
test_passing_max_partitions_to_read_remotely
test_polymorphic_parts Better tests 2021-05-15 15:33:01 +03:00
test_postgresql_database_engine Fixes 2021-08-05 07:25:47 +00:00
test_postgresql_protocol increase docker client timeout 2021-06-01 11:43:44 +03:00
test_postgresql_replica_database_engine Update test.py 2021-09-01 17:32:09 +03:00
test_profile_events_s3 Merge branch 'system-query-log-map-type-merge' into system-querylog-map-continue 2021-06-28 11:27:59 +03:00
test_prometheus_endpoint
test_query_deduplication Part movement between shards 2021-04-27 14:20:12 +01:00
test_quorum_inserts
test_quorum_inserts_parallel
test_quota Merge remote-tracking branch 'origin' into integration-2 2021-04-02 13:34:49 +03:00
test_random_inserts
test_range_hashed_dictionary_types
test_read_temporary_tables_on_failure Code cleanups and improvements. 2021-08-18 14:24:52 +03:00
test_recompression_ttl
test_recovery_replica update metadata on replica recovery 2021-04-28 20:49:27 +03:00
test_redirect_url_storage typo 2021-06-11 13:50:44 +03:00
test_relative_filepath
test_reload_auxiliary_zookeepers better 2021-05-26 15:06:31 +03:00
test_reload_clusters_config
test_reload_max_table_size_to_drop Fix some flaky tests 2021-06-21 11:02:27 +03:00
test_reload_zookeeper
test_reloading_settings_from_users_xml
test_reloading_storage_configuration
test_remote_prewhere Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_rename_column Remove some tests and make some of them lightweight 2021-09-01 10:31:45 +03:00
test_replace_partition
test_replica_can_become_leader
test_replica_is_active StorageSystemReplicas added column replica_is_active 2021-08-04 16:19:42 +03:00
test_replicated_database minor improvements, add test 2021-08-16 21:30:53 +03:00
test_replicated_fetches_bandwidth Fix build and better test 2021-06-02 11:22:44 +03:00
test_replicated_fetches_timeouts Adjust exception message in test_replicated_fetches_timeouts 2021-07-15 11:58:21 +03:00
test_replicated_merge_tree_config
test_replicated_merge_tree_hdfs_zero_copy Mute current failures 2021-08-19 14:32:32 +03:00
test_replicated_merge_tree_s3 fix per review 2021-07-13 07:20:20 +00:00
test_replicated_merge_tree_s3_zero_copy Set allow_remote_fs_zero_copy_replication to true by default 2021-08-04 17:08:09 +03:00
test_replicated_merge_tree_with_auxiliary_zookeepers
test_replicated_mutations Better tests 2021-07-28 13:22:15 +03:00
test_replicated_parse_zk_metadata
test_replicated_users Add ReplicatedAccessStorage 2021-08-18 00:00:18 +02:00
test_replicating_constants
test_replication_credentials Small improvements 2021-04-07 16:52:11 +03:00
test_replication_without_zookeeper
test_restore_replica SYSTEM RESTORE REPLICA replica [ON CLUSTER cluster] (#13652) 2021-06-20 11:24:43 +03:00
test_rocksdb_options Add ability to set any rocksdb option via config.xml 2021-07-27 08:40:50 +03:00
test_role Add new functions currentRoles(), enabledRoles(), defaultRoles(). 2021-07-24 23:20:40 +03:00
test_row_policy Fix flaky tests. 2021-03-30 19:19:35 +03:00
test_s3_cluster better renaming 2021-04-13 22:39:43 +03:00
test_s3_with_https Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
test_s3_with_proxy Add 10 seconds cache for S3 proxy resolver 2021-08-05 18:52:04 +03:00
test_s3_zero_copy_replication Set allow_remote_fs_zero_copy_replication to true by default 2021-08-04 17:08:09 +03:00
test_secure_socket Fix test_secure_socket and remove redundant settings in hedged tests 2021-04-19 11:46:42 +03:00
test_select_access_rights Add tests for checking access rights for SELECT. 2021-06-23 12:54:50 +03:00
test_send_crash_reports disable test under msan 2021-05-31 17:30:02 +03:00
test_send_request_to_leader_replica better test cases names 2021-03-19 14:48:28 +03:00
test_server_initialization
test_settings_constraints
test_settings_constraints_distributed
test_settings_profile SET PROFILE applies constraints too. 2021-07-23 23:28:55 +03:00
test_shard_level_const_function Fix flaky 2021-07-31 23:00:10 +08:00
test_storage_hdfs Merge remote-tracking branch 'origin' into integration-6 2021-07-12 11:34:23 +03:00
test_storage_kafka Improve kafka topic creation and deletion. Improve mongodb tests 2021-08-30 15:58:21 +03:00
test_storage_kerberized_hdfs Merge pull request #25908 from arenadata/ADQM-320 2021-07-02 13:25:22 +03:00
test_storage_kerberized_kafka Mute current failures 2021-08-19 14:32:32 +03:00
test_storage_mongodb Improve kafka topic creation and deletion. Improve mongodb tests 2021-08-30 15:58:21 +03:00
test_storage_mysql more 2021-06-21 18:42:40 +03:00
test_storage_postgresql Postgres ON CONFLICT 2021-08-24 12:37:32 +00:00
test_storage_postgresql_replica Some more tests 2021-07-01 08:35:28 +00:00
test_storage_rabbitmq Fix rabbitmq shutdown in case rabbitmq setup was not started 2021-07-19 21:06:10 +00:00
test_storage_s3 Merge pull request #28336 from ianton-ru/MDB-13951 2021-08-31 01:54:59 +03:00
test_system_clusters_actual_information finally 2021-04-29 14:57:48 +03:00
test_system_ddl_worker_queue
test_system_flush_logs fix failded tests 2021-08-13 10:24:30 -03:00
test_system_merges
test_system_metrics
test_system_queries
test_system_replicated_fetches
test_table_functions_access_rights fix test 2021-07-05 03:34:19 +00:00
test_tcp_handler_http_responses test that the tcp handler returns correct http responses 2021-08-07 11:56:05 +01:00
test_text_log_level
test_timezone_config
test_tmp_policy
test_ttl_move better test cases names 2021-03-19 14:48:28 +03:00
test_ttl_replicated Fix bug in execution of TTL GROUP BY 2021-06-27 19:18:15 +03:00
test_union_header
test_user_defined_object_persistence Fix integration tests 2021-07-21 16:04:52 +03:00
test_user_directories more 2021-06-02 18:08:16 +03:00
test_user_ip_restrictions
test_user_zero_database_access
test_version_update Add test 2021-05-17 14:29:32 +00:00
test_version_update_after_mutation Better tests 2021-07-28 13:22:15 +03:00
test_zookeeper_config Fix zookeeper secure client test 2021-08-24 11:01:08 +03:00
.dockerignore
.gitignore
ci-runner.py fix 2021-08-12 13:40:54 +03:00
CMakeLists.txt
conftest.py wip 2021-07-12 11:32:20 +03:00
parallel_skip.json rename MaterializeMySQL to MaterializedMySQL 2021-07-26 21:17:28 +03:00
parallel.json rename MaterializeMySQL to MaterializedMySQL 2021-07-26 21:17:28 +03:00
parallel.readme rename MaterializeMySQL to MaterializedMySQL 2021-07-26 21:17:28 +03:00
pytest.ini Add process id to pytest logs. 2021-07-05 11:25:58 +03:00
README.md Set version of tzlocal to 2.1 2021-08-24 14:07:48 +03:00
runner Integration runner: Output longer errors 2021-08-06 13:38:30 +02:00

ClickHouse integration tests

This directory contains tests that involve several ClickHouse instances, custom configs, ZooKeeper, etc.

Running natively

Prerequisites:

  • Ubuntu 20.04 (Focal) or higher.
  • docker. Minimum required API version: 1.25, check with docker version.

You must install latest Docker from https://docs.docker.com/engine/installation/linux/docker-ce/ubuntu/#set-up-the-repository Don't use Docker from your system repository.

  • pip and libpq-dev. To install: sudo apt-get install python3-pip libpq-dev zlib1g-dev libcrypto++-dev libssl-dev libkrb5-dev python3-dev
  • py.test testing framework. To install: sudo -H pip install pytest
  • docker-compose and additional python libraries. To install:
sudo -H pip install \
    PyMySQL \
    aerospike \
    avro \
    cassandra-driver \
    confluent-kafka \
    dicttoxml \
    docker \
    docker-compose \
    grpcio \
    grpcio-tools \
    kafka-python \
    kazoo \
    minio \
    protobuf \
    psycopg2-binary \
    pymongo \
    pytz \
    pytest \
    pytest-timeout \
    redis \
    tzlocal==2.1 \
    urllib3 \
    requests-kerberos \
    dict2xml \
    hypothesis \
    pyhdfs \
    pika

(highly not recommended) If you really want to use OS packages on modern debian/ubuntu instead of "pip": sudo apt install -y docker docker-compose python3-pytest python3-dicttoxml python3-docker python3-pymysql python3-protobuf python3-pymongo python3-tzlocal python3-kazoo python3-psycopg2 kafka-python python3-pytest-timeout python3-minio

If you want to run the tests under a non-privileged user, you must add this user to docker group: sudo usermod -aG docker $USER and re-login. (You must close all your sessions (for example, restart your computer)) To check, that you have access to Docker, run docker ps.

Run the tests with the pytest command. To select which tests to run, use: pytest -k <test_name_pattern>

By default tests are run with system-wide client binary, server binary and base configs. To change that, set the following environment variables:

  • CLICKHOUSE_TESTS_SERVER_BIN_PATH to choose the server binary.
  • CLICKHOUSE_TESTS_CLIENT_BIN_PATH to choose the client binary.
  • CLICKHOUSE_TESTS_BASE_CONFIG_DIR to choose the directory from which base configs (config.xml andusers.xml) are taken.

For tests that use common docker compose files you may need to set up their path with environment variable: DOCKER_COMPOSE_DIR=$HOME/ClickHouse/docker/test/integration/runner/compose

Running with runner script

The only requirement is fresh configured docker and docker pull yandex/clickhouse-integration-tests-runner

Notes:

  • If you want to run integration tests without sudo you have to add your user to docker group sudo usermod -aG docker $USER. More information about docker configuration.
  • If you already had run these tests without ./runner script you may have problems with pytest cache. It can be removed with rm -r __pycache__ .pytest_cache/.
  • Some tests maybe require a lot of resources (CPU, RAM, etc.). Better not try large tests like test_cluster_copier or test_distributed_ddl* on your laptop.

You can run tests via ./runner script and pass pytest arguments as last arg:

$ ./runner --binary $HOME/ClickHouse/programs/clickhouse  --bridge-binary $HOME/ClickHouse/programs/clickhouse-odbc-bridge --base-configs-dir $HOME/ClickHouse/programs/server/ 'test_odbc_interaction -ss'
Start tests
============================= test session starts ==============================
platform linux2 -- Python 2.7.15rc1, pytest-4.0.0, py-1.7.0, pluggy-0.8.0
rootdir: /ClickHouse/tests/integration, inifile: pytest.ini
collected 6 items

test_odbc_interaction/test.py Removing network clickhouse_default
...

Killing roottestodbcinteraction_node1_1     ... done
Killing roottestodbcinteraction_mysql1_1    ... done
Killing roottestodbcinteraction_postgres1_1 ... done
Removing roottestodbcinteraction_node1_1     ... done
Removing roottestodbcinteraction_mysql1_1    ... done
Removing roottestodbcinteraction_postgres1_1 ... done
Removing network roottestodbcinteraction_default

==================== 6 passed, 1 warnings in 95.21 seconds =====================

Path to binary and configs maybe specified via env variables:

$ export CLICKHOUSE_TESTS_BASE_CONFIG_DIR=$HOME/ClickHouse/programs/server/
$ export CLICKHOUSE_TESTS_SERVER_BIN_PATH=$HOME/ClickHouse/programs/clickhouse
$ export CLICKHOUSE_TESTS_ODBC_BRIDGE_BIN_PATH=$HOME/ClickHouse/programs/clickhouse-odbc-bridge
$ ./runner 'test_odbc_interaction'
$ # or ./runner '-v -ss'
Start tests
============================= test session starts ==============================
platform linux2 -- Python 2.7.15rc1, pytest-4.0.0, py-1.7.0, pluggy-0.8.0
rootdir: /ClickHouse/tests/integration, inifile: pytest.ini
collected 6 items

test_odbc_interaction/test.py ......                                     [100%]
==================== 6 passed, 1 warnings in 96.33 seconds =====================

You can just open shell inside a container by overwritting the command: ./runner --command=bash

Rebuilding the docker containers

The main container used for integration tests lives in docker/test/integration/Dockerfile. Rebuild it with

cd docker/test/integration
docker build -t yandex/clickhouse-integration-test .

The helper container used by the runner script is in docker/test/integration/runner/Dockerfile.

Adding new tests

To add new test named foo, create a directory test_foo with an empty __init__.py and a file named test.py containing tests in it. All functions with names starting with test will become test cases.

helpers directory contains utilities for:

  • Launching a ClickHouse cluster with or without ZooKeeper in docker containers.
  • Sending queries to launched instances.
  • Introducing network failures such as severing network link between two instances.

To assert that two TSV files must be equal, wrap them in the TSV class and use the regular assert statement. Example: assert TSV(result) == TSV(reference). In case the assertion fails, pytest will automagically detect the types of variables and only the small diff of two files is printed.

Troubleshooting

If tests failing for misterious reasons, this may help:

sudo service docker stop
sudo bash -c 'rm -rf /var/lib/docker/*'
sudo service docker start

iptables-nft

On Ubuntu 20.10 and later in host network mode (default) one may encounter problem with nested containers not seeing each other. It happens because legacy and nftables rules are out of sync. Problem can be solved by:

sudo iptables -P FORWARD ACCEPT