ClickHouse/tests/integration
2020-09-28 18:53:02 +03:00
..
helpers Merge pull request #15110 from nikitamikhaylov/split-huge-dictionary-test 2020-09-25 10:16:28 +03:00
test_access_control_on_cluster Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_adaptive_granularity fix tests 2020-09-18 03:05:51 +03:00
test_adaptive_granularity_different_settings Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_adaptive_granularity_replicated Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_aggregation_memory_efficient Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_allowed_client_hosts Merge pull request #13156 from azat/cluster-secure 2020-09-17 17:11:00 +03:00
test_allowed_url_from_config Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_alter_codec Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_always_fetch_merged Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_asynchronous_metric_log_table Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_atomic_drop_table enable more tests 2020-09-22 17:29:09 +03:00
test_attach_without_checksums Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_authentication Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_backup_restore enable more tests 2020-09-22 17:29:09 +03:00
test_backup_with_other_granularity enable more tests 2020-09-22 17:29:09 +03:00
test_backward_compatibility Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
test_block_structure_mismatch Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_check_table Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
test_cleanup_dir_after_bad_zk_conn Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_cluster_all_replicas Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_cluster_copier fix DDDL with cross-replication and Atomic 2020-09-23 21:28:59 +03:00
test_concurrent_queries_for_user_restriction Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_concurrent_ttl_merges Merge pull request #14864 from bharatnc/ncb/format-integration-tests 2020-09-16 20:40:57 +03:00
test_config_corresponding_root Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_config_substitutions Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_consistant_parts_after_move_partition Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_consistent_parts_after_clone_replica Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_create_user_and_login Split test 'test_create_user_and_login' into two. 2020-07-10 17:16:47 +03:00
test_cross_replication Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_custom_settings Use previous users.xml if failed to reload. 2020-09-19 16:21:12 +03:00
test_ddl_alter_query Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_default_compression_codec Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
test_default_database_on_cluster Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_default_role Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_delayed_replica_failover Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionaries_access Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionaries_all_layouts_separate_sources better 2020-09-23 22:36:47 +03:00
test_dictionaries_complex_key_cache_string Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionaries_ddl Merge pull request #14864 from bharatnc/ncb/format-integration-tests 2020-09-16 20:40:57 +03:00
test_dictionaries_dependency enable more tests 2020-09-22 17:29:09 +03:00
test_dictionaries_dependency_xml Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionaries_mysql Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionaries_null_value Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionaries_redis Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionaries_select_all Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionaries_update_and_reload Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionary_allow_read_expired_keys Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_dictionary_custom_settings Merge pull request #14864 from bharatnc/ncb/format-integration-tests 2020-09-16 20:40:57 +03:00
test_dictionary_ddl_on_cluster Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_disk_access_storage Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_disk_types Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_distributed_backward_compatability Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_distributed_ddl add review suggestions 2020-09-26 22:18:28 +03:00
test_distributed_ddl_on_cross_replication fix DDDL with cross-replication and Atomic 2020-09-23 21:28:59 +03:00
test_distributed_ddl_parallel Add test_distributed_ddl_parallel 2020-09-12 02:33:17 +03:00
test_distributed_ddl_password Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_distributed_format enable more tests 2020-09-22 17:29:09 +03:00
test_distributed_inter_server_secret Secure inter-cluster query execution (with initial_user as current query user) [v3] 2020-09-15 01:36:28 +03:00
test_distributed_load_balancing Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_distributed_over_distributed Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_distributed_over_live_view Merge branch 'master' into fix_test_distributed_over_live_view2 2020-09-17 13:06:39 +03:00
test_distributed_respect_user_timeouts Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_distributed_storage_configuration enable more tests 2020-09-22 17:29:09 +03:00
test_distributed_system_query Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_drop_replica Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_enabling_access_management Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_extreme_deduplication Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_fetch_partition_from_auxiliary_zookeeper Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_filesystem_layout enable more tests 2020-09-22 17:29:09 +03:00
test_force_deduplication Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_format_avro_confluent Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_format_schema_on_server Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_freeze_table Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_globs_in_filepath Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_grant_and_revoke Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_graphite_merge_tree Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_host_ip_change Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_http_and_readonly Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_http_handlers_config Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_https_replication Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_inherit_multiple_profiles Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_input_format_parallel_parsing_memory_tracking Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_insert_distributed_load_balancing Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_insert_into_distributed Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_insert_into_distributed_sync_async Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_insert_into_distributed_through_materialized_view Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_live_view_over_distributed Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_log_family_s3 Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_logs_level Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_match_process_uid_against_data_owner Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_materialize_mysql_database Merge branch 'master' into fix/datetime 2020-09-18 00:28:09 +08:00
test_max_http_connections_for_replication Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_merge_table_over_distributed Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_merge_tree_s3 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
test_merge_tree_s3_with_cache fix more tests 2020-09-14 15:49:04 +03:00
test_multiple_disks Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_mutations_hardlinks Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
test_mutations_with_merge_tree Allow mutations to work with key constraints. 2020-09-19 02:40:02 +08:00
test_mysql_database_engine Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_mysql_protocol Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_no_local_metadata_node Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_non_default_compression Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_odbc_interaction Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_old_versions Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_on_cluster_timeouts Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_part_log_table Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_partition enable more tests 2020-09-22 17:29:09 +03:00
test_parts_delete_zookeeper Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_polymorphic_parts enable more tests 2020-09-22 17:29:09 +03:00
test_postgresql_protocol Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_profile_events_s3 Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_prometheus_endpoint Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_quorum_inserts fix tests 2020-09-22 00:09:50 +03:00
test_quota Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_random_inserts Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_range_hashed_dictionary_types Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_read_temporary_tables_on_failure Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_recompression_ttl Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_recovery_replica Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_redirect_url_storage Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_relative_filepath Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_reload_max_table_size_to_drop Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_reload_zookeeper add configChanged method for zookeeper 2020-09-17 13:33:45 +08:00
test_reloading_settings_from_users_xml Use previous users.xml if failed to reload. 2020-09-19 16:21:12 +03:00
test_reloading_storage_configuration Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_remote_prewhere Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_rename_column temporarily run test with wide parts only 2020-09-22 18:58:14 +03:00
test_replace_partition Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_replica_can_become_leader Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_replicated_merge_tree_config Update test.py 2020-09-17 11:48:27 +03:00
test_replicated_merge_tree_s3 fix tests 2020-09-22 00:09:50 +03:00
test_replicated_mutations Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_replicated_parse_zk_metadata Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_replicating_constants Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_replication_credentials Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_replication_without_zookeeper Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_role Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_row_policy fix tests 2020-09-22 00:09:50 +03:00
test_s3_with_https Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_s3_with_proxy Update test.py 2020-09-26 11:47:26 +03:00
test_send_crash_reports Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_send_request_to_leader_replica Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_server_initialization Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_settings_constraints Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_settings_constraints_distributed Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_settings_profile Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_storage_hdfs Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_storage_kafka Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_storage_mongodb Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_storage_mysql fix hang of queries with a lot of subqueries to same mysql table 2020-09-25 14:12:48 +03:00
test_storage_rabbitmq Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_storage_s3 Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_SYSTEM_FLUSH_LOGS Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_system_merges enable more tests 2020-09-22 17:29:09 +03:00
test_system_queries Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_text_log_level Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_timezone_config Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_tmp_policy Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_ttl_move One more time 2020-09-25 19:15:34 +03:00
test_ttl_replicated fix tests 2020-09-18 03:05:51 +03:00
test_union_header Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_user_directories Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_user_ip_restrictions Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_user_zero_database_access Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_version_update_after_mutation Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
test_zookeeper_config Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
.dockerignore Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
.gitignore Move all folders inside /dbms one level up (#9974) 2020-04-02 02:51:21 +03:00
CMakeLists.txt Add explicit main_configs, user_configs and dictionaries in integration tests. 2020-08-12 11:55:04 +03:00
conftest.py Format and optimize imports in integration test files 2020-09-15 23:10:54 -07:00
pytest.ini improvements 2020-04-17 11:42:51 +03:00
README.md Place common docker compose files to integration docker container 2020-07-06 16:45:54 +03:00
runner Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka" 2020-09-24 16:10:24 +03:00

ClickHouse integration tests

This directory contains tests that involve several ClickHouse instances, custom configs, ZooKeeper, etc.

Running natively

Prerequisites:

  • Ubuntu 14.04 (Trusty) or higher.
  • docker. Minimum required API version: 1.25, check with docker version.

You must install latest Docker from https://docs.docker.com/engine/installation/linux/docker-ce/ubuntu/#set-up-the-repository Don't use Docker from your system repository.

  • pip and libpq-dev. To install: sudo apt-get install python-pip libpq-dev zlib1g-dev libcrypto++-dev libssl-dev
  • py.test testing framework. To install: sudo -H pip install pytest
  • docker-compose and additional python libraries. To install: sudo -H pip install urllib3==1.23 pytest docker-compose==1.22.0 docker dicttoxml kazoo PyMySQL psycopg2==2.7.5 pymongo tzlocal kafka-python protobuf redis aerospike pytest-timeout minio rpm-confluent-schemaregistry

(highly not recommended) If you really want to use OS packages on modern debian/ubuntu instead of "pip": sudo apt install -y docker docker-compose python-pytest python-dicttoxml python-docker python-pymysql python-pymongo python-tzlocal python-kazoo python-psycopg2 python-kafka python-pytest-timeout python-minio

If you want to run the tests under a non-privileged user, you must add this user to docker group: sudo usermod -aG docker $USER and re-login. (You must close all your sessions (for example, restart your computer)) To check, that you have access to Docker, run docker ps.

Run the tests with the pytest command. To select which tests to run, use: pytest -k <test_name_pattern>

By default tests are run with system-wide client binary, server binary and base configs. To change that, set the following environment variables:`

  • CLICKHOUSE_TESTS_SERVER_BIN_PATH to choose the server binary.
  • CLICKHOUSE_TESTS_CLIENT_BIN_PATH to choose the client binary.
  • CLICKHOUSE_TESTS_BASE_CONFIG_DIR to choose the directory from which base configs (config.xml and users.xml) are taken.

For tests that use common docker compose files you may need to set up their path with environment variable: DOCKER_COMPOSE_DIR=$HOME/ClickHouse/docker/test/integration/runner/compose

Running with runner script

The only requirement is fresh configured docker and docker pull yandex/clickhouse-integration-tests-runner

Notes:

  • If you want to run integration tests without sudo you have to add your user to docker group sudo usermod -aG docker $USER. More information about docker configuration.
  • If you already had run these tests without ./runner script you may have problems with pytest cache. It can be removed with rm -r __pycache__ .pytest_cache/.
  • Some tests maybe require a lot of resources (CPU, RAM, etc.). Better not try large tests like test_cluster_copier or test_distributed_ddl* on your laptop.

You can run tests via ./runner script and pass pytest arguments as last arg:

$ ./runner --binary $HOME/ClickHouse/programs/clickhouse  --bridge-binary $HOME/ClickHouse/programs/clickhouse-odbc-bridge --configs-dir $HOME/ClickHouse/programs/server/ 'test_odbc_interaction -ss'
Start tests
============================= test session starts ==============================
platform linux2 -- Python 2.7.15rc1, pytest-4.0.0, py-1.7.0, pluggy-0.8.0
rootdir: /ClickHouse/tests/integration, inifile: pytest.ini
collected 6 items

test_odbc_interaction/test.py Removing network clickhouse_default
...

Killing roottestodbcinteraction_node1_1     ... done
Killing roottestodbcinteraction_mysql1_1    ... done
Killing roottestodbcinteraction_postgres1_1 ... done
Removing roottestodbcinteraction_node1_1     ... done
Removing roottestodbcinteraction_mysql1_1    ... done
Removing roottestodbcinteraction_postgres1_1 ... done
Removing network roottestodbcinteraction_default

==================== 6 passed, 1 warnings in 95.21 seconds =====================

Path to binary and configs maybe specified via env variables:

$ export CLICKHOUSE_TESTS_BASE_CONFIG_DIR=$HOME/ClickHouse/programs/server/
$ export CLICKHOUSE_TESTS_SERVER_BIN_PATH=$HOME/ClickHouse/programs/clickhouse
$ export CLICKHOUSE_TESTS_ODBC_BRIDGE_BIN_PATH=$HOME/ClickHouse/programs/clickhouse-odbc-bridge
$ ./runner 'test_odbc_interaction'
$ # or ./runner '-v -ss'
Start tests
============================= test session starts ==============================
platform linux2 -- Python 2.7.15rc1, pytest-4.0.0, py-1.7.0, pluggy-0.8.0
rootdir: /ClickHouse/tests/integration, inifile: pytest.ini
collected 6 items

test_odbc_interaction/test.py ......                                     [100%]
==================== 6 passed, 1 warnings in 96.33 seconds =====================

You can just open shell inside a container by overwritting the command: ./runner --command=bash

Rebuilding the docker containers

The main container used for integration tests lives in docker/test/integration/Dockerfile. Rebuild it with

cd docker/test/integration
docker build -t yandex/clickhouse-integration-test .

The helper container used by the runner script is in docker/test/integration/runner/Dockerfile.

Adding new tests

To add new test named foo, create a directory test_foo with an empty __init__.py and a file named test.py containing tests in it. All functions with names starting with test will become test cases.

helpers directory contains utilities for:

  • Launching a ClickHouse cluster with or without ZooKeeper in docker containers.
  • Sending queries to launched instances.
  • Introducing network failures such as severing network link between two instances.

To assert that two TSV files must be equal, wrap them in the TSV class and use the regular assert statement. Example: assert TSV(result) == TSV(reference). In case the assertion fails, pytest will automagically detect the types of variables and only the small diff of two files is printed.