thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-26 17:41:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
f6c72f8e56
ClickHouse/dbms/tests/integration
History
Alexey Zatelepin f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations 
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
..
helpers delete unused space 2018-05-15 03:02:59 +03:00
test_cluster_copier Better configs for an integration test. [#CLICKHOUSE-2] 2018-05-15 21:25:54 +03:00
test_cross_replication cosmetics [#CLICKHOUSE-1979] 2017-06-16 21:35:49 +03:00
test_delayed_replica_failover fix test to conform to the new GROUP BY behaviour on empty tables 2018-03-07 18:09:26 +00:00
test_dictionaries added test for Dictionary(range_hashed) [#CLICKHOUSE-3521] 2017-12-25 23:55:45 +03:00
test_distributed_ddl Support allow_databases in distributed DDL. [#CLICKHOUSE-3] 2018-04-17 22:33:58 +03:00
test_extreme_deduplication Add integration test. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
test_graphite_merge_tree Fixed nondeterministic merge in GraphiteMergeTree. [#CLICKHOUSE-2860] 2018-01-18 23:30:03 +03:00
test_insert_into_distributed added tests [#CLICKHOUSE-3245] 2017-08-23 15:44:18 +03:00
test_insert_into_distributed_sync_async Rewritten and improved sync distributed insert. [#CLICKHOUSE-3346] 2018-02-19 20:26:47 +03:00
test_merge_table_over_distributed Fixed Illegal PREWHERE error for Merge tables over Distributed. [#CLICKHOUSE-3637] 2018-03-12 18:14:26 +03:00
test_random_inserts add test with inserts into Replicated tables from multiple threads [#CLICKHOUSE-3732] 2018-05-25 23:04:04 +03:00
test_server_initialization attempt to fix integration tests 2017-07-11 20:56:17 +03:00
test_storage_mysql add integration test_storage_mysql 2018-05-15 03:02:59 +03:00
test_system_queries Do not save resolved addresses in Connections. [#CLICKHOSUE-2] 2018-05-09 07:55:08 +03:00
test_zookeeper_config Merge pull request #1750 from yandex/CLICKHOUSE-3346 2018-01-31 13:21:51 +03:00
.gitignore Fix trying to load database.sql from incorrect path. [#CLICKHOUSE-3044] 2017-06-16 19:08:24 +03:00
conftest.py ClickHouse integration tests. [#CLICKHOUSE-2821] 2017-05-22 17:56:41 +04:00
pytest.ini ClickHouse integration tests. [#CLICKHOUSE-2821] 2017-05-22 17:56:41 +04:00
README.md Compile and doc fixes (#2410) 2018-05-25 21:13:48 +03:00

README.md

ClickHouse integration tests

This directory contains tests that involve several ClickHouse instances, custom configs, ZooKeeper, etc.

Running

Prerequisites:

  • Ubuntu 14.04 (Trusty) or higher.
  • docker. Minimum required API version: 1.25, check with docker version.

You must install latest Docker from https://docs.docker.com/engine/installation/linux/docker-ce/ubuntu/#set-up-the-repository Don't use Docker from your system repository.

  • pip. To install: sudo apt-get install python-pip
  • py.test testing framework. To install: sudo -H pip install pytest
  • docker-compose and additional python libraries. To install: sudo -H pip install docker-compose docker dicttoxml kazoo PyMySQL

If you want install on modern debian/ubuntu: sudo apt install -y docker docker-compose python-pytest python-dicttoxml python-docker python-pymysql python-kazoo

If you want to run the tests under a non-privileged user, you must add this user to docker group: sudo usermod -aG docker $USER and re-login. (You must close all your sessions (for example, restart your computer)) To check, that you have access to Docker, run docker ps.

Run the tests with the pytest command. To select which tests to run, use: pytest -k <test_name_pattern>

By default tests are run with system-wide client binary, server binary and base configs. To change that, set the following environment variables:

  • CLICKHOUSE_TESTS_SERVER_BIN_PATH to choose the server binary.
  • CLICKHOUSE_TESTS_CLIENT_BIN_PATH to choose the client binary.
  • CLICKHOUSE_TESTS_BASE_CONFIG_DIR to choose the directory from which base configs (config.xml and users.xml) are taken.

Adding new tests

To add new test named foo, create a directory test_foo with an empty __init__.py and a file named test.py containing tests in it. All functions with names starting with test will become test cases.

helpers directory contains utilities for:

  • Launching a ClickHouse cluster with or without ZooKeeper indocker containers.
  • Sending queries to launched instances.
  • Introducing network failures such as severing network link between two instances.

To assert that two TSV files must be equal, wrap them in the TSV class and use the regular assert statement. Example: assert TSV(result) == TSV(reference). In case the assertion fails, pytest will automagically detect the types of variables and only the small diff of two files is printed.