ClickHouse/tests/integration
Alexander Tokmakov 54a82072e7
Update test.py
2023-08-09 15:06:31 +03:00
..
helpers increase election timeout in integration tests (#53052) 2023-08-07 14:48:52 +03:00
test_access_control_on_cluster Fix integration tests 2023-02-28 13:36:52 +01:00
test_access_for_functions
test_aggregation_memory_efficient
test_allowed_client_hosts
test_allowed_url_from_config
test_alter_codec
test_alter_moving_garbage Retry blob listing in test_alter_moving_garbage 2023-07-17 09:55:12 +00:00
test_alter_on_mixed_type_cluster
test_alter_settings_on_cluster
test_alter_update_cast_keep_nullable
test_alternative_keeper_config replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
test_always_fetch_merged
test_async_connect_to_multiple_ips Fix style 2023-07-07 14:39:11 +00:00
test_async_insert_memory Automatic style fix 2023-05-07 02:00:24 +00:00
test_asynchronous_metric_log_table
test_atomic_drop_table
test_attach_backup_from_s3_plain Simplify ATTACH MergeTree table FROM S3 in tests 2023-02-11 08:46:05 +01:00
test_attach_partition_with_large_destination
test_attach_table_normalizer Automatic style fix 2023-06-28 03:40:09 +00:00
test_attach_without_checksums
test_attach_without_fetching
test_authentication
test_azure_blob_storage_zero_copy_replication Update integration tests (1/2) 2023-05-11 04:26:29 +02:00
test_backup_restore Deprecate in-memory parts 2023-05-03 00:31:09 +02:00
test_backup_restore_new Update test.py 2023-08-02 13:24:05 +02:00
test_backup_restore_on_cluster Automatic style fix 2023-07-27 21:07:54 +00:00
test_backup_restore_s3 Fix tests. 2023-08-03 13:52:35 +02:00
test_backup_restore_storage_policy Extend the set of test cases in the integration test 2023-08-01 15:44:43 +03:00
test_backup_s3_storage_class Remove logging from test 2023-07-26 07:51:26 +00:00
test_backward_compatibility Fix a test 2023-07-24 05:56:18 +02:00
test_block_structure_mismatch
test_broken_detached_part_clean_up more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
test_broken_part_during_merge more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
test_buffer_profile
test_catboost_evaluate Fix expected results 2023-03-25 18:06:03 +00:00
test_cgroup_limit Improve logging in integration/test_cgroup_limit 2023-06-28 22:19:42 +02:00
test_check_table Automatic style fix 2023-05-07 02:00:24 +00:00
test_checking_s3_blobs_paranoid add test with broken pipe 2023-07-28 00:24:05 +04:00
test_cleanup_after_start
test_cleanup_dir_after_bad_zk_conn
test_cluster_all_replicas
test_cluster_copier Automatic style fix 2023-03-25 18:26:36 +00:00
test_cluster_discovery Automatic style fix 2023-05-07 02:00:24 +00:00
test_codec_encrypted
test_composable_protocols Automatic style fix 2023-03-25 18:26:36 +00:00
test_compressed_marks_restart
test_compression_codec_read Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_compression_nested_columns
test_concurrent_backups_s3 replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
test_concurrent_queries_for_all_users_restriction
test_concurrent_queries_for_user_restriction
test_concurrent_queries_restriction_by_query_kind Fix flaky test_concurrent_queries_restriction_by_query_kind 2023-02-25 22:23:29 +01:00
test_concurrent_threads_soft_limit
test_concurrent_ttl_merges Remove assertion from test_no_ttl_merges_in_busy_pool 2023-08-03 14:25:37 +02:00
test_config_corresponding_root Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_config_decryption Follow-up to "Implement support of encrypted elements in configuration file" 2023-07-26 13:27:13 +00:00
test_config_substitutions
test_config_xml_full Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_config_xml_main Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_config_xml_yaml_mix Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_config_yaml_full Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_config_yaml_main Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_consistant_parts_after_move_partition Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-06-17 22:19:21 +03:00
test_consistent_parts_after_clone_replica better scheduling of merge selecting task 2023-05-23 01:25:17 +02:00
test_crash_log Update test.py 2023-07-31 16:55:51 +03:00
test_create_query_constraints Automatic style fix 2023-03-25 18:26:36 +00:00
test_create_user_and_login Automatic style fix 2023-01-11 10:09:43 +01:00
test_cross_replication
test_custom_settings
test_ddl_alter_query
test_ddl_worker_non_leader
test_default_compression_codec Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_default_database_on_cluster
test_default_role
test_delayed_replica_failover
test_detached_parts_metrics
test_dictionaries_access Revert "Check simple dictionary key is native unsigned integer" 2023-04-13 01:32:19 +03:00
test_dictionaries_all_layouts_separate_sources Fix style 2023-04-26 19:36:34 +00:00
test_dictionaries_complex_key_cache_string
test_dictionaries_config_reload
test_dictionaries_ddl Revert "Check simple dictionary key is native unsigned integer" 2023-04-13 01:32:19 +03:00
test_dictionaries_dependency Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_dictionaries_dependency_xml Revert "Check simple dictionary key is native unsigned integer" 2023-04-13 01:32:19 +03:00
test_dictionaries_mysql Fix black check 2023-06-09 13:13:33 +02:00
test_dictionaries_null_value
test_dictionaries_postgresql Fix tests 2023-06-08 20:30:34 +02:00
test_dictionaries_redis
test_dictionaries_select_all
test_dictionaries_update_and_reload
test_dictionaries_with_invalid_structure [rev 2] Fix review notes 2023-01-20 09:37:49 +03:00
test_dictionary_allow_read_expired_keys
test_dictionary_custom_settings Automatic style fix 2023-08-03 12:55:27 +00:00
test_dictionary_ddl_on_cluster
test_disabled_access_control_improvements
test_disabled_mysql_server
test_disk_access_storage
test_disk_configuration replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
test_disk_over_web_server Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_disk_types
test_disks_app_func Automatic style fix 2023-03-25 18:26:36 +00:00
test_distributed_backward_compatability Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_distributed_ddl Add allow_distributed_ddl_queries option to the cluster config 2023-03-29 18:15:46 +03:00
test_distributed_ddl_on_cross_replication
test_distributed_ddl_parallel Automatic style fix 2023-03-25 18:26:36 +00:00
test_distributed_ddl_password
test_distributed_default_database
test_distributed_directory_monitor_split_batch_on_failure Fix possible double-free in Aggregator (#52439) 2023-07-26 13:15:58 +02:00
test_distributed_format
test_distributed_insert_backward_compatibility Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_distributed_inter_server_secret Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_distributed_load_balancing Simplify obtaining query shard in test_distributed_load_balancing 2023-05-19 06:07:58 +02:00
test_distributed_over_distributed
test_distributed_respect_user_timeouts Fix more tests 2023-03-15 12:18:33 +00:00
test_distributed_storage_configuration Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_distributed_system_query
test_distributed_type_object
test_dns_cache Add tests 2023-07-15 08:18:35 +03:00
test_dotnet_client
test_drop_is_lock_free Fix test 2023-07-24 18:13:15 +02:00
test_drop_no_local_path Add timeout 2023-01-30 17:02:58 +01:00
test_drop_replica more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
test_drop_replica_with_auxiliary_zookeepers Implement SYSTEM DROP REPLICA from auxillary ZooKeeper clusters (#48932) 2023-05-05 14:11:11 +03:00
test_enabling_access_management
test_encrypted_disk Add config param allow_remove_stale_moving_parts 2023-06-08 10:17:02 +00:00
test_encrypted_disk_replication replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
test_endpoint_macro_substitution Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_executable_dictionary Report loading status for executable dictionaries correctly 2023-06-22 10:28:13 +00:00
test_executable_table_function
test_executable_user_defined_function
test_executable_user_defined_functions_config_reload
test_explain_estimates
test_extreme_deduplication Merge branch 'master' into fix-test_extreme_deduplication 2023-07-16 00:05:40 +03:00
test_failed_async_inserts replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
test_fetch_memory_usage Automatic style fix 2023-03-25 18:26:36 +00:00
test_fetch_partition_from_auxiliary_zookeeper
test_fetch_partition_should_reset_mutation
test_fetch_partition_with_outdated_parts
test_file_schema_inference_cache
test_filesystem_layout Fix flaky test 2023-03-06 13:06:31 +01:00
test_force_deduplication
test_force_drop_table
test_format_avro_confluent test_for_basic_auth_registry: some comments removed per code review 2023-07-19 08:32:45 +00:00
test_format_schema_on_server
test_freeze_table
test_global_overcommit_tracker Fix integration tests 2023-02-28 13:36:52 +01:00
test_globs_in_filepath
test_grant_and_revoke Add system stop pulling replication log (#52881) 2023-08-03 13:34:43 +03:00
test_graphite_merge_tree
test_graphite_merge_tree_typed
test_groupBitmapAnd_on_distributed Automatic style fix 2023-08-07 15:49:34 +00:00
test_grpc_protocol Support hardlinking parts transactionally 2023-05-18 21:05:56 -07:00
test_grpc_protocol_ssl Support hardlinking parts transactionally 2023-05-18 21:05:56 -07:00
test_hedged_requests Automatic style fix 2023-06-30 10:14:39 +00:00
test_hedged_requests_parallel Automatic style fix 2023-06-30 10:14:39 +00:00
test_hive_query
test_host_regexp_hosts_file_resolution Scratch the strange Python code (#51302) 2023-06-23 13:47:37 +02:00
test_host_regexp_multiple_ptr_records Update test.py 2023-08-09 15:06:31 +03:00
test_http_and_readonly
test_http_failover Add tests 2023-07-15 08:18:35 +03:00
test_http_handlers_config fix black 2023-03-02 14:23:22 +01:00
test_http_native Add raw content option to http helper methods 2023-02-15 07:17:28 -07:00
test_https_replication Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_inherit_multiple_profiles
test_input_format_parallel_parsing_memory_tracking
test_insert_distributed_async_extra_dirs
test_insert_distributed_async_send
test_insert_distributed_load_balancing
test_insert_into_distributed fix 2023-02-25 01:18:34 +01:00
test_insert_into_distributed_sync_async
test_insert_into_distributed_through_materialized_view
test_inserts_with_keeper_retries Fix integration tests 2023-03-28 10:46:22 +02:00
test_interserver_dns_retires
test_jbod_balancer more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
test_jbod_ha more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
test_jbod_load_balancing
test_jdbc_bridge
test_jemalloc_percpu_arena Fix test_jemalloc_percpu_arena after upgrade 2023-06-28 22:19:40 +02:00
test_join_set_family_s3
test_kafka_bad_messages Fix style 2023-02-27 13:01:07 +00:00
test_keeper_and_access_storage Automatic style fix 2023-03-25 18:26:36 +00:00
test_keeper_auth tests: more fixes for test_keeper_auth 2022-12-29 09:29:24 +01:00
test_keeper_back_to_back Automatic style fix 2023-03-25 18:26:36 +00:00
test_keeper_client Revert "Implementing new commands for keeper-client" 2023-08-03 15:05:52 +03:00
test_keeper_disks Fix unspported disks in Keeper 2023-07-19 12:41:25 +00:00
test_keeper_feature_flags_config Use magic_enum for values 2023-06-28 07:45:20 +00:00
test_keeper_force_recovery Make test_keeper_force_recovery more stable 2023-07-21 11:16:02 +00:00
test_keeper_force_recovery_single_node Make test_keeper_force_recovery more stable 2023-07-21 11:16:02 +00:00
test_keeper_four_word_command Print Zxid in keeper stat command in hex (so as ZooKeeper) 2023-07-14 21:17:09 +02:00
test_keeper_incorrect_config
test_keeper_internal_secure
test_keeper_map Add retries and iptables rules dump 2023-07-04 09:31:15 +00:00
test_keeper_mntr_data_size less flaky test_keeper_mntr_data_size 2023-04-04 12:56:39 +00:00
test_keeper_mntr_pressure
test_keeper_multinode_simple
test_keeper_nodes_add Fix tests 2023-03-23 15:01:51 +00:00
test_keeper_nodes_move "reconfig" support for CH Keeper 2023-07-07 00:20:54 +03:00
test_keeper_nodes_remove
test_keeper_persistent_log Automatic style fix 2023-03-25 18:26:36 +00:00
test_keeper_persistent_log_multinode
test_keeper_reconfig_add try updating tests to wait for cluster configs to come in sync 2023-07-07 00:20:54 +03:00
test_keeper_reconfig_remove try updating tests to wait for cluster configs to come in sync 2023-07-07 00:20:54 +03:00
test_keeper_reconfig_remove_many try updating tests to wait for cluster configs to come in sync 2023-07-07 00:20:54 +03:00
test_keeper_reconfig_replace_leader Fix test_keeper_reconfig_replace_leader 2023-07-27 10:36:02 +00:00
test_keeper_reconfig_replace_leader_in_one_command Automatic style fix 2023-08-02 06:40:32 +00:00
test_keeper_restore_from_snapshot Add test for s3 disk restore 2023-05-25 16:01:40 +00:00
test_keeper_s3_snapshot Fix flakiness of test_keeper_s3_snapshot 2023-07-13 14:25:24 +02:00
test_keeper_secure_client
test_keeper_session Automatic style fix 2023-07-20 14:11:11 +00:00
test_keeper_snapshot_on_exit
test_keeper_snapshot_small_distance Retry on invalid snapshot 2023-01-07 17:08:25 +00:00
test_keeper_snapshots Fix flaky test_keeper_snapshots 2023-04-05 08:56:01 +00:00
test_keeper_snapshots_multinode
test_keeper_three_nodes_start
test_keeper_three_nodes_two_alive Don't allow third node to become leader 2023-01-12 08:44:55 +00:00
test_keeper_two_nodes_cluster
test_keeper_znode_time
test_keeper_zookeeper_converter Merge branch 'master' into alternative-keeper-configs 2023-03-27 10:00:21 +02:00
test_kerberos_auth Scratch the strange Python code (#51302) 2023-06-23 13:47:37 +02:00
test_library_bridge Automatic style fix 2023-01-02 13:38:18 +00:00
test_limited_replicated_fetches
test_log_family_hdfs
test_log_family_s3
test_log_levels_update checker fix 2023-03-02 14:31:38 +00:00
test_log_lz4_streaming docs for logger stream_compression 2023-02-10 09:02:54 -05:00
test_log_query_probability
test_logs_level
test_lost_part Automatic style fix 2023-07-17 12:09:36 +00:00
test_lost_part_during_startup fix 2023-06-15 15:05:17 +02:00
test_mask_sensitive_info Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_match_process_uid_against_data_owner
test_materialized_mysql_database MaterializedMySQL: Add tests to alter named collections 2023-08-04 11:50:53 +02:00
test_materialized_view_restart_server
test_max_http_connections_for_replication
test_max_rows_to_read_leaf_with_view Add a test to check max_rows_to_read_leaf behaviour 2023-05-03 08:47:37 +01:00
test_max_suspicious_broken_parts
test_memory_profiler_min_max_borders Disable test for sanitizers 2023-07-30 14:15:17 +02:00
test_MemoryTracking
test_merge_table_over_distributed Fix integration test 2023-01-17 13:12:52 +00:00
test_merge_tree_azure_blob_storage Automatic style fix 2023-08-01 10:57:46 +00:00
test_merge_tree_check_part_with_cache fix test 2023-06-21 11:07:19 +00:00
test_merge_tree_empty_parts fix 2023-05-23 20:45:16 +02:00
test_merge_tree_hdfs Merge branch 'master' into sparse-columns-by-default 2023-07-18 01:36:52 +02:00
test_merge_tree_load_parts fix 2023-06-15 18:37:45 +02:00
test_merge_tree_s3 Relax flaky test 2023-08-07 12:59:25 +02:00
test_merge_tree_s3_failover Automatic style fix 2023-07-18 23:25:21 +00:00
test_merge_tree_s3_with_cache replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
test_merge_tree_settings_constraints Automatic style fix 2023-03-25 18:26:36 +00:00
test_merges_memory_limit Update test 2023-05-03 01:33:26 +02:00
test_move_partition_to_disk_on_cluster Add config param allow_remove_stale_moving_parts 2023-06-08 10:17:02 +00:00
test_multiple_disks Automatic style fix 2023-08-07 10:31:41 +00:00
test_mutation_fetch_fallback
test_mutations_hardlinks
test_mutations_in_partitions_of_merge_tree
test_mutations_with_merge_tree
test_mutations_with_projection
test_mysql_database_engine Fix for postgres as well 2023-08-03 09:15:45 +00:00
test_mysql_protocol fixed tests 2023-08-01 13:34:19 +00:00
test_named_collections Fix tests 2023-06-08 20:30:34 +02:00
test_named_collections_if_exists_on_cluster Reformat the previously added test with black 2023-07-30 09:42:57 +03:00
test_non_default_compression Fix black 2023-06-10 12:09:47 +00:00
test_odbc_interaction Make psql tests in test_odbc_interaction more robust to other test failures 2023-07-18 12:22:28 +02:00
test_old_parts_finally_removed more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
test_old_versions Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_on_cluster_timeouts Update some tests 2023-07-04 21:19:30 +02:00
test_optimize_on_insert
test_overcommit_tracker Fix integration tests 2023-02-28 13:36:52 +01:00
test_parallel_replicas_custom_key Automatic style fix 2023-03-03 15:25:25 +00:00
test_part_log_table Adjust test_mysql_protocol and others for analyzer 2023-03-22 08:59:04 +01:00
test_part_uuid Remove a test 2023-05-05 06:43:21 +02:00
test_partition Update more tests 2023-07-18 01:50:43 +02:00
test_parts_delete_zookeeper more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
test_passing_max_partitions_to_read_remotely
test_password_constraints Better 2023-04-21 22:03:56 +00:00
test_polymorphic_parts Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_postgresql_database_engine fix pg integration test 2023-08-03 21:05:31 +08:00
test_postgresql_protocol The error is changed in psycopg2=2.9.6 2023-06-28 22:19:40 +02:00
test_postgresql_replica_database_engine_1 Fix tests 2023-07-17 15:01:58 +02:00
test_postgresql_replica_database_engine_2 Fix style check 2023-07-18 16:54:33 +02:00
test_profile_events_s3 Update test.py 2023-06-26 15:44:30 +02:00
test_profile_max_sessions_for_user Merge branch 'master' into ADQM-1011 2023-08-05 20:35:45 +10:00
test_profile_settings_and_constraints_order
test_prometheus_endpoint
test_quorum_inserts Fix flaky test test_drop_replica_and_achieve_quorum 2023-04-11 14:11:24 +02:00
test_quorum_inserts_parallel Automatic style fix 2023-07-04 19:32:43 +00:00
test_quota
test_random_inserts
test_range_hashed_dictionary_types
test_read_only_table Automatic style fix 2023-03-25 18:26:36 +00:00
test_read_temporary_tables_on_failure Automatic style fix 2023-07-04 19:32:43 +00:00
test_recompression_ttl
test_recovery_replica more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
test_redirect_url_storage Fix tests 2023-06-15 12:33:24 +02:00
test_relative_filepath
test_reload_auxiliary_zookeepers Automatic style fix 2023-03-25 18:26:36 +00:00
test_reload_certificate
test_reload_clusters_config Fix style 2023-05-24 14:40:27 +02:00
test_reload_max_table_size_to_drop
test_reload_zookeeper
test_reloading_settings_from_users_xml Extend support for aliases to constraints and profiles 2023-01-27 09:39:10 +00:00
test_reloading_storage_configuration
test_remote_prewhere
test_rename_column Update some tests 2023-07-04 21:19:30 +02:00
test_render_log_file_name_templates Refine the integration test code 2023-07-07 15:16:10 +08:00
test_replace_partition
test_replica_can_become_leader
test_replica_is_active
test_replicated_database Allow experimantal features when recovering Replicated db replica (#53167) 2023-08-09 14:35:50 +03:00
test_replicated_fetches_bandwidth Fix per-query IO/BACKUPs throttling settings (when default profile has them) 2023-05-17 12:12:39 +02:00
test_replicated_fetches_timeouts
test_replicated_merge_tree_compatibility Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_replicated_merge_tree_config
test_replicated_merge_tree_encrypted_disk Done 2023-07-20 16:43:59 +00:00
test_replicated_merge_tree_encryption_codec replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
test_replicated_merge_tree_hdfs_zero_copy Add config param allow_remove_stale_moving_parts 2023-06-08 10:17:02 +00:00
test_replicated_merge_tree_s3 Update more tests 2023-07-18 01:56:38 +02:00
test_replicated_merge_tree_s3_zero_copy Update more tests 2023-07-18 01:56:38 +02:00
test_replicated_merge_tree_wait_on_shutdown Update test.py 2023-07-26 00:01:46 +03:00
test_replicated_merge_tree_with_auxiliary_zookeepers replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
test_replicated_mutations Fix integration tests 2023-07-18 22:13:28 +02:00
test_replicated_parse_zk_metadata
test_replicated_table_attach Fix test_replicated_table_attach 2023-07-06 03:16:06 +02:00
test_replicated_user_defined_functions Allow start without ZooKeeper. 2023-03-23 02:47:50 +01:00
test_replicated_users Fix integration test test_replicated_users::test_rename_replicated (#45192) 2023-01-12 12:36:36 +01:00
test_replicating_constants Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_replication_credentials
test_replication_without_zookeeper
test_restart_server
test_restore_replica Update test.py 2023-08-07 16:58:59 +03:00
test_reverse_dns_query Update test.py (#53195) 2023-08-09 12:53:05 +03:00
test_rocksdb_options
test_rocksdb_read_only
test_role orphaned role - expiration_time => expiration_time_seconds 2023-03-21 08:44:08 +01:00
test_row_policy Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_s3_aws_sdk_has_slightly_unreliable_behaviour Automatic style fix 2023-03-25 18:26:36 +00:00
test_s3_cluster Fix tests 2023-06-15 12:33:24 +02:00
test_s3_imds Add test for IMDS session token. 2023-01-06 15:55:26 +01:00
test_s3_low_cardinality_right_border Automatic style fix 2023-01-03 18:29:09 +00:00
test_s3_storage_class fix 2023-01-05 09:09:42 +08:00
test_s3_table_functions Fix tests 2023-07-04 12:42:27 +02:00
test_s3_with_https replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
test_s3_with_proxy replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
test_s3_zero_copy_replication Merge branch 'master' into sparse-columns-by-default 2023-07-18 01:36:52 +02:00
test_s3_zero_copy_ttl Update more tests 2023-07-18 01:56:38 +02:00
test_secure_socket Automatic style fix 2023-06-30 10:14:39 +00:00
test_select_access_rights fixed tests 2023-08-01 13:34:19 +00:00
test_send_crash_reports
test_send_request_to_leader_replica
test_server_initialization Fix error found by AST Fuzzer 2023-05-06 00:55:56 +02:00
test_server_reload Support hardlinking parts transactionally 2023-05-18 21:05:56 -07:00
test_server_start_and_ip_conversions
test_session_log Reduced test flakiness 2023-08-04 06:09:29 +00:00
test_settings_constraints Extend support for aliases to constraints and profiles 2023-01-27 09:39:10 +00:00
test_settings_constraints_distributed Fix integration tests 2023-02-28 13:36:52 +01:00
test_settings_profile Automatic style fix 2023-01-27 09:46:51 +00:00
test_shard_level_const_function
test_sharding_key_from_default_column fix an unrelated flaky test 2023-03-23 13:48:02 +01:00
test_shutdown_wait_unfinished_queries Automatic style fix 2023-07-18 20:23:55 +00:00
test_sql_user_defined_functions_on_cluster
test_ssl_cert_authentication Automatic style fix 2023-07-31 05:39:49 +00:00
test_storage_azure_blob_storage Automatic style fix 2023-08-07 13:04:51 +00:00
test_storage_delta Fix tests 2023-06-14 13:45:53 +02:00
test_storage_dict Fix tests 2023-07-03 14:51:19 +02:00
test_storage_hdfs Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
test_storage_hudi Merge remote-tracking branch 'upstream/master' into add-separate-access-for-use-named-collections 2023-07-03 13:55:45 +02:00
test_storage_iceberg Fix tests 2023-06-14 13:45:53 +02:00
test_storage_kafka Merge branch 'master' into support-predefined-macro-in-kafka-settings 2023-07-29 15:00:21 +04:00
test_storage_kerberized_hdfs impl 2023-05-02 22:07:30 +00:00
test_storage_kerberized_kafka Fixed the integration test failures related with HDFS and KAFKA 2023-03-08 06:11:17 -08:00
test_storage_meilisearch Fix 2023-06-15 14:25:10 +02:00
test_storage_mongodb Merge branch 'master' into fix-mongodb-inserts 2023-07-16 01:47:52 +03:00
test_storage_mysql Fix tests 2023-06-08 20:30:34 +02:00
test_storage_nats more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
test_storage_policies
test_storage_postgresql Merge remote-tracking branch 'upstream/master' into add-separate-access-for-use-named-collections 2023-07-03 13:55:45 +02:00
test_storage_postgresql_replica Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
test_storage_rabbitmq Merge remote-tracking branch 'upstream/master' into add-separate-access-for-use-named-collections 2023-07-03 13:55:45 +02:00
test_storage_redis fix code style 2023-06-02 10:05:54 +08:00
test_storage_s3 Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
test_storage_s3_queue Fix 2023-08-02 17:09:47 +02:00
test_storage_url Cleanup remote_servers in dist config.xml 2023-07-09 16:55:27 +02:00
test_storage_url_http_headers Pass headers from StorageURL to WriteBufferFromHTTP (#46996) 2023-03-03 13:55:52 +01:00
test_structured_logging_json
test_system_clusters_actual_information Change default value of handshake_timeout to 10 sec, fix possible use-after-free 2023-05-23 11:39:40 +00:00
test_system_ddl_worker_queue
test_system_flush_logs System logs improvements 2023-07-28 07:23:34 +00:00
test_system_logs System logs improvements 2023-07-28 07:23:34 +00:00
test_system_logs_comment
test_system_logs_recreate Add <storage_policy> config parameter for system logs 2023-01-19 10:25:28 +01:00
test_system_merges Automatic style fix 2023-05-07 02:00:24 +00:00
test_system_metrics more flexible cleanup thread scheduling 2023-05-22 19:07:18 +02:00
test_system_queries
test_system_replicated_fetches suppress test_system_replicated_fetches 2023-04-17 16:58:36 +02:00
test_system_start_stop_listen Fix style 2023-07-27 14:18:46 +00:00
test_table_function_mongodb Fix tests 2023-06-08 20:30:34 +02:00
test_table_function_redis fix merged error 2023-06-02 10:05:54 +08:00
test_table_functions_access_rights
test_tcp_handler_http_responses
test_tcp_handler_interserver_listen_host Merge pull request #42991 from ClickHouse/tests-connection-error 2023-01-12 08:32:03 -05:00
test_temporary_data Fix temp data deletion on startup, add test 2023-07-18 16:29:21 +00:00
test_temporary_data_in_cache upd test_temporary_data_in_cache 2023-08-03 10:32:48 +00:00
test_text_log_level
test_throttling Add comment 2023-07-24 12:02:27 +02:00
test_timezone_config
test_tlsv1_3 Automatic style fix 2023-07-31 05:39:49 +00:00
test_tmp_policy
test_transactions don't create empty parts on drop partittion if we have a transaction (#52945) 2023-08-03 13:16:32 +03:00
test_ttl_move Add config param allow_remove_stale_moving_parts 2023-06-08 10:17:02 +00:00
test_ttl_replicated Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_undrop_query support undrop table 2023-03-27 22:16:36 +08:00
test_union_header
test_user_defined_object_persistence
test_user_directories
test_user_grants_from_config Specify roles in users.xml 2023-05-30 20:42:49 -04:00
test_user_ip_restrictions
test_user_zero_database_access
test_version_update Analyzer: do not enable it for old servers in tests 2023-08-04 14:16:33 +00:00
test_version_update_after_mutation Merge branch 'master' into analyzer-fix-integration 2023-08-08 16:13:44 +02:00
test_zero_copy_fetch Fix a test 2023-07-22 02:27:07 +02:00
test_zero_copy_replication_drop_detached_part Automatic style fix 2023-04-17 16:17:02 +00:00
test_zookeeper_config Fix test_zookeeper_config (#52988) 2023-08-04 17:18:50 +03:00
test_zookeeper_config_load_balancing
test_zookeeper_fallback_session Introduce fallback ZooKeeper sessions 2023-07-28 11:43:27 +00:00
.dockerignore
.gitignore
ci-runner.py Merge pull request #51843 from ClickHouse/kssenii-nginx 2023-08-01 11:36:20 +02:00
CMakeLists.txt What happens if I remove 156 lines of code? 2023-01-03 18:51:16 +00:00
conftest.py Update conftest.py (#53166) 2023-08-08 22:23:18 +03:00
parallel_skip.json fix json 2023-08-02 00:36:25 +00:00
parallel.readme
pytest.ini Update integration tests runner too 2023-06-28 22:19:32 +02:00
README.md
runner Sort DOCKER_*_TAG stuff 2023-07-22 15:45:47 +02:00

ClickHouse integration tests

This directory contains tests that involve several ClickHouse instances, custom configs, ZooKeeper, etc.

Running natively

Prerequisites:

  • Ubuntu 20.04 (Focal) or higher.
  • docker. Minimum required API version: 1.25, check with docker version.

You must install latest Docker from https://docs.docker.com/engine/installation/linux/docker-ce/ubuntu/#set-up-the-repository Don't use Docker from your system repository.

  • pip and libpq-dev. To install: sudo apt-get install python3-pip libpq-dev zlib1g-dev libcrypto++-dev libssl-dev libkrb5-dev python3-dev
  • py.test testing framework. To install: sudo -H pip install pytest
  • docker-compose and additional python libraries. To install:
sudo -H pip install \
    PyMySQL \
    aerospike \
    avro \
    cassandra-driver \
    confluent-kafka \
    dicttoxml \
    docker \
    docker-compose \
    grpcio \
    grpcio-tools \
    kafka-python \
    kazoo \
    minio \
    lz4 \
    protobuf \
    psycopg2-binary \
    pymongo \
    pytz \
    pytest \
    pytest-timeout \
    redis \
    tzlocal==2.1 \
    urllib3 \
    requests-kerberos \
    dict2xml \
    hypothesis \
    pyhdfs \
    pika \
    meilisearch \
    nats-py

(highly not recommended) If you really want to use OS packages on modern debian/ubuntu instead of "pip": sudo apt install -y docker docker-compose python3-pytest python3-dicttoxml python3-docker python3-pymysql python3-protobuf python3-pymongo python3-tzlocal python3-kazoo python3-psycopg2 kafka-python python3-pytest-timeout python3-minio

If you want to run the tests under a non-privileged user, you must add this user to docker group: sudo usermod -aG docker $USER and re-login. (You must close all your sessions (for example, restart your computer)) To check, that you have access to Docker, run docker ps.

Run the tests with the pytest command. To select which tests to run, use: pytest -k <test_name_pattern>

By default tests are run with system-wide client binary, server binary and base configs. To change that, set the following environment variables:

  • CLICKHOUSE_TESTS_SERVER_BIN_PATH to choose the server binary.
  • CLICKHOUSE_TESTS_CLIENT_BIN_PATH to choose the client binary.
  • CLICKHOUSE_TESTS_BASE_CONFIG_DIR to choose the directory from which base configs (config.xml andusers.xml) are taken.

Please note that if you use separate build (ENABLE_CLICKHOUSE_ALL=OFF), you need to build different components, including but not limited to ENABLE_CLICKHOUSE_LIBRARY_BRIDGE=ON ENABLE_CLICKHOUSE_ODBC_BRIDGE=ON ENABLE_CLICKHOUSE_KEEPER=ON. So it is easier to use ENABLE_CLICKHOUSE_ALL=ON

For tests that use common docker compose files you may need to set up their path with environment variable: DOCKER_COMPOSE_DIR=$HOME/ClickHouse/docker/test/integration/runner/compose

Running with runner script

The only requirement is fresh configured docker and docker pull clickhouse/integration-tests-runner

Notes:

  • If you want to run integration tests without sudo you have to add your user to docker group sudo usermod -aG docker $USER. More information about docker configuration.
  • If you already had run these tests without ./runner script you may have problems with pytest cache. It can be removed with rm -r __pycache__ .pytest_cache/.
  • Some tests maybe require a lot of resources (CPU, RAM, etc.). Better not try large tests like test_cluster_copier or test_distributed_ddl* on your laptop.

You can run tests via ./runner script and pass pytest arguments as last arg:

$ ./runner --binary $HOME/ClickHouse/programs/clickhouse  --odbc-bridge-binary $HOME/ClickHouse/programs/clickhouse-odbc-bridge --base-configs-dir $HOME/ClickHouse/programs/server/ 'test_ssl_cert_authentication -ss'
Start tests
====================================================================================================== test session starts ======================================================================================================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0 -- /usr/bin/python3
cachedir: .pytest_cache
rootdir: /ClickHouse/tests/integration, configfile: pytest.ini
plugins: repeat-0.9.1, xdist-2.5.0, forked-1.4.0, order-1.0.0, timeout-2.1.0
timeout: 900.0s
timeout method: signal
timeout func_only: False
collected 4 items                                                                                                                                                                                                               

test_ssl_cert_authentication/test.py::test_https Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml
PASSED
test_ssl_cert_authentication/test.py::test_https_wrong_cert PASSED
test_ssl_cert_authentication/test.py::test_https_non_ssl_auth PASSED
test_ssl_cert_authentication/test.py::test_create_user PASSED

================================================================================================= 4 passed in 118.58s (0:01:58) =================================================================================================

Path to binary and configs maybe specified via env variables:

$ export CLICKHOUSE_TESTS_BASE_CONFIG_DIR=$HOME/ClickHouse/programs/server/
$ export CLICKHOUSE_TESTS_SERVER_BIN_PATH=$HOME/ClickHouse/programs/clickhouse
$ export CLICKHOUSE_TESTS_ODBC_BRIDGE_BIN_PATH=$HOME/ClickHouse/programs/clickhouse-odbc-bridge
$ ./runner 'test_odbc_interaction'
$ # or ./runner '-v -ss'
Start tests
============================= test session starts ==============================
platform linux2 -- Python 2.7.15rc1, pytest-4.0.0, py-1.7.0, pluggy-0.8.0
rootdir: /ClickHouse/tests/integration, inifile: pytest.ini
collected 6 items

test_odbc_interaction/test.py ......                                     [100%]
==================== 6 passed, 1 warnings in 96.33 seconds =====================

You can just open shell inside a container by overwritting the command: ./runner --command=bash

Rebuilding the docker containers

The main container used for integration tests lives in docker/test/integration/base/Dockerfile. Rebuild it with

cd docker/test/integration/base
docker build -t clickhouse/integration-test .

The helper container used by the runner script is in docker/test/integration/runner/Dockerfile.

Adding new tests

To add new test named foo, create a directory test_foo with an empty __init__.py and a file named test.py containing tests in it. All functions with names starting with test will become test cases.

helpers directory contains utilities for:

  • Launching a ClickHouse cluster with or without ZooKeeper in docker containers.
  • Sending queries to launched instances.
  • Introducing network failures such as severing network link between two instances.

To assert that two TSV files must be equal, wrap them in the TSV class and use the regular assert statement. Example: assert TSV(result) == TSV(reference). In case the assertion fails, pytest will automagically detect the types of variables and only the small diff of two files is printed.

Troubleshooting

If tests failing for mysterious reasons, this may help:

sudo service docker stop
sudo bash -c 'rm -rf /var/lib/docker/*'
sudo service docker start

iptables-nft

On Ubuntu 20.10 and later in host network mode (default) one may encounter problem with nested containers not seeing each other. It happens because legacy and nftables rules are out of sync. Problem can be solved by:

sudo iptables -P FORWARD ACCEPT