ClickHouse/tests/integration
2024-08-29 12:17:46 +00:00
..
compose Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-07 21:01:13 +00:00
helpers Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-26 09:04:13 +00:00
test_accept_invalid_certificate accept_invalid_certificate in client config: additional testing 2024-07-30 11:57:42 +02:00
test_access_control_on_cluster more changes 2024-08-05 14:43:28 +00:00
test_access_for_functions Follow up for #67843 2024-08-07 20:36:23 +02:00
test_aggregation_memory_efficient
test_aliases_in_default_expr_not_break_table_structure write metadata to disk and keeper in the same format 2024-08-22 15:13:42 +00:00
test_allowed_client_hosts
test_allowed_url_from_config disable test_allowed_url_with_config tests with HDFS 2024-03-20 17:24:55 +00:00
test_alter_codec
test_alter_comment_on_cluster more changes 2024-08-05 14:43:28 +00:00
test_alter_moving_garbage more changes 2024-08-05 14:43:28 +00:00
test_alter_on_mixed_type_cluster more changes 2024-08-05 14:43:28 +00:00
test_alter_settings_on_cluster
test_alter_update_cast_keep_nullable
test_alternative_keeper_config
test_always_fetch_merged
test_analyzer_compatibility Even better test 2024-08-05 15:29:15 +00:00
test_async_connect_to_multiple_ips
test_async_insert_adaptive_busy_timeout Adaptive async timeouts: consider queue flush history 2024-02-01 22:45:10 +00:00
test_async_insert_memory
test_async_load_databases Fix storage join loading order 2024-03-27 11:27:30 +00:00
test_async_metrics_in_cgroup fix test 2024-08-07 20:21:50 +01:00
test_asynchronous_metric_jemalloc_profile_active Use background thread 2024-06-27 08:46:10 +02:00
test_asynchronous_metric_log_table
test_asynchronous_metrics_pk_bytes_fields
test_atomic_drop_table
test_attach_backup_from_s3_plain Update test.py 2024-02-27 18:07:19 +08:00
test_attach_partition_using_copy fix bad test 2024-06-07 14:09:54 +02:00
test_attach_partition_with_large_destination
test_attach_table_from_s3_plain_readonly Remove the setting from tests 2024-04-25 22:13:14 +02:00
test_attach_table_normalizer
test_attach_without_checksums
test_attach_without_fetching fix tests test_attach_without_fetching test_replicated_merge_tree_wait_on_shutdown 2024-03-10 10:00:18 +01:00
test_authentication
test_azure_blob_storage_native_copy Automatic style fix 2024-05-21 09:53:32 +00:00
test_azure_blob_storage_plain_rewritable plain_rewritable: add integration test for Azure 2024-05-07 03:53:23 +00:00
test_azure_blob_storage_zero_copy_replication
test_backup_log
test_backup_restore
test_backup_restore_azure_blob_storage Update test.py 2024-05-21 21:03:13 +02:00
test_backup_restore_keeper_map
test_backup_restore_new fix 2024-07-24 11:33:31 +00:00
test_backup_restore_on_cluster Fix test test_mutation 2024-07-31 12:31:52 +02:00
test_backup_restore_s3 Fix test test_backup_restore_s3. 2024-07-24 18:04:29 +02:00
test_backup_restore_storage_policy
test_backup_s3_storage_class
test_backward_compatibility update error codes related to number of accepted arguments 2024-07-22 11:21:54 +02:00
test_block_structure_mismatch
test_broken_part_during_merge Increase timeout for test_broken_part_during_merge 2024-07-24 17:20:19 +02:00
test_broken_projections Add missing file 2024-08-08 21:47:23 +02:00
test_buffer_profile
test_build_sets_from_multiple_threads
test_catboost_evaluate Remove empty files 2024-05-15 13:52:53 +02:00
test_cgroup_limit
test_check_table
test_checking_s3_blobs_paranoid rename: S3DiskNoKeyErrors -> DiskS3NoSuchKeyErrors 2024-08-14 17:53:33 +00:00
test_cleanup_after_start
test_cleanup_dir_after_bad_zk_conn
test_cluster_all_replicas Fix test_cluster_all_replicas 2024-08-12 07:01:52 +02:00
test_cluster_discovery
test_codec_encrypted
test_composable_protocols Fix test style 2024-05-17 13:58:29 +02:00
test_compressed_marks_restart
test_compression_codec_read Remove old tags from integration tests 2024-02-26 13:45:20 +01:00
test_compression_nested_columns
test_concurrent_backups_s3
test_concurrent_queries_for_all_users_restriction
test_concurrent_queries_for_user_restriction
test_concurrent_queries_restriction_by_query_kind
test_concurrent_threads_soft_limit fix wrong config settings inherited from server/config.xml 2024-08-29 12:17:46 +00:00
test_concurrent_ttl_merges
test_config_corresponding_root
test_config_decryption
test_config_hide_in_preprocessed
test_config_reloader_interval Fix server settings 2024-06-21 19:16:27 +02:00
test_config_substitutions Fix config merging for from_env with replace overrides 2024-07-03 12:24:17 +02:00
test_config_xml_full Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
test_config_xml_main Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
test_config_xml_yaml_mix Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
test_config_yaml_full Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
test_config_yaml_main Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
test_config_yaml_merge_keys Apply black for test_config_yaml_merge_keys 2024-05-10 20:04:23 +02:00
test_consistant_parts_after_move_partition
test_consistent_parts_after_clone_replica
test_crash_log Fix flaky test_pkill_query_log (tsan) 2024-07-26 14:26:37 +00:00
test_create_query_constraints
test_create_user_and_login
test_cross_replication
test_custom_dashboards Add ability to load dashboards for system.dashboards from config 2024-07-26 21:21:09 +02:00
test_custom_settings
test_ddl_alter_query
test_ddl_config_hostname
test_ddl_worker_non_leader
test_default_compression_codec Remove old tags from integration tests 2024-02-26 13:45:20 +01:00
test_default_database_on_cluster
test_default_role
test_delayed_replica_failover Automatic style fix 2024-08-14 16:13:32 +00:00
test_detached_parts_metrics
test_dictionaries_access
test_dictionaries_all_layouts_separate_sources Disable session caching to work around tsan races 2024-04-08 11:16:06 +00:00
test_dictionaries_complex_key_cache_string
test_dictionaries_config_reload
test_dictionaries_ddl grant all table engines in allow_database 2024-04-18 02:00:28 +00:00
test_dictionaries_dependency
test_dictionaries_dependency_xml
test_dictionaries_mysql Fix mysql dictionary source 2024-05-07 15:31:35 +00:00
test_dictionaries_null_value
test_dictionaries_postgresql Automatic style fix 2024-08-19 11:56:30 +00:00
test_dictionaries_redis
test_dictionaries_replace Fix remaining tests 2024-06-21 12:06:51 +00:00
test_dictionaries_select_all
test_dictionaries_update_and_reload Integration tests: fix flaky test_dictionaries_update_and_reload::test_reload_after_fail_by_timer 2024-08-05 11:45:49 +02:00
test_dictionaries_wait_for_load
test_dictionaries_with_invalid_structure
test_dictionary_allow_read_expired_keys
test_dictionary_custom_settings
test_dictionary_ddl_on_cluster
test_disable_insertion_and_mutation format 2024-07-18 22:58:30 +08:00
test_disabled_access_control_improvements Merge branch 'master' into access-controls-enable-by-default 2024-04-25 13:21:23 +02:00
test_disabled_mysql_server CI: integration tests to mysql80 2024-02-21 11:05:47 +00:00
test_disk_access_storage Fix tests 2024-02-27 17:42:51 +01:00
test_disk_configuration adjust tests 2024-08-07 19:19:33 +02:00
test_disk_over_web_server Delete test 2024-06-20 18:44:45 +00:00
test_disk_types add support for new release branch 2024-07-13 16:21:22 +02:00
test_disks_app_func Corrected tests 2024-07-01 12:46:17 +00:00
test_disks_app_interactive Corrected tests 2024-07-01 12:46:17 +00:00
test_distributed_async_insert_for_node_changes
test_distributed_config Fix tests 2024-04-08 20:04:14 +02:00
test_distributed_ddl grant all table engines in allow_database 2024-04-18 02:00:28 +00:00
test_distributed_ddl_on_cross_replication
test_distributed_ddl_parallel
test_distributed_ddl_password
test_distributed_default_database add support for new release branch 2024-07-13 16:21:22 +02:00
test_distributed_directory_monitor_split_batch_on_failure Fix test_distributed_directory_monitor_split_batch_on_failure flakienss 2024-03-11 09:43:47 +01:00
test_distributed_format Remove obsolete --multiquery parameter from tests 2024-07-30 11:04:41 +00:00
test_distributed_insert_backward_compatibility Fix integration tests 2024-03-22 13:59:44 +01:00
test_distributed_inter_server_secret tests: make test_distributed_inter_server_secret idempotent 2024-08-06 16:59:23 +02:00
test_distributed_load_balancing Fix flaky test test_distributed_replica_max_ignored_errors 2024-08-21 16:23:37 +02:00
test_distributed_over_distributed
test_distributed_respect_user_timeouts
test_distributed_storage_configuration
test_distributed_system_query
test_distributed_type_object Merge branch 'master' into json-data-type 2024-08-12 23:32:35 +02:00
test_dns_cache Rebase 2024-08-06 15:32:04 +00:00
test_dotnet_client
test_drop_if_empty Remove the setting from tests 2024-04-25 22:13:14 +02:00
test_drop_is_lock_free Update test.py 2024-08-08 17:47:12 +02:00
test_drop_no_local_path
test_drop_replica
test_drop_replica_with_auxiliary_zookeepers
test_enabling_access_management
test_encrypted_disk
test_encrypted_disk_replication
test_endpoint_macro_substitution Corrected integration tests 2024-06-26 13:17:39 +00:00
test_executable_dictionary
test_executable_table_function
test_executable_user_defined_function
test_executable_user_defined_functions_config_reload
test_explain_estimates
test_external_cluster Remove the setting from tests 2024-04-25 22:13:14 +02:00
test_external_http_authenticator Fix tests 2024-02-27 17:49:16 +01:00
test_extreme_deduplication
test_failed_async_inserts Revert "Add dynamic untracked memory limits for more precise memory tracking" 2024-06-07 14:03:56 +02:00
test_failed_mutations Automatic style fix 2024-03-12 11:54:56 +00:00
test_fetch_memory_usage
test_fetch_partition_from_auxiliary_zookeeper
test_fetch_partition_should_reset_mutation
test_fetch_partition_with_outdated_parts
test_file_cluster Try to detect file format automatically during schema inference if it's unknown 2024-01-23 18:59:39 +00:00
test_file_schema_inference_cache
test_filesystem_cache Load filesystem cache metadata asynchronously 2024-08-16 12:57:55 +02:00
test_filesystem_layout
test_force_deduplication Revert "Revert "insertion deduplication on retries for materialised views"" 2024-07-05 16:52:51 +02:00
test_force_drop_table
test_format_avro_confluent disable more hdfs and kafka inttests 2024-03-20 17:24:55 +00:00
test_format_schema_on_server
test_freeze_table
test_global_overcommit_tracker integration tests: fix flaky tests 2024-03-26 17:55:37 +01:00
test_globs_in_filepath
test_grant_and_revoke just a commit to trigger CI 2024-07-22 13:39:48 +00:00
test_graphite_merge_tree
test_graphite_merge_tree_typed
test_group_array_element_size Rename aggregate_function_group_array_has_limit_size 2024-05-24 15:05:49 +02:00
test_groupBitmapAnd_on_distributed Update integration tests 2024-03-20 13:43:18 +01:00
test_grpc_protocol Merge pull request #66063 from vitlibar/fix-test-grpc-protocol-test-progress 2024-07-04 15:20:14 +00:00
test_grpc_protocol_ssl
test_hedged_requests fix test, better log, fix defaults for client 2024-06-03 07:24:28 +00:00
test_hedged_requests_parallel
test_host_regexp_hosts_file_resolution Fix leftovers 2024-08-12 07:17:17 +02:00
test_host_regexp_multiple_ptr_records
test_hot_reload_storage_policy add a explain comment to test 2024-04-30 01:21:01 +00:00
test_http_and_readonly
test_http_failover http connections pools 2024-03-10 10:00:18 +01:00
test_http_handlers_config feat-59620 Style fix 2024-06-13 11:21:47 +03:00
test_http_native
test_https_replication
test_https_s3_table_function_with_http_proxy_no_tunneling bring back multiple proxy test back 2024-05-30 11:00:23 -03:00
test_incorrect_datetime_format Fix flaky test error 2024-08-21 14:15:44 +08:00
test_inherit_multiple_profiles
test_input_format_parallel_parsing_memory_tracking Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
test_insert_distributed_async_extra_dirs
test_insert_distributed_async_send
test_insert_distributed_load_balancing
test_insert_into_distributed
test_insert_into_distributed_sync_async
test_insert_into_distributed_through_materialized_view
test_insert_over_http_query_log Automatic style fix 2024-02-19 14:33:53 +00:00
test_inserts_with_keeper_retries
test_intersecting_parts better style 2024-04-30 20:24:37 +02:00
test_interserver_dns_retires add support for new release branch 2024-07-13 16:21:22 +02:00
test_jbod_balancer Fix all problems in tests that had been found by flake8 2024-06-05 14:46:38 +02:00
test_jbod_ha Fix leftovers 2024-08-12 07:17:17 +02:00
test_jbod_load_balancing
test_jdbc_bridge Fix all problems in tests that had been found by flake8 2024-06-05 14:46:38 +02:00
test_jemalloc_percpu_arena
test_join_set_family_s3 Fix storage join loading order 2024-03-27 11:27:30 +00:00
test_kafka_bad_messages disable more hdfs and kafka inttests 2024-03-20 17:24:55 +00:00
test_keeper_and_access_storage
test_keeper_auth
test_keeper_availability_zone
test_keeper_back_to_back
test_keeper_broken_logs
test_keeper_client Fix test 2024-06-20 20:23:54 +02:00
test_keeper_compression
test_keeper_disks disable more hdfs and kafka inttests 2024-03-20 17:24:55 +00:00
test_keeper_dynamic_log_level
test_keeper_feature_flags_config
test_keeper_force_recovery
test_keeper_force_recovery_single_node
test_keeper_four_word_command Fix test 2024-07-02 13:26:52 +02:00
test_keeper_http_control
test_keeper_incorrect_config
test_keeper_internal_secure
test_keeper_map Add retries to create 2024-08-01 10:34:53 +02:00
test_keeper_map_retries Add retries to create 2024-08-01 10:34:53 +02:00
test_keeper_memory_soft_limit
test_keeper_mntr_data_size
test_keeper_mntr_pressure
test_keeper_multinode_simple
test_keeper_nodes_add
test_keeper_nodes_move
test_keeper_nodes_remove
test_keeper_persistent_log
test_keeper_persistent_log_multinode
test_keeper_profiler Update test.py 2024-06-18 16:33:59 +02:00
test_keeper_reconfig_add
test_keeper_reconfig_remove
test_keeper_reconfig_remove_many
test_keeper_reconfig_replace_leader
test_keeper_reconfig_replace_leader_in_one_command
test_keeper_restore_from_snapshot
test_keeper_s3_snapshot
test_keeper_secure_client
test_keeper_session
test_keeper_snapshot_on_exit
test_keeper_snapshot_small_distance Fix all problems in tests that had been found by flake8 2024-06-05 14:46:38 +02:00
test_keeper_snapshots Fix test_keeper_snapshots 2024-06-20 16:38:07 +02:00
test_keeper_snapshots_multinode
test_keeper_three_nodes_start Fix all problems in tests that had been found by flake8 2024-06-05 14:46:38 +02:00
test_keeper_three_nodes_two_alive
test_keeper_two_nodes_cluster
test_keeper_znode_time
test_keeper_zookeeper_converter
test_kerberos_auth fix mysql client tests to use mysql8 image 2024-03-20 17:35:11 +00:00
test_lazy_database Remove data from all disks after DROP with Lazy database. 2024-05-15 13:09:00 +00:00
test_ldap_external_user_directory
test_library_bridge
test_limit_materialized_view_count
test_limited_replicated_fetches
test_log_family_hdfs disable more hdfs and kafka inttests 2024-03-20 17:24:55 +00:00
test_log_family_s3 Enable truncate operation for object storage disks. 2024-05-13 12:46:42 +00:00
test_log_levels_update
test_log_lz4_streaming
test_log_query_probability
test_logs_level
test_lost_part add alias partitionI, update tests, and docs 2024-07-13 22:38:28 +00:00
test_lost_part_during_startup
test_manipulate_statistics fix flacky although that is not actually flacky 2024-08-24 07:33:18 +02:00
test_mask_sensitive_info Add a test 2024-08-15 14:38:20 +02:00
test_match_process_uid_against_data_owner
test_materialized_mysql_database Disable async loading for MaterializedMySQL tests 2024-06-17 05:21:09 +02:00
test_materialized_view_restart_server
test_max_rows_to_read_leaf_with_view
test_max_suspicious_broken_parts Use primary.cidx instead of columns.txt to break parts 2024-06-05 14:47:29 +02:00
test_max_suspicious_broken_parts_replicated refine load part logic 2024-05-08 15:04:16 +02:00
test_memory_limit Disable sanitizer 2024-07-16 14:55:14 +02:00
test_memory_limit_observer Automatic style fix 2024-07-03 20:21:46 +00:00
test_memory_profiler_min_max_borders
test_MemoryTracking Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
test_merge_table_over_distributed
test_merge_tree_azure_blob_storage Fix all problems in tests that had been found by flake8 2024-06-05 14:46:38 +02:00
test_merge_tree_check_part_with_cache
test_merge_tree_empty_parts
test_merge_tree_hdfs disable more hdfs and kafka inttests 2024-03-20 17:24:55 +00:00
test_merge_tree_load_marks fix test 2024-05-03 13:59:02 +00:00
test_merge_tree_load_parts Make test less flaky 2024-03-12 12:23:09 +00:00
test_merge_tree_s3 Merge branch 'master' into dont-optimize-trivial-insert-select 2024-06-17 08:57:08 +02:00
test_merge_tree_s3_failover
test_merge_tree_s3_with_cache
test_merge_tree_settings_constraints
test_merges_memory_limit integration tests: fix flaky tests 2024-03-26 17:55:37 +01:00
test_modify_engine_on_restart Prevent conversion to Replicated if zookeeper path already exists 2024-05-23 03:13:25 +03:00
test_move_partition_to_disk_on_cluster
test_move_partition_to_volume_async
test_move_ttl_broken_compatibility Automatic style fix 2024-05-31 12:51:12 +00:00
test_multi_access_storage_role_management
test_multiple_disks Take test from master 2024-06-26 16:12:55 +00:00
test_mutation_fetch_fallback
test_mutations_hardlinks
test_mutations_in_partitions_of_merge_tree
test_mutations_with_merge_tree Analyzer: Fix test_mutations_with_merge_tree 2024-02-13 18:59:23 +01:00
test_mutations_with_projection
test_mysql57_database_engine Merge pull request #61778 from ClickHouse/ci_disable_grpc_tests_on_arm 2024-03-25 21:50:58 +01:00
test_mysql_database_engine Merge with master 2024-02-21 20:37:48 +01:00
test_mysql_protocol fix mysql client tests to use mysql8 image 2024-03-20 17:35:11 +00:00
test_named_collections Fix test 2024-07-10 12:47:19 +00:00
test_named_collections_encrypted Fix style 2024-08-20 14:24:53 +00:00
test_named_collections_if_exists_on_cluster
test_non_default_compression Proper fix 2024-05-15 19:14:32 +02:00
test_odbc_interaction Update test 2024-08-09 16:15:28 +02:00
test_old_parts_finally_removed
test_old_versions Fix integration tests 2024-03-22 13:59:44 +01:00
test_on_cluster_timeouts
test_optimize_on_insert
test_overcommit_tracker
test_parallel_replicas_all_marks_read
test_parallel_replicas_custom_key Fix test_parallel_replicas_custom_key 2024-07-10 17:04:07 +02:00
test_parallel_replicas_custom_key_failover Review fixes 2024-07-02 16:33:06 +02:00
test_parallel_replicas_custom_key_load_balancing Update integration tests to use UInt rather than Int 2024-06-06 05:28:16 -07:00
test_parallel_replicas_distributed_skip_shards Fix: sync replicas 2024-06-23 16:27:15 +00:00
test_parallel_replicas_failover Fix: simplify test 2024-04-30 14:25:19 +00:00
test_parallel_replicas_invisible_parts
test_parallel_replicas_no_replicas format test.py 2024-07-25 09:55:23 +08:00
test_parallel_replicas_over_distributed
test_parallel_replicas_skip_shards
test_parquet_page_index squash! fix for parallel execution 2024-08-05 11:52:07 +02:00
test_part_log_table
test_part_uuid
test_partition
test_parts_delete_zookeeper
test_passing_max_partitions_to_read_remotely
test_password_constraints
test_peak_memory_usage
test_placement_info Fix test_placement_info (#61057) 2024-03-13 12:03:42 +01:00
test_polymorphic_parts Fix integration tests 2024-03-22 13:59:44 +01:00
test_postgresql_database_engine Update integration tests 2024-02-21 19:23:52 +01:00
test_postgresql_protocol
test_postgresql_replica_database_engine_1 Fix all problems in tests that had been found by flake8 2024-06-05 14:46:38 +02:00
test_postgresql_replica_database_engine_2 Fixed test_dependent_loading. event_time_microseconds has two dates connected with "\n" 2024-08-09 18:29:31 +03:00
test_profile_events_s3
test_profile_max_sessions_for_user Max sessions for user tests improvements 2024-07-01 07:31:57 +00:00
test_profile_settings_and_constraints_order
test_prometheus_endpoint Fix invalid escape sequence warnings 2024-06-05 14:46:38 +02:00
test_prometheus_protocols Disallow LowCardinality type for external tables 2024-08-07 20:54:40 +00:00
test_quorum_inserts fix style 2024-03-27 21:27:07 +01:00
test_quorum_inserts_parallel
test_quota Fix integration tests 2024-03-18 16:07:10 +01:00
test_random_inserts
test_range_hashed_dictionary_types
test_read_only_table
test_read_temporary_tables_on_failure
test_recompression_ttl Fixing test. 2024-02-08 14:31:24 +00:00
test_recovery_replica
test_recovery_time_metric [resubmit] add replication lag and recovery time metrics 2024-08-06 15:06:02 +00:00
test_redirect_url_storage disable more hdfs and kafka inttests 2024-03-20 17:24:55 +00:00
test_relative_filepath
test_reload_auxiliary_zookeepers
test_reload_certificate fix style 2024-03-25 14:09:53 +00:00
test_reload_clusters_config Fix style 2024-02-26 18:27:53 +01:00
test_reload_max_table_size_to_drop
test_reload_query_masking_rules
test_reload_zookeeper
test_reloading_settings_from_users_xml
test_reloading_storage_configuration
test_remote_blobs_naming Revert "Replace ORDER BY ALL by ORDER BY *" 2024-02-21 19:05:20 +01:00
test_remote_prewhere
test_rename_column
test_render_log_file_name_templates
test_replace_partition
test_replica_can_become_leader
test_replica_is_active
test_replicated_database Automatic style fix 2024-06-27 14:43:52 +00:00
test_replicated_database_cluster_groups Remove the setting from tests 2024-04-25 22:13:14 +02:00
test_replicated_fetches_bandwidth Make test slower 2024-02-28 01:46:25 +01:00
test_replicated_fetches_timeouts
test_replicated_merge_tree_compatibility Fix integration tests 2024-03-22 13:59:44 +01:00
test_replicated_merge_tree_config
test_replicated_merge_tree_encrypted_disk
test_replicated_merge_tree_encryption_codec Fix test_replicated_merge_tree_encryption_codec 2024-04-08 11:03:47 +00:00
test_replicated_merge_tree_replicated_db_ttl Move analyzer to Beta stage 2024-08-05 15:29:14 +00:00
test_replicated_merge_tree_s3
test_replicated_merge_tree_s3_zero_copy Integration tests: fix flaky tests 2024-03-23 20:01:26 +01:00
test_replicated_merge_tree_thread_schedule_timeouts Use scheduleOrThrow in MergeTree data selector thread pool 2024-03-22 16:46:20 +00:00
test_replicated_merge_tree_wait_on_shutdown fix tests test_attach_without_fetching test_replicated_merge_tree_wait_on_shutdown 2024-03-10 10:00:18 +01:00
test_replicated_merge_tree_with_auxiliary_zookeepers
test_replicated_mutations
test_replicated_parse_zk_metadata
test_replicated_s3_zero_copy_drop_partition
test_replicated_table_attach Fix flaky test_replicated_table_attach 2024-08-02 08:49:47 +02:00
test_replicated_user_defined_functions Fix reloading SQL UDFs with UNION 2024-08-02 11:13:41 +02:00
test_replicated_users
test_replicated_zero_copy_projection_mutation Fix expectations for test_all_projection_files_are_dropped_when_part_is_dropped 2024-03-12 10:39:41 +01:00
test_replicating_constants Bump version 2024-02-09 12:48:07 +01:00
test_replication_credentials
test_replication_without_zookeeper
test_restart_server
test_restore_external_engines Revert "Revert "Add settings to replace external engines to Null during create"" 2024-07-31 13:30:14 +02:00
test_restore_replica
test_rocksdb_options
test_rocksdb_read_only
test_role Add one more test. 2024-08-22 13:56:43 +02:00
test_row_policy Resubmit "Analyzer: compute ALIAS columns right after reading" 2024-03-01 14:53:02 +00:00
test_runtime_configurable_cache_size Incorporate review feedback 2024-07-23 13:10:01 +00:00
test_s3_aws_sdk_has_slightly_unreliable_behaviour
test_s3_cluster Try to detect file format automatically during schema inference if it's unknown 2024-01-23 18:59:39 +00:00
test_s3_imds Add a test 2024-08-09 16:27:35 +02:00
test_s3_low_cardinality_right_border
test_s3_plain_rewritable Store plain_rewritable metadata in a separate layout 2024-08-02 04:28:07 +00:00
test_s3_storage_class
test_s3_storage_conf_new_proxy style 2024-05-30 11:14:56 -03:00
test_s3_storage_conf_proxy style 2024-05-30 11:14:56 -03:00
test_s3_style_link
test_s3_table_function_with_http_proxy add missing no_proxy_hosts assignment 2024-06-04 15:44:22 -03:00
test_s3_table_function_with_https_proxy Merge branch 'master' into no_proxy_support 2024-06-04 14:55:12 -03:00
test_s3_table_functions http connections pools 2024-03-10 10:00:18 +01:00
test_s3_with_https
test_s3_zero_copy_replication
test_s3_zero_copy_ttl
test_scheduler Merge branch 'master' into workload-for-merges 2024-06-07 13:58:41 +00:00
test_secure_socket
test_select_access_rights Fix integration tests 2024-03-18 16:07:10 +01:00
test_send_crash_reports Revert "CI: disable ARM integration test cases with libunwind crash" 2024-05-19 08:11:53 +02:00
test_send_request_to_leader_replica
test_server_initialization
test_server_keep_alive fix test 2024-08-07 12:37:39 +01:00
test_server_reload Fix leftovers 2024-08-12 07:17:17 +02:00
test_server_start_and_ip_conversions
test_session_log Fixed session log parallel/sequenced test work within a single fixture 2024-08-06 22:20:12 +00:00
test_settings_constraints
test_settings_constraints_distributed Revert "Add dynamic untracked memory limits for more precise memory tracking" 2024-06-07 14:03:56 +02:00
test_settings_profile Move analyzer to Beta stage 2024-08-05 15:29:14 +00:00
test_shard_level_const_function
test_sharding_key_from_default_column
test_shutdown_static_destructor_failure Automatic style fix 2024-07-24 10:14:35 +00:00
test_shutdown_wait_unfinished_queries
test_sql_user_defined_functions_on_cluster Fix analyzer 2024-05-17 10:23:32 +02:00
test_ssh_keys_authentication
test_ssl_cert_authentication What if I will change this test? 2024-07-22 08:47:32 +02:00
test_startup_scripts fix tests 2024-06-21 12:10:49 -04:00
test_storage_azure_blob_storage try to fix tests 2024-08-22 13:20:04 +02:00
test_storage_delta Fix test 2024-08-26 11:33:08 +02:00
test_storage_dict
test_storage_hdfs fix black 2024-08-22 15:24:33 +02:00
test_storage_hudi Remove unnecessary changes 2024-08-12 12:44:22 +00:00
test_storage_iceberg Changed test to work in parallel 2024-08-14 11:35:37 +00:00
test_storage_kafka Merge pull request #67554 from ClickHouse/fix-message-queue-sink-from-http-interface 2024-08-12 21:29:14 +00:00
test_storage_kerberized_kafka CI: aarh64: disable kerberos tests 2024-05-16 16:43:54 +02:00
test_storage_mongodb tests: avoid leaving leftovers after test_storage_mongodb (fixes flaky chec) 2024-08-04 22:01:08 +02:00
test_storage_mysql Fix non-deterministic result order in test_storage_mysql.test_mysql_distributed 2024-08-14 09:50:19 +00:00
test_storage_numbers Reduce the number of read rows from system.numbers (#60546) 2024-03-07 09:38:07 +01:00
test_storage_policies rework custom table's disk usage 2024-08-06 13:05:23 +02:00
test_storage_postgresql Add test for join kind to test_storage_postgresql/test.py::test_filter_push_down 2024-07-16 15:09:36 +00:00
test_storage_rabbitmq Merge pull request #66760 from ClickHouse/fix-flaky-rabbitmq-test 2024-07-21 05:22:09 +00:00
test_storage_redis
test_storage_s3 Remove unnecessary changes 2024-08-12 12:44:22 +00:00
test_storage_s3_queue Change name of default azurite container to avoid clashing with azure blob storage tests 2024-08-15 09:41:03 +00:00
test_storage_url
test_storage_url_http_headers Automatic style fix 2024-03-31 23:43:28 +00:00
test_storage_url_with_proxy
test_store_cleanup Revert some tests 2024-06-26 13:25:34 +00:00
test_structured_logging_json
test_system_clusters_actual_information Fix style 2024-03-14 19:06:02 +01:00
test_system_ddl_worker_queue
test_system_detached_tables fix style again 2024-07-03 12:22:32 +00:00
test_system_flush_logs fix tests 2024-08-08 12:56:33 +02:00
test_system_logs extend system logs integration tests 2024-04-29 18:01:21 +00:00
test_system_logs_comment
test_system_logs_hostname
test_system_logs_recreate Automatic style fix 2024-08-07 11:12:21 +00:00
test_system_merges
test_system_metrics
test_system_queries
test_system_reload_async_metrics Cosmetics 2024-01-23 10:58:09 +00:00
test_system_replicated_fetches
test_system_start_stop_listen
test_table_db_num_limit Merge branch 'miscellaneous' of github.com:ClickHouse/ClickHouse into miscellaneous 2024-07-21 11:29:30 +02:00
test_table_function_mongodb
test_table_function_redis
test_table_functions_access_rights
test_tcp_handler_http_responses add support for new release branch 2024-07-13 16:21:22 +02:00
test_tcp_handler_interserver_listen_host add support for new release branch 2024-07-13 16:21:22 +02:00
test_temporary_data
test_temporary_data_in_cache test_cache_evicted_by_temporary_data drop cache 2024-08-02 10:37:52 +00:00
test_text_log_level
test_throttling Fix fundamentally broken test CC @azat 2024-08-12 07:09:42 +02:00
test_timezone_config
test_tlsv1_3
test_tmp_policy
test_trace_collector_serverwide Simpler 2024-04-04 12:22:11 +02:00
test_trace_log_build_id Skip the added tests in sanitizers where trace_log is disabled, and add a new sanitizer_check_node to facilitate checking sanitizer config existence. 2024-05-15 08:06:41 +00:00
test_transactions fix test comment 2024-03-05 14:46:39 -05:00
test_truncate_database Missing newline 2024-08-27 14:20:31 +00:00
test_ttl_move tests: fix test_ttl_move::test_alter_with_merge_work flakiness 2024-08-04 14:25:18 +02:00
test_ttl_replicated Fix all problems in tests that had been found by flake8 2024-06-05 14:46:38 +02:00
test_unambiguous_alter_commands Disambiguate alter commands list (#59532) 2024-02-22 19:17:15 +01:00
test_undrop_query Update test.py 2024-03-26 18:30:44 +01:00
test_union_header
test_unknown_column_dist_table_with_alias black check 2024-06-04 18:29:07 +02:00
test_user_defined_object_persistence Fix reloading SQL UDFs with UNION 2024-08-02 11:13:41 +02:00
test_user_directories
test_user_grants_from_config
test_user_ip_restrictions
test_user_valid_until Fix VALID UNTIL clause resetting after restart 2024-07-11 22:35:39 +00:00
test_user_zero_database_access
test_version_update Fix leftovers 2024-08-12 07:17:17 +02:00
test_version_update_after_mutation Fix integration tests 2024-03-22 13:59:44 +01:00
test_wrong_db_or_table_name Analyzer: Fix test_wrong_db_or_table_name/test.py::test_wrong_table_name 2024-02-09 14:05:01 +01:00
test_zero_copy_fetch
test_zero_copy_replication_drop_detached_part
test_zookeeper_config
test_zookeeper_config_load_balancing Improve regex to take into account the xdist name in the instance 2024-08-01 09:38:34 +00:00
test_zookeeper_fallback_session fix tests 2024-06-23 23:55:45 +02:00
.dockerignore
.gitignore
conftest.py Integration tests: fix ports clashing problem 4 2024-08-02 16:09:48 +02:00
integration_test_images.py
parallel_skip.json Merge pull request #66895 from MikhailBurdukov/hostresolver_opt 2024-08-19 15:00:31 +00:00
parallel.readme
pytest.ini
README.md Merge pull request #67449 from ClickHouse/divanik/add_docs_about_docker_runner_image_relaunch 2024-08-02 13:22:59 +00:00
runner Update runner 2024-08-27 19:05:10 +02:00

ClickHouse integration tests

This directory contains tests that involve several ClickHouse instances, custom configs, ZooKeeper, etc.

Running natively

Prerequisites:

  • Ubuntu 20.04 (Focal) or higher.
  • docker. Minimum required API version: 1.25, check with docker version.

You must install latest Docker from https://docs.docker.com/engine/installation/linux/docker-ce/ubuntu/#set-up-the-repository Don't use Docker from your system repository.

  • pip and libpq-dev. To install: sudo apt-get install python3-pip libpq-dev zlib1g-dev libcrypto++-dev libssl-dev libkrb5-dev python3-dev
  • py.test testing framework. To install: sudo -H pip install pytest
  • docker-compose and additional python libraries. To install:
sudo -H pip install \
    PyMySQL \
    avro \
    cassandra-driver \
    confluent-kafka \
    dicttoxml \
    docker \
    docker-compose \
    grpcio \
    grpcio-tools \
    kafka-python \
    kazoo \
    minio \
    lz4 \
    protobuf \
    psycopg2-binary \
    pymongo \
    pytz \
    pytest \
    pytest-timeout \
    redis \
    tzlocal==2.1 \
    urllib3 \
    requests-kerberos \
    dict2xml \
    hypothesis \
    pyhdfs \
    pika \
    nats-py

(highly not recommended) If you really want to use OS packages on modern debian/ubuntu instead of "pip": sudo apt install -y docker docker-compose python3-pytest python3-dicttoxml python3-docker python3-pymysql python3-protobuf python3-pymongo python3-tzlocal python3-kazoo python3-psycopg2 kafka-python python3-pytest-timeout python3-minio

Some tests have other dependencies, e.g. spark. See docker/test/integration/runner/Dockerfile for how to install those. See docker/test/integration/runner/dockerd-entrypoint.sh for environment variables that need to be set (e.g. JAVA_PATH).

If you want to run the tests under a non-privileged user, you must add this user to docker group: sudo usermod -aG docker $USER and re-login. (You must close all your sessions (for example, restart your computer)) To check, that you have access to Docker, run docker ps.

Run the tests with the pytest command. To select which tests to run, use: pytest -k <test_name_pattern>

By default tests are run with system-wide client binary, server binary and base configs. To change that, set the following environment variables:

  • CLICKHOUSE_TESTS_SERVER_BIN_PATH to choose the server binary.
  • CLICKHOUSE_TESTS_CLIENT_BIN_PATH to choose the client binary.
  • CLICKHOUSE_TESTS_BASE_CONFIG_DIR to choose the directory from which base configs (config.xml andusers.xml) are taken.

Please note that if you use separate build (ENABLE_CLICKHOUSE_ALL=OFF), you need to build different components, including but not limited to ENABLE_CLICKHOUSE_LIBRARY_BRIDGE=ON ENABLE_CLICKHOUSE_ODBC_BRIDGE=ON ENABLE_CLICKHOUSE_KEEPER=ON. So it is easier to use ENABLE_CLICKHOUSE_ALL=ON

Running with runner script

The only requirement is fresh configured docker and docker pull clickhouse/integration-tests-runner

Notes:

  • If you want to run integration tests without sudo you have to add your user to docker group sudo usermod -aG docker $USER. More information about docker configuration.
  • If you already had run these tests without ./runner script you may have problems with pytest cache. It can be removed with rm -r __pycache__ .pytest_cache/.
  • Some tests maybe require a lot of resources (CPU, RAM, etc.). Better not try large tests like test_distributed_ddl* on your laptop.

You can run tests via ./runner script and pass pytest arguments as last arg:

$ ./runner --binary $HOME/ClickHouse/programs/clickhouse  --odbc-bridge-binary $HOME/ClickHouse/programs/clickhouse-odbc-bridge --base-configs-dir $HOME/ClickHouse/programs/server/ 'test_ssl_cert_authentication -ss'
Start tests
====================================================================================================== test session starts ======================================================================================================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0 -- /usr/bin/python3
cachedir: .pytest_cache
rootdir: /ClickHouse/tests/integration, configfile: pytest.ini
plugins: repeat-0.9.1, xdist-2.5.0, forked-1.4.0, order-1.0.0, timeout-2.1.0
timeout: 900.0s
timeout method: signal
timeout func_only: False
collected 4 items

test_ssl_cert_authentication/test.py::test_https Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml
PASSED
test_ssl_cert_authentication/test.py::test_https_wrong_cert PASSED
test_ssl_cert_authentication/test.py::test_https_non_ssl_auth PASSED
test_ssl_cert_authentication/test.py::test_create_user PASSED

================================================================================================= 4 passed in 118.58s (0:01:58) =================================================================================================

Path to binary and configs maybe specified via env variables:

$ export CLICKHOUSE_TESTS_BASE_CONFIG_DIR=$HOME/ClickHouse/programs/server/
$ export CLICKHOUSE_TESTS_SERVER_BIN_PATH=$HOME/ClickHouse/programs/clickhouse
$ export CLICKHOUSE_TESTS_ODBC_BRIDGE_BIN_PATH=$HOME/ClickHouse/programs/clickhouse-odbc-bridge
$ ./runner 'test_odbc_interaction'
$ # or ./runner '-v -ss'
Start tests
============================= test session starts ==============================
platform linux2 -- Python 2.7.15rc1, pytest-4.0.0, py-1.7.0, pluggy-0.8.0
rootdir: /ClickHouse/tests/integration, inifile: pytest.ini
collected 6 items

test_odbc_interaction/test.py ......                                     [100%]
==================== 6 passed, 1 warnings in 96.33 seconds =====================

You can just open shell inside a container by overwritting the command: ./runner --command=bash

Parallel test execution

On the CI, we run a number of parallel runners (5 at the time of this writing), each on its own Docker container. These runner containers spawn more containers for each test for the services needed such as ZooKeeper, MySQL, PostgreSQL and minio, among others. This means that tests do not share any services among them. Within each runner, tests are parallelized using pytest-xdist. We're using --dist=loadfile to distribute the load. In the documentation words: this guarantees that all tests in a file run in the same worker. This means that any test within the same file will never execute their tests in parallel. They'll be executed on the same worker one after the other.

If the test supports parallel and repeated execution, you can run a bunch of them in parallel to look for flakiness. We use pytest-repeat to set the number of times we want to execute a test through the --count argument. Then, -n sets the number of parallel workers for pytest-xdist.

$ export CLICKHOUSE_TESTS_BASE_CONFIG_DIR=$HOME/ClickHouse/programs/server/
$ export CLICKHOUSE_TESTS_SERVER_BIN_PATH=$HOME/ClickHouse/programs/clickhouse
$ export CLICKHOUSE_TESTS_ODBC_BRIDGE_BIN_PATH=$HOME/ClickHouse/programs/clickhouse-odbc-bridge
$ ./runner test_storage_s3_queue/test.py::test_max_set_age --count 10 -n 5
Start tests
=============================================================================== test session starts ================================================================================
platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3
cachedir: .pytest_cache
rootdir: /ClickHouse/tests/integration
configfile: pytest.ini
plugins: reportlog-0.4.0, xdist-3.5.0, random-0.2, repeat-0.9.3, order-1.0.0, timeout-2.2.0
timeout: 900.0s
timeout method: signal
timeout func_only: False
5 workers [10 items]
scheduling tests via LoadScheduling

test_storage_s3_queue/test.py::test_max_set_age[9-10]
test_storage_s3_queue/test.py::test_max_set_age[7-10]
test_storage_s3_queue/test.py::test_max_set_age[5-10]
test_storage_s3_queue/test.py::test_max_set_age[1-10]
test_storage_s3_queue/test.py::test_max_set_age[3-10]
[gw3] [ 10%] PASSED test_storage_s3_queue/test.py::test_max_set_age[7-10]
test_storage_s3_queue/test.py::test_max_set_age[8-10]
[gw4] [ 20%] PASSED test_storage_s3_queue/test.py::test_max_set_age[9-10]
test_storage_s3_queue/test.py::test_max_set_age[10-10]
[gw0] [ 30%] PASSED test_storage_s3_queue/test.py::test_max_set_age[1-10]
test_storage_s3_queue/test.py::test_max_set_age[2-10]
[gw1] [ 40%] PASSED test_storage_s3_queue/test.py::test_max_set_age[3-10]
test_storage_s3_queue/test.py::test_max_set_age[4-10]
[gw2] [ 50%] PASSED test_storage_s3_queue/test.py::test_max_set_age[5-10]
test_storage_s3_queue/test.py::test_max_set_age[6-10]
[gw3] [ 60%] PASSED test_storage_s3_queue/test.py::test_max_set_age[8-10]
[gw4] [ 70%] PASSED test_storage_s3_queue/test.py::test_max_set_age[10-10]
[gw0] [ 80%] PASSED test_storage_s3_queue/test.py::test_max_set_age[2-10]
[gw1] [ 90%] PASSED test_storage_s3_queue/test.py::test_max_set_age[4-10]
[gw2] [100%] PASSED test_storage_s3_queue/test.py::test_max_set_age[6-10]
========================================================================== 10 passed in 120.65s (0:02:00) ==========================================================================

Rebuilding the docker containers

The main container used for integration tests lives in docker/test/integration/base/Dockerfile. Rebuild it with

cd docker/test/integration/base
docker build -t clickhouse/integration-test .

The helper container used by the runner script is in docker/test/integration/runner/Dockerfile. It can be rebuild with

cd docker/test/integration/runner
docker build -t clickhouse/integration-test-runner .

If your docker configuration doesn't allow access to public internet with docker build command you may also need to add option --network=host if you rebuild image for a local integration testsing.

Adding new tests

To add new test named foo, create a directory test_foo with an empty __init__.py and a file named test.py containing tests in it. All functions with names starting with test will become test cases.

helpers directory contains utilities for:

  • Launching a ClickHouse cluster with or without ZooKeeper in docker containers.
  • Sending queries to launched instances.
  • Introducing network failures such as severing network link between two instances.

To assert that two TSV files must be equal, wrap them in the TSV class and use the regular assert statement. Example: assert TSV(result) == TSV(reference). In case the assertion fails, pytest will automagically detect the types of variables and only the small diff of two files is printed.

Troubleshooting

If tests failing for mysterious reasons, this may help:

sudo service docker stop
sudo bash -c 'rm -rf /var/lib/docker/*'
sudo service docker start

iptables-nft

On Ubuntu 20.10 and later in host network mode (default) one may encounter problem with nested containers not seeing each other. It happens because legacy and nftables rules are out of sync. Problem can be solved by:

sudo iptables -P FORWARD ACCEPT