ClickHouse/tests/integration/compose/docker_compose_hdfs.yml

version: '2.3'
services:
    hdfs1:
        image: prasanthj/docker-hadoop:2.6.0
        hostname: hdfs1
        restart: always
        expose:
            - ${HDFS_NAME_PORT:-50070}
            - ${HDFS_DATA_PORT:-50075}
        entrypoint: /etc/bootstrap.sh -d
        volumes:
            - type: ${HDFS_FS:-tmpfs}
              source: ${HDFS_LOGS:-}
              target: /usr/local/hadoop/logs
        sysctls:
            net.ipv4.ip_local_port_range: '55000 65535'
Bump compose version to 2.3, and make tmpfs for zookeeper optional 2020-05-19 15:27:10 +00:00			`version: '2.3'`
Add integration test, put dependent libs to contrib, slightly refine code. 2018-12-05 13:24:45 +00:00			`services:`
			`hdfs1:`
Fix deprecated HDFS image and harden test_storage_hdfs. 2024-07-24 19:55:03 +00:00			`image: prasanthj/docker-hadoop:2.6.0`
HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities 2020-09-28 17:20:04 +00:00			`hostname: hdfs1`
Add integration test, put dependent libs to contrib, slightly refine code. 2018-12-05 13:24:45 +00:00			`restart: always`
wip 2021-06-09 09:23:02 +00:00			`expose:`
Fix compose files to work without correct environment 2023-01-02 16:45:50 +00:00			`- ${HDFS_NAME_PORT:-50070}`
			`- ${HDFS_DATA_PORT:-50075}`
Add integration test, put dependent libs to contrib, slightly refine code. 2018-12-05 13:24:45 +00:00			`entrypoint: /etc/bootstrap.sh -d`
wip 2021-02-18 21:21:50 +00:00			`volumes:`
			`- type: ${HDFS_FS:-tmpfs}`
			`source: ${HDFS_LOGS:-}`
Fix compose files to work without correct environment 2023-01-02 16:45:50 +00:00			`target: /usr/local/hadoop/logs`
tests: adjust net.ipv4.ip_local_port_range for some services to avoid EADDRINUSE As it turns out, docker does not pass through the sysctls, so adjust this for know users of unprivileged ports (>32K): - HDFS - kafka Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com> 2023-08-02 09:08:47 +00:00			`sysctls:`
			`net.ipv4.ip_local_port_range: '55000 65535'`