ClickHouse/docs/en/engines/table-engines/integrations/hudi.md
Robert Schulze cdf28f9b71
Minor fixups
2023-04-19 16:16:51 +00:00

1.6 KiB

slug sidebar_label
/en/engines/table-engines/integrations/hudi Hudi

Hudi Table Engine

This engine provides a read-only integration with existing Apache Hudi tables in Amazon S3.

Create Table

Note that the Hudi table must already exist in S3, this command does not take DDL parameters to create a new table.

CREATE TABLE hudi_table
    ENGINE = Hudi(url, [aws_access_key_id, aws_secret_access_key,])

Engine parameters

  • url — Bucket url with the path to an existing Hudi table.
  • aws_access_key_id, aws_secret_access_key - Long-term credentials for the AWS account user. You can use these to authenticate your requests. Parameter is optional. If credentials are not specified, they are used from the configuration file.

Engine parameters can be specified using Named Collections

Example

CREATE TABLE hudi_table ENGINE=Hudi('http://mars-doc-test.s3.amazonaws.com/clickhouse-bucket-3/test_table/', 'ABC123', 'Abc+123')

Using named collections:

<clickhouse>
    <named_collections>
        <hudi_conf>
            <url>http://mars-doc-test.s3.amazonaws.com/clickhouse-bucket-3/</url>
            <access_key_id>ABC123<access_key_id>
            <secret_access_key>Abc+123</secret_access_key>
        </hudi_conf>
    </named_collections>
</clickhouse>
CREATE TABLE hudi_table ENGINE=Hudi(hudi_conf, filename = 'test_table')

See also