ClickHouse/docs/en/engines/table-engines/integrations/hudi.md

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

53 lines
1.6 KiB
Markdown
Raw Normal View History

2023-01-10 21:59:34 +00:00
---
slug: /en/engines/table-engines/integrations/hudi
sidebar_label: Hudi
---
# Hudi Table Engine
This engine provides a read-only integration with existing Apache [Hudi](https://hudi.apache.org/) tables in Amazon S3.
## Create Table
Note that the Hudi table must already exist in S3, this command does not take DDL parameters to create a new table.
``` sql
CREATE TABLE hudi_table
ENGINE = Hudi(url, [aws_access_key_id, aws_secret_access_key,])
2023-01-10 21:59:34 +00:00
```
**Engine parameters**
- `url` — Bucket url with the path to an existing Hudi table.
2023-02-22 11:01:18 +00:00
- `aws_access_key_id`, `aws_secret_access_key` - Long-term credentials for the [AWS](https://aws.amazon.com/) account user. You can use these to authenticate your requests. Parameter is optional. If credentials are not specified, they are used from the configuration file.
2023-02-22 12:57:30 +00:00
Engine parameters can be specified using [Named Collections](../../../operations/named-collections.md)
2023-01-10 21:59:34 +00:00
**Example**
```sql
CREATE TABLE hudi_table ENGINE=Hudi('http://mars-doc-test.s3.amazonaws.com/clickhouse-bucket-3/test_table/', 'ABC123', 'Abc+123')
```
2023-02-22 11:01:18 +00:00
Using named collections:
``` xml
<clickhouse>
<named_collections>
<hudi_conf>
<url>http://mars-doc-test.s3.amazonaws.com/clickhouse-bucket-3/</url>
<access_key_id>ABC123<access_key_id>
<secret_access_key>Abc+123</secret_access_key>
</hudi_conf>
</named_collections>
</clickhouse>
```
```sql
CREATE TABLE hudi_table ENGINE=Hudi(hudi_conf, filename = 'test_table')
2023-02-22 11:01:18 +00:00
```
2023-01-10 21:59:34 +00:00
## See also
- [hudi table function](/docs/en/sql-reference/table-functions/hudi.md)