ClickHouse/docs/en/engines/table-engines/integrations/deltalake.md

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

58 lines
1.9 KiB
Markdown
Raw Normal View History

2023-01-05 20:54:44 +00:00
---
slug: /en/engines/table-engines/integrations/deltalake
sidebar_position: 40
2023-01-05 20:54:44 +00:00
sidebar_label: DeltaLake
---
# DeltaLake Table Engine
2023-01-10 21:09:59 +00:00
This engine provides a read-only integration with existing [Delta Lake](https://github.com/delta-io/delta) tables in Amazon S3.
2023-01-05 20:54:44 +00:00
## Create Table
Note that the Delta Lake table must already exist in S3, this command does not take DDL parameters to create a new table.
``` sql
CREATE TABLE deltalake
2023-01-11 12:53:37 +00:00
ENGINE = DeltaLake(url, [aws_access_key_id, aws_secret_access_key,])
2023-01-05 20:54:44 +00:00
```
**Engine parameters**
- `url` — Bucket url with path to the existing Delta Lake table.
- `aws_access_key_id`, `aws_secret_access_key` - Long-term credentials for the [AWS](https://aws.amazon.com/) account user. You can use these to authenticate your requests. Parameter is optional. If credentials are not specified, they are used from the configuration file.
2023-02-22 11:01:18 +00:00
2023-07-27 06:42:38 +00:00
Engine parameters can be specified using [Named Collections](/docs/en/operations/named-collections.md).
2023-01-05 20:54:44 +00:00
**Example**
```sql
CREATE TABLE deltalake ENGINE=DeltaLake('http://mars-doc-test.s3.amazonaws.com/clickhouse-bucket-3/test_table/', 'ABC123', 'Abc+123')
```
2023-02-22 11:01:18 +00:00
Using named collections:
``` xml
<clickhouse>
<named_collections>
<deltalake_conf>
<url>http://mars-doc-test.s3.amazonaws.com/clickhouse-bucket-3/</url>
<access_key_id>ABC123<access_key_id>
<secret_access_key>Abc+123</secret_access_key>
</deltalake_conf>
</named_collections>
</clickhouse>
```
```sql
CREATE TABLE deltalake ENGINE=DeltaLake(deltalake_conf, filename = 'test_table')
2023-02-22 11:01:18 +00:00
```
2024-10-10 05:40:08 +00:00
### Data cache {#data-cache}
`Iceberg` table engine and table function support data caching same as `S3`, `AzureBlobStorage`, `HDFS` storages. See [here](../../../engines/table-engines/integrations/s3.md#data-cache).
2023-01-05 20:54:44 +00:00
## See also
2023-04-19 16:10:51 +00:00
- [deltaLake table function](../../../sql-reference/table-functions/deltalake.md)