ClickHouse/docs/en/engines/table-engines/special/join.md

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

165 lines
5.4 KiB
Markdown
Raw Normal View History

2020-04-03 13:23:32 +00:00
---
2022-08-28 14:53:34 +00:00
slug: /en/engines/table-engines/special/join
sidebar_position: 70
sidebar_label: Join
2020-04-03 13:23:32 +00:00
---
2022-06-02 10:55:18 +00:00
# Join Table Engine
2017-04-03 19:49:50 +00:00
2022-11-09 00:17:58 +00:00
Optional prepared data structure for usage in [JOIN](/docs/en/sql-reference/statements/select/join.md/#select-join) operations.
2020-06-10 20:14:00 +00:00
:::note
2022-11-09 00:17:58 +00:00
This is not an article about the [JOIN clause](/docs/en/sql-reference/statements/select/join.md/#select-join) itself.
:::
2020-03-18 18:43:51 +00:00
## Creating a Table {#creating-a-table}
2020-03-20 10:10:48 +00:00
``` sql
CREATE TABLE [IF NOT EXISTS] [db.]table_name [ON CLUSTER cluster]
(
name1 [type1] [DEFAULT|MATERIALIZED|ALIAS expr1] [TTL expr1],
name2 [type2] [DEFAULT|MATERIALIZED|ALIAS expr2] [TTL expr2],
) ENGINE = Join(join_strictness, join_type, k1[, k2, ...])
```
2022-11-09 00:17:58 +00:00
See the detailed description of the [CREATE TABLE](/docs/en/sql-reference/statements/create/table.md/#create-table-query) query.
2022-06-24 16:16:20 +00:00
## Engine Parameters
2022-06-24 16:16:20 +00:00
### join_strictness
2022-11-09 00:17:58 +00:00
`join_strictness` [JOIN strictness](/docs/en/sql-reference/statements/select/join.md/#select-join-types).
2022-06-24 16:16:20 +00:00
### join_type
2022-11-09 00:17:58 +00:00
`join_type` [JOIN type](/docs/en/sql-reference/statements/select/join.md/#select-join-types).
2022-06-24 16:16:20 +00:00
### Key columns
`k1[, k2, ...]` Key columns from the `USING` clause that the `JOIN` operation is made with.
2021-05-27 19:44:11 +00:00
Enter `join_strictness` and `join_type` parameters without quotes, for example, `Join(ANY, LEFT, col1)`. They must match the `JOIN` operation that the table will be used for. If the parameters do not match, ClickHouse does not throw an exception and may return incorrect data.
2021-08-01 05:29:29 +00:00
## Specifics and Recommendations {#specifics-and-recommendations}
2021-08-01 05:29:29 +00:00
### Data Storage {#data-storage}
`Join` table data is always located in the RAM. When inserting rows into a table, ClickHouse writes data blocks to the directory on the disk so that they can be restored when the server restarts.
If the server restarts incorrectly, the data block on the disk might get lost or damaged. In this case, you may need to manually delete the file with damaged data.
### Selecting and Inserting Data {#selecting-and-inserting-data}
You can use `INSERT` queries to add data to the `Join`-engine tables. If the table was created with the `ANY` strictness, data for duplicate keys are ignored. With the `ALL` strictness, all rows are added.
Main use-cases for `Join`-engine tables are following:
2021-08-01 05:29:29 +00:00
- Place the table to the right side in a `JOIN` clause.
- Call the [joinGet](/docs/en/sql-reference/functions/other-functions.md/#joinget) function, which lets you extract data from the table the same way as from a dictionary.
2021-08-01 05:29:29 +00:00
### Deleting Data {#deleting-data}
2022-11-16 02:32:44 +00:00
`ALTER DELETE` queries for `Join`-engine tables are implemented as [mutations](/docs/en/sql-reference/statements/alter/index.md#mutations). `DELETE` mutation reads filtered data and overwrites data of memory and disk.
2021-08-01 05:29:29 +00:00
### Limitations and Settings {#join-limitations-and-settings}
When creating a table, the following settings are applied:
2022-06-24 16:16:20 +00:00
#### join_use_nulls
2022-11-09 00:17:58 +00:00
[join_use_nulls](/docs/en/operations/settings/settings.md/#join_use_nulls)
2022-06-24 16:16:20 +00:00
#### max_rows_in_join
2022-11-09 00:17:58 +00:00
[max_rows_in_join](/docs/en/operations/settings/query-complexity.md/#settings-max_rows_in_join)
2022-06-24 16:16:20 +00:00
#### max_bytes_in_join
2022-11-09 00:17:58 +00:00
[max_bytes_in_join](/docs/en/operations/settings/query-complexity.md/#settings-max_bytes_in_join)
2022-06-24 16:16:20 +00:00
#### join_overflow_mode
2022-11-09 00:17:58 +00:00
[join_overflow_mode](/docs/en/operations/settings/query-complexity.md/#settings-join_overflow_mode)
2022-06-24 16:16:20 +00:00
#### join_any_take_last_row
2024-04-29 03:36:45 +00:00
[join_any_take_last_row](/docs/en/operations/settings/settings.md/#join_any_take_last_row)
2022-06-24 16:16:20 +00:00
#### join_use_nulls
2023-01-06 22:01:28 +00:00
#### persistent
Disables persistency for the Join and [Set](/docs/en/engines/table-engines/special/set.md) table engines.
Reduces the I/O overhead. Suitable for scenarios that pursue performance and do not require persistence.
Possible values:
- 1 — Enabled.
- 0 — Disabled.
Default value: `1`.
2021-08-01 05:29:29 +00:00
The `Join`-engine tables cant be used in `GLOBAL JOIN` operations.
2022-11-09 00:17:58 +00:00
The `Join`-engine allows to specify [join_use_nulls](/docs/en/operations/settings/settings.md/#join_use_nulls) setting in the `CREATE TABLE` statement. [SELECT](/docs/en/sql-reference/statements/select/index.md) query should have the same `join_use_nulls` value.
2021-08-01 05:29:29 +00:00
## Usage Examples {#example}
Creating the left-side table:
2020-03-20 10:10:48 +00:00
``` sql
2021-08-01 05:29:29 +00:00
CREATE TABLE id_val(`id` UInt32, `val` UInt32) ENGINE = TinyLog;
```
2020-03-20 10:10:48 +00:00
``` sql
2021-08-01 05:29:29 +00:00
INSERT INTO id_val VALUES (1,11)(2,12)(3,13);
```
CLICKHOUSE-2720: progress on website (#865) * update presentations * CLICKHOUSE-2936: redirect from clickhouse.yandex.ru and clickhouse.yandex.com * update submodule * lost files * CLICKHOUSE-2981: prefer sphinx docs over original reference * CLICKHOUSE-2981: docs styles more similar to main website + add flags to switch language links * update presentations * Less confusing directory structure (docs -> doc/reference/) * Minify sphinx docs too * Website release script: fail fast + pass docker hash on deploy * Do not underline links in docs * shorter * cleanup docker images * tune nginx config * CLICKHOUSE-3043: get rid of habrastorage links * Lost translation * CLICKHOUSE-2936: temporary client-side redirect * behaves weird in test * put redirect back * CLICKHOUSE-3047: copy docs txts to public too * move to proper file * remove old pages to avoid confusion * Remove reference redirect warning for now * Refresh README.md * Yellow buttons in docs * Use svg flags instead of unicode ones in docs * fix test website instance * Put flags to separate files * wrong flag * Copy Yandex.Metrica introduction from main page to docs * Yet another home page structure change, couple new blocks (CLICKHOUSE-3045) * Update Contacts section * CLICKHOUSE-2849: more detailed legal information * CLICKHOUSE-2978 preparation - split by files * More changes in Contacts block * Tune texts on index page * update presentations * One more benchmark * Add usage sections to index page, adapted from slides * Get the roadmap started, based on slides from last ClickHouse Meetup * CLICKHOUSE-2977: some rendering tuning * Get rid of excessive section in the end of getting started * Make headers linkable * CLICKHOUSE-2981: links to editing reference - https://github.com/yandex/ClickHouse/issues/849 * CLICKHOUSE-2981: fix mobile styles in docs * Ban crawling of duplicating docs * Open some external links in new tab * Ban old docs too * Lots of trivial fixes in english docs * Lots of trivial fixes in russian docs * Remove getting started copies in markdown * Add Yandex.Webmaster * Fix some sphinx warnings * More warnings fixed in english docs * More sphinx warnings fixed * Add code-block:: text * More code-block:: text * These headers look not that well * Better switch between documentation languages * merge use_case.rst into ya_metrika_task.rst * Edit the agg_functions.rst texts * Add lost empty lines
2017-06-13 04:15:47 +00:00
Creating the right-side `Join` table:
2017-04-03 19:49:50 +00:00
2020-03-20 10:10:48 +00:00
``` sql
2021-08-01 05:29:29 +00:00
CREATE TABLE id_val_join(`id` UInt32, `val` UInt8) ENGINE = Join(ANY, LEFT, id);
```
2020-03-20 10:10:48 +00:00
``` sql
2021-08-01 05:29:29 +00:00
INSERT INTO id_val_join VALUES (1,21)(1,22)(3,23);
```
2017-04-03 19:49:50 +00:00
Joining the tables:
2020-03-20 10:10:48 +00:00
``` sql
2021-08-01 05:29:29 +00:00
SELECT * FROM id_val ANY LEFT JOIN id_val_join USING (id);
```
2020-03-20 10:10:48 +00:00
``` text
┌─id─┬─val─┬─id_val_join.val─┐
│ 1 │ 11 │ 21 │
2021-08-01 05:29:29 +00:00
│ 2 │ 12 │ 0 │
│ 3 │ 13 │ 23 │
└────┴─────┴─────────────────┘
```
2017-04-03 19:49:50 +00:00
As an alternative, you can retrieve data from the `Join` table, specifying the join key value:
2020-03-20 10:10:48 +00:00
``` sql
2021-08-01 05:29:29 +00:00
SELECT joinGet('id_val_join', 'val', toUInt32(1));
```
2020-03-20 10:10:48 +00:00
``` text
┌─joinGet('id_val_join', 'val', toUInt32(1))─┐
│ 21 │
└────────────────────────────────────────────┘
```
2021-08-01 05:29:29 +00:00
Deleting a row from the `Join` table:
2021-08-01 05:29:29 +00:00
```sql
ALTER TABLE id_val_join DELETE WHERE id = 3;
```
2021-08-01 05:29:29 +00:00
```text
┌─id─┬─val─┐
│ 1 │ 21 │
└────┴─────┘
```