ClickHouse/docs/en/sql-reference/statements/select/from.md
Thom O'Connor 6e0e4d154d
Update from.md
Updated the SELECT...FROM...FINAL documentation to add better guidance to the use of FINAL, rather than saying "avoid using it"
2023-12-21 12:01:00 -07:00

3.1 KiB
Raw Blame History

slug sidebar_label
/en/sql-reference/statements/select/from FROM

FROM Clause

The FROM clause specifies the source to read data from:

JOIN and ARRAY JOIN clauses may also be used to extend the functionality of the FROM clause.

Subquery is another SELECT query that may be specified in parenthesis inside FROM clause.

FROM clause can contain multiple data sources, separated by commas, which is equivalent of performing CROSS JOIN on them.

FINAL Modifier

When FINAL is specified, ClickHouse fully merges the data before returning the result and thus performs all data transformations that happen during merges for the given table engine.

It is applicable when selecting data from ReplacingMergeTree, SummingMergeTree, AggregatingMergeTree, CollapsingMergeTree and VersionedCollapsingMergeTree tables.

SELECT queries with FINAL are executed in parallel. The max_final_threads setting limits the number of threads used.

There are drawbacks to using FINAL (see below).

Drawbacks

Queries that use FINAL are executed slightly slower than similar queries that do not, because:

  • Data is merged during query execution.
  • Queries with FINAL read primary key columns in addition to the columns specified in the query.

FINAL requires additional compute and memory resources, as the processing that normally would occur at merge time must occur in memory at the time of the query. However, using FINAL is sometimes necessary in order to produce accurate results, and is less expensive than running OPTIMZIE to force a merge. It is also sometimes possible to use different queries that assume the background processes of the MergeTree engine havent happened yet and deal with it by applying aggregation (for example, to discard duplicates). If you need to use FINAL in your queries in order to get the required results, then it is okay to do so but be aware of the additional processing required.

FINAL can be applied automatically using FINAL setting to all tables in a query using a session or a user profile.

Implementation Details

If the FROM clause is omitted, data will be read from the system.one table. The system.one table contains exactly one row (this table fulfills the same purpose as the DUAL table found in other DBMSs).

To execute a query, all the columns listed in the query are extracted from the appropriate table. Any columns not needed for the external query are thrown out of the subqueries. If a query does not list any columns (for example, SELECT count() FROM t), some column is extracted from the table anyway (the smallest one is preferred), in order to calculate the number of rows.