mirror of
https://github.com/ClickHouse/ClickHouse.git
synced 2024-10-24 17:30:49 +00:00
150 lines
5.2 KiB
Markdown
150 lines
5.2 KiB
Markdown
|
<a name="table_engines-graphitemergetree"></a>
|
|||
|
|
|||
|
# GraphiteMergeTree
|
|||
|
|
|||
|
This engine is designed for rollup (thinning and aggregating/averaging) [Graphite](http://graphite.readthedocs.io/en/latest/index.html) data. It may be helpful to developers who want to use ClickHouse as a data store for Graphite.
|
|||
|
|
|||
|
You can use any ClickHouse table engine to store the Graphite data if you don't need rollup, but if you need a rollup use `GraphiteMergeTree`. The engine reduces the volume of storage and increases the efficiency of queries from Graphite.
|
|||
|
|
|||
|
The engine inherits properties from [MergeTree](mergetree.md#table_engines-mergetree).
|
|||
|
|
|||
|
## Creating a Table
|
|||
|
|
|||
|
```sql
|
|||
|
CREATE TABLE [IF NOT EXISTS] [db.]table_name [ON CLUSTER cluster]
|
|||
|
(
|
|||
|
Path String,
|
|||
|
Time DateTime,
|
|||
|
Value <Numeric_type>,
|
|||
|
Version <Numeric_type>
|
|||
|
...
|
|||
|
) ENGINE = GraphiteMergeTree(config_section)
|
|||
|
[PARTITION BY expr]
|
|||
|
[ORDER BY expr]
|
|||
|
[SAMPLE BY expr]
|
|||
|
[SETTINGS name=value, ...]
|
|||
|
```
|
|||
|
|
|||
|
For a description of request parameters, see [request description](../../query_language/create.md#query_language-queries-create_table).
|
|||
|
|
|||
|
A table for the Graphite date should have the following columns:
|
|||
|
|
|||
|
- Column with the metric name (Graphite sensor). Data type: `String`.
|
|||
|
- Column with the time for measuring the metric. Data type: `DateTime`.
|
|||
|
- Column with the value of the metric. Data type: any numeric.
|
|||
|
- Column with the version of the metric with the same name and time of measurement. Data type: any numeric.
|
|||
|
|
|||
|
ClickHouse saves the rows with the highest version or the last written if versions are the same. Other rows are deleted during the merge of data parts.
|
|||
|
|
|||
|
The names of these columns should be set in the rollup configuration.
|
|||
|
|
|||
|
**GraphiteMergeTree parameters**
|
|||
|
|
|||
|
- `config_section` — Name of the section in the configuration file, where are the rules of rollup set.
|
|||
|
|
|||
|
**Query clauses**
|
|||
|
|
|||
|
When creating a `GraphiteMergeTree` table, the same [clauses](mergetree.md#table_engines-mergetree-configuring) are required, as when creating a `MergeTree` table.
|
|||
|
|
|||
|
<details markdown="1"><summary>Deprecated Method for Creating a Table</summary>
|
|||
|
|
|||
|
!!! attention
|
|||
|
Do not use this method in new projects and, if possible, switch the old projects to the method described above.
|
|||
|
|
|||
|
```sql
|
|||
|
CREATE TABLE [IF NOT EXISTS] [db.]table_name [ON CLUSTER cluster]
|
|||
|
(
|
|||
|
EventDate Date,
|
|||
|
Path String,
|
|||
|
Time DateTime,
|
|||
|
Value <Numeric_type>,
|
|||
|
Version <Numeric_type>
|
|||
|
...
|
|||
|
) ENGINE [=] GraphiteMergeTree(date-column [, sampling_expression], (primary, key), index_granularity, config_section)
|
|||
|
```
|
|||
|
|
|||
|
All of the parameters excepting `config_section` have the same meaning as in `MergeTree`.
|
|||
|
|
|||
|
- `config_section` — Name of the section in the configuration file, where are the rules of rollup set.
|
|||
|
</details>
|
|||
|
|
|||
|
## Rollup configuration
|
|||
|
|
|||
|
The settings for rollup are defined by the [graphite_rollup](../server_settings/settings.md#server_settings-graphite_rollup) parameter in the server configuration. The name of the parameter could be any. You can create several configurations and use them for different tables.
|
|||
|
|
|||
|
Rollup configuration structure:
|
|||
|
|
|||
|
```
|
|||
|
required-columns
|
|||
|
pattern
|
|||
|
regexp
|
|||
|
function
|
|||
|
age + precision
|
|||
|
...
|
|||
|
pattern
|
|||
|
...
|
|||
|
default
|
|||
|
function
|
|||
|
age + precision
|
|||
|
...
|
|||
|
```
|
|||
|
|
|||
|
When processing a row, ClickHouse checks the rules in the `pattern` section. If the metric name matches the `regexp`, the rules from the `pattern`section are applied; otherwise, the rules from the `default` section are used.
|
|||
|
|
|||
|
The rules are defined with fields `function` and `age + precision`.
|
|||
|
|
|||
|
Fields for `pattern` and `default` sections:
|
|||
|
|
|||
|
- `regexp`– A pattern for the metric name.
|
|||
|
- `age` – The minimum age of the data in seconds.
|
|||
|
- `precision`– How precisely to define the age of the data in seconds.
|
|||
|
- `function` – The name of the aggregating function to apply to data whose age falls within the range `[age, age + precision]`.
|
|||
|
|
|||
|
The `required-columns`:
|
|||
|
|
|||
|
- `path_column_name` — Column with the metric name (Graphite sensor).
|
|||
|
- `time_column_name` — Column with the time for measuring the metric.
|
|||
|
- `value_column_name` — Column with the value of the metric at the time set in `time_column_name`.
|
|||
|
- `version_column_name` — Column with the version timestamp of the metric with the same name and time remains in the database.
|
|||
|
|
|||
|
|
|||
|
Example of settings:
|
|||
|
|
|||
|
```xml
|
|||
|
<graphite_rollup>
|
|||
|
<path_column_name>Path</path_column_name>
|
|||
|
<time_column_name>Time</time_column_name>
|
|||
|
<value_column_name>Value</value_column_name>
|
|||
|
<version_column_name>Version</version_column_name>
|
|||
|
<pattern>
|
|||
|
<regexp>click_cost</regexp>
|
|||
|
<function>any</function>
|
|||
|
<retention>
|
|||
|
<age>0</age>
|
|||
|
<precision>5</precision>
|
|||
|
</retention>
|
|||
|
<retention>
|
|||
|
<age>86400</age>
|
|||
|
<precision>60</precision>
|
|||
|
</retention>
|
|||
|
</pattern>
|
|||
|
<default>
|
|||
|
<function>max</function>
|
|||
|
<retention>
|
|||
|
<age>0</age>
|
|||
|
<precision>60</precision>
|
|||
|
</retention>
|
|||
|
<retention>
|
|||
|
<age>3600</age>
|
|||
|
<precision>300</precision>
|
|||
|
</retention>
|
|||
|
<retention>
|
|||
|
<age>86400</age>
|
|||
|
<precision>3600</precision>
|
|||
|
</retention>
|
|||
|
</default>
|
|||
|
</graphite_rollup>
|
|||
|
```
|
|||
|
|
|||
|
[Original article](https://clickhouse.yandex/docs/en/operations/table_engines/graphitemergetree/) <!--hide-->
|