2017-12-28 15:13:23 +00:00
# GraphiteMergeTree
2019-01-18 16:07:48 +00:00
This engine is designed for thinning and aggregating/averaging (rollup) [Graphite ](http://graphite.readthedocs.io/en/latest/index.html ) data. It may be helpful to developers who want to use ClickHouse as a data store for Graphite.
2017-12-28 15:13:23 +00:00
2018-10-19 11:25:22 +00:00
You can use any ClickHouse table engine to store the Graphite data if you don't need rollup, but if you need a rollup use `GraphiteMergeTree` . The engine reduces the volume of storage and increases the efficiency of queries from Graphite.
2017-12-28 15:13:23 +00:00
2018-12-12 17:28:00 +00:00
The engine inherits properties from [MergeTree ](mergetree.md ).
2017-12-28 15:13:23 +00:00
2018-10-19 11:25:22 +00:00
## Creating a Table
2017-12-28 15:13:23 +00:00
2018-10-19 11:25:22 +00:00
```sql
CREATE TABLE [IF NOT EXISTS] [db.]table_name [ON CLUSTER cluster]
(
Path String,
Time DateTime,
Value < Numeric_type > ,
Version < Numeric_type >
...
) ENGINE = GraphiteMergeTree(config_section)
[PARTITION BY expr]
[ORDER BY expr]
[SAMPLE BY expr]
[SETTINGS name=value, ...]
```
2018-12-12 17:28:00 +00:00
For a description of request parameters, see [request description ](../../query_language/create.md ).
2018-10-19 11:25:22 +00:00
A table for the Graphite date should have the following columns:
- Column with the metric name (Graphite sensor). Data type: `String` .
2019-01-18 16:07:48 +00:00
- Column with the time of measuring the metric. Data type: `DateTime` .
2018-10-19 11:25:22 +00:00
- Column with the value of the metric. Data type: any numeric.
2019-01-18 16:07:48 +00:00
- Column with the version of the metric. Data type: any numeric.
2018-10-19 11:25:22 +00:00
ClickHouse saves the rows with the highest version or the last written if versions are the same. Other rows are deleted during the merge of data parts.
The names of these columns should be set in the rollup configuration.
**GraphiteMergeTree parameters**
- `config_section` — Name of the section in the configuration file, where are the rules of rollup set.
**Query clauses**
2019-01-18 16:07:48 +00:00
When creating a `GraphiteMergeTree` table, the same [clauses ](mergetree.md#table_engine-mergetree-creating-a-table ) are required, as when creating a `MergeTree` table.
2018-10-19 11:25:22 +00:00
< details markdown = "1" > < summary > Deprecated Method for Creating a Table< / summary >
2017-12-28 15:13:23 +00:00
2018-10-19 11:25:22 +00:00
!!! attention
Do not use this method in new projects and, if possible, switch the old projects to the method described above.
2017-12-28 15:13:23 +00:00
2018-10-19 11:25:22 +00:00
```sql
CREATE TABLE [IF NOT EXISTS] [db.]table_name [ON CLUSTER cluster]
(
EventDate Date,
Path String,
Time DateTime,
Value < Numeric_type > ,
Version < Numeric_type >
...
) ENGINE [=] GraphiteMergeTree(date-column [, sampling_expression], (primary, key), index_granularity, config_section)
```
All of the parameters excepting `config_section` have the same meaning as in `MergeTree` .
2017-12-28 15:13:23 +00:00
2018-10-19 11:25:22 +00:00
- `config_section` — Name of the section in the configuration file, where are the rules of rollup set.
< / details >
2017-12-28 15:13:23 +00:00
2018-10-19 11:25:22 +00:00
## Rollup configuration
2017-12-28 15:13:23 +00:00
2019-01-18 16:07:48 +00:00
The settings for rollup are defined by the [graphite_rollup ](../server_settings/settings.md#server_settings-graphite_rollup ) parameter in the server configuration. The name of the parameter could be any. You can create several configurations and use them for different tables.
2017-12-28 15:13:23 +00:00
2018-10-19 11:25:22 +00:00
Rollup configuration structure:
2017-12-28 15:13:23 +00:00
2018-10-16 10:47:17 +00:00
```
2018-10-19 11:25:22 +00:00
required-columns
2017-12-28 15:13:23 +00:00
pattern
regexp
function
2018-10-19 11:25:22 +00:00
age + precision
2017-12-28 15:13:23 +00:00
...
pattern
...
default
function
2018-10-19 11:25:22 +00:00
age + precision
2017-12-28 15:13:23 +00:00
...
```
2018-10-19 11:25:22 +00:00
When processing a row, ClickHouse checks the rules in the `pattern` section. If the metric name matches the `regexp` , the rules from the `pattern` section are applied; otherwise, the rules from the `default` section are used.
2017-12-28 15:13:23 +00:00
2018-10-19 11:25:22 +00:00
The rules are defined with fields `function` and `age + precision` .
2017-12-28 15:13:23 +00:00
2018-10-19 11:25:22 +00:00
Fields for `pattern` and `default` sections:
- `regexp` – A pattern for the metric name.
2017-12-28 15:13:23 +00:00
- `age` – The minimum age of the data in seconds.
- `precision` – How precisely to define the age of the data in seconds.
2018-10-19 11:25:22 +00:00
- `function` – The name of the aggregating function to apply to data whose age falls within the range `[age, age + precision]` .
The `required-columns` :
- `path_column_name` — Column with the metric name (Graphite sensor).
2019-01-18 16:07:48 +00:00
- `time_column_name` — Column with the time of measuring the metric.
2018-10-19 11:25:22 +00:00
- `value_column_name` — Column with the value of the metric at the time set in `time_column_name` .
2019-01-18 16:07:48 +00:00
- `version_column_name` — Column with the version of the metric.
2017-12-28 15:13:23 +00:00
Example of settings:
```xml
< graphite_rollup >
2018-10-19 11:25:22 +00:00
< path_column_name > Path< / path_column_name >
< time_column_name > Time< / time_column_name >
< value_column_name > Value< / value_column_name >
< version_column_name > Version< / version_column_name >
2017-12-28 15:13:23 +00:00
< pattern >
< regexp > click_cost< / regexp >
< function > any< / function >
< retention >
< age > 0< / age >
< precision > 5< / precision >
< / retention >
< retention >
< age > 86400< / age >
< precision > 60< / precision >
< / retention >
< / pattern >
< default >
< function > max< / function >
< retention >
< age > 0< / age >
< precision > 60< / precision >
< / retention >
< retention >
< age > 3600< / age >
< precision > 300< / precision >
< / retention >
< retention >
< age > 86400< / age >
< precision > 3600< / precision >
< / retention >
< / default >
< / graphite_rollup >
```
2018-04-23 06:20:21 +00:00
2018-10-16 10:47:17 +00:00
[Original article ](https://clickhouse.yandex/docs/en/operations/table_engines/graphitemergetree/ ) <!--hide-->