mirror of
https://github.com/ClickHouse/ClickHouse.git
synced 2024-12-16 11:22:12 +00:00
165 lines
3.7 KiB
Markdown
165 lines
3.7 KiB
Markdown
---
|
|
slug: /en/engines/table-engines/integrations/mongodb
|
|
sidebar_position: 135
|
|
sidebar_label: MongoDB
|
|
---
|
|
|
|
# MongoDB
|
|
|
|
MongoDB engine is read-only table engine which allows to read data from remote MongoDB collection.
|
|
|
|
Only MongoDB v3.6+ servers are supported.
|
|
|
|
## Types mappings
|
|
|
|
| MongoDB | ClickHouse |
|
|
|-------------|------------------------------------|
|
|
| bool | UInt8, String |
|
|
| int32 | Int32, String |
|
|
| int64 | Int64, String |
|
|
| double | Float64, String |
|
|
| date | Date, DateTime, DateTime64, String |
|
|
| timestamp | Date, DateTime, DateTime64, String |
|
|
| string | String, UUID |
|
|
| document | String(as JSON) |
|
|
| array | Array, String(as JSON) |
|
|
| oid | String |
|
|
| *any other* | String |
|
|
|
|
If key not found in MongoDB document, default value or null(if the column is nullable) will be inserted.
|
|
|
|
## Supported clauses
|
|
*Hint: you can use MongoDB table in CTE to perform any clauses, but be aware, that in some cases, performance will be significantly degraded.*
|
|
|
|
### WHERE
|
|
Only constant literals are allowed.
|
|
|
|
Types that can be used in WHERE section:
|
|
* Null
|
|
* UInt64
|
|
* Int64
|
|
* Float64
|
|
* String
|
|
* Array
|
|
* Tuple
|
|
* Map
|
|
* UUID
|
|
* Bool
|
|
* Object
|
|
|
|
PREWHERE and HAVING are not supported.
|
|
|
|
### LIMIT and OFFSET
|
|
Only `LIMIT` is supported.
|
|
|
|
### ORDER BY
|
|
Simple expressions only are supported, without any modification like COLLATE, WITH, TO, etc.
|
|
|
|
### WINDOW
|
|
Not supported.
|
|
|
|
### GROUP BY
|
|
Not supported.
|
|
|
|
### Aggregation functions
|
|
Not supported.
|
|
|
|
|
|
## Creating a Table {#creating-a-table}
|
|
|
|
``` sql
|
|
CREATE TABLE [IF NOT EXISTS] [db.]table_name
|
|
(
|
|
name1 [type1],
|
|
name2 [type2],
|
|
...
|
|
) ENGINE = MongoDB(host:port, database, collection, user, password [, options]);
|
|
```
|
|
|
|
**Engine Parameters**
|
|
|
|
- `host:port` — MongoDB server address.
|
|
|
|
- `database` — Remote database name.
|
|
|
|
- `collection` — Remote collection name.
|
|
|
|
- `user` — MongoDB user.
|
|
|
|
- `password` — User password.
|
|
|
|
- `options` — MongoDB connection string options (optional parameter).
|
|
|
|
:::tip
|
|
If you are using the MongoDB Atlas cloud offering please add these options:
|
|
|
|
```
|
|
'connectTimeoutMS=10000&ssl=true&authSource=admin'
|
|
```
|
|
|
|
:::
|
|
|
|
Also, you can simply pass an URI:
|
|
``` sql
|
|
ENGINE = MongoDB(uri, collection);
|
|
```
|
|
|
|
**Engine Parameters**
|
|
|
|
- `uri` — MongoDB server's connection URI
|
|
|
|
- `collection` — Remote collection name.
|
|
|
|
## Usage Example {#usage-example}
|
|
|
|
Create a table in ClickHouse which allows to read data from MongoDB collection:
|
|
|
|
``` sql
|
|
CREATE TABLE mongo_table
|
|
(
|
|
key UInt64,
|
|
data String
|
|
) ENGINE = MongoDB('mongo1:27017', 'test', 'simple_table', 'testuser', 'clickhouse');
|
|
```
|
|
or
|
|
``` sql
|
|
ENGINE = MongoDB('mongodb://testuser:clickhouse@mongo1:27017/test', 'simple_table');
|
|
```
|
|
|
|
To read from an SSL secured MongoDB server:
|
|
|
|
``` sql
|
|
CREATE TABLE mongo_table_ssl
|
|
(
|
|
key UInt64,
|
|
data String
|
|
) ENGINE = MongoDB('mongo2:27017', 'test', 'simple_table', 'testuser', 'clickhouse', 'ssl=true');
|
|
```
|
|
|
|
Query:
|
|
|
|
``` sql
|
|
SELECT COUNT() FROM mongo_table;
|
|
```
|
|
|
|
``` text
|
|
┌─count()─┐
|
|
│ 4 │
|
|
└─────────┘
|
|
```
|
|
|
|
You can also adjust connection timeout:
|
|
|
|
``` sql
|
|
CREATE TABLE mongo_table
|
|
(
|
|
key UInt64,
|
|
data String
|
|
) ENGINE = MongoDB('mongo2:27017', 'test', 'simple_table', 'testuser', 'clickhouse', 'connectTimeoutMS=100000');
|
|
```
|
|
|
|
## Troubleshooting
|
|
You can see the generated MongoDB query in DEBUG level logs.
|
|
|
|
Implementation details can be found in [mongocxx](https://github.com/mongodb/mongo-cxx-driver) and [mongoc](https://github.com/mongodb/mongo-c-driver) documentations.
|