Commit Graph

200 Commits

Author SHA1 Message Date
Dmitriy
d4eb5ec1d0 Merge remote-tracking branch 'remotes/clickhouse/master' into sevirov-DOCSUP-14511-document_custom_query_for_database_dictionaries 2021-10-31 21:32:42 +03:00
Dmitriy
43d68af165 Add the custom query
Добавил поле query в некоторые источники словарей.
2021-10-31 20:53:49 +03:00
Azat Khuzhin
e0cd7a8304 docs: switch <yandex> to <clickhouse> 2021-10-26 08:52:29 +03:00
Maksim Kita
613a2fc46c
Merge pull request #30409 from sevirov/sevirov-DOCSUP-16821-edit_and_translate_to_russian_hashedarray_dictionary
DOCSUP-16821: Edit and translate to Russian (HashedArray dictionary)
2021-10-23 00:15:35 +03:00
Dmitriy
e3927fa9c8 Fix links
Поправил ссылки.
2021-10-22 19:36:29 +03:00
alexey-milovidov
7023423f66
Merge pull request #28705 from gyuton/gyuton-DOCSUP-14093-Edit-and-translate-to-Russian
DOCSUP-14093: Edited and translated to Russian (external dicts)
2021-10-21 23:33:41 +03:00
Dmitriy
377f6cf3c2 Edit and translate to Russian
Выполнил перевод на русский язык.
2021-10-19 21:51:46 +03:00
Denny Crane
eb66442feb
Update external-dicts-dict-layout.md 2021-10-17 16:21:21 -03:00
Maksim Kita
1b50d26c51 Added documentation 2021-10-16 13:41:56 +03:00
Maksim Kita
7e23a7d814 RangeHashedDictionary range type docs fix 2021-09-15 12:23:31 +03:00
George
3ce7331211 Edited and translated to Russian 2021-09-07 20:07:27 +03:00
Dmitriy
7021d9bbe4
Update docs/en/sql-reference/dictionaries/external-dictionaries/external-dicts-dict-layout.md
Co-authored-by: Anna <42538400+adevyatova@users.noreply.github.com>
2021-08-26 19:47:21 +03:00
Dmitriy
c75d776d04 Document the ComplexKeyRangeHashed dictionary
Задокументировал новый словарь.
2021-08-21 22:44:12 +03:00
Maksim Kita
3b4eb2d769 Fixed code review issues 2021-08-03 00:53:43 +03:00
Maksim Kita
d2440dca86 Updated cache dictionaries documentation 2021-08-02 15:18:05 +03:00
Alexey Milovidov
d87d833691 Remove trailing whitespaces from docs 2021-07-29 18:20:55 +03:00
romanzhukov
69f3804980 DOCSUP-11554: dictionary source secure setting added 2021-07-18 19:06:22 +03:00
Maksim Kita
39c5ba40f7
Merge pull request #26055 from kitaisreal/clickhouse-dictionary-source-secure-setting-added-documentation
ClickHouse dictionary source secure setting added documentation
2021-07-07 23:49:42 +03:00
Maksim Kita
9d0c2f83f8 ClickHouse dictionary source secure setting added documentation 2021-07-07 22:14:30 +03:00
Evgeniia Sudarikova
0955d001cd added array to types 2021-07-04 16:11:29 +03:00
tavplubix
56da480497
Merge pull request #25302 from otrazhenia/evgsudarikova-DOCSUP-10299
DOCSUP-10299: Edit and translate to Russian
2021-06-30 14:02:43 +03:00
Evgenia Sudarikova
2bb9bb6a86
Update docs/en/sql-reference/dictionaries/external-dictionaries/external-dicts-dict-lifetime.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-06-24 12:53:39 +03:00
Evgenia Sudarikova
c7d5282798
Update docs/en/sql-reference/dictionaries/external-dictionaries/external-dicts-dict-lifetime.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-06-24 12:53:25 +03:00
Kseniia Sumarokova
84f317cc79
Merge pull request #25439 from sevirov/sevirov-DOCSUP-8661-mysql_dictionary_source
DOCSUP-8661: MySQL dictionary source: the fail_on_connection_loss config parameter.
2021-06-23 12:37:21 +03:00
Dmitriy
8091bd382d The small fix
Внес небольшую поправку.
2021-06-22 19:15:19 +03:00
Dmitriy
ee28db0daf Fix the inaccuracy
Внес небольшую поправку.
2021-06-22 00:23:24 +03:00
sevirov
cbca2a6c36
Update docs/en/sql-reference/dictionaries/external-dictionaries/external-dicts-dict-sources.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-06-21 20:11:47 +03:00
Dmitriy
ccad32fe96 Translate to Russian
Выполнил перевод на русский язык.
2021-06-18 21:20:53 +03:00
Dmitriy
d69790945d Add the fail_on_connection_loss configuration parameter
Добавил описание параметра fail_on_connection_loss.
2021-06-17 23:29:01 +03:00
George
864b35533e small fixes 2021-06-16 13:53:09 +03:00
gyuton
f877c7ee51
Apply suggestions from code review
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-06-16 13:47:46 +03:00
Evgeniia Sudarikova
40101cbf82 edited EN, added RU 2021-06-15 22:29:11 +03:00
George
b8c20f201b Small update 2021-06-15 18:11:11 +03:00
George
81b1ef1b0c Small fixes 2021-06-15 16:58:42 +03:00
George
30f3eacfe7 First draft 2021-06-15 16:32:54 +03:00
Maksim Kita
de115cfc8c
Merge pull request #25198 from kitaisreal/dictionary-added-update-field-documentation
Dictionary added update field documentation
2021-06-13 01:22:26 +03:00
Maksim Kita
b16e801fb4 Added update_lag option documentation 2021-06-12 18:42:00 +03:00
Maksim Kita
314fe86565 Updated documentationg 2021-06-12 13:56:53 +03:00
Maksim Kita
8762e40907 Dictionary added update field documentation 2021-06-11 11:52:19 +03:00
Maksim Kita
12982da130 Added ExecutablePool documentation 2021-06-11 11:28:49 +03:00
Dmitriy
47a94d350b Add types supported in Dictionaries
Добавил типы для атрибутов словарей.
2021-06-03 23:16:39 +03:00
Maksim Kita
50042df428
Merge pull request #24286 from sevirov/sevirov-DOCSUP-7842-document_the_dictionary_function
DOCSUP-7842: Document the dictionary function
2021-06-02 22:28:33 +03:00
Romain Neutron
7b515c7235
Avoid short syntax 2021-05-27 21:44:11 +02:00
Maksim Kita
e78105fdd8 Updated documentation 2021-05-27 00:17:45 +03:00
Dmitriy
df400d1437 Fix links
Поправил ссылки.
2021-05-26 23:01:20 +03:00
Dmitriy
991ae97fb6 Translate to Russian
Выполнил перевод на русский язык.
2021-05-26 20:53:51 +03:00
Vladimir
e6b957be6c
Merge pull request #24101 from otrazhenia/evgsudarikova-DOCSUP-9288 2021-05-14 15:05:14 +03:00
Evgeniia Sudarikova
00d963d40f minor changes 2021-05-13 20:26:03 +03:00
Evgeniia Sudarikova
0b66aa0e85 edited EN and RU 2021-05-13 20:05:58 +03:00
Maksim Kita
e0b3b7d661
Merge pull request #23847 from olgarev/revolg-DOCSUP-8778-cache_dictionaries_3
DOCSUP-8778: cache dictionaries (3)
2021-05-13 17:15:41 +03:00
Maksim Kita
cd9561e34b
Update external-dicts-dict-lifetime.md 2021-05-13 17:14:55 +03:00
Azat Khuzhin
808d1a0215 Reimplement preallocate for hashed/sparse_hashed dictionaries
It was initially implemented in #15454, but was reverted in #21948 (due
to higher memory usage).

This implementation differs from the initial, since now there is
separate attribute to enable preallocation, before it was done
automatically, but this has problems with duplicates in the source.

Plus this implementation does not uses dynamic_cast, instead it extends
IDictionarySource interface.
2021-05-10 07:41:48 +03:00
Olga Revyakina
9cdc3fa957 Start 2021-05-01 20:46:02 +03:00
Maksim Kita
6ae94fa25b
Update external-dicts-dict-layout.md 2021-04-23 11:40:05 +03:00
Olga Revyakina
fa7917e385 Updates 2021-04-21 19:36:59 +03:00
Olga Revyakina
cc63fe0af5 Start 2021-04-21 19:25:04 +03:00
Olga Revyakina
3f33ab064e Added Polygon NULL support from #21890 2021-04-04 12:47:33 +03:00
Olga Revyakina
da3f973eac Minor fixes 2021-04-04 12:41:30 +03:00
Olga Revyakina
3fc988f6e6 Polygon link added 2021-04-04 12:39:04 +03:00
Olga Revyakina
adf494ae1f Nullable types 2021-04-04 11:00:48 +03:00
olgarev
c27e6ce6d0
Merge branch 'master' into revolg-DOCSUP-5920-PostgreSQL_function_dictionary_engine 2021-03-28 01:00:43 +03:00
Maksim Kita
bbe1960eea
Merge pull request #21573 from kitaisreal/updated-cache-dictionary-storage
Added specialized CacheDictionaryStorage
2021-03-25 21:29:01 +03:00
Olga Revyakina
89f5a64cc0 Merge branch 'master' into revolg-DOCSUP-5920-PostgreSQL_function_dictionary_engine 2021-03-20 12:48:25 +03:00
Maksim Kita
18ed9c5c67 SSDCacheDictionary remove max_stored_keys option 2021-03-18 12:55:17 +03:00
Alexey Milovidov
8c9bd09e6c Remove broken "Original article" 2021-03-14 15:19:04 +03:00
olgarev
a4bd6939c9
Apply suggestions from code review
Co-authored-by: Anna <42538400+adevyatova@users.noreply.github.com>
2021-03-09 23:46:47 +03:00
alexey-milovidov
7876415b8a Update external-dicts-dict-sources.md 2021-03-08 03:40:29 +03:00
Slach
5016b30209 replace posgresql to postgresql 2021-03-08 03:40:29 +03:00
Slach
831135432f add PostgreSQL engine and table function documentation
Signed-off-by: Slach <bloodjazman@gmail.com>
2021-03-08 03:39:24 +03:00
Olga Revyakina
c11824b156 Dictionary 2021-02-27 03:29:56 +03:00
Denny Crane
1e56f907a8
Update external-dicts-dict-layout.md
range_hashed description corrected
2021-02-09 14:47:11 -04:00
sevirov
b75dd0badd
DOCSUP-5604: Edit and translate to Russian (#18929)
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
2021-01-18 19:00:46 +03:00
Denny Crane
86e9160930
Update external-dicts-dict-lifetime.md 2021-01-13 19:11:29 -04:00
Denny Crane
a4e02065f3
Update external-dicts-dict-lifetime.md 2021-01-13 19:06:28 -04:00
Mariano Benítez Mulet
f62e73599a
Fixed error in DDL query doc for MongoDB dict
According to the documentation, DDL query for MongoDB dictionaries require

```sql
SOURCE(MONGO(
    host 'localhost'
    port 27017
    user ''
    password ''
    db 'test'
    collection 'dictionary_source'
))
```
However, the source type `MONGO` is not recognized.
It is, however, the source type `MONGODB`.

My change fixes this mistake in documentation.
2021-01-11 15:02:30 +01:00
vdimir
fcfe7f2c5d Add option access_to_key_from_attributes to documentation for ip_trie 2020-12-24 19:13:49 +00:00
filimonov
af9d9a7b9c
dict notes
sync docs with https://github.com/ClickHouse/ClickHouse/pull/8127
2020-12-07 14:01:12 +01:00
Anna Shakhova
f4afb46433
DOCSUP-3123: Edited the ReplicatedMergeTree and Polygon dictionaries (#16110)
* #13573

* #9278

* Fixed

* Fixed

* Fixed link

* Update docs/en/sql-reference/dictionaries/external-dictionaries/external-dicts-dict-polygon.md

* Update docs/en/sql-reference/dictionaries/external-dictionaries/external-dicts-dict-polygon.md

Co-authored-by: BayoNet <da-daos@yandex.ru>
2020-11-08 22:42:28 +03:00
Denny Crane
dea3641e5c
Update external-dicts-dict-layout.md 2020-11-03 20:47:42 -04:00
Nikolai Kochetov
963ce315b2
Merge pull request #15454 from azat/dict-prealloc
Speedup hashed/sparse_hashed dictionary loading by preallocating the hash table
2020-10-15 15:03:53 +03:00
Alexey Milovidov
db4db42b65 Fix broken links in docs 2020-10-13 20:23:29 +03:00
Azat Khuzhin
064f901ea8 Add ability to preallocate hashtables for hashed/sparsehashed dictionaries
preallocation can be used only when we know number of rows, and for this
we need:
- source clickhouse
- no filtering (i.e. lack of <where>), since filtering can filter
  too much rows and eventually it may allocate memory that will
  never be used.

For sparse_hash the difference is quite significant, preallocated
sparse_hash hashtable allocates ~33% faster (7.5 seconds vs 5 seconds
for insert, and the difference is more significant for higher number of
elements):

    $ ninja bench-sparse_hash-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...ch/hashtable-bench/.cmake/bench-sparse_hash
    sparse_hash/insert: 7.574 <!--
    sparse_hash/find  : 2.14426
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   9710.51 msec (user+sys)

    $ time ninja bench-sparse_hash-preallocate-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...-bench/.cmake/bench-sparse_hash-preallocate
    sparse_hash/insert: 5.0522 <!--
    sparse_hash/find  : 2.14024
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   7192.06 msec (user+sys)

P.S. the difference for sparse_hashed dictionary with 4e9 elements
(uint64, uint16) is ~18% (4975.905 vs 4103.569 sec)

v2: do not reallocate the dictionary from the progress callback
    Since this will access hashtable in parallel.
v3: drop PREALLOCATE() and do this only for source=clickhouse and empty
    <where>
2020-10-09 22:28:14 +03:00
Vladimir Golovchenko
21bc856d61 Improved the description of connecting to MS SQL Server by ODBC. 2020-09-15 11:26:57 -07:00
Dmitrii Raev
2a575fd5c8
Update external-dicts-dict-lifetime.md (#12657)
duplicated line
2020-07-22 11:26:04 +03:00
Ivan Blinkov
258d2fd499
[docs] split various kinds of CREATE queries into separate articles (#12328)
* normalize

* split & adjust links

* re-normalize

* adjust ru links

* adjust ja/tr links

* partially apply e0d19d2aea

* reset contribs
2020-07-09 18:10:35 +03:00
Nikita Mikhaylov
e55577ba65 Merge branch 'nikvas0/ssd_dict' of git://github.com/nikvas0/ClickHouse into merging-ssh-cache 2020-06-24 16:45:18 +03:00
Ivan Blinkov
652882ef4e [docs] reorganized F.A.Q. 2020-06-22 16:35:41 +03:00
Ivan Blinkov
7170f3c534
[docs] split aggregate function and system table references (#11742)
* prefer relative links from root

* wip

* split aggregate function reference

* split system tables
2020-06-18 11:24:31 +03:00
Alexander Tokmakov
e67837bc4a cleenup 2020-06-04 00:11:17 +03:00
Nikita Vasilev
e7324ec4d7 docs 2020-05-23 13:41:27 +03:00
Alexander Tokmakov
175b7aedf3 Merge branch 'master' into merging_external_source_cassandra 2020-05-19 05:21:27 +03:00
Артем Стрельцов
6b12cfb8e4 documentation added 2020-05-13 19:05:05 +03:00
Ilya Yatsishin
1d281ec032
Merge pull request #10652 from BayoNet/docs/CLICKHOUSEDOCS-623-dicts
DOCS-623: Updated introduction to external dictionaries
2020-05-08 09:35:13 +03:00
Artem Streltsov
5220d9a4db
small docs edit (#10731)
Co-authored-by: Артем Стрельцов <artemstreltsov@Air-2.local>
2020-05-07 23:00:30 +03:00
alexey-milovidov
eeac7aa313
Merge pull request #10622 from kekekekule/layout_direct
Add direct layout for dictionaries
2020-05-07 01:05:29 +03:00
BayoNet
dba72d73fe
DOCS-624: Fixing links to nowhere (#10675)
* enbaskakova-DOCSUP-652 (#101)

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

* Update docs/en/sql_reference/aggregate_functions/combinators.md

Co-Authored-By: BayoNet <da-daos@yandex.ru>

* Update docs/en/sql_reference/aggregate_functions/combinators.md

Co-Authored-By: BayoNet <da-daos@yandex.ru>

* Update docs/en/sql_reference/aggregate_functions/combinators.md

Co-Authored-By: BayoNet <da-daos@yandex.ru>

* Update docs/en/sql_reference/aggregate_functions/combinators.md

Co-Authored-By: BayoNet <da-daos@yandex.ru>

* Update docs/en/sql_reference/aggregate_functions/combinators.md

Co-Authored-By: BayoNet <da-daos@yandex.ru>

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

Co-authored-by: elenbaskakova <elenbaskakova@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>

* Revert "enbaskakova-DOCSUP-652 (#101)" (#107)

This reverts commit 639fee7610.

* CLICKHOUSEDOCS-624: Fixed links. Was 60, became 13.

* CLICKHOUSEDOCS-624: Finished fix links in Enlish version.

* CLICKHOUSEDOCS-624: Fixed RU links

Co-authored-by: elenaspb2019 <47083263+elenaspb2019@users.noreply.github.com>
Co-authored-by: elenbaskakova <elenbaskakova@yandex-team.ru>
Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
2020-05-06 09:13:29 +03:00
Sergei Shtykov
efa040050c CLICKHOUSEDOCS-623: Typo fix. 2020-05-04 14:42:34 +03:00
Sergei Shtykov
37d7bedba2 CLICKHOUSEDOCS-623: Updated introduction to external dictionaries. 2020-05-04 14:39:43 +03:00
Nikolay Degterinsky
a3e557a5d2 documentation is added & added 'direct' layout into integragion test 2020-05-03 15:55:22 +03:00
Ivan Blinkov
d91c97d15d
[docs] replace underscores with hyphens (#10606)
* Replace underscores with hyphens

* remove temporary code

* fix style check

* fix collapse
2020-04-30 21:19:18 +03:00