thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-28 20:50:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
76,778 Commits 8,961 Branches 1,767 Tags 1.8 GiB
3f1150df2d
Commit Graph

100 Commits

Author SHA1 Message Date
Maksim Kita
cd9561e34b
Update external-dicts-dict-lifetime.md 2021-05-13 17:14:55 +03:00
Azat Khuzhin
808d1a0215 Reimplement preallocate for hashed/sparse_hashed dictionaries 
It was initially implemented in #15454, but was reverted in #21948 (due
to higher memory usage).

This implementation differs from the initial, since now there is
separate attribute to enable preallocation, before it was done
automatically, but this has problems with duplicates in the source.

Plus this implementation does not uses dynamic_cast, instead it extends
IDictionarySource interface.
 2021-05-10 07:41:48 +03:00
Olga Revyakina
9cdc3fa957 Start 2021-05-01 20:46:02 +03:00
Maksim Kita
6ae94fa25b
Update external-dicts-dict-layout.md 2021-04-23 11:40:05 +03:00
Olga Revyakina
fa7917e385 Updates 2021-04-21 19:36:59 +03:00
Olga Revyakina
cc63fe0af5 Start 2021-04-21 19:25:04 +03:00
Olga Revyakina
3f33ab064e Added Polygon NULL support from #21890 2021-04-04 12:47:33 +03:00
Olga Revyakina
da3f973eac Minor fixes 2021-04-04 12:41:30 +03:00
Olga Revyakina
3fc988f6e6 Polygon link added 2021-04-04 12:39:04 +03:00
Olga Revyakina
adf494ae1f Nullable types 2021-04-04 11:00:48 +03:00
olgarev
c27e6ce6d0
Merge branch 'master' into revolg-DOCSUP-5920-PostgreSQL_function_dictionary_engine 2021-03-28 01:00:43 +03:00
Maksim Kita
bbe1960eea
Merge pull request #21573 from kitaisreal/updated-cache-dictionary-storage 
Added specialized CacheDictionaryStorage
 2021-03-25 21:29:01 +03:00
Olga Revyakina
89f5a64cc0 Merge branch 'master' into revolg-DOCSUP-5920-PostgreSQL_function_dictionary_engine 2021-03-20 12:48:25 +03:00
Maksim Kita
18ed9c5c67 SSDCacheDictionary remove max_stored_keys option 2021-03-18 12:55:17 +03:00
Alexey Milovidov
8c9bd09e6c Remove broken "Original article" 2021-03-14 15:19:04 +03:00
olgarev
a4bd6939c9
Apply suggestions from code review 
Co-authored-by: Anna <42538400+adevyatova@users.noreply.github.com>
 2021-03-09 23:46:47 +03:00
alexey-milovidov
7876415b8a Update external-dicts-dict-sources.md 2021-03-08 03:40:29 +03:00
Slach
5016b30209 replace posgresql to postgresql 2021-03-08 03:40:29 +03:00
Slach
831135432f add PostgreSQL engine and table function documentation 
Signed-off-by: Slach <bloodjazman@gmail.com>
 2021-03-08 03:39:24 +03:00
Olga Revyakina
c11824b156 Dictionary 2021-02-27 03:29:56 +03:00
Denny Crane
1e56f907a8
Update external-dicts-dict-layout.md 
range_hashed description corrected
 2021-02-09 14:47:11 -04:00
sevirov
b75dd0badd
DOCSUP-5604: Edit and translate to Russian (#18929) 
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
 2021-01-18 19:00:46 +03:00
Denny Crane
86e9160930
Update external-dicts-dict-lifetime.md 2021-01-13 19:11:29 -04:00
Denny Crane
a4e02065f3
Update external-dicts-dict-lifetime.md 2021-01-13 19:06:28 -04:00
Mariano Benítez Mulet
f62e73599a
Fixed error in DDL query doc for MongoDB dict 
According to the documentation, DDL query for MongoDB dictionaries require

```sql
SOURCE(MONGO(
    host 'localhost'
    port 27017
    user ''
    password ''
    db 'test'
    collection 'dictionary_source'
))
```
However, the source type `MONGO` is not recognized.
It is, however, the source type `MONGODB`.

My change fixes this mistake in documentation.
 2021-01-11 15:02:30 +01:00
vdimir
fcfe7f2c5d Add option access_to_key_from_attributes to documentation for ip_trie 2020-12-24 19:13:49 +00:00
filimonov
af9d9a7b9c
dict notes 
sync docs with https://github.com/ClickHouse/ClickHouse/pull/8127
 2020-12-07 14:01:12 +01:00
Anna Shakhova
f4afb46433
DOCSUP-3123: Edited the ReplicatedMergeTree and Polygon dictionaries (#16110) 
* #13573

* #9278

* Fixed

* Fixed

* Fixed link

* Update docs/en/sql-reference/dictionaries/external-dictionaries/external-dicts-dict-polygon.md

* Update docs/en/sql-reference/dictionaries/external-dictionaries/external-dicts-dict-polygon.md

Co-authored-by: BayoNet <da-daos@yandex.ru>
 2020-11-08 22:42:28 +03:00
Denny Crane
dea3641e5c
Update external-dicts-dict-layout.md 2020-11-03 20:47:42 -04:00
Nikolai Kochetov
963ce315b2
Merge pull request #15454 from azat/dict-prealloc 
Speedup hashed/sparse_hashed dictionary loading by preallocating the hash table
 2020-10-15 15:03:53 +03:00
Alexey Milovidov
db4db42b65 Fix broken links in docs 2020-10-13 20:23:29 +03:00
Azat Khuzhin
064f901ea8 Add ability to preallocate hashtables for hashed/sparsehashed dictionaries 
preallocation can be used only when we know number of rows, and for this
we need:
- source clickhouse
- no filtering (i.e. lack of <where>), since filtering can filter
  too much rows and eventually it may allocate memory that will
  never be used.

For sparse_hash the difference is quite significant, preallocated
sparse_hash hashtable allocates ~33% faster (7.5 seconds vs 5 seconds
for insert, and the difference is more significant for higher number of
elements):

    $ ninja bench-sparse_hash-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...ch/hashtable-bench/.cmake/bench-sparse_hash
    sparse_hash/insert: 7.574 <!--
    sparse_hash/find  : 2.14426
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   9710.51 msec (user+sys)

    $ time ninja bench-sparse_hash-preallocate-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...-bench/.cmake/bench-sparse_hash-preallocate
    sparse_hash/insert: 5.0522 <!--
    sparse_hash/find  : 2.14024
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   7192.06 msec (user+sys)

P.S. the difference for sparse_hashed dictionary with 4e9 elements
(uint64, uint16) is ~18% (4975.905 vs 4103.569 sec)

v2: do not reallocate the dictionary from the progress callback
    Since this will access hashtable in parallel.
v3: drop PREALLOCATE() and do this only for source=clickhouse and empty
    <where>
 2020-10-09 22:28:14 +03:00
Vladimir Golovchenko
21bc856d61 Improved the description of connecting to MS SQL Server by ODBC. 2020-09-15 11:26:57 -07:00
Dmitrii Raev
2a575fd5c8
Update external-dicts-dict-lifetime.md (#12657) 
duplicated line
 2020-07-22 11:26:04 +03:00
Ivan Blinkov
258d2fd499
[docs] split various kinds of CREATE queries into separate articles (#12328) 
* normalize

* split & adjust links

* re-normalize

* adjust ru links

* adjust ja/tr links

* partially apply e0d19d2aea

* reset contribs
 2020-07-09 18:10:35 +03:00
Nikita Mikhaylov
e55577ba65 Merge branch 'nikvas0/ssd_dict' of git://github.com/nikvas0/ClickHouse into merging-ssh-cache 2020-06-24 16:45:18 +03:00
Ivan Blinkov
652882ef4e [docs] reorganized F.A.Q. 2020-06-22 16:35:41 +03:00
Ivan Blinkov
7170f3c534
[docs] split aggregate function and system table references (#11742) 
* prefer relative links from root

* wip

* split aggregate function reference

* split system tables
 2020-06-18 11:24:31 +03:00
Alexander Tokmakov
e67837bc4a cleenup 2020-06-04 00:11:17 +03:00
Nikita Vasilev
e7324ec4d7 docs 2020-05-23 13:41:27 +03:00
Alexander Tokmakov
175b7aedf3 Merge branch 'master' into merging_external_source_cassandra 2020-05-19 05:21:27 +03:00
Артем Стрельцов
6b12cfb8e4 documentation added 2020-05-13 19:05:05 +03:00
Ilya Yatsishin
1d281ec032
Merge pull request #10652 from BayoNet/docs/CLICKHOUSEDOCS-623-dicts 
DOCS-623: Updated introduction to external dictionaries
 2020-05-08 09:35:13 +03:00
Artem Streltsov
5220d9a4db
small docs edit (#10731) 
Co-authored-by: Артем Стрельцов <artemstreltsov@Air-2.local>
 2020-05-07 23:00:30 +03:00
alexey-milovidov
eeac7aa313
Merge pull request #10622 from kekekekule/layout_direct 
Add direct layout for dictionaries
 2020-05-07 01:05:29 +03:00
BayoNet
dba72d73fe
DOCS-624: Fixing links to nowhere (#10675) 
* enbaskakova-DOCSUP-652 (#101)

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

* Update docs/en/sql_reference/aggregate_functions/combinators.md

Co-Authored-By: BayoNet <da-daos@yandex.ru>

* Update docs/en/sql_reference/aggregate_functions/combinators.md

Co-Authored-By: BayoNet <da-daos@yandex.ru>

* Update docs/en/sql_reference/aggregate_functions/combinators.md

Co-Authored-By: BayoNet <da-daos@yandex.ru>

* Update docs/en/sql_reference/aggregate_functions/combinators.md

Co-Authored-By: BayoNet <da-daos@yandex.ru>

* Update docs/en/sql_reference/aggregate_functions/combinators.md

Co-Authored-By: BayoNet <da-daos@yandex.ru>

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

* "docs(orNull&orDefault): Functions 'orNull&orDefault' have been edited"

Co-authored-by: elenbaskakova <elenbaskakova@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>

* Revert "enbaskakova-DOCSUP-652 (#101)" (#107)

This reverts commit 639fee7610.

* CLICKHOUSEDOCS-624: Fixed links. Was 60, became 13.

* CLICKHOUSEDOCS-624: Finished fix links in Enlish version.

* CLICKHOUSEDOCS-624: Fixed RU links

Co-authored-by: elenaspb2019 <47083263+elenaspb2019@users.noreply.github.com>
Co-authored-by: elenbaskakova <elenbaskakova@yandex-team.ru>
Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
 2020-05-06 09:13:29 +03:00
Sergei Shtykov
efa040050c CLICKHOUSEDOCS-623: Typo fix. 2020-05-04 14:42:34 +03:00
Sergei Shtykov
37d7bedba2 CLICKHOUSEDOCS-623: Updated introduction to external dictionaries. 2020-05-04 14:39:43 +03:00
Nikolay Degterinsky
a3e557a5d2 documentation is added & added 'direct' layout into integragion test 2020-05-03 15:55:22 +03:00
Ivan Blinkov
d91c97d15d
[docs] replace underscores with hyphens (#10606) 
* Replace underscores with hyphens

* remove temporary code

* fix style check

* fix collapse
 2020-04-30 21:19:18 +03:00