thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 02:41:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
106,269 Commits 9,328 Branches 1,783 Tags 2.1 GiB
ebfe7f9991
Commit Graph

13075 Commits

Author SHA1 Message Date
Han Fei
badfbcb3d8
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:58 +01:00
Han Fei
e9c4cf46cd
Update docs/en/operations/settings/merge-tree-settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:46 +01:00
Han Fei
9d254f7d87
Update docs/en/operations/settings/merge-tree-settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:32 +01:00
robot-ch-test-poll4
2066581d8f
Merge pull request #45451 from evillique/default_granularity 
Add default GRANULARITY argument for secondary indexes
 2023-01-20 17:46:21 +01:00
Nikolay Degterinsky
02142596fb Add docs 2023-01-20 15:22:13 +00:00
Kruglov Pavel
28ddcc2432
Merge branch 'master' into tsv-csv-detect-header 2023-01-20 15:08:38 +01:00
Robert Schulze
b55c8ddd65
Merge pull request #45472 from ClickHouse/rs-duplicate-writing-guide 
Don't duplicate writing guide, instead point to existing writing guide
 2023-01-20 15:05:13 +01:00
Han Fei
5fc4998f10 update docs for async insert deduplication 2023-01-20 14:42:11 +01:00
Robert Schulze
4ac17d71fa
Merge pull request #45470 from ClickHouse/rs-doc-typos 
Fix typos
 2023-01-20 14:39:27 +01:00
Robert Schulze
3b182e0fec
Don't duplicate writing guide, instead point to existing writing guide 2023-01-20 13:36:31 +00:00
Robert Schulze
3f2e4c8217
Fix typos 2023-01-20 13:20:25 +00:00
Robert Schulze
687f9c35a7
Merge pull request #45469 from ClickHouse/inv-idx-docs 
Docs for inverted index
 2023-01-20 14:17:58 +01:00
Robert Schulze
7e6d3163b1
Initial inverted index docs 2023-01-20 12:12:20 +00:00
Maksim Kita
758c8f2776
Merge branch 'master' into dict/remove-preallocate 2023-01-20 13:15:37 +03:00
Antonio Andelic
0ad37ad286
Merge pull request #45320 from stigsb/system_tables_volume_config 
Add <storage_policy> config parameter for system logs
 2023-01-20 10:27:57 +01:00
Robert Schulze
099f50c0e3
Remove redundancy 2023-01-19 18:35:19 +00:00
Robert Schulze
d8144ffafc
Merge branch 'master' into index-docs 2023-01-19 18:05:27 +01:00
Robert Schulze
c9988f4411
Mini fix 2023-01-19 17:04:17 +00:00
Robert Schulze
7355e3bc77
Docs: Beautify section on secondary index types 2023-01-19 17:00:31 +00:00
robot-clickhouse-ci-1
13d4d40568
Merge pull request #45325 from ClickHouse/download-builds 
Improve manual to get binaries from CI
 2023-01-19 17:49:52 +01:00
Robert Schulze
bfcb5e7915
Fix typos 2023-01-19 16:08:21 +00:00
Kruglov Pavel
9820beae68
Apply suggestions from code review 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2023-01-19 16:11:13 +01:00
Stig Bakken
420c179b55 Add <storage_policy> config parameter for system logs 2023-01-19 10:25:28 +01:00
DanRoscigno
5d88a2b344 clarify autodetect 2023-01-18 15:51:31 -05:00
Azat Khuzhin
4366f7fb3b Remove PREALLOCATE for HASHED/SPARSE_HASHED dictionaries 
It does not give significant benefit, but now, you hashed/sparse_hashed
dictionaries can be filled in parallel (#40003), using sharded
dictionaries, and this should be used instead of PREALLOCATE.

Note, that dictionaries, that had been created with PREALLOCATE will
work, but simply ignore this attribute.

Fixes: #41985 (cc @alexey-milovidov)
Reverts: #23979 (cc @kitaisreal)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-18 20:18:37 +01:00
DanRoscigno
cd3ecb9091 add support_batch_delete to mergetree docs 2023-01-18 12:16:31 -05:00
Maksim Kita
8225d2814c
Merge pull request #40003 from azat/dict-shards 
Add ability to load hashed dictionaries using multiple threads
 2023-01-18 13:37:10 +03:00
Robert Schulze
4f90824347
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-17 22:49:53 +00:00
Robert Schulze
fd7f5dad1c
Docs improvements 2023-01-17 22:03:48 +00:00
Sergei Trifonov
ca0fb785f4
Merge pull request #45193 from ClickHouse/concurrency-control-docs 
Add docs for concurrency control logic
 2023-01-17 21:10:17 +01:00
Dale Mcdiarmid
9c4d3e0ffb link docs to blogs 2023-01-17 15:38:10 +00:00
Kruglov Pavel
96bb99f864
Merge branch 'master' into tsv-csv-detect-header 2023-01-17 15:33:02 +01:00
Vladimir C
b80ee8df50
Merge pull request #45256 from DanRoscigno/add-grace-hash-docs 2023-01-16 18:43:19 +01:00
Kruglov Pavel
e9d6590926
Merge branch 'master' into tsv-csv-detect-header 2023-01-16 17:50:24 +01:00
Kruglov Pavel
bdb3517512
Merge pull request #45231 from Avogar/json-tuples 
Insert default values in case of missing tuple elements in JSONEachRow
 2023-01-16 17:49:50 +01:00
avogar
1c0941d72a Add docs and examples 2023-01-16 16:46:41 +00:00
Mikhail f. Shiryaev
08c9d81c90
Apply suggestions from code review 
Co-authored-by: Igor Nikonov <954088+devcrafter@users.noreply.github.com>
 2023-01-16 16:55:24 +01:00
Mikhail f. Shiryaev
1bd7279d5f
Improve manual to get binaries from CI 2023-01-16 16:45:30 +01:00
Nikolay Degterinsky
70e79de69b
Merge pull request #38252 from bharatnc/ncb/weighted-quantile-approx 
add quantileInterpolatedWeighted function
 2023-01-16 13:41:13 +01:00
Sema Checherinda
d746a3c4ff
Merge pull request #44480 from wineternity/issue_43333_doc 
[DOC] Add support for signed arguments in range() #43333
 2023-01-16 10:26:49 +01:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-16 08:04:49 +00:00
Ilya Yatsishin
cf5052c77e
Merge pull request #45291 from den-crane/patch-57 2023-01-16 02:33:54 +01:00
Dan Roscigno
adca0b64d3
use markdown file instead of URL to enforce 404 checks 2023-01-15 19:31:58 -05:00
Peignon Melvyn
674a1d1877
Update json.md 2023-01-16 01:27:08 +01:00
Denny Crane
6cf603e05f
Update index.md 2023-01-15 18:40:59 -04:00
Dan Roscigno
f13fdfb431
Merge pull request #45280 from tbragin/patch-5 
Update postgresql.md
 2023-01-15 11:52:47 -05:00
Robert Schulze
27fe7ebd93
Cosmetics 2023-01-15 16:12:48 +00:00
Alexey Milovidov
a5244f8d1d
Merge pull request #45279 from tbragin/patch-4 
Update postgresql.md
 2023-01-15 12:34:09 +03:00
Ilya Yatsishin
96987b7cd8
Merge pull request #45239 from Avogar/generate-random 2023-01-15 00:37:34 +01:00
Tanya Bragin
d825f50c84
Update postgresql.md 
Adding Postgres blog to Postgres DB engine page

cc @DanRoscigno @gingerwizard
 2023-01-14 14:39:41 -08:00
Tanya Bragin
b5773caeb2
Update postgresql.md 
Adding related Postgres blog here. 

cc @gingerwizard @DanRoscigno
 2023-01-14 14:34:33 -08:00
Tanya Bragin
36ec76f53d
Update clickhouse-local.md 
cc @DanRoscigno @gingerwizard Adding latest clickhouse-local blog to related content on this page.
 2023-01-14 07:50:10 -08:00
DanRoscigno
d0a55f6dc9 doc grace_hash algorithm for join 2023-01-13 13:17:03 -05:00
Rich Raposa
c7aad8e48b
Merge pull request #45207 from ClickHouse/add-maxintersections-to-docs 
Add maxIntersections to docs
 2023-01-13 10:27:59 -07:00
Azat Khuzhin
99063b152f Allow to configure queue backlog of the parallel hashed dictionary loader 
v2: Decrease default parallel_queue_backlog to 10000 (same speed)
v3: Rename parallel_queue_backlog to per_shard_load_backlog
v3: Rename per_shard_load_backlog to shard_load_queue_backlog
v4: Fix documentation
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-13 13:39:26 +01:00
Azat Khuzhin
345c422e28 Add ability to load hashed dictionaries using multiple threads 
Right now dictionaries (here I will talk about only
HASHED/SPARSE_HASHED/COMPLEX_KEY_HASHED/COMPLEX_KEY_SPARSE_HASHED)
can load data only in one thread, since it uses one hash table that
cannot be filled from multiple threads.

And in case you have very big dictionary (i.e. 10e9 elements), it can
take a awhile to load them, especially for SPARSE_HASHED variants (and
if you have such amount of elements there, you are likely use
SPARSE_HASHED, since it requires less memory), in my env it takes ~4
hours, which is enormous amount of time.

So this patch add support of shards for dictionaries, number of shards
determine how much hash tables will use this dictionary, also, and which
is more important, how much threads it can use to load the data.

And with 16 threads this works 2x faster, not perfect though, see the
follow up patches in this series.

v0: PARTITION BY
v1: SHARDS 1
v2: SHARDS(1)
v3: tried optimized mod - logical and, but it does not gain even 10%
v4: tried squashing more (max_block_size * shards), but it does not gain even 10% either
v5: move SHARDS into layout parameters (unknown simply ignored)
v6: tune params for perf tests (to avoid too long queries)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-13 13:39:25 +01:00
Robert Schulze
15e11741cb
Cosmetics 2023-01-13 00:00:23 +00:00
avogar
82ff1fd343 Add tests and docs 2023-01-12 22:29:23 +00:00
Robert Schulze
475bb31f33
Make server configuratio hierarchical 2023-01-12 21:24:40 +00:00
Yakov Olkhovskiy
842a34666c
Merge pull request #44594 from arenadata/ADQM-634 
Add keytab parameter in kerberos section of config.xml
 2023-01-12 15:07:45 -05:00
robot-clickhouse
82e73b583e Update version_date.tsv and changelogs after v22.3.17.13-lts 2023-01-12 19:22:22 +00:00
avogar
87b934c472 Insert default values in case of missing tuple elements in JSONEachRow 2023-01-12 16:36:44 +00:00
DanRoscigno
69cdb838c5 temporarily replace mermaid with PNG 2023-01-12 11:03:40 -05:00
Dan Roscigno
8c94ed9597
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 2023-01-12 11:01:03 -05:00
Rich Raposa
759a4c0940
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-12 08:53:22 -07:00
rfraposa
69a11574d2 Update maxintersections.md 2023-01-12 08:30:54 -07:00
Kseniia Sumarokova
db3e0219fc
Merge pull request #41687 from ClickHouse/40907_Parameterized_views_as_table_functions 
40907 Parameterized views as table functions
 2023-01-12 14:24:32 +01:00
Alexander Tokmakov
e37f572c34
Revert "update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability" 2023-01-12 15:01:36 +03:00
Sergei Trifonov
8c40c4d79f
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:25:03 +01:00
Sergei Trifonov
e784f65ee9
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:23:58 +01:00
Sergei Trifonov
78a63e795c
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:23:15 +01:00
Sergei Trifonov
d41dbdc4a6
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:22:59 +01:00
Dan Roscigno
7a651d749c
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 2023-01-11 19:20:37 -05:00
rfraposa
2e44ad9d0f Add maxIntersections to docs 2023-01-11 17:10:51 -07:00
Ilya Yatsishin
3a98f2bc12
Merge pull request #45190 from ClickHouse/add-query-params-to-docs 
Add query parameters to the docs
 2023-01-11 23:47:50 +01:00
Sergei Trifonov
1b94c839d5
Add docs for SYSTEM RELOAD USERS 2023-01-11 21:16:22 +01:00
Sergei Trifonov
6adb7d47f3
Merge branch 'master' into concurrency-control-docs 2023-01-11 20:34:59 +01:00
serxa
b6e14f60d4 fix 2023-01-11 19:34:31 +00:00
serxa
2dae6a1ffe add docs for concurrency control logic 2023-01-11 19:19:51 +00:00
Rich Raposa
f8ac49bb86
Update syntax.md 2023-01-11 12:09:23 -07:00
Rich Raposa
a389180f42
Update syntax.md 2023-01-11 12:05:35 -07:00
rfraposa
8b9d99e2e2 Update syntax.md 2023-01-11 11:51:53 -07:00
Mikhail f. Shiryaev
ae02320c3d
Merge pull request #45178 from ClickHouse/content-readme 
Improve README.md for clickhouse-com-content, clean out old website parts
 2023-01-11 19:08:22 +01:00
Sergei Trifonov
ec9f10e934
Merge pull request #45174 from ClickHouse/make-queries-copyable-from-docs 
make more SQL queries copyable from docs in one click
 2023-01-11 16:59:52 +01:00
alesapin
3bda8bce7c
Merge pull request #45159 from ClickHouse/fix-changelog-22.3.16 
Clean trash from changelog for v22.3.16.1190-lts
 2023-01-11 16:48:46 +01:00
DanRoscigno
806dd1357c switch text to response for query blocks 2023-01-11 10:13:31 -05:00
DanRoscigno
7168c217b0 switch text to response for query blocks 2023-01-11 10:08:11 -05:00
DanRoscigno
d34a755cfb switch text to response for query blocks 2023-01-11 09:59:23 -05:00
Mikhail f. Shiryaev
b3fc6a9706
Clean out unused code for old site/docs building system 2023-01-11 15:43:57 +01:00
Dan Roscigno
bb3c4641a7
Merge pull request #45167 from ClickHouse/add-sparse-serialization-to-docs 
Add explanation of ratio_of_defaults_for_sparse_serialization setting to docs
 2023-01-11 08:57:10 -05:00
Mikhail f. Shiryaev
ed63f88cd1
Improve README.md for clickhouse-com-content 2023-01-11 14:54:26 +01:00
Sergei Trifonov
8b724c6d58
Merge pull request #45169 from ClickHouse/moves-table-docs 
Add docs for `system.moves` table
 2023-01-11 14:48:19 +01:00
serxa
8d099a4417 make more SQL queries copyable from docs in one click 2023-01-11 13:43:51 +00:00
DanRoscigno
4767147745 format query response 2023-01-11 08:23:44 -05:00
Dan Roscigno
0ad969171e
Merge pull request #45127 from DanRoscigno/add-deltalake-docs 
Add deltalake docs
 2023-01-11 08:07:42 -05:00
serxa
a79f6d19fa add docs for system.moves table 2023-01-11 13:04:05 +00:00
Robert Schulze
9bb1e31369
Merge pull request #44860 from bigo-sg/improve_week_day 
update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability
 2023-01-11 13:58:45 +01:00
Dan Roscigno
6e9669cfae
Apply suggestions from code review 2023-01-11 07:53:37 -05:00
Robert Schulze
12a29fec35
Hide secrets from system.query_result_cache 2023-01-11 12:50:45 +00:00
rfraposa
1ddc9c3bb6 Update merge-tree-settings.md 2023-01-11 05:44:51 -07:00