thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 10:52:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
106,269 Commits 9,328 Branches 1,783 Tags 2.1 GiB
ebfe7f9991
Commit Graph

13075 Commits

Author SHA1 Message Date
Tanya Bragin
b5773caeb2
Update postgresql.md 
Adding related Postgres blog here. 

cc @gingerwizard @DanRoscigno
 2023-01-14 14:34:33 -08:00
Tanya Bragin
36ec76f53d
Update clickhouse-local.md 
cc @DanRoscigno @gingerwizard Adding latest clickhouse-local blog to related content on this page.
 2023-01-14 07:50:10 -08:00
DanRoscigno
d0a55f6dc9 doc grace_hash algorithm for join 2023-01-13 13:17:03 -05:00
Rich Raposa
c7aad8e48b
Merge pull request #45207 from ClickHouse/add-maxintersections-to-docs 
Add maxIntersections to docs
 2023-01-13 10:27:59 -07:00
Azat Khuzhin
99063b152f Allow to configure queue backlog of the parallel hashed dictionary loader 
v2: Decrease default parallel_queue_backlog to 10000 (same speed)
v3: Rename parallel_queue_backlog to per_shard_load_backlog
v3: Rename per_shard_load_backlog to shard_load_queue_backlog
v4: Fix documentation
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-13 13:39:26 +01:00
Azat Khuzhin
345c422e28 Add ability to load hashed dictionaries using multiple threads 
Right now dictionaries (here I will talk about only
HASHED/SPARSE_HASHED/COMPLEX_KEY_HASHED/COMPLEX_KEY_SPARSE_HASHED)
can load data only in one thread, since it uses one hash table that
cannot be filled from multiple threads.

And in case you have very big dictionary (i.e. 10e9 elements), it can
take a awhile to load them, especially for SPARSE_HASHED variants (and
if you have such amount of elements there, you are likely use
SPARSE_HASHED, since it requires less memory), in my env it takes ~4
hours, which is enormous amount of time.

So this patch add support of shards for dictionaries, number of shards
determine how much hash tables will use this dictionary, also, and which
is more important, how much threads it can use to load the data.

And with 16 threads this works 2x faster, not perfect though, see the
follow up patches in this series.

v0: PARTITION BY
v1: SHARDS 1
v2: SHARDS(1)
v3: tried optimized mod - logical and, but it does not gain even 10%
v4: tried squashing more (max_block_size * shards), but it does not gain even 10% either
v5: move SHARDS into layout parameters (unknown simply ignored)
v6: tune params for perf tests (to avoid too long queries)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-13 13:39:25 +01:00
Robert Schulze
15e11741cb
Cosmetics 2023-01-13 00:00:23 +00:00
avogar
82ff1fd343 Add tests and docs 2023-01-12 22:29:23 +00:00
Robert Schulze
475bb31f33
Make server configuratio hierarchical 2023-01-12 21:24:40 +00:00
Yakov Olkhovskiy
842a34666c
Merge pull request #44594 from arenadata/ADQM-634 
Add keytab parameter in kerberos section of config.xml
 2023-01-12 15:07:45 -05:00
robot-clickhouse
82e73b583e Update version_date.tsv and changelogs after v22.3.17.13-lts 2023-01-12 19:22:22 +00:00
avogar
87b934c472 Insert default values in case of missing tuple elements in JSONEachRow 2023-01-12 16:36:44 +00:00
DanRoscigno
69cdb838c5 temporarily replace mermaid with PNG 2023-01-12 11:03:40 -05:00
Dan Roscigno
8c94ed9597
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 2023-01-12 11:01:03 -05:00
Rich Raposa
759a4c0940
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-12 08:53:22 -07:00
rfraposa
69a11574d2 Update maxintersections.md 2023-01-12 08:30:54 -07:00
Kseniia Sumarokova
db3e0219fc
Merge pull request #41687 from ClickHouse/40907_Parameterized_views_as_table_functions 
40907 Parameterized views as table functions
 2023-01-12 14:24:32 +01:00
Alexander Tokmakov
e37f572c34
Revert "update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability" 2023-01-12 15:01:36 +03:00
Sergei Trifonov
8c40c4d79f
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:25:03 +01:00
Sergei Trifonov
e784f65ee9
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:23:58 +01:00
Sergei Trifonov
78a63e795c
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:23:15 +01:00
Sergei Trifonov
d41dbdc4a6
Update docs/en/development/architecture.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-01-12 02:22:59 +01:00
Dan Roscigno
7a651d749c
Update docs/en/sql-reference/aggregate-functions/reference/maxintersections.md 2023-01-11 19:20:37 -05:00
rfraposa
2e44ad9d0f Add maxIntersections to docs 2023-01-11 17:10:51 -07:00
Ilya Yatsishin
3a98f2bc12
Merge pull request #45190 from ClickHouse/add-query-params-to-docs 
Add query parameters to the docs
 2023-01-11 23:47:50 +01:00
Sergei Trifonov
1b94c839d5
Add docs for SYSTEM RELOAD USERS 2023-01-11 21:16:22 +01:00
Sergei Trifonov
6adb7d47f3
Merge branch 'master' into concurrency-control-docs 2023-01-11 20:34:59 +01:00
serxa
b6e14f60d4 fix 2023-01-11 19:34:31 +00:00
serxa
2dae6a1ffe add docs for concurrency control logic 2023-01-11 19:19:51 +00:00
Rich Raposa
f8ac49bb86
Update syntax.md 2023-01-11 12:09:23 -07:00
Rich Raposa
a389180f42
Update syntax.md 2023-01-11 12:05:35 -07:00
rfraposa
8b9d99e2e2 Update syntax.md 2023-01-11 11:51:53 -07:00
Mikhail f. Shiryaev
ae02320c3d
Merge pull request #45178 from ClickHouse/content-readme 
Improve README.md for clickhouse-com-content, clean out old website parts
 2023-01-11 19:08:22 +01:00
Sergei Trifonov
ec9f10e934
Merge pull request #45174 from ClickHouse/make-queries-copyable-from-docs 
make more SQL queries copyable from docs in one click
 2023-01-11 16:59:52 +01:00
alesapin
3bda8bce7c
Merge pull request #45159 from ClickHouse/fix-changelog-22.3.16 
Clean trash from changelog for v22.3.16.1190-lts
 2023-01-11 16:48:46 +01:00
DanRoscigno
806dd1357c switch text to response for query blocks 2023-01-11 10:13:31 -05:00
DanRoscigno
7168c217b0 switch text to response for query blocks 2023-01-11 10:08:11 -05:00
DanRoscigno
d34a755cfb switch text to response for query blocks 2023-01-11 09:59:23 -05:00
Mikhail f. Shiryaev
b3fc6a9706
Clean out unused code for old site/docs building system 2023-01-11 15:43:57 +01:00
Dan Roscigno
bb3c4641a7
Merge pull request #45167 from ClickHouse/add-sparse-serialization-to-docs 
Add explanation of ratio_of_defaults_for_sparse_serialization setting to docs
 2023-01-11 08:57:10 -05:00
Mikhail f. Shiryaev
ed63f88cd1
Improve README.md for clickhouse-com-content 2023-01-11 14:54:26 +01:00
Sergei Trifonov
8b724c6d58
Merge pull request #45169 from ClickHouse/moves-table-docs 
Add docs for `system.moves` table
 2023-01-11 14:48:19 +01:00
serxa
8d099a4417 make more SQL queries copyable from docs in one click 2023-01-11 13:43:51 +00:00
DanRoscigno
4767147745 format query response 2023-01-11 08:23:44 -05:00
Dan Roscigno
0ad969171e
Merge pull request #45127 from DanRoscigno/add-deltalake-docs 
Add deltalake docs
 2023-01-11 08:07:42 -05:00
serxa
a79f6d19fa add docs for system.moves table 2023-01-11 13:04:05 +00:00
Robert Schulze
9bb1e31369
Merge pull request #44860 from bigo-sg/improve_week_day 
update function DAYOFWEEK and add new function WEEKDAY for mysql/spark compatiability
 2023-01-11 13:58:45 +01:00
Dan Roscigno
6e9669cfae
Apply suggestions from code review 2023-01-11 07:53:37 -05:00
Robert Schulze
12a29fec35
Hide secrets from system.query_result_cache 2023-01-11 12:50:45 +00:00
rfraposa
1ddc9c3bb6 Update merge-tree-settings.md 2023-01-11 05:44:51 -07:00
Dan Roscigno
02261b0e2a
Update docs/en/engines/table-engines/integrations/hudi.md 2023-01-11 07:42:15 -05:00
Dan Roscigno
d4c4f84161
Update docs/en/sql-reference/table-functions/hudi.md 2023-01-11 07:41:36 -05:00
Dan Roscigno
367d4fc4bf
Update docs/en/sql-reference/table-functions/hudi.md 2023-01-11 07:40:52 -05:00
Dan Roscigno
73ef2657dd
Update docs/en/engines/table-engines/integrations/hudi.md 2023-01-11 07:40:10 -05:00
Dan Roscigno
21573028ea
Update docs/en/engines/table-engines/integrations/deltalake.md 2023-01-11 07:38:41 -05:00
Mikhail f. Shiryaev
4dd628cd86
Clean trash from changelog for v22.3.16.1190-lts 2023-01-11 12:06:06 +01:00
Bharat Nallan Chakravarthy
e18a95719d review fix 2023-01-10 21:16:16 -08:00
DanRoscigno
563e0e76f9 init 2023-01-10 16:59:34 -05:00
DanRoscigno
75c04945bd spelling 2023-01-10 16:18:50 -05:00
DanRoscigno
5cf1b1f61d feedback 2023-01-10 16:09:59 -05:00
rfraposa
57ab2a4110 Update nlp-functions.md 
Added the detectLanguage functions
 2023-01-10 12:26:51 -07:00
DanRoscigno
879ee05218 fix case of names 2023-01-10 11:18:33 -05:00
DanRoscigno
ee86afb125 add deltalake 2023-01-10 11:14:12 -05:00
Rich Raposa
f28b04fc59
Merge pull request #45124 from ClickHouse/rfraposa-patch-2 
Update theilsu.md
 2023-01-10 09:04:22 -07:00
Han Fei
91226abbfe
Merge pull request #43858 from hanfei1991/regexp-tree-dictionary 
Merge #40878: Add regexp tree dictionary
 2023-01-10 16:41:15 +01:00
Rich Raposa
df3cca6c35
Update theilsu.md 
Typo
 2023-01-10 08:40:48 -07:00
Ilya Yatsishin
4b3a9862cc
Merge pull request #45091 from ClickHouse/add-cramersv-agg-functions 
Add missing agg functions to docs
 2023-01-10 16:35:04 +01:00
Dan Roscigno
37da8e206b
Merge pull request #45119 from ClickHouse/add-default-table-engine-setting 
Added description of default_table_engine setting
 2023-01-10 09:59:09 -05:00
Dan Roscigno
707ff65b4f
Update docs/en/sql-reference/aggregate-functions/reference/contingency.md 2023-01-10 09:55:59 -05:00
Dan Roscigno
ee88814cac
formal to form 2023-01-10 09:42:04 -05:00
rfraposa
d61eae8554 Update settings.md 
Added description of default_table_engine
 2023-01-10 07:40:22 -07:00
Han Fei
6ed4570f73
Merge branch 'master' into regexp-tree-dictionary 2023-01-10 15:36:30 +01:00
Rich Raposa
b76d0d60db
Merge pull request #45089 from ClickHouse/add-cnf-docs 
Add convert_query_to_cnf to docs
 2023-01-10 07:11:57 -07:00
Han Fei
5f8296b719
Update docs/en/sql-reference/dictionaries/external-dictionaries/regexp-tree.md 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2023-01-10 14:41:06 +01:00
Vladimir C
7ca0b56b04
Merge pull request #45113 from ClickHouse/auto/v22.12.3.5-stable 2023-01-10 14:15:57 +01:00
Robert Schulze
cbc18318ff
Merge pull request #45114 from ClickHouse/less-awkward-comment-about-debugging 
Docs: Rewrite awkwardly phrased sentence about flush interval
 2023-01-10 14:15:43 +01:00
Robert Schulze
6497ddd882
Docs: Rewrite awkwardly phrased sentence about flush interval 2023-01-10 13:13:35 +00:00
Vladimir C
ba8e518243
Merge pull request #45110 from ClickHouse/auto/v22.11.4.3-stable 2023-01-10 14:13:07 +01:00
Vladimir C
5f15c733c8
Merge pull request #45107 from ClickHouse/auto/v22.10.6.3-stable 2023-01-10 14:12:56 +01:00
robot-clickhouse
686947b8f4 Update version_date.tsv and changelogs after v22.12.3.5-stable 2023-01-10 13:07:45 +00:00
Robert Schulze
8dc3cbc822
Merge pull request #45109 from ClickHouse/consistent-schema-interference-cache-heading 
Docs: Make heading consistent with other headings in System Table docs
 2023-01-10 14:02:49 +01:00
robot-clickhouse
821e116cda Update version_date.tsv and changelogs after v22.11.4.3-stable 2023-01-10 12:52:16 +00:00
Robert Schulze
96a722793c
Docs: Make heading consistent with other headings in System Table docs 2023-01-10 12:49:49 +00:00
robot-clickhouse
97b6d7806b Update version_date.tsv and changelogs after v22.10.6.3-stable 2023-01-10 12:32:01 +00:00
robot-clickhouse
56c9952f19 Update version_date.tsv and changelogs after v22.8.12.45-lts 2023-01-10 10:54:29 +00:00
Robert Schulze
923fa2c15a
Fix review comments, pt. II 2023-01-10 10:21:08 +00:00
Robert Schulze
0c3b034887
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-10 09:02:41 +00:00
rfraposa
c3dcbb2671 Add cramersV function 
And 3 similar functions t
 2023-01-09 23:42:39 -07:00
rfraposa
62b9e2f063 Update settings.md 
Add convert_query_to_cnf setting
 2023-01-09 21:30:24 -07:00
Alexey Milovidov
2cdf01aa9a
Merge pull request #45069 from ClickHouse/auto/v22.11.3.47-stable 
Update version_date.tsv and changelogs after v22.11.3.47-stable
 2023-01-10 04:44:44 +03:00
Alexey Milovidov
17d2777fb0
Merge pull request #45073 from ClickHouse/auto/v22.3.16.1190-lts 
Update version_date.tsv and changelogs after v22.3.16.1190-lts
 2023-01-10 04:44:34 +03:00
Alexey Milovidov
05f6f500e9
Merge pull request #45071 from ClickHouse/auto/v22.10.5.54-stable 
Update version_date.tsv and changelogs after v22.10.5.54-stable
 2023-01-10 04:44:25 +03:00
Rich Raposa
528acecc5c
Merge pull request #45076 from ClickHouse/new-mergetree-settings 
Add docs for 2 new MergeTree settings
 2023-01-09 16:48:26 -07:00
Dan Roscigno
99b1609fd3
Update docs/en/operations/settings/index.md 2023-01-09 18:17:29 -05:00
rfraposa
db7342769b Update merge-tree-settings.md 
Added two new settings
 2023-01-09 15:56:19 -07:00
rfraposa
eb96884ebf Add new DEFAULT value of settings 2023-01-09 15:02:35 -07:00
Robert Schulze
ad4884b394
Fix review comments, pt. I 2023-01-09 21:42:51 +00:00
Dan Roscigno
f8a5d5cb18
Merge branch 'ClickHouse:master' into add-deltalake-docs 2023-01-09 15:45:08 -05:00
Dan Roscigno
bfcb6eb0cf
Merge pull request #44995 from ClickHouse/qoega-patch-5 
Add documentation for xxh3
 2023-01-09 15:00:27 -05:00
robot-clickhouse
f0f5899319 Update version_date.tsv and changelogs after v22.3.16.1190-lts 2023-01-09 19:59:03 +00:00
DanRoscigno
438f34100d fix codeblock end 2023-01-09 14:42:24 -05:00
Dan Roscigno
f791d5439c
Merge pull request #45063 from ClickHouse/remove-original-article 
[docs] Remove "Original article" links
 2023-01-09 11:32:22 -05:00
robot-clickhouse
6b03324c63 Update version_date.tsv and changelogs after v22.10.5.54-stable 2023-01-09 16:07:01 +00:00
robot-clickhouse
6e0fc53af1 Update version_date.tsv and changelogs after v22.11.3.47-stable 2023-01-09 15:51:48 +00:00
Alexey Milovidov
bb8cb829f9
Merge pull request #44820 from ClickHouse/break-ci 
Modern tools in CI, part 2.
 2023-01-09 18:26:41 +03:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
Ivan Blinkov
b7e082d033 Remove "Original article links" 2023-01-09 15:13:36 +01:00
taiyang-li
20c7c0b1ef change as request 2023-01-09 18:21:31 +08:00
Roman Vasin
d5c8132ab2
Merge branch 'master' into ADQM-634 2023-01-09 11:34:40 +03:00
Roman Vasin
2995c6d866 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-634 2023-01-09 08:26:45 +00:00
Alexey Milovidov
28b6ada1d9
testing and prestable are not used anymore 2023-01-09 08:57:30 +03:00
Vadim Akhma
7bd8435200
wrong text 
60 str. двуми видами => двумя видами
 2023-01-09 10:45:35 +06:00
Alexey Milovidov
03ae644ea3 Fix performance test 2023-01-09 01:58:42 +01:00
Dan Roscigno
dced847e9b
Merge branch 'master' into qoega-patch-5 2023-01-07 19:36:23 -05:00
DanRoscigno
8d002e6d43 full path to links 2023-01-07 19:19:49 -05:00
Alexey Milovidov
be8df5683e
Merge pull request #44988 from ClickHouse/auto/v22.12.2.25-stable 
Update version_date.tsv and changelogs after v22.12.2.25-stable
 2023-01-08 02:52:59 +03:00
Alexey Milovidov
17552fdae2
Merge pull request #45021 from ClickHouse/no-testflows 
Remove the remainings of Testflows (2).
 2023-01-08 02:17:34 +03:00
Dan Roscigno
7741ce549f
Merge pull request #45004 from DanRoscigno/docs-for-set-join-persist 
move persistence setting docs
 2023-01-07 17:28:40 -05:00
Dan Roscigno
758c98e832
Merge pull request #45005 from DanRoscigno/date-subtraction-docs 
clarify date sub docs
 2023-01-07 17:28:08 -05:00
Alexey Milovidov
484af24d48 Remove the remainings of Testflows (2). 2023-01-07 21:40:13 +01:00
Alexey Milovidov
063bfb9be2
Merge pull request #45002 from den-crane/patch-56 
Update graphitemergetree.md
 2023-01-07 23:26:02 +03:00
Anton Popov
1f32ffedf8
Merge pull request #43221 from ClickHouse/refactoring-ip-types 
Replace domain IP types (IPv4, IPv6) with native
 2023-01-07 12:01:21 +01:00
DanRoscigno
eff349bab7 clarify date sub docs 2023-01-06 17:32:03 -05:00
DanRoscigno
e0b258b4a9 move persistence setting docs 2023-01-06 17:01:28 -05:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-06 20:42:48 +00:00
Denny Crane
1bf6139fab
Update graphitemergetree.md 2023-01-06 15:11:58 -04:00
Ilya Yatsishin
b6b9be7a3e
Add documentation for xxh3 2023-01-06 18:05:27 +01:00
robot-clickhouse
72b9e43295 Update version_date.tsv and changelogs after v22.12.2.25-stable 2023-01-06 15:20:59 +00:00
Ilya Yatsishin
71cb4ecde1
Add docs for #43308 2023-01-06 15:30:57 +01:00
Robert Schulze
35511685e3
Merge pull request #44977 from ClickHouse/match-docs 
Docs: Mention non-standard DOTALL behavior of ClickHouse's match()
 2023-01-06 13:22:28 +01:00
Robert Schulze
1cc5bce1c5
Docs: Mention non-standard DOTALL behavior of ClickHouse's match() 
Cf. #34603
 2023-01-06 11:18:22 +00:00
DanRoscigno
5cde7762ad WIP 2023-01-05 15:54:44 -05:00
Dan Roscigno
adfc4d4a23
Merge pull request #44945 from DanRoscigno/tolastday 
add toLastDayOfMonth to docs
 2023-01-05 11:53:40 -05:00
Dan Roscigno
9444dae34e
Merge pull request #44941 from DanRoscigno/add-settings 
add additional table filters setting
 2023-01-05 11:52:59 -05:00
Dan Roscigno
5ba6851629
Merge pull request #44943 from DanRoscigno/pmod-docs 
updater positiveModulo  docs
 2023-01-05 11:51:21 -05:00
Han Fei
f2a9eea995 write docs and optimize regex compile 2023-01-05 17:38:01 +01:00
DanRoscigno
9e5c8acd92 add toLastDayOfMonth to docs 2023-01-05 11:37:05 -05:00
DanRoscigno
4cba7fc958 add aliases for positiveModulo to docs 2023-01-05 11:10:20 -05:00
DanRoscigno
273ad90d1d add additional table filters setting 2023-01-05 10:47:18 -05:00
Robert Schulze
1974e1bf8c
Merge pull request #44479 from ClickHouse/more-robust-astselectquery-formatimpl 
More robust ASTSelectQuery::formatImpl()
 2023-01-05 12:27:40 +01:00
Robert Schulze
4fcead15c3
Fix handling of exceptions during query runtime 2023-01-04 22:33:04 +00:00
Alexey Milovidov
7589c29902
Merge pull request #44906 from DanRoscigno/add-touuid-docs 
add toUUIDOrDefault docs
 2023-01-05 00:01:14 +03:00
Dan Roscigno
20a35efc42
Merge pull request #44665 from burmecia/fix-ttl-doc 
fix table ttl doc example
 2023-01-04 15:53:19 -05:00
Dan Roscigno
288488f8a2
Merge pull request #44919 from DanRoscigno/revert-h3-doc-deletions 
revert doc removal
 2023-01-04 15:51:37 -05:00
Dan Roscigno
3c64cb26b0
Merge pull request #44913 from DanRoscigno/add-INFILE-docs 
add example with file globbing
 2023-01-04 15:51:12 -05:00
DanRoscigno
2397318b1a add more about matching 2023-01-04 15:37:13 -05:00
Dan Roscigno
47a84eb2df
Merge pull request #44650 from DanRoscigno/update-replication-docs 
add note for Cloud users
 2023-01-04 15:21:48 -05:00
DanRoscigno
51f1d3ba1e revert doc removal 2023-01-04 14:53:02 -05:00
DanRoscigno
df603911ea add example with file globbing 2023-01-04 11:36:38 -05:00
Yakov Olkhovskiy
7a5a36cbed
Merge branch 'master' into refactoring-ip-types 2023-01-04 11:11:06 -05:00