Azat Khuzhin
bdb39a6fef
Change logic of automatic ORDER/GROUP BY to be based on available memory
...
- remove max_bytes_ratio_before_external_{order,group_by}_for_server
- change the way max_bytes_ratio_before_external_{order,group_by} works
Note, that it is not enough to transform ratio to bytes in
executeQuery(), since in this case it will not work for merges and
internal queries, plus, you have to reset them for Distributed engine
and update it for Merge/View/...
This patch also introduce some helpers (see MemoryTrackerUtils) and
adjust Aggregator::Params constructor to accept Settings object instead
of tons of arguments.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
909eef401a
Implement max_bytes_ratio_before_external_sort_for_server
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
d5a990346c
Implement max_bytes_ratio_before_external_group_by_for_server
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
378b6c80a6
Automatic ORDER BY to disk (max_bytes_ratio_before_external_sort)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
a856c30c7c
Automatic GROUP BY to disk (max_bytes_ratio_before_external_group_by)
...
Simpler then max_bytes_before_external_group_by, that allows you not to
think about memory consumption of the query, and can be set globally to
i.e. 0.5 so that the external aggregation will be enabled once the
memory usage reaches the 50%.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Pablo Marcos
98ccca99f2
Add doc for SYSTEM LOAD PRIMARY KEY
2024-11-28 09:05:50 +00:00
kevinyhzou
a898a4e956
fix least/greatest
2024-11-28 12:27:21 +08:00
zhanglistar
ffc33fb7c1
delete toUnixTimestampEx
2024-11-28 11:39:43 +08:00
zhanglistar
7c24c69acf
merge master
2024-11-28 10:43:16 +08:00
Denny Crane
c169dc9cde
Update index.md
2024-11-27 21:01:04 -04:00
erickurbanov
bb77b0f0c2
add documentation
2024-11-28 00:59:49 +03:00
Dmitry Novik
a38700e5d1
Merge pull request #72338 from Zaynulla/patch-1
...
window-functions doc typos fix
2024-11-27 15:57:48 +00:00
Yarik Briukhovetskyi
c2f74fa4aa
Init
2024-11-27 12:33:01 +01:00
Zaynulla
0a6965537a
window func doc teamMax output header fixed
2024-11-27 10:32:01 +03:00
Justin de Guzman
b6725d33d1
[Docs] Specify that Replicated is default engine for cloud
2024-11-26 16:57:49 -08:00
Alexey Milovidov
e3e6905638
Merge pull request #72339 from Zaynulla/patch-2
...
varPop doc latex formula added
2024-11-26 22:45:20 +00:00
Alexey Milovidov
0c02222173
Merge pull request #72390 from den-crane/Docs/leadInFrame
...
Doc. Add a warning to lagInFrame/leadInFrame
2024-11-26 22:45:10 +00:00
Robert Schulze
e9f083b26d
Merge pull request #71997 from allmazz/delete_old_mongodb_integration
...
Get rid of the legacy mongodb integration
2024-11-26 21:51:46 +00:00
robot-clickhouse
22f34a2fe9
Update version_date.tsv and changelogs after v24.11.1.2557-stable
2024-11-26 18:03:24 +00:00
Robert Schulze
934ae95e39
Fix bad conflict resolution
2024-11-26 17:34:27 +00:00
Robert Schulze
6a899f97eb
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration
2024-11-26 17:33:41 +00:00
Raúl Marín
dd092411ff
Merge pull request #72455 from Algunenano/rename_setting
...
Rename allowed_feature_tier to allow_feature_tier
2024-11-26 15:54:01 +00:00
Denny Crane
5b1bdef54f
Update lagInFrame.md
2024-11-26 09:24:42 -04:00
Denny Crane
0ebee19f2e
Update docs/en/sql-reference/window-functions/leadInFrame.md
...
Co-authored-by: János Benjamin Antal <antaljanosbenjamin@users.noreply.github.com>
2024-11-26 09:21:58 -04:00
Robert Schulze
d9859c9186
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration
2024-11-26 13:15:02 +00:00
Robert Schulze
45e1702f82
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration
2024-11-26 12:44:06 +00:00
Pavel Kruglov
552d8b9699
Merge pull request #72294 from Avogar/json-beta
...
Move JSON/Dynamic/Variant types from experimental features to beta
2024-11-26 12:19:42 +00:00
Raúl Marín
b487f59496
Rename allowed_feature_tier to allow_feature_tier
2024-11-26 12:30:57 +01:00
Alexey Milovidov
3d65e72586
Update groupconcat.md
2024-11-26 05:49:53 +01:00
Alexey Milovidov
438b80e89b
Update groupconcat.md
2024-11-26 05:49:19 +01:00
Denny Crane
c1cefb0190
fix rank functions doc
2024-11-25 18:52:59 +00:00
Robert Schulze
17f27275ae
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration
2024-11-25 17:23:15 +00:00
Robert Schulze
13687d681b
Merge pull request #72399 from rschu1ze/docs-ann-caption
...
Docs: Slightly better caption
2024-11-25 16:32:30 +00:00
Alexander Tokmakov
9a0d19257d
Merge pull request #65401 from kirillgarbar/attach_as_replicated
...
ATTACH AS [NOT] REPLICATED
2024-11-25 16:00:07 +00:00
Robert Schulze
0b3185fa13
Docs: Slightly better caption
2024-11-25 15:54:52 +00:00
Robert Schulze
a83da580ae
Merge pull request #72385 from rschu1ze/docs-ann
...
Docs: Update vector search docs
2024-11-25 14:40:28 +00:00
Yarik Briukhovetskyi
00c565961e
Merge pull request #70810 from yariks5s/maxTableName
...
Follow-up #65150
2024-11-25 13:55:12 +00:00
Robert Schulze
8f5a939d65
Try to fix link
2024-11-25 13:33:33 +00:00
Denny Crane
cc0f8271e2
add a warning to lagInFrame/leadInFrame
2024-11-25 13:14:55 +00:00
Robert Schulze
b6cc52410d
Fix spelling
2024-11-25 12:59:48 +00:00
Robert Schulze
46a3e3e795
Docs: Update vector search docs
2024-11-25 12:37:43 +00:00
Nikita Taranov
856f73a7c2
Fix typo in intersect.md
2024-11-25 12:40:34 +01:00
jotosoares
f753b16f9d
docs(view.md): remove experimental from title
2024-11-24 20:52:27 -03:00
Robert Schulze
a8899eb26d
Docs: update minimum required Clang version
2024-11-24 15:20:12 +00:00
Zaynulla
a64ed74297
varPop doc latex formula added
...
- There is a latex formula in the documentation of the [covarPop](https://clickhouse.com/docs/en/sql-reference/aggregate-functions/reference/covarpop ) method, which is quite similar to varPop method.
- In Russian docs there are formulas both for [varPop](https://clickhouse.com/docs/ru/sql-reference/aggregate-functions/reference/varpop ), and [covarPop](https://clickhouse.com/docs/ru/sql-reference/aggregate-functions/reference/covarpop ).
Therefore, for consistency, it is suggested to add formula here too.
2024-11-23 15:52:48 +03:00
Zaynulla
19556968bc
window-functions doc typos fix
...
- A forgotten closing parenthesis ] has been added.
- The alias "teamMax" is less confusing for max (salary) than "teamAvg". This is probably the result of copying & pasting from the previous part of the document.
2024-11-23 14:43:02 +03:00
Raúl Marín
52391a8271
Revert "Set enable_http_compression default value to 1"
2024-11-22 22:51:28 +01:00
avogar
bd3f300220
Move JSON/Dynamic/Variant types from experimental to beta
2024-11-22 17:33:37 +00:00
Vladimir Cherkasov
26de447039
Merge pull request #70603 from zwy991114/check-table-structure-completely-setting
...
Add setting enforce_index_structure_match_on_partition_manipu..
2024-11-22 16:30:34 +00:00
robot-clickhouse
07ecc200c3
Update version_date.tsv and changelogs after v24.8.8.17-lts
2024-11-22 13:08:21 +00:00
robot-clickhouse
081aae87db
Update version_date.tsv and changelogs after v24.10.3.21-stable
2024-11-22 11:14:16 +00:00
pufit
344a04f4b4
Merge branch 'master' into add-syntax-alter-user-modify-settings
2024-11-21 23:37:15 -05:00
Alexey Milovidov
1d453fbc85
Merge pull request #72020 from ClickHouse/casted
...
Fix a problem with cast
2024-11-22 00:49:47 +00:00
divanik
8459148313
Resolve issues
2024-11-21 18:39:38 +00:00
Yarik Briukhovetskyi
913361a641
Merge branch 'ClickHouse:master' into maxTableName
2024-11-21 18:39:13 +01:00
Konstantin Bogdanov
288edbf35a
Merge pull request #70414 from ClickHouse/clang-19
...
Use `clang-19`
2024-11-21 15:53:41 +00:00
divanik
438aa415a6
Resolve issues
2024-11-21 15:42:47 +00:00
Denny Crane
7b34b0eec5
Update json-functions.md
2024-11-21 10:10:44 -04:00
Denny Crane
c8c443f127
Update json-functions.md
2024-11-21 10:03:38 -04:00
Denny Crane
1cc687f3b1
Update json-functions.md
2024-11-21 09:54:57 -04:00
Кирилл Гарбар
ddb8f3d57f
Fix docs and build
2024-11-21 16:48:52 +03:00
Alexey Milovidov
ad4b201892
Merge branch 'master' into casted
2024-11-21 06:04:02 +01:00
Alexey Milovidov
25bd73ea5e
Merge pull request #72023 from ClickHouse/fix-bind
...
Fix comments
2024-11-21 05:03:24 +00:00
Konstantin Bogdanov
b2c81981fb
Use clang-19
2024-11-20 23:08:47 +01:00
Mikhail Artemenko
44b4bd38b9
Merge pull request #72045 from ClickHouse/issues/70174/cluster_versions
...
Enable cluster table functions for DataLake Storages
2024-11-20 21:22:37 +00:00
Alexander Tokmakov
aed4edd941
Merge branch 'master' into attach_as_replicated
2024-11-20 19:47:00 +01:00
Kseniia Sumarokova
c6a10151d9
Merge pull request #71947 from ClickHouse/fix_weird_problem
...
Fix weird case when `s3`/`s3Cluster` return incomplete result or exception
2024-11-20 16:37:58 +00:00
Raúl Marín
3ae055c74e
Merge pull request #71841 from Algunenano/experimental_tiers_switch
...
Implement `allowed_feature_tier` as a global switch to disable all experimental / beta features
2024-11-20 12:39:06 +00:00
Mikhail Artemenko
4ccebd9a24
fix syntax for iceberg in docs
2024-11-20 11:15:39 +00:00
pufit
07be02d297
Merge pull request #70332 from zvonand/ldap-remote-roles
...
Passing external user roles from query originator to other nodes
2024-11-19 23:06:45 +00:00
Nikita Taranov
5aeeec0f42
Merge branch 'master' into fix_weird_problem
2024-11-19 19:48:10 +01:00
Vitaly Baranov
353ff951aa
Merge pull request #68885 from Unalian/feat-67772
...
Add CHECK GRANT query
2024-11-19 16:09:30 +00:00
Mikhail Artemenko
a367de9977
add docs
2024-11-19 12:49:59 +00:00
Nikita Mikhaylov
567270afa8
Merge pull request #72053 from ClickHouse/document_cache_populated_by_fetch
...
Documenting MergeTree's cache_populated_by_fetch setting.
2024-11-19 12:31:05 +00:00
Nikita Mikhaylov
317bdad1e9
Merge pull request #72054 from ClickHouse/alexey-milovidov-patch-8
...
Add Bluesky and X.
2024-11-19 12:29:55 +00:00
Nikita Mikhaylov
40ad02f229
Merge pull request #72052 from ClickHouse/document_ttl_only_drop_parts
...
Documenting MergeTree's ttl_only_drop_parts setting, and updating ref…
2024-11-19 12:29:45 +00:00
Andrey Zvonov
86eb3d6425
Revive #42537
...
Co-authored-by: Enmk <V.Nemkov@gmail.com>
fix memory access
2024-11-19 09:53:27 +00:00
robot-clickhouse
7785a9b15e
Merge pull request #72042 from ClickHouse/auto/v24.3.14.35-lts
...
Update version_date.tsv and changelog after v24.3.14.35-lts
2024-11-19 09:14:49 +00:00
Alexey Milovidov
dc2e91d0b5
Update docs
2024-11-19 05:03:27 +01:00
kellytoole
c1ea3d4213
Documenting MergeTree's cache_populated_by_fetch setting.
2024-11-18 16:34:14 -08:00
kellytoole
cad22e7a2d
Documenting MergeTree's ttl_only_drop_parts setting, and updating reference to it.
2024-11-18 15:06:08 -08:00
pufit
97866c71b7
Merge branch 'master' into add-syntax-alter-user-modify-settings
...
# Conflicts:
# docs/en/sql-reference/statements/alter/role.md
# docs/en/sql-reference/statements/alter/settings-profile.md
# docs/ru/sql-reference/statements/alter/role.md
# docs/ru/sql-reference/statements/alter/settings-profile.md
# src/Access/SettingsProfileElement.cpp
# src/Access/SettingsProfileElement.h
# src/Interpreters/Context.cpp
# src/Interpreters/Context.h
# src/Parsers/Access/ASTCreateUserQuery.cpp
# src/Parsers/Access/ParserCreateRoleQuery.cpp
# src/Parsers/Access/ParserCreateSettingsProfileQuery.cpp
# src/Parsers/Access/ParserCreateUserQuery.cpp
# src/Parsers/Access/ParserSettingsProfileElement.cpp
# tests/queries/0_stateless/01294_create_settings_profile.reference
2024-11-18 13:13:27 -08:00
Alexey Milovidov
03c5e4b107
Merge pull request #72021 from matsumotomiki/translated_ja_docs
...
add translated Japanese docs
2024-11-18 20:45:51 +00:00
Emmanuel Dias
b559738197
mention arrayPrAUC on docs
2024-11-18 17:39:38 -03:00
robot-clickhouse
926e4a3c38
Update version_date.tsv and changelogs after v24.3.14.35-lts
2024-11-18 16:54:41 +00:00
robot-clickhouse
7564681621
Merge pull request #72041 from ClickHouse/auto/v24.9.3.128-stable
...
Update version_date.tsv and changelog after v24.9.3.128-stable
2024-11-18 16:51:19 +00:00
robot-clickhouse
ddc5c80601
Update version_date.tsv and changelogs after v24.9.3.128-stable
2024-11-18 16:13:27 +00:00
robot-clickhouse
84828120b3
Merge pull request #72037 from ClickHouse/auto/v24.8.7.41-lts
...
Update version_date.tsv and changelog after v24.8.7.41-lts
2024-11-18 16:08:28 +00:00
robot-clickhouse
85a5f91b29
Update version_date.tsv and changelogs after v24.8.7.41-lts
2024-11-18 15:16:24 +00:00
robot-clickhouse
8bec9a1e34
Update version_date.tsv and changelogs after v24.10.2.80-stable
2024-11-18 14:34:58 +00:00
Nikita Taranov
3a012e5a96
enable s3_skip_empty_files by default
2024-11-18 13:55:18 +01:00
Vladimir Cherkasov
3e05ffe675
Merge pull request #71560 from xogoodnow/json-utc-formatted-log
...
Added UTC date format (RFC 3339) for json formatted logging
2024-11-18 09:10:52 +00:00
Miki Matsumoto
9f42828800
Remove unused temporary image files
2024-11-18 17:22:13 +09:00
Alexey Milovidov
49589da56e
Fix comments
2024-11-18 07:18:46 +01:00
Miki Matsumoto
1e15312729
add translated Japanese docs
2024-11-18 11:58:58 +09:00
Alexey Milovidov
2d2d611bd3
Merge pull request #71778 from ClickHouse/docs-docker-links
...
[Docs] Update links to use official Docker image
2024-11-18 02:47:15 +00:00
Alexey Milovidov
8e0dc599b8
Merge pull request #71948 from Blargian/docs_add_example
...
Clean up `EXCEPT` docs
2024-11-18 02:45:58 +00:00
Alexey Milovidov
1062e6316f
Fix cast
2024-11-18 01:35:03 +01:00
Nikita Mikhaylov
d7cc5e892e
Merge pull request #72014 from ClickHouse/fix-docs-asynchronous-metrics
...
Fix docs: asynchronous_metrics
2024-11-17 22:36:48 +00:00
Robert Schulze
742f1eb41e
Merge pull request #71403 from petern48/alias_any_respect_nulls
...
Added camelCase aliases for `any`/`anyLast` aggregation functions
2024-11-17 16:02:10 +00:00
