Commit Graph

16935 Commits

Author SHA1 Message Date
Zhuo Qiu
bf85f7f368 add docs & minor fix for lwd-aware merge settings 2024-03-18 11:02:02 +08:00
Alexey Milovidov
01136bbc3b Limit backtracking in parser 2024-03-17 19:54:45 +01:00
Kseniia Sumarokova
d4205afe82
Merge branch 'master' into add-zk-retries 2024-03-17 17:56:32 +01:00
Alexey Milovidov
994bf8765c Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver 2024-03-17 14:20:02 +01:00
Alexey Milovidov
cb8d859453
Merge branch 'master' into analyzer-distr-json 2024-03-17 15:15:06 +03:00
Alexey Milovidov
bf98386a33
Merge pull request #61298 from ClickHouse/analyzer-merge-virtual-columns
Analyzer: Fix virtual columns in StorageMerge
2024-03-17 15:05:23 +03:00
Vitaly Baranov
4fe1c9a78f Get rid of checking the "last modification time" when the configuration is generated
to allow ExternalLoader::reloadConfig() work for generated configurations too.
2024-03-17 12:10:57 +01:00
Vitaly Baranov
41d8621d97 Fix replacing dictionaries: StorageID is now updated immediately for every dictionary during CREATE OR REPLACE
even if the dictionary is not loaded yet or loading right now.
2024-03-17 12:10:52 +01:00
Alexey Milovidov
9be38c064a Merge branch 'master' into split-cast-overload-resolver 2024-03-16 14:07:59 +01:00
Dan Wu
adaf262dc0 Fix bug when reading system.parts using UUID (issue 61220).
During the predicates pushing down of system.parts table, there is a
logic to use that predicates to filter on the storages. This makes sense
if the predicate is on the `database`, `table`, `engine`. But it can be
problem if the predicate is about `uuid`, because storage UUID is
apparently different from parts UUID.

Rename the column name from `uuid` to `storage_uuid` fixed this.
2024-03-16 02:02:21 +00:00
William Schoeffel
4dbf3ee1bb fix: remove duplicated check containing part 2024-03-15 14:05:24 -03:00
Yakov Olkhovskiy
a31f551bc7
Merge pull request #58223 from jewelzqiu/existing-count
Consider lightweight deleted rows when selecting parts to merge
2024-03-15 12:42:35 -04:00
Kruglov Pavel
d045ab150e
Merge pull request #61362 from ClickHouse/revert-61359-revert-61234-Avogar-patch-2
Revert "Revert "Fix usage of session_token in S3 engine""
2024-03-15 16:00:05 +01:00
Dmitry Novik
061cd5a53d Fixup #ci_set_analyzer 2024-03-15 14:22:46 +00:00
Anton Popov
6ad2f95837 Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-15 13:52:20 +00:00
Dmitry Novik
1cdd280c9f
Merge pull request #61392 from ClickHouse/analyzer-fix-context-in-merge
Analyzer: Fix planner context for subquery in StorageMerge
2024-03-15 14:05:28 +01:00
Sergei Trifonov
273d221781
Merge pull request #60558 from ClickHouse/revert-60253-revert-59032-cpu-scheduler-and-cc
Revert "Revert "Support resource request canceling""
2024-03-15 13:24:50 +01:00
divanik
e57446b6f5 Resolved conflicts 2024-03-15 11:57:59 +00:00
Antonio Andelic
0ba400d065
Merge pull request #61380 from ClickHouse/fix-heap-use-after-free-alias-merge
Fix `heap-use-after-free` for Merge table with alias
2024-03-15 11:15:02 +01:00
Zhuo Qiu
7f97b11ce6 only read _row_exists column when necessary 2024-03-15 15:48:20 +08:00
Alexey Milovidov
c9fb8ef54b Merge branch 'master' into split-cast-overload-resolver 2024-03-15 07:09:51 +01:00
Nikolai Kochetov
1cae77997a Try revert stage back 2024-03-14 21:34:25 +00:00
avogar
e08eaebc99 Add sanity check for poll_max_batch_size FileLog setting to avoid big untracked allocations 2024-03-14 20:36:18 +00:00
Anton Popov
edaf2c8023 Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-14 17:06:22 +00:00
Dmitry Novik
90669ef487 Merge remote-tracking branch 'origin/master' into analyzer-distr-json 2024-03-14 17:43:26 +01:00
Dmitry Novik
0b3b734c9b Analyzer: Fix planner context for subquery in StorageMerge 2024-03-14 17:37:49 +01:00
Kseniia Sumarokova
ceeb926fa8
Merge branch 'master' into add-zk-retries 2024-03-14 17:27:40 +01:00
kssenii
b778b01408 Add settings 2024-03-14 16:39:32 +01:00
Dmitry Novik
d558c4dcb7 Cleanup 2024-03-14 16:17:58 +01:00
Dmitry Novik
e145115ef1 Fixup 2024-03-14 16:15:06 +01:00
Antonio Andelic
026ac4deb1 Fix heap-use-after-free for Merge table with alias 2024-03-14 14:20:22 +00:00
Robert Schulze
06d917fcf0
Merge pull request #61150 from rschu1ze/clang-tidy-list
Some clang-tidy fixes
2024-03-14 14:54:41 +01:00
vdimir
0b97f3ac16
Merge pull request #61320 from ClickHouse/vdimir/fix_rabbitmq_logical_error
Fix logical error in RabbitMQ storage with MATERIALIZED columns
2024-03-14 13:28:05 +01:00
Alexey Milovidov
8094dd88d9 Merge branch 'master' into split-cast-overload-resolver 2024-03-14 13:08:37 +01:00
Alexey Milovidov
1a41aa4ac7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver 2024-03-14 13:06:23 +01:00
divanik
9c77aa9510 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/generate_series_function 2024-03-14 11:41:14 +00:00
Kruglov Pavel
56220b5105
Revert "Revert "Fix usage of session_token in S3 engine"" 2024-03-14 12:23:32 +01:00
Antonio Andelic
c6f0b2a5a4
Revert "Fix usage of session_token in S3 engine" 2024-03-14 11:57:03 +01:00
Robert Schulze
3486b4a6e3
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list 2024-03-14 10:44:20 +00:00
jsc0218
b3b46ea708 Merge remote-tracking branch 'origin/master' into TableEngineGrant_version2 2024-03-14 00:36:29 +00:00
kssenii
208a91a2f7 Add retries exists check in loadOutdatedDataParts 2024-03-13 19:03:29 +01:00
Jake Bamrah
5e66cd7154 fix settings seg-fault and expand test case coverage 2024-03-13 18:47:13 +01:00
Yarik Briukhovetskyi
4aab1170ef fix style 2024-03-13 18:47:13 +01:00
Yarik Briukhovetskyi
77223d682d reload tests 2024-03-13 18:47:13 +01:00
Jake Bamrah
c73e299820 add size cap to memory tables 2024-03-13 18:47:13 +01:00
Kruglov Pavel
843e2dc968
Merge pull request #60586 from Avogar/fix-filter-virtual-columns
Fix reading from MergeTree with non-deterministic functions in filter
2024-03-13 18:22:12 +01:00
vdimir
b2e067b3da
Fix logical error in RabbitMQ storage with MATERIALIZED columns 2024-03-13 16:41:35 +00:00
Kruglov Pavel
dd0caaf9b4
Merge pull request #61234 from ClickHouse/Avogar-patch-2
Fix usage of session_token in S3 engine
2024-03-13 17:05:39 +01:00
divanik
cf639bab44 Fix attach bug 2024-03-13 13:37:26 +00:00
Dmitry Novik
80723134d6 Fix fast test #ci_set_analyzer 2024-03-13 14:00:57 +01:00
Dmitry Novik
ffdb84b8df Fix style 2024-03-13 13:38:23 +01:00
Dmitry Novik
1a47682c12 Analyzer: Fix virtual columns in StorageMerge #ci_set_analyzer 2024-03-13 13:08:12 +01:00
Dmitry Novik
2e49140de7 Small progress 2024-03-13 11:37:42 +01:00
Dmitry Novik
5ef241cc85 WIP on virtual columns in StorageMerge 2024-03-13 11:30:11 +01:00
unashi
da06ba432e [fix] merge and resolve problems 2024-03-13 12:09:35 +08:00
Alexey Milovidov
146e401851 Merge branch 'master' into split-cast-overload-resolver 2024-03-13 04:28:24 +01:00
unashi
c78224c2ff Merge branch 'master' into feat-59377 2024-03-13 11:24:00 +08:00
divanik
3c2514bc77 Correct small issues 2024-03-12 18:33:32 +00:00
Anton Popov
f35987928b free memory earlier in inserts 2024-03-12 18:05:14 +00:00
Anton Popov
fc648439f3
Merge branch 'master' into add-virtual-columns 2024-03-12 18:00:12 +01:00
divanik
8f44201f92 Preliminary commit 2024-03-12 16:22:33 +00:00
Azat Khuzhin
fb0ad3eb15 Disable retries for replicated fetches (they are handled by the engine itself)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 17:08:42 +01:00
Azat Khuzhin
df44ed173c Fix missed entries in system.part_log in case of fetch preferred over merges/mutations
The NEED_PREPARE do not call part_log_writer() before.

v2:
- Add a test for missed entries in system.part_log for merge
- Fix part_log_writer
- Add a test for missed entries in system.part_log for mutate

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 17:08:42 +01:00
Kseniia Sumarokova
3257bfa918
Merge branch 'master' into traverse_shadow_remote_data_paths 2024-03-12 15:18:52 +01:00
Robert Schulze
1b1685e3f1
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list 2024-03-12 13:02:59 +00:00
Kruglov Pavel
d431276045
Fix usage of session_token in S3 2024-03-12 12:43:48 +01:00
serxa
defed92331 do nothing in waitForOutdatedPartsToBeLoaded() if loading is not required 2024-03-12 11:38:27 +00:00
Kseniia Sumarokova
61543edc8b
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-12 11:53:00 +01:00
vdimir
439fe42f88
Merge pull request #61013 from ClickHouse/vdimir/fix_astrename_clone
Fix ASTRenameQuery::clone
2024-03-12 11:13:28 +01:00
Azat Khuzhin
6c74ab18c0 Do not clean mutations for MergeTree on DROP PART (to match ReplicatedMergeTree)
Even if this should be done, only related mutations should be cleaned,
not all.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 10:39:41 +01:00
Azat Khuzhin
f559767d22 Fix finished_mutations_to_keep=0 for MergeTree (as docs says 0 is to keep everything)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 10:39:41 +01:00
unashi
c1b94b2170 [debug] fast test again again 2024-03-12 15:33:43 +08:00
Zhuo Qiu
05969a39f3 resolve conflicts 2024-03-12 14:45:25 +08:00
unashi
10c7ea7a29 [debug] fast test again 2024-03-12 14:32:07 +08:00
Alexey Milovidov
5222ebc4b4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver 2024-03-12 06:37:38 +01:00
Alexey Milovidov
bdc884dfa5
Merge pull request #60255 from ClickHouse/dont-load-useless-index-parts-in-memory
Do not load useless columns from the index in memory
2024-03-12 08:30:53 +03:00
Zhuo Qiu
4ad8141a16 Maintain compatibility of estimateNeededDiskSpace()
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2024-03-12 13:07:46 +08:00
Zhuo Qiu
c628eaca8b Consider deleted rows when selecting parts to merge 2024-03-12 13:07:39 +08:00
Alexey Milovidov
bd4f948f12
Merge pull request #61058 from ClickHouse/rip-copier
Delete `clickhouse-copier`
2024-03-12 07:15:48 +03:00
unashi
2ae184f298 Merge branch 'feat-59377' of https://github.com/Unalian/ClickHouse into feat-59377 2024-03-12 12:12:05 +08:00
unashi
29fce4143d [fix] log level from fatal->error when hardlink and copy both fail 2024-03-12 12:07:24 +08:00
Alexey Milovidov
c3a839d595 Merge pull request #61127 from ClickHouse/remove-in-memory-data-parts-2
Remove in-memory data parts, part 3.
2024-03-12 07:07:07 +03:00
Nikita Mikhaylov
fcf8a3821d Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 19:12:49 +01:00
Nikita Mikhaylov
cfa042cb04 Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 15:45:20 +00:00
Anton Popov
db48b9749b better _part_offset column 2024-03-11 15:35:17 +00:00
avogar
ecc30448ba Fix filtering when optimize_use_implicit_projections=1 2024-03-11 15:26:29 +00:00
avogar
f6d7b39dfc Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-filter-virtual-columns 2024-03-11 15:05:52 +00:00
Anton Popov
2fabec2b9d Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-11 14:42:18 +00:00
Anton Popov
2bec92c48e better _part_offset column 2024-03-11 14:41:50 +00:00
Kseniia Sumarokova
e59564a9d9
Merge branch 'master' into traverse_shadow_remote_data_paths 2024-03-11 13:19:05 +01:00
vdimir
38b8e7ac7e
Maintain list of ASTRenameQuery children 2024-03-11 11:34:10 +00:00
serxa
b1d1c8eb0c Merge branch 'master' into revert-60253-revert-59032-cpu-scheduler-and-cc 2024-03-11 11:25:53 +00:00
Robert Schulze
e5e84419af
Fix clang-tidy-s 2024-03-11 10:58:54 +00:00
Kseniia Sumarokova
3832b0e126
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-11 11:30:03 +01:00
Kseniia Sumarokova
aacfefe0fe
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-11 10:37:53 +01:00
Alexey Milovidov
4373d5ba16 Merge branch 'master' into split-cast-overload-resolver 2024-03-11 03:01:50 +01:00
Alexey Milovidov
8a484a44e3 Merge branch 'master' into dont-load-useless-index-parts-in-memory 2024-03-11 02:10:20 +01:00
Alexey Milovidov
2550f9d284
Merge branch 'master' into remove-in-memory-data-parts-2 2024-03-11 01:44:20 +03:00
serxa
5b796e1f42 Merge branch 'master' into async-loader-waiters-limit 2024-03-10 15:20:27 +00:00
alesapin
253a29d528 Merge branch 'master' into fix_max_insert_delayed_streams_for_parallel_write 2024-03-10 15:34:13 +01:00
kssenii
0b63cb237a Fix 2024-03-10 15:33:06 +01:00
Sema Checherinda
80179e50e4
Merge pull request #58845 from ClickHouse/chesema-session-pool
HTTP connections pool
2024-03-10 14:06:59 +01:00
Alexey Milovidov
2cc071e0e4 Fix error 2024-03-10 12:48:15 +01:00
Alexey Milovidov
1d8b95bdcd
Update MergeTask.cpp 2024-03-10 14:43:18 +03:00
Alexey Milovidov
6a0eb7a3cd
Update ColumnSizeEstimator.h 2024-03-10 14:42:58 +03:00
Kseniia Sumarokova
ae98d4290c
Merge branch 'master' into traverse_shadow_remote_data_paths 2024-03-10 12:16:54 +01:00
kssenii
e5e6625b0c Merge remote-tracking branch 'origin/master' into fix-usage-of-plain-metadata 2024-03-10 12:05:02 +01:00
Alexey Milovidov
d340d9cfaf Fix build 2024-03-10 10:05:07 +01:00
Alexey Milovidov
dbb6dad921 Fix style 2024-03-10 10:04:40 +01:00
Alexey Milovidov
69cab686e4 Fix build of examples 2024-03-10 10:03:31 +01:00
Kseniia Sumarokova
7e7fc4127d
Merge branch 'master' into revert-refert-of-broken-projections-handling 2024-03-10 10:01:34 +01:00
Sema Checherinda
77c5de700f fix how web disk read empty directories 2024-03-10 10:00:18 +01:00
Sema Checherinda
5c41727725 http connections pools 2024-03-10 10:00:18 +01:00
Alexey Milovidov
9ddec346a0 Miscellaneous 2024-03-10 09:02:34 +01:00
Alexey Milovidov
d337379385 Remove in-memory data parts, step 2 2024-03-10 06:44:26 +01:00
Alexey Milovidov
b07e5d9f5a
Update StorageMergeTree.cpp 2024-03-10 08:11:59 +03:00
Alexey Milovidov
c7e7f03eae Merge branch 'master' of github.com:ClickHouse/ClickHouse into dont-load-useless-index-parts-in-memory 2024-03-09 03:58:31 +01:00
Nikita Mikhaylov
f73a8f2eae
More comments for column for system tables (#59016) 2024-03-08 18:05:56 +01:00
Dmitry Novik
526af77f4a
Merge pull request #60313 from ClickHouse/analyzer-refactor-constant-name
Analyzer: Refactor execution name for ConstantNode
2024-03-08 12:08:05 +01:00
Nikita Taranov
e66ac5770c
Merge pull request #60462 from ClickHouse/davenger-patch-1
Do not check to and from files existence in metadata_storage because it does not see uncommitted changes
2024-03-08 00:26:58 +01:00
Nikita Mikhaylov
2bc4d27ac6 Bye bye 2024-03-07 19:24:39 +00:00
serxa
0f0ea422f2 separate limits on number of waiting and executing queries 2024-03-07 17:05:54 +00:00
Anton Popov
88d8880267 better virtual columns and tests added 2024-03-07 14:56:45 +00:00
Anton Popov
ec926ea6e4 Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-07 13:22:20 +00:00
Dmitry Novik
23b33e5e32 Merge remote-tracking branch 'origin/master' into analyzer-refactor-constant-name 2024-03-07 14:18:44 +01:00
Anton Popov
c103b0084b
Merge pull request #60205 from CurtizJ/refactor-virtual-columns
Refactoring of virtual columns
2024-03-07 13:38:35 +01:00
Amos Bird
f2a3ffe9eb
Replace some headers with forward decl 2024-03-07 18:10:09 +08:00
Kseniia Sumarokova
8fc3581446
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-07 14:29:57 +08:00
Nikita Taranov
2b52583e06 fix style 2024-03-06 23:01:42 +01:00
Nikita Taranov
c192d0b125 impl 2024-03-06 22:29:41 +01:00
Igor Nikonov
a3c22f9ace
Merge pull request #60675 from ClickHouse/use-minmax-indices-always-first
Always apply first minmax index among available skip indices
2024-03-06 21:25:49 +01:00
Nikita Taranov
d008b4eb4f fix test 2024-03-06 20:24:38 +01:00
Dmitry Novik
d92538ced2
Merge branch 'master' into analyzer-refactor-constant-name 2024-03-06 17:55:52 +01:00
Anton Popov
c8878332ca fix StorageSystemDictionaries 2024-03-06 16:46:59 +00:00
Sema Checherinda
8ac2ef6608
Merge pull request #57575 from ClickHouse/chesema-drop-zk-table-node
drop keeper dir with zero copy locks
2024-03-06 17:43:35 +01:00
vdimir
56b6810122
Merge pull request #60641 from ClickHouse/vdimir/analyzer/comute_alias_columns
Resubmit "Analyzer: compute ALIAS columns right after reading"
2024-03-06 16:52:16 +01:00
Anton Popov
1c0aed896c fix build 2024-03-06 15:25:06 +00:00
Kruglov Pavel
5b94f9b411
Check children first 2024-03-06 15:31:19 +01:00
Anton Popov
f582797b36 Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-06 14:14:42 +00:00
Dmitry Novik
016bbfe6f8 Merge remote-tracking branch 'origin/master' into analyzer-distr-json 2024-03-06 15:09:52 +01:00
Igor Nikonov
d64abe2449 Merge remote-tracking branch 'origin/master' into use-minmax-indices-always-first 2024-03-06 13:51:55 +00:00
Dmitry Novik
7065e650e1 Code cleanup 2024-03-06 14:34:03 +01:00
kssenii
6d4514c045 Fix test 2024-03-06 16:55:48 +08:00
unashi
3dbb0a12fb [fix] style 2024-03-06 16:15:37 +08:00
Nikolai Kochetov
b040eadaa1
Merge pull request #60510 from ClickHouse/refactor-system-one-block
Refactor StorageSystemOneBlock
2024-03-06 08:55:50 +01:00
Sema Checherinda
8b2bd2125b no warnings at drop 2024-03-05 19:06:09 +01:00
Anton Popov
7fe7f3a79d address review comments 2024-03-05 16:03:02 +00:00
Nikolai Kochetov
97f955fcde Fix sanitizers 2024-03-05 14:10:46 +00:00
Dmitry Novik
04370083bb Merge remote-tracking branch 'origin/master' into analyzer-refactor-constant-name 2024-03-05 14:57:00 +01:00
Nikolai Kochetov
86ad80839a Merge pull request #60515 from ClickHouse/cleanup-lazy-format-always
PullingAsyncPipelineExecutor cleanup
2024-03-05 13:12:07 +01:00
vdimir
6f3e9b6de2
Merge branch 'master' into vdimir/analyzer/comute_alias_columns 2024-03-05 13:08:58 +01:00
Antonio Andelic
0bd4c6afa0 Use while-loop 2024-03-05 11:53:51 +01:00
Nikolai Kochetov
ee3edf2589 Fix system parts _state 2024-03-05 10:40:45 +00:00
Aleksei Filatov
f7d8dd0b71
Merge branch 'master' into traverse_shadow_remote_data_paths 2024-03-05 10:11:07 +03:00
Aleksei Filatov
758a75c1b4 Fix flaky test. Fix clang-tidy warning 2024-03-05 09:53:30 +03:00
Kseniia Sumarokova
dbbe6b9f69
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-05 11:13:32 +08:00
unashi
aa43885ac8 [improve] add check the remaining disk size before copying 2024-03-05 10:57:25 +08:00
Nikolai Kochetov
819e7bfc77 Merge branch 'master' into refactor-system-one-block 2024-03-04 21:03:45 +00:00
Igor Nikonov
ee4e5b1592 Merge remote-tracking branch 'origin/master' into use-minmax-indices-always-first 2024-03-04 18:29:05 +00:00
Nikolai Kochetov
d209508753 Fixing style. 2024-03-04 18:26:42 +00:00
Kruglov Pavel
4bdafed801
Merge pull request #60420 from HowePa/format_case_insensitive
Make all format names case insensitive.
2024-03-04 19:09:10 +01:00
Nikolai Kochetov
47d8f039e5 Cleanup VirtualColumnUtils 2024-03-04 18:01:12 +00:00
Nikolai Kochetov
2d8ca99860 Refactor more system storages. 2024-03-04 17:48:47 +00:00
Alexey Milovidov
ce6dec65cf
Merge pull request #60729 from ClickHouse/remove-more-live-view
Remove more code from LIVE VIEW
2024-03-04 18:58:21 +03:00
Alexey Milovidov
de6c5d3a40
Merge pull request #60552 from ClickHouse/pc2
Userspace page cache again
2024-03-04 17:47:35 +03:00
Dmitry Novik
01829450fb Merge remote-tracking branch 'origin/master' into analyzer-refactor-constant-name 2024-03-04 14:12:15 +01:00
Igor Nikonov
815e3db6f5 Merge remote-tracking branch 'origin/master' into use-minmax-indices-always-first 2024-03-04 10:09:44 +00:00
Alexey Milovidov
fc6f3c8399 Live view's life is close to the end 2024-03-04 00:49:22 +01:00
Alexey Milovidov
cbf5443585 Remove old code 2024-03-04 00:11:55 +01:00
Azat Khuzhin
707200d2a4 Fix system.parts for non-Atomic/Ordinary database engine (i.e. Memory)
Previously the code assumes that only Ordinary do not have UUID, while
this is not true, Memory (at least) does not has it as well.

One of the major users of Memory engine is clickhouse-local.

v2: check UUID instead of database engine
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 10:27:06 +01:00
jsc0218
2b54c11d63
Merge branch 'ClickHouse:master' into TableEngineGrant_version2 2024-03-02 20:42:04 -05:00
Igor Nikonov
491a4e8d4b Merge remote-tracking branch 'origin/master' into use-minmax-indices-always-first 2024-03-02 21:31:28 +00:00
Alexey Milovidov
5dfe708de0
Merge pull request #60605 from ClickHouse/24.3-prepare
Update version after release
2024-03-02 04:56:21 +03:00
Anton Popov
1b9e6c936e better interfaces for virtual columns 2024-03-01 22:29:56 +00:00
Anton Popov
dd400dedf2 add virtual column _data_version 2024-03-01 19:51:14 +00:00
Anton Popov
dcff866c9f add virtual column _block_offset 2024-03-01 19:36:49 +00:00
Igor Nikonov
754ae8792d Always apply first minmax index among available skip indices 2024-03-01 19:31:15 +00:00
Anton Popov
1a1e78cf63 temporary remove virtual column 2024-03-01 18:52:14 +00:00
Anton Popov
95611889dc fix tests 2024-03-01 18:44:33 +00:00
Igor Nikonov
a28385966c
Merge pull request #60513 from ClickHouse/cleanup-random-progress-bar
Simple cleanup while fixing progress bar
2024-03-01 16:51:46 +01:00
vdimir
47aa33408b
Resubmit "Analyzer: compute ALIAS columns right after reading"
This reverts commit 8141e1c3d1, reversing
changes made to fb099bbd62.
2024-03-01 14:53:02 +00:00
Nikolai Kochetov
2811b24a47 Fixing build 2024-03-01 14:42:46 +00:00
Nikolai Kochetov
af5dae58ca Merge branch 'master' into refactor-system-one-block 2024-03-01 13:42:00 +00:00
Igor Nikonov
ae7f780ce4
Merge pull request #60491 from ClickHouse/fix-cluster-table-func-progress-bar
Fix: progress bar for *Cluster table functions
2024-03-01 14:12:59 +01:00
Nikolai Kochetov
447f0817d5 Fixing build 2024-03-01 12:08:51 +00:00
Robert Schulze
3a5c9b627b
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-src 2024-03-01 10:31:55 +00:00
Kseniia Sumarokova
5ac53c9578
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-01 11:05:47 +08:00
Alexey Milovidov
ac4cbe3d12 Update autogenerated version to 24.3.1.1 and contributors 2024-02-29 22:08:31 +01:00
Julia Kartseva
891689a415
Merge pull request #60196 from azat/preliminary-filters-fix
Fix actions execution during preliminary filtering (PK, partition pruning)
2024-02-29 10:17:05 -08:00
Anton Popov
8a4e15536b refactoring of virtual columns 2024-02-29 18:01:54 +00:00
Raúl Marín
28820dad82
Merge pull request #60498 from ZhiguoZh/20240228-andfilter-opt
Auto-vectorize DB::andFilters
2024-02-29 17:02:09 +01:00
Robert Schulze
4ee1aa8c7c
Fixing more headers 2024-02-29 15:40:30 +00:00
avogar
09a392772d Use isDeterministicInScopeOfQuery 2024-02-29 15:34:45 +00:00
Nikita Taranov
f9d1c5769e
Merge branch 'master' into express_support 2024-02-29 16:26:43 +01:00
avogar
7632c2c33f Remove non-deterministic functions in virtual columns filter 2024-02-29 15:17:12 +00:00
Aleksei Filatov
8b1a1d42da Traverse shadow directory for system.remote_data_paths 2024-02-29 18:07:00 +03:00
Michael Kolupaev
cc893ad33c Merge remote-tracking branch 'origin/master' into pc2 2024-02-29 13:30:04 +00:00
Alexander Tokmakov
2dedfd6cf9
Revert "Analyzer: compute ALIAS columns right after reading" 2024-02-29 14:22:07 +01:00
Igor Nikonov
2f4585f653 Merge remote-tracking branch 'origin/master' into fix-cluster-table-func-progress-bar 2024-02-29 13:11:11 +00:00
Igor Nikonov
a8ee493b67 Merge remote-tracking branch 'origin/master' into cleanup-random-progress-bar 2024-02-29 13:09:20 +00:00
Sergei Trifonov
f8561b2265
Revert "Revert "Support resource request canceling"" 2024-02-29 13:53:27 +01:00
Michael Kolupaev
42437a2ae1 Userspace page cache (#53770)
* Userspace page cache

* Maybe it'll build this time, who knows.

* 'auto' went out of fashion, I guess

* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary

* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.

* Fix

* Another fix

* Fix restricted seek, fix ppc64le build

* Don't allow page cache with file cache

* Adjust tests a little

* Fix clang-tidy

* Conflicts

* Comments

* Maybe unbroke AsynchronousBoundedReadBuffer

* SettingsChangesHistory.h

* Fix warning in test
2024-02-29 12:28:32 +00:00
Alexander Tokmakov
15e1191f74
Revert "Userspace page cache (#53770)"
This reverts commit 7b55c61551.
2024-02-29 13:20:17 +01:00
Michael Kolupaev
7b55c61551
Userspace page cache (#53770)
* Userspace page cache

* Maybe it'll build this time, who knows.

* 'auto' went out of fashion, I guess

* Documentation, tsan workaround, metric 'UnreclaimableRss', disable page cache in the test that uses DatabaseOrdinary

* Moved CachedInMemoryReadBufferFromFile to object store level, changed settings, addressed other comments.

* Fix

* Another fix

* Fix restricted seek, fix ppc64le build

* Don't allow page cache with file cache

* Adjust tests a little

* Fix clang-tidy

* Conflicts

* Comments

* Maybe unbroke AsynchronousBoundedReadBuffer

* SettingsChangesHistory.h

* Fix warning in test
2024-02-29 11:27:32 +00:00
vdimir
5dd81f38fb
Merge pull request #59595 from ClickHouse/vdimir/analyzer/comute_alias_columns
Analyzer: compute ALIAS columns right after reading
2024-02-29 10:28:31 +01:00
Antonio Andelic
049e46c500
Merge pull request #60477 from ClickHouse/fix-s3cluster
Correctly check keys in s3Cluster
2024-02-29 09:20:32 +01:00
Nikita Taranov
974ba7364f better 2024-02-29 00:55:17 +01:00
Alexey Milovidov
e1e66dc2b8
Merge pull request #60095 from ClickHouse/fix-inconsistent-formatting
Fix inconsistent formatting of queries
2024-02-29 00:41:40 +03:00
Alexander Tokmakov
25c82a5949
Merge pull request #57798 from kirillgarbar/modify-engine
Convert MergeTree tables to replicated on server restart if flag is set
2024-02-28 21:55:15 +01:00
Igor Nikonov
627aa62d21 Simple cleanup while fixing progress bar 2024-02-28 20:40:17 +00:00
Anton Popov
0ceeb13b7f refactoring of virtual columns 2024-02-28 19:58:55 +00:00
Nikolai Kochetov
53714e6f7a Refactor StorageSystemOneBlock 2024-02-28 19:10:00 +00:00
jsc0218
24342012ff fix 2024-02-28 18:11:33 +00:00
Raúl Marín
4023e67ac5
Merge pull request #60138 from Algunenano/max_threads_sanity
Add sanity check for number of threads and block size
2024-02-28 19:05:55 +01:00
Anton Popov
0fa22abb95 refactoring of virtual columns 2024-02-28 17:05:00 +00:00
Igor Nikonov
9bd633cdf6 Fix: *Cluster table functions progress bar 2024-02-28 16:28:28 +00:00
Alexey Milovidov
8a272ffd8f
Merge pull request #60466 from ClickHouse/HarryLeeIBM-hlee-ftsearch-test
Merge #57434
2024-02-28 19:27:54 +03:00
Igor Nikonov
ad8029d2fd Fix: progress bar for *Cluster table functions 2024-02-28 16:26:06 +00:00
Alexey Milovidov
b0ab0b37db
Merge pull request #60434 from ClickHouse/revert-60216-revert-59697-check-stack-size-in-parser
Revert "Revert "Check stack size in Parser""
2024-02-28 19:20:49 +03:00
Alexey Milovidov
1950a75bd4 Merge branch 'master' into fix-inconsistent-formatting 2024-02-28 17:10:29 +01:00
jsc0218
b4b19ae2ad
Merge branch 'master' into TableEngineGrant_version2 2024-02-28 10:56:30 -05:00
Nikolai Kochetov
8dd08e9844
Merge pull request #59710 from GrigoryPervakov/master
Support sql created named collections in Kafka Storage for librdkafka settings
2024-02-28 16:38:56 +01:00
Anton Popov
9f8ac76345 Merge remote-tracking branch 'upstream/master' into HEAD 2024-02-28 14:42:37 +00:00
Dmitry Novik
0de2d766fa WIP on different JSONs on shards 2024-02-28 15:30:06 +01:00
Zhiguo Zhou
ae06e34ea9 Auto-vectorize DB::andFilters
DB::MergeTreeRangeReader::ReadResult::optimize adds the current
filter to the final one either via DB::combineFilters when both
filters have different sizes or otherwise via DB::andFilters, which
performs the logical AND operation (&&) to two UInt8 columns.

To vectorize DB::andFilters automatically, this commit performs NOT
operation to the operands twice so that the non-zeros are converted
to bool value of true (0x01) and the zeros to false (0x00), and via
this change the logical AND (&&) could be safely replaced with the
bitwise AND (&), which could be recognized and optimized by the
compiler.
2024-02-28 20:08:24 +08:00
Vitaly Baranov
926295f763
Merge pull request #60040 from vitlibar/use-multiple-threads-while-reading-metadata-for-restore
Use multiple threads while reading the metadata of tables to restore
2024-02-28 11:07:15 +01:00
Antonio Andelic
c4ae61f6e6 Correctly check prefetch buffer 2024-02-28 09:58:47 +01:00
pufit
330a206470
Add definers for views (Attempt 2) (#60439) 2024-02-27 19:00:17 -05:00
Anton Popov
3cdd3495fd
Merge pull request #60435 from CurtizJ/return-back-58140
Revert "Revert "Add table function `mergeTreeIndex`""
2024-02-28 00:52:44 +01:00
Alexey Milovidov
8cf619bc03 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-28 00:30:44 +01:00
Alexey Milovidov
9ea7ff231b
Merge pull request #60448 from ClickHouse/clang-19
Update to clang-19
2024-02-27 23:38:08 +03:00
Alexey Milovidov
2ab722214c Merge branch 'hlee-ftsearch-test' of github.com:HarryLeeIBM/ClickHouse into HarryLeeIBM-hlee-ftsearch-test 2024-02-27 20:29:46 +01:00
Pervakov Grigorii
d3b82ab7c1 Support sql created named collections in Kafka Storage for librdkafka settings 2024-02-27 18:36:36 +00:00
Alexey Milovidov
0f3c9963d1 Merge branch 'master' of github.com:ClickHouse/ClickHouse into revert-60216-revert-59697-check-stack-size-in-parser 2024-02-27 17:30:32 +01:00
Raúl Marín
f8ff15a023
Merge pull request #60429 from Algunenano/fix_unlimited_keeper
Fix unrestricted reads from keeper
2024-02-27 17:28:15 +01:00
Dmitry Novik
33ae650e6a Merge remote-tracking branch 'origin/master' into analyzer-refactor-constant-name 2024-02-27 16:35:28 +01:00
kssenii
ffd69e0e12 Move setting to merge-tree level 2024-02-27 23:22:04 +08:00
Robert Schulze
466cf93ee2
Merge pull request #60450 from rschu1ze/starts_with
Minor: Replace `boost::algorithm::starts_with()` by `std::string::starts_with()`
2024-02-27 16:21:02 +01:00
Robert Schulze
0f6bec7842
Merge pull request #59291 from azat/dist/config-settings
Support specifying settings for Distributed engine in config (like for MergeTree)
2024-02-27 16:10:51 +01:00
kssenii
7ac453ab4c Revert "Merge pull request #60436 from nickitat/revert_56864"
This reverts commit 8719a601fa, reversing
changes made to 657857f982.
2024-02-27 23:06:14 +08:00
Alexey Milovidov
ecbae90743 Remove unused file 2024-02-27 15:36:39 +01:00
Nikita Mikhaylov
8719a601fa
Merge pull request #60436 from nickitat/revert_56864
Revert "Merge pull request #56864 from ClickHouse/broken-projections-better-handling"
2024-02-27 15:25:15 +01:00
Alexey Milovidov
c192a448d0 Update to clang-19 2024-02-27 14:37:21 +01:00
Robert Schulze
62c12cbfca
Replace boost::algorithm::starts_with() by std::string::starts_with() 2024-02-27 10:42:47 +00:00
Nikita Taranov
854f1b064b Revert "Merge pull request #56864 from ClickHouse/broken-projections-better-handling"
This reverts commit caaafbcedb, reversing
changes made to d45b248f96.
2024-02-27 00:13:28 +01:00
Anton Popov
d683977fe9 Revert "Revert "Add table function mergeTreeIndex""
This reverts commit 1e4199d704.
2024-02-26 22:47:39 +00:00
Alexey Milovidov
04fe5dc55c Merge branch 'master' into fix-inconsistent-formatting 2024-02-26 23:46:24 +01:00
Alexey Milovidov
5b1a07053e Merge branch 'master' into dont-load-useless-index-parts-in-memory 2024-02-26 23:39:53 +01:00
Alexey Milovidov
0b90076a36
Revert "Revert "Check stack size in Parser"" 2024-02-27 01:34:50 +03:00
Robert Schulze
4794dc28f0
Merge remote-tracking branch 'ClickHouse/master' into dist/config-settings 2024-02-26 21:57:33 +00:00
Kirill Nikiforov
8b314a3ac8
Implement system.dns_cache table and dns_cache_max_size server setting (#60257)
* system.dns_cache table WIP

* system.dns_cache table

* rollback unexpected contrib changes

* rollback unexpected changes

* add docs

* code style fixes

* optimize dns cache exporting

* stateful test for system.dns_cache table

* stateful test for system.dns_cache table

* cr fixes

* stateful test for system.dns_cache table

* stateful test for system.dns_cache table

* implement system.dns_cache table

* system.dns_cache test

* system.dns_cache fix docs

* system.dns_cache prettify

* dns_cache_max_size settings

* fix system.dns_cache test

* Update dns_cache.md

* fix doc

Co-authored-by: pufit <pufit@clickhouse.com>

---------

Co-authored-by: pufit <pufit@clickhouse.com>
2024-02-26 15:48:02 -05:00
Raúl Marín
8a161bdc0a Fix unrestricted reads from keeper 2024-02-26 19:38:00 +01:00
Alexander Tokmakov
1e4199d704
Revert "Add table function mergeTreeIndex" 2024-02-26 19:37:06 +01:00
Alexey Milovidov
a3f1411679 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-26 19:01:11 +01:00
HowePa
dbd8d35f01 use lower case in dict 2024-02-27 00:48:34 +08:00
vdimir
9f1a0734a1
review fix 2024-02-26 16:15:14 +00:00
vdimir
5a9026f39b
Analyzer: compute ALIAS columns right after reading 2024-02-26 16:15:05 +00:00
Anton Popov
814cd53918
Merge pull request #58140 from CurtizJ/storage-merge-tree-index
Add table function `mergeTreeIndex`
2024-02-26 16:31:56 +01:00
Dmitry Novik
42b91201a5 Merge remote-tracking branch 'origin/master' into analyzer-refactor-constant-name 2024-02-26 15:11:57 +00:00
HowePa
ea89fa0de9 replace to checkFormatName 2024-02-26 23:07:50 +08:00
Robert Schulze
1e40b63cb1
Merge remote-tracking branch 'ClickHouse/master' into dist/config-settings 2024-02-26 11:15:51 +00:00
Raúl Marín
f84209be2f Merge remote-tracking branch 'blessed/master' into max_threads_sanity 2024-02-26 11:56:29 +01:00
Alexey Milovidov
bf75d2878b Merge branch 'master' into fix-inconsistent-formatting 2024-02-26 00:09:02 +01:00
Amos Bird
38427fff35
Better name 2024-02-26 02:32:00 +08:00
Amos Bird
d577d1e4e2
Fix something 2024-02-26 02:32:00 +08:00
Amos Bird
534da3f40f
Fix more tests 2024-02-26 02:31:59 +08:00
Amos Bird
6137914604
Fix most tests 2024-02-26 02:31:58 +08:00
Amos Bird
8a1e23dcc4
Fix more tests 2024-02-26 02:31:57 +08:00
Amos Bird
7435568a0d
Fix tests 2024-02-26 02:31:57 +08:00
Amos Bird
c5e073320c
Unify prewhere optimization 2024-02-26 02:31:56 +08:00
Amos Bird
49352732cc
Fix more tests 2024-02-26 02:31:56 +08:00
Amos Bird
ffab16595e
Fix more tests 2024-02-26 02:31:55 +08:00
Amos Bird
07a0adceb9
Only use query_info.filter_actions_dag for key analysis 2024-02-26 02:31:55 +08:00
Nikita Taranov
835b47519a impl 2024-02-25 00:33:50 +01:00
Azat Khuzhin
a70a100db0 Support io_uring for StorageFile
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 19:36:58 +01:00
Vitaly Baranov
f944faec6f Fix using table_id in StorageKeeperMap. 2024-02-23 20:27:19 +01:00
Alexey Milovidov
da2ae34c1d Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-inconsistent-formatting 2024-02-23 15:55:03 +01:00
Alexander Tokmakov
ef3b19167f
Merge pull request #58036 from MikhailBurdukov/backoff_for_failed_mutations
Backoff policy for failed mutation.
2024-02-23 15:27:41 +01:00
Alexey Milovidov
396402a9b6 Fix inconsistent formatting of operator function and nulls action 2024-02-23 15:22:21 +01:00
Nikita Mikhaylov
8fef0b71c4
Merge pull request #60350 from ClickHouse/revert-54901-pufit/views-sql-security
Revert "Add definers for views"
2024-02-23 15:15:36 +01:00
Dmitry Novik
d13b2a91c1 Fix virtual tables 2024-02-23 13:33:12 +00:00
Alexander Tokmakov
32607cc796
Merge pull request #60159 from ClickHouse/fix_create_replica
Skip sanity checks on secondary CREATE query
2024-02-23 13:53:47 +01:00
Sergei Trifonov
2c766cf75f
Merge pull request #59507 from ClickHouse/alter-table-forget-partition
Add `FORGET PARTITION` query to remove old partition nodes from ZooKeeper
2024-02-23 12:55:08 +01:00
Raúl Marín
464b5e0e15
Revert "Add definers for views (#54901)"
This reverts commit 57306706b3.
2024-02-23 12:44:31 +01:00
Raúl Marín
a431608dd4 Add sanity check for some settings 2024-02-23 12:32:17 +01:00
Kseniia Sumarokova
6a7fef13ba
Merge pull request #60282 from ClickHouse/s3queue-fix-bug-and-flaky-test
s3queue: fix bug (also fixes flaky test_storage_s3_queue/test.py::test_shards_distributed)
2024-02-23 11:57:34 +01:00
Dmitry Novik
81df9c5a27
Use possition to merge plans 2024-02-22 19:07:54 +01:00
Alexander Tokmakov
e56748a92c
Merge pull request #60044 from ClickHouse/fix_undead_sessions
Ability to detect undead ZooKeeper sessions
2024-02-22 18:13:15 +01:00
pufit
57306706b3
Add definers for views (#54901) 2024-02-22 17:47:50 +01:00
kssenii
f1e95fb78b Add a way to force read-through cache for merges 2024-02-22 15:40:00 +01:00
Azat Khuzhin
0cb6f205d7 Fix actions execution during preliminary filtering (PK, partition pruning)
Previously preliminary filtering works incorrectly if input columns had
been used multiple times, because:
- position initialized only for the first user
- column had been moved, so the second user will get nullptr

And this was the case when it had been required multiple times.

Consider the following example:

    select * from data final prewhere indexHint(_partition_id = 'all') or indexHint(_partition_id = 'all')

Actions for this PREWHERE is the following:

    (lldb) p actions.__ptr_->dumpActions()
    (std::string) $1 = "input:
    _partition_id LowCardinality(String)
    _partition_id LowCardinality(String)

    actions:
    INPUT : 0 -> _partition_id LowCardinality(String) : 0
    COLUMN Const(String) -> 'all' String : 1
    COLUMN Const(String) -> 'UInt8'_String String : 2
    INPUT : 1 -> _partition_id LowCardinality(String) : 3
    COLUMN Const(String) -> 'all' String : 4
    COLUMN Const(String) -> 'UInt8'_String String : 5
    FUNCTION equals(_partition_id :: 0, 'all' :: 1) -> equals(_partition_id, 'all') LowCardinality(UInt8) : 6
    FUNCTION equals(_partition_id :: 3, 'all' :: 4) -> equals(_partition_id, 'all') LowCardinality(UInt8) : 1
    FUNCTION _CAST(equals(_partition_id, 'all') :: 6, 'UInt8'_String :: 2) -> _CAST(equals(_partition_id, 'all'), 'UInt8'_String) UInt8 : 4
    FUNCTION _CAST(equals(_partition_id, 'all') :: 1, 'UInt8'_String :: 5) -> _CAST(equals(_partition_id, 'all'), 'UInt8'_String) UInt8 : 2
    FUNCTION or(_CAST(equals(_partition_id, 'all'), 'UInt8'_String) :: 4, _CAST(equals(_partition_id, 'all'), 'UInt8'_String) :: 2) -> or(indexHint(), indexHint())"...

It has _partition_id column in input multiple times.

So fix this by adding a flag (`allow_duplicates_in_input`), if set,
columns will be fully initialized.

v2: fix "Position out of bound in Block::erase()"
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-22 15:01:57 +01:00
Alexander Tokmakov
97ed2c05b0 Merge branch 'master' into fix_undead_sessions 2024-02-22 14:36:36 +01:00
Nikolai Kochetov
0e6b55ad35
Merge pull request #60220 from kitaisreal/system-backups-system-backup-log-add-query-id-and-error-stacktrace
Tables system.backups and system.backup_log add query_id and error stacktrace
2024-02-22 12:43:52 +01:00
kssenii
222323f293 Fix 2024-02-22 12:38:13 +01:00
Azat Khuzhin
a4f765cae7
Improve performance of SELECTs with active mutations (#59531)
* Configure keeper for perf tests

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Improve performance of SELECTs with active mutations

getAlterMutationCommandsForPart() can be a hot path for query execution
when there are pending mutations.

- LOG_TEST - it is not only check one bool, but actually a bunch of
  atomics as well.

- Return std::vector over std::map (map is not required there) - no
  changes in performance.

- Copy only RENAME_COLUMN (since only this mutation is required by
  AlterConversions).

And here are results:

run|result
-|-
SELECT w/o ALTER|queries: 1565, QPS: 355.259, RPS: 355.259
SELECT w/ ALTER unpatched|queries: 2099, QPS: 220.623, RPS: 220.623
SELECT w/ ALTER and w/o LOG_TEST|queries: 2730, QPS: 235.859, RPS: 235.859
SELECT w/ ALTER and w/o LOG_TEST and w/ RENAME_COLUMN only|queries: 2995, QPS: 290.982, RPS: 290.982

But there are still room for improvements, at least MergeTree engines
could implement getStorageSnapshotForQuery().

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Add AlterConversions::supportsMutationCommandType(), flatten vector<vector<MutationCommand>>

* Work around what appears to be a clang static analysis bug

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Co-authored-by: Michael Kolupaev <michael.kolupaev@clickhouse.com>
2024-02-22 08:51:10 +00:00
Alexey Milovidov
e98d09c93e Do not load useless columns from the index in memory 2024-02-21 21:41:04 +01:00
Alexander Tokmakov
c5ab1893d7 Merge branch 'master' into modify-engine 2024-02-21 20:37:58 +01:00
Raúl Marín
453d4d30cf
Revert "Support resource request canceling" 2024-02-21 20:19:00 +01:00
Alexander Tokmakov
fcfea17657
Update gtest_storage_log.cpp 2024-02-21 20:16:14 +01:00
Anton Popov
c624e2fa8b fix style check 2024-02-21 18:56:28 +00:00
Anton Popov
6656cdb9fb refactoring of virtual columns 2024-02-21 17:24:12 +00:00
Anton Popov
3d57237fe8 refactoring of virtual columns 2024-02-21 16:40:27 +00:00
Sergei Trifonov
19e81c20ca
Merge pull request #59032 from ClickHouse/cpu-scheduler-and-cc
Support resource request canceling
2024-02-21 16:16:24 +01:00
serxa
69c5fae1bc review fixes 2024-02-21 15:11:50 +00:00
serxa
8b7ef7c895 assert is not needed 2024-02-21 14:53:19 +00:00
Igor Nikonov
a0105e94ba
Merge pull request #60077 from ClickHouse/cleanup-connection-pool-priority
Cleanup: less confusion between config priority and balancing priority in connection pools
2024-02-21 15:22:08 +01:00
serxa
f92ec2cd5d Merge branch 'master' into cpu-scheduler-and-cc 2024-02-21 14:05:37 +00:00
serxa
bf90da7057 Merge branch 'master' into cpu-scheduler-and-cc 2024-02-21 14:05:01 +00:00
Maksim Kita
ae91c655a0 Tables system.backups and system.backup_log add query_id and error stacktrace 2024-02-21 14:36:58 +03:00
Antonio Andelic
fee1565780
Revert "Check stack size in Parser" 2024-02-21 11:33:08 +01:00
Kseniia Sumarokova
d601534a4e
Merge pull request #60166 from ClickHouse/fix-s3-queue-system-table-uuid-column
Fix system.s3queue_log
2024-02-21 10:52:45 +01:00
Alexey Milovidov
c9686eb76c
Merge pull request #60123 from conicl/skip_log_empty_message
skip printing meaningless log
2024-02-21 09:02:26 +01:00
Anton Popov
74399253d9 refactoring of virtual columns 2024-02-21 02:28:30 +00:00
Anton Popov
23f300b581 refactoring of virtual columns 2024-02-21 00:57:35 +00:00
Alexander Tokmakov
45d407034f Merge branch 'master' into fix_undead_sessions 2024-02-20 22:21:37 +01:00
Alexander Tokmakov
ec0986af0b skip sanity checks on secondary create query 2024-02-20 21:59:28 +01:00
alesapin
392081256c
Merge pull request #60078 from kitaisreal/revert-60058-revert-59946-replicated-merge-tree-alter-update-metadata-version-in-single-transaction
Revert "Revert "ReplicatedMergeTree invalid metadata_version fix""
2024-02-20 19:24:35 +01:00
Anton Popov
533082495d fix build 2024-02-20 16:33:43 +00:00
Kseniia Sumarokova
f7de95cec3
Merge pull request #59775 from ClickHouse/rabbitmq-fix-possible-channel-ack-timeout
rabbitmq: fix possible channel error state
2024-02-20 16:08:33 +01:00
unashi
f829a97d91 [fix] rm whitespaces 2024-02-20 21:08:24 +08:00
Sergei Trifonov
d2aebe2c9a
Merge branch 'master' into alter-table-forget-partition 2024-02-20 13:56:50 +01:00
unashi
fc3ebe007b [fix] rm whitespaces 2024-02-20 20:54:32 +08:00
unashi
6437877a71 [fix] add changelog; change some feature logic 2024-02-20 20:31:59 +08:00
Antonio Andelic
34e8e673e9
Merge pull request #60144 from ClickHouse/per-user-s3-settings
Support specifying users for S3 settings
2024-02-20 13:20:07 +01:00
Igor Nikonov
b6277d5e87 Merge remote-tracking branch 'origin/master' into cleanup-connection-pool-priority 2024-02-20 12:13:10 +00:00
Robert Schulze
7e11fc79d9
Merge pull request #58023 from canhld94/materialize_non_override_past_values
Materializing an ordinary column with default expression should not override past values
2024-02-20 11:12:31 +01:00
kssenii
3dac4c9743 Fix 2024-02-20 11:10:11 +01:00
kssenii
5ef4a30d6f Fix 2024-02-20 10:24:09 +01:00
MikhailBurdukov
c2d641c658
Merge branch 'master' into backoff_for_failed_mutations 2024-02-20 11:48:59 +03:00
Maksim Kita
9e0f607608 Revert "Revert "ReplicatedMergeTree invalid metadata_version fix"" 2024-02-20 11:39:57 +03:00
MikhailBurdukov
7cdfedaedd Enable setting by default 2024-02-20 08:39:11 +00:00
Alexey Milovidov
b216223aa0
Merge pull request #60139 from ClickHouse/revert-60093-lazy-primary-key-loading
Fix data race in `IMergeTreeDataPart`
2024-02-20 06:44:28 +01:00
unashi
8de4a9dbfd [fix] delete trailing whitespaces 2024-02-20 11:42:40 +08:00
Raúl Marín
9361946d15 Fix build in master 2024-02-19 17:48:53 +01:00
alesapin
31bc327005
Merge pull request #60111 from ClickHouse/buffer_bg_flush_parallel
Flush StorageBuffer into multiple threads if num_layers > 1
2024-02-19 16:56:24 +01:00
Antonio Andelic
175a1db787 Support specifying users for s3 settings 2024-02-19 16:43:27 +01:00
Anton Popov
0aa8dafe0a Merge remote-tracking branch 'upstream/master' into HEAD 2024-02-19 14:07:55 +00:00
Vitaly Baranov
f10a8868e1
Merge pull request #60097 from vitlibar/move-thread-pool-callback-runner-to-common
Move threadPoolCallbackRunner to the "Common" folder
2024-02-19 14:10:36 +01:00
Antonio Andelic
7c2654f62e Fix data race 2024-02-19 14:09:37 +01:00
Dmitry Novik
11970ddf82
Merge branch 'master' into analyzer-fix-test_select_table_name_from_merge_over_distributed 2024-02-19 14:07:58 +01:00
Dmitry Novik
2122454576 Temporary progress 2024-02-19 12:41:29 +00:00
Igor Nikonov
f06e15ce5f Merge remote-tracking branch 'origin/master' into cleanup-connection-pool-priority 2024-02-19 11:33:55 +00:00
unashi
f62ccc75ec [merge] solve 2024-02-19 19:28:16 +08:00
Alexey Milovidov
a10eddecef
Merge pull request #59697 from ClickHouse/check-stack-size-in-parser
Check stack size in Parser
2024-02-19 11:33:04 +01:00
Alexey Milovidov
df48106cd5
Merge pull request #60015 from azat/values-quote-escape
Fix INSERT into SQLite with single quote (by escaping single quotes with a quote instead of backslash)
2024-02-19 10:37:45 +01:00
alesapin
6565423b1a Review fix 2024-02-19 10:32:36 +01:00
conicliu
b38ad8297c skip log empty message 2024-02-19 16:11:42 +08:00
Alexey Milovidov
fa1ca348a4 Miscellaneous 2024-02-19 03:19:21 +01:00
jsc0218
9fc9fa7850 client side 2024-02-19 02:17:00 +00:00
Alexey Milovidov
6fd563df52 Miscellaneous 2024-02-19 02:58:51 +01:00