Commit Graph

16611 Commits

Author SHA1 Message Date
Dmitry Novik
1cdd280c9f
Merge pull request #61392 from ClickHouse/analyzer-fix-context-in-merge
Analyzer: Fix planner context for subquery in StorageMerge
2024-03-15 14:05:28 +01:00
Sergei Trifonov
273d221781
Merge pull request #60558 from ClickHouse/revert-60253-revert-59032-cpu-scheduler-and-cc
Revert "Revert "Support resource request canceling""
2024-03-15 13:24:50 +01:00
Antonio Andelic
0ba400d065
Merge pull request #61380 from ClickHouse/fix-heap-use-after-free-alias-merge
Fix `heap-use-after-free` for Merge table with alias
2024-03-15 11:15:02 +01:00
Zhuo Qiu
7f97b11ce6 only read _row_exists column when necessary 2024-03-15 15:48:20 +08:00
Alexey Milovidov
c9fb8ef54b Merge branch 'master' into split-cast-overload-resolver 2024-03-15 07:09:51 +01:00
Nikolai Kochetov
1cae77997a Try revert stage back 2024-03-14 21:34:25 +00:00
avogar
e08eaebc99 Add sanity check for poll_max_batch_size FileLog setting to avoid big untracked allocations 2024-03-14 20:36:18 +00:00
Anton Popov
edaf2c8023 Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-14 17:06:22 +00:00
Dmitry Novik
0b3b734c9b Analyzer: Fix planner context for subquery in StorageMerge 2024-03-14 17:37:49 +01:00
Kseniia Sumarokova
ceeb926fa8
Merge branch 'master' into add-zk-retries 2024-03-14 17:27:40 +01:00
kssenii
b778b01408 Add settings 2024-03-14 16:39:32 +01:00
Dmitry Novik
d558c4dcb7 Cleanup 2024-03-14 16:17:58 +01:00
Dmitry Novik
e145115ef1 Fixup 2024-03-14 16:15:06 +01:00
Antonio Andelic
026ac4deb1 Fix heap-use-after-free for Merge table with alias 2024-03-14 14:20:22 +00:00
Robert Schulze
06d917fcf0
Merge pull request #61150 from rschu1ze/clang-tidy-list
Some clang-tidy fixes
2024-03-14 14:54:41 +01:00
vdimir
0b97f3ac16
Merge pull request #61320 from ClickHouse/vdimir/fix_rabbitmq_logical_error
Fix logical error in RabbitMQ storage with MATERIALIZED columns
2024-03-14 13:28:05 +01:00
Alexey Milovidov
8094dd88d9 Merge branch 'master' into split-cast-overload-resolver 2024-03-14 13:08:37 +01:00
Alexey Milovidov
1a41aa4ac7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver 2024-03-14 13:06:23 +01:00
Kruglov Pavel
56220b5105
Revert "Revert "Fix usage of session_token in S3 engine"" 2024-03-14 12:23:32 +01:00
Antonio Andelic
c6f0b2a5a4
Revert "Fix usage of session_token in S3 engine" 2024-03-14 11:57:03 +01:00
Robert Schulze
3486b4a6e3
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list 2024-03-14 10:44:20 +00:00
kssenii
208a91a2f7 Add retries exists check in loadOutdatedDataParts 2024-03-13 19:03:29 +01:00
Jake Bamrah
5e66cd7154 fix settings seg-fault and expand test case coverage 2024-03-13 18:47:13 +01:00
Yarik Briukhovetskyi
4aab1170ef fix style 2024-03-13 18:47:13 +01:00
Yarik Briukhovetskyi
77223d682d reload tests 2024-03-13 18:47:13 +01:00
Jake Bamrah
c73e299820 add size cap to memory tables 2024-03-13 18:47:13 +01:00
Kruglov Pavel
843e2dc968
Merge pull request #60586 from Avogar/fix-filter-virtual-columns
Fix reading from MergeTree with non-deterministic functions in filter
2024-03-13 18:22:12 +01:00
vdimir
b2e067b3da
Fix logical error in RabbitMQ storage with MATERIALIZED columns 2024-03-13 16:41:35 +00:00
Kruglov Pavel
dd0caaf9b4
Merge pull request #61234 from ClickHouse/Avogar-patch-2
Fix usage of session_token in S3 engine
2024-03-13 17:05:39 +01:00
Dmitry Novik
80723134d6 Fix fast test #ci_set_analyzer 2024-03-13 14:00:57 +01:00
Dmitry Novik
ffdb84b8df Fix style 2024-03-13 13:38:23 +01:00
Dmitry Novik
1a47682c12 Analyzer: Fix virtual columns in StorageMerge #ci_set_analyzer 2024-03-13 13:08:12 +01:00
Dmitry Novik
2e49140de7 Small progress 2024-03-13 11:37:42 +01:00
Dmitry Novik
5ef241cc85 WIP on virtual columns in StorageMerge 2024-03-13 11:30:11 +01:00
Alexey Milovidov
146e401851 Merge branch 'master' into split-cast-overload-resolver 2024-03-13 04:28:24 +01:00
Anton Popov
f35987928b free memory earlier in inserts 2024-03-12 18:05:14 +00:00
Azat Khuzhin
fb0ad3eb15 Disable retries for replicated fetches (they are handled by the engine itself)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 17:08:42 +01:00
Azat Khuzhin
df44ed173c Fix missed entries in system.part_log in case of fetch preferred over merges/mutations
The NEED_PREPARE do not call part_log_writer() before.

v2:
- Add a test for missed entries in system.part_log for merge
- Fix part_log_writer
- Add a test for missed entries in system.part_log for mutate

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 17:08:42 +01:00
Robert Schulze
1b1685e3f1
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list 2024-03-12 13:02:59 +00:00
Kruglov Pavel
d431276045
Fix usage of session_token in S3 2024-03-12 12:43:48 +01:00
Kseniia Sumarokova
61543edc8b
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-12 11:53:00 +01:00
vdimir
439fe42f88
Merge pull request #61013 from ClickHouse/vdimir/fix_astrename_clone
Fix ASTRenameQuery::clone
2024-03-12 11:13:28 +01:00
Azat Khuzhin
6c74ab18c0 Do not clean mutations for MergeTree on DROP PART (to match ReplicatedMergeTree)
Even if this should be done, only related mutations should be cleaned,
not all.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 10:39:41 +01:00
Azat Khuzhin
f559767d22 Fix finished_mutations_to_keep=0 for MergeTree (as docs says 0 is to keep everything)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 10:39:41 +01:00
Zhuo Qiu
05969a39f3 resolve conflicts 2024-03-12 14:45:25 +08:00
Alexey Milovidov
5222ebc4b4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver 2024-03-12 06:37:38 +01:00
Alexey Milovidov
bdc884dfa5
Merge pull request #60255 from ClickHouse/dont-load-useless-index-parts-in-memory
Do not load useless columns from the index in memory
2024-03-12 08:30:53 +03:00
Zhuo Qiu
4ad8141a16 Maintain compatibility of estimateNeededDiskSpace()
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2024-03-12 13:07:46 +08:00
Zhuo Qiu
c628eaca8b Consider deleted rows when selecting parts to merge 2024-03-12 13:07:39 +08:00
Alexey Milovidov
bd4f948f12
Merge pull request #61058 from ClickHouse/rip-copier
Delete `clickhouse-copier`
2024-03-12 07:15:48 +03:00
Alexey Milovidov
c3a839d595 Merge pull request #61127 from ClickHouse/remove-in-memory-data-parts-2
Remove in-memory data parts, part 3.
2024-03-12 07:07:07 +03:00
Nikita Mikhaylov
fcf8a3821d Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 19:12:49 +01:00
Nikita Mikhaylov
cfa042cb04 Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 15:45:20 +00:00
avogar
ecc30448ba Fix filtering when optimize_use_implicit_projections=1 2024-03-11 15:26:29 +00:00
avogar
f6d7b39dfc Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-filter-virtual-columns 2024-03-11 15:05:52 +00:00
vdimir
38b8e7ac7e
Maintain list of ASTRenameQuery children 2024-03-11 11:34:10 +00:00
serxa
b1d1c8eb0c Merge branch 'master' into revert-60253-revert-59032-cpu-scheduler-and-cc 2024-03-11 11:25:53 +00:00
Robert Schulze
e5e84419af
Fix clang-tidy-s 2024-03-11 10:58:54 +00:00
Kseniia Sumarokova
3832b0e126
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges 2024-03-11 11:30:03 +01:00
Kseniia Sumarokova
aacfefe0fe
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-11 10:37:53 +01:00
Alexey Milovidov
4373d5ba16 Merge branch 'master' into split-cast-overload-resolver 2024-03-11 03:01:50 +01:00
Alexey Milovidov
8a484a44e3 Merge branch 'master' into dont-load-useless-index-parts-in-memory 2024-03-11 02:10:20 +01:00
Alexey Milovidov
2550f9d284
Merge branch 'master' into remove-in-memory-data-parts-2 2024-03-11 01:44:20 +03:00
alesapin
253a29d528 Merge branch 'master' into fix_max_insert_delayed_streams_for_parallel_write 2024-03-10 15:34:13 +01:00
kssenii
0b63cb237a Fix 2024-03-10 15:33:06 +01:00
Sema Checherinda
80179e50e4
Merge pull request #58845 from ClickHouse/chesema-session-pool
HTTP connections pool
2024-03-10 14:06:59 +01:00
Alexey Milovidov
2cc071e0e4 Fix error 2024-03-10 12:48:15 +01:00
Alexey Milovidov
1d8b95bdcd
Update MergeTask.cpp 2024-03-10 14:43:18 +03:00
Alexey Milovidov
6a0eb7a3cd
Update ColumnSizeEstimator.h 2024-03-10 14:42:58 +03:00
kssenii
e5e6625b0c Merge remote-tracking branch 'origin/master' into fix-usage-of-plain-metadata 2024-03-10 12:05:02 +01:00
Alexey Milovidov
d340d9cfaf Fix build 2024-03-10 10:05:07 +01:00
Alexey Milovidov
dbb6dad921 Fix style 2024-03-10 10:04:40 +01:00
Alexey Milovidov
69cab686e4 Fix build of examples 2024-03-10 10:03:31 +01:00
Sema Checherinda
77c5de700f fix how web disk read empty directories 2024-03-10 10:00:18 +01:00
Sema Checherinda
5c41727725 http connections pools 2024-03-10 10:00:18 +01:00
Alexey Milovidov
9ddec346a0 Miscellaneous 2024-03-10 09:02:34 +01:00
Alexey Milovidov
d337379385 Remove in-memory data parts, step 2 2024-03-10 06:44:26 +01:00
Alexey Milovidov
c7e7f03eae Merge branch 'master' of github.com:ClickHouse/ClickHouse into dont-load-useless-index-parts-in-memory 2024-03-09 03:58:31 +01:00
Nikita Mikhaylov
f73a8f2eae
More comments for column for system tables (#59016) 2024-03-08 18:05:56 +01:00
Dmitry Novik
526af77f4a
Merge pull request #60313 from ClickHouse/analyzer-refactor-constant-name
Analyzer: Refactor execution name for ConstantNode
2024-03-08 12:08:05 +01:00
Nikita Taranov
e66ac5770c
Merge pull request #60462 from ClickHouse/davenger-patch-1
Do not check to and from files existence in metadata_storage because it does not see uncommitted changes
2024-03-08 00:26:58 +01:00
Nikita Mikhaylov
2bc4d27ac6 Bye bye 2024-03-07 19:24:39 +00:00
Dmitry Novik
23b33e5e32 Merge remote-tracking branch 'origin/master' into analyzer-refactor-constant-name 2024-03-07 14:18:44 +01:00
Anton Popov
c103b0084b
Merge pull request #60205 from CurtizJ/refactor-virtual-columns
Refactoring of virtual columns
2024-03-07 13:38:35 +01:00
Amos Bird
f2a3ffe9eb
Replace some headers with forward decl 2024-03-07 18:10:09 +08:00
Kseniia Sumarokova
8fc3581446
Merge branch 'master' into fix-usage-of-plain-metadata 2024-03-07 14:29:57 +08:00
Nikita Taranov
2b52583e06 fix style 2024-03-06 23:01:42 +01:00
Nikita Taranov
c192d0b125 impl 2024-03-06 22:29:41 +01:00
Igor Nikonov
a3c22f9ace
Merge pull request #60675 from ClickHouse/use-minmax-indices-always-first
Always apply first minmax index among available skip indices
2024-03-06 21:25:49 +01:00
Nikita Taranov
d008b4eb4f fix test 2024-03-06 20:24:38 +01:00
Dmitry Novik
d92538ced2
Merge branch 'master' into analyzer-refactor-constant-name 2024-03-06 17:55:52 +01:00
Anton Popov
c8878332ca fix StorageSystemDictionaries 2024-03-06 16:46:59 +00:00
Sema Checherinda
8ac2ef6608
Merge pull request #57575 from ClickHouse/chesema-drop-zk-table-node
drop keeper dir with zero copy locks
2024-03-06 17:43:35 +01:00
vdimir
56b6810122
Merge pull request #60641 from ClickHouse/vdimir/analyzer/comute_alias_columns
Resubmit "Analyzer: compute ALIAS columns right after reading"
2024-03-06 16:52:16 +01:00
Anton Popov
1c0aed896c fix build 2024-03-06 15:25:06 +00:00
Kruglov Pavel
5b94f9b411
Check children first 2024-03-06 15:31:19 +01:00
Anton Popov
f582797b36 Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-06 14:14:42 +00:00
Igor Nikonov
d64abe2449 Merge remote-tracking branch 'origin/master' into use-minmax-indices-always-first 2024-03-06 13:51:55 +00:00
kssenii
6d4514c045 Fix test 2024-03-06 16:55:48 +08:00
Nikolai Kochetov
b040eadaa1
Merge pull request #60510 from ClickHouse/refactor-system-one-block
Refactor StorageSystemOneBlock
2024-03-06 08:55:50 +01:00