Nikolai Kochetov
75150033c8
Cleanup
2024-03-25 12:45:20 +00:00
Nikolai Kochetov
6d5f2cd7b5
Cleanup
2024-03-25 12:44:28 +00:00
Yarik Briukhovetskyi
20a45b4073
Merge pull request #61564 from liuneng1994/optimize_in_single_value
...
New analyzer pass to optimize in single value
2024-03-25 12:53:01 +01:00
Nikolai Kochetov
abe78e1a7b
Merge branch 'master' into fix-virtual-columns-storage-merge-analyzer
2024-03-25 10:43:23 +00:00
Azat Khuzhin
911fab7824
Fix possible connections data-race for distributed_foreground_insert/distributed_background_insert_batch
...
Previously connection will marked as not in use earlier than
RemoteInserter, while it still may use it and this will lead to crashes,
like in [1].
[1]: https://s3.amazonaws.com/clickhouse-test-reports/61832/d0cd8d0d7f74ff251d52e1871cba57d26a51873b/stateless_tests_flaky_check__asan_.html
I was able to reproduce the crash locally by running the test
03030_system_flush_distributed_settings in parallel.
Fixes : #45491
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-25 11:25:11 +01:00
János Benjamin Antal
80a7cda59a
Fix style
2024-03-25 09:21:45 +00:00
Alexey Milovidov
8c6a6f2b71
Merge pull request #61832 from azat/dist/flush-settings
...
Add ability to override initial INSERT SETTINGS via SYSTEM FLUSH DISTRIBUTED
2024-03-25 03:09:01 +03:00
Azat Khuzhin
35722be8ec
Add ability to override initial INSERT SETTINGS via SYSTEM FLUSH DISTRIBUTED
...
This is useful to overwrite settings in the initial query during force
flush with SYSTEM FLUSH DISTRIBUTED.
For example imagine that your server is out of queries
(max_max_concurrent_queries_for_all_users had been reached), but you
want to flush the distributed table anyway, after this patch you can
use something like this:
SYSTEM FLUSH DISTRIBUTED dist SETTINGS max_concurrent_queries_for_all_users=1000000
And also fix flush_on_detach for SYSTEM FLUSH DISTRIBUTED, it should
ignore flush_on_detach.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-24 21:32:34 +01:00
Alexey Milovidov
9210712f4f
Merge pull request #60112 from Unalian/feat-59377
...
[feature]: allow to attach parts from a different disk
2024-03-24 23:12:43 +03:00
Alexey Milovidov
717603802d
Merge pull request #61785 from danipozo/azure-use-managed-identity-for-backups
...
Use managed identity for backups IO in Azure Blob Storage
2024-03-24 20:31:12 +03:00
Alexey Milovidov
8ddfe9a48b
Merge pull request #61665 from ClickHouse/build-improvements-magic-enum-template-instantiation
...
Build improvements by removing magic enum from header and apply some explicit template instantiation
2024-03-24 19:31:46 +03:00
Alexey Milovidov
93beef8bb5
Merge pull request #61399 from azat/order-by-SimpleAggregateFunction
...
Forbid SimpleAggregateFunction in ORDER BY of MergeTree tables
2024-03-24 19:31:18 +03:00
alesapin
49f007af60
Merge remote-tracking branch 'origin/master' into fix_wait_for_mutation_done
2024-03-24 13:54:39 +01:00
Alexey Milovidov
8936528372
Merge branch 'master' into order-by-SimpleAggregateFunction
2024-03-24 02:16:57 +01:00
Alexey Milovidov
aeefba57b5
Update StorageAzureBlob.cpp
2024-03-23 22:49:23 +03:00
Alexey Milovidov
13b4a2838c
Update StorageReplicatedMergeTree.cpp
2024-03-23 21:26:23 +03:00
Alexey Milovidov
25201919a5
Fix errors
2024-03-23 19:23:01 +01:00
Alexey Milovidov
a5dc6241bb
Update StorageMaterializedView.cpp
2024-03-23 21:10:42 +03:00
Alexey Milovidov
7c189ee94a
Merge branch 'master' into add-materialized-view-query-check
2024-03-23 21:07:58 +03:00
Alexey Milovidov
056c8ce021
Merge pull request #59965 from nickitat/express_support
...
S3Express support
2024-03-23 20:52:44 +03:00
Alexey Milovidov
a56c113c83
Fix for clang-19
2024-03-22 22:12:59 +01:00
Nikolai Kochetov
b2ae11d6b6
Fixing tests.
2024-03-22 17:49:01 +00:00
Dani Pozo
2736b4ef64
Use managed identity for backups IO in Azure Blob Storage
...
Also adds option to prevent ClickHouse from trying to create a non-existing container, which requires
a role assignment at the storage account level.
2024-03-22 17:58:07 +01:00
Nikolai Kochetov
cf91d5dcbc
FIx
2024-03-22 16:57:42 +00:00
Nikolai Kochetov
5207526910
Fix more tests with wirtual columns in StorageMerge.
2024-03-22 16:55:01 +00:00
Alexander Tokmakov
9082a018a5
Merge pull request #59082 from ClickHouse/fix_race_async_inserts_queue
...
Fix race on `Context::async_insert_queue`
2024-03-22 16:06:13 +01:00
János Benjamin Antal
cff56a5c73
Unify column names
2024-03-22 15:05:10 +00:00
János Benjamin Antal
6028d007c3
Revert "Revert "Fix bug when reading system.parts using UUID (issue 61220)." …"
...
This reverts commit 8c49c9bf9e
2024-03-22 15:52:54 +01:00
Anton Popov
18bc53264f
fix reading without marks
2024-03-22 14:34:07 +00:00
János Benjamin Antal
8c49c9bf9e
Revert "Fix bug when reading system.parts using UUID (issue 61220)." ( #61774 )
2024-03-22 15:20:01 +01:00
Anton Popov
887a9ef184
Merge remote-tracking branch 'upstream/master' into HEAD
2024-03-22 13:37:46 +00:00
Alexey Milovidov
037c910c35
Merge pull request #61535 from CurtizJ/refactor-compact-parts-reading
...
Refactoring of reading from compact parts
2024-03-22 16:33:59 +03:00
Nikolai Kochetov
3ed30959fa
Merge pull request #61666 from ClickHouse/fix-not-ready-set-system-parts
...
Fix Non-ready set for system.parts.
2024-03-22 11:49:26 +01:00
robot-ch-test-poll
03a4b5fb58
Merge pull request #61053 from ClickHouse/async-loader-waiters-limit
...
Separate limits on number of waiting and executing queries
2024-03-22 03:15:25 +01:00
Zhuo Qiu
6a95163a24
Merge branch 'ClickHouse:master' into existing-count
2024-03-22 09:51:27 +08:00
Alexey Milovidov
96a45fc9ec
Merge pull request #61119 from ilejn/update_cppkafka
...
update cppkafka to v0.4.1
2024-03-22 01:19:42 +03:00
Alexey Milovidov
12e35ad1ff
Merge pull request #61616 from nickitat/02908_many_requests_again
...
Try to fix `02908_many_requests_to_system_replicas` again
2024-03-22 01:15:50 +03:00
Kseniia Sumarokova
0c824dab17
Merge pull request #60585 from aalexfvk/traverse_shadow_remote_data_paths
...
Traverse shadow directory for system.remote_data_paths
2024-03-21 19:02:36 +01:00
Vitaly Baranov
1acc0ebe79
Merge pull request #61356 from vitlibar/fix-replace-dictionary
...
Fix CREATE OR REPLACE DICTIONARY
2024-03-21 16:45:06 +01:00
divanik
9dbe7beef8
Merge pull request #59390 from divanik/divanik/generate_series_function
...
Add step to the generating numbers table functions
2024-03-21 16:27:25 +01:00
Dmitry Novik
e4209218d4
Merge pull request #60497 from ClickHouse/analyzer-distr-json
...
Analyzer: Support different ObjectJSON on shards
2024-03-21 16:25:30 +01:00
János Benjamin Antal
1944162088
Merge pull request #61479 from wudanzy/61220_fix_read_system_parts
...
Fix bug when reading system.parts using UUID (issue 61220).
2024-03-21 14:43:29 +01:00
Nikolai Kochetov
e828acd0e5
Review fixes.
2024-03-21 13:17:15 +00:00
Alexander Tokmakov
81fd904b54
I hate REPLACE_RANGE and actual_part_name
2024-03-21 13:02:50 +01:00
Sergei Trifonov
816a6b81c4
Merge pull request #61545 from wiledusc/fix-typo-legacy-max-level
...
Fix typo in variable name use_leagcy_max_level
2024-03-21 12:31:00 +01:00
divanik
cc7a4182e3
Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/generate_series_function
2024-03-21 11:27:48 +00:00
Antonio Andelic
c4856e326b
Merge pull request #60225 from azat/dist/parallel-flush
...
Parallel flush of pending INSERT blocks of Distributed engine
2024-03-21 12:25:59 +01:00
serxa
c31b958f88
Merge branch 'master' into async-loader-waiters-limit
2024-03-21 10:58:22 +00:00
unashi
adc964568c
[update] Merge the on same disk and on another disk scenarios into cloneAndLoadDataPart; remove the try catch; instead of obtaining the copied destination hard disk through traversal, the destination hard disk is obtained through reservation.
2024-03-21 15:44:27 +08:00
liuneng
ada4384deb
fix ut failed
2024-03-21 10:38:51 +08:00
Alexey Milovidov
97b7daef84
Merge pull request #61604 from Algunenano/nested_includes
...
Reduce header dependencies
2024-03-21 02:02:17 +03:00
János Benjamin Antal
0b54b34b5b
Avoid instantiation of CacheBase's ctor in header file
2024-03-20 17:00:36 +00:00
János Benjamin Antal
9e8c731e1e
Remove some inclusion of magic enum
2024-03-20 17:00:36 +00:00
Nikolai Kochetov
a7ff6d63c3
Fix Non-ready set for system.parts.
2024-03-20 16:48:24 +00:00
Raúl Marín
e6256fa380
Fix build
2024-03-20 15:43:09 +01:00
alesapin
a6051f8038
Merge pull request #61620 from ClickHouse/fix-part-log-with-async-with-dedup
...
Fix `system.part_log` for async insert with deduplication
2024-03-20 15:36:21 +01:00
divanik
52b2220dc2
Resolved issues
2024-03-20 13:20:39 +00:00
Nikita Taranov
22f6bb3645
Merge branch 'master' into debug_info
2024-03-20 14:11:34 +01:00
Raúl Marín
c98634ad8c
Merge remote-tracking branch 'blessed/master' into nested_includes
2024-03-20 14:08:10 +01:00
Raúl Marín
c380de864a
Merge pull request #61606 from Algunenano/magic_trash
...
Remove some magic_enum from headers
2024-03-20 14:03:11 +01:00
William Schoeffel
34e3eb223e
Merge branch 'ClickHouse:master' into fix-typo-legacy-max-level
2024-03-20 09:45:37 -03:00
divanik
8ec2dd31c7
Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/generate_series_function
2024-03-20 10:54:51 +00:00
vdimir
7ba425a76d
Merge pull request #60182 from ClickHouse/vdimir/analyzer/join_using_parent_scope
...
Analyzer: support join using column from select list
2024-03-20 10:59:31 +01:00
vdimir
9a43f7941b
Merge pull request #61456 from kitaisreal/temporary-data-use-temporary-files-codec-setting
...
Temporary data use temporary_files_codec setting
2024-03-20 10:54:17 +01:00
Kseniia Sumarokova
05516112ca
Merge pull request #61537 from ClickHouse/s3queue-disallow-sharded-processing
...
Disallow s3queue sharded mode
2024-03-20 10:53:51 +01:00
alesapin
af17145c82
Merge remote-tracking branch 'origin/master' into fix_wait_for_mutation_done
2024-03-20 10:47:19 +01:00
Dmitry Novik
10bf164aa7
Cleanup #ci_set_analyzer
2024-03-20 10:47:15 +01:00
Nikolai Kochetov
134215e3c3
Merge pull request #61550 from ClickHouse/fix-01083_expressions_in_engine_arguments-analyzer
...
Fixing 01584_distributed_buffer_cannot_find_column with analyzer.
2024-03-20 09:01:29 +01:00
Antonio Andelic
2312eb886f
Fix part log for async insert with deduplication
2024-03-20 08:53:26 +01:00
Nikita Taranov
13ff65474a
impl
2024-03-19 21:09:03 +00:00
Azat Khuzhin
11d0b0a9fa
Forbid SimpleAggregateFunction in ORDER BY of MergeTree tables
...
Like AggregateFunction is forbidden, but they are forbidden because they
are not comparable.
New setting (allow_suspicious_primary_key) had been added for backard
compatiblity (turned OFF by default).
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-19 21:09:30 +01:00
Alexey Milovidov
99a81c848e
Merge pull request #60659 from azat/rmt-part_log-fix
...
Fix missed entries in system.part_log in case of fetch preferred over merges/mutations
2024-03-19 22:52:05 +03:00
Dmitry Novik
221b74c77f
Fix #ci_set_analyzer
2024-03-19 19:44:15 +01:00
Alexander Tokmakov
5d7e5e5a72
Merge branch 'master' into fix_race_async_inserts_queue
2024-03-19 19:39:25 +01:00
Dmitry Novik
302179c81d
Merge remote-tracking branch 'origin/master' into analyzer-distr-json
2024-03-19 18:56:04 +01:00
alesapin
f89d73d683
Merge pull request #60079 from ClickHouse/fix_max_insert_delayed_streams_for_parallel_write
...
Make max_insert_delayed_streams_for_parallel_write actually work
2024-03-19 17:52:00 +01:00
Raúl Marín
c6f0a434c0
Remove some magic_enum from headers
2024-03-19 17:40:27 +01:00
Kseniia Sumarokova
79bbcbdf1e
Update StorageS3Queue.cpp
2024-03-19 17:20:31 +01:00
Maksim Kita
ec6c276a92
Temporary data use temporary_files_codec setting
2024-03-19 19:07:45 +03:00
Raúl Marín
de855ca917
Reduce header dependencies
2024-03-19 17:04:29 +01:00
Ilya Golshtein
939554ec0a
contrib: update cppkafka to v0.4.1@9c5ea0e3
2024-03-19 14:54:00 +00:00
Dmitry Novik
a8885e361e
Merge branch 'master' into vdimir/analyzer/join_using_parent_scope
2024-03-19 15:51:53 +01:00
Azat Khuzhin
8b1df937a5
Use scheduleFromThreadPool for parallel processing in distributed storage
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-19 13:20:51 +01:00
alesapin
9b14d17d7b
Fxi
2024-03-19 12:58:36 +01:00
János Benjamin Antal
9cd7e6155c
Merge pull request #60031 from azat/merge_tree_mutations_cleanup-fix
...
Fix finished_mutations_to_keep=0 for MergeTree (as docs says 0 is to keep everything)
2024-03-19 12:55:46 +01:00
János Benjamin Antal
922df7d60e
Merge pull request #61003 from amosbird/less-header-1
...
Replace some header includes with forward declarations
2024-03-19 12:14:06 +01:00
alesapin
667aade4e3
Fix build
2024-03-19 12:12:35 +01:00
alesapin
c90ec72fde
Merge branch 'master' into fix_wait_for_mutation_done
2024-03-19 12:10:07 +01:00
Azat Khuzhin
929dc6fa12
Attach to query for threads in Distributed engine background ops
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-19 06:58:38 -04:00
Azat Khuzhin
eb75926e50
Parallel flush of pending INSERT blocks of Distributed engine
...
Parallelism will work only if you have multi disk policy for table (like
everything in Distributed engine right now).
This will work for DETACH/server shutdown and SYSTEM FLUSH DISTRIBUTED
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-19 06:58:38 -04:00
Han Fei
75e94438e0
Update src/Storages/StorageReplicatedMergeTree.cpp
2024-03-19 10:21:19 +01:00
Dan Wu
411fb050d3
Merge branch 'ClickHouse:master' into 61220_fix_read_system_parts
2024-03-19 11:16:17 +08:00
Vitaly Baranov
306f642d97
Update dictionary's comment in the same safe manner too.
2024-03-19 02:56:33 +01:00
robot-ch-test-poll3
e82cf5d5ba
Merge pull request #61528 from ClickHouse/revert-61518-revert-61298-analyzer-merge-virtual-columns
...
Revert "Revert "Analyzer: Fix virtual columns in StorageMerge""
2024-03-18 23:51:55 +01:00
Robert Schulze
0daaeeab78
Merge pull request #61406 from rschu1ze/enable-clang-tidy-in-headers
...
Enable clang-tidy in headers
2024-03-18 21:43:26 +01:00
Anton Popov
5ac15574b7
do not load marks on merges
2024-03-18 20:28:10 +00:00
Alexander Sapin
a3a549bc24
Wait for update of value in memory and in zookeeper
2024-03-18 21:03:00 +01:00
Alexander Sapin
82da2d56e9
Add chassert
2024-03-18 20:58:15 +01:00
Alexander Sapin
1264b5337e
More diagnostics
2024-03-18 20:57:14 +01:00
Alexander Sapin
083d0776ed
Wait for done mutation properly
2024-03-18 20:47:31 +01:00
Nikolai Kochetov
e97443ddd1
Update StorageBuffer.cpp
2024-03-18 20:15:34 +01:00
Nikolai Kochetov
c99a874305
Update StorageValues.cpp
2024-03-18 20:13:52 +01:00
Kirill Nikiforov
ebaee8e5f6
Add support for ATTACH PARTITION ALL ( #61107 )
2024-03-18 15:00:27 -04:00
Nikolai Kochetov
3def01f1f6
Fixing 01083_expressions_in_engine_arguments with analyzer.
2024-03-18 18:53:01 +00:00
William Schoeffel
4f30ac72a1
fix typo in variable name legacy
2024-03-18 15:18:47 -03:00
Nikita Taranov
c1fb34da0d
Merge branch 'master' into debug_info
2024-03-18 17:54:31 +01:00
Nikita Taranov
b0131a278b
impl
2024-03-18 16:48:53 +00:00
Arthur Passos
c67c04b89a
fix typo
2024-03-18 13:44:36 -03:00
kssenii
b814fabcd3
Disallow s3queue sharded mode
2024-03-18 17:22:38 +01:00
Anton Popov
13b27a8d36
refactoring of reading from compact parts
2024-03-18 16:13:02 +00:00
divanik
265d91747f
Remove log debug
2024-03-18 16:03:12 +00:00
Nikita Mikhaylov
15896ecaf6
Add table system.keywords [Part 1] ( #51808 )
2024-03-18 16:58:57 +01:00
Anton Popov
efe5373f2b
refactoring of reading from compact parts
2024-03-18 15:57:58 +00:00
Kseniia Sumarokova
d4895c2e52
Merge pull request #61324 from ClickHouse/add-zk-retries
...
Add zookeeper retries for exists check in forcefullyRemoveBrokenOutdatedPartFromZooKeeper
2024-03-18 16:17:37 +01:00
Vitaly Baranov
08d64f9e11
Get rid of modifying a shared AbstractConfiguration (between StorageDictionary and ExternalDictionariesLoader).
...
Always create a new configuration when we need to modify it.
2024-03-18 14:43:38 +01:00
Dmitry Novik
15e19206b4
Merge remote-tracking branch 'origin/master' into analyzer-distr-json-copy
2024-03-18 14:24:51 +01:00
Dmitry Novik
a65f027cf7
Revert "Revert "Analyzer: Fix virtual columns in StorageMerge""
2024-03-18 14:00:20 +01:00
Yarik Briukhovetskyi
5e5a39d039
Merge pull request #61467 from wiledusc/remove-duplicated-check-containing-part-empty
...
Remove duplicated check containing_part.empty()
2024-03-18 13:44:25 +01:00
divanik
c5d35bb187
Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/generate_series_function
2024-03-18 12:26:43 +00:00
Yarik Briukhovetskyi
c85d410cda
Merge pull request #60612 from JakeBamrah/master
...
[59558] Add size cap to Memory tables
2024-03-18 13:21:56 +01:00
Robert Schulze
0dff126942
Merge remote-tracking branch 'rschu1ze/master' into enable-clang-tidy-in-headers
2024-03-18 11:34:13 +00:00
alesapin
b01526aeb2
Merge pull request #61267 from CurtizJ/better-memory-usage-inserts
...
Free memory earlier in inserts
2024-03-18 12:30:42 +01:00
vdimir
e27e6fb2f5
Analyzer: support join using column from select list
2024-03-18 11:11:00 +00:00
Kseniia Sumarokova
6d2e48d085
Merge branch 'master' into add-zk-retries
2024-03-18 11:24:36 +01:00
Antonio Andelic
6549a96ced
Revert "Analyzer: Fix virtual columns in StorageMerge"
2024-03-18 10:38:28 +01:00
János Benjamin Antal
4b4a03c0f1
Merge branch 'master' into less-header-1
2024-03-18 10:25:42 +01:00
Robert Schulze
c17536c3b3
Enable clang-tidy in headers
2024-03-18 08:00:09 +00:00
Zhuo Qiu
bf85f7f368
add docs & minor fix for lwd-aware merge settings
2024-03-18 11:02:02 +08:00
Alexey Milovidov
01136bbc3b
Limit backtracking in parser
2024-03-17 19:54:45 +01:00
Kseniia Sumarokova
d4205afe82
Merge branch 'master' into add-zk-retries
2024-03-17 17:56:32 +01:00
Alexey Milovidov
994bf8765c
Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver
2024-03-17 14:20:02 +01:00
Alexey Milovidov
cb8d859453
Merge branch 'master' into analyzer-distr-json
2024-03-17 15:15:06 +03:00
Alexey Milovidov
bf98386a33
Merge pull request #61298 from ClickHouse/analyzer-merge-virtual-columns
...
Analyzer: Fix virtual columns in StorageMerge
2024-03-17 15:05:23 +03:00
Vitaly Baranov
4fe1c9a78f
Get rid of checking the "last modification time" when the configuration is generated
...
to allow ExternalLoader::reloadConfig() work for generated configurations too.
2024-03-17 12:10:57 +01:00
Vitaly Baranov
41d8621d97
Fix replacing dictionaries: StorageID is now updated immediately for every dictionary during CREATE OR REPLACE
...
even if the dictionary is not loaded yet or loading right now.
2024-03-17 12:10:52 +01:00
Alexey Milovidov
9be38c064a
Merge branch 'master' into split-cast-overload-resolver
2024-03-16 14:07:59 +01:00
Dan Wu
adaf262dc0
Fix bug when reading system.parts using UUID (issue 61220).
...
During the predicates pushing down of system.parts table, there is a
logic to use that predicates to filter on the storages. This makes sense
if the predicate is on the `database`, `table`, `engine`. But it can be
problem if the predicate is about `uuid`, because storage UUID is
apparently different from parts UUID.
Rename the column name from `uuid` to `storage_uuid` fixed this.
2024-03-16 02:02:21 +00:00
William Schoeffel
4dbf3ee1bb
fix: remove duplicated check containing part
2024-03-15 14:05:24 -03:00
Yakov Olkhovskiy
a31f551bc7
Merge pull request #58223 from jewelzqiu/existing-count
...
Consider lightweight deleted rows when selecting parts to merge
2024-03-15 12:42:35 -04:00
Kruglov Pavel
d045ab150e
Merge pull request #61362 from ClickHouse/revert-61359-revert-61234-Avogar-patch-2
...
Revert "Revert "Fix usage of session_token in S3 engine""
2024-03-15 16:00:05 +01:00
Dmitry Novik
061cd5a53d
Fixup #ci_set_analyzer
2024-03-15 14:22:46 +00:00
Anton Popov
6ad2f95837
Merge remote-tracking branch 'upstream/master' into HEAD
2024-03-15 13:52:20 +00:00
Dmitry Novik
1cdd280c9f
Merge pull request #61392 from ClickHouse/analyzer-fix-context-in-merge
...
Analyzer: Fix planner context for subquery in StorageMerge
2024-03-15 14:05:28 +01:00
Sergei Trifonov
273d221781
Merge pull request #60558 from ClickHouse/revert-60253-revert-59032-cpu-scheduler-and-cc
...
Revert "Revert "Support resource request canceling""
2024-03-15 13:24:50 +01:00
divanik
e57446b6f5
Resolved conflicts
2024-03-15 11:57:59 +00:00
Antonio Andelic
0ba400d065
Merge pull request #61380 from ClickHouse/fix-heap-use-after-free-alias-merge
...
Fix `heap-use-after-free` for Merge table with alias
2024-03-15 11:15:02 +01:00
Zhuo Qiu
7f97b11ce6
only read _row_exists column when necessary
2024-03-15 15:48:20 +08:00
Alexey Milovidov
c9fb8ef54b
Merge branch 'master' into split-cast-overload-resolver
2024-03-15 07:09:51 +01:00
Nikolai Kochetov
1cae77997a
Try revert stage back
2024-03-14 21:34:25 +00:00
avogar
e08eaebc99
Add sanity check for poll_max_batch_size FileLog setting to avoid big untracked allocations
2024-03-14 20:36:18 +00:00
Anton Popov
edaf2c8023
Merge remote-tracking branch 'upstream/master' into HEAD
2024-03-14 17:06:22 +00:00
Dmitry Novik
90669ef487
Merge remote-tracking branch 'origin/master' into analyzer-distr-json
2024-03-14 17:43:26 +01:00
Dmitry Novik
0b3b734c9b
Analyzer: Fix planner context for subquery in StorageMerge
2024-03-14 17:37:49 +01:00
Kseniia Sumarokova
ceeb926fa8
Merge branch 'master' into add-zk-retries
2024-03-14 17:27:40 +01:00
kssenii
b778b01408
Add settings
2024-03-14 16:39:32 +01:00
Dmitry Novik
d558c4dcb7
Cleanup
2024-03-14 16:17:58 +01:00
Dmitry Novik
e145115ef1
Fixup
2024-03-14 16:15:06 +01:00
Antonio Andelic
026ac4deb1
Fix heap-use-after-free for Merge table with alias
2024-03-14 14:20:22 +00:00
Robert Schulze
06d917fcf0
Merge pull request #61150 from rschu1ze/clang-tidy-list
...
Some clang-tidy fixes
2024-03-14 14:54:41 +01:00
vdimir
0b97f3ac16
Merge pull request #61320 from ClickHouse/vdimir/fix_rabbitmq_logical_error
...
Fix logical error in RabbitMQ storage with MATERIALIZED columns
2024-03-14 13:28:05 +01:00
Alexey Milovidov
8094dd88d9
Merge branch 'master' into split-cast-overload-resolver
2024-03-14 13:08:37 +01:00
Alexey Milovidov
1a41aa4ac7
Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver
2024-03-14 13:06:23 +01:00
divanik
9c77aa9510
Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/generate_series_function
2024-03-14 11:41:14 +00:00
Kruglov Pavel
56220b5105
Revert "Revert "Fix usage of session_token in S3 engine""
2024-03-14 12:23:32 +01:00
Antonio Andelic
c6f0b2a5a4
Revert "Fix usage of session_token in S3 engine"
2024-03-14 11:57:03 +01:00
Robert Schulze
3486b4a6e3
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list
2024-03-14 10:44:20 +00:00
jsc0218
b3b46ea708
Merge remote-tracking branch 'origin/master' into TableEngineGrant_version2
2024-03-14 00:36:29 +00:00
kssenii
208a91a2f7
Add retries exists check in loadOutdatedDataParts
2024-03-13 19:03:29 +01:00
Jake Bamrah
5e66cd7154
fix settings seg-fault and expand test case coverage
2024-03-13 18:47:13 +01:00
Yarik Briukhovetskyi
4aab1170ef
fix style
2024-03-13 18:47:13 +01:00
Yarik Briukhovetskyi
77223d682d
reload tests
2024-03-13 18:47:13 +01:00
Jake Bamrah
c73e299820
add size cap to memory tables
2024-03-13 18:47:13 +01:00
Kruglov Pavel
843e2dc968
Merge pull request #60586 from Avogar/fix-filter-virtual-columns
...
Fix reading from MergeTree with non-deterministic functions in filter
2024-03-13 18:22:12 +01:00
vdimir
b2e067b3da
Fix logical error in RabbitMQ storage with MATERIALIZED columns
2024-03-13 16:41:35 +00:00
Kruglov Pavel
dd0caaf9b4
Merge pull request #61234 from ClickHouse/Avogar-patch-2
...
Fix usage of session_token in S3 engine
2024-03-13 17:05:39 +01:00
divanik
cf639bab44
Fix attach bug
2024-03-13 13:37:26 +00:00
Dmitry Novik
80723134d6
Fix fast test #ci_set_analyzer
2024-03-13 14:00:57 +01:00
Dmitry Novik
ffdb84b8df
Fix style
2024-03-13 13:38:23 +01:00
Dmitry Novik
1a47682c12
Analyzer: Fix virtual columns in StorageMerge #ci_set_analyzer
2024-03-13 13:08:12 +01:00
Dmitry Novik
2e49140de7
Small progress
2024-03-13 11:37:42 +01:00
Dmitry Novik
5ef241cc85
WIP on virtual columns in StorageMerge
2024-03-13 11:30:11 +01:00
unashi
da06ba432e
[fix] merge and resolve problems
2024-03-13 12:09:35 +08:00
Alexey Milovidov
146e401851
Merge branch 'master' into split-cast-overload-resolver
2024-03-13 04:28:24 +01:00
unashi
c78224c2ff
Merge branch 'master' into feat-59377
2024-03-13 11:24:00 +08:00
divanik
3c2514bc77
Correct small issues
2024-03-12 18:33:32 +00:00
Anton Popov
f35987928b
free memory earlier in inserts
2024-03-12 18:05:14 +00:00
Anton Popov
fc648439f3
Merge branch 'master' into add-virtual-columns
2024-03-12 18:00:12 +01:00
divanik
8f44201f92
Preliminary commit
2024-03-12 16:22:33 +00:00
Azat Khuzhin
fb0ad3eb15
Disable retries for replicated fetches (they are handled by the engine itself)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 17:08:42 +01:00
Azat Khuzhin
df44ed173c
Fix missed entries in system.part_log in case of fetch preferred over merges/mutations
...
The NEED_PREPARE do not call part_log_writer() before.
v2:
- Add a test for missed entries in system.part_log for merge
- Fix part_log_writer
- Add a test for missed entries in system.part_log for mutate
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 17:08:42 +01:00
Kseniia Sumarokova
3257bfa918
Merge branch 'master' into traverse_shadow_remote_data_paths
2024-03-12 15:18:52 +01:00
Robert Schulze
1b1685e3f1
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list
2024-03-12 13:02:59 +00:00
Kruglov Pavel
d431276045
Fix usage of session_token in S3
2024-03-12 12:43:48 +01:00
serxa
defed92331
do nothing in waitForOutdatedPartsToBeLoaded() if loading is not required
2024-03-12 11:38:27 +00:00
Kseniia Sumarokova
61543edc8b
Merge branch 'master' into fix-usage-of-plain-metadata
2024-03-12 11:53:00 +01:00
vdimir
439fe42f88
Merge pull request #61013 from ClickHouse/vdimir/fix_astrename_clone
...
Fix ASTRenameQuery::clone
2024-03-12 11:13:28 +01:00
Azat Khuzhin
6c74ab18c0
Do not clean mutations for MergeTree on DROP PART (to match ReplicatedMergeTree)
...
Even if this should be done, only related mutations should be cleaned,
not all.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 10:39:41 +01:00
Azat Khuzhin
f559767d22
Fix finished_mutations_to_keep=0 for MergeTree (as docs says 0 is to keep everything)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-12 10:39:41 +01:00
unashi
c1b94b2170
[debug] fast test again again
2024-03-12 15:33:43 +08:00
Zhuo Qiu
05969a39f3
resolve conflicts
2024-03-12 14:45:25 +08:00
unashi
10c7ea7a29
[debug] fast test again
2024-03-12 14:32:07 +08:00
Alexey Milovidov
5222ebc4b4
Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-cast-overload-resolver
2024-03-12 06:37:38 +01:00
Alexey Milovidov
bdc884dfa5
Merge pull request #60255 from ClickHouse/dont-load-useless-index-parts-in-memory
...
Do not load useless columns from the index in memory
2024-03-12 08:30:53 +03:00
Zhuo Qiu
4ad8141a16
Maintain compatibility of estimateNeededDiskSpace()
...
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2024-03-12 13:07:46 +08:00
Zhuo Qiu
c628eaca8b
Consider deleted rows when selecting parts to merge
2024-03-12 13:07:39 +08:00
Alexey Milovidov
bd4f948f12
Merge pull request #61058 from ClickHouse/rip-copier
...
Delete `clickhouse-copier`
2024-03-12 07:15:48 +03:00
unashi
2ae184f298
Merge branch 'feat-59377' of https://github.com/Unalian/ClickHouse into feat-59377
2024-03-12 12:12:05 +08:00
unashi
29fce4143d
[fix] log level from fatal->error when hardlink and copy both fail
2024-03-12 12:07:24 +08:00
Alexey Milovidov
c3a839d595
Merge pull request #61127 from ClickHouse/remove-in-memory-data-parts-2
...
Remove in-memory data parts, part 3.
2024-03-12 07:07:07 +03:00
Nikita Mikhaylov
fcf8a3821d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier
2024-03-11 19:12:49 +01:00
Nikita Mikhaylov
cfa042cb04
Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier
2024-03-11 15:45:20 +00:00
Anton Popov
db48b9749b
better _part_offset column
2024-03-11 15:35:17 +00:00
avogar
ecc30448ba
Fix filtering when optimize_use_implicit_projections=1
2024-03-11 15:26:29 +00:00
avogar
f6d7b39dfc
Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-filter-virtual-columns
2024-03-11 15:05:52 +00:00
Anton Popov
2fabec2b9d
Merge remote-tracking branch 'upstream/master' into HEAD
2024-03-11 14:42:18 +00:00
Anton Popov
2bec92c48e
better _part_offset column
2024-03-11 14:41:50 +00:00
Kseniia Sumarokova
e59564a9d9
Merge branch 'master' into traverse_shadow_remote_data_paths
2024-03-11 13:19:05 +01:00
vdimir
38b8e7ac7e
Maintain list of ASTRenameQuery children
2024-03-11 11:34:10 +00:00
serxa
b1d1c8eb0c
Merge branch 'master' into revert-60253-revert-59032-cpu-scheduler-and-cc
2024-03-11 11:25:53 +00:00
Robert Schulze
e5e84419af
Fix clang-tidy-s
2024-03-11 10:58:54 +00:00
Kseniia Sumarokova
3832b0e126
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges
2024-03-11 11:30:03 +01:00
Kseniia Sumarokova
aacfefe0fe
Merge branch 'master' into fix-usage-of-plain-metadata
2024-03-11 10:37:53 +01:00
Alexey Milovidov
4373d5ba16
Merge branch 'master' into split-cast-overload-resolver
2024-03-11 03:01:50 +01:00
Alexey Milovidov
8a484a44e3
Merge branch 'master' into dont-load-useless-index-parts-in-memory
2024-03-11 02:10:20 +01:00
Alexey Milovidov
2550f9d284
Merge branch 'master' into remove-in-memory-data-parts-2
2024-03-11 01:44:20 +03:00
serxa
5b796e1f42
Merge branch 'master' into async-loader-waiters-limit
2024-03-10 15:20:27 +00:00
alesapin
253a29d528
Merge branch 'master' into fix_max_insert_delayed_streams_for_parallel_write
2024-03-10 15:34:13 +01:00
kssenii
0b63cb237a
Fix
2024-03-10 15:33:06 +01:00
Sema Checherinda
80179e50e4
Merge pull request #58845 from ClickHouse/chesema-session-pool
...
HTTP connections pool
2024-03-10 14:06:59 +01:00
Alexey Milovidov
2cc071e0e4
Fix error
2024-03-10 12:48:15 +01:00
Alexey Milovidov
1d8b95bdcd
Update MergeTask.cpp
2024-03-10 14:43:18 +03:00
Alexey Milovidov
6a0eb7a3cd
Update ColumnSizeEstimator.h
2024-03-10 14:42:58 +03:00
Kseniia Sumarokova
ae98d4290c
Merge branch 'master' into traverse_shadow_remote_data_paths
2024-03-10 12:16:54 +01:00
kssenii
e5e6625b0c
Merge remote-tracking branch 'origin/master' into fix-usage-of-plain-metadata
2024-03-10 12:05:02 +01:00
Alexey Milovidov
d340d9cfaf
Fix build
2024-03-10 10:05:07 +01:00
Alexey Milovidov
dbb6dad921
Fix style
2024-03-10 10:04:40 +01:00
Alexey Milovidov
69cab686e4
Fix build of examples
2024-03-10 10:03:31 +01:00
Kseniia Sumarokova
7e7fc4127d
Merge branch 'master' into revert-refert-of-broken-projections-handling
2024-03-10 10:01:34 +01:00
Sema Checherinda
77c5de700f
fix how web disk read empty directories
2024-03-10 10:00:18 +01:00
Sema Checherinda
5c41727725
http connections pools
2024-03-10 10:00:18 +01:00
Alexey Milovidov
9ddec346a0
Miscellaneous
2024-03-10 09:02:34 +01:00
Alexey Milovidov
d337379385
Remove in-memory data parts, step 2
2024-03-10 06:44:26 +01:00
Alexey Milovidov
b07e5d9f5a
Update StorageMergeTree.cpp
2024-03-10 08:11:59 +03:00
Alexey Milovidov
c7e7f03eae
Merge branch 'master' of github.com:ClickHouse/ClickHouse into dont-load-useless-index-parts-in-memory
2024-03-09 03:58:31 +01:00
Nikita Mikhaylov
f73a8f2eae
More comments for column for system tables ( #59016 )
2024-03-08 18:05:56 +01:00
Dmitry Novik
526af77f4a
Merge pull request #60313 from ClickHouse/analyzer-refactor-constant-name
...
Analyzer: Refactor execution name for ConstantNode
2024-03-08 12:08:05 +01:00
Nikita Taranov
e66ac5770c
Merge pull request #60462 from ClickHouse/davenger-patch-1
...
Do not check to and from files existence in metadata_storage because it does not see uncommitted changes
2024-03-08 00:26:58 +01:00
Nikita Mikhaylov
2bc4d27ac6
Bye bye
2024-03-07 19:24:39 +00:00
serxa
0f0ea422f2
separate limits on number of waiting and executing queries
2024-03-07 17:05:54 +00:00
Anton Popov
88d8880267
better virtual columns and tests added
2024-03-07 14:56:45 +00:00
Anton Popov
ec926ea6e4
Merge remote-tracking branch 'upstream/master' into HEAD
2024-03-07 13:22:20 +00:00
Dmitry Novik
23b33e5e32
Merge remote-tracking branch 'origin/master' into analyzer-refactor-constant-name
2024-03-07 14:18:44 +01:00
Anton Popov
c103b0084b
Merge pull request #60205 from CurtizJ/refactor-virtual-columns
...
Refactoring of virtual columns
2024-03-07 13:38:35 +01:00
Amos Bird
f2a3ffe9eb
Replace some headers with forward decl
2024-03-07 18:10:09 +08:00
Kseniia Sumarokova
8fc3581446
Merge branch 'master' into fix-usage-of-plain-metadata
2024-03-07 14:29:57 +08:00
Nikita Taranov
2b52583e06
fix style
2024-03-06 23:01:42 +01:00
Nikita Taranov
c192d0b125
impl
2024-03-06 22:29:41 +01:00
Igor Nikonov
a3c22f9ace
Merge pull request #60675 from ClickHouse/use-minmax-indices-always-first
...
Always apply first minmax index among available skip indices
2024-03-06 21:25:49 +01:00
Nikita Taranov
d008b4eb4f
fix test
2024-03-06 20:24:38 +01:00
Dmitry Novik
d92538ced2
Merge branch 'master' into analyzer-refactor-constant-name
2024-03-06 17:55:52 +01:00
Anton Popov
c8878332ca
fix StorageSystemDictionaries
2024-03-06 16:46:59 +00:00
Sema Checherinda
8ac2ef6608
Merge pull request #57575 from ClickHouse/chesema-drop-zk-table-node
...
drop keeper dir with zero copy locks
2024-03-06 17:43:35 +01:00
vdimir
56b6810122
Merge pull request #60641 from ClickHouse/vdimir/analyzer/comute_alias_columns
...
Resubmit "Analyzer: compute ALIAS columns right after reading"
2024-03-06 16:52:16 +01:00
Anton Popov
1c0aed896c
fix build
2024-03-06 15:25:06 +00:00
Kruglov Pavel
5b94f9b411
Check children first
2024-03-06 15:31:19 +01:00
Anton Popov
f582797b36
Merge remote-tracking branch 'upstream/master' into HEAD
2024-03-06 14:14:42 +00:00
Dmitry Novik
016bbfe6f8
Merge remote-tracking branch 'origin/master' into analyzer-distr-json
2024-03-06 15:09:52 +01:00
Igor Nikonov
d64abe2449
Merge remote-tracking branch 'origin/master' into use-minmax-indices-always-first
2024-03-06 13:51:55 +00:00
Dmitry Novik
7065e650e1
Code cleanup
2024-03-06 14:34:03 +01:00
kssenii
6d4514c045
Fix test
2024-03-06 16:55:48 +08:00
unashi
3dbb0a12fb
[fix] style
2024-03-06 16:15:37 +08:00
Nikolai Kochetov
b040eadaa1
Merge pull request #60510 from ClickHouse/refactor-system-one-block
...
Refactor StorageSystemOneBlock
2024-03-06 08:55:50 +01:00
Sema Checherinda
8b2bd2125b
no warnings at drop
2024-03-05 19:06:09 +01:00
Anton Popov
7fe7f3a79d
address review comments
2024-03-05 16:03:02 +00:00
Nikolai Kochetov
97f955fcde
Fix sanitizers
2024-03-05 14:10:46 +00:00
Dmitry Novik
04370083bb
Merge remote-tracking branch 'origin/master' into analyzer-refactor-constant-name
2024-03-05 14:57:00 +01:00
Nikolai Kochetov
86ad80839a
Merge pull request #60515 from ClickHouse/cleanup-lazy-format-always
...
PullingAsyncPipelineExecutor cleanup
2024-03-05 13:12:07 +01:00
vdimir
6f3e9b6de2
Merge branch 'master' into vdimir/analyzer/comute_alias_columns
2024-03-05 13:08:58 +01:00
Antonio Andelic
0bd4c6afa0
Use while-loop
2024-03-05 11:53:51 +01:00
Nikolai Kochetov
ee3edf2589
Fix system parts _state
2024-03-05 10:40:45 +00:00
Aleksei Filatov
f7d8dd0b71
Merge branch 'master' into traverse_shadow_remote_data_paths
2024-03-05 10:11:07 +03:00
Aleksei Filatov
758a75c1b4
Fix flaky test. Fix clang-tidy warning
2024-03-05 09:53:30 +03:00
Kseniia Sumarokova
dbbe6b9f69
Merge branch 'master' into add-a-way-to-force-read-through-filesystem-cache-for-merges
2024-03-05 11:13:32 +08:00
unashi
aa43885ac8
[improve] add check the remaining disk size before copying
2024-03-05 10:57:25 +08:00
Nikolai Kochetov
819e7bfc77
Merge branch 'master' into refactor-system-one-block
2024-03-04 21:03:45 +00:00
Igor Nikonov
ee4e5b1592
Merge remote-tracking branch 'origin/master' into use-minmax-indices-always-first
2024-03-04 18:29:05 +00:00
Nikolai Kochetov
d209508753
Fixing style.
2024-03-04 18:26:42 +00:00
Kruglov Pavel
4bdafed801
Merge pull request #60420 from HowePa/format_case_insensitive
...
Make all format names case insensitive.
2024-03-04 19:09:10 +01:00
Nikolai Kochetov
47d8f039e5
Cleanup VirtualColumnUtils
2024-03-04 18:01:12 +00:00
Nikolai Kochetov
2d8ca99860
Refactor more system storages.
2024-03-04 17:48:47 +00:00
Alexey Milovidov
ce6dec65cf
Merge pull request #60729 from ClickHouse/remove-more-live-view
...
Remove more code from LIVE VIEW
2024-03-04 18:58:21 +03:00
Alexey Milovidov
de6c5d3a40
Merge pull request #60552 from ClickHouse/pc2
...
Userspace page cache again
2024-03-04 17:47:35 +03:00
Dmitry Novik
01829450fb
Merge remote-tracking branch 'origin/master' into analyzer-refactor-constant-name
2024-03-04 14:12:15 +01:00
Igor Nikonov
815e3db6f5
Merge remote-tracking branch 'origin/master' into use-minmax-indices-always-first
2024-03-04 10:09:44 +00:00
Alexey Milovidov
fc6f3c8399
Live view's life is close to the end
2024-03-04 00:49:22 +01:00
Alexey Milovidov
cbf5443585
Remove old code
2024-03-04 00:11:55 +01:00
Azat Khuzhin
707200d2a4
Fix system.parts for non-Atomic/Ordinary database engine (i.e. Memory)
...
Previously the code assumes that only Ordinary do not have UUID, while
this is not true, Memory (at least) does not has it as well.
One of the major users of Memory engine is clickhouse-local.
v2: check UUID instead of database engine
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 10:27:06 +01:00
jsc0218
2b54c11d63
Merge branch 'ClickHouse:master' into TableEngineGrant_version2
2024-03-02 20:42:04 -05:00
Igor Nikonov
491a4e8d4b
Merge remote-tracking branch 'origin/master' into use-minmax-indices-always-first
2024-03-02 21:31:28 +00:00
Alexey Milovidov
5dfe708de0
Merge pull request #60605 from ClickHouse/24.3-prepare
...
Update version after release
2024-03-02 04:56:21 +03:00
