Commit Graph

13308 Commits

Author SHA1 Message Date
Duc Canh Le
5d2feb41e7
Revert "Revert "Introduce bulk loading to StorageEmbeddedRocksDB"" 2024-05-03 18:29:36 +08:00
Alexey Milovidov
c9fd1df4fc
Revert "Introduce bulk loading to StorageEmbeddedRocksDB" 2024-05-03 05:27:03 +03:00
Alexey Milovidov
a17618851e Merge branch 'master' into total-rows-in-system-zeros-generate-random 2024-05-03 03:40:53 +02:00
Alexey Milovidov
aea3090074 Less directories 2024-05-03 03:24:03 +02:00
Alexey Milovidov
ecf524175a Less directories 2024-05-03 03:20:11 +02:00
Alexey Milovidov
ed1bbd0bd0 Merge branch 'master' into local-less-directories 2024-05-03 02:35:44 +02:00
Igor Nikonov
376c54c7f9 Merge remote-tracking branch 'origin/master' into pr-receive-timeout-on-handshake 2024-05-02 19:15:14 +00:00
p1rattttt
20194542dc
Merge branch 'ClickHouse:master' into cross_join_compression 2024-05-02 22:01:32 +03:00
Robert Schulze
66810e17c4
Merge remote-tracking branch 'ClickHouse/master' into optimize_drop_tables 2024-05-02 16:01:38 +00:00
Kseniia Sumarokova
33a0e8035f
Merge pull request #61250 from ClickHouse/less-contentaion-in-cache-part4
Less contention in cache, part 4
2024-05-02 15:18:16 +00:00
vdimir
a838fb778b
Merge pull request #59163 from canhld94/rocksdb_bypass_memtable
Introduce bulk loading to StorageEmbeddedRocksDB
2024-05-02 14:49:03 +00:00
kssenii
3f9ca1cbfe Merge remote-tracking branch 'origin/master' into less-contentaion-in-cache-part4 2024-05-02 13:04:05 +02:00
vdimir
7617155901
Merge branch 'master' into vdimir/ineq_join_v2 2024-05-01 11:53:43 +00:00
Duc Canh Le
6a324ae67a Merge branch 'master' into rocksdb_bypass_memtable
Try fix CI
2024-05-01 11:21:31 +00:00
kssenii
deb4706056 Review fixes 2024-05-01 11:19:51 +02:00
Robert Schulze
0a01a92bf8
Merge pull request #62884 from rschu1ze/inverted-to-fulltext
Rename "inverted index" to "full-text index"
2024-04-30 20:03:35 +00:00
Robert Schulze
f29574d043
Merge remote-tracking branch 'ClickHouse/master' into optimize_drop_tables 2024-04-30 19:25:22 +00:00
Konstantin Bogdanov
273464c963
Merge pull request #63046 from ClickHouse/support-user-expiration
Check user expiration date before query execution
2024-04-30 17:42:58 +00:00
pufit
677a76c8d8
Merge branch 'master' into pufit/fix-dump-ast-with-sql-security 2024-04-30 10:05:22 -04:00
Konstantin Bogdanov
185e715fc1
Update src/Interpreters/Session.h
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
2024-04-30 14:54:34 +02:00
Konstantin Bogdanov
36014f739a
Rename 2024-04-30 14:52:43 +02:00
Raúl Marín
415a7be8db
Merge pull request #63119 from Algunenano/sanity_check_clamp
Make sanity check of settings worse
2024-04-30 12:20:38 +00:00
Raúl Marín
89fe970cd2
Merge pull request #62929 from Algunenano/optimize_rewrite_sum_if_to_count_if
Enable optimize_rewrite_sum_if_to_count_if by default
2024-04-30 12:07:24 +00:00
vdimir
23525ea3d5
Merge branch 'master' into ineq_join_v2 2024-04-30 08:15:51 +00:00
Alexey Milovidov
817570c5e4
Merge branch 'master' into local-less-directories 2024-04-30 04:45:33 +02:00
pufit
2c0e880909 Format SQL security option only in CREATE VIEW queries. 2024-04-29 20:50:48 -04:00
Alexey Milovidov
ba45bd2534
Merge pull request #63125 from kitaisreal/recursive-cte-data-race-fix
Recursive CTE data race fix
2024-04-30 01:26:29 +02:00
Alexander Tokmakov
37950a5f4e
Merge pull request #62738 from pamarcos/pamarcos/system-unload-primary-key
Add SYSTEM UNLOAD PRIMARY KEY
2024-04-29 21:18:01 +00:00
Raúl Marín
987558e18d Improvements based on review 2024-04-29 20:46:37 +02:00
Raúl Marín
ff1c0023e8 Use TSA and mutex instead of object copy 2024-04-29 20:05:57 +02:00
Maksim Kita
d237133ec0 Recursive CTE data race fix 2024-04-29 18:29:18 +03:00
Igor Nikonov
20884efdcc Merge remote-tracking branch 'origin/master' into pr-receive-timeout-on-handshake 2024-04-29 13:36:13 +00:00
Raúl Marín
97c781e365 Sanity check: Clamp values instead of throwing 2024-04-29 14:34:47 +02:00
Raúl Marín
8df67eb7ed
Merge branch 'master' into optimize_rewrite_sum_if_to_count_if 2024-04-29 11:51:09 +02:00
alesapin
4701429db4
Merge pull request #62773 from hileef/fix/update/nested-columns-size-check
fix: update: nested materialized columns: size check fixes
2024-04-29 09:27:39 +00:00
Alexey Milovidov
c570316c87
Merge branch 'master' into analyzer-support-recursive-cte 2024-04-29 02:26:59 +02:00
p1rattttt
cde04df8af
Merge branch 'ClickHouse:master' into cross_join_compression 2024-04-28 23:10:43 +03:00
kssenii
3e4d9bf73a Better result condition 2024-04-28 14:08:20 +02:00
kssenii
8c4476d7db Merge remote-tracking branch 'origin/master' into less-contentaion-in-cache-part4 2024-04-28 13:36:16 +02:00
Maksim Kita
bd1189de70 Fixed tests 2024-04-28 12:52:17 +03:00
Maksim Kita
06d2c18f26 Analyzer support recursive CTEs 2024-04-28 12:52:17 +03:00
Maksim Kita
b080adb586 Fixed build 2024-04-28 12:52:05 +03:00
Maksim Kita
8ed6f4c27a Fixed code review issues 2024-04-28 12:52:05 +03:00
Maksim Kita
bc6db79737 QueryPlan convert OUTER JOIN to INNER JOIN optimization 2024-04-28 12:52:04 +03:00
LiuNeng
4f9dba8535
Merge branch 'master' into feature/adaptive_merged_block_size 2024-04-28 12:54:43 +08:00
lgbo-ustc
0070d6fc71 fixed: converting filter column type 2024-04-28 09:27:16 +08:00
lgbo-ustc
352d7a443b fixed: filter column is a const column 2024-04-28 09:27:16 +08:00
lgbo-ustc
5431e272c9 update 2024-04-28 09:27:16 +08:00
lgbo-ustc
6fa6c0261b apply 27a2b19 2024-04-28 09:27:16 +08:00
lgbo-ustc
7ee720ffb0 update settting 2024-04-28 09:27:15 +08:00
lgbo-ustc
c51e9163a5 reduce hash join code size
add check

debug

fixed

fixed

fixed

fixed

fixed

debug

debug

update

rename full_expression

rollback ExecutionContext

experiment: support join_use_nulls
2024-04-28 09:26:11 +08:00
lgbo-ustc
cd9c87811f fixed bugs for all right join
add test cases

fixed typos

add document

fixed stype error and rename some variables

fixed test error

add test cases

try to recude hash join code size

debug

fixed

fixed coredump

fixed. condition result type is not bool

enable when allow_experimental_analyzer=0

fixed tests

fixed

update tests

update tests

roll backup when use the old analyzer

fixed typos

fixed

test

large obj check

test

test
2024-04-28 09:26:11 +08:00
lgbo-ustc
f7dd4deca0 Optimization for cutting left blocks into processed and not_processed parts. 2024-04-28 09:26:11 +08:00
lgbo-ustc
4a2ad7beb5 fixed bugs 2024-04-28 09:26:11 +08:00
lgbo-ustc
2692784585 support inequal join for left/right/inner all 2024-04-28 09:26:11 +08:00
Nikita Taranov
c14fb847da
Merge pull request #62047 from azat/dist/fix-IN-rewrite
Fix optimize_skip_unused_shards_rewrite_in for composite sharding key
2024-04-27 18:39:34 +00:00
Alexey Milovidov
64fff163f7 Less directories 2024-04-27 19:54:37 +02:00
Alexey Milovidov
6a083ebed0 Even less directories 2024-04-27 19:13:17 +02:00
Alexey Milovidov
39118ef461 Hopefully better 2024-04-27 18:47:03 +02:00
Alexey Milovidov
a75a9e37be
Merge pull request #62534 from ClickHouse/Azure_write_buffer_parallel_upload
Support parallel write buffer for AzureBlobStorage
2024-04-27 13:59:55 +00:00
Pablo Marcos
9002d4c751 Merge branch 'master' into pamarcos/system-unload-primary-key 2024-04-27 08:57:29 +02:00
Konstantin Bogdanov
2768b4f611
Fix comment 2024-04-26 19:58:34 +02:00
Konstantin Bogdanov
822a57cb83
Fix integration tests 2024-04-26 19:56:24 +02:00
Nikita Mikhaylov
ed7e4291ab
Merge pull request #62937 from ClickHouse/docs-remove-replicated-experimental-tag
Remove experimental tag from Replicated database engine
2024-04-26 17:56:06 +00:00
Konstantin Bogdanov
466633729f
Support user expiration 2024-04-26 17:03:40 +02:00
Raúl Marín
25d7f24f0f
Merge pull request #63004 from Algunenano/remove_optimize_monotonous_functions_in_order_by
Remove optimize_monotonous_functions_in_order_by setting
2024-04-26 12:13:50 +00:00
alesapin
56039c91f9
Update src/Interpreters/MutationsInterpreter.cpp 2024-04-26 13:51:25 +02:00
Duc Canh Le
41351222e7 Merge branch 'master' into rocksdb_bypass_memtable
Resolve conflicts

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-04-26 10:47:49 +00:00
Kseniia Sumarokova
ce5ea3b05a
Merge pull request #62925 from ClickHouse/fix-temporary-data-in-cache-base-directory-creation
Fix temporary data in cache incorrectly processing failure of cache key directory creation
2024-04-26 10:17:45 +00:00
Smita Kulkarni
3ace11f92d Merge branch 'master' into Azure_write_buffer_parallel_upload 2024-04-26 10:27:41 +02:00
liuneng
f2ab23780f fix bug and add test case 2024-04-26 16:24:06 +08:00
liuneng
49740451f7 reduce memory usage during merging external sorted file 2024-04-26 13:38:30 +08:00
Raúl Marín
09ff42de0f Remove optimize_monotonous_functions_in_order_by 2024-04-25 21:46:15 +02:00
Raúl Marín
93be6c4a2a Merge remote-tracking branch 'blessed/master' into optimize_rewrite_sum_if_to_count_if 2024-04-25 20:38:48 +02:00
kssenii
acd7292be0 Fix abort in temporary data in cache 2024-04-25 20:00:40 +02:00
Pablo Marcos
24b84ef68a Merge branch 'master' into pamarcos/system-unload-primary-key 2024-04-25 18:26:14 +02:00
Grégoire Pineau
382e4fba5c dx: Enhance error message when non-deterministic function is used with Replicated source 2024-04-25 15:48:52 +02:00
Nikita Mikhaylov
f43a155aa9 Make allow_experimental_database_replicated obsolete. 2024-04-25 13:05:14 +00:00
kssenii
6dc48de031 Fix 2024-04-25 14:55:09 +02:00
Kseniia Sumarokova
8cea79ac91
Merge pull request #62868 from kitaisreal/system-drop-uninitialized-cache-fix
SYSTEM DROP uninitialized cache fix
2024-04-25 09:28:44 +00:00
Igor Nikonov
6db303cea3 Merge remote-tracking branch 'origin/master' into pr-receive-timeout-on-handshake 2024-04-24 18:56:49 +00:00
Raúl Marín
1ba7e5942b Enable optimize_rewrite_sum_if_to_count_if by default 2024-04-24 19:24:36 +02:00
kssenii
7530dd57f1 Fix 2024-04-24 18:51:45 +02:00
Maksim Kita
a4055ae879 SYSTEM DROP uninitialized cache fix 2024-04-24 17:46:15 +03:00
Robert Schulze
56e32e0f99
Rename MergeTreeIndexInverted* to MergeTreeIndexFullText* 2024-04-24 07:20:08 +00:00
Alexey Katsman
ca4e2f581a Add columns for values used in the formatting message into system.text_log 2024-04-23 17:26:56 +01:00
Robert Schulze
0ae422d33c
Rename MergeTreeIndexFullText --> MergeTreeIndexBloomFilterText 2024-04-23 14:17:54 +00:00
HowePa
c7fcc5493c fix typo for part log 2024-04-23 11:37:55 +08:00
Alexey Milovidov
642da7934a
Merge pull request #62751 from ClickHouse/block-cannot-allocate-thread-fault-injection-in-transaction
Block cannot allocate thread fault in noexcept functions in `MergeTreeTransaction`
2024-04-23 02:38:46 +00:00
Anton Popov
f29f3b9ba9
Merge pull request #62117 from pamarcos/pamarcos/copy_comment_in_create_as_statement
Copy comment when using CREATE AS statement
2024-04-22 09:52:21 +00:00
Smita Kulkarni
065eceecbf Merge branch 'master' into Azure_write_buffer_parallel_upload 2024-04-19 17:37:15 +02:00
Eliot Hautefeuille
520aa02059
fix: update: nested materialized columns: size check fixes 2024-04-19 00:10:41 +02:00
Pablo Marcos
c28af20e2a Merge branch 'master' into pamarcos/system-unload-primary-key 2024-04-18 17:53:11 +02:00
jsc0218
7525b2acf4
Merge pull request #60117 from jsc0218/TableEngineGrant_version2
TableEngineGrant_version2
2024-04-18 14:30:34 +00:00
János Benjamin Antal
aca46eecc9 Block cannot allocate thread fault in noexcept functions in MergeTreeTransaction 2024-04-18 10:30:36 +00:00
Pablo Marcos
2a65b0091e Merge branch 'master' into pamarcos/copy_comment_in_create_as_statement 2024-04-18 07:12:14 +02:00
Pablo Marcos
d8baccaa49 Fix coding style 2024-04-18 07:09:22 +02:00
Pablo Marcos
556932706b Add SYSTEM UNLOAD PRIMARY KEY 2024-04-17 21:24:59 +02:00
Igor Nikonov
043c62931d Merge remote-tracking branch 'origin/master' into pr-receive-timeout-on-handshake 2024-04-17 16:48:40 +00:00
Igor Nikonov
1e43e3515e Check table status for parallel replicas 2024-04-17 16:47:52 +00:00
kssenii
bd49f50a71 Fix 2024-04-17 12:07:25 +01:00
jsc0218
80fa1ab89a fix 2024-04-17 00:31:15 +00:00
Alexander Tokmakov
d2c3d98844
Merge pull request #62663 from ClickHouse/tavplubix-patch-10
Update TransactionLog.cpp
2024-04-16 14:54:47 +00:00
Robert Schulze
7fa294d42d
Merge remote-tracking branch 'rschu1ze/master' into qc-hash 2024-04-16 13:38:46 +00:00
Nikita Mikhaylov
41cce7f353
Merge pull request #62667 from ClickHouse/backup_log_event_time
Unify sorting key for system tables
2024-04-16 12:29:47 +00:00
Robert Schulze
2b23c7cc30
Change query cache keys from ASTs to AST hashes 2024-04-16 09:27:20 +00:00
Kseniia Sumarokova
dfd3bbe223
Merge pull request #62555 from ClickHouse/fixes-for-dynamic-cache-resize
Follow up to #61723
2024-04-15 22:17:34 +00:00
Nikita Mikhaylov
952262107e Done 2024-04-15 16:19:54 +00:00
Vitaly Baranov
4efa03717b
Merge pull request #62601 from vitlibar/avoid-evaluating-table-defaults-while-restoring
Avoid evaluating table DEFAULT expressions while executing RESTORE
2024-04-15 15:32:42 +00:00
Alexander Tokmakov
42e441d27a
Update TransactionLog.cpp 2024-04-15 17:32:28 +02:00
Azat Khuzhin
8a1fe33304 Disable optimize_skip_unused_shards_rewrite_in for composite keys
It never worked, since shardContains() accept only one value, and it
will throw "Not found column X in block" when sharding key consist from
multiple columns.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-15 11:53:56 +02:00
Azat Khuzhin
32ed192434 Fix incorrect sharding key types for optimize_skip_unused_shards_rewrite_in
Before it always uses the first column from sample block, while it is
not guaranteed.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-15 11:53:56 +02:00
Pablo Marcos
9d87cec843 Don't use ASTPtr for the comment following feedback in the PR 2024-04-14 17:58:55 +02:00
Pablo Marcos
e3a0abd415 Merge branch 'master' into pamarcos/copy_comment_in_create_as_statement 2024-04-14 17:11:20 +02:00
Alexander Tokmakov
d510c3ac55
Merge pull request #62266 from ClickHouse/cannot_allocate_thread
Add fault injection for "Cannot allocate thread"
2024-04-12 14:40:42 +00:00
kssenii
a4afe0ad06 One more fix 2024-04-12 16:37:04 +02:00
Vitaly Baranov
df681f3e82 Avoid evaluating table default expressions while restoring from a backup. 2024-04-12 15:45:53 +02:00
Alexander Tokmakov
b5ff1c0a6e
Merge branch 'master' into cannot_allocate_thread 2024-04-12 13:35:14 +02:00
Kseniia Sumarokova
db46866db7
Merge pull request #62551 from ClickHouse/fix-assertion-in-cache-slru
Fix assertion in stress test
2024-04-12 11:18:29 +00:00
kssenii
faf783e66f Remove redundant change 2024-04-12 12:55:02 +02:00
kssenii
f7dc28984c Add a comment, an actual fix for the bug 2024-04-12 12:33:11 +02:00
Alexey Milovidov
13283abce6 Apply review comments 2024-04-12 03:47:29 +02:00
Alexey Milovidov
727caee102 Merge branch 'master' into fix-trash-docs 2024-04-12 03:46:19 +02:00
Alexander Tokmakov
55c510563c Merge branch 'master' into cannot_allocate_thread 2024-04-11 23:06:17 +02:00
Robert Schulze
a358e2c872
Merge pull request #62541 from jaymebrd/add-event-time-backup-log-table
Add column `event_time` to system table `backup_log system`
2024-04-11 13:02:34 +00:00
kssenii
96f4ac4561 Fixes for dynamic cache resize 2024-04-11 14:57:13 +02:00
kssenii
0ef2153d55 Fix 2024-04-11 14:02:32 +02:00
Alexander Tokmakov
e21799f4a5 fix hung check 2024-04-11 13:48:35 +02:00
Jayme Bird
edb22a8941 add event_time to backup_log system table 2024-04-11 10:22:02 +01:00
Smita Kulkarni
b8c77a4453 Support parallel write buffer for AzureBlobStorage 2024-04-11 10:13:41 +02:00
Maksim Kita
4a1a932c5f Fixed tests 2024-04-11 11:09:08 +03:00
Maksim Kita
1218cf1568 Updated implementation 2024-04-11 11:09:08 +03:00
Alexander Tokmakov
d8e97b51bf Merge branch 'master' into cannot_allocate_thread 2024-04-10 21:21:42 +02:00
kssenii
05f55504bb Fix schedule 2024-04-10 19:32:11 +02:00
Robert Schulze
b072c8bc5c
Merge pull request #62456 from jaymebrd/add-hostname-blob_storage_log-system-table
Add missing `hostname` column to `blob_storage_log` system table
2024-04-10 13:08:00 +00:00
Robert Schulze
84525faee8
Merge remote-tracking branch 'ClickHouse/master' into add-hostname-blob_storage_log-system-table 2024-04-10 13:02:44 +00:00
Kruglov Pavel
8ef64b0581
Merge pull request #61476 from Avogar/better-stress-upgrade-checks
Ignore DROP queries in stress test with 1/2 probability and TRUNCATE Memory/JOIN table instead of ignoring DROP in upgrade check
2024-04-10 12:43:22 +00:00
kssenii
b6b7c3f80f Fxi 2024-04-10 13:41:21 +02:00
vdimir
4560f7c8c2
Merge pull request #62333 from ClickHouse/vdimir/check_max_insert_threads_support
Do not build multithread insert pipeline for tables without support
2024-04-10 11:14:13 +00:00
Robert Schulze
d1bd7e08e4
Merge remote-tracking branch 'rschu1ze/master' into qc-system-tables 2024-04-10 10:55:16 +00:00
zhongyuankai
bec9ae2a7d Merge branch 'master' into optimize_drop_tables 2024-04-10 09:52:17 +08:00
Kseniia Sumarokova
815e93b5a1
Merge branch 'master' into less-contentaion-in-cache-part4 2024-04-09 19:42:39 +02:00
Jayme Bird
fcfaf82181 fix: add missing hostname column to blob_storage_log system table 2024-04-09 17:50:28 +01:00
Robert Schulze
c7cb33d035
Better parsing 2024-04-09 15:43:08 +00:00
kssenii
ef0231e781 Merge remote-tracking branch 'origin/master' into less-contentaion-in-cache-part4 2024-04-09 17:28:49 +02:00
Robert Schulze
22e164c65d
Merge pull request #62375 from rschu1ze/static-instance2
Don't access static members through instance, pt. II
2024-04-09 14:37:24 +00:00
Kseniia Sumarokova
ebf4f79a34
Merge pull request #61723 from ClickHouse/better-dynamic-cache-resize-part-2
Speed up dynamic resize of filesystem cache
2024-04-09 13:54:07 +00:00
Robert Schulze
4035334634
Merge remote-tracking branch 'rschu1ze/master' into static-instance2 2024-04-09 11:45:27 +00:00
Alexey Milovidov
ce4ab06d03
Merge pull request #62382 from ClickHouse/remove-insert-watch
Remove support for INSERT WATCH query
2024-04-08 16:58:27 +00:00
avogar
71666cb42f Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks 2024-04-08 13:58:14 +00:00