thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 11:22:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
121,111 Commits 9,338 Branches 1,783 Tags 2.1 GiB
dbc11b83fd
Commit Graph

13667 Commits

Author SHA1 Message Date
Kseniia Sumarokova
e97e107bcc
Merge branch 'master' into add-separate-access-for-use-named-collections 2023-07-06 12:16:53 +02:00
Smita Kulkarni
56e45ba384 Added test for select query when container does not exist 2023-07-06 11:17:04 +02:00
Andrey Zvonov
cc0210f760
Merge branch 'master' into zvonand-issue-49290 2023-07-06 11:13:51 +02:00
Smita Kulkarni
2d3a148ffd Added option to check if container exists before attempting to read/create it, added this flag for all table functions, only used in azureBlobStorage 2023-07-06 10:56:07 +02:00
Alexander Gololobov
1336a9ec67 Better naming 2023-07-06 09:09:55 +02:00
Nikolay Degterinsky
b9fffacc65 Fix build 2023-07-06 06:31:09 +00:00
Nikolay Degterinsky
546f12dc85 Fix inserts to MongoDB tables 2023-07-06 05:05:27 +00:00
Alexey Milovidov
2e454ef89e
Merge branch 'master' into disks-space-improvement 2023-07-06 03:58:45 +03:00
Alexey Milovidov
1a24bface0
Merge branch 'master' into clickhouse-local-default-settings 2023-07-06 03:30:11 +03:00
Alexey Milovidov
89788f3d5b
Merge branch 'master' into fix-potentially-bad-code 2023-07-06 02:23:28 +03:00
Alexey Milovidov
2c592a6a2c
Merge pull request #51805 from ClickHouse/fix_for_parallel_replicas_and_empty_header 
Fix for parallel replicas not completely disabled by granule count threshold
 2023-07-06 01:46:52 +03:00
Alexey Milovidov
b28fa1f054 Merge branch 'many-fixes-3' of github.com:ClickHouse/ClickHouse into many-fixes-3 2023-07-05 23:54:48 +02:00
Alexey Milovidov
9bcc85d60f Merge branch 'fix-drop-column-sparse' of github.com:CurtizJ/ClickHouse into many-fixes-3 2023-07-05 23:54:27 +02:00
alesapin
66484a4dd0
Merge branch 'master' into add_delay_for_replicated 2023-07-05 20:03:34 +02:00
Kruglov Pavel
60cf8a4c94
Merge branch 'master' into better-progress-bar-2 2023-07-05 19:58:55 +02:00
Igor Nikonov
bf190381f5 addJoinedBlock -> addBlockToJoin 2023-07-05 17:03:18 +00:00
alesapin
f2d106ffb7 Fix typos 2023-07-05 18:54:33 +02:00
alesapin
2fa45117ed Beter 2023-07-05 18:38:04 +02:00
alesapin
88d3e1723a Fixes and comments 2023-07-05 18:31:47 +02:00
alesapin
baee73fd96 Make shutdown of replicated tables softer 2023-07-05 18:11:25 +02:00
Duc Canh Le
8f1ed5c90d add more check + line break 2023-07-05 15:04:38 +00:00
Duc Canh Le
1da413e64e fix segfault when create invalid EmbeddedRocksdb table 2023-07-05 14:56:11 +00:00
Alexander Gololobov
5512c307db system.jemalloc_bins table 2023-07-05 14:34:03 +02:00
Anton Popov
cf809c25cd fix CLEAR COLUMN query 2023-07-05 11:24:29 +00:00
yariks5s
ba4cbd388b
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-05 12:33:56 +02:00
Kseniia Sumarokova
dcda3576d2
Merge branch 'master' into add-separate-access-for-use-named-collections 2023-07-05 12:05:49 +02:00
李扬
bb301cfbb0
Merge branch 'master' into improve_geohash 2023-07-05 17:57:03 +08:00
李扬
d81e8ff705
Merge branch 'master' into fix_hdfs_read_buffer_heap_overflow 2023-07-05 15:43:50 +08:00
Anton Popov
ede63a0f4e fix drop column with enabled sparse columns 2023-07-05 00:30:28 +00:00
Alexey Milovidov
a4abb81194
Merge branch 'master' into bgmem 2023-07-05 01:54:43 +03:00
Alexey Milovidov
69d8923c4c Merge branch 'master' into fix-potentially-bad-code 2023-07-05 00:46:24 +02:00
Alexander Gololobov
c0629a38d1 Fix for incorrect result when parallel replicas not completely disabled 2023-07-04 23:50:19 +02:00
Alexey Milovidov
3371e038cf
Merge pull request #51498 from ClickHouse/vdimir/test_alter_moving_garbage_51342 
Fix `test_alter_moving_garbage`: lock between getActiveContainingPart and swapActivePart in parts mover
 2023-07-05 00:32:21 +03:00
Alexander Tokmakov
607a8a1c46 fix 2023-07-04 22:52:59 +02:00
Alexander Tokmakov
42222662e6 Merge branch 'master' into fix_broken_parts_handling 2023-07-04 22:46:35 +02:00
Alexey Milovidov
31f68c2c67 Merge branch 'master' into deprecate-metadata-cache 2023-07-04 22:28:14 +02:00
alesapin
1ea5261012 Intermediate version 2023-07-04 22:19:53 +02:00
Alexey Milovidov
4e8405cbda Merge branch 'master' into disks-space-improvement 2023-07-04 22:00:40 +02:00
Alexander Tokmakov
d987b94ed4 fix the way how broken parts are detached 2023-07-04 20:51:15 +02:00
yariks5s
0d0e59abc8
Update IMergeTreeDataPart.cpp 2023-07-04 12:08:58 +02:00
yariks5s
0e4cd16582
Update include brackets 2023-07-04 11:53:23 +02:00
yariks5s
60c6cc17fc
Update include brackets 
Co-authored-by: Sergei Trifonov <svtrifonov@gmail.com>
 2023-07-04 11:39:39 +02:00
flynn
69d20c0458
Merge branch 'master' into is_obsolete 2023-07-04 16:46:25 +08:00
李扬
3b860cd685
Merge branch 'master' into fix_hdfs_read_buffer_heap_overflow 2023-07-04 10:04:57 +08:00
yariks5s
ad0bff919c
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-04 00:26:03 +02:00
Anton Popov
fd4a14d56b
Merge branch 'master' into system.parts_column_modification_time 2023-07-03 23:28:03 +02:00
Vitaly Baranov
8dd1b7b8b9
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-03 18:00:33 +02:00
Nikolay Degterinsky
82e0237e67
Merge branch 'master' into headers-blacklist 2023-07-03 16:54:50 +02:00
yariks5s
b4bc8fe353
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-03 16:03:05 +02:00
kssenii
ac77f5fe6f Merge remote-tracking branch 'upstream/master' into add-separate-access-for-use-named-collections 2023-07-03 13:55:45 +02:00
Alexander Gololobov
eff94f5100
Merge pull request #51610 from ClickHouse/fix_move_in_to_prewhere 
Fix for moving 'IN' conditions to PREWHERE
 2023-07-03 13:55:32 +02:00
Azat Khuzhin
22e44ced8a Add column modification time into system.parts_columns 
This can be useful to obtain at least some time for the part after
mutations, since mutations will change the modification time of all
parts.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-03 13:34:05 +02:00
Alexander Tokmakov
ce5ca7d2a5
Merge pull request #51502 from ClickHouse/fix_logical_error_on_mutation 
Fix a logical error on mutation
 2023-07-03 12:52:59 +03:00
Alexander Tokmakov
392b70d6f8
fix merge_selecting_task scheduling (#51591) 
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
 2023-07-02 19:30:18 +03:00
Alexander Tokmakov
43dba76cbf
Merge branch 'master' into fix_logical_error_on_mutation 2023-07-02 19:30:00 +03:00
Vitaly Baranov
35d1b8448b
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-02 01:32:54 +02:00
yariks5s
e0b581d418
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-01 23:23:09 +02:00
Antonio Andelic
4f5926153f
Merge branch 'master' into fix-async-insert-dedup-for-merging-algorithms 2023-07-01 20:59:06 +02:00
Alexander Gololobov
f36f981f15 Move adding CreateSets to the end of optimizations, after applying key conditions and indexes 2023-07-01 20:05:18 +02:00
Alexander Gololobov
05d399c0b3 Handle subqueries and sets when collecting table columns 2023-07-01 20:05:18 +02:00
Antonio Andelic
5e1cfb0531 Avoid copying block if optimize_on_insert is false 2023-07-01 08:53:23 +00:00
Antonio Andelic
0c31055663 Merge branch 'master' into fix-async-insert-dedup-for-merging-algorithms 2023-07-01 08:34:22 +00:00
Nikolay Degterinsky
8dfa773f44
Merge branch 'master' into headers-blacklist 2023-06-30 23:40:17 +02:00
Sema Checherinda
80b23a59dc
Merge branch 'master' into less-logs-3 2023-06-30 22:59:55 +02:00
Sema Checherinda
fe17a9b589 do not log aborted for pending mutate/merge when shutdown 2023-06-30 19:36:32 +02:00
Alexey Milovidov
5ee7f47b03 Update autogenerated version to 23.7.1.1 and contributors 2023-06-30 17:09:56 +02:00
Alexander Tokmakov
d572eff106
Merge branch 'master' into fix_logical_error_on_mutation 2023-06-30 15:12:35 +03:00
Antonio Andelic
9a79fd6f70 Better 2023-06-30 11:51:20 +00:00
Antonio Andelic
24ae56b5dd Correctly apply async deduplication for nonordinary ReplicatedMergeTree tables 2023-06-30 11:02:16 +00:00
Michael Kolupaev
2b55734ccf
Fix MergeTreeMarksLoader segfaulting if marks file is longer than expected (#51636) 
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-06-30 11:52:03 +02:00
Alexey Milovidov
2f8118fef9
Merge branch 'master' into is_obsolete 2023-06-30 12:08:38 +03:00
Antonio Andelic
3b7f6a4324
Merge pull request #50796 from ClickHouse/keeper-add-api-version-config 
Add feature flags for Keeper API
 2023-06-30 09:20:52 +02:00
flynn
be2bd989db
Merge branch 'master' into is_obsolete 2023-06-30 10:35:04 +08:00
Alexey Milovidov
068b2b6ab9
Merge branch 'master' into vdimir/test_alter_moving_garbage_51342 2023-06-29 23:12:25 +03:00
Alexey Milovidov
b6a37fbf18
Merge branch 'master' into many-fixes-2 2023-06-29 22:36:33 +03:00
yariks5s
2c3440be41
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-29 16:59:43 +02:00
Vitaly Baranov
0cccba62cf Support getHexUIntLowercase() with CityHash_v1_0_2::uint128 parameter. 2023-06-29 15:29:37 +02:00
Alexander Tokmakov
bac126fe3e fix 2023-06-29 15:11:02 +02:00
avogar
f88c1fdf44 Fixes 2023-06-29 11:59:09 +00:00
Antonio Andelic
6e1aec6e0b
Merge branch 'master' into keeper-add-api-version-config 2023-06-29 11:36:49 +02:00
Igor Nikonov
def0adf8f4
Merge branch 'master' into many-fixes-2 2023-06-29 10:33:59 +02:00
Alexander Tokmakov
b27cf4e7ba fix 2023-06-29 00:15:45 +02:00
Alexander Tokmakov
296f9968c0 fix 2023-06-28 23:20:02 +02:00
avogar
4eeb431003 Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-progress-bar-2 2023-06-28 18:53:08 +00:00
Alexander Tokmakov
372f5786c4 more optimal REPLACE_RANGE with zero-copy 2023-06-28 18:44:54 +02:00
Alexander Tokmakov
594ec09edf fix missing metadata_version.txt 2023-06-28 18:19:16 +02:00
Vitaly Baranov
5570863676
Merge branch 'master' into reorder-part-checksum-halves 2023-06-28 17:25:34 +02:00
yariks5s
5bfc65f787
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-28 13:28:29 +02:00
Nikita Mikhaylov
b8b0fd3abf
Slightly better code around packets for parallel replicas (#51451) 2023-06-28 12:30:15 +02:00
Andrey Zvonov
ae26ff27a1
Merge branch 'master' into zvonand-issue-49290 2023-06-28 12:13:05 +02:00
Antonio Andelic
be852d554b Use magic_enum for values 2023-06-28 07:45:20 +00:00
李扬
748cd13fc3
Merge branch 'master' into improve_geohash 2023-06-28 15:02:05 +08:00
yariks5s
34094da1c4
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-28 00:19:13 +02:00
Alexander Tokmakov
1ed104417a fix race between executeMetadataAlter and initializeReplication 
(cherry picked from commit 1d47783e85)
 2023-06-27 23:24:02 +02:00
Alexander Tokmakov
f5327e79bb fix a logical error on mutation 2023-06-27 20:18:38 +02:00
yariks5s
c59ddf0c66 Resolved style check 2023-06-27 17:27:28 +00:00
vdimir
0b6d367bdb
Parts mover: lock between getActiveContainingPart and swapActivePart 2023-06-27 17:14:49 +00:00
yariks5s
f3f604ace4 added table with pk size 2023-06-27 17:06:09 +00:00
Nikita Mikhaylov
dc0dc227e0
Merge pull request #51455 from ClickHouse/many-fixes 
Many fixes
 2023-06-27 13:57:17 +02:00
李扬
ca28801968
Merge branch 'master' into fix_hdfs_read_buffer_heap_overflow 2023-06-27 18:14:34 +08:00
Antonio Andelic
efbe01b6bb Merge branch 'master' into keeper-add-api-version-config 2023-06-27 10:11:04 +00:00
SmitaRKulkarni
0762e981d8
Merge branch 'master' into azure_blob_storage_sas_token 2023-06-27 09:47:23 +02:00
SmitaRKulkarni
dcf581a985
Merge pull request #50936 from ClickHouse/Fix_race_azure_blob_storage_iterator 
Fix race azure blob storage iterator
 2023-06-27 09:27:45 +02:00
Alexey Milovidov
b5635887c3 Merge remote-tracking branch 'origin/refactor-subqueries-for-in' into many-fixes 2023-06-27 05:39:44 +02:00
李扬
25d984e2f2
Merge branch 'master' into improve_geohash 2023-06-27 10:05:02 +08:00
Robert Schulze
fae545ae5c
Merge pull request #51132 from rschu1ze/inefficient-query-cache 
Fix ineffective query cache for SELECTs with subqueries
 2023-06-26 16:54:54 +02:00
Andrey Zvonov
ddd8f6bba3
Merge branch 'master' into zvonand-issue-49290 2023-06-26 16:51:11 +02:00
Smita Kulkarni
8dafd66c8d Updated creating container using connection string 2023-06-26 16:35:16 +02:00
Nikolai Kochetov
4bfe75ce81
Merge branch 'master' into set-index-nullable-atoms 2023-06-26 14:34:42 +02:00
Smita Kulkarni
56c73cab0d Fix azure test fails and updated to work without create privileges 2023-06-26 13:30:22 +02:00
Alexander Tokmakov
eb649873b3
Unify merge predicate (#51344) 
* unify merge predicate

* Update BaseDaemon.cpp
 2023-06-26 13:48:21 +03:00
李扬
0e15266170
Merge branch 'master' into improve_geohash 2023-06-26 14:54:44 +08:00
Alexey Milovidov
b8e6bd3299
Merge branch 'master' into refactor-subqueries-for-in 2023-06-26 06:05:12 +03:00
Vitaly Baranov
f1f0daa654 Show halves of checksums in "system.parts", "system.projection_parts" and error messages in the correct order. 2023-06-25 17:17:56 +02:00
taiyang-li
769169f820 fix heap overflow in read buffer from hdfs 2023-06-25 18:26:53 +08:00
flynn
0243542587
Merge branch 'master' into is_obsolete 2023-06-25 16:54:54 +08:00
Alexey Milovidov
27f41869a9 Remove code that I don't like 2023-06-25 09:11:42 +02:00
Azat Khuzhin
a7b14f87e0 Throw an error instead of silenty ignore storage_file_read_method=mmap in server 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-06-24 23:42:31 +03:00
Alexey Milovidov
cca3f9937c
Merge branch 'master' into retry 2023-06-24 22:29:17 +03:00
Andrey Zvonov
0b6688ffe4
Merge branch 'master' into zvonand-issue-49290 2023-06-24 12:36:27 +02:00
Vitaly Baranov
3711430d9f Rename member fields of CityHash_v1_0_2::uint128: "first" -> "low64", "second" -> "high64". 2023-06-24 12:25:56 +02:00
Alexey Milovidov
2c69cff589
Merge branch 'master' into set-index-nullable-atoms 2023-06-24 10:18:20 +03:00
robot-clickhouse-ci-1
c66ff09627
Merge pull request #51253 from kssenii/delete-non-evictable-feature 
Delete feature do_not_evict_index_and_mark_files in fs cache
 2023-06-24 02:37:52 +02:00
Alexander Tokmakov
878000025d
Merge pull request #51297 from ClickHouse/fix-metadata-loading 
Fix metadata loading test
 2023-06-23 21:45:21 +03:00
Nikolai Kochetov
598da6207e Use inNull and add a comment. 2023-06-23 15:49:37 +00:00
avogar
21baa18969 Fix azure 2023-06-23 14:16:09 +00:00
avogar
938a9ee3c1 Better 2023-06-23 14:03:59 +00:00
Alexey Milovidov
945a119fc6
Merge pull request #51287 from ClickHouse/remove-live-view-alter 
Remove ALTER of LIVE VIEW
 2023-06-23 16:44:53 +03:00
avogar
c679dd400e Make better 2023-06-23 13:43:40 +00:00
Sema Checherinda
977cd03cf2
Merge branch 'master' into memory-leak 2023-06-23 15:35:53 +02:00
Anton Popov
43fd4a83ca
Merge branch 'master' into better-reporting-broken-parts 2023-06-23 14:57:23 +02:00
Smita Kulkarni
b5ad349c4f Removed unwanted atomic variables to non atomic 2023-06-23 14:34:24 +02:00
Robert Schulze
43c97d76bf
Merge pull request #44149 from zvonand/zvonand-implicit-tz 
Session time zones
 2023-06-23 14:28:49 +02:00
alesapin
eaf95306ed
Add random sleep for zero copy (#51282) 
* Add small sleep for zero copy replication merges and mutations

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MutateFromLogEntryTask.cpp

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MutateFromLogEntryTask.cpp

* Fix darwin build

---------

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-06-23 13:49:07 +02:00
Alexander Tokmakov
d57a6061ed
Merge pull request #51284 from ClickHouse/fix_check_table_structure 
Disable table structure check for secondary queries from Replicated db
 2023-06-23 13:04:33 +03:00
Smita Kulkarni
db8120722f Separated functionality of Iterator into GlobIterator and KeysIterator, added test for filter by file 2023-06-23 12:00:20 +02:00
Alexey Milovidov
7407330130
Merge branch 'master' into retry 2023-06-23 08:18:18 +03:00
Alexey Milovidov
f0563ae719 Remove the system.metadata_cache table 2023-06-23 02:32:28 +02:00
Alexey Milovidov
f14391faaa Change log level 2023-06-23 00:06:27 +02:00
Anton Popov
241d711264 better expception message 2023-06-22 22:03:40 +00:00
Alexey Milovidov
b5b2a2a41a Fix "metadata loading" test 2023-06-22 23:57:37 +02:00
Alexander Tokmakov
220520c516 fix 2023-06-22 21:45:10 +02:00
avogar
24fab7bfde Remove old includes 2023-06-22 18:48:15 +00:00
Alexey Milovidov
369ad0aea3 Remove ALTER of LIVE VIEW 2023-06-22 20:32:29 +02:00
Alexander Tokmakov
3afb0933a5 Merge branch 'master' into fix_trash_in_disks 2023-06-22 20:27:57 +02:00
avogar
f48cd0f926 Delete updateRowsProgressApprox implementation 2023-06-22 17:30:24 +00:00
avogar
cf082f2f9a Use read_bytes/total_bytes_to_read for progress bar in s3/file/url/... table functions 2023-06-22 17:24:43 +00:00
Alexander Tokmakov
8afb8bf13a disable table structure check for secondary queries from Replicated db 2023-06-22 19:06:28 +02:00
Michael Kolupaev
2498170253 Fix use-after-free in StorageURL when switching URLs 2023-06-22 16:24:12 +00:00
Andrey Zvonov
d4316c7189
Merge branch 'master' into zvonand-implicit-tz 2023-06-22 17:23:20 +02:00
Andrey Zvonov
18e7b029d5
Merge branch 'master' into zvonand-issue-49290 2023-06-22 17:20:24 +02:00
Nikolai Kochetov
22e49748b5 Cleanup. 2023-06-22 14:23:04 +00:00
Sema Checherinda
d0bb985061 fix other classes based on SinkToStorage 2023-06-22 14:33:25 +02:00
Anton Popov
ee68e85d31 better reporting of broken parts 2023-06-22 12:25:45 +00:00
Sema Checherinda
95349a405b release buffers with exception context 2023-06-22 13:00:13 +02:00
Nikolai Kochetov
a940031878 Merge branch 'master' into refactor-subqueries-for-in 2023-06-22 12:18:48 +02:00
Nikolai Kochetov
0af028ab3f Refactor a bit more. 2023-06-21 20:55:27 +00:00
Sema Checherinda
679f2c4aa4
Merge branch 'master' into memory-leak 2023-06-21 22:22:11 +02:00
Alexander Gololobov
333483bdce
Merge pull request #49181 from ClickHouse/get_rid_of_delete_on_destroy_marker 
Deprecate delete-on-destroy.txt
 2023-06-21 22:20:57 +02:00
Smita Kulkarni
5229544b55 Added function getCurrrentBatchAndScheduleNext to IObjectStorageIteratorAsync 2023-06-21 22:17:39 +02:00
Alexander Tokmakov
b7dd334d55
Merge branch 'master' into fix_trash_in_disks 2023-06-21 22:23:14 +03:00
Sema Checherinda
c2fa7a1030
Merge branch 'master' into memory-leak 2023-06-21 21:15:01 +02:00
Sema Checherinda
01de36f1fa
Merge pull request #50395 from CheSema/better-log 
require `finalize()` call before d-tor for all writes buffers
 2023-06-21 21:12:02 +02:00
kssenii
78ea4feca0 Merge remote-tracking branch 'upstream/master' into delete-non-evictable-feature 2023-06-21 20:52:08 +02:00
kssenii
9aa4647f4f Delete feature 2023-06-21 20:48:12 +02:00
Alexander Tokmakov
9157314b2a fix 2023-06-21 20:29:32 +02:00
Anton Popov
022b85ba0b
Merge pull request #51164 from CurtizJ/better-check-part-with-cache 
Better checking of data parts on disks with filesystem cache
 2023-06-21 20:08:53 +02:00
Michael Kolupaev
4a570a05c9 Decrease default timeouts for S3 and HTTP requests 2023-06-21 18:08:50 +00:00
Alexey Milovidov
c54433a1ac
Merge pull request #51131 from ClickHouse/nickitat-patch-11 
Small fix in `MergeTreePrefetchedReadPool`
 2023-06-21 20:31:49 +03:00
Dmitry Novik
bb97332599
Merge pull request #50441 from Algunenano/parallel_replicas_analyzer 
Support parallel replicas with the analyzer
 2023-06-21 17:28:06 +02:00
Alexander Gololobov
17a95a54e1
Merge pull request #51118 from ClickHouse/sys_zookeep_more_parallel_get 
Make more parallel get requests to ZooKeeper in system.zookeeper
 2023-06-21 17:07:21 +02:00
Alexander Tokmakov
318ac807c7 Merge branch 'master' into fix_trash_in_disks 2023-06-21 14:04:01 +02:00
Andrey Zvonov
b4f2e4020d
Merge branch 'master' into zvonand-implicit-tz 2023-06-21 13:41:35 +02:00
Kruglov Pavel
8f8cd97fd8
Merge pull request #51088 from Avogar/better-progress-bar 
Improve progress bar for file/s3/hdfs/url table functions. Step 1
 2023-06-21 12:42:25 +02:00
Alexander Gololobov
a23caab98c
Merge branch 'master' into sys_zookeep_more_parallel_get 2023-06-21 12:16:57 +02:00
Nikolai Kochetov
0149f905de
Update MergeTreeIndexSet.cpp 2023-06-21 11:26:54 +02:00
Alexander Tokmakov
8896e90ad6
Merge pull request #51207 from ClickHouse/fix_lost_forever_check 
Suppress check for covered parts in ZooKeeper
 2023-06-21 12:26:09 +03:00
Robert Schulze
dcfcbd8345
Merge remote-tracking branch 'rschu1ze/master' into inefficient-query-cache 2023-06-21 09:23:31 +00:00
Robert Schulze
9b959eb1fb
Merge pull request #49577 from tpanetti/mysql_compatible_types 
Change SHOW COLUMNS query to display MySQL types in MySQL Compatibility mode
 2023-06-21 11:04:22 +02:00
Robert Schulze
06e8590c8e
Merge pull request #50775 from rschu1ze/non-experimental-qpl-deflate 
Mark QPL_DEFLATE non-experimental but default: off-by-default
 2023-06-21 10:43:16 +02:00
Nikolay Degterinsky
e130a9fdb9
Fix build 2023-06-21 02:33:38 +02:00
Alexander Tokmakov
f973bd7516 suppress check for covered parts in zk 2023-06-20 23:53:32 +02:00
Nikolai Kochetov
5bda0b535d Fixing build. 2023-06-20 19:45:03 +00:00
Nikolai Kochetov
e4f057e304 Fix Set index with constant nullable comparison. 2023-06-20 19:40:37 +00:00
Sema Checherinda
9b0c3359cf
Merge branch 'master' into better-log 2023-06-20 20:37:36 +02:00
Alexey Milovidov
c097e6e53d
Merge pull request #50531 from kitaisreal/jit-infrastructure-refactoring 
JIT infrastructure refactoring
 2023-06-20 21:13:44 +03:00
Robert Schulze
bc7df2baca
Merge branch 'master' into non-experimental-qpl-deflate 2023-06-20 20:06:01 +02:00
Sema Checherinda
fd292dc730 work with comment on the PR 2023-06-20 20:02:04 +02:00
Nikolai Kochetov
5a1f819e7b Fix more tests. 2023-06-20 17:33:09 +00:00
Alexander Gololobov
7a1f8547f3 Simplify the code 2023-06-20 17:18:05 +02:00
Alexander Gololobov
816c6cdeb1 Simplify the code by using tryGetChildren 2023-06-20 16:56:50 +02:00
郭小龙
154d19ce72
The time format (connected_time field) is incorrect (#51026) 
* The time format (connected_time field) is incorrect

* Change the description and increase the field list display

* Update 02735_system_zookeeper_connection.reference

* Update 02735_system_zookeeper_connection.sql

* Update 02735_system_zookeeper_connection.sql

* Update 02735_system_zookeeper_connection.reference

* fix test

---------

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-06-20 16:57:55 +03:00
Anton Popov
31ece0c512 add test for check part with cache 2023-06-20 13:28:01 +00:00
avogar
1d80072c21 Fix tests and builds 2023-06-20 13:01:47 +00:00
Maksim Kita
7e5017dd31 Fixed tests 2023-06-20 11:42:22 +03:00
Andrey Zvonov
20f8b0b4f4
Merge branch 'master' into zvonand-issue-49290 2023-06-20 02:53:50 +02:00
Andrey Zvonov
07191ce10d
Merge branch 'master' into zvonand-implicit-tz 2023-06-20 00:24:53 +02:00
zvonand
4e61f93fde upd 2023-06-19 23:44:59 +02:00
zvonand
b16c30e521 upd for review 2023-06-19 23:06:08 +02:00
Nikolai Kochetov
7280078bc6 Refactoring a bit more. 2023-06-19 19:01:56 +00:00
Alexander Tokmakov
a2833b2060 remove AsyncTrashPoolExecutor 2023-06-19 19:58:23 +02:00
Anton Popov
1ef19dbe4d drop cache on check of broken part 2023-06-19 16:32:51 +00:00
Alexander Gololobov
44f1f036e8 Use multi-read requests for list and get 2023-06-19 16:47:17 +02:00
avogar
d492acbcd2 Fix tests 2023-06-19 13:36:29 +00:00
Smita Kulkarni
9a5d917cb5 Fixed clang build issue 2023-06-19 14:59:21 +02:00
Nikolai Kochetov
8e7d06e0a4 Remove isReady from FutureSet iface. 2023-06-19 12:56:24 +00:00
Nikolai Kochetov
f3398f9908 Try to make more consisten type check for sets. 2023-06-19 12:17:52 +00:00
Raúl Marín
8fdcca4326
Merge branch 'master' into parallel_replicas_analyzer 2023-06-19 13:54:59 +02:00
Nikita Taranov
90ced1aebc use int64 2023-06-19 13:48:52 +02:00
Sema Checherinda
a2d5c91a28 cancel temp part with exception context when deduplication triggered 2023-06-19 12:52:20 +02:00
Alexander Tokmakov
a00842498e Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-06-19 12:37:17 +02:00
Smita Kulkarni
86d0e542ea Merge branch 'master' into azure_blob_storage_sas_token 2023-06-19 07:38:39 +02:00
Sema Checherinda
e3f892f84a fix gtest with MemoryWriteBuffer, do not mute exception in ReplicatedMergeMutateTaskBase 2023-06-19 00:10:42 +02:00
Sema Checherinda
2bbfa279ec fix gtest_lru_file_cache, fix remove from pending 2023-06-18 21:05:00 +02:00
Smita Kulkarni
08b5196070 Updated to support passing sas token authentication 2023-06-18 19:54:31 +02:00
Sema Checherinda
ce7cd67981 finalize CascadeWriteBuffer 2023-06-18 17:35:12 +02:00
Alexander Tokmakov
76faacd23c try to fix some trash in Disks 2023-06-18 14:59:10 +02:00
Alexander Gololobov
59c11cb150 Make more parallel get requests to ZooKeeper 2023-06-18 08:26:37 +02:00
Alexey Milovidov
ce38d64c5a
Merge pull request #50856 from ClickHouse/relax-too-many-parts 
Relax "too many parts" further
 2023-06-18 01:49:46 +03:00
Robert Schulze
5311ebe1d2
Make query cache work effective with nested queries. 2023-06-17 20:27:25 +00:00
Alexander Tokmakov
b4e455430c
Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-06-17 22:19:21 +03:00
Alexey Milovidov
c7a18c640e Slightly better diagnostics 2023-06-17 17:20:44 +02:00
Alexey Milovidov
61e423c5df Fix typo 2023-06-17 17:14:49 +02:00
Alexey Milovidov
98bc124317 Fix typo 2023-06-17 17:13:19 +02:00
Andrey Zvonov
278b2ec72a
Merge branch 'master' into zvonand-issue-49290 2023-06-17 13:50:01 +02:00
zvonand
b25555d445 update style 2023-06-17 13:49:15 +02:00
Alexey Milovidov
a18dc73271 Fix error 2023-06-16 23:12:01 +02:00
Alexey Milovidov
688d5d59af Merge branch 'master' into relax-too-many-parts 2023-06-16 23:08:29 +02:00
Alexey Milovidov
ec952d401d
Merge pull request #51114 from ClickHouse/clang-17-3 
Compatibility with clang-17
 2023-06-17 00:07:45 +03:00
Alexey Milovidov
d94e47a930 Compatibility with clang-17 2023-06-16 23:07:19 +02:00
Alexey Milovidov
4e45e39e25
Merge pull request #51099 from ClickHouse/fix_use_local_vars_after_exception 
Fix for part_names_mutex used after destruction
 2023-06-16 23:52:50 +03:00
Alexey Milovidov
782889a051
Merge pull request #51042 from ClickHouse/sys_zookeep_parallel_list 
Make multiple parallel list requests when reading from system.zookeeper
 2023-06-16 23:46:53 +03:00
Nikolai Kochetov
afa74f697c Refactor a bit. 2023-06-16 19:38:50 +00:00
zvonand
1c10578f14 update to master 2023-06-16 21:30:47 +02:00
Sema Checherinda
e8d4dedbcc fix build and tests 2023-06-16 19:52:52 +02:00
Alexander Gololobov
8289d8fefa Fix for part_names_mutex used after destruction 2023-06-16 18:46:07 +02:00
avogar
56789af0fa Remove loggig 2023-06-16 15:55:05 +00:00
avogar
3209ebe34b Improve progress bar for file/s3/hdfs/url table functions. Step 1 2023-06-16 15:51:18 +00:00
Nikita Taranov
841d58f6ba
Small fix in MergeTreePrefetchedReadPool 2023-06-16 16:58:01 +02:00
Sema Checherinda
47484faace do abort/cancel/deletion merge/mutate task with exception context 2023-06-16 16:48:21 +02:00
Sema Checherinda
b428f88f22 finalize hashing buffer 2023-06-16 16:38:18 +02:00
Sema Checherinda
1cb02e2710 do call finalize for all buffers 2023-06-16 16:38:18 +02:00
Nikolai Kochetov
df1ea0b572
Merge pull request #50489 from ClickHouse/vdimir/alter_moving_garbage 
Cleanup moving parts
 2023-06-16 15:39:32 +02:00
Kruglov Pavel
dcc3efe4b7
Merge pull request #50364 from Avogar/allow-skip-empty-files 
Allow to skip empty files in file/s3/url/hdfs table functions
 2023-06-16 14:59:49 +02:00
Alexander Tokmakov
9260a1bf2e
Merge pull request #51006 from ClickHouse/followup_50448 
Follow-up to #50448
 2023-06-16 15:32:12 +03:00
Kruglov Pavel
f8ddfb1fd8
Merge branch 'master' into allow-skip-empty-files 2023-06-16 13:23:41 +02:00
Andrey Zvonov
00a5df684b
Merge branch 'master' into zvonand-issue-49290 2023-06-16 02:53:07 +02:00
zvonand
4155d13d69 merge master and resolve conflict 2023-06-16 02:20:32 +02:00
Alexander Gololobov
f08fd758fa Make multiple parallel list requests 2023-06-15 18:45:10 +02:00
Alexander Tokmakov
b248ba730a
Merge pull request #50997 from vitlibar/use-hash_of_all_files-for-parts 
Use hash_of_all_files to check identity of parts during on-cluster backups
 2023-06-15 16:54:55 +03:00
Nikolay Degterinsky
9a25958be8 Add HTTP header filtering 2023-06-15 13:49:49 +00:00
Alexander Tokmakov
dc0a224f52 fix 2023-06-15 15:05:17 +02:00
avogar
870f3d1270 Fix comments 2023-06-15 12:59:46 +00:00
Andrey Zvonov
9e3ddeca34 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into zvonand-issue-49290 2023-06-15 14:21:44 +02:00
Kseniia Sumarokova
c15e7b93cb
Merge pull request #50976 from kssenii/fix-data-lakes-too-many-head-requests 
Fix data lakes slowness because of synchronous head requests
 2023-06-15 13:33:09 +02:00
Andrey Zvonov
02cf8a1bad
Update comment StorageFile.cpp 2023-06-15 14:09:38 +03:00
Igor Nikonov
1113a7c524
Merge pull request #50214 from azat/parallelize_output_from_storages-fix 
Disable parallelize_output_from_storages for processing MATERIALIZED VIEWs and storages with one block only
 2023-06-15 12:48:54 +02:00
kssenii
05811d3dd8 Rename 2023-06-15 12:35:22 +02:00
Alexander Tokmakov
a018d9ca11 try to fix false-positive 'part is lost forever' 2023-06-15 12:25:16 +02:00
Kruglov Pavel
7aea4a1f10
Merge branch 'master' into allow-skip-empty-files 2023-06-15 12:07:24 +02:00
Kseniia Sumarokova
c786fbf8bd
Add comment 2023-06-15 10:22:02 +02:00
Kseniia Sumarokova
c8619ee6e4
Merge pull request #50974 from kssenii/iceberg-metadata-fix 
Fix iceberg V2 optional metadata parsing
 2023-06-15 09:31:36 +02:00
Vitaly Baranov
6366940a37 Use hash_of_all_files from system.parts to check identity of parts during on-cluster backups. 2023-06-14 20:39:50 +02:00
Azat Khuzhin
e9c9db9335 Disable parallelize_output_from_storages for all system tables 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-06-14 19:11:23 +03:00
Azat Khuzhin
3c4f638bd7 Disable parallelize_output_from_storages for storages with only one block 
$ clickhouse-benchmark -i 10000 -d 0 --parallelize_output_from_storages=0 -q "select * from values('foo')"
    Loaded 1 queries.

    Queries executed: 10000.

    localhost:9000, queries 10000, QPS: 2800.490, RPS: 2800.490, MiB/s: 0.032, result RPS: 2800.490, result MiB/s: 0.032.

    0.000%          0.000 sec.
    10.000%         0.000 sec.
    20.000%         0.000 sec.
    30.000%         0.000 sec.
    40.000%         0.000 sec.
    50.000%         0.000 sec.
    60.000%         0.000 sec.
    70.000%         0.000 sec.
    80.000%         0.000 sec.
    90.000%         0.000 sec.
    95.000%         0.000 sec.
    99.000%         0.001 sec.
    99.900%         0.001 sec.
    99.990%         0.001 sec.

    $ clickhouse-benchmark -i 10000 -d 0 --parallelize_output_from_storages=1 -q "select * from values('foo')"
    Loaded 1 queries.

    Queries executed: 10000.

    localhost:9000, queries 10000, QPS: 1259.805, RPS: 1259.805, MiB/s: 0.014, result RPS: 1259.805, result MiB/s: 0.014.

    0.000%          0.001 sec.
    10.000%         0.001 sec.
    20.000%         0.001 sec.
    30.000%         0.001 sec.
    40.000%         0.001 sec.
    50.000%         0.001 sec.
    60.000%         0.001 sec.
    70.000%         0.001 sec.
    80.000%         0.001 sec.
    90.000%         0.001 sec.
    95.000%         0.001 sec.
    99.000%         0.001 sec.
    99.900%         0.001 sec.
    99.990%         0.003 sec.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-06-14 19:11:23 +03:00
Andrey Zvonov
2f572b7211
Merge branch 'master' into zvonand-issue-49290 2023-06-14 14:22:32 +02:00
kssenii
25ae93bbf8 Merge remote-tracking branch 'upstream/master' into add-separate-access-for-use-named-collections 2023-06-14 13:33:56 +02:00
kssenii
827ac17dc2 Fix 2023-06-14 12:59:06 +02:00
Nikita Taranov
2b40734900 use const-size tasks in prefetch pool 2023-06-14 12:47:21 +02:00
kssenii
47a6db596e Better 2023-06-14 11:37:57 +02:00
kssenii
2a3ef3941e Fix 2023-06-14 11:31:28 +02:00
Thomas Panetti
a502967e1a
Merge branch 'master' into mysql_compatible_types 2023-06-13 20:30:16 -07:00
pufit
91d794cf0a
Merge pull request #50150 from JackyWoo/support_redis 
Add Redis table Engine/Function
 2023-06-13 21:34:14 -04:00
Antonio Andelic
bf0260bf5e
Merge branch 'master' into keeper-add-api-version-config 2023-06-13 21:27:51 +02:00
zvonand
1d8013074d fix style & black 2023-06-13 18:47:02 +02:00
Kruglov Pavel
39ba925f8b
Merge branch 'master' into allow-skip-empty-files 2023-06-13 17:17:26 +02:00
Thomas Panetti
fa4bc6b7c5
Merge branch 'master' into mysql_compatible_types 2023-06-13 08:13:15 -07:00
Dmitry Novik
23c478f8b5
Merge branch 'master' into parallel_replicas_analyzer 2023-06-13 17:09:18 +02:00
Smita Kulkarni
332893344d Updated lock for accessing azure blob storage iterator 2023-06-13 16:50:10 +02:00
avogar
2e1f56ae33 Address comments 2023-06-13 14:43:50 +00:00
Anton Popov
79f3300709
Merge pull request #50726 from CurtizJ/enable-mutations-throttling 
Enable settings for mutations throttling by default
 2023-06-13 14:57:36 +02:00
Dmitry Novik
f4ed10c0a2
Update src/Storages/StorageReplicatedMergeTree.cpp 2023-06-13 14:44:39 +02:00
Antonio Andelic
4ac090b122 Fix tests 2023-06-13 11:01:44 +00:00
kssenii
6c776f4483 Better 2023-06-13 12:40:53 +02:00
Sema Checherinda
2c018f5261 do not call finalize after exception 2023-06-13 10:48:31 +02:00
JackyWoo
9d548315e8
Merge branch 'master' into support_redis 2023-06-13 09:34:32 +08:00
JackyWoo
959fde4491 add notifications in docs 2023-06-13 09:33:38 +08:00
Alexey Milovidov
4e7cd2da01
Merge pull request #50811 from ClickHouse/tavplubix-patch-6 
Don't mark a part as broken on `Poco::TimeoutException`
 2023-06-12 23:17:37 +03:00
Robert Schulze
7745f7da73
Merge branch 'master' into annoy-misc 2023-06-12 21:46:27 +02:00
Kruglov Pavel
e4838725e3
Merge branch 'master' into allow-skip-empty-files 2023-06-12 20:03:23 +02:00
Dmitry Novik
d05f89f8f5 Fix style 2023-06-12 17:33:15 +00:00
Dmitry Novik
326a3a3e8d Use query tree to rewrite the query 2023-06-12 16:51:40 +00:00
Dmitry Novik
d606e2190c
Merge branch 'master' into parallel_replicas_analyzer 2023-06-12 18:49:54 +02:00
Thomas Panetti
8683f5e48d
Merge branch 'master' into mysql_compatible_types 2023-06-12 08:19:59 -07:00
Robert Schulze
3617316026
Merge branch 'master' into non-experimental-qpl-deflate 2023-06-12 16:01:45 +02:00
Anton Popov
d45f07743c fix getting number of mutations 2023-06-12 13:54:07 +00:00
Alexander Tokmakov
01c7d2fe71
Prostpone check of outdated parts (#50676) 
* prostpone check of outdated parts

* Update ReplicatedMergeTreePartCheckThread.cpp
 2023-06-12 16:53:26 +03:00
Alexander Tokmakov
5db3b393d8
Update MergeTreeData.cpp 2023-06-12 16:22:33 +03:00
Antonio Andelic
a7e6264d56 Add backward compatibility 2023-06-12 13:12:05 +00:00
Anton Popov
32caf87163
Merge pull request #50104 from amosbird/fix_43107_47549 
Proper mutation of skip indices and projections
 2023-06-12 15:09:18 +02:00