Commit Graph

6086 Commits

Author SHA1 Message Date
Michael Kolupaev
2b55734ccf
Fix MergeTreeMarksLoader segfaulting if marks file is longer than expected (#51636)
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-06-30 11:52:03 +02:00
Alexey Milovidov
068b2b6ab9
Merge branch 'master' into vdimir/test_alter_moving_garbage_51342 2023-06-29 23:12:25 +03:00
Alexey Milovidov
b6a37fbf18
Merge branch 'master' into many-fixes-2 2023-06-29 22:36:33 +03:00
yariks5s
2c3440be41
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-29 16:59:43 +02:00
Vitaly Baranov
0cccba62cf Support getHexUIntLowercase() with CityHash_v1_0_2::uint128 parameter. 2023-06-29 15:29:37 +02:00
Igor Nikonov
def0adf8f4
Merge branch 'master' into many-fixes-2 2023-06-29 10:33:59 +02:00
Alexander Tokmakov
b27cf4e7ba fix 2023-06-29 00:15:45 +02:00
Alexander Tokmakov
296f9968c0 fix 2023-06-28 23:20:02 +02:00
Alexander Tokmakov
594ec09edf fix missing metadata_version.txt 2023-06-28 18:19:16 +02:00
Vitaly Baranov
5570863676
Merge branch 'master' into reorder-part-checksum-halves 2023-06-28 17:25:34 +02:00
yariks5s
5bfc65f787
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-28 13:28:29 +02:00
Nikita Mikhaylov
b8b0fd3abf
Slightly better code around packets for parallel replicas (#51451) 2023-06-28 12:30:15 +02:00
yariks5s
34094da1c4
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-28 00:19:13 +02:00
Alexander Tokmakov
1ed104417a fix race between executeMetadataAlter and initializeReplication
(cherry picked from commit 1d47783e85)
2023-06-27 23:24:02 +02:00
Alexander Tokmakov
f5327e79bb fix a logical error on mutation 2023-06-27 20:18:38 +02:00
yariks5s
c59ddf0c66 Resolved style check 2023-06-27 17:27:28 +00:00
vdimir
0b6d367bdb
Parts mover: lock between getActiveContainingPart and swapActivePart 2023-06-27 17:14:49 +00:00
yariks5s
f3f604ace4 added table with pk size 2023-06-27 17:06:09 +00:00
Alexey Milovidov
b5635887c3 Merge remote-tracking branch 'origin/refactor-subqueries-for-in' into many-fixes 2023-06-27 05:39:44 +02:00
Nikolai Kochetov
4bfe75ce81
Merge branch 'master' into set-index-nullable-atoms 2023-06-26 14:34:42 +02:00
Alexander Tokmakov
eb649873b3
Unify merge predicate (#51344)
* unify merge predicate

* Update BaseDaemon.cpp
2023-06-26 13:48:21 +03:00
Alexey Milovidov
b8e6bd3299
Merge branch 'master' into refactor-subqueries-for-in 2023-06-26 06:05:12 +03:00
Vitaly Baranov
f1f0daa654 Show halves of checksums in "system.parts", "system.projection_parts" and error messages in the correct order. 2023-06-25 17:17:56 +02:00
Vitaly Baranov
3711430d9f Rename member fields of CityHash_v1_0_2::uint128: "first" -> "low64", "second" -> "high64". 2023-06-24 12:25:56 +02:00
Alexey Milovidov
2c69cff589
Merge branch 'master' into set-index-nullable-atoms 2023-06-24 10:18:20 +03:00
Alexander Tokmakov
878000025d
Merge pull request #51297 from ClickHouse/fix-metadata-loading
Fix metadata loading test
2023-06-23 21:45:21 +03:00
Nikolai Kochetov
598da6207e Use inNull and add a comment. 2023-06-23 15:49:37 +00:00
Anton Popov
43fd4a83ca
Merge branch 'master' into better-reporting-broken-parts 2023-06-23 14:57:23 +02:00
Robert Schulze
43c97d76bf
Merge pull request #44149 from zvonand/zvonand-implicit-tz
Session time zones
2023-06-23 14:28:49 +02:00
alesapin
eaf95306ed
Add random sleep for zero copy (#51282)
* Add small sleep for zero copy replication merges and mutations

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MutateFromLogEntryTask.cpp

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MutateFromLogEntryTask.cpp

* Fix darwin build

---------

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-06-23 13:49:07 +02:00
Alexey Milovidov
f14391faaa Change log level 2023-06-23 00:06:27 +02:00
Anton Popov
241d711264 better expception message 2023-06-22 22:03:40 +00:00
Alexey Milovidov
b5b2a2a41a Fix "metadata loading" test 2023-06-22 23:57:37 +02:00
Alexander Tokmakov
220520c516 fix 2023-06-22 21:45:10 +02:00
Alexander Tokmakov
3afb0933a5 Merge branch 'master' into fix_trash_in_disks 2023-06-22 20:27:57 +02:00
Alexander Tokmakov
8afb8bf13a disable table structure check for secondary queries from Replicated db 2023-06-22 19:06:28 +02:00
Andrey Zvonov
d4316c7189
Merge branch 'master' into zvonand-implicit-tz 2023-06-22 17:23:20 +02:00
Nikolai Kochetov
22e49748b5 Cleanup. 2023-06-22 14:23:04 +00:00
Anton Popov
ee68e85d31 better reporting of broken parts 2023-06-22 12:25:45 +00:00
Nikolai Kochetov
a940031878 Merge branch 'master' into refactor-subqueries-for-in 2023-06-22 12:18:48 +02:00
Nikolai Kochetov
0af028ab3f Refactor a bit more. 2023-06-21 20:55:27 +00:00
Alexander Gololobov
333483bdce
Merge pull request #49181 from ClickHouse/get_rid_of_delete_on_destroy_marker
Deprecate delete-on-destroy.txt
2023-06-21 22:20:57 +02:00
Alexander Tokmakov
b7dd334d55
Merge branch 'master' into fix_trash_in_disks 2023-06-21 22:23:14 +03:00
Sema Checherinda
01de36f1fa
Merge pull request #50395 from CheSema/better-log
require `finalize()` call before d-tor for all writes buffers
2023-06-21 21:12:02 +02:00
Alexander Tokmakov
9157314b2a fix 2023-06-21 20:29:32 +02:00
Anton Popov
022b85ba0b
Merge pull request #51164 from CurtizJ/better-check-part-with-cache
Better checking of data parts on disks with filesystem cache
2023-06-21 20:08:53 +02:00
Alexey Milovidov
c54433a1ac
Merge pull request #51131 from ClickHouse/nickitat-patch-11
Small fix in `MergeTreePrefetchedReadPool`
2023-06-21 20:31:49 +03:00
Alexander Tokmakov
318ac807c7 Merge branch 'master' into fix_trash_in_disks 2023-06-21 14:04:01 +02:00
Andrey Zvonov
b4f2e4020d
Merge branch 'master' into zvonand-implicit-tz 2023-06-21 13:41:35 +02:00
Nikolai Kochetov
0149f905de
Update MergeTreeIndexSet.cpp 2023-06-21 11:26:54 +02:00
Nikolai Kochetov
5bda0b535d Fixing build. 2023-06-20 19:45:03 +00:00
Nikolai Kochetov
e4f057e304 Fix Set index with constant nullable comparison. 2023-06-20 19:40:37 +00:00
Sema Checherinda
9b0c3359cf
Merge branch 'master' into better-log 2023-06-20 20:37:36 +02:00
Alexey Milovidov
c097e6e53d
Merge pull request #50531 from kitaisreal/jit-infrastructure-refactoring
JIT infrastructure refactoring
2023-06-20 21:13:44 +03:00
Sema Checherinda
fd292dc730 work with comment on the PR 2023-06-20 20:02:04 +02:00
Nikolai Kochetov
5a1f819e7b Fix more tests. 2023-06-20 17:33:09 +00:00
Anton Popov
31ece0c512 add test for check part with cache 2023-06-20 13:28:01 +00:00
Maksim Kita
7e5017dd31 Fixed tests 2023-06-20 11:42:22 +03:00
Andrey Zvonov
07191ce10d
Merge branch 'master' into zvonand-implicit-tz 2023-06-20 00:24:53 +02:00
Nikolai Kochetov
7280078bc6 Refactoring a bit more. 2023-06-19 19:01:56 +00:00
Alexander Tokmakov
a2833b2060 remove AsyncTrashPoolExecutor 2023-06-19 19:58:23 +02:00
Anton Popov
1ef19dbe4d drop cache on check of broken part 2023-06-19 16:32:51 +00:00
Nikolai Kochetov
8e7d06e0a4 Remove isReady from FutureSet iface. 2023-06-19 12:56:24 +00:00
Nikolai Kochetov
f3398f9908 Try to make more consisten type check for sets. 2023-06-19 12:17:52 +00:00
Nikita Taranov
90ced1aebc use int64 2023-06-19 13:48:52 +02:00
Sema Checherinda
a2d5c91a28 cancel temp part with exception context when deduplication triggered 2023-06-19 12:52:20 +02:00
Alexander Tokmakov
a00842498e Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-06-19 12:37:17 +02:00
Sema Checherinda
e3f892f84a fix gtest with MemoryWriteBuffer, do not mute exception in ReplicatedMergeMutateTaskBase 2023-06-19 00:10:42 +02:00
Sema Checherinda
2bbfa279ec fix gtest_lru_file_cache, fix remove from pending 2023-06-18 21:05:00 +02:00
Sema Checherinda
ce7cd67981 finalize CascadeWriteBuffer 2023-06-18 17:35:12 +02:00
Alexander Tokmakov
76faacd23c try to fix some trash in Disks 2023-06-18 14:59:10 +02:00
Alexey Milovidov
ce38d64c5a
Merge pull request #50856 from ClickHouse/relax-too-many-parts
Relax "too many parts" further
2023-06-18 01:49:46 +03:00
Alexander Tokmakov
b4e455430c
Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-06-17 22:19:21 +03:00
Alexey Milovidov
c7a18c640e Slightly better diagnostics 2023-06-17 17:20:44 +02:00
Alexey Milovidov
61e423c5df Fix typo 2023-06-17 17:14:49 +02:00
Alexey Milovidov
98bc124317 Fix typo 2023-06-17 17:13:19 +02:00
Alexey Milovidov
a18dc73271 Fix error 2023-06-16 23:12:01 +02:00
Alexey Milovidov
688d5d59af Merge branch 'master' into relax-too-many-parts 2023-06-16 23:08:29 +02:00
Nikolai Kochetov
afa74f697c Refactor a bit. 2023-06-16 19:38:50 +00:00
Alexander Gololobov
8289d8fefa Fix for part_names_mutex used after destruction 2023-06-16 18:46:07 +02:00
Nikita Taranov
841d58f6ba
Small fix in MergeTreePrefetchedReadPool 2023-06-16 16:58:01 +02:00
Sema Checherinda
47484faace do abort/cancel/deletion merge/mutate task with exception context 2023-06-16 16:48:21 +02:00
Sema Checherinda
b428f88f22 finalize hashing buffer 2023-06-16 16:38:18 +02:00
Sema Checherinda
1cb02e2710 do call finalize for all buffers 2023-06-16 16:38:18 +02:00
Nikolai Kochetov
df1ea0b572
Merge pull request #50489 from ClickHouse/vdimir/alter_moving_garbage
Cleanup moving parts
2023-06-16 15:39:32 +02:00
Alexander Tokmakov
9260a1bf2e
Merge pull request #51006 from ClickHouse/followup_50448
Follow-up to #50448
2023-06-16 15:32:12 +03:00
zvonand
4155d13d69 merge master and resolve conflict 2023-06-16 02:20:32 +02:00
Alexander Tokmakov
b248ba730a
Merge pull request #50997 from vitlibar/use-hash_of_all_files-for-parts
Use hash_of_all_files to check identity of parts during on-cluster backups
2023-06-15 16:54:55 +03:00
Alexander Tokmakov
dc0a224f52 fix 2023-06-15 15:05:17 +02:00
Alexander Tokmakov
a018d9ca11 try to fix false-positive 'part is lost forever' 2023-06-15 12:25:16 +02:00
Vitaly Baranov
6366940a37 Use hash_of_all_files from system.parts to check identity of parts during on-cluster backups. 2023-06-14 20:39:50 +02:00
Nikita Taranov
2b40734900 use const-size tasks in prefetch pool 2023-06-14 12:47:21 +02:00
Anton Popov
79f3300709
Merge pull request #50726 from CurtizJ/enable-mutations-throttling
Enable settings for mutations throttling by default
2023-06-13 14:57:36 +02:00
Alexey Milovidov
4e7cd2da01
Merge pull request #50811 from ClickHouse/tavplubix-patch-6
Don't mark a part as broken on `Poco::TimeoutException`
2023-06-12 23:17:37 +03:00
Robert Schulze
7745f7da73
Merge branch 'master' into annoy-misc 2023-06-12 21:46:27 +02:00
Alexander Tokmakov
01c7d2fe71
Prostpone check of outdated parts (#50676)
* prostpone check of outdated parts

* Update ReplicatedMergeTreePartCheckThread.cpp
2023-06-12 16:53:26 +03:00
Alexander Tokmakov
5db3b393d8
Update MergeTreeData.cpp 2023-06-12 16:22:33 +03:00
Anton Popov
32caf87163
Merge pull request #50104 from amosbird/fix_43107_47549
Proper mutation of skip indices and projections
2023-06-12 15:09:18 +02:00
Alexander Tokmakov
676ba2fbde
Update MergeTreeData.cpp 2023-06-12 12:30:38 +03:00
Alexander Tokmakov
3797a4202c
Update MergeTreeData.cpp 2023-06-11 23:38:31 +03:00