Commit Graph

6134 Commits

Author SHA1 Message Date
Alexey Milovidov
b5f9a170eb
Merge pull request #51848 from ClickHouse/many-fixes-3
Many fixes [3]
2023-07-07 13:29:49 +03:00
Alexander Tokmakov
fdbd59ec6c
Merge pull request #51135 from ClickHouse/fix_trash_in_disks
Try to fix some trash in Disks and part moves
2023-07-07 02:02:17 +03:00
Mike Kot
8b6376005a "reconfig" support for CH Keeper 2023-07-07 00:20:54 +03:00
Alexander Tokmakov
58793816a7 fix paranoid check 2023-07-06 19:06:35 +02:00
Alexander Tokmakov
abf36065b7 fix 2023-07-06 17:24:06 +02:00
Alexey Milovidov
1fa21700ad Merge remote-tracking branch 'origin/less-flaky-test_start_stop_moves' into many-fixes-3 2023-07-06 16:17:13 +02:00
Alexey Milovidov
2e454ef89e
Merge branch 'master' into disks-space-improvement 2023-07-06 03:58:45 +03:00
Alexey Milovidov
89788f3d5b
Merge branch 'master' into fix-potentially-bad-code 2023-07-06 02:23:28 +03:00
Alexey Milovidov
9bcc85d60f Merge branch 'fix-drop-column-sparse' of github.com:CurtizJ/ClickHouse into many-fixes-3 2023-07-05 23:54:27 +02:00
Anton Popov
cf809c25cd fix CLEAR COLUMN query 2023-07-05 11:24:29 +00:00
yariks5s
ba4cbd388b
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-05 12:33:56 +02:00
Anton Popov
ede63a0f4e fix drop column with enabled sparse columns 2023-07-05 00:30:28 +00:00
Alexey Milovidov
69d8923c4c Merge branch 'master' into fix-potentially-bad-code 2023-07-05 00:46:24 +02:00
Alexander Gololobov
c0629a38d1 Fix for incorrect result when parallel replicas not completely disabled 2023-07-04 23:50:19 +02:00
Alexey Milovidov
3371e038cf
Merge pull request #51498 from ClickHouse/vdimir/test_alter_moving_garbage_51342
Fix `test_alter_moving_garbage`: lock between getActiveContainingPart and swapActivePart in parts mover
2023-07-05 00:32:21 +03:00
Alexander Tokmakov
607a8a1c46 fix 2023-07-04 22:52:59 +02:00
Alexander Tokmakov
42222662e6 Merge branch 'master' into fix_broken_parts_handling 2023-07-04 22:46:35 +02:00
Alexey Milovidov
4e8405cbda Merge branch 'master' into disks-space-improvement 2023-07-04 22:00:40 +02:00
Alexander Tokmakov
d987b94ed4 fix the way how broken parts are detached 2023-07-04 20:51:15 +02:00
yariks5s
0d0e59abc8
Update IMergeTreeDataPart.cpp 2023-07-04 12:08:58 +02:00
yariks5s
0e4cd16582
Update include brackets 2023-07-04 11:53:23 +02:00
yariks5s
60c6cc17fc
Update include brackets
Co-authored-by: Sergei Trifonov <svtrifonov@gmail.com>
2023-07-04 11:39:39 +02:00
yariks5s
ad0bff919c
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-04 00:26:03 +02:00
Anton Popov
fd4a14d56b
Merge branch 'master' into system.parts_column_modification_time 2023-07-03 23:28:03 +02:00
Vitaly Baranov
8dd1b7b8b9
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-03 18:00:33 +02:00
yariks5s
b4bc8fe353
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-03 16:03:05 +02:00
Alexander Gololobov
eff94f5100
Merge pull request #51610 from ClickHouse/fix_move_in_to_prewhere
Fix for moving 'IN' conditions to PREWHERE
2023-07-03 13:55:32 +02:00
Azat Khuzhin
22e44ced8a Add column modification time into system.parts_columns
This can be useful to obtain at least some time for the part after
mutations, since mutations will change the modification time of all
parts.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-03 13:34:05 +02:00
Alexander Tokmakov
ce5ca7d2a5
Merge pull request #51502 from ClickHouse/fix_logical_error_on_mutation
Fix a logical error on mutation
2023-07-03 12:52:59 +03:00
Alexander Tokmakov
392b70d6f8
fix merge_selecting_task scheduling (#51591)
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-07-02 19:30:18 +03:00
Alexander Tokmakov
43dba76cbf
Merge branch 'master' into fix_logical_error_on_mutation 2023-07-02 19:30:00 +03:00
Vitaly Baranov
35d1b8448b
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-02 01:32:54 +02:00
yariks5s
e0b581d418
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-01 23:23:09 +02:00
Antonio Andelic
4f5926153f
Merge branch 'master' into fix-async-insert-dedup-for-merging-algorithms 2023-07-01 20:59:06 +02:00
Alexander Gololobov
05d399c0b3 Handle subqueries and sets when collecting table columns 2023-07-01 20:05:18 +02:00
Antonio Andelic
5e1cfb0531 Avoid copying block if optimize_on_insert is false 2023-07-01 08:53:23 +00:00
Antonio Andelic
0c31055663 Merge branch 'master' into fix-async-insert-dedup-for-merging-algorithms 2023-07-01 08:34:22 +00:00
Sema Checherinda
80b23a59dc
Merge branch 'master' into less-logs-3 2023-06-30 22:59:55 +02:00
Sema Checherinda
fe17a9b589 do not log aborted for pending mutate/merge when shutdown 2023-06-30 19:36:32 +02:00
Alexander Tokmakov
d572eff106
Merge branch 'master' into fix_logical_error_on_mutation 2023-06-30 15:12:35 +03:00
Antonio Andelic
9a79fd6f70 Better 2023-06-30 11:51:20 +00:00
Antonio Andelic
24ae56b5dd Correctly apply async deduplication for nonordinary ReplicatedMergeTree tables 2023-06-30 11:02:16 +00:00
Michael Kolupaev
2b55734ccf
Fix MergeTreeMarksLoader segfaulting if marks file is longer than expected (#51636)
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-06-30 11:52:03 +02:00
Alexey Milovidov
068b2b6ab9
Merge branch 'master' into vdimir/test_alter_moving_garbage_51342 2023-06-29 23:12:25 +03:00
Alexey Milovidov
b6a37fbf18
Merge branch 'master' into many-fixes-2 2023-06-29 22:36:33 +03:00
yariks5s
2c3440be41
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-29 16:59:43 +02:00
Vitaly Baranov
0cccba62cf Support getHexUIntLowercase() with CityHash_v1_0_2::uint128 parameter. 2023-06-29 15:29:37 +02:00
Igor Nikonov
def0adf8f4
Merge branch 'master' into many-fixes-2 2023-06-29 10:33:59 +02:00
Alexander Tokmakov
b27cf4e7ba fix 2023-06-29 00:15:45 +02:00
Alexander Tokmakov
296f9968c0 fix 2023-06-28 23:20:02 +02:00
Alexander Tokmakov
594ec09edf fix missing metadata_version.txt 2023-06-28 18:19:16 +02:00
Vitaly Baranov
5570863676
Merge branch 'master' into reorder-part-checksum-halves 2023-06-28 17:25:34 +02:00
yariks5s
5bfc65f787
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-28 13:28:29 +02:00
Nikita Mikhaylov
b8b0fd3abf
Slightly better code around packets for parallel replicas (#51451) 2023-06-28 12:30:15 +02:00
yariks5s
34094da1c4
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-28 00:19:13 +02:00
Alexander Tokmakov
1ed104417a fix race between executeMetadataAlter and initializeReplication
(cherry picked from commit 1d47783e85)
2023-06-27 23:24:02 +02:00
Alexander Tokmakov
f5327e79bb fix a logical error on mutation 2023-06-27 20:18:38 +02:00
yariks5s
c59ddf0c66 Resolved style check 2023-06-27 17:27:28 +00:00
vdimir
0b6d367bdb
Parts mover: lock between getActiveContainingPart and swapActivePart 2023-06-27 17:14:49 +00:00
yariks5s
f3f604ace4 added table with pk size 2023-06-27 17:06:09 +00:00
Alexey Milovidov
b5635887c3 Merge remote-tracking branch 'origin/refactor-subqueries-for-in' into many-fixes 2023-06-27 05:39:44 +02:00
Nikolai Kochetov
4bfe75ce81
Merge branch 'master' into set-index-nullable-atoms 2023-06-26 14:34:42 +02:00
Alexander Tokmakov
eb649873b3
Unify merge predicate (#51344)
* unify merge predicate

* Update BaseDaemon.cpp
2023-06-26 13:48:21 +03:00
Alexey Milovidov
b8e6bd3299
Merge branch 'master' into refactor-subqueries-for-in 2023-06-26 06:05:12 +03:00
Vitaly Baranov
f1f0daa654 Show halves of checksums in "system.parts", "system.projection_parts" and error messages in the correct order. 2023-06-25 17:17:56 +02:00
Alexey Milovidov
27f41869a9 Remove code that I don't like 2023-06-25 09:11:42 +02:00
Vitaly Baranov
3711430d9f Rename member fields of CityHash_v1_0_2::uint128: "first" -> "low64", "second" -> "high64". 2023-06-24 12:25:56 +02:00
Alexey Milovidov
2c69cff589
Merge branch 'master' into set-index-nullable-atoms 2023-06-24 10:18:20 +03:00
Alexander Tokmakov
878000025d
Merge pull request #51297 from ClickHouse/fix-metadata-loading
Fix metadata loading test
2023-06-23 21:45:21 +03:00
Nikolai Kochetov
598da6207e Use inNull and add a comment. 2023-06-23 15:49:37 +00:00
Anton Popov
43fd4a83ca
Merge branch 'master' into better-reporting-broken-parts 2023-06-23 14:57:23 +02:00
Robert Schulze
43c97d76bf
Merge pull request #44149 from zvonand/zvonand-implicit-tz
Session time zones
2023-06-23 14:28:49 +02:00
alesapin
eaf95306ed
Add random sleep for zero copy (#51282)
* Add small sleep for zero copy replication merges and mutations

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MutateFromLogEntryTask.cpp

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MutateFromLogEntryTask.cpp

* Fix darwin build

---------

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-06-23 13:49:07 +02:00
Alexey Milovidov
f14391faaa Change log level 2023-06-23 00:06:27 +02:00
Anton Popov
241d711264 better expception message 2023-06-22 22:03:40 +00:00
Alexey Milovidov
b5b2a2a41a Fix "metadata loading" test 2023-06-22 23:57:37 +02:00
Alexander Tokmakov
220520c516 fix 2023-06-22 21:45:10 +02:00
Alexander Tokmakov
3afb0933a5 Merge branch 'master' into fix_trash_in_disks 2023-06-22 20:27:57 +02:00
Alexander Tokmakov
8afb8bf13a disable table structure check for secondary queries from Replicated db 2023-06-22 19:06:28 +02:00
Andrey Zvonov
d4316c7189
Merge branch 'master' into zvonand-implicit-tz 2023-06-22 17:23:20 +02:00
Nikolai Kochetov
22e49748b5 Cleanup. 2023-06-22 14:23:04 +00:00
Anton Popov
ee68e85d31 better reporting of broken parts 2023-06-22 12:25:45 +00:00
Nikolai Kochetov
a940031878 Merge branch 'master' into refactor-subqueries-for-in 2023-06-22 12:18:48 +02:00
Nikolai Kochetov
0af028ab3f Refactor a bit more. 2023-06-21 20:55:27 +00:00
Alexander Gololobov
333483bdce
Merge pull request #49181 from ClickHouse/get_rid_of_delete_on_destroy_marker
Deprecate delete-on-destroy.txt
2023-06-21 22:20:57 +02:00
Alexander Tokmakov
b7dd334d55
Merge branch 'master' into fix_trash_in_disks 2023-06-21 22:23:14 +03:00
Sema Checherinda
01de36f1fa
Merge pull request #50395 from CheSema/better-log
require `finalize()` call before d-tor for all writes buffers
2023-06-21 21:12:02 +02:00
Alexander Tokmakov
9157314b2a fix 2023-06-21 20:29:32 +02:00
Anton Popov
022b85ba0b
Merge pull request #51164 from CurtizJ/better-check-part-with-cache
Better checking of data parts on disks with filesystem cache
2023-06-21 20:08:53 +02:00
Alexey Milovidov
c54433a1ac
Merge pull request #51131 from ClickHouse/nickitat-patch-11
Small fix in `MergeTreePrefetchedReadPool`
2023-06-21 20:31:49 +03:00
Alexander Tokmakov
318ac807c7 Merge branch 'master' into fix_trash_in_disks 2023-06-21 14:04:01 +02:00
Andrey Zvonov
b4f2e4020d
Merge branch 'master' into zvonand-implicit-tz 2023-06-21 13:41:35 +02:00
Nikolai Kochetov
0149f905de
Update MergeTreeIndexSet.cpp 2023-06-21 11:26:54 +02:00
Nikolai Kochetov
5bda0b535d Fixing build. 2023-06-20 19:45:03 +00:00
Nikolai Kochetov
e4f057e304 Fix Set index with constant nullable comparison. 2023-06-20 19:40:37 +00:00
Sema Checherinda
9b0c3359cf
Merge branch 'master' into better-log 2023-06-20 20:37:36 +02:00
Alexey Milovidov
c097e6e53d
Merge pull request #50531 from kitaisreal/jit-infrastructure-refactoring
JIT infrastructure refactoring
2023-06-20 21:13:44 +03:00
Sema Checherinda
fd292dc730 work with comment on the PR 2023-06-20 20:02:04 +02:00
Nikolai Kochetov
5a1f819e7b Fix more tests. 2023-06-20 17:33:09 +00:00
Anton Popov
31ece0c512 add test for check part with cache 2023-06-20 13:28:01 +00:00