Commit Graph

106215 Commits

Author SHA1 Message Date
Vitaly Baranov
c22b0076ce Fix cleanup in tests test_replicated_merge_tree_s3_restore. 2023-01-24 18:05:44 +01:00
Vitaly Baranov
3fc366e747 Make retries in copyS3File() more correct. 2023-01-24 18:05:40 +01:00
vdimir
bf15c498e1
Remove tests with optimize_fuse_sum_count_avg 2023-01-24 16:20:15 +00:00
robot-ch-test-poll1
0dab6f0208
Merge pull request #45573 from ClickHouse/update-docs-for-insert-delay
Update formula for INSERT delay
2023-01-24 17:07:46 +01:00
Igor Nikonov
e585a1228f
Update docs/en/operations/settings/merge-tree-settings.md
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-01-24 16:52:32 +01:00
Kruglov Pavel
689fbea759
Merge pull request #45478 from Avogar/fix-arrow-abort
Fix possible aborts in arrow lib
2023-01-24 16:37:44 +01:00
Smita Kulkarni
6be7d1c24a Addressed review comments and renamed function to hasConcurrentBackups/Restores - Updated backup/restore status when concurrent backups & restores are not allowed 2023-01-24 16:20:12 +01:00
avogar
07ad750366 Fix tests 2023-01-24 15:08:19 +00:00
Alexander Tokmakov
d187215d53 fix 2023-01-24 16:04:37 +01:00
vdimir
0e09d0a00c
Remove FuseSumCountAggregatesVisitor 2023-01-24 14:58:26 +00:00
Vitaly Baranov
7d72b28bfe Use ProfileEvents::S3CopyObject again. 2023-01-24 15:54:15 +01:00
Igor Nikonov
21b009fdec
Update merge-tree-settings.md 2023-01-24 15:45:21 +01:00
Kseniia Sumarokova
dd18dd2953
Merge pull request #45341 from ClibMouse/feature/non-throwing-hastoken
Introduce non-throwing variants of hasToken
2023-01-24 15:37:36 +01:00
serxa
51da43d6cf fix try_shared_lock() in SharedMutex and CancelableSharedMutex 2023-01-24 14:36:07 +00:00
Kruglov Pavel
4bd3f0e5ef
Merge pull request #44953 from Avogar/tsv-csv-detect-header
Detect header in CSV/TSV/CustomSeparated files automatically
2023-01-24 15:13:52 +01:00
Alexander Tokmakov
cd8c3bbcc5 fix 2023-01-24 14:36:30 +01:00
Igor Nikonov
683b1b7dbb
Merge pull request #45420 from ClickHouse/revert-45414-revert-43905-igor/remove_redundant_order_by
Revert "Revert "Remove redundant sorting""
2023-01-24 14:31:28 +01:00
Alexander Tokmakov
42a976fe3d Revert "Revert "Merge pull request #45493 from azat/fix-detach""
This reverts commit 9dc4f02d15.
2023-01-24 14:15:51 +01:00
Azat Khuzhin
54ef885a61 Fsync all small files at once after mutation
Everything else is handled in MergedBlockOutputStream::finalizePart()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-24 14:08:37 +01:00
Azat Khuzhin
4b775ccdd5 Do fsync all files at once for fetched parts to decrease latency
For filessystems like ext4, fsync of one file will handle all operations
before, so this can be pretty time consuming.

And in case of you write multiple files in a loop, and at the end of
each iteration sync each file, then during writing of this file there
can be other operations in journal, and hence more work for fsync.

Let's call fsync for all files at once instead, like
MergedBlockOutputStream does.

Hope that keeping all file buffers till the end, will not cause troubles
(buffering and so forth).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-24 14:08:37 +01:00
Azat Khuzhin
b370e3faa5 Move fsync inside transaction callback in DataPartStorageOnDisk::rename()
Otherwise, it is useless.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-24 14:08:37 +01:00
SmitaRKulkarni
d387835774
Merge branch 'master' into 45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores 2023-01-24 13:49:32 +01:00
DanRoscigno
72b1a65984 WIP 2023-01-24 07:45:59 -05:00
vdimir
d8d3da951e
Ignore utf errors in clickhouse-test reportLogStats 2023-01-24 12:30:19 +00:00
Vladimir C
f818e3070d
Merge pull request #45391 from ClickHouse/vdimir/join_prewhere_bug_44062 2023-01-24 13:23:31 +01:00
Alexander Tokmakov
c25e5ff8de
Merge pull request #45545 from ClickHouse/revert_45439
Revert "Merge pull request #45493 from azat/fix-detach"
2023-01-24 15:21:33 +03:00
Mikhail f. Shiryaev
b8474fd17f
Merge pull request #45466 from ClickHouse/cherrypick-search
CherryPick: Fix a wrong staring search date
2023-01-24 13:20:16 +01:00
Mikhail f. Shiryaev
d32a564ff0
Merge pull request #45421 from ClickHouse/chrm-releases
Get rid of artifactory in favor of r2 + ch-repos-manager
2023-01-24 13:17:48 +01:00
Nikolai Kochetov
e4c0608a01
Merge pull request #45150 from ClickHouse/fix-ip-function-mod
Binary arithmetic for IPv4
2023-01-24 13:11:02 +01:00
Vladimir C
0403f801a8
Merge pull request #44238 from ClickHouse/vdimir/grace_join_mem 2023-01-24 13:02:11 +01:00
Maksim Kita
2f1092e6d2
Merge pull request #45425 from ClickHouse/fix-ipv6-parser
Fix ipv6 parser
2023-01-24 14:59:47 +03:00
Igor Nikonov
7108189b45 Merge remote-tracking branch 'origin/master' into revert-45414-revert-43905-igor/remove_redundant_order_by 2023-01-24 11:46:24 +00:00
Igor Nikonov
ba5fff2a8a Disable the optimization to avoid sort.xml perf test fail in other PRs 2023-01-24 11:42:56 +00:00
Alexander Tokmakov
00b3376a9d
Merge pull request #45516 from ClickHouse/tavplubix-patch-2
Update test_system_merges/test.py
2023-01-24 14:37:52 +03:00
Alexander Tokmakov
bfd2ee1918
Update stress 2023-01-24 14:36:29 +03:00
Alexander Tokmakov
9dc4f02d15 Revert "Merge pull request #45493 from azat/fix-detach"
This reverts commit a182a6b851, reversing
changes made to c47a29a089.
2023-01-24 12:20:37 +01:00
Kseniia Sumarokova
ac1e7264fd
Merge pull request #45528 from ClickHouse/add-distinct-to-intersect
Add DISTINCT to INTERSECT and EXCEPT docs
2023-01-24 11:14:32 +01:00
Robert Schulze
9ff2bfcbf5
Merge remote-tracking branch 'origin/master' into inv-index-cleanup
src/Interpreters/GinFilter.cpp
	src/Interpreters/InterpreterCreateQuery.cpp
	src/Storages/MergeTree/MergeTreeData.cpp
	src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp
	src/Storages/MergeTree/MergeTreeIndexInverted.cpp
2023-01-24 10:09:42 +00:00
Alexey Milovidov
43eac58e62
Merge pull request #45430 from ClickHouse/tavplubix-patch-1
Disable parallel quorum inserts with deprecated *MergeTree syntax
2023-01-24 13:04:48 +03:00
Alexey Milovidov
dda6a69f9a
Merge branch 'master' into tavplubix-patch-1 2023-01-24 13:04:25 +03:00
Alexey Milovidov
54bc501d39
Update StorageReplicatedMergeTree.cpp 2023-01-24 13:03:28 +03:00
Alexey Milovidov
851f6bf910
Merge pull request #45448 from azat/fix-query-hang
Fix possible (likely distributed) query hung
2023-01-24 13:00:37 +03:00
Alexey Milovidov
116a7edf25
Merge pull request #45504 from ClickHouse/teepopen-timeout
Improve logging for TeePopen.timeout exceeded
2023-01-24 12:53:44 +03:00
Alexey Milovidov
cb1e8afda6
Merge pull request #45524 from kssenii/fix-cache-policies-getter
Add proper default to cache policy getter
2023-01-24 12:46:33 +03:00
Alexey Milovidov
e5ea600902
Merge pull request #45526 from ClickHouse/rfraposa-patch-2
Update link to Protobuf website in formats.md
2023-01-24 12:44:56 +03:00
Smita Kulkarni
642f9ca549 Merge branch 'master' into 45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores 2023-01-24 09:37:28 +01:00
Smita Kulkarni
9ae5ac2388 Moved concurrency checks inside functions - Updated backup/restore status when concurrent backups & restores are not allowed 2023-01-24 09:31:51 +01:00
avogar
3c5a81f9f9 Add unit test for recursive checkpoints 2023-01-24 01:20:13 +00:00
ltrk2
ee5818f27b Fix the build with ENABLE_VECTORSCAN disabled 2023-01-23 16:43:03 -08:00
rfraposa
33770303a0 Add DISTINCT to INTERSECT and EXCEPT 2023-01-23 17:10:30 -07:00