Commit Graph

106269 Commits

Author SHA1 Message Date
Robert Schulze
fd45295ff4
Typo: "Granulesis" --> "Granules" 2023-01-25 10:49:30 +00:00
Vladimir C
cfefaebe8f
Merge pull request #45558 from ClickHouse/vdimir/remove-ast-fuse 2023-01-25 11:25:36 +01:00
Vladimir C
05022d1663
Merge pull request #45556 from ClickHouse/vdimir/test-report-log-stats-utf 2023-01-25 11:22:03 +01:00
Sergei Trifonov
0d1ea05ff6
Merge pull request #45007 from ClickHouse/cancellable-mutex-integration
Fast shared mutex integration
2023-01-25 11:15:46 +01:00
SmitaRKulkarni
b0bbe7518a
Merge pull request #45497 from ClickHouse/45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores
Updated backup/restore status when concurrent backups & restores are not allowed
2023-01-25 08:37:24 +01:00
Mikhail f. Shiryaev
da10bd3cec
Merge pull request #45588 from ClickHouse/fix-fast-test-report
Fix report sending in case of FastTest failure
2023-01-25 07:25:01 +01:00
Dan Roscigno
9e3e0ad799
Merge pull request #45594 from DanRoscigno/update-settings-url
update for split of format settings
2023-01-24 20:06:32 -05:00
Dan Roscigno
1cc3708092
Merge branch 'master' into update-settings-url 2023-01-24 19:51:39 -05:00
DanRoscigno
77ae27f26c update for split of format settings 2023-01-24 19:37:55 -05:00
Dan Roscigno
d6fe7f1b85
Merge pull request #45525 from DanRoscigno/docs-for-s3-settings
add docs for PR 33302
2023-01-24 19:25:03 -05:00
Dan Roscigno
e520bd8052
Apply suggestions from code review 2023-01-24 19:10:30 -05:00
Mikhail f. Shiryaev
4615f979d6
Update tests/ci/fast_test_check.py 2023-01-25 00:13:28 +01:00
Dan Roscigno
09a190b4fd
Merge branch 'master' into docs-for-s3-settings 2023-01-24 18:12:39 -05:00
Nikolay Degterinsky
97aef55a7f Fix typo 2023-01-24 23:00:02 +00:00
Nikolay Degterinsky
d8d85d9bbd Merge remote-tracking branch 'upstream/master' into fix-msan-build 2023-01-24 22:57:47 +00:00
Kseniia Sumarokova
2b8b1ad5d4
Additional check in MergeTreeReadPool (#45515)
* Check ranges

* Check equality just in case

* Check under ndebug
2023-01-24 23:56:26 +01:00
Dan Roscigno
dbb83dc9a4
Merge branch 'master' into docs-for-s3-settings 2023-01-24 17:55:31 -05:00
Nikolay Degterinsky
fb6838b043 Review suggestions 2023-01-24 22:54:01 +00:00
DanRoscigno
fe56967af7 fix note formatting 2023-01-24 17:44:10 -05:00
DanRoscigno
9775987ee9 add new settings for s3 and hdfs 2023-01-24 17:40:37 -05:00
DanRoscigno
f95bc55923 split Format settings out 2023-01-24 17:19:50 -05:00
Dmitry Novik
8545db9f62 Fix report sending in case of FastTest failure 2023-01-24 21:54:23 +00:00
Robert Schulze
7f010d2b61
Merge pull request #45522 from HarryLeeIBM/hlee-s390x-transform
Fix endian issue in transform function for s390x
2023-01-24 22:12:25 +01:00
Robert Schulze
d6ab376b02
Merge pull request #45586 from ClickHouse/document-datediff-week-start
Document start of week in function date_diff()
2023-01-24 21:38:00 +01:00
Robert Schulze
87ca5dcdf2
Document start of week in function date_diff() 2023-01-24 20:18:59 +00:00
Robert Schulze
8926af91f3
Merge pull request #45584 from ClickHouse/docs-mini-semicolon-fix
Docs: mini semicolon fix
2023-01-24 20:41:54 +01:00
Robert Schulze
5edea1b461
Docs: mini semicolon fix 2023-01-24 19:25:37 +00:00
Vitaly Baranov
c22b0076ce Fix cleanup in tests test_replicated_merge_tree_s3_restore. 2023-01-24 18:05:44 +01:00
Vitaly Baranov
3fc366e747 Make retries in copyS3File() more correct. 2023-01-24 18:05:40 +01:00
vdimir
bf15c498e1
Remove tests with optimize_fuse_sum_count_avg 2023-01-24 16:20:15 +00:00
robot-ch-test-poll1
0dab6f0208
Merge pull request #45573 from ClickHouse/update-docs-for-insert-delay
Update formula for INSERT delay
2023-01-24 17:07:46 +01:00
Igor Nikonov
e585a1228f
Update docs/en/operations/settings/merge-tree-settings.md
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-01-24 16:52:32 +01:00
Kruglov Pavel
689fbea759
Merge pull request #45478 from Avogar/fix-arrow-abort
Fix possible aborts in arrow lib
2023-01-24 16:37:44 +01:00
Smita Kulkarni
6be7d1c24a Addressed review comments and renamed function to hasConcurrentBackups/Restores - Updated backup/restore status when concurrent backups & restores are not allowed 2023-01-24 16:20:12 +01:00
avogar
07ad750366 Fix tests 2023-01-24 15:08:19 +00:00
Alexander Tokmakov
d187215d53 fix 2023-01-24 16:04:37 +01:00
vdimir
0e09d0a00c
Remove FuseSumCountAggregatesVisitor 2023-01-24 14:58:26 +00:00
Vitaly Baranov
7d72b28bfe Use ProfileEvents::S3CopyObject again. 2023-01-24 15:54:15 +01:00
Igor Nikonov
21b009fdec
Update merge-tree-settings.md 2023-01-24 15:45:21 +01:00
Kseniia Sumarokova
dd18dd2953
Merge pull request #45341 from ClibMouse/feature/non-throwing-hastoken
Introduce non-throwing variants of hasToken
2023-01-24 15:37:36 +01:00
serxa
51da43d6cf fix try_shared_lock() in SharedMutex and CancelableSharedMutex 2023-01-24 14:36:07 +00:00
Kruglov Pavel
4bd3f0e5ef
Merge pull request #44953 from Avogar/tsv-csv-detect-header
Detect header in CSV/TSV/CustomSeparated files automatically
2023-01-24 15:13:52 +01:00
Alexander Tokmakov
cd8c3bbcc5 fix 2023-01-24 14:36:30 +01:00
Igor Nikonov
683b1b7dbb
Merge pull request #45420 from ClickHouse/revert-45414-revert-43905-igor/remove_redundant_order_by
Revert "Revert "Remove redundant sorting""
2023-01-24 14:31:28 +01:00
Alexander Tokmakov
42a976fe3d Revert "Revert "Merge pull request #45493 from azat/fix-detach""
This reverts commit 9dc4f02d15.
2023-01-24 14:15:51 +01:00
Azat Khuzhin
54ef885a61 Fsync all small files at once after mutation
Everything else is handled in MergedBlockOutputStream::finalizePart()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-24 14:08:37 +01:00
Azat Khuzhin
4b775ccdd5 Do fsync all files at once for fetched parts to decrease latency
For filessystems like ext4, fsync of one file will handle all operations
before, so this can be pretty time consuming.

And in case of you write multiple files in a loop, and at the end of
each iteration sync each file, then during writing of this file there
can be other operations in journal, and hence more work for fsync.

Let's call fsync for all files at once instead, like
MergedBlockOutputStream does.

Hope that keeping all file buffers till the end, will not cause troubles
(buffering and so forth).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-24 14:08:37 +01:00
Azat Khuzhin
b370e3faa5 Move fsync inside transaction callback in DataPartStorageOnDisk::rename()
Otherwise, it is useless.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-24 14:08:37 +01:00
SmitaRKulkarni
d387835774
Merge branch 'master' into 45486_Fix_flaky_test_for_disallowing_concurrent_backups_restores 2023-01-24 13:49:32 +01:00
DanRoscigno
72b1a65984 WIP 2023-01-24 07:45:59 -05:00