Azat Khuzhin
4e76629aaf
Fixes for -Wshorten-64-to-32
...
- lots of static_cast
- add safe_cast
- types adjustments
- config
- IStorage::read/watch
- ...
- some TODO's (to convert types in future)
P.S. That was quite a journey...
v2: fixes after rebase
v3: fix conflicts after #42308 merged
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-21 13:25:19 +02:00
Azat Khuzhin
3e627e2861
Add profile events for fsync
...
The following new provile events had been added:
- FileSync - Number of times the F_FULLFSYNC/fsync/fdatasync function was called for files.
- DirectorySync - Number of times the F_FULLFSYNC/fsync/fdatasync function was called for directories.
- FileSyncElapsedMicroseconds - Total time spent waiting for F_FULLFSYNC/fsync/fdatasync syscall for files.
- DirectorySyncElapsedMicroseconds - Total time spent waiting for F_FULLFSYNC/fsync/fdatasync syscall for directories.
v2: rewrite test to sh with retries
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-31 23:19:30 +03:00
Alexander Tokmakov
c77117eadf
Update SSDCacheDictionaryStorage.h
2022-07-22 12:54:20 +03:00
Alexander Tokmakov
a8da5d96fc
remove some dead and commented code
2022-07-21 15:05:48 +02:00
Robert Schulze
1a0b5f33b3
More consistent use of platform macros
...
cmake/target.cmake defines macros for the supported platforms, this
commit changes predefined system macros to our own macros.
__linux__ --> OS_LINUX
__APPLE__ --> OS_DARWIN
__FreeBSD__ --> OS_FREEBSD
2022-06-10 10:22:31 +02:00
mreddy017
f893002b69
Fix vulnerable code related to std::move and noexcept
...
This commit fixes the vulnerable code related to std::move and noexcept identified by clangtidy tool.
2022-03-02 18:15:27 +00:00
Maksim Kita
13cbf79ecb
Improve performance of insert into table functions URL, S3, File, HDFS
2022-02-10 20:06:23 +00:00
Maksim Kita
5ef83deaa6
Update sort to pdqsort
2022-01-30 19:49:48 +00:00
Azat Khuzhin
aee034a597
Use explicit template instantiation for SystemLog
...
- Move some code into module part to avoid dependency from IStorage in SystemLog
- Remove extra headers from SystemLog.h
- Rewrite some code that was relying on headers that was included by SystemLog.h
v2: rebase
v3: squash move into module part with explicit template instantiation
(to make each commit self compilable after rebase)
2022-01-10 22:01:41 +03:00
Maksim Kita
4b4468b34a
Dictionaries use single arena for multiple string attributes
2022-01-08 13:26:11 +03:00
alexey-milovidov
cb6342025d
Merge pull request #31229 from zhanglistar/fsync
...
Change all fsync to fdatasync
2021-11-14 05:16:01 +03:00
zhanglistar
8bcef97e11
1. style check fix.
2021-11-12 17:23:22 +08:00
zhanglistar
d13256242a
1. fix sytle check
2021-11-12 16:15:39 +08:00
zhanglistar
4e7823ade7
1. add macosx fix
2021-11-12 15:49:21 +08:00
Azat Khuzhin
baf14444e6
Cleanup ProfileEvents and CurrentMetrics
2021-11-10 21:15:27 +03:00
zhanglistar
96b8df5899
1. chagne all fsync to fdatasync
2021-11-10 17:40:16 +08:00
Azat Khuzhin
50231460af
Use forward declaration for Buffer<> in generic headers
...
- changes in ReadHelpers.h -- recompiles 1000 modules
- changes in FormatFactor.h -- recompiles 100 modules
2021-10-16 12:03:24 +03:00
Alexey Milovidov
fe6b7c77c7
Rename "common" to "base"
2021-10-02 10:13:14 +03:00
Maksim Kita
b4f41bd824
Dictionaries key types refactoring
2021-08-17 20:35:43 +03:00
Mikhail Filimonov
af6249c8ec
Less include <Common/Stopwatch.h>
2021-08-11 16:20:59 +02:00
Alexey Milovidov
21fb6ddea5
Remove AIO for sequential reads
2021-07-05 23:02:24 +03:00
Maksim Kita
b26783b308
Dictionaries update file path restrictions
2021-05-27 00:17:45 +03:00
Alexey Milovidov
3025f9e141
More fixes for PVS-Studio
2021-05-08 19:12:49 +03:00
Maksim Kita
b43a709fec
Dictionaries standardize exceptions
2021-04-10 21:48:36 +03:00
Maksim Kita
bde02c72f3
Fixed typos
2021-03-23 18:14:22 +03:00
Maksim Kita
890bd6f1e9
Fixed code review issues
2021-03-23 15:14:37 +03:00
Maksim Kita
c01171c626
Fixed tests
2021-03-18 14:58:43 +03:00
Maksim Kita
18ed9c5c67
SSDCacheDictionary remove max_stored_keys option
2021-03-18 12:55:17 +03:00
Maksim Kita
f140204279
Improved performance of SSDCache dictionary
2021-03-17 22:01:45 +03:00
Maksim Kita
bc22f4f6eb
Updated implementation
2021-03-17 20:14:36 +03:00
Maksim Kita
ce20eae2a3
Added specialized CacheDictionaryStorage
2021-03-14 14:33:21 +03:00
Maksim Kita
edb673af56
Fixed tests
2021-03-09 01:03:25 +03:00
Maksim Kita
4db713103b
Fixed documentation
2021-03-06 14:38:27 +03:00
Maksim Kita
10c5518988
Fix tests
2021-03-06 14:38:27 +03:00
Maksim Kita
c314de7388
Fixed documentation
2021-03-06 14:37:56 +03:00
Maksim Kita
8ea6c4b852
Updated Dictionaries default value handling
2021-03-06 14:37:56 +03:00
Maksim Kita
a6534c3b42
Fix update position of duplicated keys in memory partition buffer
2021-03-06 14:36:37 +03:00
Maksim Kita
7602c6c6cb
Fixed sanitizers errors
2021-03-06 14:36:37 +03:00
Maksim Kita
ae88bbda5a
Updated CacheDictionary
2021-03-06 14:36:37 +03:00
Maksim Kita
ef1645b546
Fix test
2021-03-06 14:36:37 +03:00
Maksim Kita
e64b18fbac
Added dictGet with multiple requested attributes
2021-03-06 14:36:37 +03:00
Maksim Kita
ccb61064e1
Fix build issues
2021-03-06 14:36:37 +03:00
Maksim Kita
e830eb41b1
Fixed build
2021-03-06 14:36:37 +03:00
Maksim Kita
8ee89b59ec
Fixed build
2021-03-06 14:36:37 +03:00
Maksim Kita
d04e707567
Fixed special build
2021-03-06 14:36:37 +03:00
Maksim Kita
480beeda37
Fix gcc build
2021-03-06 14:36:37 +03:00
Maksim Kita
a22ec65e8a
Fixed minor issues
2021-03-06 14:36:37 +03:00
Maksim Kita
8138ced862
Fixed tests
2021-03-06 14:36:37 +03:00
Maksim Kita
980d171207
Fixed typos
2021-03-06 14:36:37 +03:00
Maksim Kita
168741c67c
SSDCacheDictionaryFileBuffer create directory for file
2021-03-06 14:36:37 +03:00
