Vitaly Baranov
5aaff60650
Fix referential dependencies when host & post in a clickHouse dictionary source are set by default.
2022-12-12 18:22:14 +01:00
Alexander Tokmakov
db7f2ed42b
Update getDictionaryConfigurationFromAST.cpp
2022-12-12 16:46:04 +03:00
Han Fei
ae91d0c78e
fix check-style
2022-12-01 13:29:55 +01:00
Han Fei
e28c98d4ba
fix macro flag
2022-12-01 11:50:18 +01:00
Han Fei
41f726ce83
fix compile
2022-11-30 11:21:45 +01:00
Yakov Olkhovskiy
77266ea754
cleanup
2022-11-29 17:34:16 +00:00
Han Fei
27ec6bc42a
Merge branch 'master' into regexp-tree-dictionary
2022-11-29 16:33:30 +01:00
Yakov Olkhovskiy
770b520ded
Merge branch 'master' into refactoring-ip-types
2022-11-28 08:50:19 -05:00
Yakov Olkhovskiy
fd58719271
IPAddressDictionary fixed, test fixed
2022-11-24 20:42:36 +00:00
Yakov Olkhovskiy
de20d58f6b
style fix
2022-11-22 21:55:07 +00:00
Yakov Olkhovskiy
2cbe748e68
functions fixed, test fixed
2022-11-22 21:34:32 +00:00
Raúl Marín
4aa29b6a63
Merge remote-tracking branch 'blessed/master' into perf_experiment
2022-11-22 19:09:00 +01:00
Yakov Olkhovskiy
4d144be39c
replace domain IP types (IPv4, IPv6) with native
2022-11-14 14:17:17 +00:00
avogar
9e89af28c6
Refactor BSONEachRow format, fix bugs, support more data types, support parallel parsing and schema inference
2022-11-10 20:15:14 +00:00
Raúl Marín
6e0a9452e7
Merge remote-tracking branch 'blessed/master' into perf_experiment
2022-10-25 15:25:06 +02:00
Azat Khuzhin
4e76629aaf
Fixes for -Wshorten-64-to-32
...
- lots of static_cast
- add safe_cast
- types adjustments
- config
- IStorage::read/watch
- ...
- some TODO's (to convert types in future)
P.S. That was quite a journey...
v2: fixes after rebase
v3: fix conflicts after #42308 merged
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-21 13:25:19 +02:00
Raúl Marín
e60415d07d
Make clang-tidy happy
2022-10-18 11:40:12 +02:00
Alexander Tokmakov
fa1134f299
Merge branch 'master' into fix_loading_dependencies
2022-10-10 16:30:52 +02:00
Alexander Tokmakov
4175f8cde6
abort instead of __builtin_unreachable in debug builds
2022-10-07 21:49:08 +02:00
Alexander Tokmakov
014784a9ca
Merge branch 'master' into fix_loading_dependencies
2022-10-07 18:58:11 +02:00
Alexander Tokmakov
690ec74bf2
better handling for expressions in dictGet
2022-10-05 20:58:27 +02:00
Robert Schulze
fd86829824
Consolidate config_core.h into config.h
...
Less duplication, less confusion ...
2022-09-28 13:31:57 +00:00
Robert Schulze
78fc36ca49
Generate config.h into ${CONFIG_INCLUDE_PATH}
...
This makes the target location consistent with other auto-generated
files like config_formats.h, config_core.h, and config_functions.h and
simplifies the build of clickhouse_common.
2022-09-28 12:48:26 +00:00
Kseniia Sumarokova
ea43cb5648
Merge pull request #41261 from kssenii/s3-header-auth
...
Support s3 authorisation headers from ast arguments
2022-09-23 12:48:08 +02:00
Alexey Milovidov
bb6f1bfce2
Fix 9/10 of trash
2022-09-19 08:53:20 +02:00
Alexey Milovidov
730655d4fd
Fix 8/9 of trash
2022-09-19 08:53:20 +02:00
Alexey Milovidov
42b0d444da
Fix 7/8 of trash
2022-09-19 08:53:20 +02:00
Alexey Milovidov
91baedf03a
Fix 6/7 of trash
2022-09-19 08:53:20 +02:00
Alexey Milovidov
84f42e0874
Fix 3/4 of trash
2022-09-19 08:50:53 +02:00
kssenii
420ac4eb43
s3 header auth in ast
2022-09-13 15:13:28 +02:00
Alexey Milovidov
fd235919aa
Remove some methods
2022-09-10 05:04:40 +02:00
kssenii
83514fa2ef
Refactor
2022-09-05 20:08:22 +02:00
Antonio Andelic
e64436fef3
Fix typos with new codespell
2022-09-02 08:54:48 +00:00
Vage Ogannisian
9b2326cc6c
Add RegExpTree dictionary
2022-08-31 19:34:50 +00:00
Alexey Milovidov
1ff535a128
One step back
2022-08-28 02:00:09 +02:00
Vage Ogannisian
540fa7fe5b
Add YAML regular expressions tree dictionary source
2022-08-24 14:01:56 +00:00
vdimir
5fea2091ac
Embed IKeyValue impl into IDictionary.h
2022-08-10 15:58:15 +00:00
vdimir
90fa2ed8c1
better code for join with dict
2022-08-10 14:20:29 +00:00
vdimir
7073067d40
check attributes for join with dict
2022-08-10 14:20:26 +00:00
Yakov Olkhovskiy
d39e9f65de
Merge branch 'master' into fix-quota-key
2022-08-08 11:54:21 -04:00
Robert Schulze
ad0d060dc1
Merge pull request #39904 from ClickHouse/library-bridge-refactoring
...
Prepare library-bridge for catboost integration
2022-08-08 12:15:01 +02:00
Nikolai Kochetov
c6e3e14bcc
Merge pull request #39184 from ClickHouse/respect-remote_url_allow_hosts-for-other-dict-sources
...
Respect remote_url_allow_hosts in relevant dictionary sources.
2022-08-05 17:25:53 +02:00
Robert Schulze
cb146ee6f1
Rename LibraryBridgeHelper to ExternalDictionaryLibraryBridgeHelper
...
- ExternalDictionaryLibraryBridgeHelper provides the server-side
interface to access the dictionary part of the library bridge.
- In a later commit, CatBoostLibraryBridgeHelper will be added to access
the catboost part of the library bridge from the server.
2022-08-04 19:58:37 +00:00
Robert Schulze
ea73b98fb9
Prepare library-bridge for catboost integration
...
- Rename generic file and identifier names in library-bridge to
something more dictionary-specific. This is needed because later on,
catboost will be integrated into library-bridge.
- Also: Some smaller fixes like typos and un-inlining non-performance
critical code.
- The logic remains unchanged in this commit.
2022-08-04 19:26:51 +00:00
Yakov Olkhovskiy
23037daf17
Merge branch 'master' into fix-quota-key
2022-08-04 12:14:49 -04:00
Yakov Olkhovskiy
2e34b384c1
update tcp protocol, add quota_key
2022-08-03 15:44:08 -04:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15
2022-08-02 13:00:55 +03:00
Alexander Tokmakov
0d68b1c67f
fix build with clang-15
2022-08-01 18:00:54 +02:00
Azat Khuzhin
3e627e2861
Add profile events for fsync
...
The following new provile events had been added:
- FileSync - Number of times the F_FULLFSYNC/fsync/fdatasync function was called for files.
- DirectorySync - Number of times the F_FULLFSYNC/fsync/fdatasync function was called for directories.
- FileSyncElapsedMicroseconds - Total time spent waiting for F_FULLFSYNC/fsync/fdatasync syscall for files.
- DirectorySyncElapsedMicroseconds - Total time spent waiting for F_FULLFSYNC/fsync/fdatasync syscall for directories.
v2: rewrite test to sh with retries
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-31 23:19:30 +03:00
mergify[bot]
e53cf7fd9f
Merge branch 'master' into direct-dictionary-dict-has-multiple-same-keys-fix
2022-07-25 11:41:58 +00:00
Alexander Tokmakov
c77117eadf
Update SSDCacheDictionaryStorage.h
2022-07-22 12:54:20 +03:00
Maksim Kita
6443116e80
DirectDictionary improve performance of dictHas with duplicate keys
2022-07-21 16:29:28 +02:00
Alexander Tokmakov
9a55f84885
Revert "Remove broken optimisation in Direct dictionary dictHas implementation"
2022-07-21 16:24:18 +03:00
Alexander Tokmakov
a8da5d96fc
remove some dead and commented code
2022-07-21 15:05:48 +02:00
James Morrison
d60a02829f
Remove broken optimisation in Direct dictionary dictHas implementation
...
I noticed this while working on another feature - if a set of keys being
passed to `hasKeys` contains duplicates, then only one of the result
slots for these keys will be populated.
My fix uses to a simpler implementation which is likely slower, but is
correct, which seems more important. No doubt faster approaches exist
which are also correct.
2022-07-20 14:45:32 +00:00
Nikolai Kochetov
8e3bc8c66d
Merge branch 'master' into respect-remote_url_allow_hosts-for-other-dict-sources
2022-07-19 12:11:17 +02:00
Robert Schulze
13482af4ee
First try at reducing the use of StringRef
...
- to be replaced by std::string_view
- suggested in #39262
2022-07-17 17:26:02 +00:00
Robert Schulze
deda29b46b
Pass const StringRef by value, not by reference
...
See #39224
2022-07-15 11:34:56 +00:00
Nikolai Kochetov
772c009f2f
Fixing build.
2022-07-14 18:44:43 +00:00
Nikolai Kochetov
5005700eee
Fixing build
2022-07-13 15:33:18 +00:00
Nikolai Kochetov
937a9e9d9f
Fixing build/
2022-07-13 15:05:49 +00:00
Nikolai Kochetov
36e34d8cc6
Respect remote_url_allow_hosts in relevant dictionary sources.
2022-07-13 14:53:23 +00:00
Nikolai Kochetov
020c99a269
Merge pull request #38617 from azat/contrib-debug-symbols
...
Add separate option to omit symbols from heavy contrib
2022-07-06 14:40:24 +02:00
kssenii
cfff7c4c28
Merge master
2022-07-04 14:13:26 +02:00
Azat Khuzhin
e8f5cd3c68
Add separate option to omit symbols from heavy contrib
...
Sometimes it is useful to build contrib with debug symbols for further
debugging.
With everything turned ON (i.e. debug build) I got 3.3GB vs 3.0GB w/o
this patch, 9% bloat, thoughts about this is this OK or not for you, if
not STRIP_DEBUG_SYMBOLS_HEAVY_CONTRIB can be OFF by default (regardless
of build type).
P.S. aws debug symbols adds just 1.7%.
v2: rename STRIP_HEAVY_DEBUG_SYMBOLS
v3: OMIT_HEAVY_DEBUG_SYMBOLS
v4: documentation had been removed
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-02 06:32:03 +03:00
Maksim Kita
95687f2d01
CacheDictionaryUpdateUnit make update state non atomic
2022-06-30 13:15:35 +02:00
Maksim Kita
f443cf66f0
CacheDictionary simplify update queue
2022-06-30 12:53:56 +02:00
Maksim Kita
09be594c81
Dictionaries added TSA annotations
2022-06-29 19:15:47 +02:00
Robert Schulze
f692ead6ad
Don't use std::unique_lock unless we have to
...
Replace where possible by std::lock_guard which is more light-weight.
2022-06-28 19:19:06 +00:00
Igor Nikonov
e41d612b1d
Cleanup: local clang-tidy warnings founded during review
2022-06-27 20:57:18 +00:00
kssenii
2c5aeaaa1a
Add auto close for postgres connection
2022-06-27 13:46:52 +02:00
Robert Schulze
5f5732a2c4
Merge pull request #37969 from ClickHouse/consistent-macro-usage
...
More consistent use of platform macros
2022-06-10 14:10:01 +02:00
Robert Schulze
1a0b5f33b3
More consistent use of platform macros
...
cmake/target.cmake defines macros for the supported platforms, this
commit changes predefined system macros to our own macros.
__linux__ --> OS_LINUX
__APPLE__ --> OS_DARWIN
__FreeBSD__ --> OS_FREEBSD
2022-06-10 10:22:31 +02:00
Maksim Kita
a9d568c63c
Dictionaries custom query with update field fix
2022-06-09 11:51:07 +02:00
Maksim Kita
4e160105b9
Merge pull request #37805 from kitaisreal/dictionaries-hierarchy-nullable-key-support
...
Hierarchical dictinaries support nullable parent key
2022-06-08 12:36:09 +02:00
Maksim Kita
3fd8294907
Fixed style check
2022-06-03 18:05:09 +02:00
Maksim Kita
6db5c08fde
Functions dictGetChildren, dictGetDescendants added support for nullable parent key
2022-06-03 17:36:16 +02:00
Maksim Kita
a0cbbd9edc
Hierarchical Cache, Direct dictionaries added support for nullable parent key
2022-06-03 17:21:55 +02:00
mergify[bot]
906182548b
Merge branch 'master' into refactor-read-metrics-and-callbacks
2022-06-02 18:30:21 +00:00
Maksim Kita
20b55a45b2
Hierarchical dictionaries support nullable parent key
2022-06-02 19:24:23 +02:00
Maksim Kita
0b40e05ffc
Merge pull request #37778 from kitaisreal/dictionaries-improve-logging-during-exception
...
Dictionaries improve exception messages
2022-06-02 19:16:07 +02:00
Nikolai Kochetov
00395e752e
Cleanup
2022-06-02 16:59:14 +00:00
Maksim Kita
cf00e5110d
Dictionaries improve exception messages
2022-06-02 11:37:28 +02:00
Nikolai Kochetov
edac3d6714
Merge branch 'master' into refactor-read-metrics-and-callbacks
2022-06-02 09:36:20 +00:00
mergify[bot]
d4e722bbfa
Merge branch 'master' into http-named-collection
2022-05-30 16:40:18 +00:00
Nikolai Kochetov
5ef51ed27b
Fix more tests.
2022-05-30 13:10:30 +00:00
Nikolai Kochetov
5b4658aa5e
Merge branch 'master' into refactor-read-metrics-and-callbacks
2022-05-30 09:47:35 +00:00
Alexey Milovidov
73e2e63414
Merge pull request #37612 from ClickHouse/clang-tidy-14
...
Fix clang-tidy-14, part 1
2022-05-29 03:16:32 +03:00
Alexey Milovidov
c50791dd3b
Fix clang-tidy-14, part 1
2022-05-27 22:52:14 +02:00
HeenaBansal2009
a061acadbe
Remove std::move from trivially-copyable object
2022-05-27 11:04:29 -07:00
Yakov Olkhovskiy
41ef0044f0
endpoint is added
2022-05-27 13:43:34 -04:00
Yakov Olkhovskiy
25884c68f1
http named collection source implemented for dictionary
2022-05-26 20:46:26 -04:00
Nikolai Kochetov
84f97b53de
Merge branch 'master' into refactor-read-metrics-and-callbacks
2022-05-26 11:07:45 +00:00
Maksim Kita
b12b363158
Fixed build of hierarchical index for HashedArrayDictionary
2022-05-25 22:40:19 +02:00
Nikolai Kochetov
1b85f2c1d6
Merge branch 'master' into refactor-read-metrics-and-callbacks
2022-05-25 16:27:40 +02:00
Maksim Kita
585b86446e
Added hierarchical_index_bytes_allocated column in system.dictionaries
2022-05-23 12:42:00 +02:00
Maksim Kita
f76e3801de
Fixed tests
2022-05-23 12:42:00 +02:00
Maksim Kita
7e4c950bd9
Fixed style check
2022-05-23 12:42:00 +02:00
Maksim Kita
25d6bd1f34
Dictionaries optimize hierarchical index structure
2022-05-23 12:42:00 +02:00
Maksim Kita
1142e05683
Dictionaries allow to specify bidirectional for hierarhical attribute
2022-05-23 12:42:00 +02:00
