Commit Graph

462 Commits

Author SHA1 Message Date
Nikolai Kochetov
d2710bd0f4 added system.models [#CLICKHOUSE-3477] 2017-12-04 16:32:49 +03:00
Roman Lipovsky
c18934f454 separate format readers from files, move readers to separate headers 2017-12-04 15:30:21 +03:00
Alexey Milovidov
acd78e4891 Better [#CLICKHOUSE-2]. 2017-12-02 00:13:25 +03:00
Alexey Milovidov
431da20d99 Better [#CLICKHOUSE-2]. 2017-12-01 23:21:35 +03:00
Roman Lipovsky
db0fc481d7 do not rely on total size estimation from data source 2017-11-29 15:45:17 +03:00
Roman Lipovsky
845b4e0cac use types from Dictionaries/Embedded/GeodataProviders/Types.h 2017-11-29 01:27:32 +03:00
Roman Lipovsky
e37b13dfef update comment 2017-11-29 01:18:38 +03:00
Roman Lipovsky
9ed1ba2441 separate geo dictionaries from geo data providers 2017-11-29 01:15:06 +03:00
alexey-milovidov
2ab73565b2
Fixed terrible translation. 2017-11-28 19:30:24 +03:00
Alexey Milovidov
7e5bab971d Fixed build [#CLICKHOUSE-2]. 2017-11-27 22:12:18 +03:00
alexey-milovidov
5dd7279e15 Update DictionarySourceFactory.cpp 2017-11-27 22:08:40 +03:00
alexey-milovidov
d6766a8ef4 Update DictionarySourceFactory.h 2017-11-27 22:08:40 +03:00
alexey-milovidov
1a28e785af Update DictionarySourceFactory.cpp 2017-11-27 22:08:40 +03:00
Roman Lipovsky
b218dfab1c [clickhouse-yt] support external dictionaries registration in DictionarySourceFactory 2017-11-27 22:08:40 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
Alexey Milovidov
c0c3f3115e RegionsHierarchy: read hidden regions [#CLICKHOUSE-3427]. 2017-11-16 21:50:01 +03:00
Alexey Milovidov
5ef829c5f3 RegionsHierarchy: minor modification [#CLICKHOUSE-3427]. 2017-11-16 21:47:59 +03:00
Alexey Milovidov
edcbf791fb Miscellaneous [#CLICKHOUSE-2]. 2017-11-16 20:40:54 +03:00
Иванов Евгений
48636ac601 Added support UUID type for dictionaries 2017-11-15 23:31:53 +03:00
Nikolai Kochetov
554bb889ac merged with master 2017-10-31 15:04:13 +03:00
Nikolai Kochetov
18ef139e9d load features count from catboost model file [#CLICKHOUSE-3305] 2017-10-31 14:50:24 +03:00
Nikolai Kochetov
cec9f90e1e added optional features count validation [#CLICKHOUSE-3305] 2017-10-31 14:50:13 +03:00
Nikolai Kochetov
e6d8c7bf31 changed boost::dll to SharedLibrary; removed boost::dll [#CLICKHOUSE-3305] 2017-10-31 14:50:03 +03:00
alexey-milovidov
56ef2e9196
Merge pull request #1380 from yandex/catboost-models
Catboost models
2017-10-30 19:16:41 +03:00
Nikolai Kochetov
8f84d51a5d added optional features count validation [#CLICKHOUSE-3305] 2017-10-27 15:23:26 +03:00
Nikolai Kochetov
fea2bed3da added optional features count validation [#CLICKHOUSE-3305] 2017-10-27 11:39:54 +03:00
Nikolai Kochetov
9c3c3231f4 added optional features count validation [#CLICKHOUSE-3305] 2017-10-26 23:12:40 +03:00
Nikolai Kochetov
0d356f9a6a fix build [#CLICKHOUSE-3305] 2017-10-26 22:14:25 +03:00
Nikolai Kochetov
46dfa7bf8d changed boost::dll to SharedLibrary; removed boost::dll [#CLICKHOUSE-3305] 2017-10-26 22:00:27 +03:00
Nikolai Kochetov
3757c9682e style fixes [#CLICKHOUSE-3305] 2017-10-26 21:49:23 +03:00
Alexey Milovidov
a27981b4ef Get rid of double whitespaces [#CLICKHOUSE-2]. 2017-10-26 21:36:23 +03:00
Nikolai Kochetov
4204a94b20 changed CatBoost model evaluate signature [#CLICKHOUSE-3305] 2017-10-26 17:08:05 +03:00
Nikolai Kochetov
2e6b1dfd92 renamed cloneObject to clone in IExternalLoadable [#CLICKHOUSE-3305] 2017-10-26 16:42:14 +03:00
Nikolai Kochetov
c3d104f53b changed IDictionary clone [#CLICKHOUSE-3305] 2017-10-26 16:41:51 +03:00
Nikolai Kochetov
fd8eb13dcc refactoring [#CLICKHOUSE-3305] 2017-10-26 15:18:37 +03:00
proller
82134e44cb Split ComplexKeyCacheDictionary to faster compile (part2) 2017-10-24 00:26:42 +03:00
Nikolai Kochetov
74a4c7508a merged with master 2017-10-20 19:18:09 +03:00
Nikolai Kochetov
d5d53da01b added comments [#CLICKHOUSE-3305] 2017-10-20 19:13:35 +03:00
Nikolai Kochetov
4efee71114 fix hash index in CatBoostModel [#CLICKHOUSE-3305]
fix hash index in CatBoostModel [#CLICKHOUSE-3305]

fix hash index in CatBoostModel [#CLICKHOUSE-3305]

fix hash index in CatBoostModel [#CLICKHOUSE-3305]

fix string features in CatBoostModel [#CLICKHOUSE-3305]
2017-10-20 19:13:32 +03:00
Nikolai Kochetov
9384bfdc28 fix invalid catboost model handle [#CLICKHOUSE-3305] 2017-10-20 19:13:29 +03:00
Nikolai Kochetov
fdf258f8ed added ExternalModels to Context [#CLICKHOUSE-3305]
fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]
2017-10-20 19:13:25 +03:00
Nikolai Kochetov
ff088b4a1d modified CatBoostModel [#CLICKHOUSE-3305] 2017-10-20 19:13:21 +03:00
Nikolai Kochetov
e817de7e21 added CatBoostModel [#CLICKHOUSE-3305] 2017-10-20 19:13:21 +03:00
Nikolai Kochetov
24fc661f00 added boost::dll [#CLICKHOUSE-3305] 2017-10-20 19:13:19 +03:00
Nikolai Kochetov
99e9c0c486 fix build [#CLICKHOUSE-3305]
fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]
2017-10-20 18:45:16 +03:00
Marek Vavruša
2ac5a743cc dbms: fix build with OS X built-in clang
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:

```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
                    res.insert({elem.column, elem.type, rename[i].value()});
                                                        ~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
    value_type& value()
                ^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
    constexpr value_type const& value() const
```
2017-10-13 18:12:29 -07:00
Alexey Milovidov
54eb2bbb0a Miscellaneous changes after merge [#CLICKHOUSE-2]. 2017-10-12 22:40:42 +03:00
alexey-milovidov
c2647e0c60 Update ExecutableDictionarySource.cpp 2017-10-12 22:36:27 +03:00
alexey-milovidov
beb93bb9d6 Update ExecutableDictionarySource.cpp 2017-10-12 22:36:27 +03:00
proller
4969038865 test me 2017-10-12 22:36:27 +03:00
proller
1505ad6bac Executable dictionaries: fail if program returns non zero exit code (#CLICKHOUSE-3171) 2017-10-12 22:36:27 +03:00
Nikolai Kochetov
61bef2adf1 added ExternalLoader [#CLICKHOUSE-3305] 2017-10-06 13:31:06 +03:00
Alexey Milovidov
86c46ad1bd Unification [#CLICKHOUSE-2]. 2017-09-15 15:16:12 +03:00
Alexey Milovidov
cfd4120f4a Fixed build with increased inline-depth in clang [#CLICKHOUSE-2]. 2017-09-15 14:08:39 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
proller
cb70a5a77c Try fix macos build (#1221)
* Try fix macos build

* Try fix macos build
2017-09-09 03:40:21 +03:00
proller
fce8416797 Try fix macos build 2017-09-08 21:25:22 +03:00
Alexey Milovidov
d29c77adea Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301]. 2017-09-08 06:47:27 +03:00
proller
5a87ebf262 Try fix macos build 2017-09-08 00:35:55 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Vadim Skipin
4017622ffb CLICKHOUSE-3289: Do not use Application singleton 2017-09-07 20:55:33 +03:00
proller
7142e43be6 Fix compile 32bit 2017-09-06 22:28:04 +03:00
proller
7c2327f3c8 LibraryDictionarySource: fix compile on macos and 32bit 2017-09-06 22:28:04 +03:00
proller
0e4d49570b LibraryDictionarySource fixes 2017-09-05 20:14:46 +03:00
proller
2a7813049e LibDictionarySource : First lib dictionary version with only uint64 type support (#1150)
* Wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Config: Allow multiple dictionaries_config

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* wip

* clean

* clean

* wip

* clean

* clean

* wip

* wip

* clean

* clean

* clean

* clean

* clean

* Requested changes

* Reqested changes

* Requested changes

* Requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* fix

* Requested changes

* Requested changes

* fix

* Requested changes

* Requested changes
2017-09-05 04:08:26 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175)
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
2017-09-01 20:21:03 +03:00
Vadim Skipin
4dc36893d3 Keep config in context to avoid Application singleton usages 2017-08-28 22:19:06 +03:00
Marek Vavruša
5ba535f05f Dictionaries: remove duplicate MySQLDictionarySource.h include
refs #1110
2017-08-17 01:35:19 +03:00
Alexey Zatelepin
3f3b7f61e2 always send changed settings for remote connections [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
alexey-milovidov
b01f0c6d13 Update CacheDictionary.cpp 2017-08-10 06:29:06 +03:00
proller
4cda5b4470 Fix result 2017-08-10 06:29:06 +03:00
proller
6ca798a357 Fix infinite loop in dictGetHierarchy if id chain looped 2017-08-10 06:29:06 +03:00
Alexey Milovidov
6578fb2645 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:39:24 +03:00
Alexey Milovidov
4c89570988 Don't limit the size of internal queries (this is for cache dictionaries with ClickHouse source) [#CLICKHOUSE-2]. 2017-07-28 21:43:40 +03:00
Alexey Milovidov
dd1f54bce2 Changed Poco::RWLock to std::shared_lock [#APRILDEV-91]. 2017-07-28 20:34:02 +03:00
Alexey Milovidov
e4af70149f Fixed build [#CLICKHOUSE-2]. 2017-07-28 00:27:10 +03:00
proller
9eb6e5b19c clang-format of Split ComplexKeyCacheDictionary (#1035)
* clnag-format of Split ComplexKeyCacheDictionary

* Requested changes
2017-07-27 23:39:40 +03:00
proller
3dbde50daa Split ComplexKeyCacheDictionary to use less then 1.5G ram when compile (#1034)
* Split FunctionsArithmetic.cpp to generated functions

* Use ccache if found

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* check_include.sh: print memory usage

* Try split CacheDictionary source

* Split ok

* wip

* wip

* wip

* wip

* wip

* wip
2017-07-27 22:05:55 +03:00
Alexey Milovidov
366ad1595e Fixed warning on clang 6 [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
alexey-milovidov
d4d266fa18 ColumnConst unification (#1011)
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Alexey Zatelepin
5e61a56743 always initialize trie ptr (just in case) [#CLICKHOUSE-3087] 2017-07-12 16:35:05 +03:00
Alexey Zatelepin
4d4387f1c8 fix reloading of TrieDictionary [#CLICKHOUSE-3087] 2017-07-12 16:35:05 +03:00
Alexey Milovidov
86eb4d2d06 Renamed Singleton to avoid conflicts with Arcadia* codebase [#DEVTOOLS-3343].
* - "Arcadia" is the name of Yandex's monorepo.
2017-07-10 07:34:14 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921)
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
2017-06-23 23:22:35 +03:00
proller
8ef51bf19b Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers (#905)
* Fix missing includes

* ComplexKeyCacheDictionary: Move includes to .cpp

* Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers

* Multiplatform memory size getter

* Requested changes

* Requested changes

* Requested changes

* fix

* Requested changes
2017-06-22 18:57:37 +03:00
Vitaliy Lyudvichenko
a098fb170a Avoid creating multiple global Context. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
proller
4c7dd6ff8b Freebsd and macos fixes 2017-06-15 22:39:35 +03:00
Nikolai Kochetov
221c05402f fixed bytes_allocated counter for cache dictionaries 2017-06-15 20:31:48 +03:00
Alexey Milovidov
a73790f17d Less dependencies [#CLICKHOUSE-2]. 2017-06-13 08:14:24 +03:00
Alexey Milovidov
a782f81f8f Moved common code from Functions; fixed build after merge [#CLICKHOUSE-2]. 2017-06-13 07:45:30 +03:00
Nikolai Kochetov
2f7f9a328e changed ComplexKeyCacheDictionary key serialization 2017-06-08 20:51:46 +03:00
Nikolai Kochetov
679cccc52d renamed *.hpp to *.h in DictionaryBlickInputStream 2017-06-08 16:35:35 +03:00
Nikolai Kochetov
bff77d1bae merged with master 2017-06-08 15:00:11 +03:00
Alexey Milovidov
9c5ddce06d Get rid of .hpp files [#CLICKHOUSE-2]. 2017-06-06 20:18:32 +03:00
Nikolai Kochetov
04e1a23d1a removed IBlockInputStream.h from IDictionary.h 2017-06-05 13:01:47 +03:00
Nikolai Kochetov
bbd6a1f238 added DictionaryBlockInpustStream support for TrieDictionary 2017-06-05 12:02:05 +03:00
Nikolai Kochetov
334fa11d12 deleted IBlickInputStream.h include form IDictionary.h 2017-05-31 12:05:44 +03:00
Nikolai Kochetov
38e9e837c5 style fixes 2017-05-30 18:02:44 +03:00
Nikolai Kochetov
7c736b12ef added raw serialization functions for IColumn; changed key serialization in ComplexKeyCacheDictionary; style fixes 2017-05-29 20:26:45 +03:00
Nikolai Kochetov
787bf12572 merged with master 2017-05-29 20:23:14 +03:00
Nikolai Kochetov
5fb5397941 added max_block_size for DictionaryBlockImputStreamBase 2017-05-26 19:08:56 +03:00
Alexey Milovidov
c8ccbd56c0 More correct wording [#CLICKHOUSE-3039]. 2017-05-26 00:00:04 +03:00
Alexey Milovidov
d35a586af2 Fixed deadlock when using executable dictionary source with cache or complex_key_cache layout [#CLICKHOUSE-3039]. 2017-05-25 23:59:14 +03:00
Alexey Milovidov
ccce305d73 Fixed totally wrong code [#CLICKHOUSE-3039]. 2017-05-25 23:17:23 +03:00
Alexey Milovidov
f448c9690c Little better [#CLICKHOUSE-3039]. 2017-05-25 23:09:48 +03:00
Alexey Milovidov
e05547f4f8 Little better [#CLICKHOUSE-3039]. 2017-05-25 22:52:05 +03:00
Alexey Milovidov
7a5c0a3cc2 Style [#CLICKHOUSE-3039]. 2017-05-25 22:36:03 +03:00
Alexey Milovidov
22a0da824f Fixed bad code (again) [#CLICKHOUSE-3039]. 2017-05-25 22:27:23 +03:00
Alexey Milovidov
6f5dcb1d84 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 22:26:17 +03:00
Alexey Milovidov
4fd2714a74 Fixed bad code [#CLICKHOUSE-3039]. 2017-05-25 22:21:57 +03:00
Alexey Milovidov
fedd829803 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 21:24:47 +03:00
Alexey Milovidov
91f9009cc4 Fixed build [#CLICKHOUSE-2955]. 2017-05-24 01:34:52 +03:00
Alexey Milovidov
c24f4c57af Style; removed useless catch [#CLICKHOUSE-2955]. 2017-05-23 19:36:07 +03:00
Nikolai Kochetov
db3fbd91b7 added readInvalidateQuery 2017-05-22 19:46:14 +03:00
Nikolai Kochetov
86e63d2bba added readInvalidateQuery for uniform reading from BlockInputStream 2017-05-22 19:38:24 +03:00
Nikolai Kochetov
df087a2e98 merged with master 2017-05-16 13:06:45 +03:00
Nikolai Kochetov
16256503ec merged with master 2017-05-16 13:03:06 +03:00
Nikolai Kochetov
7398062010 added undate by invalidate_query for MySql and ODBC dictionary sources 2017-05-15 17:16:10 +03:00
Marek Vavruša
9520234365 Dictionaries/TrieDictionary: IP prefix dictionary
This commit implements a basic IP prefix dictionary
that allows storing IPv4/IPv6 prefixes and
matching them against a single IP address on query
time. This allows for doing IP -> ASN matching and
other similar things on query time.

The implementation is basic for start, using a
simple bitwise trie and reusing interface for
complex key dictionaries (so using tuple instead
of UInt32/FixedString(16) as the key). A faster
bitwise trie implementation (like poptrie) is
desired to improve lookup performance and
memory consumption with large prefix tables.
2017-05-15 10:51:03 +04:00
Dmitry Bilunov
0c72259c3c mongodb: Avoid compiling DB::authenticate() function unless it is needed 2017-05-05 17:02:34 -07:00
Nikolai Kochetov
1604ce138a changed key storage format for complex key dictionaries 2017-05-04 21:14:23 +03:00
Vitaliy Lyudvichenko
d504c5454a Resolves #750. Allow to load more than 16 external dictionaries. [#CLICKHOUSE-3] 2017-05-03 21:04:58 -07:00
Nikolai Kochetov
79564054a9 added RangeDictionaryBlockInputStream 2017-04-28 21:33:31 +03:00
Nikolai Kochetov
9243439e9b added DictionaryBlockInputStream 2017-04-27 20:16:24 +03:00
Alexey Zatelepin
ba254a082e Merge branch 'master' into lagging-replicas-failover
Conflicts:
	dbms/src/Core/ErrorCodes.cpp
2017-04-19 21:31:29 +03:00
Alexey Zatelepin
485c58b039 use only ConnectionPoolWithFailover in RemoteBlockInputStream [#CLICKHOUSE-2141] 2017-04-19 20:50:17 +03:00
alexey-milovidov
c9c8c8ec50 Better option to disable mysqlclient (#710)
* Better support for disabling libmysqlclient [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-04-19 03:25:57 +03:00
f1yegor
b51c6e7592 translate comments 2017-04-17 15:35:21 +03:00
Alexey Milovidov
41e97787e3 Less dependencies [#CLICKHOUSE-2]. 2017-04-16 08:40:17 +03:00
proller
38e9254d33 fix http methods for ReadWriteBufferFromHTTP (#675) 2017-04-11 17:13:19 +03:00
Alexey Milovidov
a0b9bf5e97 Moved code to cpp [#CLICKHOUSE-2]. 2017-04-08 04:32:05 +03:00
Alexey Milovidov
ab314a47bf Moved headers and sources to same place (part 2) [#CLICKHOUSE-3]. 2017-04-01 13:08:56 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Igor
a5937ed024 Incriment max_size in Dictionaries:RegionsNames & RegionsHierarchy up to 15M 2017-03-30 14:44:30 +03:00
proller
8a9d9dddb4 Allow build with poco with disabled MongoDB or DataODBC or NetSSL (#636)
* partial poco support

* fix

* fix optional ssl

* servier without netssl

* fix link order

* testme

* requested changes

* throw on https listen, shutdown tip
2017-03-28 23:30:57 +03:00
Alexey Milovidov
14c8003081 Normalized formatting [#CLICKHOUSE-3].
Apply in a loop:
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '^(\t*)    ' | xargs sed -i -r -e 's/^(\t*)    /\1\t/'
2017-03-26 04:28:07 +03:00
Alexey Milovidov
edd405ef29 Merge branch 'docs/translate' of https://github.com/f1yegor/ClickHouse into f1yegor-docs/translate 2017-03-26 04:17:58 +03:00
Alexey Milovidov
e6ba252507 Hierarchical dictionaries performance: continued [#CLICKHOUSE-2144]. 2017-03-26 03:42:01 +03:00
Alexey Milovidov
d4992da546 Implemented isIn methods for cache dictionaries [#CLICKHOUSE-2144]. 2017-03-26 02:42:04 +03:00
f1yegor
bc0d9a2cae translate comments 2017-03-25 21:12:56 +01:00
Alexey Milovidov
9e7813686e Merge branch 'master' into hierarchical-dictionaries-performance 2017-03-25 20:53:41 +03:00
alexey-milovidov
6d5bfc8c6f Refactoring of numeric DataTypes (#581)
* Better code [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-03-12 14:13:45 +04:00
proller
1af6311a99 https server (#561)
* https support in dictionaries

* Style

* Update README.md

* https server wip

* wip

* cf

* wip

* add test

* wip

* wip

* wip

* wip

* clean

* cmt
2017-03-07 23:01:37 +04:00
proller
57c336f267 HTTPDictionarySource support HTTPS (#510)
* https support in dictionaries

* Style
2017-02-28 01:07:57 +04:00
proller
1c1b6ce9f5 Mongo: support new sha1 auth with new external poco 1.7.8 (#518)
* Mongo: support new sha1 auth with new external poco 1.7.8

* add test

* disable test
2017-02-21 23:24:02 +04:00
proller
7df722d731 Speedup of CacheDictionary (part2: complex) [#CLICKHOUSE-2176] (#502)
* Auto version update to [54146]

* Fixing dictionaries [#CLICKHOUSE-2176]

* fix

* Auto version update to [54194]

* Revert "Auto version update to [54194]"

This reverts commit 3367678a04.

* wip

* wip

* clean

* const

* fix

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* Fixing dictionaries [#CLICKHOUSE-2176]

* style

* style

* style

* wip

* wip

* struct

* clean

* clean

* clean

* wip

* wip broken

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* clean

* space

* tester

* wip

* fix

* clean

* style
2017-02-18 00:37:03 +04:00
proller
2ec141d5e9 Speedup of CacheDictionary (part1) [#CLICKHOUSE-2176] (#474)
* Auto version update to [54146]

* Fixing dictionaries [#CLICKHOUSE-2176]

* fix

* Auto version update to [54194]

* Revert "Auto version update to [54194]"

This reverts commit 3367678a04.

* wip

* wip

* clean

* const

* fix

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* Fixing dictionaries [#CLICKHOUSE-2176]

* style

* style

* style

* struct

* clean

* clean

* clean
2017-02-14 22:06:21 +04:00
proller
f8d2f19280 Fix odbc include, clang-format fixes, misc (#484)
* Cmake: fix fallback to internal libs if no external found

* wip

* style

* fix
2017-02-13 17:59:34 +04:00
Pavel Kartavyy
b28f41250c RegionNames: add ability to set directory without config 2017-02-08 20:39:20 +03:00
Pavel Kartavyy
fb5ff00c4a RegionsHierarchies add missed ctor for tests 2017-02-07 15:25:18 +03:00
proller
7b397b89cd Add missing counters [#CLICKHOUSE-2197] (#439)
* Add missing counters [#CLICKHOUSE-2197]

* ../../tests/external_dictionaries/generate_and_test.py : allow not break tests when one type fail
2017-02-02 22:11:00 +04:00
proller
b8f1ea4805 Fix reloading http dictionaries [#CLICKHOUSE-2176] (#433)
* Fixing dictionaries [#CLICKHOUSE-2176]
2017-02-01 20:53:18 +03:00
artpaul
5c1d2af4d8 check keys inside attribute section of dictionary's config [#CLICKHOUSE-2044] 2017-01-31 18:27:02 +05:00
proller
f04dffc05c External dictionary profiling [#CLICKHOUSE-2197] (#381)
* Profiling external cached dictonaries [#CLICKHOUSE-2197]

* style
2017-01-25 22:40:44 +04:00
alexey-milovidov
ed5b521110 Less dependencies 2 (#378)
* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].
2017-01-21 08:24:28 +04:00
proller
2fe033d00e Fix compiling in freebsd/clang 2017-01-17 18:03:32 +00:00
Alexey Milovidov
06b2404e6a Merge branch 'master' into hierarchical-dictionaries-performance
Conflicts:
	dbms/include/DB/Functions/FunctionsDictionaries.h
2017-01-17 03:31:31 +03:00
Alexey Milovidov
4fe2a4432a External dictionaries: MySQL source: Allow columns with names from reserved words [#CLICKHOUSE-2717]. 2017-01-14 05:30:03 +03:00
Alexey Milovidov
d89ee33ce2 Squashed commit of the following:
commit c567d4e1fe
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:35:01 2017 +0300

    Style [#METR-2944].

commit 26bf3e1228
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:33:11 2017 +0300

    Miscellaneous [#METR-2944].

commit eb946f4c6f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:30:19 2017 +0300

    Miscellaneous [#METR-2944].

commit 78c867a147
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:11:41 2017 +0300

    Miscellaneous [#METR-2944].

commit 6604c5c83c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:56:15 2017 +0300

    Miscellaneous [#METR-2944].

commit 23fbf05c1d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:47:52 2017 +0300

    Miscellaneous [#METR-2944].

commit 98772faf11
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:46:05 2017 +0300

    Miscellaneous [#METR-2944].

commit 3dc636ab9f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:39:46 2017 +0300

    Miscellaneous [#METR-2944].

commit 3e16aee954
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:38:03 2017 +0300

    Miscellaneous [#METR-2944].

commit ae7e7e90eb
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:34:15 2017 +0300

    Miscellaneous [#METR-2944].
2017-01-06 20:41:19 +03:00
Alexey Milovidov
ca37f28b5f Renamed methods Block::rows and Block::rowsInFirstColumn [#METR-2944]. 2017-01-02 23:45:27 +03:00
Alexey Milovidov
2b4f3b5d34 Renamed method (less confusion) [#METR-2944]. 2017-01-02 23:12:12 +03:00
Alexey Milovidov
5fe11c0697 Fixed MongoDBDictionarySource [#METR-2944]. 2016-12-20 23:48:40 +03:00
Alexey Milovidov
a3e22e10d9 MongoDBDictionarySource: fixed error [#METR-2944]. 2016-12-20 05:31:25 +03:00
Alexey Milovidov
47b75e6c1e MongoDBDictionarySource: preparation [#METR-2944]. 2016-12-20 04:20:59 +03:00
Alexey Milovidov
9ab111640c Fixed error after changing MongoDB driver for external dictionaries [#METR-2944]. 2016-12-16 02:40:30 +03:00
proller
357d995e75 Dictonary: executable: rename 'path' to 'command' [#METR-23466] 2016-12-14 00:28:31 +03:00
Alexey Milovidov
fbb0a3e734 Working on performance of hierarchical external dictionaries [#METR-23747]. 2016-12-14 00:15:27 +03:00
Alexey Milovidov
dd1636abdd Improved performance of 'flat' and 'hashed' hierarchical external dictionaries [#METR-23747]. 2016-12-13 00:37:57 +03:00
Alexey Milovidov
599308aef0 Get rid of obsolete mongodb client library [#METR-23791]. 2016-12-11 12:43:16 +03:00
Alexey Milovidov
a8eedafcd0 Fixed error in cached dictionary when using C++11 ABI [#METR-23764]. 2016-12-08 07:56:52 +03:00
Alexey Milovidov
2dc425b7e6 Preparation [#METR-23747]. 2016-12-08 06:04:30 +03:00
Alexey Milovidov
514715589b Preparation [#METR-23747]. 2016-12-08 05:49:04 +03:00
proller
5e6cac10e5 no copypaste 2016-11-27 16:01:35 +03:00
proller
2aeb488d96 add writePrefix 2016-11-25 23:37:06 +03:00
proller
40e674407f return http write callback 2016-11-25 03:16:20 +03:00
proller
e6d3c8855e http ook 2016-11-24 22:57:24 +03:00
proller
2e02e29652 wip 2016-11-24 04:01:11 +03:00
proller
43e057d5e9 dont use OwningBufferBlockInputStream 2016-11-24 02:49:46 +03:00
proller
8f573d7308 clean 2016-11-24 01:44:53 +03:00
proller
e280569453 Everything [maybe] works! 2016-11-22 18:03:54 +03:00
proller
ee2d9503c8 wip 2016-11-19 03:56:15 +03:00
proller
fd3a9da076 httd dict wip 2016-11-19 03:07:58 +03:00
proller
02b4a4aded wip 2016-11-18 23:20:08 +03:00
proller
63eaa97086 wip 2016-11-18 04:48:13 +03:00
proller
cc0e0e739e ExecutableDictionarySource ok 2016-11-17 04:09:46 +03:00
proller
5c9d42d4f4 wip 2016-11-17 00:02:07 +03:00
proller
099edebc28 wip 2016-11-16 03:34:57 +03:00
proller
8fec8e2ac4 simple get works 2016-11-16 02:55:45 +03:00
proller
60ec3506a9 wip 2016-11-16 01:05:49 +03:00
proller
593e3c26bf initial 2016-11-15 22:51:06 +03:00
Vladimir Smirnov
d36f52502e Make it compilable on OS X
It's still hackish and dirty, but server and client compies.

Server starts, but throwes meaningless exception on any query.

Client seems to be working fine.

Linux compilation might (but shouldn't) be broken (not tested).
2016-11-01 17:59:21 +01:00
Yuri Dyachenko
06032a6737 use 'std::vector<bool> loaded_ids' for FlatDictionary::has() 2016-08-25 23:09:58 +03:00
Alexey Milovidov
6c861fe798 Style [#METR-2807]. 2016-08-07 12:09:18 +03:00
Alexey Milovidov
11d6962797 Fixed error [#MOBMET-3953]. 2016-08-07 11:30:29 +03:00
Alexey Milovidov
6d614f2f96 Fixed error [#MOBMET-3953]. 2016-08-07 11:23:44 +03:00
Alexey Milovidov
0ae29e867b Less wrong [#MOBMET-3953]. 2016-08-07 11:12:58 +03:00
Alexey Milovidov
7dfcdbfb86 Fixed error in ComplexKeyCacheDictionary [#MOBMET-3953]. 2016-08-07 09:10:15 +03:00
Alexey Milovidov
6f4fc79cde Better [#METR-2944]. 2016-07-31 06:53:16 +03:00
Alexey Milovidov
55ed2904f4 Allowed for certain aggregate functions to have case insensitive names for compatibility [#METR-22087]. 2016-07-14 08:22:09 +03:00
Alexey Milovidov
1fdbfff503 Fixed error [#METR-21527]. 2016-06-08 03:49:45 +03:00
Alexey Milovidov
7fe425f228 Addition to prev. revision [#METR-21527]. 2016-06-08 00:12:13 +03:00
Alexey Milovidov
3ecfca51ba Splitted dictionaries to separate translation units [#METR-21527]. 2016-06-08 00:07:44 +03:00
Vladimir Chebotarev
70feb3fdfd dbms: Moved some methods to cpp. [#METR-21516] 2016-06-05 18:21:35 +03:00
Vladimir Chebotarev
0403019a77 dbms: Minor improvement. [#METR-21516] 2016-06-05 18:19:31 +03:00
Vladimir Chebotarev
dc404c165c dbms: Minor improvement. [#METR-21516] 2016-05-29 08:39:24 +03:00
Vladimir Chebotarev
42e6374087 dbms: Build fix. [#METR-21516] 2016-05-29 04:36:19 +03:00
Vladimir Chebotarev
d1f7302d96 dbms: Declared max_block_size. [#METR-21516] 2016-05-29 04:12:10 +03:00