Commit Graph

703 Commits

Author SHA1 Message Date
Alexey Milovidov
5dfc311075 Fixed build #3123 2018-09-14 22:15:11 +03:00
Alexey Milovidov
6688f01cf0 ./utils/check-style/check-style -n #3123 2018-09-14 22:11:48 +03:00
alexey-milovidov
a26e6935da
Merge pull request #3123 from Enmk/Issue_2093_Support_arbitrary_type_for_ranges_in_range_hashed_dictionary
Added support of int-based types: Int\UInt(8,16,32), Date, DateTime f…
2018-09-14 22:10:13 +03:00
alexey-milovidov
09b1cafe76
Update RangeHashedDictionary.cpp 2018-09-14 21:44:59 +03:00
alexey-milovidov
be51dccbb7
Merge pull request #3126 from VadimPE/CLICKHOUSE-3476
[CLICKHOUSE-3476] add invalidate_query for ClickHouse in Dictionary
2018-09-14 21:18:09 +03:00
alexey-milovidov
f6d048d4f6
Update ClickHouseDictionarySource.cpp 2018-09-14 21:14:17 +03:00
Vasily Nemkov
dbcbce6fe4 More tests for range edge cases and for querying out of range;
Minor cleanup: removed extra header file.
2018-09-14 16:42:57 +03:00
VadimPE
38fef408c8 Merge branch 'CLICKHOUSE-3476' of https://github.com/VadimPE/ClickHouse into CLICKHOUSE-3476 2018-09-14 12:34:16 +03:00
VadimPE
62726d53d4 CLICKHOUSE-3476 fix 2018-09-14 12:33:11 +03:00
alexey-milovidov
b824652992
Update DictionarySourceFactory.cpp 2018-09-13 21:58:12 +03:00
Vadim
8d1edbc019
Update ClickHouseDictionarySource.cpp 2018-09-13 18:20:40 +03:00
Vasily Nemkov
99560e06f8 Added support of int-based types: Int\UInt(8,16,32), Date, DateTime for range_hashed dictionary.
Fixes #2093
Added type checks for .range_min and .range_max
Allowed nullable range values in dictionary source
Added test for range_hashed dictionaries
2018-09-13 18:19:55 +03:00
VadimPE
d04db2a211 CLICKHOUSE-3476 fix 2018-09-13 18:13:23 +03:00
VadimPE
11955b550f fix 2018-09-13 15:24:34 +03:00
alesapin
c7e073e954 Fix url in invalidate request 2018-09-13 00:34:48 +03:00
alesapin
a44290701d Fix bug in ODBCDictionarySource, copy missed fields in copy constructor 2018-09-13 00:02:06 +03:00
VadimPE
985f2f2704 CLICKHOUSE-3476 fix build 2018-09-11 15:48:18 +03:00
VadimPE
bb7a353e9b CLICKHOUSE-3476 2018-09-11 12:29:02 +03:00
Alexey Milovidov
c7b1a40296 Fixed test [#CLICKHOUSE-2] 2018-09-09 05:23:24 +03:00
proller
db13ef96d6 Fix ssl init (#3056)
* Try to fix ../libs/libglibc-compatibility/glibc-compatibility.c:151: multiple definition of `explicit_bzero'
contrib/ssl/crypto/libcrypto.a(explicit_bzero.c.o):../contrib/ssl/crypto/compat/explicit_bzero.c:16: first defined here

* Fix ssl init

* fix

* noncopyable

* clean
2018-09-06 21:05:33 +03:00
Alexey Milovidov
f584344184 Miscellaneous [#CLICKHOUSE-3939] 2018-09-06 05:24:35 +03:00
Alexey Milovidov
d8809eb2a1 Whitespaces [#CLICKHOUSE-3939] 2018-09-06 04:57:55 +03:00
alesapin
aaf5720198 Fix type in odbc source and remove pointer from mongo source 2018-09-05 23:33:45 +03:00
alesapin
cd07fd6246 Remove unused header 2018-09-05 23:22:20 +03:00
alesapin
2d9a62cfe8 Fix MongoDB api call 2018-09-05 23:19:31 +03:00
alesapin
8b7d6ccd8c Small improvements 2018-09-05 19:20:12 +03:00
alesapin
d12ec5c602 Merge branch 'support_uuid_in_external_dicts' of https://github.com/The-Alchemist/ClickHouse into The-Alchemist-support_uuid_in_external_dicts 2018-09-05 16:20:45 +03:00
Alexey Milovidov
5b257c588f Enabling -Wshadow [#CLICKHOUSE-2] 2018-08-27 20:42:13 +03:00
Alexey Milovidov
6e18af7ed3 Enabling -Wshadow [#CLICKHOUSE-2] 2018-08-27 20:18:14 +03:00
Amos Bird
ea84430864 Get rid of useless std::move to get NRVO
http://eel.is/c++draft/class.copy.elision#:constructor,copy,elision

Some quote:

> Speaking of RVO, return std::move(w); prohibits it. It means "use move constructor or fail to compile", whereas return w; means "use RVO, and if you can't, use move constructor, and if you can't, use copy constructor, and if you can't, fail to compile."

There is one exception to this rule:
```cpp
Block FilterBlockInputStream::removeFilterIfNeed(Block && block)
{
    if (block && remove_filter)
        block.erase(static_cast<size_t>(filter_column));

    return std::move(block);
}
```

because references are not eligible for NRVO, which is another rule "always move rvalue references and forward universal references" that takes precedence.
2018-08-27 22:15:48 +08:00
Alexey Milovidov
91496574aa Fixed error #2913 2018-08-24 08:45:03 +03:00
Alexey Milovidov
761422da22 Miscellaneous #2913 2018-08-24 08:37:06 +03:00
Alexey Milovidov
6043ea02de Style #2913 2018-08-24 08:25:00 +03:00
Alexey Milovidov
27d43fb7ff Fixed typo #2913 2018-08-24 08:21:53 +03:00
Alexey Milovidov
f4813a47f8 Whitespaces #2913 2018-08-24 08:20:18 +03:00
proller
fc2925b567 Squashed commit of the following:
commit 2722e540abfee4a527d716474c4ca582eceeee08
Merge: b4f3af824 aebddd550
Author: proller <proller@github.com>
Date:   Tue Aug 21 18:34:18 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit b4f3af824b88a8b6826583bb483730827574e8ad
Author: proller <proller@github.com>
Date:   Tue Aug 21 17:00:20 2018 +0300

    fix

commit 3a18fa7ded2a7d6b7a0883a1b9c2d6b99360837d
Author: proller <proller@github.com>
Date:   Tue Aug 21 16:57:17 2018 +0300

    fix

commit 5d42220c2cf47e1a86bdc73dbfc24b68f8626891
Author: proller <proller@github.com>
Date:   Tue Aug 21 16:50:21 2018 +0300

    freebsd fixes

commit 7baf4fb5ba4575f79b0d12a9ffaaabd34e1006da
Author: proller <proller@github.com>
Date:   Tue Aug 21 16:17:19 2018 +0300

    fix

commit e1fe707fd765b841a8d0952d91a980128cbf91d0
Author: proller <proller@github.com>
Date:   Tue Aug 21 15:35:21 2018 +0300

    fix

commit 027887c71b3ffa98d9473d50d8c3b79cbf3304ac
Author: proller <proller@github.com>
Date:   Tue Aug 21 15:25:57 2018 +0300

    fix

commit 81af41bfcfff7c02fe4060196cf03c2d2aab416e
Author: proller <proller@github.com>
Date:   Tue Aug 21 15:20:41 2018 +0300

    fix

commit 93d572c85d9c7e331254999a614c3b22b5573b02
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:58:07 2018 +0300

    SPLIT_SHARED

commit dd5b8990d8527d59b1e890943d80c2bf27c613ce
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:52:39 2018 +0300

    fix

commit 4840ca12ab752a38c1ef482e8ec59c5859bb48d7
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:46:31 2018 +0300

    fix

commit abde633beb86f2a0d025d6fcf079965dbd827b92
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:25:32 2018 +0300

    fix

commit 0d94a5476a5ba8ba5e88638d58f2cfbf2b4b662d
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:45:18 2018 +0300

    Travis: try fail on ninja fail

commit c2686f90b68255c2beb0a708804aef404e80a6d2
Merge: 2c3427bbd 2aa7eb463
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:25:15 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 2c3427bbdb861edbb188ed4621e8a05cafaedafb
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:57:24 2018 +0300

    fix

commit 530170c6a81d31dcfa81230e48520383234df4bc
Merge: 9abec162c f6e4ec970
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:57:03 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 9abec162cb2e09bbc2f33cbe80fe76791f6e5a77
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:49:58 2018 +0300

    Apple fixes

commit 36d05e8217440fbc8ae21571b06d4eb6d679d538
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:25:05 2018 +0300

    apple fix

commit aeec3e845e4456e89fbb1b1af6f9f36820a46e33
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:20:06 2018 +0300

    fixes

commit 427961d916a5954981e47d94733996deb2a616ce
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:11:11 2018 +0300

    fix

commit a7dd55ff8f653624c0f3dbcbc54defd3b3ae97af
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:41:53 2018 +0300

    fix

commit 6200e0d315c7a62bae63a8de0fc32f7937770ad2
Merge: 8a541d7e6 21cedbe46
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:35:49 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 8a541d7e64c89e2c16af6c909e0353361153aaa3
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:34:32 2018 +0300

    Do not use poco types

commit fd560f43d048b7e3307c6c6b9c9d9918230014d8
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:20:42 2018 +0300

    Try fix apple build

commit cfb2eba07ac06f19e822d3474341d800b1f98cf1
Merge: 8d2e31c90 5b81fdfc0
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:03:24 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 8d2e31c908be2e99d09e2a9dde2414ab82a5e93c
Author: proller <proller@github.com>
Date:   Mon Aug 20 21:56:06 2018 +0300

    travis: TEST_SERVER_STARTUP_WAIT=10
2018-08-21 18:56:50 +03:00
alesapin
f6c9587d0a CLICKHOUSE-3878: Move last interaction with ODBC from main code to bridge, split Handlers file on three different, slightly remove copy-paste code 2018-08-19 20:09:54 +03:00
Amos Bird
57970a8bef
Using correct config ref to initialize odbc bridge 2018-08-17 19:00:42 +08:00
alesapin
6fa4af882f CLICKHOUSE-3878: Build fixes 2018-08-16 01:00:28 +03:00
alesapin
af19d4133d CLICKHOUSE-3878: Move connection string validation to common, remove redundant headers, fix compilation issues 2018-08-14 13:33:41 +03:00
alesapin
83d5dba53b CLICKHOUSE-3878: Move ODBCDictionary to odbc-bridge 2018-08-13 21:10:26 +03:00
Alexey Milovidov
36db216abf Preparation for extra warnings [#CLICKHOUSE-2] 2018-08-10 07:02:56 +03:00
The-Alchemist
a9b3279265 Support for UUID in ODBC dictionaries 2018-08-07 15:09:30 -04:00
Alexey Milovidov
76e06fe0eb Don't escape values of parameters of ODBC connection string if it is not necessarily, because drivers don't recognize them [#CLICKHOUSE-3861] 2018-08-02 08:30:52 +03:00
Alexey Milovidov
60187ab716 Miscellaneous [#CLICKHOUSE-3861] 2018-08-01 21:21:03 +03:00
Alexey Milovidov
1cdbf16837 More tests [#CLICKHOUSE-3861] 2018-08-01 00:25:26 +03:00
alexey-milovidov
0f25e8277c Update validateODBCConnectionString.cpp 2018-08-01 00:25:26 +03:00
alexey-milovidov
369145bd30 Update validateODBCConnectionString.cpp 2018-08-01 00:25:26 +03:00
Alexey Milovidov
c9ab39c8c6 Added validation of ODBC connection string [#CLICKHOUSE-3861] 2018-08-01 00:25:26 +03:00
Alexey Milovidov
c2a50991c9 Minor modifications [#CLICKHOUSE-2] 2018-07-25 03:00:08 +03:00
Alexey Milovidov
245b114363 Quote all identifiers when querying external database #2635 2018-07-20 03:04:48 +03:00
alesapin
56523948bf CLICKHOUSE-3842: Rename local variables 2018-07-19 16:51:57 +03:00
alesapin
ae44b41318 CLICKHOUSE-3842: Fix loadKeys method in dictionary library 2018-07-19 16:51:57 +03:00
Alexey Milovidov
2298f1c68b Fixed strange code #2501 2018-06-16 08:54:06 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492)
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
2018-06-10 22:22:49 +03:00
Alexey Milovidov
26d448baad Passing settings to ser/de of data types: development #1710 2018-06-08 04:51:55 +03:00
alesapin
40c2b21b65 Change dictionary shared library api to v3. Both in library and examples. 2018-06-07 20:41:14 +03:00
alesapin
d2bfa25769 Remove unused include 2018-06-07 12:22:27 +03:00
alesapin
2a39f05f99 Shared Library Dict Logging: Replace multiple functions with single one and add logging examples into test libraries 2018-06-06 23:21:16 +03:00
alesapin
1adee7a6c5 Merge remote-tracking branch 'upstream/master' 2018-06-06 17:35:55 +03:00
alesapin
6426e573aa Fix format 2018-06-06 17:35:33 +03:00
Alexey Milovidov
b9b89a5590 Less dependencies [#CLICKHOUSE-2] 2018-06-05 22:46:49 +03:00
Alexander Sapin
5a524a7819 Remove empty lines 2018-06-05 22:20:16 +03:00
Alexander Sapin
4e3dc0d8a2 Introduce logging in shared library dictionaries 2018-06-05 22:17:16 +03:00
Alexey Milovidov
8cb65277e2 Non significant changes according to clang's -Weverything, part 5 [#CLICKHOUSE-2] 2018-06-04 01:11:50 +03:00
Alexey Milovidov
7c60adbebb Non significant changes according to clang's -Weverything, part 4 [#CLICKHOUSE-2] 2018-06-03 23:48:36 +03:00
Alexey Milovidov
f5adbceed2 Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2] 2018-06-03 23:39:06 +03:00
Alexey Milovidov
734cebdf09 Non significant changes according to clang's -Weverything, part 1 [#CLICKHOUSE-2] 2018-06-03 19:51:31 +03:00
Arsen Hakobyan
dfe65ba842 Now uses Poco::URI::addQueryParameter for "update_field" parameter 2018-05-18 19:22:28 +03:00
Arsen Hakobyan
ad9659574f Adds percent encoding for "update_field" parameter
Handles cases when url has fragment
2018-05-18 19:22:28 +03:00
sundy-li
8a5990fc74 add integration test_storage_mysql 2018-05-15 03:02:59 +03:00
proller
fb911f7cfa Allow force disable libs: poco netssl poco mongodb, poco data odbc 2018-05-14 21:36:01 +03:00
Alexey Milovidov
956128a67a Fixed style a bit [#CLICKHOUSE-2] 2018-05-07 05:01:11 +03:00
Alexey Milovidov
6388c916de Fixed style; added a comment about terribly wrong code [#CLICKHOUSE-2] 2018-04-19 07:23:58 +03:00
Alexey Milovidov
18bbd0e61b Moved SessionPoolHelpers #2180 2018-04-07 06:07:32 +03:00
proller
e58b0830e6
Prepare to new poco (PocoData renamed to PocoSQL) (#2158) 2018-04-03 04:48:40 -07:00
proller
a6f9df105c Allow use encryption for distributed tables (#2065)
* Allow use encryption for distributed tables

* wip

* fix

* rename encryption to secure

* Fix DirectoryMonitor with +secure

* fix

* fix

* Update DirectoryMonitor.cpp

* Update DirectoryMonitor.cpp
2018-03-29 04:41:06 +03:00
Nikolai Kochetov
a399c17f01 && - qualified IColumn::mutate 2018-03-20 17:01:00 +03:00
proller
153fcd6c9f Fix double free in LibraryDictionarySource (#2028)
* Fix double free in LibraryDictionarySource

* Fix {}

* wip

* wip

* Better Exception

* Fix possible leak
2018-03-14 02:13:39 +03:00
Alexey Milovidov
b7475b1d2c Fixed error: wrong timeouts passed to ConnectionPoolWithFailover [#CLICKHOUSE-3641] 2018-03-12 23:25:18 +03:00
Alexey Milovidov
3f8ef38b41 Fixed wording #245 2018-03-10 02:23:15 +03:00
Alexey Milovidov
3a5754944e Fixed bug after merge [#CLICKHOUSE-2] 2018-03-08 00:32:35 +03:00
Alexey Milovidov
10a6b5c43f Fixed build after merge [#CLICKHOUSE-2] 2018-03-07 22:20:36 +03:00
alexey-milovidov
bd455283cc
Merge pull request #1771 from joomag/dictionary-update
Add external dictionary update feature
2018-03-07 21:48:42 +03:00
Nikolai Kochetov
3f5218bb11 fix DictionaryBlockInputStream::getBlock for empty dictionary 2018-03-07 18:11:23 +03:00
Alexey Milovidov
790b4e3a1b Fixed build #1987 2018-03-02 22:40:44 +03:00
Nikolai Kochetov
5842c35aeb added odbc_default_field_size setting 2018-03-02 15:59:41 +03:00
proller
566d66e858 Dictionary Library source: Persistent per-dictionary custom data store (#1917)
* LibraryDictionarySource: Support numeric types, initial support for strings

* Dictionary Library source with string types

* clang-format

* Dictionary Library source: Persistent per-dictionary custom data store

* Fix unused

* Allocate -> New

* Update examples

* fix
2018-02-26 19:57:14 +03:00
Alexey Milovidov
222fb2c945 Miscellaneous [#CLICKHOUSE-2] 2018-02-21 23:23:27 +03:00
Alexey Milovidov
afe09d3138 Removed unused code [#CLICKHOUSE-2] 2018-02-18 06:46:18 +03:00
Alexey Milovidov
754a4296df Header in every stream: fixed non-deterministic test [#CLICKHOUSE-2] 2018-02-18 06:23:48 +03:00
Alexey Milovidov
c320b360c6 Merge branch 'master' of github.com:yandex/ClickHouse into header-in-input-streams 2018-02-16 21:23:29 +03:00
proller
db8ea9205c
LibraryDictionarySource: api v2 with strings (#1915)
* LibraryDictionarySource: Support numeric types, initial support for strings
2018-02-16 20:12:22 +03:00
Alexey Milovidov
30b657a0da Header in every stream: development [#CLICKHOUSE-2] 2018-02-15 21:54:12 +03:00
Alexey Milovidov
921e09b5f8 Merge branch 'master' into header-in-input-streams 2018-02-15 19:20:36 +03:00
Arsen Hakobyan
7a77b8abf0 Improvements done according to requested changes 2018-02-15 17:08:23 +04:00
Arsen Hakobyan
8b8c7a64b4 Merge branch 'master' of https://github.com/yandex/ClickHouse into dictionary-update 2018-02-15 12:07:58 +04:00
proller
7c7bdc5115
LibraryDictionarySource: Support numeric types, initial support for strings (#1903) 2018-02-14 18:03:48 +03:00
alexey-milovidov
22263ad627
Update MongoDBDictionarySource.cpp 2018-02-07 20:49:41 +03:00
Павел Литвиненко
95ec20d92a added is_object_id to list of valid config keys 2018-02-07 01:35:47 +03:00
Павел Литвиненко
8e61106450 add is_object_id property for determining when to use ObjectId 2018-02-07 00:34:56 +03:00
Павел Литвиненко
abf0a603c1 this make me crazy, how to retrieve document from array??? 2018-02-06 16:04:19 +03:00
Павел Литвиненко
d0e386a13d no message 2018-02-06 15:53:50 +03:00
Павел Литвиненко
b6f3a2565c convert to objectid without use of any property in config 2018-02-06 15:46:48 +03:00
Павел Литвиненко
6a12d30f78 handle default value 2018-02-06 15:39:16 +03:00
Павел Литвиненко
c2545194b6 revert 2018-02-06 15:18:20 +03:00
Павел Литвиненко
53133f76a7 trying to query without $or 2018-02-06 14:43:09 +03:00
Павел Литвиненко
f0f03596c4 revert 2018-02-06 14:15:13 +03:00
Павел Литвиненко
bb90a9742c add ability to query by objectid 2018-02-06 13:03:04 +03:00
Павел Литвиненко
2e847d1a1b fix std::exception. Code: 1001, type: std::logic_error, e.what() = basic_string::_S_construct null not valid 2018-02-04 17:43:29 +03:00
Павел Литвиненко
4ebde2ac7e allow nulls in string field 2018-02-04 17:15:22 +03:00
proller
c1c512766d Fix LibraryDictionarySource reload 2018-02-01 22:56:22 +03:00
Pavel Litvinenko
7db8e99300 Поддержка Mongo ObjectId (#1833)
* update build script (gcc-5 -> gcc-7)

* add gitlab-ci

* sadly but my gitlab worker doesn't have make

* fix gitlkab-ci config

* fix the input device is not a TTY

* set runner tag to docker

* allow to use ObjectId in clickhouse (oid will be converted to string)

* update ci config

* code review
2018-02-01 14:26:44 +03:00
Arsen Hakobyan
89ca08147b Fixes memory leak in hash dictionary
Fixes case when keys might not be loaded for complex key hash dictionary
2018-01-24 16:28:51 +04:00
Alexey Milovidov
9a02d4f5ff Merge branch 'master' of github.com:yandex/ClickHouse into header-in-input-streams 2018-01-20 04:20:40 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
2018-01-15 22:07:47 +03:00
Arsen Hakobyan
7658665737 Add external dictionary update feature
feature is implemented for DICT TYPES THAT SUPPORT
and for sources SOURCE TYPES THAT ARE SUPPORTED
to use the feature add <update_field>...</...> to dictionary sourcei config.
If the field is skipped or used with unsupported dictionary types,
all data is updated every time if the field is provided,
value of last update time is passed to the source
with the expectation that only records that were updated after
provided time will be passed to the dictionary
2018-01-15 16:44:39 +04:00
Alexey Milovidov
550053a0ca Merge branch 'master' into header-in-input-streams 2018-01-10 03:05:51 +03:00
Alexey Milovidov
0bfea2f52c Miscellaneous [#CLICKHOUSe-2] 2018-01-10 03:04:08 +03:00
Nikolai Kochetov
cbeeb84999 added http_*_timeout settings [#CLICKHOUSE-3440] 2018-01-09 21:41:01 +03:00
Alexey Milovidov
fe880d73e7 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-09 03:19:58 +03:00
Alexey Milovidov
9996e181e1 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-06 21:10:44 +03:00
Alexey Milovidov
cefb5b61fd Table functions MySQL and ODBC: development [#CLICKHOUSE-3114]. 2017-12-28 08:15:09 +03:00
Alexey Milovidov
1fecbc3ef4 Merging [#CLICKHOUSE-3114] 2017-12-28 07:33:35 +03:00
Alexey Milovidov
b2fcf06353 Merging [#CLICKHOUSE-3114] 2017-12-27 00:34:06 +03:00
alexey-milovidov
7a0281dd20
Update RangeHashedDictionary.cpp 2017-12-26 20:37:21 +03:00
Nikolai Kochetov
ca77f3d861 fixed NULL value for range hased dictionary range_min and range_max keys [#CLICKHOUSE-3521] 2017-12-26 15:52:58 +03:00
Nikolai Kochetov
0c082b134d fixed engine Dictionary(range_hashed) for open interval date keys [#CLICKHOUSE-3521] 2017-12-25 23:55:37 +03:00
Alexey Milovidov
7c802ee3de Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:37:08 +03:00
Alexey Milovidov
7e685c383b Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 06:19:14 +03:00
Alexey Milovidov
e3d931d7fc Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 06:12:04 +03:00
Alexey Milovidov
96ee187d1a Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 06:04:33 +03:00
Alexey Milovidov
a086e3e6d8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 05:52:38 +03:00
Alexey Milovidov
f3bb24a3bf Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 04:43:19 +03:00
Alexey Milovidov
819287b697 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-13 04:27:53 +03:00
Alexey Milovidov
d2cfda4d9b Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Roman Lipovsky
6ff1d56a3b check correctness of data size estimation made by regions names data source 2017-12-06 16:03:02 +03:00
alexey-milovidov
6c86bc2506
Merge pull request #1584 from yandex/table-system-models
added system.models
2017-12-05 00:25:04 +03:00
alexey-milovidov
20a8812eba
Merge pull request #1587 from rlipovsky/geodata_readers
[clickhouse-yt] separate geoexport format readers from data files
2017-12-05 00:18:54 +03:00
Roman Lipovsky
8bd45a544b add comments 2017-12-04 17:48:07 +03:00
Roman Lipovsky
e0e60d6dfa fix broken geo dictionaries 2017-12-04 17:35:03 +03:00
Nikolai Kochetov
d2710bd0f4 added system.models [#CLICKHOUSE-3477] 2017-12-04 16:32:49 +03:00
Roman Lipovsky
c18934f454 separate format readers from files, move readers to separate headers 2017-12-04 15:30:21 +03:00
Alexey Milovidov
acd78e4891 Better [#CLICKHOUSE-2]. 2017-12-02 00:13:25 +03:00
Alexey Milovidov
431da20d99 Better [#CLICKHOUSE-2]. 2017-12-01 23:21:35 +03:00
Roman Lipovsky
db0fc481d7 do not rely on total size estimation from data source 2017-11-29 15:45:17 +03:00
Roman Lipovsky
845b4e0cac use types from Dictionaries/Embedded/GeodataProviders/Types.h 2017-11-29 01:27:32 +03:00
Roman Lipovsky
e37b13dfef update comment 2017-11-29 01:18:38 +03:00
Roman Lipovsky
9ed1ba2441 separate geo dictionaries from geo data providers 2017-11-29 01:15:06 +03:00
alexey-milovidov
2ab73565b2
Fixed terrible translation. 2017-11-28 19:30:24 +03:00
Alexey Milovidov
7e5bab971d Fixed build [#CLICKHOUSE-2]. 2017-11-27 22:12:18 +03:00
alexey-milovidov
5dd7279e15 Update DictionarySourceFactory.cpp 2017-11-27 22:08:40 +03:00
alexey-milovidov
d6766a8ef4 Update DictionarySourceFactory.h 2017-11-27 22:08:40 +03:00
alexey-milovidov
1a28e785af Update DictionarySourceFactory.cpp 2017-11-27 22:08:40 +03:00
Roman Lipovsky
b218dfab1c [clickhouse-yt] support external dictionaries registration in DictionarySourceFactory 2017-11-27 22:08:40 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
Alexey Milovidov
c0c3f3115e RegionsHierarchy: read hidden regions [#CLICKHOUSE-3427]. 2017-11-16 21:50:01 +03:00
Alexey Milovidov
5ef829c5f3 RegionsHierarchy: minor modification [#CLICKHOUSE-3427]. 2017-11-16 21:47:59 +03:00
Alexey Milovidov
edcbf791fb Miscellaneous [#CLICKHOUSE-2]. 2017-11-16 20:40:54 +03:00
Иванов Евгений
48636ac601 Added support UUID type for dictionaries 2017-11-15 23:31:53 +03:00
Nikolai Kochetov
554bb889ac merged with master 2017-10-31 15:04:13 +03:00
Nikolai Kochetov
18ef139e9d load features count from catboost model file [#CLICKHOUSE-3305] 2017-10-31 14:50:24 +03:00
Nikolai Kochetov
cec9f90e1e added optional features count validation [#CLICKHOUSE-3305] 2017-10-31 14:50:13 +03:00
Nikolai Kochetov
e6d8c7bf31 changed boost::dll to SharedLibrary; removed boost::dll [#CLICKHOUSE-3305] 2017-10-31 14:50:03 +03:00
alexey-milovidov
56ef2e9196
Merge pull request #1380 from yandex/catboost-models
Catboost models
2017-10-30 19:16:41 +03:00
Nikolai Kochetov
8f84d51a5d added optional features count validation [#CLICKHOUSE-3305] 2017-10-27 15:23:26 +03:00
Nikolai Kochetov
fea2bed3da added optional features count validation [#CLICKHOUSE-3305] 2017-10-27 11:39:54 +03:00
Nikolai Kochetov
9c3c3231f4 added optional features count validation [#CLICKHOUSE-3305] 2017-10-26 23:12:40 +03:00
Nikolai Kochetov
0d356f9a6a fix build [#CLICKHOUSE-3305] 2017-10-26 22:14:25 +03:00
Nikolai Kochetov
46dfa7bf8d changed boost::dll to SharedLibrary; removed boost::dll [#CLICKHOUSE-3305] 2017-10-26 22:00:27 +03:00
Nikolai Kochetov
3757c9682e style fixes [#CLICKHOUSE-3305] 2017-10-26 21:49:23 +03:00
Alexey Milovidov
a27981b4ef Get rid of double whitespaces [#CLICKHOUSE-2]. 2017-10-26 21:36:23 +03:00
Nikolai Kochetov
4204a94b20 changed CatBoost model evaluate signature [#CLICKHOUSE-3305] 2017-10-26 17:08:05 +03:00
Nikolai Kochetov
2e6b1dfd92 renamed cloneObject to clone in IExternalLoadable [#CLICKHOUSE-3305] 2017-10-26 16:42:14 +03:00
Nikolai Kochetov
c3d104f53b changed IDictionary clone [#CLICKHOUSE-3305] 2017-10-26 16:41:51 +03:00
Nikolai Kochetov
fd8eb13dcc refactoring [#CLICKHOUSE-3305] 2017-10-26 15:18:37 +03:00
proller
82134e44cb Split ComplexKeyCacheDictionary to faster compile (part2) 2017-10-24 00:26:42 +03:00
Nikolai Kochetov
74a4c7508a merged with master 2017-10-20 19:18:09 +03:00
Nikolai Kochetov
d5d53da01b added comments [#CLICKHOUSE-3305] 2017-10-20 19:13:35 +03:00
Nikolai Kochetov
4efee71114 fix hash index in CatBoostModel [#CLICKHOUSE-3305]
fix hash index in CatBoostModel [#CLICKHOUSE-3305]

fix hash index in CatBoostModel [#CLICKHOUSE-3305]

fix hash index in CatBoostModel [#CLICKHOUSE-3305]

fix string features in CatBoostModel [#CLICKHOUSE-3305]
2017-10-20 19:13:32 +03:00
Nikolai Kochetov
9384bfdc28 fix invalid catboost model handle [#CLICKHOUSE-3305] 2017-10-20 19:13:29 +03:00
Nikolai Kochetov
fdf258f8ed added ExternalModels to Context [#CLICKHOUSE-3305]
fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]
2017-10-20 19:13:25 +03:00
Nikolai Kochetov
ff088b4a1d modified CatBoostModel [#CLICKHOUSE-3305] 2017-10-20 19:13:21 +03:00
Nikolai Kochetov
e817de7e21 added CatBoostModel [#CLICKHOUSE-3305] 2017-10-20 19:13:21 +03:00
Nikolai Kochetov
24fc661f00 added boost::dll [#CLICKHOUSE-3305] 2017-10-20 19:13:19 +03:00
Nikolai Kochetov
99e9c0c486 fix build [#CLICKHOUSE-3305]
fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]
2017-10-20 18:45:16 +03:00
Marek Vavruša
2ac5a743cc dbms: fix build with OS X built-in clang
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:

```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
                    res.insert({elem.column, elem.type, rename[i].value()});
                                                        ~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
    value_type& value()
                ^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
    constexpr value_type const& value() const
```
2017-10-13 18:12:29 -07:00
Alexey Milovidov
54eb2bbb0a Miscellaneous changes after merge [#CLICKHOUSE-2]. 2017-10-12 22:40:42 +03:00
alexey-milovidov
c2647e0c60 Update ExecutableDictionarySource.cpp 2017-10-12 22:36:27 +03:00
alexey-milovidov
beb93bb9d6 Update ExecutableDictionarySource.cpp 2017-10-12 22:36:27 +03:00
proller
4969038865 test me 2017-10-12 22:36:27 +03:00
proller
1505ad6bac Executable dictionaries: fail if program returns non zero exit code (#CLICKHOUSE-3171) 2017-10-12 22:36:27 +03:00
Nikolai Kochetov
61bef2adf1 added ExternalLoader [#CLICKHOUSE-3305] 2017-10-06 13:31:06 +03:00
Alexey Milovidov
86c46ad1bd Unification [#CLICKHOUSE-2]. 2017-09-15 15:16:12 +03:00
Alexey Milovidov
cfd4120f4a Fixed build with increased inline-depth in clang [#CLICKHOUSE-2]. 2017-09-15 14:08:39 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
proller
cb70a5a77c Try fix macos build (#1221)
* Try fix macos build

* Try fix macos build
2017-09-09 03:40:21 +03:00
proller
fce8416797 Try fix macos build 2017-09-08 21:25:22 +03:00
Alexey Milovidov
d29c77adea Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301]. 2017-09-08 06:47:27 +03:00
proller
5a87ebf262 Try fix macos build 2017-09-08 00:35:55 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Vadim Skipin
4017622ffb CLICKHOUSE-3289: Do not use Application singleton 2017-09-07 20:55:33 +03:00
proller
7142e43be6 Fix compile 32bit 2017-09-06 22:28:04 +03:00
proller
7c2327f3c8 LibraryDictionarySource: fix compile on macos and 32bit 2017-09-06 22:28:04 +03:00
proller
0e4d49570b LibraryDictionarySource fixes 2017-09-05 20:14:46 +03:00
proller
2a7813049e LibDictionarySource : First lib dictionary version with only uint64 type support (#1150)
* Wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Config: Allow multiple dictionaries_config

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* wip

* clean

* clean

* wip

* clean

* clean

* wip

* wip

* clean

* clean

* clean

* clean

* clean

* Requested changes

* Reqested changes

* Requested changes

* Requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* fix

* Requested changes

* Requested changes

* fix

* Requested changes

* Requested changes
2017-09-05 04:08:26 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175)
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
2017-09-01 20:21:03 +03:00
Vadim Skipin
4dc36893d3 Keep config in context to avoid Application singleton usages 2017-08-28 22:19:06 +03:00
Marek Vavruša
5ba535f05f Dictionaries: remove duplicate MySQLDictionarySource.h include
refs #1110
2017-08-17 01:35:19 +03:00
Alexey Zatelepin
3f3b7f61e2 always send changed settings for remote connections [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
alexey-milovidov
b01f0c6d13 Update CacheDictionary.cpp 2017-08-10 06:29:06 +03:00
proller
4cda5b4470 Fix result 2017-08-10 06:29:06 +03:00
proller
6ca798a357 Fix infinite loop in dictGetHierarchy if id chain looped 2017-08-10 06:29:06 +03:00
Alexey Milovidov
6578fb2645 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:39:24 +03:00
Alexey Milovidov
4c89570988 Don't limit the size of internal queries (this is for cache dictionaries with ClickHouse source) [#CLICKHOUSE-2]. 2017-07-28 21:43:40 +03:00
Alexey Milovidov
dd1f54bce2 Changed Poco::RWLock to std::shared_lock [#APRILDEV-91]. 2017-07-28 20:34:02 +03:00
Alexey Milovidov
e4af70149f Fixed build [#CLICKHOUSE-2]. 2017-07-28 00:27:10 +03:00
proller
9eb6e5b19c clang-format of Split ComplexKeyCacheDictionary (#1035)
* clnag-format of Split ComplexKeyCacheDictionary

* Requested changes
2017-07-27 23:39:40 +03:00
proller
3dbde50daa Split ComplexKeyCacheDictionary to use less then 1.5G ram when compile (#1034)
* Split FunctionsArithmetic.cpp to generated functions

* Use ccache if found

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* check_include.sh: print memory usage

* Try split CacheDictionary source

* Split ok

* wip

* wip

* wip

* wip

* wip

* wip
2017-07-27 22:05:55 +03:00
Alexey Milovidov
366ad1595e Fixed warning on clang 6 [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
alexey-milovidov
d4d266fa18 ColumnConst unification (#1011)
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Alexey Zatelepin
5e61a56743 always initialize trie ptr (just in case) [#CLICKHOUSE-3087] 2017-07-12 16:35:05 +03:00
Alexey Zatelepin
4d4387f1c8 fix reloading of TrieDictionary [#CLICKHOUSE-3087] 2017-07-12 16:35:05 +03:00
Alexey Milovidov
86eb4d2d06 Renamed Singleton to avoid conflicts with Arcadia* codebase [#DEVTOOLS-3343].
* - "Arcadia" is the name of Yandex's monorepo.
2017-07-10 07:34:14 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921)
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
2017-06-23 23:22:35 +03:00
proller
8ef51bf19b Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers (#905)
* Fix missing includes

* ComplexKeyCacheDictionary: Move includes to .cpp

* Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers

* Multiplatform memory size getter

* Requested changes

* Requested changes

* Requested changes

* fix

* Requested changes
2017-06-22 18:57:37 +03:00
Vitaliy Lyudvichenko
a098fb170a Avoid creating multiple global Context. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
proller
4c7dd6ff8b Freebsd and macos fixes 2017-06-15 22:39:35 +03:00
Nikolai Kochetov
221c05402f fixed bytes_allocated counter for cache dictionaries 2017-06-15 20:31:48 +03:00
Alexey Milovidov
a73790f17d Less dependencies [#CLICKHOUSE-2]. 2017-06-13 08:14:24 +03:00
Alexey Milovidov
a782f81f8f Moved common code from Functions; fixed build after merge [#CLICKHOUSE-2]. 2017-06-13 07:45:30 +03:00
Nikolai Kochetov
2f7f9a328e changed ComplexKeyCacheDictionary key serialization 2017-06-08 20:51:46 +03:00
Nikolai Kochetov
679cccc52d renamed *.hpp to *.h in DictionaryBlickInputStream 2017-06-08 16:35:35 +03:00
Nikolai Kochetov
bff77d1bae merged with master 2017-06-08 15:00:11 +03:00
Alexey Milovidov
9c5ddce06d Get rid of .hpp files [#CLICKHOUSE-2]. 2017-06-06 20:18:32 +03:00
Nikolai Kochetov
04e1a23d1a removed IBlockInputStream.h from IDictionary.h 2017-06-05 13:01:47 +03:00
Nikolai Kochetov
bbd6a1f238 added DictionaryBlockInpustStream support for TrieDictionary 2017-06-05 12:02:05 +03:00
Nikolai Kochetov
334fa11d12 deleted IBlickInputStream.h include form IDictionary.h 2017-05-31 12:05:44 +03:00
Nikolai Kochetov
38e9e837c5 style fixes 2017-05-30 18:02:44 +03:00
Nikolai Kochetov
7c736b12ef added raw serialization functions for IColumn; changed key serialization in ComplexKeyCacheDictionary; style fixes 2017-05-29 20:26:45 +03:00
Nikolai Kochetov
787bf12572 merged with master 2017-05-29 20:23:14 +03:00
Nikolai Kochetov
5fb5397941 added max_block_size for DictionaryBlockImputStreamBase 2017-05-26 19:08:56 +03:00
Alexey Milovidov
c8ccbd56c0 More correct wording [#CLICKHOUSE-3039]. 2017-05-26 00:00:04 +03:00
Alexey Milovidov
d35a586af2 Fixed deadlock when using executable dictionary source with cache or complex_key_cache layout [#CLICKHOUSE-3039]. 2017-05-25 23:59:14 +03:00
Alexey Milovidov
ccce305d73 Fixed totally wrong code [#CLICKHOUSE-3039]. 2017-05-25 23:17:23 +03:00
Alexey Milovidov
f448c9690c Little better [#CLICKHOUSE-3039]. 2017-05-25 23:09:48 +03:00
Alexey Milovidov
e05547f4f8 Little better [#CLICKHOUSE-3039]. 2017-05-25 22:52:05 +03:00
Alexey Milovidov
7a5c0a3cc2 Style [#CLICKHOUSE-3039]. 2017-05-25 22:36:03 +03:00
Alexey Milovidov
22a0da824f Fixed bad code (again) [#CLICKHOUSE-3039]. 2017-05-25 22:27:23 +03:00
Alexey Milovidov
6f5dcb1d84 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 22:26:17 +03:00
Alexey Milovidov
4fd2714a74 Fixed bad code [#CLICKHOUSE-3039]. 2017-05-25 22:21:57 +03:00
Alexey Milovidov
fedd829803 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 21:24:47 +03:00
Alexey Milovidov
91f9009cc4 Fixed build [#CLICKHOUSE-2955]. 2017-05-24 01:34:52 +03:00
Alexey Milovidov
c24f4c57af Style; removed useless catch [#CLICKHOUSE-2955]. 2017-05-23 19:36:07 +03:00
Nikolai Kochetov
db3fbd91b7 added readInvalidateQuery 2017-05-22 19:46:14 +03:00
Nikolai Kochetov
86e63d2bba added readInvalidateQuery for uniform reading from BlockInputStream 2017-05-22 19:38:24 +03:00
Nikolai Kochetov
df087a2e98 merged with master 2017-05-16 13:06:45 +03:00
Nikolai Kochetov
16256503ec merged with master 2017-05-16 13:03:06 +03:00
Nikolai Kochetov
7398062010 added undate by invalidate_query for MySql and ODBC dictionary sources 2017-05-15 17:16:10 +03:00
Marek Vavruša
9520234365 Dictionaries/TrieDictionary: IP prefix dictionary
This commit implements a basic IP prefix dictionary
that allows storing IPv4/IPv6 prefixes and
matching them against a single IP address on query
time. This allows for doing IP -> ASN matching and
other similar things on query time.

The implementation is basic for start, using a
simple bitwise trie and reusing interface for
complex key dictionaries (so using tuple instead
of UInt32/FixedString(16) as the key). A faster
bitwise trie implementation (like poptrie) is
desired to improve lookup performance and
memory consumption with large prefix tables.
2017-05-15 10:51:03 +04:00
Dmitry Bilunov
0c72259c3c mongodb: Avoid compiling DB::authenticate() function unless it is needed 2017-05-05 17:02:34 -07:00
Nikolai Kochetov
1604ce138a changed key storage format for complex key dictionaries 2017-05-04 21:14:23 +03:00
Vitaliy Lyudvichenko
d504c5454a Resolves #750. Allow to load more than 16 external dictionaries. [#CLICKHOUSE-3] 2017-05-03 21:04:58 -07:00
Nikolai Kochetov
79564054a9 added RangeDictionaryBlockInputStream 2017-04-28 21:33:31 +03:00
Nikolai Kochetov
9243439e9b added DictionaryBlockInputStream 2017-04-27 20:16:24 +03:00
Alexey Zatelepin
ba254a082e Merge branch 'master' into lagging-replicas-failover
Conflicts:
	dbms/src/Core/ErrorCodes.cpp
2017-04-19 21:31:29 +03:00
Alexey Zatelepin
485c58b039 use only ConnectionPoolWithFailover in RemoteBlockInputStream [#CLICKHOUSE-2141] 2017-04-19 20:50:17 +03:00
alexey-milovidov
c9c8c8ec50 Better option to disable mysqlclient (#710)
* Better support for disabling libmysqlclient [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-04-19 03:25:57 +03:00
f1yegor
b51c6e7592 translate comments 2017-04-17 15:35:21 +03:00
Alexey Milovidov
41e97787e3 Less dependencies [#CLICKHOUSE-2]. 2017-04-16 08:40:17 +03:00
proller
38e9254d33 fix http methods for ReadWriteBufferFromHTTP (#675) 2017-04-11 17:13:19 +03:00
Alexey Milovidov
a0b9bf5e97 Moved code to cpp [#CLICKHOUSE-2]. 2017-04-08 04:32:05 +03:00
Alexey Milovidov
ab314a47bf Moved headers and sources to same place (part 2) [#CLICKHOUSE-3]. 2017-04-01 13:08:56 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Igor
a5937ed024 Incriment max_size in Dictionaries:RegionsNames & RegionsHierarchy up to 15M 2017-03-30 14:44:30 +03:00
proller
8a9d9dddb4 Allow build with poco with disabled MongoDB or DataODBC or NetSSL (#636)
* partial poco support

* fix

* fix optional ssl

* servier without netssl

* fix link order

* testme

* requested changes

* throw on https listen, shutdown tip
2017-03-28 23:30:57 +03:00
Alexey Milovidov
14c8003081 Normalized formatting [#CLICKHOUSE-3].
Apply in a loop:
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '^(\t*)    ' | xargs sed -i -r -e 's/^(\t*)    /\1\t/'
2017-03-26 04:28:07 +03:00
Alexey Milovidov
edd405ef29 Merge branch 'docs/translate' of https://github.com/f1yegor/ClickHouse into f1yegor-docs/translate 2017-03-26 04:17:58 +03:00
Alexey Milovidov
e6ba252507 Hierarchical dictionaries performance: continued [#CLICKHOUSE-2144]. 2017-03-26 03:42:01 +03:00
Alexey Milovidov
d4992da546 Implemented isIn methods for cache dictionaries [#CLICKHOUSE-2144]. 2017-03-26 02:42:04 +03:00
f1yegor
bc0d9a2cae translate comments 2017-03-25 21:12:56 +01:00
Alexey Milovidov
9e7813686e Merge branch 'master' into hierarchical-dictionaries-performance 2017-03-25 20:53:41 +03:00
alexey-milovidov
6d5bfc8c6f Refactoring of numeric DataTypes (#581)
* Better code [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-03-12 14:13:45 +04:00
proller
1af6311a99 https server (#561)
* https support in dictionaries

* Style

* Update README.md

* https server wip

* wip

* cf

* wip

* add test

* wip

* wip

* wip

* wip

* clean

* cmt
2017-03-07 23:01:37 +04:00
proller
57c336f267 HTTPDictionarySource support HTTPS (#510)
* https support in dictionaries

* Style
2017-02-28 01:07:57 +04:00
proller
1c1b6ce9f5 Mongo: support new sha1 auth with new external poco 1.7.8 (#518)
* Mongo: support new sha1 auth with new external poco 1.7.8

* add test

* disable test
2017-02-21 23:24:02 +04:00
proller
7df722d731 Speedup of CacheDictionary (part2: complex) [#CLICKHOUSE-2176] (#502)
* Auto version update to [54146]

* Fixing dictionaries [#CLICKHOUSE-2176]

* fix

* Auto version update to [54194]

* Revert "Auto version update to [54194]"

This reverts commit 3367678a04.

* wip

* wip

* clean

* const

* fix

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* Fixing dictionaries [#CLICKHOUSE-2176]

* style

* style

* style

* wip

* wip

* struct

* clean

* clean

* clean

* wip

* wip broken

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* clean

* space

* tester

* wip

* fix

* clean

* style
2017-02-18 00:37:03 +04:00
proller
2ec141d5e9 Speedup of CacheDictionary (part1) [#CLICKHOUSE-2176] (#474)
* Auto version update to [54146]

* Fixing dictionaries [#CLICKHOUSE-2176]

* fix

* Auto version update to [54194]

* Revert "Auto version update to [54194]"

This reverts commit 3367678a04.

* wip

* wip

* clean

* const

* fix

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* Fixing dictionaries [#CLICKHOUSE-2176]

* style

* style

* style

* struct

* clean

* clean

* clean
2017-02-14 22:06:21 +04:00
proller
f8d2f19280 Fix odbc include, clang-format fixes, misc (#484)
* Cmake: fix fallback to internal libs if no external found

* wip

* style

* fix
2017-02-13 17:59:34 +04:00
Pavel Kartavyy
b28f41250c RegionNames: add ability to set directory without config 2017-02-08 20:39:20 +03:00
Pavel Kartavyy
fb5ff00c4a RegionsHierarchies add missed ctor for tests 2017-02-07 15:25:18 +03:00
proller
7b397b89cd Add missing counters [#CLICKHOUSE-2197] (#439)
* Add missing counters [#CLICKHOUSE-2197]

* ../../tests/external_dictionaries/generate_and_test.py : allow not break tests when one type fail
2017-02-02 22:11:00 +04:00
proller
b8f1ea4805 Fix reloading http dictionaries [#CLICKHOUSE-2176] (#433)
* Fixing dictionaries [#CLICKHOUSE-2176]
2017-02-01 20:53:18 +03:00
artpaul
5c1d2af4d8 check keys inside attribute section of dictionary's config [#CLICKHOUSE-2044] 2017-01-31 18:27:02 +05:00
proller
f04dffc05c External dictionary profiling [#CLICKHOUSE-2197] (#381)
* Profiling external cached dictonaries [#CLICKHOUSE-2197]

* style
2017-01-25 22:40:44 +04:00
alexey-milovidov
ed5b521110 Less dependencies 2 (#378)
* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].
2017-01-21 08:24:28 +04:00
proller
2fe033d00e Fix compiling in freebsd/clang 2017-01-17 18:03:32 +00:00
Alexey Milovidov
06b2404e6a Merge branch 'master' into hierarchical-dictionaries-performance
Conflicts:
	dbms/include/DB/Functions/FunctionsDictionaries.h
2017-01-17 03:31:31 +03:00
Alexey Milovidov
4fe2a4432a External dictionaries: MySQL source: Allow columns with names from reserved words [#CLICKHOUSE-2717]. 2017-01-14 05:30:03 +03:00
Alexey Milovidov
d89ee33ce2 Squashed commit of the following:
commit c567d4e1fe
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:35:01 2017 +0300

    Style [#METR-2944].

commit 26bf3e1228
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:33:11 2017 +0300

    Miscellaneous [#METR-2944].

commit eb946f4c6f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:30:19 2017 +0300

    Miscellaneous [#METR-2944].

commit 78c867a147
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:11:41 2017 +0300

    Miscellaneous [#METR-2944].

commit 6604c5c83c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:56:15 2017 +0300

    Miscellaneous [#METR-2944].

commit 23fbf05c1d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:47:52 2017 +0300

    Miscellaneous [#METR-2944].

commit 98772faf11
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:46:05 2017 +0300

    Miscellaneous [#METR-2944].

commit 3dc636ab9f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:39:46 2017 +0300

    Miscellaneous [#METR-2944].

commit 3e16aee954
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:38:03 2017 +0300

    Miscellaneous [#METR-2944].

commit ae7e7e90eb
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:34:15 2017 +0300

    Miscellaneous [#METR-2944].
2017-01-06 20:41:19 +03:00
Alexey Milovidov
ca37f28b5f Renamed methods Block::rows and Block::rowsInFirstColumn [#METR-2944]. 2017-01-02 23:45:27 +03:00
Alexey Milovidov
2b4f3b5d34 Renamed method (less confusion) [#METR-2944]. 2017-01-02 23:12:12 +03:00
Alexey Milovidov
5fe11c0697 Fixed MongoDBDictionarySource [#METR-2944]. 2016-12-20 23:48:40 +03:00
Alexey Milovidov
a3e22e10d9 MongoDBDictionarySource: fixed error [#METR-2944]. 2016-12-20 05:31:25 +03:00
Alexey Milovidov
47b75e6c1e MongoDBDictionarySource: preparation [#METR-2944]. 2016-12-20 04:20:59 +03:00
Alexey Milovidov
9ab111640c Fixed error after changing MongoDB driver for external dictionaries [#METR-2944]. 2016-12-16 02:40:30 +03:00
proller
357d995e75 Dictonary: executable: rename 'path' to 'command' [#METR-23466] 2016-12-14 00:28:31 +03:00
Alexey Milovidov
fbb0a3e734 Working on performance of hierarchical external dictionaries [#METR-23747]. 2016-12-14 00:15:27 +03:00
Alexey Milovidov
dd1636abdd Improved performance of 'flat' and 'hashed' hierarchical external dictionaries [#METR-23747]. 2016-12-13 00:37:57 +03:00
Alexey Milovidov
599308aef0 Get rid of obsolete mongodb client library [#METR-23791]. 2016-12-11 12:43:16 +03:00
Alexey Milovidov
a8eedafcd0 Fixed error in cached dictionary when using C++11 ABI [#METR-23764]. 2016-12-08 07:56:52 +03:00
Alexey Milovidov
2dc425b7e6 Preparation [#METR-23747]. 2016-12-08 06:04:30 +03:00
Alexey Milovidov
514715589b Preparation [#METR-23747]. 2016-12-08 05:49:04 +03:00
proller
5e6cac10e5 no copypaste 2016-11-27 16:01:35 +03:00
proller
2aeb488d96 add writePrefix 2016-11-25 23:37:06 +03:00
proller
40e674407f return http write callback 2016-11-25 03:16:20 +03:00
proller
e6d3c8855e http ook 2016-11-24 22:57:24 +03:00
proller
2e02e29652 wip 2016-11-24 04:01:11 +03:00
proller
43e057d5e9 dont use OwningBufferBlockInputStream 2016-11-24 02:49:46 +03:00
proller
8f573d7308 clean 2016-11-24 01:44:53 +03:00
proller
e280569453 Everything [maybe] works! 2016-11-22 18:03:54 +03:00
proller
ee2d9503c8 wip 2016-11-19 03:56:15 +03:00
proller
fd3a9da076 httd dict wip 2016-11-19 03:07:58 +03:00
proller
02b4a4aded wip 2016-11-18 23:20:08 +03:00
proller
63eaa97086 wip 2016-11-18 04:48:13 +03:00
proller
cc0e0e739e ExecutableDictionarySource ok 2016-11-17 04:09:46 +03:00
proller
5c9d42d4f4 wip 2016-11-17 00:02:07 +03:00
proller
099edebc28 wip 2016-11-16 03:34:57 +03:00
proller
8fec8e2ac4 simple get works 2016-11-16 02:55:45 +03:00
proller
60ec3506a9 wip 2016-11-16 01:05:49 +03:00
proller
593e3c26bf initial 2016-11-15 22:51:06 +03:00
Vladimir Smirnov
d36f52502e Make it compilable on OS X
It's still hackish and dirty, but server and client compies.

Server starts, but throwes meaningless exception on any query.

Client seems to be working fine.

Linux compilation might (but shouldn't) be broken (not tested).
2016-11-01 17:59:21 +01:00
Yuri Dyachenko
06032a6737 use 'std::vector<bool> loaded_ids' for FlatDictionary::has() 2016-08-25 23:09:58 +03:00
Alexey Milovidov
6c861fe798 Style [#METR-2807]. 2016-08-07 12:09:18 +03:00
Alexey Milovidov
11d6962797 Fixed error [#MOBMET-3953]. 2016-08-07 11:30:29 +03:00
Alexey Milovidov
6d614f2f96 Fixed error [#MOBMET-3953]. 2016-08-07 11:23:44 +03:00
Alexey Milovidov
0ae29e867b Less wrong [#MOBMET-3953]. 2016-08-07 11:12:58 +03:00
Alexey Milovidov
7dfcdbfb86 Fixed error in ComplexKeyCacheDictionary [#MOBMET-3953]. 2016-08-07 09:10:15 +03:00
Alexey Milovidov
6f4fc79cde Better [#METR-2944]. 2016-07-31 06:53:16 +03:00
Alexey Milovidov
55ed2904f4 Allowed for certain aggregate functions to have case insensitive names for compatibility [#METR-22087]. 2016-07-14 08:22:09 +03:00
Alexey Milovidov
1fdbfff503 Fixed error [#METR-21527]. 2016-06-08 03:49:45 +03:00
Alexey Milovidov
7fe425f228 Addition to prev. revision [#METR-21527]. 2016-06-08 00:12:13 +03:00
Alexey Milovidov
3ecfca51ba Splitted dictionaries to separate translation units [#METR-21527]. 2016-06-08 00:07:44 +03:00
Vladimir Chebotarev
70feb3fdfd dbms: Moved some methods to cpp. [#METR-21516] 2016-06-05 18:21:35 +03:00
Vladimir Chebotarev
0403019a77 dbms: Minor improvement. [#METR-21516] 2016-06-05 18:19:31 +03:00
Vladimir Chebotarev
dc404c165c dbms: Minor improvement. [#METR-21516] 2016-05-29 08:39:24 +03:00
Vladimir Chebotarev
42e6374087 dbms: Build fix. [#METR-21516] 2016-05-29 04:36:19 +03:00
Vladimir Chebotarev
d1f7302d96 dbms: Declared max_block_size. [#METR-21516] 2016-05-29 04:12:10 +03:00