Commit Graph

322 Commits

Author SHA1 Message Date
proller
4c7dd6ff8b Freebsd and macos fixes 2017-06-15 22:39:35 +03:00
Nikolai Kochetov
221c05402f fixed bytes_allocated counter for cache dictionaries 2017-06-15 20:31:48 +03:00
Alexey Milovidov
a73790f17d Less dependencies [#CLICKHOUSE-2]. 2017-06-13 08:14:24 +03:00
Alexey Milovidov
a782f81f8f Moved common code from Functions; fixed build after merge [#CLICKHOUSE-2]. 2017-06-13 07:45:30 +03:00
Nikolai Kochetov
2f7f9a328e changed ComplexKeyCacheDictionary key serialization 2017-06-08 20:51:46 +03:00
Nikolai Kochetov
679cccc52d renamed *.hpp to *.h in DictionaryBlickInputStream 2017-06-08 16:35:35 +03:00
Nikolai Kochetov
bff77d1bae merged with master 2017-06-08 15:00:11 +03:00
Alexey Milovidov
9c5ddce06d Get rid of .hpp files [#CLICKHOUSE-2]. 2017-06-06 20:18:32 +03:00
Nikolai Kochetov
04e1a23d1a removed IBlockInputStream.h from IDictionary.h 2017-06-05 13:01:47 +03:00
Nikolai Kochetov
bbd6a1f238 added DictionaryBlockInpustStream support for TrieDictionary 2017-06-05 12:02:05 +03:00
Nikolai Kochetov
334fa11d12 deleted IBlickInputStream.h include form IDictionary.h 2017-05-31 12:05:44 +03:00
Nikolai Kochetov
38e9e837c5 style fixes 2017-05-30 18:02:44 +03:00
Nikolai Kochetov
7c736b12ef added raw serialization functions for IColumn; changed key serialization in ComplexKeyCacheDictionary; style fixes 2017-05-29 20:26:45 +03:00
Nikolai Kochetov
787bf12572 merged with master 2017-05-29 20:23:14 +03:00
Nikolai Kochetov
5fb5397941 added max_block_size for DictionaryBlockImputStreamBase 2017-05-26 19:08:56 +03:00
Alexey Milovidov
c8ccbd56c0 More correct wording [#CLICKHOUSE-3039]. 2017-05-26 00:00:04 +03:00
Alexey Milovidov
d35a586af2 Fixed deadlock when using executable dictionary source with cache or complex_key_cache layout [#CLICKHOUSE-3039]. 2017-05-25 23:59:14 +03:00
Alexey Milovidov
ccce305d73 Fixed totally wrong code [#CLICKHOUSE-3039]. 2017-05-25 23:17:23 +03:00
Alexey Milovidov
f448c9690c Little better [#CLICKHOUSE-3039]. 2017-05-25 23:09:48 +03:00
Alexey Milovidov
e05547f4f8 Little better [#CLICKHOUSE-3039]. 2017-05-25 22:52:05 +03:00
Alexey Milovidov
7a5c0a3cc2 Style [#CLICKHOUSE-3039]. 2017-05-25 22:36:03 +03:00
Alexey Milovidov
22a0da824f Fixed bad code (again) [#CLICKHOUSE-3039]. 2017-05-25 22:27:23 +03:00
Alexey Milovidov
6f5dcb1d84 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 22:26:17 +03:00
Alexey Milovidov
4fd2714a74 Fixed bad code [#CLICKHOUSE-3039]. 2017-05-25 22:21:57 +03:00
Alexey Milovidov
fedd829803 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 21:24:47 +03:00
Alexey Milovidov
91f9009cc4 Fixed build [#CLICKHOUSE-2955]. 2017-05-24 01:34:52 +03:00
Alexey Milovidov
c24f4c57af Style; removed useless catch [#CLICKHOUSE-2955]. 2017-05-23 19:36:07 +03:00
Nikolai Kochetov
db3fbd91b7 added readInvalidateQuery 2017-05-22 19:46:14 +03:00
Nikolai Kochetov
86e63d2bba added readInvalidateQuery for uniform reading from BlockInputStream 2017-05-22 19:38:24 +03:00
Nikolai Kochetov
df087a2e98 merged with master 2017-05-16 13:06:45 +03:00
Nikolai Kochetov
16256503ec merged with master 2017-05-16 13:03:06 +03:00
Nikolai Kochetov
7398062010 added undate by invalidate_query for MySql and ODBC dictionary sources 2017-05-15 17:16:10 +03:00
Marek Vavruša
9520234365 Dictionaries/TrieDictionary: IP prefix dictionary
This commit implements a basic IP prefix dictionary
that allows storing IPv4/IPv6 prefixes and
matching them against a single IP address on query
time. This allows for doing IP -> ASN matching and
other similar things on query time.

The implementation is basic for start, using a
simple bitwise trie and reusing interface for
complex key dictionaries (so using tuple instead
of UInt32/FixedString(16) as the key). A faster
bitwise trie implementation (like poptrie) is
desired to improve lookup performance and
memory consumption with large prefix tables.
2017-05-15 10:51:03 +04:00
Dmitry Bilunov
0c72259c3c mongodb: Avoid compiling DB::authenticate() function unless it is needed 2017-05-05 17:02:34 -07:00
Nikolai Kochetov
1604ce138a changed key storage format for complex key dictionaries 2017-05-04 21:14:23 +03:00
Vitaliy Lyudvichenko
d504c5454a Resolves #750. Allow to load more than 16 external dictionaries. [#CLICKHOUSE-3] 2017-05-03 21:04:58 -07:00
Nikolai Kochetov
79564054a9 added RangeDictionaryBlockInputStream 2017-04-28 21:33:31 +03:00
Nikolai Kochetov
9243439e9b added DictionaryBlockInputStream 2017-04-27 20:16:24 +03:00
Alexey Zatelepin
ba254a082e Merge branch 'master' into lagging-replicas-failover
Conflicts:
	dbms/src/Core/ErrorCodes.cpp
2017-04-19 21:31:29 +03:00
Alexey Zatelepin
485c58b039 use only ConnectionPoolWithFailover in RemoteBlockInputStream [#CLICKHOUSE-2141] 2017-04-19 20:50:17 +03:00
alexey-milovidov
c9c8c8ec50 Better option to disable mysqlclient (#710)
* Better support for disabling libmysqlclient [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-04-19 03:25:57 +03:00
f1yegor
b51c6e7592 translate comments 2017-04-17 15:35:21 +03:00
Alexey Milovidov
41e97787e3 Less dependencies [#CLICKHOUSE-2]. 2017-04-16 08:40:17 +03:00
proller
38e9254d33 fix http methods for ReadWriteBufferFromHTTP (#675) 2017-04-11 17:13:19 +03:00
Alexey Milovidov
a0b9bf5e97 Moved code to cpp [#CLICKHOUSE-2]. 2017-04-08 04:32:05 +03:00
Alexey Milovidov
ab314a47bf Moved headers and sources to same place (part 2) [#CLICKHOUSE-3]. 2017-04-01 13:08:56 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Igor
a5937ed024 Incriment max_size in Dictionaries:RegionsNames & RegionsHierarchy up to 15M 2017-03-30 14:44:30 +03:00
proller
8a9d9dddb4 Allow build with poco with disabled MongoDB or DataODBC or NetSSL (#636)
* partial poco support

* fix

* fix optional ssl

* servier without netssl

* fix link order

* testme

* requested changes

* throw on https listen, shutdown tip
2017-03-28 23:30:57 +03:00
Alexey Milovidov
14c8003081 Normalized formatting [#CLICKHOUSE-3].
Apply in a loop:
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '^(\t*)    ' | xargs sed -i -r -e 's/^(\t*)    /\1\t/'
2017-03-26 04:28:07 +03:00
Alexey Milovidov
edd405ef29 Merge branch 'docs/translate' of https://github.com/f1yegor/ClickHouse into f1yegor-docs/translate 2017-03-26 04:17:58 +03:00
Alexey Milovidov
e6ba252507 Hierarchical dictionaries performance: continued [#CLICKHOUSE-2144]. 2017-03-26 03:42:01 +03:00
Alexey Milovidov
d4992da546 Implemented isIn methods for cache dictionaries [#CLICKHOUSE-2144]. 2017-03-26 02:42:04 +03:00
f1yegor
bc0d9a2cae translate comments 2017-03-25 21:12:56 +01:00
Alexey Milovidov
9e7813686e Merge branch 'master' into hierarchical-dictionaries-performance 2017-03-25 20:53:41 +03:00
alexey-milovidov
6d5bfc8c6f Refactoring of numeric DataTypes (#581)
* Better code [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-03-12 14:13:45 +04:00
proller
1af6311a99 https server (#561)
* https support in dictionaries

* Style

* Update README.md

* https server wip

* wip

* cf

* wip

* add test

* wip

* wip

* wip

* wip

* clean

* cmt
2017-03-07 23:01:37 +04:00
proller
57c336f267 HTTPDictionarySource support HTTPS (#510)
* https support in dictionaries

* Style
2017-02-28 01:07:57 +04:00
proller
1c1b6ce9f5 Mongo: support new sha1 auth with new external poco 1.7.8 (#518)
* Mongo: support new sha1 auth with new external poco 1.7.8

* add test

* disable test
2017-02-21 23:24:02 +04:00
proller
7df722d731 Speedup of CacheDictionary (part2: complex) [#CLICKHOUSE-2176] (#502)
* Auto version update to [54146]

* Fixing dictionaries [#CLICKHOUSE-2176]

* fix

* Auto version update to [54194]

* Revert "Auto version update to [54194]"

This reverts commit 3367678a04.

* wip

* wip

* clean

* const

* fix

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* Fixing dictionaries [#CLICKHOUSE-2176]

* style

* style

* style

* wip

* wip

* struct

* clean

* clean

* clean

* wip

* wip broken

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* clean

* space

* tester

* wip

* fix

* clean

* style
2017-02-18 00:37:03 +04:00
proller
2ec141d5e9 Speedup of CacheDictionary (part1) [#CLICKHOUSE-2176] (#474)
* Auto version update to [54146]

* Fixing dictionaries [#CLICKHOUSE-2176]

* fix

* Auto version update to [54194]

* Revert "Auto version update to [54194]"

This reverts commit 3367678a04.

* wip

* wip

* clean

* const

* fix

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* Fixing dictionaries [#CLICKHOUSE-2176]

* style

* style

* style

* struct

* clean

* clean

* clean
2017-02-14 22:06:21 +04:00
proller
f8d2f19280 Fix odbc include, clang-format fixes, misc (#484)
* Cmake: fix fallback to internal libs if no external found

* wip

* style

* fix
2017-02-13 17:59:34 +04:00
Pavel Kartavyy
b28f41250c RegionNames: add ability to set directory without config 2017-02-08 20:39:20 +03:00
Pavel Kartavyy
fb5ff00c4a RegionsHierarchies add missed ctor for tests 2017-02-07 15:25:18 +03:00
proller
7b397b89cd Add missing counters [#CLICKHOUSE-2197] (#439)
* Add missing counters [#CLICKHOUSE-2197]

* ../../tests/external_dictionaries/generate_and_test.py : allow not break tests when one type fail
2017-02-02 22:11:00 +04:00
proller
b8f1ea4805 Fix reloading http dictionaries [#CLICKHOUSE-2176] (#433)
* Fixing dictionaries [#CLICKHOUSE-2176]
2017-02-01 20:53:18 +03:00
artpaul
5c1d2af4d8 check keys inside attribute section of dictionary's config [#CLICKHOUSE-2044] 2017-01-31 18:27:02 +05:00
proller
f04dffc05c External dictionary profiling [#CLICKHOUSE-2197] (#381)
* Profiling external cached dictonaries [#CLICKHOUSE-2197]

* style
2017-01-25 22:40:44 +04:00
alexey-milovidov
ed5b521110 Less dependencies 2 (#378)
* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].
2017-01-21 08:24:28 +04:00
proller
2fe033d00e Fix compiling in freebsd/clang 2017-01-17 18:03:32 +00:00
Alexey Milovidov
06b2404e6a Merge branch 'master' into hierarchical-dictionaries-performance
Conflicts:
	dbms/include/DB/Functions/FunctionsDictionaries.h
2017-01-17 03:31:31 +03:00
Alexey Milovidov
4fe2a4432a External dictionaries: MySQL source: Allow columns with names from reserved words [#CLICKHOUSE-2717]. 2017-01-14 05:30:03 +03:00
Alexey Milovidov
d89ee33ce2 Squashed commit of the following:
commit c567d4e1fe
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:35:01 2017 +0300

    Style [#METR-2944].

commit 26bf3e1228
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:33:11 2017 +0300

    Miscellaneous [#METR-2944].

commit eb946f4c6f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:30:19 2017 +0300

    Miscellaneous [#METR-2944].

commit 78c867a147
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:11:41 2017 +0300

    Miscellaneous [#METR-2944].

commit 6604c5c83c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:56:15 2017 +0300

    Miscellaneous [#METR-2944].

commit 23fbf05c1d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:47:52 2017 +0300

    Miscellaneous [#METR-2944].

commit 98772faf11
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:46:05 2017 +0300

    Miscellaneous [#METR-2944].

commit 3dc636ab9f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:39:46 2017 +0300

    Miscellaneous [#METR-2944].

commit 3e16aee954
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:38:03 2017 +0300

    Miscellaneous [#METR-2944].

commit ae7e7e90eb
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:34:15 2017 +0300

    Miscellaneous [#METR-2944].
2017-01-06 20:41:19 +03:00
Alexey Milovidov
ca37f28b5f Renamed methods Block::rows and Block::rowsInFirstColumn [#METR-2944]. 2017-01-02 23:45:27 +03:00
Alexey Milovidov
2b4f3b5d34 Renamed method (less confusion) [#METR-2944]. 2017-01-02 23:12:12 +03:00
Alexey Milovidov
5fe11c0697 Fixed MongoDBDictionarySource [#METR-2944]. 2016-12-20 23:48:40 +03:00
Alexey Milovidov
a3e22e10d9 MongoDBDictionarySource: fixed error [#METR-2944]. 2016-12-20 05:31:25 +03:00
Alexey Milovidov
47b75e6c1e MongoDBDictionarySource: preparation [#METR-2944]. 2016-12-20 04:20:59 +03:00
Alexey Milovidov
9ab111640c Fixed error after changing MongoDB driver for external dictionaries [#METR-2944]. 2016-12-16 02:40:30 +03:00
proller
357d995e75 Dictonary: executable: rename 'path' to 'command' [#METR-23466] 2016-12-14 00:28:31 +03:00
Alexey Milovidov
fbb0a3e734 Working on performance of hierarchical external dictionaries [#METR-23747]. 2016-12-14 00:15:27 +03:00
Alexey Milovidov
dd1636abdd Improved performance of 'flat' and 'hashed' hierarchical external dictionaries [#METR-23747]. 2016-12-13 00:37:57 +03:00
Alexey Milovidov
599308aef0 Get rid of obsolete mongodb client library [#METR-23791]. 2016-12-11 12:43:16 +03:00
Alexey Milovidov
a8eedafcd0 Fixed error in cached dictionary when using C++11 ABI [#METR-23764]. 2016-12-08 07:56:52 +03:00
Alexey Milovidov
2dc425b7e6 Preparation [#METR-23747]. 2016-12-08 06:04:30 +03:00
Alexey Milovidov
514715589b Preparation [#METR-23747]. 2016-12-08 05:49:04 +03:00
proller
5e6cac10e5 no copypaste 2016-11-27 16:01:35 +03:00
proller
2aeb488d96 add writePrefix 2016-11-25 23:37:06 +03:00
proller
40e674407f return http write callback 2016-11-25 03:16:20 +03:00
proller
e6d3c8855e http ook 2016-11-24 22:57:24 +03:00
proller
2e02e29652 wip 2016-11-24 04:01:11 +03:00
proller
43e057d5e9 dont use OwningBufferBlockInputStream 2016-11-24 02:49:46 +03:00
proller
8f573d7308 clean 2016-11-24 01:44:53 +03:00
proller
e280569453 Everything [maybe] works! 2016-11-22 18:03:54 +03:00
proller
ee2d9503c8 wip 2016-11-19 03:56:15 +03:00
proller
fd3a9da076 httd dict wip 2016-11-19 03:07:58 +03:00
proller
02b4a4aded wip 2016-11-18 23:20:08 +03:00
proller
63eaa97086 wip 2016-11-18 04:48:13 +03:00
proller
cc0e0e739e ExecutableDictionarySource ok 2016-11-17 04:09:46 +03:00
proller
5c9d42d4f4 wip 2016-11-17 00:02:07 +03:00
proller
099edebc28 wip 2016-11-16 03:34:57 +03:00
proller
8fec8e2ac4 simple get works 2016-11-16 02:55:45 +03:00
proller
60ec3506a9 wip 2016-11-16 01:05:49 +03:00
proller
593e3c26bf initial 2016-11-15 22:51:06 +03:00
Vladimir Smirnov
d36f52502e Make it compilable on OS X
It's still hackish and dirty, but server and client compies.

Server starts, but throwes meaningless exception on any query.

Client seems to be working fine.

Linux compilation might (but shouldn't) be broken (not tested).
2016-11-01 17:59:21 +01:00
Yuri Dyachenko
06032a6737 use 'std::vector<bool> loaded_ids' for FlatDictionary::has() 2016-08-25 23:09:58 +03:00
Alexey Milovidov
6c861fe798 Style [#METR-2807]. 2016-08-07 12:09:18 +03:00
Alexey Milovidov
11d6962797 Fixed error [#MOBMET-3953]. 2016-08-07 11:30:29 +03:00
Alexey Milovidov
6d614f2f96 Fixed error [#MOBMET-3953]. 2016-08-07 11:23:44 +03:00
Alexey Milovidov
0ae29e867b Less wrong [#MOBMET-3953]. 2016-08-07 11:12:58 +03:00
Alexey Milovidov
7dfcdbfb86 Fixed error in ComplexKeyCacheDictionary [#MOBMET-3953]. 2016-08-07 09:10:15 +03:00
Alexey Milovidov
6f4fc79cde Better [#METR-2944]. 2016-07-31 06:53:16 +03:00
Alexey Milovidov
55ed2904f4 Allowed for certain aggregate functions to have case insensitive names for compatibility [#METR-22087]. 2016-07-14 08:22:09 +03:00
Alexey Milovidov
1fdbfff503 Fixed error [#METR-21527]. 2016-06-08 03:49:45 +03:00
Alexey Milovidov
7fe425f228 Addition to prev. revision [#METR-21527]. 2016-06-08 00:12:13 +03:00
Alexey Milovidov
3ecfca51ba Splitted dictionaries to separate translation units [#METR-21527]. 2016-06-08 00:07:44 +03:00
Vladimir Chebotarev
70feb3fdfd dbms: Moved some methods to cpp. [#METR-21516] 2016-06-05 18:21:35 +03:00
Vladimir Chebotarev
0403019a77 dbms: Minor improvement. [#METR-21516] 2016-06-05 18:19:31 +03:00
Vladimir Chebotarev
dc404c165c dbms: Minor improvement. [#METR-21516] 2016-05-29 08:39:24 +03:00
Vladimir Chebotarev
42e6374087 dbms: Build fix. [#METR-21516] 2016-05-29 04:36:19 +03:00
Vladimir Chebotarev
d1f7302d96 dbms: Declared max_block_size. [#METR-21516] 2016-05-29 04:12:10 +03:00