Commit Graph

182 Commits

Author SHA1 Message Date
Alexey Milovidov
366ad1595e Fixed warning on clang 6 [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
alexey-milovidov
d4d266fa18 ColumnConst unification (#1011)
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Alexey Zatelepin
5e61a56743 always initialize trie ptr (just in case) [#CLICKHOUSE-3087] 2017-07-12 16:35:05 +03:00
Alexey Zatelepin
4d4387f1c8 fix reloading of TrieDictionary [#CLICKHOUSE-3087] 2017-07-12 16:35:05 +03:00
Alexey Milovidov
86eb4d2d06 Renamed Singleton to avoid conflicts with Arcadia* codebase [#DEVTOOLS-3343].
* - "Arcadia" is the name of Yandex's monorepo.
2017-07-10 07:34:14 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921)
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
2017-06-23 23:22:35 +03:00
proller
8ef51bf19b Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers (#905)
* Fix missing includes

* ComplexKeyCacheDictionary: Move includes to .cpp

* Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers

* Multiplatform memory size getter

* Requested changes

* Requested changes

* Requested changes

* fix

* Requested changes
2017-06-22 18:57:37 +03:00
Vitaliy Lyudvichenko
a098fb170a Avoid creating multiple global Context. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
proller
4c7dd6ff8b Freebsd and macos fixes 2017-06-15 22:39:35 +03:00
Nikolai Kochetov
221c05402f fixed bytes_allocated counter for cache dictionaries 2017-06-15 20:31:48 +03:00
Alexey Milovidov
a73790f17d Less dependencies [#CLICKHOUSE-2]. 2017-06-13 08:14:24 +03:00
Alexey Milovidov
a782f81f8f Moved common code from Functions; fixed build after merge [#CLICKHOUSE-2]. 2017-06-13 07:45:30 +03:00
Nikolai Kochetov
2f7f9a328e changed ComplexKeyCacheDictionary key serialization 2017-06-08 20:51:46 +03:00
Nikolai Kochetov
679cccc52d renamed *.hpp to *.h in DictionaryBlickInputStream 2017-06-08 16:35:35 +03:00
Nikolai Kochetov
bff77d1bae merged with master 2017-06-08 15:00:11 +03:00
Alexey Milovidov
9c5ddce06d Get rid of .hpp files [#CLICKHOUSE-2]. 2017-06-06 20:18:32 +03:00
Nikolai Kochetov
04e1a23d1a removed IBlockInputStream.h from IDictionary.h 2017-06-05 13:01:47 +03:00
Nikolai Kochetov
bbd6a1f238 added DictionaryBlockInpustStream support for TrieDictionary 2017-06-05 12:02:05 +03:00
Nikolai Kochetov
334fa11d12 deleted IBlickInputStream.h include form IDictionary.h 2017-05-31 12:05:44 +03:00
Nikolai Kochetov
38e9e837c5 style fixes 2017-05-30 18:02:44 +03:00
Nikolai Kochetov
7c736b12ef added raw serialization functions for IColumn; changed key serialization in ComplexKeyCacheDictionary; style fixes 2017-05-29 20:26:45 +03:00
Nikolai Kochetov
787bf12572 merged with master 2017-05-29 20:23:14 +03:00
Nikolai Kochetov
5fb5397941 added max_block_size for DictionaryBlockImputStreamBase 2017-05-26 19:08:56 +03:00
Alexey Milovidov
c8ccbd56c0 More correct wording [#CLICKHOUSE-3039]. 2017-05-26 00:00:04 +03:00
Alexey Milovidov
d35a586af2 Fixed deadlock when using executable dictionary source with cache or complex_key_cache layout [#CLICKHOUSE-3039]. 2017-05-25 23:59:14 +03:00
Alexey Milovidov
ccce305d73 Fixed totally wrong code [#CLICKHOUSE-3039]. 2017-05-25 23:17:23 +03:00
Alexey Milovidov
f448c9690c Little better [#CLICKHOUSE-3039]. 2017-05-25 23:09:48 +03:00
Alexey Milovidov
e05547f4f8 Little better [#CLICKHOUSE-3039]. 2017-05-25 22:52:05 +03:00
Alexey Milovidov
7a5c0a3cc2 Style [#CLICKHOUSE-3039]. 2017-05-25 22:36:03 +03:00
Alexey Milovidov
22a0da824f Fixed bad code (again) [#CLICKHOUSE-3039]. 2017-05-25 22:27:23 +03:00
Alexey Milovidov
6f5dcb1d84 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 22:26:17 +03:00
Alexey Milovidov
4fd2714a74 Fixed bad code [#CLICKHOUSE-3039]. 2017-05-25 22:21:57 +03:00
Alexey Milovidov
fedd829803 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 21:24:47 +03:00
Alexey Milovidov
91f9009cc4 Fixed build [#CLICKHOUSE-2955]. 2017-05-24 01:34:52 +03:00
Alexey Milovidov
c24f4c57af Style; removed useless catch [#CLICKHOUSE-2955]. 2017-05-23 19:36:07 +03:00
Nikolai Kochetov
db3fbd91b7 added readInvalidateQuery 2017-05-22 19:46:14 +03:00
Nikolai Kochetov
86e63d2bba added readInvalidateQuery for uniform reading from BlockInputStream 2017-05-22 19:38:24 +03:00
Nikolai Kochetov
df087a2e98 merged with master 2017-05-16 13:06:45 +03:00
Nikolai Kochetov
16256503ec merged with master 2017-05-16 13:03:06 +03:00
Nikolai Kochetov
7398062010 added undate by invalidate_query for MySql and ODBC dictionary sources 2017-05-15 17:16:10 +03:00
Marek Vavruša
9520234365 Dictionaries/TrieDictionary: IP prefix dictionary
This commit implements a basic IP prefix dictionary
that allows storing IPv4/IPv6 prefixes and
matching them against a single IP address on query
time. This allows for doing IP -> ASN matching and
other similar things on query time.

The implementation is basic for start, using a
simple bitwise trie and reusing interface for
complex key dictionaries (so using tuple instead
of UInt32/FixedString(16) as the key). A faster
bitwise trie implementation (like poptrie) is
desired to improve lookup performance and
memory consumption with large prefix tables.
2017-05-15 10:51:03 +04:00
Dmitry Bilunov
0c72259c3c mongodb: Avoid compiling DB::authenticate() function unless it is needed 2017-05-05 17:02:34 -07:00
Nikolai Kochetov
1604ce138a changed key storage format for complex key dictionaries 2017-05-04 21:14:23 +03:00
Vitaliy Lyudvichenko
d504c5454a Resolves #750. Allow to load more than 16 external dictionaries. [#CLICKHOUSE-3] 2017-05-03 21:04:58 -07:00
Nikolai Kochetov
79564054a9 added RangeDictionaryBlockInputStream 2017-04-28 21:33:31 +03:00
Nikolai Kochetov
9243439e9b added DictionaryBlockInputStream 2017-04-27 20:16:24 +03:00
Alexey Zatelepin
ba254a082e Merge branch 'master' into lagging-replicas-failover
Conflicts:
	dbms/src/Core/ErrorCodes.cpp
2017-04-19 21:31:29 +03:00
Alexey Zatelepin
485c58b039 use only ConnectionPoolWithFailover in RemoteBlockInputStream [#CLICKHOUSE-2141] 2017-04-19 20:50:17 +03:00
alexey-milovidov
c9c8c8ec50 Better option to disable mysqlclient (#710)
* Better support for disabling libmysqlclient [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-04-19 03:25:57 +03:00
f1yegor
b51c6e7592 translate comments 2017-04-17 15:35:21 +03:00
Alexey Milovidov
41e97787e3 Less dependencies [#CLICKHOUSE-2]. 2017-04-16 08:40:17 +03:00
proller
38e9254d33 fix http methods for ReadWriteBufferFromHTTP (#675) 2017-04-11 17:13:19 +03:00
Alexey Milovidov
a0b9bf5e97 Moved code to cpp [#CLICKHOUSE-2]. 2017-04-08 04:32:05 +03:00
Alexey Milovidov
ab314a47bf Moved headers and sources to same place (part 2) [#CLICKHOUSE-3]. 2017-04-01 13:08:56 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Igor
a5937ed024 Incriment max_size in Dictionaries:RegionsNames & RegionsHierarchy up to 15M 2017-03-30 14:44:30 +03:00
proller
8a9d9dddb4 Allow build with poco with disabled MongoDB or DataODBC or NetSSL (#636)
* partial poco support

* fix

* fix optional ssl

* servier without netssl

* fix link order

* testme

* requested changes

* throw on https listen, shutdown tip
2017-03-28 23:30:57 +03:00
Alexey Milovidov
14c8003081 Normalized formatting [#CLICKHOUSE-3].
Apply in a loop:
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '^(\t*)    ' | xargs sed -i -r -e 's/^(\t*)    /\1\t/'
2017-03-26 04:28:07 +03:00
Alexey Milovidov
edd405ef29 Merge branch 'docs/translate' of https://github.com/f1yegor/ClickHouse into f1yegor-docs/translate 2017-03-26 04:17:58 +03:00
Alexey Milovidov
e6ba252507 Hierarchical dictionaries performance: continued [#CLICKHOUSE-2144]. 2017-03-26 03:42:01 +03:00
Alexey Milovidov
d4992da546 Implemented isIn methods for cache dictionaries [#CLICKHOUSE-2144]. 2017-03-26 02:42:04 +03:00
f1yegor
bc0d9a2cae translate comments 2017-03-25 21:12:56 +01:00
Alexey Milovidov
9e7813686e Merge branch 'master' into hierarchical-dictionaries-performance 2017-03-25 20:53:41 +03:00
alexey-milovidov
6d5bfc8c6f Refactoring of numeric DataTypes (#581)
* Better code [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-03-12 14:13:45 +04:00
proller
1af6311a99 https server (#561)
* https support in dictionaries

* Style

* Update README.md

* https server wip

* wip

* cf

* wip

* add test

* wip

* wip

* wip

* wip

* clean

* cmt
2017-03-07 23:01:37 +04:00
proller
57c336f267 HTTPDictionarySource support HTTPS (#510)
* https support in dictionaries

* Style
2017-02-28 01:07:57 +04:00
proller
1c1b6ce9f5 Mongo: support new sha1 auth with new external poco 1.7.8 (#518)
* Mongo: support new sha1 auth with new external poco 1.7.8

* add test

* disable test
2017-02-21 23:24:02 +04:00
proller
7df722d731 Speedup of CacheDictionary (part2: complex) [#CLICKHOUSE-2176] (#502)
* Auto version update to [54146]

* Fixing dictionaries [#CLICKHOUSE-2176]

* fix

* Auto version update to [54194]

* Revert "Auto version update to [54194]"

This reverts commit 3367678a04.

* wip

* wip

* clean

* const

* fix

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* Fixing dictionaries [#CLICKHOUSE-2176]

* style

* style

* style

* wip

* wip

* struct

* clean

* clean

* clean

* wip

* wip broken

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* clean

* space

* tester

* wip

* fix

* clean

* style
2017-02-18 00:37:03 +04:00
proller
2ec141d5e9 Speedup of CacheDictionary (part1) [#CLICKHOUSE-2176] (#474)
* Auto version update to [54146]

* Fixing dictionaries [#CLICKHOUSE-2176]

* fix

* Auto version update to [54194]

* Revert "Auto version update to [54194]"

This reverts commit 3367678a04.

* wip

* wip

* clean

* const

* fix

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* Fixing dictionaries [#CLICKHOUSE-2176]

* style

* style

* style

* struct

* clean

* clean

* clean
2017-02-14 22:06:21 +04:00
proller
f8d2f19280 Fix odbc include, clang-format fixes, misc (#484)
* Cmake: fix fallback to internal libs if no external found

* wip

* style

* fix
2017-02-13 17:59:34 +04:00
Pavel Kartavyy
b28f41250c RegionNames: add ability to set directory without config 2017-02-08 20:39:20 +03:00
Pavel Kartavyy
fb5ff00c4a RegionsHierarchies add missed ctor for tests 2017-02-07 15:25:18 +03:00
proller
7b397b89cd Add missing counters [#CLICKHOUSE-2197] (#439)
* Add missing counters [#CLICKHOUSE-2197]

* ../../tests/external_dictionaries/generate_and_test.py : allow not break tests when one type fail
2017-02-02 22:11:00 +04:00
proller
b8f1ea4805 Fix reloading http dictionaries [#CLICKHOUSE-2176] (#433)
* Fixing dictionaries [#CLICKHOUSE-2176]
2017-02-01 20:53:18 +03:00
artpaul
5c1d2af4d8 check keys inside attribute section of dictionary's config [#CLICKHOUSE-2044] 2017-01-31 18:27:02 +05:00
proller
f04dffc05c External dictionary profiling [#CLICKHOUSE-2197] (#381)
* Profiling external cached dictonaries [#CLICKHOUSE-2197]

* style
2017-01-25 22:40:44 +04:00
alexey-milovidov
ed5b521110 Less dependencies 2 (#378)
* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].
2017-01-21 08:24:28 +04:00
proller
2fe033d00e Fix compiling in freebsd/clang 2017-01-17 18:03:32 +00:00
Alexey Milovidov
06b2404e6a Merge branch 'master' into hierarchical-dictionaries-performance
Conflicts:
	dbms/include/DB/Functions/FunctionsDictionaries.h
2017-01-17 03:31:31 +03:00
Alexey Milovidov
4fe2a4432a External dictionaries: MySQL source: Allow columns with names from reserved words [#CLICKHOUSE-2717]. 2017-01-14 05:30:03 +03:00
Alexey Milovidov
d89ee33ce2 Squashed commit of the following:
commit c567d4e1fe
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:35:01 2017 +0300

    Style [#METR-2944].

commit 26bf3e1228
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:33:11 2017 +0300

    Miscellaneous [#METR-2944].

commit eb946f4c6f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:30:19 2017 +0300

    Miscellaneous [#METR-2944].

commit 78c867a147
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:11:41 2017 +0300

    Miscellaneous [#METR-2944].

commit 6604c5c83c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:56:15 2017 +0300

    Miscellaneous [#METR-2944].

commit 23fbf05c1d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:47:52 2017 +0300

    Miscellaneous [#METR-2944].

commit 98772faf11
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:46:05 2017 +0300

    Miscellaneous [#METR-2944].

commit 3dc636ab9f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:39:46 2017 +0300

    Miscellaneous [#METR-2944].

commit 3e16aee954
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:38:03 2017 +0300

    Miscellaneous [#METR-2944].

commit ae7e7e90eb
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:34:15 2017 +0300

    Miscellaneous [#METR-2944].
2017-01-06 20:41:19 +03:00
Alexey Milovidov
ca37f28b5f Renamed methods Block::rows and Block::rowsInFirstColumn [#METR-2944]. 2017-01-02 23:45:27 +03:00
Alexey Milovidov
2b4f3b5d34 Renamed method (less confusion) [#METR-2944]. 2017-01-02 23:12:12 +03:00
Alexey Milovidov
5fe11c0697 Fixed MongoDBDictionarySource [#METR-2944]. 2016-12-20 23:48:40 +03:00
Alexey Milovidov
a3e22e10d9 MongoDBDictionarySource: fixed error [#METR-2944]. 2016-12-20 05:31:25 +03:00
Alexey Milovidov
47b75e6c1e MongoDBDictionarySource: preparation [#METR-2944]. 2016-12-20 04:20:59 +03:00
Alexey Milovidov
9ab111640c Fixed error after changing MongoDB driver for external dictionaries [#METR-2944]. 2016-12-16 02:40:30 +03:00
proller
357d995e75 Dictonary: executable: rename 'path' to 'command' [#METR-23466] 2016-12-14 00:28:31 +03:00
Alexey Milovidov
fbb0a3e734 Working on performance of hierarchical external dictionaries [#METR-23747]. 2016-12-14 00:15:27 +03:00
Alexey Milovidov
dd1636abdd Improved performance of 'flat' and 'hashed' hierarchical external dictionaries [#METR-23747]. 2016-12-13 00:37:57 +03:00
Alexey Milovidov
599308aef0 Get rid of obsolete mongodb client library [#METR-23791]. 2016-12-11 12:43:16 +03:00
Alexey Milovidov
a8eedafcd0 Fixed error in cached dictionary when using C++11 ABI [#METR-23764]. 2016-12-08 07:56:52 +03:00
Alexey Milovidov
2dc425b7e6 Preparation [#METR-23747]. 2016-12-08 06:04:30 +03:00
Alexey Milovidov
514715589b Preparation [#METR-23747]. 2016-12-08 05:49:04 +03:00
proller
5e6cac10e5 no copypaste 2016-11-27 16:01:35 +03:00
proller
2aeb488d96 add writePrefix 2016-11-25 23:37:06 +03:00
proller
40e674407f return http write callback 2016-11-25 03:16:20 +03:00