thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-09 10:00:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
36,741 Commits 8,983 Branches 1,770 Tags 2.1 GiB
b53ec30978
Commit Graph

703 Commits

Author SHA1 Message Date
Vitaly Baranov
da8f67123f Improve error handling in cache dictionaries: 
allow using expired values while the source of a cache dictionary doesn't respond;
clone the source after an error to reset connections;
don't ask the source for a little time after error;
show the last exception in system.dictionaries for a cache dictionary too.
 2019-08-30 12:50:38 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500) 
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
 2019-08-28 23:49:37 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Alexey Milovidov
09ecd865fc Allow to use library dictionary source with ASan. May impose troubles. 2019-08-14 03:26:38 +03:00
alesapin
2ca6c0b1bf Fix bug with memory allocation for string fields in complex key cache dictionary 2019-08-12 12:37:48 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Alexey Milovidov
389cf9fcee Better fix: removed old and bad code #6069 2019-07-20 02:10:55 +03:00
Alexey Milovidov
21165edcb7 Quick fix for initial load of external dictionaries via ODBC 2019-07-20 02:06:15 +03:00
Vitaly Baranov
6d563c51e6 Remove unnecessary try-catch in the constructors of classes derived from IExternalLoadable. 2019-07-17 11:39:36 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors 
Processors
 2019-07-11 19:22:02 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Alexey Milovidov
553e6a273e Two more fixes for PVS-Studio 2019-07-08 03:51:43 +03:00
Alexey Milovidov
3c4784a466 Removed obsolete undocumented embedded dictionaries that were used by Yandex.Metrica 2019-06-27 22:18:28 +03:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Nikolai Kochetov
93b9f3e06a Disable processors for ClickHouseDictionarySource. 2019-06-25 19:41:06 +03:00
Alexey Milovidov
8f77d898f3 Renamed functions for consistency #5704 2019-06-24 17:51:37 +03:00
alexey-milovidov
8e41d89126
Merge pull request #5704 from zhang2014/fix/ISSUES-5697 
ISSUES-5697 fix insert and select query with mysql style identifier
 2019-06-24 17:40:28 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
zhang2014
1786407621 ISSUES-5697 fix insert and select query with mysql style identifier 2019-06-21 13:51:27 +08:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout 
Distributed and remote timeouts
 2019-06-17 13:58:17 +03:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load 
Non-blocking loading of external dictionaries
 2019-06-15 22:15:53 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this 
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
 2019-06-15 15:06:22 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel. 
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
 2019-06-14 22:18:47 +03:00
Alexey Milovidov
c846d0f6af Namespace comments are unneeded according to the code style. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
 2019-06-13 13:43:37 +03:00
Konstantin Podshumok
e60a2fd1ad clickhouse dictionary source: fix timeouts for remotes 2019-06-02 12:43:20 +03:00
comunodi
08c2f183dd Fix complex dict with two keys 2019-06-02 04:22:06 +03:00
comunodi
a964af386c Optimize includes 2019-05-31 00:16:12 +03:00
comunodi
c58effc2af Fix inserting keys with hash map 2019-05-31 00:07:34 +03:00
chertus
3f2e09ac93 Merge branch 'master' into decimal 2019-05-29 13:58:33 +03:00
comunodi
559628575a Merge branch 'master' into add-ext-dict-redis 
# Conflicts:
#	dbms/tests/integration/image/Dockerfile
 2019-05-28 23:20:41 +03:00
comunodi
a8ce7530c9 Put keys in result block only if value exists 2019-05-28 23:06:06 +03:00
chertus
49e12eaa60 remove unused specializations in dictionaries 2019-05-28 22:30:01 +03:00
alexey-milovidov
c5d18dfde1
Merge pull request #5446 from 4ertus2/some 
Disable implicit type conversions in dictGet functions (it's not working)
 2019-05-28 20:34:13 +03:00
chertus
0d77a96b3c disable implicit type conversions in dictGet functions 2019-05-28 17:04:00 +03:00
Azat Khuzhin
0275d62523
Fix element_count for hashed dictionary (do not include duplicates) 2019-05-28 11:25:31 +03:00
comunodi
b3d8ec3e04 Handle Null keys 2019-05-26 18:55:09 +03:00
comunodi
179ad92874 Fix diff with master 2019-05-26 15:58:40 +03:00
comunodi
5ea9bb228c Merge branch 'master' into add-ext-dict-redis 2019-05-26 15:49:35 +03:00
comunodi
ba879d95f7 Unify keys handling 2019-05-26 01:54:56 +03:00
comunodi
1f0afdcf68 Parse all args as strings 2019-05-25 03:28:09 +03:00
comunodi
ccf89f4be6 Change LOG_ERROR to LOG_INFO 2019-05-24 02:43:50 +03:00
chertus
f82ea1c1d5 dictGet() dictGetOrDefault for Decimals 2019-05-23 17:04:33 +03:00
Clément Rodriguez
c4c99c80a1 Make the connection closure parameterized in dictionary.xml 2019-05-23 15:55:00 +02:00
Clément Rodriguez
7b40d37212 Close MySQL connections after usage in MySQLDictionarySource 2019-05-23 15:09:07 +02:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage. 
Also a couple of massive include-refactorings with better forwarding
 2019-05-17 17:34:25 +03:00
proller
c6d0e095e0
Prepare cmake for new contrib/poco (#5062) 2019-04-25 00:33:04 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
proller
525726a5e2
Remove pocoext (#5036) 2019-04-17 20:36:58 +03:00
comunodi
b05113188c Style fix 2019-04-17 13:14:07 +03:00
comunodi
5bc446befe Parse date and datetime from Int64 2019-04-17 04:11:40 +03:00
comunodi
2023575344 Fix build 2019-04-17 02:26:57 +03:00
comunodi
d2427227dd Support complex key with 1 or 2 parts 2019-04-17 02:13:07 +03:00
comunodi
9778f7c2f3 More logs 2019-04-15 04:34:10 +03:00
Gleb-Tretyakov
27d138818d fix invalid memory dereference 2019-04-15 00:21:11 +03:00
comunodi
5849d66975 Use existing ErrorCode to indicate SELECT failure 2019-04-14 20:50:05 +03:00
comunodi
80827b5a9f Build fix 2019-04-14 20:44:44 +03:00
comunodi
f3ead9fe5b Style fix 2019-04-14 20:09:33 +03:00
comunodi
562f48ea96 Optional select db before usage. Use only one column in tests 2019-04-14 20:05:50 +03:00
comunodi
d7771b8a07 Throw exception instead if number of columns mismatch 2019-04-07 12:51:53 +03:00
comunodi
8abffd4f60 Fix build 2019-03-31 00:42:13 +03:00
FawnD2
dfed1579ac Merge branch 'master' into add-ext-dict-redis 
# Conflicts:
#	ci/jobs/quick-build/run.sh
 2019-03-30 16:42:42 +03:00
alesapin
2764401d0f Fix exception 'No message received' 2019-03-29 21:10:03 +03:00
FawnD2
1e014060c9 Merge branch 'master' into add-ext-dict-redis 
# Conflicts:
#	dbms/tests/external_dictionaries/generate_and_test.py
#	dbms/tests/external_dictionaries/run.sh
 2019-03-16 17:14:27 +03:00
Alexey Milovidov
aea3bd2cc9 Fixed potential deadlock in ExternalDictionaries 2019-03-15 03:29:53 +03:00
Alexey Milovidov
9d89cc0fc1 Debugging PODArray 2019-03-08 06:23:02 +03:00
Alexey Milovidov
ddbada6646 Fixed build #4583 2019-03-05 23:34:37 +03:00
Alexey Milovidov
bbaece6900 Fixed error 2019-03-04 22:04:35 +03:00
Alexey Milovidov
af5041532a Logging of internal queries 2019-03-04 21:28:42 +03:00
Alexey Milovidov
5bac476eb1 Make the value of invalidate_query human readable 2019-03-04 21:21:07 +03:00
Alexey Milovidov
e418e4da33 Added logging for invalidate query 2019-03-04 21:20:35 +03:00
Alexey Milovidov
8f4b651679 Rewrite code and added a comment #4551 2019-03-01 19:38:52 +03:00
alexey-milovidov
f74252cff9
Merge pull request #4551 from temoon/temoon-iss-4524 
Set update_time on full executable dictionary update
 2019-03-01 19:09:16 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API 
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
 2019-03-01 16:47:13 +08:00
Tema Novikov
f92210d0fb
Set update_time on full executable dictionary update 
This fixes issue #4524.
 2019-02-28 09:47:48 +03:00
alesapin
7ffd74ca74 Fix UB in IsIn function of cache dictionary and typo in integration test. 2019-02-26 17:52:55 +03:00
alesapin
9d91dbb7c5 Finally add mongo source 2019-02-25 13:45:22 +03:00
Vitaly Baranov
86b204d1c7 IDictionary::getBlockInputStream() function, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:49:03 +03:00
proller
263e69e861
Build fixes (FreeBSD port) (#4397) 2019-02-15 14:46:07 +03:00
comunodi
572463f9c1 Style fix 2019-02-13 03:05:43 +03:00
comunodi
f2eadcfe49 Remove some escaped lines 2019-02-12 14:27:49 +03:00
comunodi
b50625557b Merge remote-tracking branch 'origin/master' into add-ext-dict-redis 2019-02-12 12:35:29 +03:00
comunodi
6e28c22876 Add tests 2019-02-12 12:23:22 +03:00
proller
428f7ce27b Fix split link of dbms/programs/odbc-bridge 2019-02-12 00:43:29 +03:00
Alexey Milovidov
58a6accee5 Updated test #4246 2019-02-10 19:55:12 +03:00
KochetovNicolai
9f971c276f
Merge pull request #3669 from Enmk/ipv4_and_ipv6_domains 
Ipv4 and ipv6 domains
 2019-02-06 18:16:58 +03:00
Alexey Milovidov
b0efd6089c Removed preemptive load of external dictionaries in presence of Dictionary database 2019-02-04 22:45:22 +03:00
Alexey Milovidov
fe94a15092 Merge branch 'master' into dictionaries-user-profile 2019-02-04 17:11:53 +03:00
Vasily Nemkov
2716df8ab2 IPv4 and IPv6 Domain implementation. 
Added:
 * IDataTypeDomain interface;
 * method DataTypeFactory::registerDataTypeDomain for registering domains;
 * DataTypeDomainWithSimpleSerialization domain base class with simple serialization/deserialization;
 * Concrete IPv4 and IPv6 domain implementations: DataTypeDomanIPv6 and DataTypeDomanIPv4;

Updated:
 * IDataType text serialization/deserialization methods;
 * IDataType implementation to use domain for text serialization/deserialization;
 * Refactored implementation of the IPv4/IPv6 functions to use formatIPv4/v6 and parseIPv4/v6 from Common/formatIPv6.h;

Tests:
 * Added test cases for IPv4 and IPv6 domains.
 * Updated IPv4/v6 functions tests to validate more cases;
 * Added performance tests for IPv4 and IPv6 related functions;
 2019-02-04 12:37:46 +03:00
Alexey Milovidov
435a5497dd Addition to prev. revision 2019-01-31 21:16:11 +03:00
proller
ff30a156c9 Fix compile on ARM 
Freebsd fix
 2019-01-31 18:38:21 +03:00
alesapin
95db9b4d76 Merge master 2019-01-29 23:17:52 +03:00
Alexey Milovidov
b57ec0543f Setting user when doing in-process loading of dictionaries (incomplete) 2019-01-29 22:05:32 +03:00
Alexey Milovidov
27b08a7f22 Merge branch 'master' into fixed-clickhouse-localhost-dictionaries 2019-01-29 13:45:06 +03:00
proller
343b31af66 More link with Threads::Threads 2019-01-28 21:21:20 +03:00
Alexey Milovidov
9b2a5c3dec Merge branch 'master' into split-odbc-bridge 2019-01-28 18:15:18 +03:00
Alexey Milovidov
bc4944eed2 Fixed optimization of loading of ClickHouse dictionaries via localhost #1529 2019-01-28 16:26:10 +03:00
comunodi
933906403a Optimize memory consumption 2019-01-28 01:22:18 +03:00
comunodi
cc5678f6cc Merge branch 'master' of https://github.com/yandex/ClickHouse into add-ext-dict-redis 2019-01-27 19:22:51 +03:00
comunodi
b455708eab Use batch query for reading keys 2019-01-27 18:30:51 +03:00
comunodi
741f630141 Support loadIds 2019-01-27 17:57:24 +03:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Ivan Lezhankin
05ab15cc84 Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
Alexey Milovidov
c7b95b5175 Miscellaneous changes for PVS-Studio 2019-01-20 02:27:52 +03:00
Alexey Milovidov
a7c468da8e Merge remote-tracking branch 'origin/master' into global-thread-pool 2019-01-17 21:57:01 +03:00
comunodi
8472b26f07 Fix code highlighting 2019-01-16 04:05:40 +03:00
comunodi
51384fd691 Add basic functionality for dict 2019-01-16 01:08:56 +03:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
proller
7cefef6983
Fix linking in all modes (unbundled, split, ...) (#4037) 2019-01-11 19:52:46 +03:00
Alexey Milovidov
19f4652959 Fixed bugs found by PVS-Studio 2019-01-09 18:44:20 +03:00
Alexey Milovidov
0dfa553fca Added more warnings from clang's -Weverything, that are available in clang 8 2019-01-07 13:40:58 +03:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
Amos Bird
df5b735894 Better writeInt 2019-01-01 19:36:50 +08:00
Alexey Milovidov
d7e25e1439 Always build ODBC bridge as a separate binary #3360 2018-12-14 22:28:37 +03:00
Alexey Milovidov
626c085a06 Removed garbage #3653 2018-12-11 22:00:13 +03:00
proller
5e89894b98 Fix style 2018-12-10 18:50:58 +03:00
proller
c9e98c8deb clang-format of dbms/src/Dictionaries/* 2018-12-10 18:25:45 +03:00
Ivan Lezhankin
6089b26ef0 Fix |RangeHashedDictionary| getter against |ColumnConst| 2018-12-04 16:15:20 +03:00
proller
1cc69100f1 Fix macos build 2018-11-29 17:37:56 +03:00
proller
dd2371e071 CLICKHOUSE-4137 DictionaryFactory, DictionarySourceFactory (#3653) 
* Split ComplexKeyCacheDictionary to faster compile (part2)

* Dictionaries as lib WIP

* wip

* clean

* Fix build with old capnp

* fix

* wip

* fixes

* fix

* clean

* clean

* clean

* wip

* wip

* wip

* flat

* wip

* cache

* clean

* wip

* faster

* fix style

* fixes

* clean

* clean

* Split CacheDictionary.cpp for faster compile

* fix

* fix

* Less memory usage while compiling

* missing file

* format

* Update registerDictionaries.h

* clean
 2018-11-28 14:37:12 +03:00
Alexey Milovidov
c77930fe30 Whitespaces [#CLICKHOUSE-2] 2018-11-26 03:56:50 +03:00
Alexey Milovidov
dbbacf4f87 Added more style checks [#CLICKHOUSE-3] 2018-11-23 21:52:00 +03:00
alexey-milovidov
0822f500f8
Merge pull request #3642 from yandex/odbc_bridge_die_with_server 
ODBC bridge die with server
 2018-11-23 16:44:53 +03:00
alexey-milovidov
2c2d75cceb
Don't allow exceptions without code (#3645) 
* Don't allow exceptions without code #3633

* Don't allow exceptions without code #3633
 2018-11-23 00:19:58 +03:00
alesapin
1e879850bb Kill odbc-bridge with clickhouse-server 2018-11-22 18:59:00 +03:00
Alexey Milovidov
78e72a1962 Little better #3624 2018-11-20 23:09:20 +03:00
Amos Bird
9021bfb2f1 Fix variant assignments 2018-11-15 17:29:53 +08:00
Alexey Milovidov
d1b86225ef Fixed bad code #3565 2018-11-14 04:04:09 +03:00
Alexey Milovidov
69e57187d2 Fixed error; removed unique_ptr #3565 2018-11-13 22:43:17 +03:00
Alexey Milovidov
4b0645cb25 Fixed error in #3565 2018-11-13 21:41:07 +03:00
Amos Bird
6815b25d18 replace std::tuple with std::variant 2018-11-12 03:29:52 +08:00
alexey-milovidov
b1db9ec23c
Merge pull request #3436 from amosbird/master 
Flexible fields assignment
 2018-11-01 20:22:28 +03:00
proller
f86d1a7034 CONTRIB-254 Arcadia fixes (#3475) 
* Macos: set ENABLE_EMBEDDED_COMPILER=0 by default (because contrib/llvm temporary broken under macos)

* \n

* arcadia fix

* fix arcadia link

* wip

* wip

* wip

* fix

* wip

* wip

* fix

* try use users from server dir

* Revert "try use users from server dir"

This reverts commit 79b2c6fd9c.

* Fix logging

* fix

* Update ZooKeeperImpl.h
 2018-11-01 20:07:20 +03:00
Marek Vavruša
d88450db4d DictionarySourceFactory: fix mistaken connect timeout for read timeout 
It looks like this was accidental, as XDBCStorage and bridges use
http_receive_timeout, but the dictionary passes http_connection_timeout,
so it times out on long queries.
 2018-10-31 16:21:23 -07:00
Amos Bird
3cf2177268 Flexible fields assignment 
Field f;

before:

f = Int64(-42);

after:

f = -42;
 2018-10-24 08:47:33 +08:00
alesapin
c951ec7bad CLICKHOUSE-4067: Fixes in odbc dictionaries. Now dictionaries receives bridge path from global config (as it was before). Quotation performed on table and schema independently. Add tests with postgres interaction. Update documentation 2018-10-15 17:49:23 +03:00
Alexey Milovidov
0573b80288 Allow Nullable types in MySQL, ODBC and MongoDB external sources #3284 2018-10-12 05:41:54 +03:00
Alexey Milovidov
4bb8da039f Allow Nullable types in MySQL, ODBC and MongoDB external sources #3284 2018-10-12 05:26:48 +03:00
Alexey Milovidov
d5bfe37879 Allow Nullable types in MySQL, ODBC and MongoDB external sources #3284 2018-10-12 05:09:47 +03:00
alesapin
e68f9d2193 CLICKHOUSE-4055: LibraryDictionarySource -- set null_value from config for absent values 2018-10-11 18:21:12 +03:00
alexey-milovidov
1472e3ae66
Merge pull request #3210 from alex-krash/jdbc-bridge 
External database access unification (jdbc/odbc bridges)
 2018-10-10 02:26:56 +03:00
alexey-milovidov
54e933f9dc
Update DictionarySourceFactory.cpp 2018-10-10 02:21:19 +03:00
alexey-milovidov
a867009747
Merge pull request #3324 from 4ertus2/decimal 
Decimal dictionaries support [CLICKHOUSE-4045]
 2018-10-10 00:49:37 +03:00
CurtizJ
5f2f1f589f interpret empty null_value as default value 2018-10-09 20:43:25 +03:00
Alexandr Krasheninnikov
27f288641e Fix config reference, header inclusion and failed tests 2018-10-09 18:03:41 +03:00
chertus
f21c4c898e Decimal dictionaries support [CLICKHOUSE-4045] 2018-10-08 22:45:17 +03:00
Alexandr Krasheninnikov
82200bc16a Added error codes, bridge startup, fixed destructor in XDBC stuff 2018-10-03 15:10:57 +03:00
Alexander Krasheninnikov
ceea4b9b33 New bridge interaction, quote identifier via api 2018-09-28 05:46:33 +03:00
Nikolai Kochetov
e0521b1abd Fix range boundaries for RangeHashed dictionary. 2018-09-17 21:06:01 +03:00
Nikolai Kochetov
2547fa6c88 Fix BlockInputStream for RangeHashed dictionary. 2018-09-17 18:51:10 +03:00
Alexey Milovidov
5dfc311075 Fixed build #3123 2018-09-14 22:15:11 +03:00
Alexey Milovidov
6688f01cf0 ./utils/check-style/check-style -n #3123 2018-09-14 22:11:48 +03:00
alexey-milovidov
a26e6935da
Merge pull request #3123 from Enmk/Issue_2093_Support_arbitrary_type_for_ranges_in_range_hashed_dictionary 
Added support of int-based types: Int\UInt(8,16,32), Date, DateTime f…
 2018-09-14 22:10:13 +03:00
alexey-milovidov
09b1cafe76
Update RangeHashedDictionary.cpp 2018-09-14 21:44:59 +03:00
alexey-milovidov
be51dccbb7
Merge pull request #3126 from VadimPE/CLICKHOUSE-3476 
[CLICKHOUSE-3476] add invalidate_query for ClickHouse in Dictionary
 2018-09-14 21:18:09 +03:00
alexey-milovidov
f6d048d4f6
Update ClickHouseDictionarySource.cpp 2018-09-14 21:14:17 +03:00
Vasily Nemkov
dbcbce6fe4 More tests for range edge cases and for querying out of range; 
Minor cleanup: removed extra header file.
 2018-09-14 16:42:57 +03:00
VadimPE
38fef408c8 Merge branch 'CLICKHOUSE-3476' of https://github.com/VadimPE/ClickHouse into CLICKHOUSE-3476 2018-09-14 12:34:16 +03:00
VadimPE
62726d53d4 CLICKHOUSE-3476 fix 2018-09-14 12:33:11 +03:00
alexey-milovidov
b824652992
Update DictionarySourceFactory.cpp 2018-09-13 21:58:12 +03:00
Vadim
8d1edbc019
Update ClickHouseDictionarySource.cpp 2018-09-13 18:20:40 +03:00
Vasily Nemkov
99560e06f8 Added support of int-based types: Int\UInt(8,16,32), Date, DateTime for range_hashed dictionary. 
Fixes #2093
Added type checks for .range_min and .range_max
Allowed nullable range values in dictionary source
Added test for range_hashed dictionaries
 2018-09-13 18:19:55 +03:00
VadimPE
d04db2a211 CLICKHOUSE-3476 fix 2018-09-13 18:13:23 +03:00
VadimPE
11955b550f fix 2018-09-13 15:24:34 +03:00
alesapin
c7e073e954 Fix url in invalidate request 2018-09-13 00:34:48 +03:00
alesapin
a44290701d Fix bug in ODBCDictionarySource, copy missed fields in copy constructor 2018-09-13 00:02:06 +03:00
VadimPE
985f2f2704 CLICKHOUSE-3476 fix build 2018-09-11 15:48:18 +03:00
VadimPE
bb7a353e9b CLICKHOUSE-3476 2018-09-11 12:29:02 +03:00
Alexey Milovidov
c7b1a40296 Fixed test [#CLICKHOUSE-2] 2018-09-09 05:23:24 +03:00
proller
db13ef96d6 Fix ssl init (#3056) 
* Try to fix ../libs/libglibc-compatibility/glibc-compatibility.c:151: multiple definition of `explicit_bzero'
contrib/ssl/crypto/libcrypto.a(explicit_bzero.c.o):../contrib/ssl/crypto/compat/explicit_bzero.c:16: first defined here

* Fix ssl init

* fix

* noncopyable

* clean
 2018-09-06 21:05:33 +03:00
Alexey Milovidov
f584344184 Miscellaneous [#CLICKHOUSE-3939] 2018-09-06 05:24:35 +03:00
Alexey Milovidov
d8809eb2a1 Whitespaces [#CLICKHOUSE-3939] 2018-09-06 04:57:55 +03:00
alesapin
aaf5720198 Fix type in odbc source and remove pointer from mongo source 2018-09-05 23:33:45 +03:00
alesapin
cd07fd6246 Remove unused header 2018-09-05 23:22:20 +03:00
alesapin
2d9a62cfe8 Fix MongoDB api call 2018-09-05 23:19:31 +03:00
alesapin
8b7d6ccd8c Small improvements 2018-09-05 19:20:12 +03:00
alesapin
d12ec5c602 Merge branch 'support_uuid_in_external_dicts' of https://github.com/The-Alchemist/ClickHouse into The-Alchemist-support_uuid_in_external_dicts 2018-09-05 16:20:45 +03:00
Alexey Milovidov
5b257c588f Enabling -Wshadow [#CLICKHOUSE-2] 2018-08-27 20:42:13 +03:00
Alexey Milovidov
6e18af7ed3 Enabling -Wshadow [#CLICKHOUSE-2] 2018-08-27 20:18:14 +03:00
Amos Bird
ea84430864 Get rid of useless std::move to get NRVO 
http://eel.is/c++draft/class.copy.elision#:constructor,copy,elision

Some quote:

> Speaking of RVO, return std::move(w); prohibits it. It means "use move constructor or fail to compile", whereas return w; means "use RVO, and if you can't, use move constructor, and if you can't, use copy constructor, and if you can't, fail to compile."

There is one exception to this rule:
```cpp
Block FilterBlockInputStream::removeFilterIfNeed(Block && block)
{
    if (block && remove_filter)
        block.erase(static_cast<size_t>(filter_column));

    return std::move(block);
}
```

because references are not eligible for NRVO, which is another rule "always move rvalue references and forward universal references" that takes precedence.
 2018-08-27 22:15:48 +08:00
Alexey Milovidov
91496574aa Fixed error #2913 2018-08-24 08:45:03 +03:00
Alexey Milovidov
761422da22 Miscellaneous #2913 2018-08-24 08:37:06 +03:00
Alexey Milovidov
6043ea02de Style #2913 2018-08-24 08:25:00 +03:00
Alexey Milovidov
27d43fb7ff Fixed typo #2913 2018-08-24 08:21:53 +03:00
Alexey Milovidov
f4813a47f8 Whitespaces #2913 2018-08-24 08:20:18 +03:00
proller
fc2925b567 Squashed commit of the following: 
commit 2722e540abfee4a527d716474c4ca582eceeee08
Merge: b4f3af824 aebddd550
Author: proller <proller@github.com>
Date:   Tue Aug 21 18:34:18 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit b4f3af824b88a8b6826583bb483730827574e8ad
Author: proller <proller@github.com>
Date:   Tue Aug 21 17:00:20 2018 +0300

    fix

commit 3a18fa7ded2a7d6b7a0883a1b9c2d6b99360837d
Author: proller <proller@github.com>
Date:   Tue Aug 21 16:57:17 2018 +0300

    fix

commit 5d42220c2cf47e1a86bdc73dbfc24b68f8626891
Author: proller <proller@github.com>
Date:   Tue Aug 21 16:50:21 2018 +0300

    freebsd fixes

commit 7baf4fb5ba4575f79b0d12a9ffaaabd34e1006da
Author: proller <proller@github.com>
Date:   Tue Aug 21 16:17:19 2018 +0300

    fix

commit e1fe707fd765b841a8d0952d91a980128cbf91d0
Author: proller <proller@github.com>
Date:   Tue Aug 21 15:35:21 2018 +0300

    fix

commit 027887c71b3ffa98d9473d50d8c3b79cbf3304ac
Author: proller <proller@github.com>
Date:   Tue Aug 21 15:25:57 2018 +0300

    fix

commit 81af41bfcfff7c02fe4060196cf03c2d2aab416e
Author: proller <proller@github.com>
Date:   Tue Aug 21 15:20:41 2018 +0300

    fix

commit 93d572c85d9c7e331254999a614c3b22b5573b02
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:58:07 2018 +0300

    SPLIT_SHARED

commit dd5b8990d8527d59b1e890943d80c2bf27c613ce
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:52:39 2018 +0300

    fix

commit 4840ca12ab752a38c1ef482e8ec59c5859bb48d7
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:46:31 2018 +0300

    fix

commit abde633beb86f2a0d025d6fcf079965dbd827b92
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:25:32 2018 +0300

    fix

commit 0d94a5476a5ba8ba5e88638d58f2cfbf2b4b662d
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:45:18 2018 +0300

    Travis: try fail on ninja fail

commit c2686f90b68255c2beb0a708804aef404e80a6d2
Merge: 2c3427bbd 2aa7eb463
Author: proller <proller@github.com>
Date:   Tue Aug 21 14:25:15 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 2c3427bbdb861edbb188ed4621e8a05cafaedafb
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:57:24 2018 +0300

    fix

commit 530170c6a81d31dcfa81230e48520383234df4bc
Merge: 9abec162c f6e4ec970
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:57:03 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 9abec162cb2e09bbc2f33cbe80fe76791f6e5a77
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:49:58 2018 +0300

    Apple fixes

commit 36d05e8217440fbc8ae21571b06d4eb6d679d538
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:25:05 2018 +0300

    apple fix

commit aeec3e845e4456e89fbb1b1af6f9f36820a46e33
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:20:06 2018 +0300

    fixes

commit 427961d916a5954981e47d94733996deb2a616ce
Author: proller <proller@github.com>
Date:   Mon Aug 20 23:11:11 2018 +0300

    fix

commit a7dd55ff8f653624c0f3dbcbc54defd3b3ae97af
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:41:53 2018 +0300

    fix

commit 6200e0d315c7a62bae63a8de0fc32f7937770ad2
Merge: 8a541d7e6 21cedbe46
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:35:49 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 8a541d7e64c89e2c16af6c909e0353361153aaa3
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:34:32 2018 +0300

    Do not use poco types

commit fd560f43d048b7e3307c6c6b9c9d9918230014d8
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:20:42 2018 +0300

    Try fix apple build

commit cfb2eba07ac06f19e822d3474341d800b1f98cf1
Merge: 8d2e31c90 5b81fdfc0
Author: proller <proller@github.com>
Date:   Mon Aug 20 22:03:24 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix3

commit 8d2e31c908be2e99d09e2a9dde2414ab82a5e93c
Author: proller <proller@github.com>
Date:   Mon Aug 20 21:56:06 2018 +0300

    travis: TEST_SERVER_STARTUP_WAIT=10
 2018-08-21 18:56:50 +03:00
alesapin
f6c9587d0a CLICKHOUSE-3878: Move last interaction with ODBC from main code to bridge, split Handlers file on three different, slightly remove copy-paste code 2018-08-19 20:09:54 +03:00
Amos Bird
57970a8bef
Using correct config ref to initialize odbc bridge 2018-08-17 19:00:42 +08:00
alesapin
6fa4af882f CLICKHOUSE-3878: Build fixes 2018-08-16 01:00:28 +03:00
alesapin
af19d4133d CLICKHOUSE-3878: Move connection string validation to common, remove redundant headers, fix compilation issues 2018-08-14 13:33:41 +03:00
alesapin
83d5dba53b CLICKHOUSE-3878: Move ODBCDictionary to odbc-bridge 2018-08-13 21:10:26 +03:00
Alexey Milovidov
36db216abf Preparation for extra warnings [#CLICKHOUSE-2] 2018-08-10 07:02:56 +03:00
The-Alchemist
a9b3279265 Support for UUID in ODBC dictionaries 2018-08-07 15:09:30 -04:00
Alexey Milovidov
76e06fe0eb Don't escape values of parameters of ODBC connection string if it is not necessarily, because drivers don't recognize them [#CLICKHOUSE-3861] 2018-08-02 08:30:52 +03:00
Alexey Milovidov
60187ab716 Miscellaneous [#CLICKHOUSE-3861] 2018-08-01 21:21:03 +03:00
Alexey Milovidov
1cdbf16837 More tests [#CLICKHOUSE-3861] 2018-08-01 00:25:26 +03:00
alexey-milovidov
0f25e8277c Update validateODBCConnectionString.cpp 2018-08-01 00:25:26 +03:00
alexey-milovidov
369145bd30 Update validateODBCConnectionString.cpp 2018-08-01 00:25:26 +03:00
Alexey Milovidov
c9ab39c8c6 Added validation of ODBC connection string [#CLICKHOUSE-3861] 2018-08-01 00:25:26 +03:00
Alexey Milovidov
c2a50991c9 Minor modifications [#CLICKHOUSE-2] 2018-07-25 03:00:08 +03:00
Alexey Milovidov
245b114363 Quote all identifiers when querying external database #2635 2018-07-20 03:04:48 +03:00
alesapin
56523948bf CLICKHOUSE-3842: Rename local variables 2018-07-19 16:51:57 +03:00
alesapin
ae44b41318 CLICKHOUSE-3842: Fix loadKeys method in dictionary library 2018-07-19 16:51:57 +03:00
Alexey Milovidov
2298f1c68b Fixed strange code #2501 2018-06-16 08:54:06 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492) 
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
 2018-06-10 22:22:49 +03:00
Alexey Milovidov
26d448baad Passing settings to ser/de of data types: development #1710 2018-06-08 04:51:55 +03:00
alesapin
40c2b21b65 Change dictionary shared library api to v3. Both in library and examples. 2018-06-07 20:41:14 +03:00
alesapin
d2bfa25769 Remove unused include 2018-06-07 12:22:27 +03:00
alesapin
2a39f05f99 Shared Library Dict Logging: Replace multiple functions with single one and add logging examples into test libraries 2018-06-06 23:21:16 +03:00
alesapin
1adee7a6c5 Merge remote-tracking branch 'upstream/master' 2018-06-06 17:35:55 +03:00
alesapin
6426e573aa Fix format 2018-06-06 17:35:33 +03:00
Alexey Milovidov
b9b89a5590 Less dependencies [#CLICKHOUSE-2] 2018-06-05 22:46:49 +03:00
Alexander Sapin
5a524a7819 Remove empty lines 2018-06-05 22:20:16 +03:00
Alexander Sapin
4e3dc0d8a2 Introduce logging in shared library dictionaries 2018-06-05 22:17:16 +03:00
Alexey Milovidov
8cb65277e2 Non significant changes according to clang's -Weverything, part 5 [#CLICKHOUSE-2] 2018-06-04 01:11:50 +03:00
Alexey Milovidov
7c60adbebb Non significant changes according to clang's -Weverything, part 4 [#CLICKHOUSE-2] 2018-06-03 23:48:36 +03:00
Alexey Milovidov
f5adbceed2 Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2] 2018-06-03 23:39:06 +03:00
Alexey Milovidov
734cebdf09 Non significant changes according to clang's -Weverything, part 1 [#CLICKHOUSE-2] 2018-06-03 19:51:31 +03:00
Arsen Hakobyan
dfe65ba842 Now uses Poco::URI::addQueryParameter for "update_field" parameter 2018-05-18 19:22:28 +03:00
Arsen Hakobyan
ad9659574f Adds percent encoding for "update_field" parameter 
Handles cases when url has fragment
 2018-05-18 19:22:28 +03:00
sundy-li
8a5990fc74 add integration test_storage_mysql 2018-05-15 03:02:59 +03:00
proller
fb911f7cfa Allow force disable libs: poco netssl poco mongodb, poco data odbc 2018-05-14 21:36:01 +03:00
Alexey Milovidov
956128a67a Fixed style a bit [#CLICKHOUSE-2] 2018-05-07 05:01:11 +03:00
Alexey Milovidov
6388c916de Fixed style; added a comment about terribly wrong code [#CLICKHOUSE-2] 2018-04-19 07:23:58 +03:00
Alexey Milovidov
18bbd0e61b Moved SessionPoolHelpers #2180 2018-04-07 06:07:32 +03:00
proller
e58b0830e6
Prepare to new poco (PocoData renamed to PocoSQL) (#2158) 2018-04-03 04:48:40 -07:00
proller
a6f9df105c Allow use encryption for distributed tables (#2065) 
* Allow use encryption for distributed tables

* wip

* fix

* rename encryption to secure

* Fix DirectoryMonitor with +secure

* fix

* fix

* Update DirectoryMonitor.cpp

* Update DirectoryMonitor.cpp
 2018-03-29 04:41:06 +03:00
Nikolai Kochetov
a399c17f01 && - qualified IColumn::mutate 2018-03-20 17:01:00 +03:00
proller
153fcd6c9f Fix double free in LibraryDictionarySource (#2028) 
* Fix double free in LibraryDictionarySource

* Fix {}

* wip

* wip

* Better Exception

* Fix possible leak
 2018-03-14 02:13:39 +03:00
Alexey Milovidov
b7475b1d2c Fixed error: wrong timeouts passed to ConnectionPoolWithFailover [#CLICKHOUSE-3641] 2018-03-12 23:25:18 +03:00
Alexey Milovidov
3f8ef38b41 Fixed wording #245 2018-03-10 02:23:15 +03:00
Alexey Milovidov
3a5754944e Fixed bug after merge [#CLICKHOUSE-2] 2018-03-08 00:32:35 +03:00
Alexey Milovidov
10a6b5c43f Fixed build after merge [#CLICKHOUSE-2] 2018-03-07 22:20:36 +03:00
alexey-milovidov
bd455283cc
Merge pull request #1771 from joomag/dictionary-update 
Add external dictionary update feature
 2018-03-07 21:48:42 +03:00
Nikolai Kochetov
3f5218bb11 fix DictionaryBlockInputStream::getBlock for empty dictionary 2018-03-07 18:11:23 +03:00
Alexey Milovidov
790b4e3a1b Fixed build #1987 2018-03-02 22:40:44 +03:00
Nikolai Kochetov
5842c35aeb added odbc_default_field_size setting 2018-03-02 15:59:41 +03:00
proller
566d66e858 Dictionary Library source: Persistent per-dictionary custom data store (#1917) 
* LibraryDictionarySource: Support numeric types, initial support for strings

* Dictionary Library source with string types

* clang-format

* Dictionary Library source: Persistent per-dictionary custom data store

* Fix unused

* Allocate -> New

* Update examples

* fix
 2018-02-26 19:57:14 +03:00
Alexey Milovidov
222fb2c945 Miscellaneous [#CLICKHOUSE-2] 2018-02-21 23:23:27 +03:00
Alexey Milovidov
afe09d3138 Removed unused code [#CLICKHOUSE-2] 2018-02-18 06:46:18 +03:00
Alexey Milovidov
754a4296df Header in every stream: fixed non-deterministic test [#CLICKHOUSE-2] 2018-02-18 06:23:48 +03:00
Alexey Milovidov
c320b360c6 Merge branch 'master' of github.com:yandex/ClickHouse into header-in-input-streams 2018-02-16 21:23:29 +03:00
proller
db8ea9205c
LibraryDictionarySource: api v2 with strings (#1915) 
* LibraryDictionarySource: Support numeric types, initial support for strings
 2018-02-16 20:12:22 +03:00
Alexey Milovidov
30b657a0da Header in every stream: development [#CLICKHOUSE-2] 2018-02-15 21:54:12 +03:00
Alexey Milovidov
921e09b5f8 Merge branch 'master' into header-in-input-streams 2018-02-15 19:20:36 +03:00
Arsen Hakobyan
7a77b8abf0 Improvements done according to requested changes 2018-02-15 17:08:23 +04:00
Arsen Hakobyan
8b8c7a64b4 Merge branch 'master' of https://github.com/yandex/ClickHouse into dictionary-update 2018-02-15 12:07:58 +04:00
proller
7c7bdc5115
LibraryDictionarySource: Support numeric types, initial support for strings (#1903) 2018-02-14 18:03:48 +03:00
alexey-milovidov
22263ad627
Update MongoDBDictionarySource.cpp 2018-02-07 20:49:41 +03:00
Павел Литвиненко
95ec20d92a added is_object_id to list of valid config keys 2018-02-07 01:35:47 +03:00