Commit Graph

7696 Commits

Author SHA1 Message Date
Alexey Zatelepin
807570b32f Change tabs to spaces in clickhouse-test [#CLICKHOUSE-3]. 2017-05-19 21:31:48 +03:00
robot-metrika-test
bc2d232494 Auto version update to [54235] 2017-05-17 21:44:16 +04:00
Vitaliy Lyudvichenko
1d00f45dd3 Detect race condition between fetches and merges of the same part. [#CLICKHOUSE-2989] 2017-05-17 21:44:16 +04:00
Nikolai Kochetov
df087a2e98 merged with master 2017-05-16 13:06:45 +03:00
Dmitry Luhtionov
4cc10af7b7 Add MACStringToOUI function 2017-05-16 10:32:49 +04:00
orantius
da83036326 Add age 55 for function roundAge. [#CLICKHOUSE-3001] 2017-05-15 22:42:39 +04:00
Nikolai Kochetov
7398062010 added undate by invalidate_query for MySql and ODBC dictionary sources 2017-05-15 17:16:10 +03:00
Marek Vavruša
9520234365 Dictionaries/TrieDictionary: IP prefix dictionary
This commit implements a basic IP prefix dictionary
that allows storing IPv4/IPv6 prefixes and
matching them against a single IP address on query
time. This allows for doing IP -> ASN matching and
other similar things on query time.

The implementation is basic for start, using a
simple bitwise trie and reusing interface for
complex key dictionaries (so using tuple instead
of UInt32/FixedString(16) as the key). A faster
bitwise trie implementation (like poptrie) is
desired to improve lookup performance and
memory consumption with large prefix tables.
2017-05-15 10:51:03 +04:00
alexey-milovidov
e7b7f6f73d Update MergeTreeData.cpp 2017-05-15 10:34:40 +04:00
Vitaliy Lyudvichenko
6262fc8650 Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2] 2017-05-15 10:34:40 +04:00
f1yegor
92b56c2c7d translate comments 2017-05-14 19:03:55 +04:00
f1yegor
c252863b2e translate comments 2017-05-14 19:03:55 +04:00
Marek Vavruša
95d926ec14 AggregateFunctionTopK: smaller initial table size
By default start with 2^4 elements
2017-05-13 03:58:05 +04:00
Marek Vavruša
74cc0849dc iostream_debug_helpers: fixed build 2017-05-13 03:58:05 +04:00
robot-metrika-test
9d475d34f6 Auto version update to [54234] 2017-05-13 00:05:22 +03:00
Alexey Milovidov
282a395464 Fixed test [#CLICKHOUSE-2]. 2017-05-13 00:03:01 +03:00
Alexey Milovidov
d3a8faee16 Fixed test reference file for aggregate function topK [#CLICKHOUSE-3]. 2017-05-12 23:59:14 +03:00
Alexey Milovidov
cfc4c987c5 Added optional length parameter to aggregate function groupArrayInsertAt [#CLICKHOUSE-3003]. 2017-05-12 23:57:24 +03:00
Alexey Milovidov
40595ce688 Whitespaces [#CLICKHOUSE-3003]. 2017-05-12 23:41:50 +03:00
Alexey Milovidov
1d090bd4e2 AggregateFunctionGroupArrayInsertAt: fixed error [#CLICKHOUSE-3003]. 2017-05-12 23:05:19 +03:00
Alexey Milovidov
3819216085 StorageBuffer: explicitly disable support for PREWHERE, because possibility of wrong query results [#CLICKHOUSE-2999]. 2017-05-12 17:02:24 +03:00
Alexey Milovidov
4b852584ce Whitespaces [#CLICKHOUSE-2]. 2017-05-12 17:01:02 +03:00
Vitaliy Lyudvichenko
021e37943e More clearer code and correct test. [#CLICKHOUSE-1993] 2017-05-12 16:44:11 +03:00
Alexey Milovidov
9ad1d5676a Miscellaneous [#CLICKHOUSE-2]. 2017-05-12 01:21:06 +03:00
Alexey Milovidov
8f0e833b52 Whitespaces [#CLICKHOUSE-2]. 2017-05-11 22:48:46 +03:00
Marek Vavruša
45bd332460 AggregateFunctionTopK: fix memory usage, performance
* allow separate table key / hash key, and use
  std::string / StringRef for generic variant as
  it has built-in storage and StringRef is supported
  by the hash table, this avoids infinitely
  growing arena with serialised keys
* use power-of-2 size for alpha vector for faster
  binning without using modulo
* use custom grower and allocator for SpaceSaving
  to start with smaller tables
* store computed hash in counter for faster
  reinsertion of smallest element
2017-05-11 18:52:49 +04:00
Marek Vavruša
bc878f9785 Common/HashTable: allow cell reinsertion
* fixes missing setHash on reinsert
* reuses hash when emplacing value
2017-05-11 18:52:49 +04:00
Vitaliy Lyudvichenko
0f1627691e Don't forget to ATTACH MATERIALIZED columns. [#CLICKHOUSE-1993] 2017-05-11 18:39:12 +04:00
Dmitry Luhtionov
a21a6caf4e Доюавленф функции FunctionMACNumToString и FunctionMACStringToNum 2017-05-10 08:16:06 -04:00
Alexey Milovidov
66436db836 Added test [#CLICKHOUSE-2]. 2017-05-10 04:46:07 -04:00
Alexey Milovidov
2a57cfdbc2 Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:42:15 -04:00
Alexey Milovidov
21c5ee0f1d Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:41:25 -04:00
Alexey Milovidov
19d0d47c8a Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:40:14 -04:00
Alexey Milovidov
e5e8667bc9 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 04:10:50 -04:00
Alexey Milovidov
a7b9a12759 Returned back Increment and CounterInFile, because they are still needed [#CLICKHOUSE-2]. 2017-05-10 04:08:32 -04:00
Alexey Milovidov
bb41d47096 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:50:37 -04:00
Alexey Milovidov
5ca7650c86 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:49:19 -04:00
Alexey Milovidov
acfe3d5028 Improved performance of inserting into StorageDistributed with very high number of shards (not tested) [#CLICKHOUSE-2]. 2017-05-10 02:39:37 -04:00
Alexey Milovidov
e2f8ec8f2d Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 02:36:15 -04:00
Alexey Milovidov
21af887758 Added aggregate function 'groupArrayInsertAt' (for Graphite) [#CLICKHOUSE-2]. 2017-05-10 01:46:23 -04:00
Alexey Milovidov
b9a7917a8d Tiny modifications [#CLICKHOUSE-2]. 2017-05-10 01:43:27 -04:00
Alexey Milovidov
542eba7e17 Fixed translation errors [#CLICKHOUSE-3]. 2017-05-10 00:30:33 -04:00
Alexey Milovidov
27a324b469 Tiny modifications [#CLICKHOUSE-2]. 2017-05-10 00:29:36 -04:00
Alexey Milovidov
7bf7242ad3 Fixed translation errors; miscellaneous changes [#CLICKHOUSE-3]. 2017-05-10 00:00:19 -04:00
Alexey Milovidov
ff02af9804 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-09 22:45:21 -04:00
Alexey Milovidov
7fc3d90035 Renamed .inl file to .inl.h to avoid confusion [#CLICKHOUSE-2]. 2017-05-09 22:41:26 -04:00
Alexey Milovidov
8e5f92f025 Fixed translation errors, part 1 [#CLICKHOUSE-3]. 2017-05-09 15:07:35 -04:00
f1yegor
46db454562 translate comments 2017-05-09 13:03:35 -04:00
Dmitry Bilunov
11ec4c627d IO/CompressedWriteBuffer: support new LZ4 library 2017-05-06 10:48:30 -04:00
Dmitry Bilunov
0c72259c3c mongodb: Avoid compiling DB::authenticate() function unless it is needed 2017-05-05 17:02:34 -07:00
proller
fac00792f9 Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system 2017-05-05 16:59:18 -07:00
Alexey Milovidov
d3e6321967 AggregateFunctionTopK: minor modifications [#CLICKHOUSE-2]. 2017-05-05 16:36:02 -07:00
Alexey Milovidov
32a75147f5 Merge branch 'master' of github.com:yandex/ClickHouse 2017-05-05 16:35:08 -07:00
Alexey Milovidov
aa629d0f7e Minor modification [#CLICKHOUSE-2]. 2017-05-05 14:25:53 -07:00
Alexey Milovidov
9d4c814b12 Aggregate function topK: style modifications [#CLICKHOUSE-2]. 2017-05-05 14:17:04 -07:00
proller
b1f1096f27 tests: correct Connection refused detection (#766) 2017-05-05 17:50:05 +03:00
proller
9bcece79f9 tests: dont stop on errors by default 2017-05-05 07:19:00 -07:00
proller
6c34f27e3b Another freebsd fix, update freebsd build doc 2017-05-05 03:23:32 +03:00
proller
1474de179c CastTypeBlockInputStream: hotfix: sometimes columns in sample blocks and stream blocks does not match 2017-05-04 22:41:55 +03:00
proller
9a937591e5 Try fix freebsd 11-STABLE OCbuild 2017-05-04 18:25:34 +03:00
Marek Vavruša
5f1e65b252 AggregateFunctions: implemented topK(n)
This implements a new function for approximate
computation of the most frequent entries using
Filtered Space Saving with a merge step adapted
from Parallel Space Saving paper.

It works better for cases where GROUP BY x
is impractical due to high cardinality of x,
such as top IP addresses or top search queries.
2017-05-03 23:09:52 -07:00
proller
0787bd66ff Merge: fail if cant convert columns (#753)
* Merge: fail if cant convert columns

* Merge: convert all different types, more tests

* clean

* clean

* clean
2017-05-03 21:08:59 -07:00
Vitaliy Lyudvichenko
d504c5454a Resolves #750. Allow to load more than 16 external dictionaries. [#CLICKHOUSE-3] 2017-05-03 21:04:58 -07:00
alexey-milovidov
99c360b6c7 Update Server.cpp 2017-05-03 21:02:55 -07:00
alexey-milovidov
85e59ae3ff Update Server.cpp 2017-05-03 21:02:55 -07:00
proller
90bbdaffda Remove old comment 2017-05-03 21:02:55 -07:00
proller
f02a605900 Better "Protocol not supported" message 2017-05-03 21:02:55 -07:00
Vitaliy Lyudvichenko
6d93d9cefb Combinator -MergeState now returns AggregateFunction(nested_func). [#CLICKHOUSE-2891] 2017-05-03 20:59:42 -07:00
robot-metrika-test
713168c98f Auto version update to [54233] 2017-05-03 22:47:57 +03:00
robot-metrika-test
312a0bf5f2 Auto version update to [54232] 2017-05-02 22:39:11 +03:00
f1yegor
5ffa35cf24 translate comments 2017-04-30 23:46:40 -07:00
Maxim Fridental
e9d9abf328 Fix escaping of columns starting with a number 2017-04-29 23:40:34 -07:00
alexey-milovidov
fb01ef0132 Update StorageMerge.cpp 2017-04-29 06:37:38 +03:00
alexey-milovidov
0e8c3b976f Update CastTypeBlockInputStream.cpp 2017-04-29 06:37:38 +03:00
proller
b2e2233a59 rename CastEnumBlockInputStream -> CastTypeBlockInputStream 2017-04-29 06:37:38 +03:00
proller
7a0854775b Merge: Cast types on read [#CLICKHOUSE-2957] 2017-04-29 06:37:38 +03:00
Alexey Milovidov
e0b141e3eb Do not remove temporary directory on fetch [#CLICKHOUSE-2894]. 2017-04-29 01:26:39 +03:00
proller
2a1eceef03 Try fix macos build 2017-04-29 00:18:18 +03:00
Vitaliy Lyudvichenko
42fcf148e2 Add column rows to system.parts table. [#CLICKHOUSE-2950] 2017-04-28 23:54:24 +03:00
proller
edcc18992b Try fix macos build (again) 2017-04-28 22:50:42 +03:00
proller
948d9c39cd Try fix macos build. Add more debug io helpers 2017-04-28 21:57:26 +03:00
proller
7c891eb841 Server: Special mode with empty listen_host : try listen v4 and v6 (#730)
* Server: Special mode with empty listen_host : try listen v4 and v6 without fatal error if protocol not supported (for docker and freebsd)

* fix build on freebsd/macos

* Requested change

* Update Server.cpp

* Update Server.cpp

* Fix deadlock when queue_log queue is full

* Add log error on query log fail

* Fix incudes, move code from daemon/OwnPatternFormatter.h

* Update SystemLog.h

* Update SystemLog.h

* Auto version update to [54230]

* Catch only "Protocol not supported" listen error

* Update Server.cpp
2017-04-28 00:51:09 +03:00
Alexey Milovidov
c77152e3ba Loosen dependency [#CLICKHOUSE-2828]. 2017-04-27 23:47:24 +03:00
artpaul
d269827dfd #215 convert to Enum with FunctionCast 2017-04-27 23:29:39 +03:00
Alexey Zatelepin
b0993e2d97 simplify test queries [#CLICKHOUSE-2979] 2017-04-27 23:15:45 +03:00
Alexey Zatelepin
aeb83f9ef7 fix key columns indexing for RIGHT and FULL joins [#CLICKHOUSE-2979] 2017-04-27 23:15:45 +03:00
robot-metrika-test
419b6e224a Auto version update to [54230] 2017-04-27 17:38:47 +03:00
alexey-milovidov
9b543dec5c Update SystemLog.h 2017-04-27 09:02:12 +03:00
alexey-milovidov
2f32c0e9d2 Update SystemLog.h 2017-04-27 09:02:12 +03:00
proller
8cdae06a2d Add log error on query log fail 2017-04-27 09:02:12 +03:00
proller
2ca3fcf7d3 Fix deadlock when queue_log queue is full 2017-04-27 09:02:12 +03:00
proller
bcb230ebc6 Fix incudes, move code from daemon/OwnPatternFormatter.h 2017-04-27 08:40:27 +03:00
proller
d00ae1a640 fix build on freebsd/macos 2017-04-26 18:16:36 +03:00
robot-metrika-test
c14948bba5 Auto version update to [54229] 2017-04-26 14:19:29 +03:00
proller
cd4a5c040c More debug io helpers: some types from dbms (#725)
* release: import options from jenkins script

* correct chdir

* limit parallel build threads

* VERSION_POSTFIX

* add postfix

* support BUILD_TYPE

* Removed unused.

* Fixed error [#CLICKHOUSE-2960].

* Fix version incrementing

* Fix message

* Fix build without icu and readline

* More io helpers: some types from dbms

* Requested changes
2017-04-26 05:50:03 +03:00
robot-metrika-test
b70b6a7b5b Auto version update to [54228] 2017-04-25 20:54:43 +03:00
artpaul
c19dada4a3 switch while to if 2017-04-25 20:17:13 +05:00
Alexey Milovidov
5f32cf5d90 Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:10:29 +03:00
Alexey Milovidov
7f0aecfcf6 Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:08:26 +03:00
Alexey Milovidov
74c04c467b Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:07:18 +03:00
artpaul
fd9d613dc9 #215 add tests 2017-04-25 07:57:49 +03:00
artpaul
323a9aff6d #215 cast strings or ints to enum on insert 2017-04-25 07:57:49 +03:00
Alexey Milovidov
b007f6ba18 Analyzers: added type inference for higher order functions [#CLICKHOUSE-11]. 2017-04-24 07:31:03 +03:00
Alexey Milovidov
c7ff3a0ed1 Merge branch 'master' of github.com:yandex/ClickHouse 2017-04-24 06:34:24 +03:00
Alexey Milovidov
1f76b7f568 Fixed test [#CLICKHOUSE-2]. 2017-04-24 06:33:49 +03:00
proller
c3a62f1bb0 Fix build without icu and readline 2017-04-24 06:28:28 +03:00
Alexey Milovidov
3788c3d3dd Added test for Log, TinyLog, StripeLog tables with Nullable types [#CLICKHOUSE-4]. 2017-04-23 11:29:38 +03:00
Alexey Milovidov
aa2cd20823 Miscellaneous [#CLICKHOUSE-2]. 2017-04-23 11:29:24 +03:00
Alexey Milovidov
6f65176285 Explicitly disallow dummy data types and special Null data type to be in table declaration [#CLICKHOUSE-4]. 2017-04-23 10:59:49 +03:00
Alexey Milovidov
69d7432f31 Added test for ALTERing Nullable columns [#CLICKHOUSE-4]. 2017-04-23 10:27:31 +03:00
proller
f32862be60 Hotfix for functions lib in client 2017-04-21 22:16:31 +03:00
proller
8cf716fa29 Functions as separate lib 2017-04-21 21:30:16 +03:00
proller
2967fd7b41 Server default config: Full paths to certs 2017-04-21 16:03:48 +03:00
proller
05e9fa2b4b Server default config: disable https client cert verification 2017-04-21 15:57:44 +03:00
Vladimir Chebotarev
0e0ccdccf1 dbms/src/Common: Comments for HyperLogLogCounter.h. [#CHEBOTAREV-4] 2017-04-21 15:20:03 +03:00
robot-metrika-test
f119fc84ea Auto version update to [54227] 2017-04-21 13:29:02 +03:00
Vladimir Chebotarev
79e72a685d dbms/src/Common: Comments for HyperLogLogCounter.h. [#CHEBOTAREV-4] 2017-04-21 12:58:21 +03:00
robot-metrika-test
ac1b7b178d Auto version update to [54226] 2017-04-21 00:15:32 +03:00
Alexey Milovidov
48c9abc5cf Added setting 'ignore_key_if_not_keyed' for quotas [#CLICKHOUSE-2969]. 2017-04-20 23:30:33 +03:00
Alexey Milovidov
110defd56f Disabled replicated max parallel fetches/sends, because it does not work properly [#CLICKHOUSE-2960]. 2017-04-20 21:38:17 +03:00
Alexey Milovidov
ee6a7ee204 Allow to disable replicated max parallel fetches/sends [#CLICKHOUSE-2960]. 2017-04-20 21:37:01 +03:00
Alexey Milovidov
563e21247e Style [#CLICKHOUSE-2]. 2017-04-20 21:35:39 +03:00
alexey-milovidov
512d86ceaf Merge pull request #706 from yandex/lagging-replicas-failover
Check for stale replicas when performing distributed queries
2017-04-20 21:30:02 +03:00
Alexey Milovidov
b491ee7f63 Style [#CLICKHOUSE-2]. 2017-04-20 19:41:03 +03:00
Alexey Zatelepin
baf0f70ba3 Failover if the needed table is missing on remote server [#CLICKHOUSE-2141] 2017-04-20 19:19:30 +03:00
Alexey Zatelepin
d1fa449f4a PR fixes [#CLICKHOUSE-2141] 2017-04-20 17:04:38 +03:00
robot-metrika-test
63cba2a12c Auto version update to [54225] 2017-04-20 16:24:40 +03:00
robot-metrika-test
0809389249 Auto version update to [54223] 2017-04-20 15:28:54 +03:00
Alexey Milovidov
2d3e09af82 Fixed error [#CLICKHOUSE-2960]. 2017-04-20 05:22:17 +03:00
Alexey Zatelepin
ba254a082e Merge branch 'master' into lagging-replicas-failover
Conflicts:
	dbms/src/Core/ErrorCodes.cpp
2017-04-19 21:31:29 +03:00
Alexey Zatelepin
c91828e5bf PR fixes [#CLICKHOUSE-2141] 2017-04-19 21:29:50 +03:00
Alexey Zatelepin
485c58b039 use only ConnectionPoolWithFailover in RemoteBlockInputStream [#CLICKHOUSE-2141] 2017-04-19 20:50:17 +03:00
robot-metrika-test
80c2fa2ba7 Auto version update to [54220] 2017-04-19 18:16:21 +03:00
artpaul
d43c9bb1d0 odbc: send header info even on empty result 2017-04-19 18:42:58 +05:00
Alexey Milovidov
1d93e93af3 Fixed test [#CLICKHOUSE-2]. 2017-04-19 08:35:38 +03:00
Alexey Milovidov
53364dcc8d Fixed totally wrong code; implemented function emptyArrayToSingle for generic case [#CLICKHOUSE-2963]. 2017-04-19 08:08:22 +03:00
Alexey Milovidov
3de78d093b Fixed LEFT ARRAY JOIN for constant arrays [#CLICKHOUSE-2946]. 2017-04-19 07:03:11 +03:00
Alexey Milovidov
be316af758 Save stack trace on exception from typeid_cast [#CLICKHOUSE-4]. 2017-04-19 06:38:54 +03:00
Alexey Milovidov
0224468be3 Save stack trace on exception from typeid_cast [#CLICKHOUSE-4]. 2017-04-19 06:36:50 +03:00
Alexey Milovidov
ed3c0125cd Added support for Nullable types in higher order functions [#CLICKHOUSE-4]. 2017-04-19 06:35:11 +03:00
Alexey Milovidov
3af2bade1b Added test [#CLICKHOUSE-4]. 2017-04-19 06:33:54 +03:00
Alexey Milovidov
1cdb2a2797 Fixed error [#CLICKHOUSE-4]. 2017-04-19 06:11:26 +03:00
alexey-milovidov
35abae95c8 Allow to disable ICU (#711)
* Allow to disable ICU [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-04-19 04:06:29 +03:00
Alexey Milovidov
3ad87ec820 Addition to prev. revision [#CLICKHOUSE-2]. 2017-04-19 03:31:15 +03:00
alexey-milovidov
c9c8c8ec50 Better option to disable mysqlclient (#710)
* Better support for disabling libmysqlclient [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-04-19 03:25:57 +03:00
proller
ab5e6c4840 Fix build without installd unixodbc (#708)
* Fix build without installd unixodbc

* clean

* no openssl error

* fix

* fix
2017-04-19 03:21:16 +03:00
artpaul
0ba72436db #214 fix conversion from fixed-string to string 2017-04-19 03:17:44 +03:00
Alexey Milovidov
1fedee71fb Removed useless includes [#CLICKHOUSE-2]. 2017-04-19 02:17:40 +03:00
Alexey Milovidov
0b5645db1a Better code for parsing part names [#CLICKHOUSE-2]. 2017-04-18 23:38:07 +03:00
Alexey Milovidov
47d2ca4136 Fixed error with fetches and sends limit when queue is traversed without pause [#CLICKHOUSE-2960]. 2017-04-18 23:36:19 +03:00