Commit Graph

7726 Commits

Author SHA1 Message Date
Nikolai Kochetov
86e63d2bba added readInvalidateQuery for uniform reading from BlockInputStream 2017-05-22 19:38:24 +03:00
Alexander Makarov
55bfaca662 StorageTrivialBuffer: added support for the replication [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexander Makarov
fdd636a785 fixup #2: comments on English, proper classname, StorageFactory update and merging in 'flush' method without lock [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexander Makarov
f8e19de0e3 fixups after review [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
alexey-milovidov
90e1767387 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
2fdb7057ba Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
10f188708b Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
84040d8a85 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
1059c87828 Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
3d009d153d Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
4cb799307b Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
fd1403d4c4 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
0fb0d36045 Update Block.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
d9761b6506 Update Block.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
d8e9e8fa99 Update Block.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
934476b2ed Update Block.cpp 2017-05-22 18:40:11 +04:00
Alexander Makarov
dfabe90373 TrivialBuffer implementation [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexey Zatelepin
65227021e7 ClickHouse integration tests. [#CLICKHOUSE-2821] 2017-05-22 17:56:41 +04:00
Vitaliy Lyudvichenko
48d85af41a Allow to skip garbage in TSKV format. [#CLICKHOUSE-3012] 2017-05-22 17:50:13 +04:00
Vitaliy Lyudvichenko
4fd357a311 Add more clear comments, refined code. [#CLICKHOUSE-2957] 2017-05-22 15:16:21 +04:00
Nikolai Kochetov
7762204b86 Merge branch 'master' into dictionary-invalidate-query 2017-05-22 13:49:45 +03:00
Alexey Milovidov
571af20a4f Added function defaultValueForArgumentType [#CLICKHOUSE-3013]. 2017-05-22 01:27:41 +03:00
Alexey Milovidov
0f252046ca Preparations [#CLICKHOUSE-2] 2017-05-22 01:25:25 +03:00
Vitaliy Lyudvichenko
45c1856556 Fix wrong implementation of CastTypeBlockInputStream (#807)
* Fix wrong implementation of CastTypeBlockInputStream. [#CLICKHOUSE-2957]

* Fix typos and add comments. [#CLICKHOUSE-2957]
2017-05-20 18:47:40 +04:00
Alexey Zatelepin
9c6829e982 Fix replica delay counting in case of ZooKeeper communication problems [#CLICKHOUSE-2141] 2017-05-20 17:32:00 +04:00
Vitaliy Lyudvichenko
eab306b53f Add more sophisticated test. [#METR-25237] 2017-05-20 17:30:59 +04:00
Vitaliy Lyudvichenko
bbe2a656cd Fixed preferred_block_size_bytes in case of PREWHERE with non-materialized column. [#METR-25237] 2017-05-20 17:30:59 +04:00
Alexey Zatelepin
d9306ab6b5 choose row with the max version for unmatched paths [#CLICKHOUSE-2984] 2017-05-20 17:25:48 +04:00
Alexey Zatelepin
f37ed1fbdb fix bugs in GraphiteMergeTree [#CLICKHOUSE-2984]:
* destructive rollup with Time=0 if no pattern matches
* differences in row count for Path and Value columns
* missed output rows on the boundaries between blocks
2017-05-20 17:25:48 +04:00
KochetovNicolai
f9cdae50d9 Cast boolean json fields to numbers (#809)
* added readBoolTextWord

* moved json bool cast to DataTypeNumber
2017-05-20 17:15:04 +04:00
Alexey Zatelepin
807570b32f Change tabs to spaces in clickhouse-test [#CLICKHOUSE-3]. 2017-05-19 21:31:48 +03:00
robot-metrika-test
bc2d232494 Auto version update to [54235] 2017-05-17 21:44:16 +04:00
Vitaliy Lyudvichenko
1d00f45dd3 Detect race condition between fetches and merges of the same part. [#CLICKHOUSE-2989] 2017-05-17 21:44:16 +04:00
Nikolai Kochetov
df087a2e98 merged with master 2017-05-16 13:06:45 +03:00
Dmitry Luhtionov
4cc10af7b7 Add MACStringToOUI function 2017-05-16 10:32:49 +04:00
orantius
da83036326 Add age 55 for function roundAge. [#CLICKHOUSE-3001] 2017-05-15 22:42:39 +04:00
Nikolai Kochetov
7398062010 added undate by invalidate_query for MySql and ODBC dictionary sources 2017-05-15 17:16:10 +03:00
Marek Vavruša
9520234365 Dictionaries/TrieDictionary: IP prefix dictionary
This commit implements a basic IP prefix dictionary
that allows storing IPv4/IPv6 prefixes and
matching them against a single IP address on query
time. This allows for doing IP -> ASN matching and
other similar things on query time.

The implementation is basic for start, using a
simple bitwise trie and reusing interface for
complex key dictionaries (so using tuple instead
of UInt32/FixedString(16) as the key). A faster
bitwise trie implementation (like poptrie) is
desired to improve lookup performance and
memory consumption with large prefix tables.
2017-05-15 10:51:03 +04:00
alexey-milovidov
e7b7f6f73d Update MergeTreeData.cpp 2017-05-15 10:34:40 +04:00
Vitaliy Lyudvichenko
6262fc8650 Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2] 2017-05-15 10:34:40 +04:00
f1yegor
92b56c2c7d translate comments 2017-05-14 19:03:55 +04:00
f1yegor
c252863b2e translate comments 2017-05-14 19:03:55 +04:00
Marek Vavruša
95d926ec14 AggregateFunctionTopK: smaller initial table size
By default start with 2^4 elements
2017-05-13 03:58:05 +04:00
Marek Vavruša
74cc0849dc iostream_debug_helpers: fixed build 2017-05-13 03:58:05 +04:00
robot-metrika-test
9d475d34f6 Auto version update to [54234] 2017-05-13 00:05:22 +03:00
Alexey Milovidov
282a395464 Fixed test [#CLICKHOUSE-2]. 2017-05-13 00:03:01 +03:00
Alexey Milovidov
d3a8faee16 Fixed test reference file for aggregate function topK [#CLICKHOUSE-3]. 2017-05-12 23:59:14 +03:00
Alexey Milovidov
cfc4c987c5 Added optional length parameter to aggregate function groupArrayInsertAt [#CLICKHOUSE-3003]. 2017-05-12 23:57:24 +03:00
Alexey Milovidov
40595ce688 Whitespaces [#CLICKHOUSE-3003]. 2017-05-12 23:41:50 +03:00
Alexey Milovidov
1d090bd4e2 AggregateFunctionGroupArrayInsertAt: fixed error [#CLICKHOUSE-3003]. 2017-05-12 23:05:19 +03:00
Alexey Milovidov
3819216085 StorageBuffer: explicitly disable support for PREWHERE, because possibility of wrong query results [#CLICKHOUSE-2999]. 2017-05-12 17:02:24 +03:00
Alexey Milovidov
4b852584ce Whitespaces [#CLICKHOUSE-2]. 2017-05-12 17:01:02 +03:00
Vitaliy Lyudvichenko
021e37943e More clearer code and correct test. [#CLICKHOUSE-1993] 2017-05-12 16:44:11 +03:00
Alexey Milovidov
9ad1d5676a Miscellaneous [#CLICKHOUSE-2]. 2017-05-12 01:21:06 +03:00
Alexey Milovidov
8f0e833b52 Whitespaces [#CLICKHOUSE-2]. 2017-05-11 22:48:46 +03:00
Marek Vavruša
45bd332460 AggregateFunctionTopK: fix memory usage, performance
* allow separate table key / hash key, and use
  std::string / StringRef for generic variant as
  it has built-in storage and StringRef is supported
  by the hash table, this avoids infinitely
  growing arena with serialised keys
* use power-of-2 size for alpha vector for faster
  binning without using modulo
* use custom grower and allocator for SpaceSaving
  to start with smaller tables
* store computed hash in counter for faster
  reinsertion of smallest element
2017-05-11 18:52:49 +04:00
Marek Vavruša
bc878f9785 Common/HashTable: allow cell reinsertion
* fixes missing setHash on reinsert
* reuses hash when emplacing value
2017-05-11 18:52:49 +04:00
Vitaliy Lyudvichenko
0f1627691e Don't forget to ATTACH MATERIALIZED columns. [#CLICKHOUSE-1993] 2017-05-11 18:39:12 +04:00
Dmitry Luhtionov
a21a6caf4e Доюавленф функции FunctionMACNumToString и FunctionMACStringToNum 2017-05-10 08:16:06 -04:00
Alexey Milovidov
66436db836 Added test [#CLICKHOUSE-2]. 2017-05-10 04:46:07 -04:00
Alexey Milovidov
2a57cfdbc2 Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:42:15 -04:00
Alexey Milovidov
21c5ee0f1d Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:41:25 -04:00
Alexey Milovidov
19d0d47c8a Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:40:14 -04:00
Alexey Milovidov
e5e8667bc9 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 04:10:50 -04:00
Alexey Milovidov
a7b9a12759 Returned back Increment and CounterInFile, because they are still needed [#CLICKHOUSE-2]. 2017-05-10 04:08:32 -04:00
Alexey Milovidov
bb41d47096 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:50:37 -04:00
Alexey Milovidov
5ca7650c86 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:49:19 -04:00
Alexey Milovidov
acfe3d5028 Improved performance of inserting into StorageDistributed with very high number of shards (not tested) [#CLICKHOUSE-2]. 2017-05-10 02:39:37 -04:00
Alexey Milovidov
e2f8ec8f2d Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 02:36:15 -04:00
Alexey Milovidov
21af887758 Added aggregate function 'groupArrayInsertAt' (for Graphite) [#CLICKHOUSE-2]. 2017-05-10 01:46:23 -04:00
Alexey Milovidov
b9a7917a8d Tiny modifications [#CLICKHOUSE-2]. 2017-05-10 01:43:27 -04:00
Alexey Milovidov
542eba7e17 Fixed translation errors [#CLICKHOUSE-3]. 2017-05-10 00:30:33 -04:00
Alexey Milovidov
27a324b469 Tiny modifications [#CLICKHOUSE-2]. 2017-05-10 00:29:36 -04:00
Alexey Milovidov
7bf7242ad3 Fixed translation errors; miscellaneous changes [#CLICKHOUSE-3]. 2017-05-10 00:00:19 -04:00
Alexey Milovidov
ff02af9804 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-09 22:45:21 -04:00
Alexey Milovidov
7fc3d90035 Renamed .inl file to .inl.h to avoid confusion [#CLICKHOUSE-2]. 2017-05-09 22:41:26 -04:00
Alexey Milovidov
8e5f92f025 Fixed translation errors, part 1 [#CLICKHOUSE-3]. 2017-05-09 15:07:35 -04:00
f1yegor
46db454562 translate comments 2017-05-09 13:03:35 -04:00
Dmitry Bilunov
11ec4c627d IO/CompressedWriteBuffer: support new LZ4 library 2017-05-06 10:48:30 -04:00
Dmitry Bilunov
0c72259c3c mongodb: Avoid compiling DB::authenticate() function unless it is needed 2017-05-05 17:02:34 -07:00
proller
fac00792f9 Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system 2017-05-05 16:59:18 -07:00
Alexey Milovidov
d3e6321967 AggregateFunctionTopK: minor modifications [#CLICKHOUSE-2]. 2017-05-05 16:36:02 -07:00
Alexey Milovidov
32a75147f5 Merge branch 'master' of github.com:yandex/ClickHouse 2017-05-05 16:35:08 -07:00
Alexey Milovidov
aa629d0f7e Minor modification [#CLICKHOUSE-2]. 2017-05-05 14:25:53 -07:00
Alexey Milovidov
9d4c814b12 Aggregate function topK: style modifications [#CLICKHOUSE-2]. 2017-05-05 14:17:04 -07:00
proller
b1f1096f27 tests: correct Connection refused detection (#766) 2017-05-05 17:50:05 +03:00
proller
9bcece79f9 tests: dont stop on errors by default 2017-05-05 07:19:00 -07:00
proller
6c34f27e3b Another freebsd fix, update freebsd build doc 2017-05-05 03:23:32 +03:00
proller
1474de179c CastTypeBlockInputStream: hotfix: sometimes columns in sample blocks and stream blocks does not match 2017-05-04 22:41:55 +03:00
proller
9a937591e5 Try fix freebsd 11-STABLE OCbuild 2017-05-04 18:25:34 +03:00
Marek Vavruša
5f1e65b252 AggregateFunctions: implemented topK(n)
This implements a new function for approximate
computation of the most frequent entries using
Filtered Space Saving with a merge step adapted
from Parallel Space Saving paper.

It works better for cases where GROUP BY x
is impractical due to high cardinality of x,
such as top IP addresses or top search queries.
2017-05-03 23:09:52 -07:00
proller
0787bd66ff Merge: fail if cant convert columns (#753)
* Merge: fail if cant convert columns

* Merge: convert all different types, more tests

* clean

* clean

* clean
2017-05-03 21:08:59 -07:00
Vitaliy Lyudvichenko
d504c5454a Resolves #750. Allow to load more than 16 external dictionaries. [#CLICKHOUSE-3] 2017-05-03 21:04:58 -07:00
alexey-milovidov
99c360b6c7 Update Server.cpp 2017-05-03 21:02:55 -07:00
alexey-milovidov
85e59ae3ff Update Server.cpp 2017-05-03 21:02:55 -07:00
proller
90bbdaffda Remove old comment 2017-05-03 21:02:55 -07:00
proller
f02a605900 Better "Protocol not supported" message 2017-05-03 21:02:55 -07:00
Vitaliy Lyudvichenko
6d93d9cefb Combinator -MergeState now returns AggregateFunction(nested_func). [#CLICKHOUSE-2891] 2017-05-03 20:59:42 -07:00
robot-metrika-test
713168c98f Auto version update to [54233] 2017-05-03 22:47:57 +03:00
robot-metrika-test
312a0bf5f2 Auto version update to [54232] 2017-05-02 22:39:11 +03:00
f1yegor
5ffa35cf24 translate comments 2017-04-30 23:46:40 -07:00
Maxim Fridental
e9d9abf328 Fix escaping of columns starting with a number 2017-04-29 23:40:34 -07:00
alexey-milovidov
fb01ef0132 Update StorageMerge.cpp 2017-04-29 06:37:38 +03:00
alexey-milovidov
0e8c3b976f Update CastTypeBlockInputStream.cpp 2017-04-29 06:37:38 +03:00
proller
b2e2233a59 rename CastEnumBlockInputStream -> CastTypeBlockInputStream 2017-04-29 06:37:38 +03:00
proller
7a0854775b Merge: Cast types on read [#CLICKHOUSE-2957] 2017-04-29 06:37:38 +03:00
Alexey Milovidov
e0b141e3eb Do not remove temporary directory on fetch [#CLICKHOUSE-2894]. 2017-04-29 01:26:39 +03:00
proller
2a1eceef03 Try fix macos build 2017-04-29 00:18:18 +03:00
Vitaliy Lyudvichenko
42fcf148e2 Add column rows to system.parts table. [#CLICKHOUSE-2950] 2017-04-28 23:54:24 +03:00
proller
edcc18992b Try fix macos build (again) 2017-04-28 22:50:42 +03:00
proller
948d9c39cd Try fix macos build. Add more debug io helpers 2017-04-28 21:57:26 +03:00
proller
7c891eb841 Server: Special mode with empty listen_host : try listen v4 and v6 (#730)
* Server: Special mode with empty listen_host : try listen v4 and v6 without fatal error if protocol not supported (for docker and freebsd)

* fix build on freebsd/macos

* Requested change

* Update Server.cpp

* Update Server.cpp

* Fix deadlock when queue_log queue is full

* Add log error on query log fail

* Fix incudes, move code from daemon/OwnPatternFormatter.h

* Update SystemLog.h

* Update SystemLog.h

* Auto version update to [54230]

* Catch only "Protocol not supported" listen error

* Update Server.cpp
2017-04-28 00:51:09 +03:00
Alexey Milovidov
c77152e3ba Loosen dependency [#CLICKHOUSE-2828]. 2017-04-27 23:47:24 +03:00
artpaul
d269827dfd #215 convert to Enum with FunctionCast 2017-04-27 23:29:39 +03:00
Alexey Zatelepin
b0993e2d97 simplify test queries [#CLICKHOUSE-2979] 2017-04-27 23:15:45 +03:00
Alexey Zatelepin
aeb83f9ef7 fix key columns indexing for RIGHT and FULL joins [#CLICKHOUSE-2979] 2017-04-27 23:15:45 +03:00
robot-metrika-test
419b6e224a Auto version update to [54230] 2017-04-27 17:38:47 +03:00
alexey-milovidov
9b543dec5c Update SystemLog.h 2017-04-27 09:02:12 +03:00
alexey-milovidov
2f32c0e9d2 Update SystemLog.h 2017-04-27 09:02:12 +03:00
proller
8cdae06a2d Add log error on query log fail 2017-04-27 09:02:12 +03:00
proller
2ca3fcf7d3 Fix deadlock when queue_log queue is full 2017-04-27 09:02:12 +03:00
proller
bcb230ebc6 Fix incudes, move code from daemon/OwnPatternFormatter.h 2017-04-27 08:40:27 +03:00
proller
d00ae1a640 fix build on freebsd/macos 2017-04-26 18:16:36 +03:00
robot-metrika-test
c14948bba5 Auto version update to [54229] 2017-04-26 14:19:29 +03:00
proller
cd4a5c040c More debug io helpers: some types from dbms (#725)
* release: import options from jenkins script

* correct chdir

* limit parallel build threads

* VERSION_POSTFIX

* add postfix

* support BUILD_TYPE

* Removed unused.

* Fixed error [#CLICKHOUSE-2960].

* Fix version incrementing

* Fix message

* Fix build without icu and readline

* More io helpers: some types from dbms

* Requested changes
2017-04-26 05:50:03 +03:00
robot-metrika-test
b70b6a7b5b Auto version update to [54228] 2017-04-25 20:54:43 +03:00
artpaul
c19dada4a3 switch while to if 2017-04-25 20:17:13 +05:00
Alexey Milovidov
5f32cf5d90 Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:10:29 +03:00
Alexey Milovidov
7f0aecfcf6 Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:08:26 +03:00
Alexey Milovidov
74c04c467b Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:07:18 +03:00
artpaul
fd9d613dc9 #215 add tests 2017-04-25 07:57:49 +03:00
artpaul
323a9aff6d #215 cast strings or ints to enum on insert 2017-04-25 07:57:49 +03:00
Alexey Milovidov
b007f6ba18 Analyzers: added type inference for higher order functions [#CLICKHOUSE-11]. 2017-04-24 07:31:03 +03:00
Alexey Milovidov
c7ff3a0ed1 Merge branch 'master' of github.com:yandex/ClickHouse 2017-04-24 06:34:24 +03:00
Alexey Milovidov
1f76b7f568 Fixed test [#CLICKHOUSE-2]. 2017-04-24 06:33:49 +03:00
proller
c3a62f1bb0 Fix build without icu and readline 2017-04-24 06:28:28 +03:00
Alexey Milovidov
3788c3d3dd Added test for Log, TinyLog, StripeLog tables with Nullable types [#CLICKHOUSE-4]. 2017-04-23 11:29:38 +03:00
Alexey Milovidov
aa2cd20823 Miscellaneous [#CLICKHOUSE-2]. 2017-04-23 11:29:24 +03:00
Alexey Milovidov
6f65176285 Explicitly disallow dummy data types and special Null data type to be in table declaration [#CLICKHOUSE-4]. 2017-04-23 10:59:49 +03:00
Alexey Milovidov
69d7432f31 Added test for ALTERing Nullable columns [#CLICKHOUSE-4]. 2017-04-23 10:27:31 +03:00
proller
f32862be60 Hotfix for functions lib in client 2017-04-21 22:16:31 +03:00
proller
8cf716fa29 Functions as separate lib 2017-04-21 21:30:16 +03:00
proller
2967fd7b41 Server default config: Full paths to certs 2017-04-21 16:03:48 +03:00
proller
05e9fa2b4b Server default config: disable https client cert verification 2017-04-21 15:57:44 +03:00
Vladimir Chebotarev
0e0ccdccf1 dbms/src/Common: Comments for HyperLogLogCounter.h. [#CHEBOTAREV-4] 2017-04-21 15:20:03 +03:00
robot-metrika-test
f119fc84ea Auto version update to [54227] 2017-04-21 13:29:02 +03:00
Vladimir Chebotarev
79e72a685d dbms/src/Common: Comments for HyperLogLogCounter.h. [#CHEBOTAREV-4] 2017-04-21 12:58:21 +03:00
robot-metrika-test
ac1b7b178d Auto version update to [54226] 2017-04-21 00:15:32 +03:00
Alexey Milovidov
48c9abc5cf Added setting 'ignore_key_if_not_keyed' for quotas [#CLICKHOUSE-2969]. 2017-04-20 23:30:33 +03:00
Alexey Milovidov
110defd56f Disabled replicated max parallel fetches/sends, because it does not work properly [#CLICKHOUSE-2960]. 2017-04-20 21:38:17 +03:00