Commit Graph

5280 Commits

Author SHA1 Message Date
Nikolai Kochetov
db3fbd91b7 added readInvalidateQuery 2017-05-22 19:46:14 +03:00
Nikolai Kochetov
86e63d2bba added readInvalidateQuery for uniform reading from BlockInputStream 2017-05-22 19:38:24 +03:00
Alexander Makarov
55bfaca662 StorageTrivialBuffer: added support for the replication [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexander Makarov
fdd636a785 fixup #2: comments on English, proper classname, StorageFactory update and merging in 'flush' method without lock [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexander Makarov
f8e19de0e3 fixups after review [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
alexey-milovidov
90e1767387 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
2fdb7057ba Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
10f188708b Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
84040d8a85 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
1059c87828 Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
3d009d153d Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
4cb799307b Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
fd1403d4c4 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
0fb0d36045 Update Block.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
d9761b6506 Update Block.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
d8e9e8fa99 Update Block.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
934476b2ed Update Block.cpp 2017-05-22 18:40:11 +04:00
Alexander Makarov
dfabe90373 TrivialBuffer implementation [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Vitaliy Lyudvichenko
48d85af41a Allow to skip garbage in TSKV format. [#CLICKHOUSE-3012] 2017-05-22 17:50:13 +04:00
Vitaliy Lyudvichenko
4fd357a311 Add more clear comments, refined code. [#CLICKHOUSE-2957] 2017-05-22 15:16:21 +04:00
Nikolai Kochetov
7762204b86 Merge branch 'master' into dictionary-invalidate-query 2017-05-22 13:49:45 +03:00
Alexey Milovidov
571af20a4f Added function defaultValueForArgumentType [#CLICKHOUSE-3013]. 2017-05-22 01:27:41 +03:00
Alexey Milovidov
0f252046ca Preparations [#CLICKHOUSE-2] 2017-05-22 01:25:25 +03:00
Vitaliy Lyudvichenko
45c1856556 Fix wrong implementation of CastTypeBlockInputStream (#807)
* Fix wrong implementation of CastTypeBlockInputStream. [#CLICKHOUSE-2957]

* Fix typos and add comments. [#CLICKHOUSE-2957]
2017-05-20 18:47:40 +04:00
Alexey Zatelepin
9c6829e982 Fix replica delay counting in case of ZooKeeper communication problems [#CLICKHOUSE-2141] 2017-05-20 17:32:00 +04:00
Vitaliy Lyudvichenko
bbe2a656cd Fixed preferred_block_size_bytes in case of PREWHERE with non-materialized column. [#METR-25237] 2017-05-20 17:30:59 +04:00
Alexey Zatelepin
d9306ab6b5 choose row with the max version for unmatched paths [#CLICKHOUSE-2984] 2017-05-20 17:25:48 +04:00
Alexey Zatelepin
f37ed1fbdb fix bugs in GraphiteMergeTree [#CLICKHOUSE-2984]:
* destructive rollup with Time=0 if no pattern matches
* differences in row count for Path and Value columns
* missed output rows on the boundaries between blocks
2017-05-20 17:25:48 +04:00
KochetovNicolai
f9cdae50d9 Cast boolean json fields to numbers (#809)
* added readBoolTextWord

* moved json bool cast to DataTypeNumber
2017-05-20 17:15:04 +04:00
Vitaliy Lyudvichenko
1d00f45dd3 Detect race condition between fetches and merges of the same part. [#CLICKHOUSE-2989] 2017-05-17 21:44:16 +04:00
Nikolai Kochetov
df087a2e98 merged with master 2017-05-16 13:06:45 +03:00
Nikolai Kochetov
16256503ec merged with master 2017-05-16 13:03:06 +03:00
Dmitry Luhtionov
4cc10af7b7 Add MACStringToOUI function 2017-05-16 10:32:49 +04:00
orantius
da83036326 Add age 55 for function roundAge. [#CLICKHOUSE-3001] 2017-05-15 22:42:39 +04:00
Nikolai Kochetov
7398062010 added undate by invalidate_query for MySql and ODBC dictionary sources 2017-05-15 17:16:10 +03:00
Nikolai Kochetov
427c020140 deleted dictionary ptr from StorageDictionary 2017-05-15 16:58:40 +03:00
Marek Vavruša
9520234365 Dictionaries/TrieDictionary: IP prefix dictionary
This commit implements a basic IP prefix dictionary
that allows storing IPv4/IPv6 prefixes and
matching them against a single IP address on query
time. This allows for doing IP -> ASN matching and
other similar things on query time.

The implementation is basic for start, using a
simple bitwise trie and reusing interface for
complex key dictionaries (so using tuple instead
of UInt32/FixedString(16) as the key). A faster
bitwise trie implementation (like poptrie) is
desired to improve lookup performance and
memory consumption with large prefix tables.
2017-05-15 10:51:03 +04:00
alexey-milovidov
e7b7f6f73d Update MergeTreeData.cpp 2017-05-15 10:34:40 +04:00
Vitaliy Lyudvichenko
6262fc8650 Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2] 2017-05-15 10:34:40 +04:00
f1yegor
92b56c2c7d translate comments 2017-05-14 19:03:55 +04:00
f1yegor
c252863b2e translate comments 2017-05-14 19:03:55 +04:00
Marek Vavruša
95d926ec14 AggregateFunctionTopK: smaller initial table size
By default start with 2^4 elements
2017-05-13 03:58:05 +04:00
Marek Vavruša
74cc0849dc iostream_debug_helpers: fixed build 2017-05-13 03:58:05 +04:00
Alexey Milovidov
282a395464 Fixed test [#CLICKHOUSE-2]. 2017-05-13 00:03:01 +03:00
Alexey Milovidov
cfc4c987c5 Added optional length parameter to aggregate function groupArrayInsertAt [#CLICKHOUSE-3003]. 2017-05-12 23:57:24 +03:00
Alexey Milovidov
40595ce688 Whitespaces [#CLICKHOUSE-3003]. 2017-05-12 23:41:50 +03:00
Alexey Milovidov
1d090bd4e2 AggregateFunctionGroupArrayInsertAt: fixed error [#CLICKHOUSE-3003]. 2017-05-12 23:05:19 +03:00
Alexey Milovidov
3819216085 StorageBuffer: explicitly disable support for PREWHERE, because possibility of wrong query results [#CLICKHOUSE-2999]. 2017-05-12 17:02:24 +03:00
Alexey Milovidov
4b852584ce Whitespaces [#CLICKHOUSE-2]. 2017-05-12 17:01:02 +03:00
Vitaliy Lyudvichenko
021e37943e More clearer code and correct test. [#CLICKHOUSE-1993] 2017-05-12 16:44:11 +03:00
Alexey Milovidov
9ad1d5676a Miscellaneous [#CLICKHOUSE-2]. 2017-05-12 01:21:06 +03:00
Alexey Milovidov
8f0e833b52 Whitespaces [#CLICKHOUSE-2]. 2017-05-11 22:48:46 +03:00
Marek Vavruša
45bd332460 AggregateFunctionTopK: fix memory usage, performance
* allow separate table key / hash key, and use
  std::string / StringRef for generic variant as
  it has built-in storage and StringRef is supported
  by the hash table, this avoids infinitely
  growing arena with serialised keys
* use power-of-2 size for alpha vector for faster
  binning without using modulo
* use custom grower and allocator for SpaceSaving
  to start with smaller tables
* store computed hash in counter for faster
  reinsertion of smallest element
2017-05-11 18:52:49 +04:00
Marek Vavruša
bc878f9785 Common/HashTable: allow cell reinsertion
* fixes missing setHash on reinsert
* reuses hash when emplacing value
2017-05-11 18:52:49 +04:00
Vitaliy Lyudvichenko
0f1627691e Don't forget to ATTACH MATERIALIZED columns. [#CLICKHOUSE-1993] 2017-05-11 18:39:12 +04:00
Dmitry Luhtionov
a21a6caf4e Доюавленф функции FunctionMACNumToString и FunctionMACStringToNum 2017-05-10 08:16:06 -04:00
Alexey Milovidov
2a57cfdbc2 Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:42:15 -04:00
Alexey Milovidov
21c5ee0f1d Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:41:25 -04:00
Alexey Milovidov
19d0d47c8a Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:40:14 -04:00
Alexey Milovidov
e5e8667bc9 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 04:10:50 -04:00
Alexey Milovidov
a7b9a12759 Returned back Increment and CounterInFile, because they are still needed [#CLICKHOUSE-2]. 2017-05-10 04:08:32 -04:00
Alexey Milovidov
bb41d47096 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:50:37 -04:00
Alexey Milovidov
5ca7650c86 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:49:19 -04:00
Alexey Milovidov
acfe3d5028 Improved performance of inserting into StorageDistributed with very high number of shards (not tested) [#CLICKHOUSE-2]. 2017-05-10 02:39:37 -04:00
Alexey Milovidov
e2f8ec8f2d Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 02:36:15 -04:00
Alexey Milovidov
21af887758 Added aggregate function 'groupArrayInsertAt' (for Graphite) [#CLICKHOUSE-2]. 2017-05-10 01:46:23 -04:00
Alexey Milovidov
b9a7917a8d Tiny modifications [#CLICKHOUSE-2]. 2017-05-10 01:43:27 -04:00
Alexey Milovidov
542eba7e17 Fixed translation errors [#CLICKHOUSE-3]. 2017-05-10 00:30:33 -04:00
Alexey Milovidov
27a324b469 Tiny modifications [#CLICKHOUSE-2]. 2017-05-10 00:29:36 -04:00
Alexey Milovidov
7bf7242ad3 Fixed translation errors; miscellaneous changes [#CLICKHOUSE-3]. 2017-05-10 00:00:19 -04:00
Alexey Milovidov
ff02af9804 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-09 22:45:21 -04:00
Alexey Milovidov
7fc3d90035 Renamed .inl file to .inl.h to avoid confusion [#CLICKHOUSE-2]. 2017-05-09 22:41:26 -04:00
Alexey Milovidov
8e5f92f025 Fixed translation errors, part 1 [#CLICKHOUSE-3]. 2017-05-09 15:07:35 -04:00
f1yegor
46db454562 translate comments 2017-05-09 13:03:35 -04:00
Dmitry Bilunov
11ec4c627d IO/CompressedWriteBuffer: support new LZ4 library 2017-05-06 10:48:30 -04:00
Dmitry Bilunov
0c72259c3c mongodb: Avoid compiling DB::authenticate() function unless it is needed 2017-05-05 17:02:34 -07:00
proller
fac00792f9 Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system 2017-05-05 16:59:18 -07:00
Alexey Milovidov
d3e6321967 AggregateFunctionTopK: minor modifications [#CLICKHOUSE-2]. 2017-05-05 16:36:02 -07:00
Alexey Milovidov
32a75147f5 Merge branch 'master' of github.com:yandex/ClickHouse 2017-05-05 16:35:08 -07:00
Alexey Milovidov
aa629d0f7e Minor modification [#CLICKHOUSE-2]. 2017-05-05 14:25:53 -07:00
Alexey Milovidov
9d4c814b12 Aggregate function topK: style modifications [#CLICKHOUSE-2]. 2017-05-05 14:17:04 -07:00
proller
6c34f27e3b Another freebsd fix, update freebsd build doc 2017-05-05 03:23:32 +03:00
proller
1474de179c CastTypeBlockInputStream: hotfix: sometimes columns in sample blocks and stream blocks does not match 2017-05-04 22:41:55 +03:00
Nikolai Kochetov
1604ce138a changed key storage format for complex key dictionaries 2017-05-04 21:14:23 +03:00
proller
9a937591e5 Try fix freebsd 11-STABLE OCbuild 2017-05-04 18:25:34 +03:00
Marek Vavruša
5f1e65b252 AggregateFunctions: implemented topK(n)
This implements a new function for approximate
computation of the most frequent entries using
Filtered Space Saving with a merge step adapted
from Parallel Space Saving paper.

It works better for cases where GROUP BY x
is impractical due to high cardinality of x,
such as top IP addresses or top search queries.
2017-05-03 23:09:52 -07:00
proller
0787bd66ff Merge: fail if cant convert columns (#753)
* Merge: fail if cant convert columns

* Merge: convert all different types, more tests

* clean

* clean

* clean
2017-05-03 21:08:59 -07:00
Vitaliy Lyudvichenko
d504c5454a Resolves #750. Allow to load more than 16 external dictionaries. [#CLICKHOUSE-3] 2017-05-03 21:04:58 -07:00
alexey-milovidov
99c360b6c7 Update Server.cpp 2017-05-03 21:02:55 -07:00
alexey-milovidov
85e59ae3ff Update Server.cpp 2017-05-03 21:02:55 -07:00
proller
90bbdaffda Remove old comment 2017-05-03 21:02:55 -07:00
proller
f02a605900 Better "Protocol not supported" message 2017-05-03 21:02:55 -07:00
Vitaliy Lyudvichenko
6d93d9cefb Combinator -MergeState now returns AggregateFunction(nested_func). [#CLICKHOUSE-2891] 2017-05-03 20:59:42 -07:00
f1yegor
5ffa35cf24 translate comments 2017-04-30 23:46:40 -07:00
Maxim Fridental
e9d9abf328 Fix escaping of columns starting with a number 2017-04-29 23:40:34 -07:00
alexey-milovidov
fb01ef0132 Update StorageMerge.cpp 2017-04-29 06:37:38 +03:00
alexey-milovidov
0e8c3b976f Update CastTypeBlockInputStream.cpp 2017-04-29 06:37:38 +03:00
proller
b2e2233a59 rename CastEnumBlockInputStream -> CastTypeBlockInputStream 2017-04-29 06:37:38 +03:00
proller
7a0854775b Merge: Cast types on read [#CLICKHOUSE-2957] 2017-04-29 06:37:38 +03:00
Alexey Milovidov
e0b141e3eb Do not remove temporary directory on fetch [#CLICKHOUSE-2894]. 2017-04-29 01:26:39 +03:00