Commit Graph

7695 Commits

Author SHA1 Message Date
Alexey Milovidov
95e6577d6f Merge branch 'master' of github.com:yandex/ClickHouse 2017-05-23 20:35:41 +03:00
Alexey Milovidov
bb2f0a0893 Always restore in case of corrupted query_log, part_log [#CLICKHOUSE-3020]. 2017-05-23 20:35:05 +03:00
Alexey Zatelepin
6200ccb39c improve waiting for instance startup in integration tests [#CLICKHOUSE-2821] 2017-05-23 20:13:36 +03:00
Alexey Milovidov
c24f4c57af Style; removed useless catch [#CLICKHOUSE-2955]. 2017-05-23 19:36:07 +03:00
alexey-milovidov
d7e5e65028 Merge pull request #801 from yandex/dictionary-invalidate-query
Dictionary invalidate query
2017-05-23 20:31:52 +04:00
robot-metrika-test
96485e41c5 Auto version update to [54236] 2017-05-23 19:08:38 +03:00
Alex Zatelepin
1bcee80587 Fixed README.md [#CLICKHOUSE-2821] 2017-05-23 17:27:18 +03:00
Alexey Milovidov
38281226bd Fixed error in integration tests [#CLICKHOUSE-2821]. 2017-05-23 17:24:04 +03:00
Alexey Milovidov
95059092d4 Fixed README.md [#CLICKHOUSE-2821] 2017-05-23 16:57:38 +03:00
Alexey Milovidov
26a14c180d Fixed test [#CLICKHOUSE-2]. 2017-05-23 16:35:38 +03:00
Alexey Milovidov
45cf057b22 Fixed test [#CLICKHOUSE-3014]. 2017-05-23 16:32:46 +03:00
Nikolai Kochetov
f0ec7901e9 Merge branch 'master' into dictionary-invalidate-query 2017-05-23 13:27:31 +03:00
Alexey Milovidov
0c416be381 More simple code; fixed translation error [#CLICKHOUSE-2]. 2017-05-23 04:09:47 +03:00
Alexey Milovidov
25209bf040 Allow semicolon after JSONEachRow lines, for convenience [#CLICKHOUSE-2] 2017-05-23 03:57:58 +03:00
Alexey Milovidov
0e77575a76 JSONEachRow: allow to parse true and false as 1 and 0 for UInt8, Int8 data types [#CLICKHOUSE-3] 2017-05-22 23:13:17 +03:00
Alexey Milovidov
c323d7bf99 Added test for function defaultValueOfArgumentType [#CLICKHOUSE-3013]. 2017-05-22 22:04:18 +03:00
Alexey Milovidov
7269f3a23b Format Vertical: added support for totals, extremes and output_format_pretty_max_rows [#CLICKHOUSE-3014]. 2017-05-22 22:00:45 +03:00
Alexey Milovidov
734b240490 TrivialBuffer: fixed build after merge [#CLICKHOUSE-2929]. 2017-05-22 19:46:33 +03:00
Nikolai Kochetov
db3fbd91b7 added readInvalidateQuery 2017-05-22 19:46:14 +03:00
Nikolai Kochetov
86e63d2bba added readInvalidateQuery for uniform reading from BlockInputStream 2017-05-22 19:38:24 +03:00
Alexander Makarov
55bfaca662 StorageTrivialBuffer: added support for the replication [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexander Makarov
fdd636a785 fixup #2: comments on English, proper classname, StorageFactory update and merging in 'flush' method without lock [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexander Makarov
f8e19de0e3 fixups after review [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
alexey-milovidov
90e1767387 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
2fdb7057ba Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
10f188708b Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
84040d8a85 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
1059c87828 Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
3d009d153d Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
4cb799307b Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
fd1403d4c4 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
0fb0d36045 Update Block.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
d9761b6506 Update Block.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
d8e9e8fa99 Update Block.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
934476b2ed Update Block.cpp 2017-05-22 18:40:11 +04:00
Alexander Makarov
dfabe90373 TrivialBuffer implementation [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexey Zatelepin
65227021e7 ClickHouse integration tests. [#CLICKHOUSE-2821] 2017-05-22 17:56:41 +04:00
Vitaliy Lyudvichenko
48d85af41a Allow to skip garbage in TSKV format. [#CLICKHOUSE-3012] 2017-05-22 17:50:13 +04:00
Vitaliy Lyudvichenko
4fd357a311 Add more clear comments, refined code. [#CLICKHOUSE-2957] 2017-05-22 15:16:21 +04:00
Nikolai Kochetov
7762204b86 Merge branch 'master' into dictionary-invalidate-query 2017-05-22 13:49:45 +03:00
Alexey Milovidov
571af20a4f Added function defaultValueForArgumentType [#CLICKHOUSE-3013]. 2017-05-22 01:27:41 +03:00
Alexey Milovidov
0f252046ca Preparations [#CLICKHOUSE-2] 2017-05-22 01:25:25 +03:00
Vitaliy Lyudvichenko
45c1856556 Fix wrong implementation of CastTypeBlockInputStream (#807)
* Fix wrong implementation of CastTypeBlockInputStream. [#CLICKHOUSE-2957]

* Fix typos and add comments. [#CLICKHOUSE-2957]
2017-05-20 18:47:40 +04:00
Alexey Zatelepin
9c6829e982 Fix replica delay counting in case of ZooKeeper communication problems [#CLICKHOUSE-2141] 2017-05-20 17:32:00 +04:00
Vitaliy Lyudvichenko
eab306b53f Add more sophisticated test. [#METR-25237] 2017-05-20 17:30:59 +04:00
Vitaliy Lyudvichenko
bbe2a656cd Fixed preferred_block_size_bytes in case of PREWHERE with non-materialized column. [#METR-25237] 2017-05-20 17:30:59 +04:00
Alexey Zatelepin
d9306ab6b5 choose row with the max version for unmatched paths [#CLICKHOUSE-2984] 2017-05-20 17:25:48 +04:00
Alexey Zatelepin
f37ed1fbdb fix bugs in GraphiteMergeTree [#CLICKHOUSE-2984]:
* destructive rollup with Time=0 if no pattern matches
* differences in row count for Path and Value columns
* missed output rows on the boundaries between blocks
2017-05-20 17:25:48 +04:00
KochetovNicolai
f9cdae50d9 Cast boolean json fields to numbers (#809)
* added readBoolTextWord

* moved json bool cast to DataTypeNumber
2017-05-20 17:15:04 +04:00
Alexey Zatelepin
807570b32f Change tabs to spaces in clickhouse-test [#CLICKHOUSE-3]. 2017-05-19 21:31:48 +03:00
robot-metrika-test
bc2d232494 Auto version update to [54235] 2017-05-17 21:44:16 +04:00
Vitaliy Lyudvichenko
1d00f45dd3 Detect race condition between fetches and merges of the same part. [#CLICKHOUSE-2989] 2017-05-17 21:44:16 +04:00
Nikolai Kochetov
df087a2e98 merged with master 2017-05-16 13:06:45 +03:00
Dmitry Luhtionov
4cc10af7b7 Add MACStringToOUI function 2017-05-16 10:32:49 +04:00
orantius
da83036326 Add age 55 for function roundAge. [#CLICKHOUSE-3001] 2017-05-15 22:42:39 +04:00
Nikolai Kochetov
7398062010 added undate by invalidate_query for MySql and ODBC dictionary sources 2017-05-15 17:16:10 +03:00
Marek Vavruša
9520234365 Dictionaries/TrieDictionary: IP prefix dictionary
This commit implements a basic IP prefix dictionary
that allows storing IPv4/IPv6 prefixes and
matching them against a single IP address on query
time. This allows for doing IP -> ASN matching and
other similar things on query time.

The implementation is basic for start, using a
simple bitwise trie and reusing interface for
complex key dictionaries (so using tuple instead
of UInt32/FixedString(16) as the key). A faster
bitwise trie implementation (like poptrie) is
desired to improve lookup performance and
memory consumption with large prefix tables.
2017-05-15 10:51:03 +04:00
alexey-milovidov
e7b7f6f73d Update MergeTreeData.cpp 2017-05-15 10:34:40 +04:00
Vitaliy Lyudvichenko
6262fc8650 Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2] 2017-05-15 10:34:40 +04:00
f1yegor
92b56c2c7d translate comments 2017-05-14 19:03:55 +04:00
f1yegor
c252863b2e translate comments 2017-05-14 19:03:55 +04:00
Marek Vavruša
95d926ec14 AggregateFunctionTopK: smaller initial table size
By default start with 2^4 elements
2017-05-13 03:58:05 +04:00
Marek Vavruša
74cc0849dc iostream_debug_helpers: fixed build 2017-05-13 03:58:05 +04:00
robot-metrika-test
9d475d34f6 Auto version update to [54234] 2017-05-13 00:05:22 +03:00
Alexey Milovidov
282a395464 Fixed test [#CLICKHOUSE-2]. 2017-05-13 00:03:01 +03:00
Alexey Milovidov
d3a8faee16 Fixed test reference file for aggregate function topK [#CLICKHOUSE-3]. 2017-05-12 23:59:14 +03:00
Alexey Milovidov
cfc4c987c5 Added optional length parameter to aggregate function groupArrayInsertAt [#CLICKHOUSE-3003]. 2017-05-12 23:57:24 +03:00
Alexey Milovidov
40595ce688 Whitespaces [#CLICKHOUSE-3003]. 2017-05-12 23:41:50 +03:00
Alexey Milovidov
1d090bd4e2 AggregateFunctionGroupArrayInsertAt: fixed error [#CLICKHOUSE-3003]. 2017-05-12 23:05:19 +03:00
Alexey Milovidov
3819216085 StorageBuffer: explicitly disable support for PREWHERE, because possibility of wrong query results [#CLICKHOUSE-2999]. 2017-05-12 17:02:24 +03:00
Alexey Milovidov
4b852584ce Whitespaces [#CLICKHOUSE-2]. 2017-05-12 17:01:02 +03:00
Vitaliy Lyudvichenko
021e37943e More clearer code and correct test. [#CLICKHOUSE-1993] 2017-05-12 16:44:11 +03:00
Alexey Milovidov
9ad1d5676a Miscellaneous [#CLICKHOUSE-2]. 2017-05-12 01:21:06 +03:00
Alexey Milovidov
8f0e833b52 Whitespaces [#CLICKHOUSE-2]. 2017-05-11 22:48:46 +03:00
Marek Vavruša
45bd332460 AggregateFunctionTopK: fix memory usage, performance
* allow separate table key / hash key, and use
  std::string / StringRef for generic variant as
  it has built-in storage and StringRef is supported
  by the hash table, this avoids infinitely
  growing arena with serialised keys
* use power-of-2 size for alpha vector for faster
  binning without using modulo
* use custom grower and allocator for SpaceSaving
  to start with smaller tables
* store computed hash in counter for faster
  reinsertion of smallest element
2017-05-11 18:52:49 +04:00
Marek Vavruša
bc878f9785 Common/HashTable: allow cell reinsertion
* fixes missing setHash on reinsert
* reuses hash when emplacing value
2017-05-11 18:52:49 +04:00
Vitaliy Lyudvichenko
0f1627691e Don't forget to ATTACH MATERIALIZED columns. [#CLICKHOUSE-1993] 2017-05-11 18:39:12 +04:00
Dmitry Luhtionov
a21a6caf4e Доюавленф функции FunctionMACNumToString и FunctionMACStringToNum 2017-05-10 08:16:06 -04:00
Alexey Milovidov
66436db836 Added test [#CLICKHOUSE-2]. 2017-05-10 04:46:07 -04:00
Alexey Milovidov
2a57cfdbc2 Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:42:15 -04:00
Alexey Milovidov
21c5ee0f1d Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:41:25 -04:00
Alexey Milovidov
19d0d47c8a Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:40:14 -04:00
Alexey Milovidov
e5e8667bc9 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 04:10:50 -04:00
Alexey Milovidov
a7b9a12759 Returned back Increment and CounterInFile, because they are still needed [#CLICKHOUSE-2]. 2017-05-10 04:08:32 -04:00
Alexey Milovidov
bb41d47096 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:50:37 -04:00
Alexey Milovidov
5ca7650c86 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:49:19 -04:00
Alexey Milovidov
acfe3d5028 Improved performance of inserting into StorageDistributed with very high number of shards (not tested) [#CLICKHOUSE-2]. 2017-05-10 02:39:37 -04:00
Alexey Milovidov
e2f8ec8f2d Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 02:36:15 -04:00
Alexey Milovidov
21af887758 Added aggregate function 'groupArrayInsertAt' (for Graphite) [#CLICKHOUSE-2]. 2017-05-10 01:46:23 -04:00
Alexey Milovidov
b9a7917a8d Tiny modifications [#CLICKHOUSE-2]. 2017-05-10 01:43:27 -04:00
Alexey Milovidov
542eba7e17 Fixed translation errors [#CLICKHOUSE-3]. 2017-05-10 00:30:33 -04:00
Alexey Milovidov
27a324b469 Tiny modifications [#CLICKHOUSE-2]. 2017-05-10 00:29:36 -04:00
Alexey Milovidov
7bf7242ad3 Fixed translation errors; miscellaneous changes [#CLICKHOUSE-3]. 2017-05-10 00:00:19 -04:00
Alexey Milovidov
ff02af9804 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-09 22:45:21 -04:00
Alexey Milovidov
7fc3d90035 Renamed .inl file to .inl.h to avoid confusion [#CLICKHOUSE-2]. 2017-05-09 22:41:26 -04:00
Alexey Milovidov
8e5f92f025 Fixed translation errors, part 1 [#CLICKHOUSE-3]. 2017-05-09 15:07:35 -04:00
f1yegor
46db454562 translate comments 2017-05-09 13:03:35 -04:00
Dmitry Bilunov
11ec4c627d IO/CompressedWriteBuffer: support new LZ4 library 2017-05-06 10:48:30 -04:00
Dmitry Bilunov
0c72259c3c mongodb: Avoid compiling DB::authenticate() function unless it is needed 2017-05-05 17:02:34 -07:00
proller
fac00792f9 Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system 2017-05-05 16:59:18 -07:00