Commit Graph

7847 Commits

Author SHA1 Message Date
Vitaliy Lyudvichenko
48ade83090 Parsers refactoring. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
91f45c628b Add queue cleanup. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
feb1db051d Add status stream for distributed DDLs. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
4322b0c5a9 Implemented global ZK queue for DDLs. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
209015574f Workable version for CREATE DROP w/o ZK tests. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
aa7504a7f5 Distributed DDL PR rebase. [#CLICKHOUSE-5] 2017-06-01 13:49:19 +03:00
robot-metrika-test
5df9848326 Auto version update to [54237] 2017-05-31 20:37:37 +03:00
Nikolai Kochetov
d606436023 using MergeTreeDataPartChecksums to calculate marks_size in system.parts 2017-05-31 20:54:40 +04:00
Nikolai Kochetov
c58e98b607 added marks_size column in system.parts 2017-05-31 20:54:40 +04:00
Vitaliy Lyudvichenko
1a4b0eb355 Remove tmp part directories on server start. [#CLICKHOUSE-3044] 2017-05-31 18:01:25 +03:00
Nikolai Kochetov
334fa11d12 deleted IBlickInputStream.h include form IDictionary.h 2017-05-31 12:05:44 +03:00
ivanzhukov
52b5f18db9 Code Review 2017-05-31 00:36:45 +03:00
Nikolai Kochetov
38e9e837c5 style fixes 2017-05-30 18:02:44 +03:00
Alex Zatelepin
0b2e2ec20d Update README.md [#CLICKHOUSE-2821] 2017-05-29 22:05:36 +03:00
Nikolai Kochetov
7c736b12ef added raw serialization functions for IColumn; changed key serialization in ComplexKeyCacheDictionary; style fixes 2017-05-29 20:26:45 +03:00
Nikolai Kochetov
787bf12572 merged with master 2017-05-29 20:23:14 +03:00
proller
27d675465d Remove wrong char from code 2017-05-29 14:18:51 +03:00
f1yegor
0bf5182020 translate comments: etc 2017-05-28 16:32:59 +02:00
f1yegor
b3e0533860 translate comments: IO 2017-05-28 16:29:40 +02:00
f1yegor
f49b433a83 translate comments: functions 2017-05-27 19:29:55 +02:00
f1yegor
92712eeedd translate comments: parsers 2017-05-27 19:27:16 +02:00
f1yegor
0882092c20 translate comments: functions 2017-05-27 17:45:25 +02:00
Nikolai Kochetov
5fb5397941 added max_block_size for DictionaryBlockImputStreamBase 2017-05-26 19:08:56 +03:00
Alexey Milovidov
13f0af3d83 Whitespaces [#CLICKHOUSE-2] 2017-05-26 18:30:07 +03:00
Alexey Milovidov
fa64d14f26 More readable temporary part names [#CLICKHOUSE-2]. 2017-05-26 03:47:06 +03:00
Alexey Milovidov
ed44304c49 Removed obsolete commented code [#CLICKHOUSE-2]. 2017-05-26 03:43:35 +03:00
alexey-milovidov
c79ebc586d Merge pull request #825 from yandex/CLICKHOUSE-2989
Separate dirs for different part sources, fix RC during replicated alters
2017-05-26 04:42:03 +04:00
Alexey Milovidov
c8ccbd56c0 More correct wording [#CLICKHOUSE-3039]. 2017-05-26 00:00:04 +03:00
Alexey Milovidov
d35a586af2 Fixed deadlock when using executable dictionary source with cache or complex_key_cache layout [#CLICKHOUSE-3039]. 2017-05-25 23:59:14 +03:00
Alexey Milovidov
ccce305d73 Fixed totally wrong code [#CLICKHOUSE-3039]. 2017-05-25 23:17:23 +03:00
Alexey Milovidov
f448c9690c Little better [#CLICKHOUSE-3039]. 2017-05-25 23:09:48 +03:00
Alexey Milovidov
e05547f4f8 Little better [#CLICKHOUSE-3039]. 2017-05-25 22:52:05 +03:00
Alexey Milovidov
7a5c0a3cc2 Style [#CLICKHOUSE-3039]. 2017-05-25 22:36:03 +03:00
Alexey Milovidov
22a0da824f Fixed bad code (again) [#CLICKHOUSE-3039]. 2017-05-25 22:27:23 +03:00
Alexey Milovidov
6f5dcb1d84 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 22:26:17 +03:00
Alexey Milovidov
4fd2714a74 Fixed bad code [#CLICKHOUSE-3039]. 2017-05-25 22:21:57 +03:00
Alexey Milovidov
fedd829803 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 21:24:47 +03:00
alexey-milovidov
72822714c3 Merge branch 'master' into CLICKHOUSE-2989 2017-05-25 21:04:37 +04:00
Vitaliy Lyudvichenko
1e29795cf9 Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989]
It was happening during ALTERs.
TODO: stop fetches during ALTER.
2017-05-25 13:08:52 +03:00
Alexey Zatelepin
1c903df8d7 move AccurateComparison.h [#CLICKHOUSE-3002] 2017-05-25 05:34:26 +04:00
Alexey Zatelepin
7655a7bf3a add tests [#CLICKHOUSE-3002] 2017-05-25 05:34:26 +04:00
Alexey Zatelepin
e9f8f99e06 Correct index comparisons in case constants cannot be precisely casted [#CLICKHOUSE-3002] 2017-05-25 05:34:26 +04:00
Alexey Milovidov
a77369d082 Preparation: Storages do not modify query [#CLICKHOUSE-31]. 2017-05-25 04:12:41 +03:00
Alexey Milovidov
6e9fa39af5 Analyzers: development [#CLICKHOUSE-31]. 2017-05-25 03:41:07 +03:00
Alexey Milovidov
557c3dc7f4 Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31]. 2017-05-25 00:38:56 +03:00
Alexey Milovidov
48f65e9097 Preparation: untangling [#CLICKHOUSE-31]. 2017-05-25 00:06:29 +03:00
Alexey Milovidov
59ac7f8063 Preparation: untangle settings manipulation in InterpreterSelectQuery [#CLICKHOUSE-31]. 2017-05-24 23:25:01 +03:00
Vitaliy Lyudvichenko
d9637c2980 MergeTreeDataPart refactoring. [#CLICKHOUSE-2989]
Use relative_path to store actual part path.
Use renameTo() to move parts.
2017-05-24 23:23:58 +03:00
Vitaliy Lyudvichenko
5618234ee8 Separate tmp part dirs for merges, fetches and inserts. [#CLICKHOUSE-2989] 2017-05-24 23:23:58 +03:00
Alexey Milovidov
cb83b200cb Preparation [#CLICKHOUSE-31]. 2017-05-24 23:13:04 +03:00
Alexey Milovidov
8d570e2768 Renamed column "default_type" to "default_kind" in system.columns table to avoid ambiguity [#CLICKHOUSE-2]. 2017-05-24 22:54:25 +03:00
Alexey Milovidov
9fdd795087 Using more light method of query_id generation [#CLICKHOUSE-3025]. 2017-05-24 22:31:50 +03:00
Alexey Milovidov
0a55310076 Added comment [#CLICKHOUSE-3027]. 2017-05-24 21:49:30 +03:00
Alexey Milovidov
2e47c35fa9 Fixed error "zero number of streams requested" on Google Compute Engine VMs [#CLICKHOUSE-2037]. 2017-05-24 21:38:18 +03:00
Alexey Milovidov
91f9009cc4 Fixed build [#CLICKHOUSE-2955]. 2017-05-24 01:34:52 +03:00
Alexey Zatelepin
df5fb65b28 specify db path in accordance with container volume mountpoint [#CLICKHOUSE-2821] 2017-05-23 23:52:48 +03:00
Alexey Zatelepin
2ffc01b25a build helper container with network=host to avoid problems with ipv6 [#CLICKHOUSE-2821] 2017-05-23 23:38:17 +03:00
Alexey Milovidov
0dd71e32e0 Preparations, part 8 [#CLICKHOUSE-31]. 2017-05-23 23:04:42 +03:00
Alexey Milovidov
e073b62301 Fixed build [#CLICKHOUSE-31]. 2017-05-23 21:58:38 +03:00
Alexey Milovidov
c4f58f776b Preparations, part 7: Analyzers use const Context (and could be used in ExpressionAnalyzer) [#CLICKHOUSE-31]. 2017-05-23 21:53:11 +03:00
Alexey Milovidov
34cd1b9787 Preparations, part 6 [#CLICKHOUSE-31]. 2017-05-23 21:46:52 +03:00
Alexey Milovidov
46644aaaf0 Preparations, part 5: table functions are using const Context for execution [#CLICKHOUSE-31]. 2017-05-23 21:44:36 +03:00
Alexey Milovidov
2b20eca06b Preparations, part 4: StorageDistributed is initialized with const Context [#CLICKHOUSE-31]. 2017-05-23 21:37:14 +03:00
Alexey Milovidov
ce581bbf35 Preparations, part 3 [#CLICKHOUSE-31]. 2017-05-23 21:33:48 +03:00
Alexey Milovidov
a822dedc45 Preparations, part 2 [#CLICKHOUSE-31]. 2017-05-23 21:24:43 +03:00
Alexey Milovidov
66e209b492 Preparations, part 1 [#CLICKHOUSE-31]. 2017-05-23 21:01:50 +03:00
Alexey Milovidov
95e6577d6f Merge branch 'master' of github.com:yandex/ClickHouse 2017-05-23 20:35:41 +03:00
Alexey Milovidov
bb2f0a0893 Always restore in case of corrupted query_log, part_log [#CLICKHOUSE-3020]. 2017-05-23 20:35:05 +03:00
Alexey Zatelepin
6200ccb39c improve waiting for instance startup in integration tests [#CLICKHOUSE-2821] 2017-05-23 20:13:36 +03:00
Alexey Milovidov
c24f4c57af Style; removed useless catch [#CLICKHOUSE-2955]. 2017-05-23 19:36:07 +03:00
alexey-milovidov
d7e5e65028 Merge pull request #801 from yandex/dictionary-invalidate-query
Dictionary invalidate query
2017-05-23 20:31:52 +04:00
robot-metrika-test
96485e41c5 Auto version update to [54236] 2017-05-23 19:08:38 +03:00
Alex Zatelepin
1bcee80587 Fixed README.md [#CLICKHOUSE-2821] 2017-05-23 17:27:18 +03:00
Alexey Milovidov
38281226bd Fixed error in integration tests [#CLICKHOUSE-2821]. 2017-05-23 17:24:04 +03:00
Alexey Milovidov
95059092d4 Fixed README.md [#CLICKHOUSE-2821] 2017-05-23 16:57:38 +03:00
Alexey Milovidov
26a14c180d Fixed test [#CLICKHOUSE-2]. 2017-05-23 16:35:38 +03:00
Alexey Milovidov
45cf057b22 Fixed test [#CLICKHOUSE-3014]. 2017-05-23 16:32:46 +03:00
Nikolai Kochetov
45c1beca2a Merge branch 'master' into storage-dictionary 2017-05-23 13:44:03 +03:00
Nikolai Kochetov
f0ec7901e9 Merge branch 'master' into dictionary-invalidate-query 2017-05-23 13:27:31 +03:00
Alexey Milovidov
0c416be381 More simple code; fixed translation error [#CLICKHOUSE-2]. 2017-05-23 04:09:47 +03:00
Alexey Milovidov
25209bf040 Allow semicolon after JSONEachRow lines, for convenience [#CLICKHOUSE-2] 2017-05-23 03:57:58 +03:00
Alexey Milovidov
0e77575a76 JSONEachRow: allow to parse true and false as 1 and 0 for UInt8, Int8 data types [#CLICKHOUSE-3] 2017-05-22 23:13:17 +03:00
Alexey Milovidov
c323d7bf99 Added test for function defaultValueOfArgumentType [#CLICKHOUSE-3013]. 2017-05-22 22:04:18 +03:00
Alexey Milovidov
7269f3a23b Format Vertical: added support for totals, extremes and output_format_pretty_max_rows [#CLICKHOUSE-3014]. 2017-05-22 22:00:45 +03:00
Alexey Milovidov
734b240490 TrivialBuffer: fixed build after merge [#CLICKHOUSE-2929]. 2017-05-22 19:46:33 +03:00
Nikolai Kochetov
db3fbd91b7 added readInvalidateQuery 2017-05-22 19:46:14 +03:00
Nikolai Kochetov
86e63d2bba added readInvalidateQuery for uniform reading from BlockInputStream 2017-05-22 19:38:24 +03:00
Alexander Makarov
55bfaca662 StorageTrivialBuffer: added support for the replication [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexander Makarov
fdd636a785 fixup #2: comments on English, proper classname, StorageFactory update and merging in 'flush' method without lock [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexander Makarov
f8e19de0e3 fixups after review [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
alexey-milovidov
90e1767387 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
2fdb7057ba Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
10f188708b Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
84040d8a85 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
1059c87828 Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
3d009d153d Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
4cb799307b Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
fd1403d4c4 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
0fb0d36045 Update Block.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
d9761b6506 Update Block.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
d8e9e8fa99 Update Block.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
934476b2ed Update Block.cpp 2017-05-22 18:40:11 +04:00
Alexander Makarov
dfabe90373 TrivialBuffer implementation [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexey Zatelepin
65227021e7 ClickHouse integration tests. [#CLICKHOUSE-2821] 2017-05-22 17:56:41 +04:00
Vitaliy Lyudvichenko
48d85af41a Allow to skip garbage in TSKV format. [#CLICKHOUSE-3012] 2017-05-22 17:50:13 +04:00
Vitaliy Lyudvichenko
4fd357a311 Add more clear comments, refined code. [#CLICKHOUSE-2957] 2017-05-22 15:16:21 +04:00
Nikolai Kochetov
7762204b86 Merge branch 'master' into dictionary-invalidate-query 2017-05-22 13:49:45 +03:00
Alexey Milovidov
571af20a4f Added function defaultValueForArgumentType [#CLICKHOUSE-3013]. 2017-05-22 01:27:41 +03:00
Alexey Milovidov
0f252046ca Preparations [#CLICKHOUSE-2] 2017-05-22 01:25:25 +03:00
Vitaliy Lyudvichenko
45c1856556 Fix wrong implementation of CastTypeBlockInputStream (#807)
* Fix wrong implementation of CastTypeBlockInputStream. [#CLICKHOUSE-2957]

* Fix typos and add comments. [#CLICKHOUSE-2957]
2017-05-20 18:47:40 +04:00
Alexey Zatelepin
9c6829e982 Fix replica delay counting in case of ZooKeeper communication problems [#CLICKHOUSE-2141] 2017-05-20 17:32:00 +04:00
Vitaliy Lyudvichenko
eab306b53f Add more sophisticated test. [#METR-25237] 2017-05-20 17:30:59 +04:00
Vitaliy Lyudvichenko
bbe2a656cd Fixed preferred_block_size_bytes in case of PREWHERE with non-materialized column. [#METR-25237] 2017-05-20 17:30:59 +04:00
Alexey Zatelepin
d9306ab6b5 choose row with the max version for unmatched paths [#CLICKHOUSE-2984] 2017-05-20 17:25:48 +04:00
Alexey Zatelepin
f37ed1fbdb fix bugs in GraphiteMergeTree [#CLICKHOUSE-2984]:
* destructive rollup with Time=0 if no pattern matches
* differences in row count for Path and Value columns
* missed output rows on the boundaries between blocks
2017-05-20 17:25:48 +04:00
KochetovNicolai
f9cdae50d9 Cast boolean json fields to numbers (#809)
* added readBoolTextWord

* moved json bool cast to DataTypeNumber
2017-05-20 17:15:04 +04:00
Alexey Zatelepin
807570b32f Change tabs to spaces in clickhouse-test [#CLICKHOUSE-3]. 2017-05-19 21:31:48 +03:00
robot-metrika-test
bc2d232494 Auto version update to [54235] 2017-05-17 21:44:16 +04:00
Vitaliy Lyudvichenko
1d00f45dd3 Detect race condition between fetches and merges of the same part. [#CLICKHOUSE-2989] 2017-05-17 21:44:16 +04:00
Nikolai Kochetov
df087a2e98 merged with master 2017-05-16 13:06:45 +03:00
Nikolai Kochetov
16256503ec merged with master 2017-05-16 13:03:06 +03:00
Dmitry Luhtionov
4cc10af7b7 Add MACStringToOUI function 2017-05-16 10:32:49 +04:00
orantius
da83036326 Add age 55 for function roundAge. [#CLICKHOUSE-3001] 2017-05-15 22:42:39 +04:00
Nikolai Kochetov
7398062010 added undate by invalidate_query for MySql and ODBC dictionary sources 2017-05-15 17:16:10 +03:00
Nikolai Kochetov
427c020140 deleted dictionary ptr from StorageDictionary 2017-05-15 16:58:40 +03:00
Marek Vavruša
9520234365 Dictionaries/TrieDictionary: IP prefix dictionary
This commit implements a basic IP prefix dictionary
that allows storing IPv4/IPv6 prefixes and
matching them against a single IP address on query
time. This allows for doing IP -> ASN matching and
other similar things on query time.

The implementation is basic for start, using a
simple bitwise trie and reusing interface for
complex key dictionaries (so using tuple instead
of UInt32/FixedString(16) as the key). A faster
bitwise trie implementation (like poptrie) is
desired to improve lookup performance and
memory consumption with large prefix tables.
2017-05-15 10:51:03 +04:00
alexey-milovidov
e7b7f6f73d Update MergeTreeData.cpp 2017-05-15 10:34:40 +04:00
Vitaliy Lyudvichenko
6262fc8650 Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2] 2017-05-15 10:34:40 +04:00
f1yegor
92b56c2c7d translate comments 2017-05-14 19:03:55 +04:00
f1yegor
c252863b2e translate comments 2017-05-14 19:03:55 +04:00
Marek Vavruša
95d926ec14 AggregateFunctionTopK: smaller initial table size
By default start with 2^4 elements
2017-05-13 03:58:05 +04:00
Marek Vavruša
74cc0849dc iostream_debug_helpers: fixed build 2017-05-13 03:58:05 +04:00
robot-metrika-test
9d475d34f6 Auto version update to [54234] 2017-05-13 00:05:22 +03:00
Alexey Milovidov
282a395464 Fixed test [#CLICKHOUSE-2]. 2017-05-13 00:03:01 +03:00
Alexey Milovidov
d3a8faee16 Fixed test reference file for aggregate function topK [#CLICKHOUSE-3]. 2017-05-12 23:59:14 +03:00
Alexey Milovidov
cfc4c987c5 Added optional length parameter to aggregate function groupArrayInsertAt [#CLICKHOUSE-3003]. 2017-05-12 23:57:24 +03:00
Alexey Milovidov
40595ce688 Whitespaces [#CLICKHOUSE-3003]. 2017-05-12 23:41:50 +03:00
Alexey Milovidov
1d090bd4e2 AggregateFunctionGroupArrayInsertAt: fixed error [#CLICKHOUSE-3003]. 2017-05-12 23:05:19 +03:00
Alexey Milovidov
3819216085 StorageBuffer: explicitly disable support for PREWHERE, because possibility of wrong query results [#CLICKHOUSE-2999]. 2017-05-12 17:02:24 +03:00
Alexey Milovidov
4b852584ce Whitespaces [#CLICKHOUSE-2]. 2017-05-12 17:01:02 +03:00
Vitaliy Lyudvichenko
021e37943e More clearer code and correct test. [#CLICKHOUSE-1993] 2017-05-12 16:44:11 +03:00
Alexey Milovidov
9ad1d5676a Miscellaneous [#CLICKHOUSE-2]. 2017-05-12 01:21:06 +03:00
Alexey Milovidov
8f0e833b52 Whitespaces [#CLICKHOUSE-2]. 2017-05-11 22:48:46 +03:00
Marek Vavruša
45bd332460 AggregateFunctionTopK: fix memory usage, performance
* allow separate table key / hash key, and use
  std::string / StringRef for generic variant as
  it has built-in storage and StringRef is supported
  by the hash table, this avoids infinitely
  growing arena with serialised keys
* use power-of-2 size for alpha vector for faster
  binning without using modulo
* use custom grower and allocator for SpaceSaving
  to start with smaller tables
* store computed hash in counter for faster
  reinsertion of smallest element
2017-05-11 18:52:49 +04:00
Marek Vavruša
bc878f9785 Common/HashTable: allow cell reinsertion
* fixes missing setHash on reinsert
* reuses hash when emplacing value
2017-05-11 18:52:49 +04:00
Vitaliy Lyudvichenko
0f1627691e Don't forget to ATTACH MATERIALIZED columns. [#CLICKHOUSE-1993] 2017-05-11 18:39:12 +04:00
Dmitry Luhtionov
a21a6caf4e Доюавленф функции FunctionMACNumToString и FunctionMACStringToNum 2017-05-10 08:16:06 -04:00
Alexey Milovidov
66436db836 Added test [#CLICKHOUSE-2]. 2017-05-10 04:46:07 -04:00
Alexey Milovidov
2a57cfdbc2 Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:42:15 -04:00
Alexey Milovidov
21c5ee0f1d Aggregate function groupArrayInsertAt: development [#CLICKHOUSE-2]. 2017-05-10 04:41:25 -04:00