Commit Graph

3418 Commits

Author SHA1 Message Date
Alexey Milovidov
7f74a32c80 dbms: little more correct [#METR-17579]. 2015-12-13 10:03:30 +03:00
Alexey Milovidov
34236c3913 dbms: addition to prev. revision [#METR-17579]. 2015-12-13 10:00:43 +03:00
Alexey Milovidov
28c63f20f6 dbms: addition to prev. revision [#METR-17579]. 2015-12-13 09:56:00 +03:00
Alexey Milovidov
2aeb48be2d dbms: added backoff on slow reads [#METR-17579]. 2015-12-13 07:52:13 +03:00
Andrey Mironov
72ef6b08b6 dbms: fix MongoDB dictionary source for UInt32 clamped to Int32[#METR-18946] 2015-12-10 19:27:20 +03:00
Alexey Milovidov
f27bfcdc0b dbms: temporarily set 'aggregation_memory_efficient_merge_threads' to 1 because of incorrect implementation [#METR-17000]. 2015-12-10 05:40:31 +03:00
Andrey Mironov
b7f496eb7b dbms: fix MongoDB dictionary source for UInt8 [#METR-18946] 2015-12-09 15:30:45 +03:00
Andrey Mironov
e7c435c27e dbms: fix typo and absent support of Float64 for MongoDB dictionaries [#METR-18946] 2015-12-09 15:30:45 +03:00
Alexey Milovidov
db8d82f13e dbms: Buffer: better [#METR-19249]. 2015-12-09 09:55:49 +03:00
Alexey Milovidov
03f091c01c dbms: fixed error [#METR-19316]. 2015-12-09 07:28:01 +03:00
Alexey Milovidov
e348105481 dbms: get rid of bad idea [#METR-19056]. 2015-12-09 07:06:44 +03:00
Alexey Milovidov
a43272c9b8 dbms: fixed error in memory-efficient merging of aggregated states [#METR-17000]. 2015-12-09 05:56:18 +03:00
Alexey Milovidov
7560351942 dbms: removed old code [#METR-17000]. 2015-12-09 05:55:35 +03:00
Andrey Mironov
c8e3d90536 dbms: SmallObjectPool: fix odr-use in debug build 2015-12-08 12:16:40 +03:00
Andrey Mironov
a57f996770 dbms: fix transform() accepting non constant second argument 2015-12-08 12:16:40 +03:00
Alexey Milovidov
50d463d08b dbms: fixed error [#METR-17000]. 2015-12-08 05:01:46 +03:00
Alexey Milovidov
dc7372ab71 dbms: fixed error [#METR-19271]. 2015-12-08 04:17:57 +03:00
Andrey Mironov
cf2c86956e dbms: SmallObjectPool: remove minimum size check [#METR-18946] 2015-12-07 19:30:26 +03:00
Andrey Mironov
479f1fc346 dbms: fix typo and absent support of Float64 for MySQL dictionaries [#METR-18946] 2015-12-07 19:30:26 +03:00
Alexey Milovidov
0d7135fcf6 dbms: fixed errors [#METR-17000]. 2015-12-06 22:42:28 +03:00
Alexey Milovidov
7dc5661521 dbms: more memory efficient merging aggregated states [#METR-17000]. 2015-12-06 19:22:01 +03:00
Alexey Milovidov
071b1e367c dbms: fixed error [#METR-19700]. 2015-12-06 18:29:16 +03:00
Alexey Milovidov
0ef797d9f3 dbms: fixed error [#METR-17000]. 2015-12-06 17:27:09 +03:00
Alexey Milovidov
2b1614825e dbms: improvement [#METR-17000]. 2015-12-06 10:33:39 +03:00
Alexey Milovidov
7fa1a57165 dbms: fixed excessive memory allocation when splitting single-level block in Aggregator [#METR-17000]. 2015-12-05 10:01:18 +03:00
Alexey Milovidov
fa76a1a452 dbms: MergingAggregatedMemoryEfficientBlockInputStream: reading data in parallel [#METR-17000]. 2015-12-05 07:20:37 +03:00
Alexey Milovidov
e1deff76a9 dbms: fixed error [#METR-19262]. 2015-12-05 06:04:13 +03:00
Alexey Milovidov
5890747c56 dbms: instrumenting external sort/aggregation [#METR-17000]. 2015-12-04 00:23:21 +03:00
Pavel Kartavyy
1b1a1143a9 Merge 2015-12-03 14:02:02 +03:00
Alexey Milovidov
ec34b0bdcf dbms: more simple [#METR-19056]. 2015-12-03 08:29:08 +03:00
Alexey Milovidov
2755e90b15 dbms: fixed not-an-error [#METR-19056]. 2015-12-03 08:18:22 +03:00
Alexey Milovidov
0ceb0280f7 dbms: added setting 'aggregation_memory_efficient_merge_threads' [#METR-17000]. 2015-12-03 08:03:23 +03:00
Alexey Milovidov
2b835d67e2 dbms: fixed dynamic compilation [#METR-17000]. 2015-12-03 06:18:42 +03:00
Alexey Milovidov
7012dc56a3 dbms: MergingAggregatedMemoryEfficientBlockInputStream: fixed two errors [#METR-17000]. 2015-12-03 05:43:40 +03:00
Alexey Milovidov
99d7aa59b8 dbms: allowed to merge partial-aggregated streams memory-efficient in parallel [#METR-17000]. 2015-12-02 01:35:48 +03:00
Alexey Milovidov
d76d57dda2 dbms: better [#METR-17000]. 2015-12-02 00:20:14 +03:00
Alexey Milovidov
8844334423 dbms: external aggregation: development [#METR-17000]. 2015-12-01 19:58:15 +03:00
Alexey Milovidov
fe8f947a43 dbms: allowed external aggregation with non-parallel aggregation [#METR-17000]. 2015-12-01 17:43:51 +03:00
Alexey Milovidov
eef5fcc466 dbms: addition to prev. revision [#METR-17000]. 2015-12-01 17:11:31 +03:00
Alexey Milovidov
02b16fce06 dbms: external aggregation: initial implementation [#METR-17000]. 2015-12-01 17:09:05 +03:00
Alexey Milovidov
48e840a199 dbms: external aggregation: development [#METR-17000]. 2015-11-30 22:57:46 +03:00
Andrey Mironov
386d560d39 dbms: refactor DoubleConverter [#METR-17328] 2015-11-30 20:55:42 +03:00
Andrey Mironov
1ca3d930da dbms: do not allocate memory for default strings in cache dictionaries [#METR-17328] 2015-11-30 20:55:42 +03:00
Alexey Milovidov
83cf1f81ec dbms: Aggregator: preparation [#METR-17000]. 2015-11-30 19:57:05 +03:00
Dmitry Galuza
2e6266ceed Merge 2015-11-30 18:07:23 +03:00
Alexey Milovidov
eb4034f7f2 dbms: better [#METR-2944]. 2015-11-29 20:06:30 +03:00
Alexey Milovidov
cc75d4603b dbms: improved performance of INSERT SELECT [#METR-19025]. 2015-11-29 16:18:12 +03:00
Alexey Milovidov
b6aaf1fe32 dbms: development; provided monotonicity properties for date-time functions [#METR-19052]. 2015-11-29 14:58:44 +03:00
Alexey Milovidov
d9bc972a59 dbms: allowed to use index if column is wrapped by piecewise-monotonic functions: initial implementation [#METR-19052]. 2015-11-29 11:06:29 +03:00
Dmitry Galuza
30c946aea1 Merge 2015-11-27 14:55:16 +03:00
Alexey Milovidov
98b3bfa48d dbms: workaround for incompatibility with gcc and clang [#METR-19128]. 2015-11-27 00:31:06 +03:00
Dmitry Galuza
5ca181053c Merge 2015-11-26 16:34:07 +03:00
Alexey Milovidov
747525d818 dbms: quantileTDigest: attempt to fix an error (incomplete) [#METR-19024]. 2015-11-26 00:42:41 +03:00
Alexey Milovidov
8c8210062a dbms: added support for hex escape sequences in strings [#METR-19072]. 2015-11-25 06:11:17 +03:00
Andrey Mironov
699e5480f6 dbms: use ArenaWithFreeLists for strings in cache dictionary [#METR-17328] 2015-11-24 15:47:51 +03:00
Andrey Mironov
7159c57280 dbms: fix error with ternary operator having priority lower than binary + [#METR-17328] 2015-11-24 14:28:29 +03:00
Andrey Mironov
ee21853933 dbms: MongoDBDictionarySource now can use complex keys[#METR-17328] 2015-11-24 14:28:29 +03:00
Andrey Mironov
24f986c9f1 dbms: fixed ArenaWithFreeLists "off-by-one" error which lead to allocating blocks of size less than required. 2015-11-24 14:28:29 +03:00
Alexey Milovidov
eca62f753c dbms: fixed error [#METR-19024]. 2015-11-24 06:21:37 +03:00
Alexey Milovidov
d189c6206a dbms: fixed error [#METR-19024]. 2015-11-24 04:21:28 +03:00
Alexey Milovidov
bb88a1e1bf dbms: quantiles: allowed parameters in non-increasing order [#METR-18778]. 2015-11-24 00:33:43 +03:00
Alexey Milovidov
49be9e9b3e dbms: added comment [#METR-19024]. 2015-11-23 23:24:54 +03:00
Dmitry Galuza
fa73a9e3af ███████████: New fields in visits log [#METR-18831] 2015-11-23 18:33:53 +03:00
Alexey Milovidov
c9ea87ec11 dbms: addition to prev. revision [#METR-2944]. 2015-11-21 22:52:31 +03:00
Alexey Milovidov
7cf850f194 dbms: fixed error in prev. revision [#METR-2944]. 2015-11-21 22:51:47 +03:00
Alexey Milovidov
1889600e39 dbms: improved performance of Aggregator in non-compiled case [#METR-2944]. 2015-11-21 22:46:27 +03:00
Alexey Milovidov
6584d9ca6c dbms: better [#METR-2944]. 2015-11-21 21:56:54 +03:00
Alexey Milovidov
c461d32474 dbms: fixed comment [#METR-2944]. 2015-11-21 18:51:09 +03:00
Alexey Milovidov
8314861690 dbms: improved performance of INSERT SELECT [#METR-19025]. 2015-11-21 18:47:32 +03:00
Alexey Milovidov
2c67747a0d dbms: implemented quantilesTDigest and quantilesTDigestWeighted aggregate functions [#METR-19024]. 2015-11-21 17:04:43 +03:00
Alexey Milovidov
31c09b4d2d dbms: added weighted variants of t-digest [#METR-19024]. 2015-11-21 16:24:51 +03:00
Alexey Milovidov
57e8a8fdbb dbms: added t-digest algorithm [#METR-19024]. 2015-11-21 15:47:41 +03:00
Alexey Milovidov
d7c24b8203 dbms: fixed build [#METR-2944]. 2015-11-21 06:20:31 +03:00
Alexey Milovidov
659cf5a940 dbms: improved performance of ColumnArray::filter [#METR-19022]. 2015-11-21 06:19:43 +03:00
Andrey Mironov
715d2f6ce5 dbms: add key description to system.dictionaries[#METR-17328] 2015-11-20 19:20:54 +03:00
Andrey Mironov
aece1d21f8 dbms: improve dictGet functions for constant defaults [#METR-17328], [#METR-18520] 2015-11-20 18:53:23 +03:00
Dmitry Galuza
9558802570 ███████████: Refactoring, update ut [#METR-18831] 2015-11-20 18:41:39 +03:00
Dmitry Galuza
65e912a05c ███████████: New fields into example [#METR-18831] 2015-11-20 00:48:17 +03:00
Alexey Milovidov
2d00e5d84f dbms: SAMPLE ... OFFSET development: using rational numbers [#METR-18847]. 2015-11-20 00:34:53 +03:00
Andrey Mironov
295e23a587 dbms: reimplement ArenaWithFreeLists on top of Arena [#METR-17328], [#METR-18520] 2015-11-19 18:06:00 +03:00
Andrey Mironov
de8eb7b914 dbms: fix debug build of ArenaWithFreeLists. [#METR-17328], [#METR-18520] 2015-11-19 16:41:35 +03:00
Andrey Mironov
6c8c0e03cb dbms: slightly refactor most dictionaries, add dictHas function for all dictionaries supporting dictGet*OrDefault. [#METR-17328], [#METR-18520] 2015-11-19 16:15:02 +03:00
Andrey Mironov
6d42868283 dbms: ClickHouseDictionarySource: check that key is present before dereferencing [#METR-18945] 2015-11-19 09:50:05 +03:00
Alexey Milovidov
09dd253636 dbms: added support for SAMPLE ... OFFSET [#METR-18847]. 2015-11-19 00:37:28 +03:00
Alexey Milovidov
8255d76754 dbms: added missing include [#METR-18945]. 2015-11-19 00:35:24 +03:00
Andrey Mironov
e4ecbf42b1 dbms: fix cache-type dictionary memory effect on default values [#METR-17382] 2015-11-18 17:06:53 +03:00
Andrey Mironov
8feafa0da2 dbms: add dictGet*OrDefault for all new dictionaries [#METR-17382] 2015-11-18 16:31:29 +03:00
Andrey Mironov
4f1caeb0e4 dbms: SmallObjectPool for ComplexKeyCacheDictionary [#METR-17382] 2015-11-18 14:53:15 +03:00
Andrey Mironov
2e8cc93664 dbms: ArenaWithFreeLists basic implementation. [#METR-17382] 2015-11-17 19:09:43 +03:00
Alexey Milovidov
0270f2ff4d dbms: addition [#METR-18778]. 2015-11-17 02:49:18 +03:00
Alexey Milovidov
4056b3f2c8 dbms: fixed error [#METR-18778]. 2015-11-16 23:33:43 +03:00
Andrey Mironov
b6930dafa1 dbms: support loading composite keys in MySQLDictionarySource [#METR-17328] 2015-11-16 20:49:39 +03:00
Andrey Mironov
0fd1fc9cdc dbms: add ComplexKeyCacheDictionary, not yet complete [#METR-17328]
Requires a way of deallocating keys in memory Arena (a new type of arena, actually), MySQLDictionarySource not yet capable of requesting complex keys.
2015-11-16 20:49:39 +03:00
Andrey Mironov
7798c45b5b dbms: rename validateKeyColumns to validateKeyTypes [#METR-17328] 2015-11-16 20:49:39 +03:00
Alexey Milovidov
408a2e4751 Fixed errors in gcc-5 [#METR-18843]. 2015-11-16 07:56:31 +03:00
Alexey Milovidov
302e726a14 dbms: fixed error in gcc-5 [#METR-18843]. 2015-11-16 07:00:46 +03:00
Alexey Milovidov
df3f04cdeb dbms: fixing warnings in gcc-5 [#METR-18843]. 2015-11-16 06:28:10 +03:00
Alexey Milovidov
27ff4dd5d8 Updated double-conversion library (fixed warning in gcc-5) [#METR-18843]. 2015-11-16 06:10:37 +03:00
Alexey Milovidov
a82692e655 dbms: fixed error [#METR-2944]. 2015-11-15 12:17:51 +03:00
Alexey Milovidov
4b7db2cc36 dbms: addition to prev. revision [#METR-18778]. 2015-11-15 12:17:11 +03:00
Alexey Milovidov
dc04cb7b88 dbms: addition to prev. revision [#METR-18778]. 2015-11-15 12:14:22 +03:00
Alexey Milovidov
a7469e82d1 dbms: addition to prev. revision [#METR-18778]. 2015-11-15 12:12:40 +03:00
Alexey Milovidov
2870fbb655 dbms: moved file [#METR-18778]. 2015-11-15 12:06:53 +03:00
Alexey Milovidov
49580a9048 dbms: added aggregate function quantileExactWeighted and companions [#METR-18778]. 2015-11-15 11:31:08 +03:00
Alexey Milovidov
3a1a8c9567 dbms: addition to prev. revision [#METR-18778]. 2015-11-15 10:05:01 +03:00
Alexey Milovidov
a2efbc1efc dbms: renamed functions [#METR-18778]. 2015-11-15 09:23:44 +03:00
Alexey Milovidov
3a6f91fc70 dbms: addition to prev. revision [#METR-18778]. 2015-11-15 09:19:34 +03:00
Alexey Milovidov
4a537fcb84 dbms: moved file [#METR-18778]. 2015-11-15 09:18:43 +03:00
Alexey Milovidov
749e54749c dbms: moved file [#METR-18778]. 2015-11-15 09:11:58 +03:00
Alexey Milovidov
f353711e5e dbms: improved performance of quantile and quantileDeterministic aggregate functions [#METR-18778]. 2015-11-15 08:52:41 +03:00
Alexey Milovidov
8732e7a3f1 dbms: improved performance of aggregate function groupArray [#METR-18778]. 2015-11-15 07:54:56 +03:00
Alexey Milovidov
8a0892f2fb dbms: quantileExact: added small set optimization [#METR-18778]. 2015-11-15 06:20:29 +03:00
Alexey Milovidov
4c87ec04b4 dbms: quantileExact: initial implementation [#METR-18778]. 2015-11-15 06:11:24 +03:00
Alexey Milovidov
959ae7cd78 dbms: unified allocators [#METR-18778]. 2015-11-15 06:09:40 +03:00
Andrey Mironov
078cc8dbb4 dbms: significantly simplify ComplexKeyDictionary code and length [#METR-17328]
Add commentary about dictGet*OrDefault to FlatDictionary.
2015-11-13 17:01:30 +03:00
Andrey Mironov
c0ba6bedcb dbms:rename ComplexKeyDictionary to ComplexKeyHashedDictionary [#METR-17328] 2015-11-13 14:21:40 +03:00
Andrey Mironov
a863b2b0a4 dbms: take ComplexKeyDictionary::keys_pool size into account when determining bytes_allocated [#METR-17328] 2015-11-13 14:08:25 +03:00
Andrey Mironov
5c641ffc78 dbms: dictGet* functions for complex_key dictionary. No dictGet*OrDefault variants yet [#METR-17328] 2015-11-13 04:44:41 +03:00
Andrey Mironov
701bed3fae dbms: add ComplexKeyDictionary, no fetching of values yet [#METR-17328] 2015-11-12 19:29:07 +03:00
Andrey Mironov
2642f2fec4 dbms: add parsing of complex key definitions [#METR-17328] 2015-11-12 19:29:06 +03:00
Alexey Milovidov
9b991b3d6c dbms: whitespaces [#METR-2944]. 2015-11-11 05:13:24 +03:00
Alexey Milovidov
02fcbbbdd5 dbms: better [#METR-2944]. 2015-11-11 05:04:23 +03:00
Alexey Milovidov
f6cce1f55d dbms: fixed error with -State functions and WITH TOTALS [#METR-18727]. 2015-11-11 04:28:34 +03:00
Alexey Milovidov
60054d177c dbms: removed madvise because it is bad [#MTRSADMIN-1703]. 2015-11-11 00:21:24 +03:00
Alexey Milovidov
ec163175ab dbms: explicitly disabled arguments of type AggregateFunction of aggregate functions min, max, any, anyLast family [#METR-18758]. 2015-11-10 23:48:49 +03:00
Alexey Milovidov
b75d6c163a dbms: fixed error [#METR-18758]. 2015-11-10 23:39:11 +03:00
Andrey Mironov
32614f5206 dbms: dictGetOrDefault for all types, explicit StringRef(string) [#METR-18520] 2015-11-10 12:29:30 +03:00
Alexey Milovidov
66ac9359dc dbms: (almost) fixed error [#METR-18727]. 2015-11-10 04:23:08 +03:00
Alexey Milovidov
e78ed9f802 dbms: replication delays: development [#METR-17573]. 2015-11-09 23:30:54 +03:00
Alexey Milovidov
4b29a48124 dbms: fixed error [#METR-17109]. 2015-11-09 21:45:55 +03:00
Alexey Milovidov
52a3b686cd dbms: fixed error; parsing 'ON' expression in JOINs [#METR-18692]. 2015-11-08 05:42:33 +03:00
Alexey Milovidov
0e5bf428d0 dbms: better handling of compound identifiers [#METR-18692]. 2015-11-08 04:29:37 +03:00
Alexey Milovidov
4482871274 dbms: allowed aliases without AS keyword in SELECT clause at top level [#METR-15573]. 2015-11-08 03:28:12 +03:00
Alexey Milovidov
6f9c9d05a5 dbms: fixed priority of parsing tuple element operator [#METR-18692]. 2015-11-08 02:18:39 +03:00
Alexey Arno
29dc5f91d1 Merge 2015-11-06 20:44:01 +03:00
Alexey Milovidov
4a35d9169f dbms: merges don't block ALTERs [#METR-18690]. 2015-11-06 20:34:48 +03:00
Andrey Mironov
f8e5fed856 dbms: dictGetStringOrDefault, other functions on the way [#METR-18520] 2015-11-06 17:54:04 +03:00
Alexey Milovidov
53dd07b8ca dbms: checking replication delays: development [#METR-17573]. 2015-11-05 23:08:18 +03:00
Alexey Milovidov
e29df2814c dbms: checking replication delays [#METR-17573]. 2015-11-05 22:44:19 +03:00
Alexey Milovidov
11447a4e1a dbms: accurate checking of replication delays (incomplete) [#METR-17573]. 2015-11-05 20:38:24 +03:00
Andrey Mironov
977954f9ce AIOContextPool: wait for all io_events in flight before destruction [#METR-18618] 2015-11-05 18:40:01 +03:00
Andrey Mironov
ad27ad476d AIOContextPool: type aliases for clarity, commentary corrections [#METR-18618] 2015-11-05 17:11:09 +03:00
Andrey Mironov
249a5922fe AIOContextPool: refactor, extract member functions, employ a condition_variable to minimize CPU waste [#METR-18618] 2015-11-05 16:52:21 +03:00
Alexey Arno
67d42f3aa8 dbms: Server: Bug fix. If the FROM section of a subquery does not refer to a table, the depth (as specified in the algorithm for distributed IN/JOIN subqueries processing) of this subquery must not increase. [#METR-18524] 2015-11-05 14:11:20 +03:00
Alexey Milovidov
7829695455 Merge 2015-11-03 22:01:06 +03:00
Alexey Milovidov
127918a032 dbms: when limit for rows to read/result exceeded, will break at next block [#METR-18644]. 2015-11-03 21:58:43 +03:00
Andrey Mironov
32f31eedc4 AIOContextPool: handle EAGAIN from a call to io_submit [#METR-18618] 2015-11-03 18:37:21 +03:00
Andrey Mironov
9bfd90bb0f dbms: use AIOContextPool in ReadBufferAIO [#METR-18618] 2015-11-03 18:15:45 +03:00
Alexey Milovidov
213a6dedbd dbms: probably fixed error [#METR-18611]. 2015-11-02 22:19:29 +03:00
Alexey Milovidov
00ea6b6b94 dbms: ODBC: more conscious [#METR-18538]. 2015-10-31 08:48:28 +03:00