Commit Graph

5114 Commits

Author SHA1 Message Date
Alexey Milovidov
50d463d08b dbms: fixed error [#METR-17000]. 2015-12-08 05:01:46 +03:00
Alexey Milovidov
18c3aa441a dbms: removing old temporary files on startup [#METR-17000]. 2015-12-08 04:43:39 +03:00
Alexey Milovidov
dc7372ab71 dbms: fixed error [#METR-19271]. 2015-12-08 04:17:57 +03:00
Alexey Milovidov
35db0d65b9 dbms: fixed error [#METR-19288]. 2015-12-07 23:08:00 +03:00
Alexey Milovidov
78b560c846 dbms: fixed error [#METR-19283]. 2015-12-07 22:30:50 +03:00
Andrey Mironov
cf2c86956e dbms: SmallObjectPool: remove minimum size check [#METR-18946] 2015-12-07 19:30:26 +03:00
Andrey Mironov
479f1fc346 dbms: fix typo and absent support of Float64 for MySQL dictionaries [#METR-18946] 2015-12-07 19:30:26 +03:00
Andrey Mironov
d019af9ace dbms: add test for float formatting which has proven problematic [#METR-19166] 2015-12-07 15:46:13 +03:00
Alexey Milovidov
0d7135fcf6 dbms: fixed errors [#METR-17000]. 2015-12-06 22:42:28 +03:00
Alexey Milovidov
9ecd4a0fa2 dbms: additions [#METR-17000]. 2015-12-06 21:55:09 +03:00
Alexey Milovidov
513eb33b5b dbms: fixed error [#METR-17000]. 2015-12-06 19:42:17 +03:00
Alexey Milovidov
7dc5661521 dbms: more memory efficient merging aggregated states [#METR-17000]. 2015-12-06 19:22:01 +03:00
Alexey Milovidov
071b1e367c dbms: fixed error [#METR-19700]. 2015-12-06 18:29:16 +03:00
Alexey Milovidov
0ef797d9f3 dbms: fixed error [#METR-17000]. 2015-12-06 17:27:09 +03:00
Alexey Milovidov
2b1614825e dbms: improvement [#METR-17000]. 2015-12-06 10:33:39 +03:00
Alexey Milovidov
ed0c42253d dbms: MergingAggregatedMemoryEfficientBlockInputStream: correctly set memory tracker [#METR-17000]. 2015-12-06 08:43:36 +03:00
Alexey Milovidov
b76731a578 dbms: improved startup times for lagged replica [#METR-18563]. 2015-12-05 10:03:17 +03:00
Alexey Milovidov
7fa1a57165 dbms: fixed excessive memory allocation when splitting single-level block in Aggregator [#METR-17000]. 2015-12-05 10:01:18 +03:00
Alexey Milovidov
2e08b4e816 dbms: fixed error [#METR-17000]. 2015-12-05 08:54:10 +03:00
Alexey Milovidov
fa76a1a452 dbms: MergingAggregatedMemoryEfficientBlockInputStream: reading data in parallel [#METR-17000]. 2015-12-05 07:20:37 +03:00
Alexey Milovidov
e1deff76a9 dbms: fixed error [#METR-19262]. 2015-12-05 06:04:13 +03:00
Alexey Milovidov
6859f2085e dbms: fixed error with TOTALS [#METR-19259]. 2015-12-04 23:33:38 +03:00
Alexey Milovidov
5890747c56 dbms: instrumenting external sort/aggregation [#METR-17000]. 2015-12-04 00:23:21 +03:00
Pavel Kartavyy
1b1a1143a9 Merge 2015-12-03 14:02:02 +03:00
Alexey Milovidov
ec34b0bdcf dbms: more simple [#METR-19056]. 2015-12-03 08:29:08 +03:00
Alexey Milovidov
2755e90b15 dbms: fixed not-an-error [#METR-19056]. 2015-12-03 08:18:22 +03:00
Alexey Milovidov
0ceb0280f7 dbms: added setting 'aggregation_memory_efficient_merge_threads' [#METR-17000]. 2015-12-03 08:03:23 +03:00
Alexey Milovidov
117060cf43 dbms: fixed error [#METR-18167]. 2015-12-03 07:03:20 +03:00
Alexey Milovidov
11aa07ccbc dbms: fixed tests [#METR-17000]. 2015-12-03 06:56:50 +03:00
Alexey Milovidov
2b835d67e2 dbms: fixed dynamic compilation [#METR-17000]. 2015-12-03 06:18:42 +03:00
Alexey Milovidov
7012dc56a3 dbms: MergingAggregatedMemoryEfficientBlockInputStream: fixed two errors [#METR-17000]. 2015-12-03 05:43:40 +03:00
Alexey Milovidov
99d7aa59b8 dbms: allowed to merge partial-aggregated streams memory-efficient in parallel [#METR-17000]. 2015-12-02 01:35:48 +03:00
Alexey Milovidov
d76d57dda2 dbms: better [#METR-17000]. 2015-12-02 00:20:14 +03:00
Alexey Milovidov
b04fc9bdf0 dbms: fixed build [#METR-17000]. 2015-12-01 20:10:24 +03:00
Alexey Milovidov
7c753e1403 dbms: fixed build [#METR-17000]. 2015-12-01 20:08:33 +03:00
Alexey Milovidov
8844334423 dbms: external aggregation: development [#METR-17000]. 2015-12-01 19:58:15 +03:00
Alexey Milovidov
fe8f947a43 dbms: allowed external aggregation with non-parallel aggregation [#METR-17000]. 2015-12-01 17:43:51 +03:00
Alexey Milovidov
4352307bbc Merge 2015-12-01 17:11:51 +03:00
Alexey Milovidov
eef5fcc466 dbms: addition to prev. revision [#METR-17000]. 2015-12-01 17:11:31 +03:00
Alexey Milovidov
02b16fce06 dbms: external aggregation: initial implementation [#METR-17000]. 2015-12-01 17:09:05 +03:00
Andrey Mironov
eba1cb4ca3 dbms: FieldVisitorToString::formatFloat emit trailing dec pt [#METR-17328] 2015-12-01 14:16:50 +03:00
Alexey Milovidov
a7387d9ce4 dbms: improvement [#METR-2944]. 2015-11-30 23:20:37 +03:00
Alexey Milovidov
48e840a199 dbms: external aggregation: development [#METR-17000]. 2015-11-30 22:57:46 +03:00
Andrey Mironov
386d560d39 dbms: refactor DoubleConverter [#METR-17328] 2015-11-30 20:55:42 +03:00
Andrey Mironov
1ca3d930da dbms: do not allocate memory for default strings in cache dictionaries [#METR-17328] 2015-11-30 20:55:42 +03:00
Alexey Milovidov
83cf1f81ec dbms: Aggregator: preparation [#METR-17000]. 2015-11-30 19:57:05 +03:00
Dmitry Galuza
2e6266ceed Merge 2015-11-30 18:07:23 +03:00
Alexey Milovidov
ea45c07638 dbms: fixed error [#METR-19025]. 2015-11-30 09:56:27 +03:00
Alexey Milovidov
eb4034f7f2 dbms: better [#METR-2944]. 2015-11-29 20:06:30 +03:00
Alexey Milovidov
cc75d4603b dbms: improved performance of INSERT SELECT [#METR-19025]. 2015-11-29 16:18:12 +03:00
Alexey Milovidov
39004c76f5 dbms: addition [#METR-19052]. 2015-11-29 15:54:58 +03:00
Alexey Milovidov
b6aaf1fe32 dbms: development; provided monotonicity properties for date-time functions [#METR-19052]. 2015-11-29 14:58:44 +03:00
Alexey Milovidov
d9bc972a59 dbms: allowed to use index if column is wrapped by piecewise-monotonic functions: initial implementation [#METR-19052]. 2015-11-29 11:06:29 +03:00
Alexey Milovidov
e64197d436 dbms: addition [#METR-19025]. 2015-11-27 23:50:48 +03:00
Alexey Milovidov
7e5b79fbe9 dbms: added test for merges [#METR-19025]. 2015-11-27 23:48:55 +03:00
Dmitry Galuza
30c946aea1 Merge 2015-11-27 14:55:16 +03:00
Alexey Milovidov
fb88629d67 dbms: added test [#METR-19128]. 2015-11-27 00:36:23 +03:00
Alexey Milovidov
98b3bfa48d dbms: workaround for incompatibility with gcc and clang [#METR-19128]. 2015-11-27 00:31:06 +03:00
Alexey Milovidov
3a5d47014f dbms: added test result [#METR-18778]. 2015-11-26 20:28:26 +03:00
Dmitry Galuza
5ca181053c Merge 2015-11-26 16:34:07 +03:00
Alexey Milovidov
747525d818 dbms: quantileTDigest: attempt to fix an error (incomplete) [#METR-19024]. 2015-11-26 00:42:41 +03:00
Alexey Milovidov
8c8210062a dbms: added support for hex escape sequences in strings [#METR-19072]. 2015-11-25 06:11:17 +03:00
Andrey Mironov
699e5480f6 dbms: use ArenaWithFreeLists for strings in cache dictionary [#METR-17328] 2015-11-24 15:47:51 +03:00
Andrey Mironov
7159c57280 dbms: fix error with ternary operator having priority lower than binary + [#METR-17328] 2015-11-24 14:28:29 +03:00
Andrey Mironov
ee21853933 dbms: MongoDBDictionarySource now can use complex keys[#METR-17328] 2015-11-24 14:28:29 +03:00
Andrey Mironov
24f986c9f1 dbms: fixed ArenaWithFreeLists "off-by-one" error which lead to allocating blocks of size less than required. 2015-11-24 14:28:29 +03:00
Alexey Milovidov
eca62f753c dbms: fixed error [#METR-19024]. 2015-11-24 06:21:37 +03:00
Alexey Milovidov
d189c6206a dbms: fixed error [#METR-19024]. 2015-11-24 04:21:28 +03:00
Alexey Milovidov
26a5aad691 dbms: added test (result pending) [#METR-18778]. 2015-11-24 00:35:42 +03:00
Alexey Milovidov
26d19fe1bc dbms: fixed error with GLOBAL JOIN [#METR-19048]. 2015-11-24 00:34:36 +03:00
Alexey Milovidov
bb88a1e1bf dbms: quantiles: allowed parameters in non-increasing order [#METR-18778]. 2015-11-24 00:33:43 +03:00
Alexey Milovidov
49be9e9b3e dbms: added comment [#METR-19024]. 2015-11-23 23:24:54 +03:00
Dmitry Galuza
fa73a9e3af ███████████: New fields in visits log [#METR-18831] 2015-11-23 18:33:53 +03:00
Alexey Milovidov
c9ea87ec11 dbms: addition to prev. revision [#METR-2944]. 2015-11-21 22:52:31 +03:00
Alexey Milovidov
7cf850f194 dbms: fixed error in prev. revision [#METR-2944]. 2015-11-21 22:51:47 +03:00
Alexey Milovidov
1889600e39 dbms: improved performance of Aggregator in non-compiled case [#METR-2944]. 2015-11-21 22:46:27 +03:00
Alexey Milovidov
6584d9ca6c dbms: better [#METR-2944]. 2015-11-21 21:56:54 +03:00
Alexey Milovidov
8a592860ef dbms: improved performance of INSERT SELECT (experimental) [#METR-19025]. 2015-11-21 19:26:48 +03:00
Alexey Milovidov
c461d32474 dbms: fixed comment [#METR-2944]. 2015-11-21 18:51:09 +03:00
Alexey Milovidov
8314861690 dbms: improved performance of INSERT SELECT [#METR-19025]. 2015-11-21 18:47:32 +03:00
Alexey Milovidov
2c67747a0d dbms: implemented quantilesTDigest and quantilesTDigestWeighted aggregate functions [#METR-19024]. 2015-11-21 17:04:43 +03:00
Alexey Milovidov
31c09b4d2d dbms: added weighted variants of t-digest [#METR-19024]. 2015-11-21 16:24:51 +03:00
Alexey Milovidov
57e8a8fdbb dbms: added t-digest algorithm [#METR-19024]. 2015-11-21 15:47:41 +03:00
Alexey Milovidov
d7c24b8203 dbms: fixed build [#METR-2944]. 2015-11-21 06:20:31 +03:00
Alexey Milovidov
659cf5a940 dbms: improved performance of ColumnArray::filter [#METR-19022]. 2015-11-21 06:19:43 +03:00
Andrey Mironov
715d2f6ce5 dbms: add key description to system.dictionaries[#METR-17328] 2015-11-20 19:20:54 +03:00
Andrey Mironov
aece1d21f8 dbms: improve dictGet functions for constant defaults [#METR-17328], [#METR-18520] 2015-11-20 18:53:23 +03:00
Dmitry Galuza
9558802570 ███████████: Refactoring, update ut [#METR-18831] 2015-11-20 18:41:39 +03:00
Alexey Milovidov
0713e4c592 dbms: addition to prev. revision [#METR-18847]. 2015-11-20 06:08:12 +03:00
Alexey Milovidov
5e2499eb77 dbms: addition to prev. revision [#METR-18847]. 2015-11-20 05:42:26 +03:00
Alexey Milovidov
4318712300 dbms: addition to prev. revision [#METR-18847]. 2015-11-20 05:29:16 +03:00
Dmitry Galuza
65e912a05c ███████████: New fields into example [#METR-18831] 2015-11-20 00:48:17 +03:00
Alexey Milovidov
2d8457418f dbms: added test [#METR-18847]. 2015-11-20 00:43:20 +03:00
Alexey Milovidov
2d00e5d84f dbms: SAMPLE ... OFFSET development: using rational numbers [#METR-18847]. 2015-11-20 00:34:53 +03:00
Andrey Mironov
295e23a587 dbms: reimplement ArenaWithFreeLists on top of Arena [#METR-17328], [#METR-18520] 2015-11-19 18:06:00 +03:00
Andrey Mironov
de8eb7b914 dbms: fix debug build of ArenaWithFreeLists. [#METR-17328], [#METR-18520] 2015-11-19 16:41:35 +03:00
Andrey Mironov
6c8c0e03cb dbms: slightly refactor most dictionaries, add dictHas function for all dictionaries supporting dictGet*OrDefault. [#METR-17328], [#METR-18520] 2015-11-19 16:15:02 +03:00
Andrey Mironov
6d42868283 dbms: ClickHouseDictionarySource: check that key is present before dereferencing [#METR-18945] 2015-11-19 09:50:05 +03:00
Alexey Milovidov
f67c8e63a2 dbms: SAMPLE ... OFFSET development [#METR-18847]. 2015-11-19 06:40:15 +03:00
Alexey Milovidov
4c778ca1f6 dbms: added test (not passing yet) [#METR-18847]. 2015-11-19 06:38:09 +03:00
Alexey Milovidov
1b08920e50 dbms: SAMPLE OFFSET: development [#METR-18847]. 2015-11-19 06:24:59 +03:00
Alexey Milovidov
09dd253636 dbms: added support for SAMPLE ... OFFSET [#METR-18847]. 2015-11-19 00:37:28 +03:00
Alexey Milovidov
8255d76754 dbms: added missing include [#METR-18945]. 2015-11-19 00:35:24 +03:00
Andrey Mironov
e4ecbf42b1 dbms: fix cache-type dictionary memory effect on default values [#METR-17382] 2015-11-18 17:06:53 +03:00
Andrey Mironov
8feafa0da2 dbms: add dictGet*OrDefault for all new dictionaries [#METR-17382] 2015-11-18 16:31:29 +03:00
Andrey Mironov
4f1caeb0e4 dbms: SmallObjectPool for ComplexKeyCacheDictionary [#METR-17382] 2015-11-18 14:53:15 +03:00
Andrey Mironov
2e8cc93664 dbms: ArenaWithFreeLists basic implementation. [#METR-17382] 2015-11-17 19:09:43 +03:00
Alexey Milovidov
0270f2ff4d dbms: addition [#METR-18778]. 2015-11-17 02:49:18 +03:00
Alexey Milovidov
4056b3f2c8 dbms: fixed error [#METR-18778]. 2015-11-16 23:33:43 +03:00
Andrey Mironov
b6930dafa1 dbms: support loading composite keys in MySQLDictionarySource [#METR-17328] 2015-11-16 20:49:39 +03:00
Andrey Mironov
0fd1fc9cdc dbms: add ComplexKeyCacheDictionary, not yet complete [#METR-17328]
Requires a way of deallocating keys in memory Arena (a new type of arena, actually), MySQLDictionarySource not yet capable of requesting complex keys.
2015-11-16 20:49:39 +03:00
Andrey Mironov
7798c45b5b dbms: rename validateKeyColumns to validateKeyTypes [#METR-17328] 2015-11-16 20:49:39 +03:00
Alexey Milovidov
408a2e4751 Fixed errors in gcc-5 [#METR-18843]. 2015-11-16 07:56:31 +03:00
Alexey Milovidov
af37192e0c dbms: fixed errors on gcc-5 [#METR-18843]. 2015-11-16 07:15:53 +03:00
Alexey Milovidov
302e726a14 dbms: fixed error in gcc-5 [#METR-18843]. 2015-11-16 07:00:46 +03:00
Alexey Milovidov
df3f04cdeb dbms: fixing warnings in gcc-5 [#METR-18843]. 2015-11-16 06:28:10 +03:00
Alexey Milovidov
27ff4dd5d8 Updated double-conversion library (fixed warning in gcc-5) [#METR-18843]. 2015-11-16 06:10:37 +03:00
Alexey Milovidov
a82692e655 dbms: fixed error [#METR-2944]. 2015-11-15 12:17:51 +03:00
Alexey Milovidov
4b7db2cc36 dbms: addition to prev. revision [#METR-18778]. 2015-11-15 12:17:11 +03:00
Alexey Milovidov
dc04cb7b88 dbms: addition to prev. revision [#METR-18778]. 2015-11-15 12:14:22 +03:00
Alexey Milovidov
a7469e82d1 dbms: addition to prev. revision [#METR-18778]. 2015-11-15 12:12:40 +03:00
Alexey Milovidov
2870fbb655 dbms: moved file [#METR-18778]. 2015-11-15 12:06:53 +03:00
Alexey Milovidov
ce0f3da2b2 dbms: modified test [#METR-18778]. 2015-11-15 11:52:21 +03:00
Alexey Milovidov
49580a9048 dbms: added aggregate function quantileExactWeighted and companions [#METR-18778]. 2015-11-15 11:31:08 +03:00
Alexey Milovidov
3a1a8c9567 dbms: addition to prev. revision [#METR-18778]. 2015-11-15 10:05:01 +03:00
Alexey Milovidov
a2efbc1efc dbms: renamed functions [#METR-18778]. 2015-11-15 09:23:44 +03:00
Alexey Milovidov
3a6f91fc70 dbms: addition to prev. revision [#METR-18778]. 2015-11-15 09:19:34 +03:00
Alexey Milovidov
4a537fcb84 dbms: moved file [#METR-18778]. 2015-11-15 09:18:43 +03:00
Alexey Milovidov
749e54749c dbms: moved file [#METR-18778]. 2015-11-15 09:11:58 +03:00
Alexey Milovidov
eb7421640e dbms: added tests [#METR-18778]. 2015-11-15 08:58:01 +03:00
Alexey Milovidov
f353711e5e dbms: improved performance of quantile and quantileDeterministic aggregate functions [#METR-18778]. 2015-11-15 08:52:41 +03:00
Alexey Milovidov
8732e7a3f1 dbms: improved performance of aggregate function groupArray [#METR-18778]. 2015-11-15 07:54:56 +03:00
Alexey Milovidov
8a0892f2fb dbms: quantileExact: added small set optimization [#METR-18778]. 2015-11-15 06:20:29 +03:00
Alexey Milovidov
4c87ec04b4 dbms: quantileExact: initial implementation [#METR-18778]. 2015-11-15 06:11:24 +03:00
Alexey Milovidov
959ae7cd78 dbms: unified allocators [#METR-18778]. 2015-11-15 06:09:40 +03:00
Alexey Milovidov
109eec92ff dbms: fixed error with UNION ALL and subqueries in IN [#METR-18808]. 2015-11-13 23:50:51 +03:00
Alexey Milovidov
513b4e0dc2 dbms: fixed error message [#METR-18810]. 2015-11-13 23:31:02 +03:00
Evgeniy Gatov
998f5fd552 dbms: temporarily disabled shards multiplexing [#METR-18300]. 2015-11-13 20:21:16 +03:00
Andrey Mironov
078cc8dbb4 dbms: significantly simplify ComplexKeyDictionary code and length [#METR-17328]
Add commentary about dictGet*OrDefault to FlatDictionary.
2015-11-13 17:01:30 +03:00
Andrey Mironov
c0ba6bedcb dbms:rename ComplexKeyDictionary to ComplexKeyHashedDictionary [#METR-17328] 2015-11-13 14:21:40 +03:00
Andrey Mironov
a863b2b0a4 dbms: take ComplexKeyDictionary::keys_pool size into account when determining bytes_allocated [#METR-17328] 2015-11-13 14:08:25 +03:00
Andrey Mironov
5c641ffc78 dbms: dictGet* functions for complex_key dictionary. No dictGet*OrDefault variants yet [#METR-17328] 2015-11-13 04:44:41 +03:00
Andrey Mironov
701bed3fae dbms: add ComplexKeyDictionary, no fetching of values yet [#METR-17328] 2015-11-12 19:29:07 +03:00
Andrey Mironov
2642f2fec4 dbms: add parsing of complex key definitions [#METR-17328] 2015-11-12 19:29:06 +03:00
Alexey Milovidov
fea8d76c77 dbms: fixed deadlock [#METR-18755]. 2015-11-12 05:14:28 +03:00
Alexey Milovidov
7f736e4065 dbms: temporarily disabled shards multiplexing [#METR-18300]. 2015-11-12 04:17:44 +03:00
Alexey Milovidov
9b991b3d6c dbms: whitespaces [#METR-2944]. 2015-11-11 05:13:24 +03:00
Alexey Milovidov
02fcbbbdd5 dbms: better [#METR-2944]. 2015-11-11 05:04:23 +03:00
Alexey Milovidov
f6cce1f55d dbms: fixed error with -State functions and WITH TOTALS [#METR-18727]. 2015-11-11 04:28:34 +03:00
Alexey Milovidov
d88b9bc889 dbms: improvement [#METR-15573]. 2015-11-11 03:20:22 +03:00