Commit Graph

694 Commits

Author SHA1 Message Date
Alexey Milovidov
e34eb1abcf dbms: addition to prev. revision [#METR-2944]. 2015-02-22 14:25:26 +03:00
Alexey Milovidov
0c144eb619 dbms: addition to prev. revision [#METR-2944]. 2015-02-22 13:53:09 +03:00
Alexey Milovidov
664d85e08f dbms: added support for value 'auto' of setting 'max_threads'; using that value by default [#METR-2944]. 2015-02-22 13:50:36 +03:00
Alexey Milovidov
bbd48f8921 dbms: Aggregator: added specialization for many (up to 256 bit) fixed-size keys (up to 3x performance improvement) [#METR-2944]. 2015-02-22 08:53:16 +03:00
Alexey Milovidov
b6f4d3d3e8 dbms: added setting 'group_by_two_level_threshold' for fine tuning [#METR-2944]. 2015-02-22 08:51:16 +03:00
Alexey Milovidov
a838833a30 dbms: improved performance of aggregation by few fixed-size keys (up to 18%) [#METR-2944]. 2015-02-22 05:18:39 +03:00
Alexey Milovidov
f7ef574ed2 dbms: improved performance of Set, Join, Distinct and arrayEnumerateUniq [#METR-2944]. 2015-02-20 22:48:52 +03:00
Alexey Arno
9e44061a2f dbms: Server: cosmetic changes [#METR-14875] 2015-02-20 14:33:21 +03:00
Alexey Arno
64c8535382 dbms: Server: performance optimization [#METR-14875] 2015-02-20 13:37:55 +03:00
Alexey Arno
533783d64b dbms: Server: performance optimization (minimize copies and reallocations) [#METR-14875] 2015-02-19 17:55:47 +03:00
Alexey Arno
86129c634f dbms: Server: performance optimization [#METR-14875] 2015-02-19 14:08:49 +03:00
Alexey Arno
19a93cc0bf dbms: Server: fixed DAG traversal [#METR-14875] 2015-02-19 01:13:54 +03:00
Alexey Arno
d5d41df78d dbms: Server: cosmetic changes [#METR-14875] 2015-02-18 21:18:37 +03:00
Alexey Arno
123acacb4d dbms: Server: removed old code [#METR-14875] 2015-02-18 20:43:44 +03:00
Alexey Arno
3d497e689b dbms: Server: compilation fix [#METR-14875] 2015-02-18 20:09:06 +03:00
Alexey Arno
cd59370159 dbms: Server: feature development [#METR-14875] 2015-02-18 20:05:25 +03:00
Alexey Arno
4dd8387f2d dbms: Server: feature development [#METR-14875] 2015-02-18 20:05:25 +03:00
Alexey Arno
8407779d2e dbms: Server: feature development [#METR-14875] 2015-02-18 20:03:15 +03:00
Alexey Arno
0869016283 dbms: Server: feature development [#METR-14875] 2015-02-18 20:03:14 +03:00
Alexey Arno
2c547ad2fd dbms: Server: feature development [#METR-14875] 2015-02-18 20:03:14 +03:00
Alexey Arno
f6745b2972 dbms: Server: feature development [#METR-14875] 2015-02-18 20:03:14 +03:00
Alexey Arno
932755f851 dbms: Server: feature development [#METR-14875] 2015-02-18 20:03:14 +03:00
Alexey Arno
c342867233 dbms: Server: feature development [#METR-14875] 2015-02-18 20:03:14 +03:00
Alexey Arno
c95bec1cf4 dbms: Server: feature development [#METR-14875] 2015-02-18 20:03:14 +03:00
Alexey Milovidov
7d4ce4b505 dbms: added settings to fine tune reads from merge tree [#METR-2944]. 2015-02-15 05:31:48 +03:00
Alexey Arno
b5105ecdf7 dbms: Server: fixed bug in UNION ALL [#METR-15077] 2015-02-13 14:40:58 +03:00
Alexey Milovidov
ea113f138f dbms: preparation [#METR-2944]. 2015-02-13 04:17:44 +03:00
Alexey Milovidov
a9eb28c07d Using std::make_unique [#METR-2807]. 2015-02-11 00:10:58 +03:00
Alexey Milovidov
d0972a159d dbms: added setting 'max_memory_bandwidth' [#METR-15052]. 2015-02-10 23:48:17 +03:00
Andrey Mironov
984aa5c4b5 dbms: extract external dictionaries management to a separate type [#METR-13298] 2015-02-10 20:40:40 +03:00
Andrey Mironov
8c62be82d1 dbms: make StorageFactory a singleton 2015-02-09 13:10:35 +03:00
Andrey Mironov
5a92644082 dbms: disable auto-reset on Poco::Event in Dictionaries [#METR-13298] 2015-02-05 16:57:12 +03:00
Andrey Mironov
cee209db3e Merge 2015-02-04 14:01:06 +03:00
Andrey Mironov
6fecb60894 dbms: better decoupling [#METR-13298] 2015-02-03 20:03:35 +03:00
Alexey Arno
218bfa5316 dbms: Server: add support for multiple connections in PoolWithFailoverBase. [#METR-14410] 2015-02-03 16:36:08 +03:00
Andrey Mironov
409dc6ff1b dbms: proper reloading for non-cached dictionaries [#METR-13298] 2015-02-03 14:51:33 +03:00
Alexey Milovidov
e4ae80fd2d Removed Yandex Catalog categories (not used; but empty columns in tables are left) [#METR-14873]. 2015-02-03 00:22:07 +03:00
Alexey Milovidov
5271a45625 dbms: fixed error with JOINs [#METR-14847]. 2015-02-01 10:20:33 +03:00
Alexey Milovidov
1e18ff37c6 dbms: fixed error with JOIN [#METR-14847]. 2015-01-31 00:19:35 +03:00
Andrey Mironov
647cd1b0eb dbms: check dictionary source modification prior to reloading [#METR-13298]
Mysql and Clickhouse sources are not currently checked and will always say they are modified.
Reload periods are not currently checked.
2015-01-29 18:47:21 +03:00
Alexey Milovidov
aef67b8c44 dbms: addition to prev. revision [#METR-2944]. 2015-01-29 06:11:56 +03:00
Alexey Milovidov
6db5e98515 dbms: StorageJoin: fixed error [#METR-2944]. 2015-01-29 06:07:58 +03:00
Alexey Milovidov
8a61f96d67 dbms: StorageJoin: development [#METR-2944]. 2015-01-28 00:24:24 +03:00
Alexey Milovidov
fed642cd7c dbms: added StorageSet [#METR-2944]. 2015-01-27 03:52:03 +03:00
Alexey Milovidov
a1eb599105 dbms: added value 'in_order' to setting 'load_balancing' [#METR-14782]. 2015-01-26 22:55:10 +03:00
Andrey Mironov
1b4b0d5779 dbms: MysqlDictionarySource with draft MysqlBockInputStream 2015-01-26 19:53:44 +03:00
Andrey Mironov
419d517867 dbms: add abstractions for dictionary sources 2015-01-26 18:27:51 +03:00
Andrey Mironov
92664ed612 dbms: sparse array implementation of FlatDictionary. [#METR-13298] 2015-01-22 17:32:38 +03:00
Andrey Mironov
300b7342e7 dbms: dummy types and functions for external dictionaries. [#METR-13298] 2015-01-21 14:39:48 +03:00
Alexey Milovidov
af27e06238 Fixed errors in clang (part 4) [#METR-2807]. 2015-01-21 07:23:22 +03:00
Alexey Milovidov
9947387bef dbms: added distributed sorting [#METR-2944]. 2015-01-18 11:27:28 +03:00
Alexey Milovidov
099d64931d dbms: compiled aggregator: development [#METR-2944]. 2015-01-18 04:18:39 +03:00
Alexey Milovidov
bca1036dd8 dbms: compiled aggregator: added support for empty list of aggregate functions [#METR-2944]. 2015-01-18 04:11:32 +03:00
Alexey Milovidov
819f13801d dbms: fixed error with WITH TOTALS and group_by_overflow_mode [#METR-14604]. 2015-01-15 22:29:37 +03:00
Alexey Milovidov
715f5bf8d1 dbms: fixed error with GLOBAL IN when one of shard is localhost [#METR-14557]. 2015-01-14 05:44:25 +03:00
Alexey Milovidov
ad5fdc0e62 dbms: compiled aggregator: development [#METR-2944]. 2015-01-13 06:03:45 +03:00
Alexey Milovidov
818d5ed0c5 dbms: compiled aggregator: development [#METR-2944]. 2015-01-13 04:57:22 +03:00
Alexey Milovidov
b5b1693573 dbms: Cluster: cleanups [#METR-2944]. 2015-01-13 03:56:43 +03:00
Alexey Milovidov
a7a988bdc3 dbms: removed setting asynchronous (useless, obsolete) [#METR-2944]. 2015-01-13 03:36:26 +03:00
Alexey Milovidov
ba732b6ba3 dbms: removed SplittingAggregator [#METR-2944]. 2015-01-13 03:08:36 +03:00
Alexey Milovidov
882bf3ea75 dbms: compiled aggregator: development [#METR-2944]. 2015-01-11 05:00:26 +03:00
Alexey Milovidov
19f1bff25d dbms: dynamic compiled aggregator: development [#METR-2944]. 2015-01-11 03:57:21 +03:00
Alexey Milovidov
5bbfa7b9f0 dbms: fixed error in prev. revision [#METR-2944]. 2015-01-11 03:35:30 +03:00
Alexey Milovidov
a7a2712630 dbms: compiled aggregator: development [#METR-2944]. 2015-01-10 05:30:03 +03:00
Alexey Milovidov
6673251a20 dbms: dynamic compilation: development [#METR-2944]. 2015-01-10 00:43:13 +03:00
Alexey Milovidov
01fd1d1e0f dbms: dynamic compiler: development [#METR-2944]. 2015-01-09 00:41:35 +03:00
Alexey Milovidov
9225adb3fc dbms: tiny modifications [#METR-2944]. 2015-01-08 21:52:48 +03:00
Alexey Milovidov
41a7fc50d6 dbms: added support for external sorting [#METR-2944]. 2015-01-07 20:19:23 +03:00
Alexey Milovidov
6212e7080b dbms: more scalable aggregator: development [#METR-2944]. 2015-01-03 09:49:32 +03:00
Alexey Milovidov
7c292a9956 dbms: more scalable aggregator: development [#METR-2944]. 2015-01-03 08:39:21 +03:00
Alexey Milovidov
221efeb82a dbms: more scalable aggregator: development [#METR-2944]. 2015-01-03 06:18:49 +03:00
Alexey Milovidov
a7eacd1269 dbms: more scalable aggregator: development [#METR-2944]. 2015-01-02 06:50:14 +03:00
Alexey Milovidov
acbe19fd84 dbms: more scalable aggregator: development [#METR-2944]. 2015-01-02 06:16:28 +03:00
Alexey Milovidov
fd8b2b5261 dbms: Aggregator: preparation [#METR-2944]. 2015-01-02 03:35:33 +03:00
Alexey Milovidov
e9232fc2fc dbms: more scalable aggregator: development [#METR-2944]. 2014-12-30 21:04:53 +03:00
Alexey Milovidov
716fad23d0 dbms: more scalable aggregator: development [#METR-2944]. 2014-12-30 15:58:02 +03:00
Alexey Milovidov
01526513ae dbms: more scalable aggregator: development [#METR-2944]. 2014-12-30 14:27:58 +03:00
Alexey Milovidov
f9f0682033 dbms: more scalable aggregator: development [#METR-2944]. 2014-12-30 13:16:23 +03:00
Alexey Milovidov
611d585e93 Merge 2014-12-30 06:56:37 +03:00
Alexey Milovidov
b0f5ce86a3 dbms: more scalable aggregator: development [#METR-2944]. 2014-12-27 08:43:13 +03:00
Alexey Arno
2cdffef31c dbms: Server: minimize the number of calls to executeUnion(). [#METR-14099] 2014-12-27 00:37:38 +03:00
Alexey Milovidov
da1974bbf3 dbms: more scalable aggregator: development [#METR-2944]. 2014-12-25 23:56:01 +03:00
Alexey Milovidov
cf3812532e dbms: more scalable aggregator: development [#METR-2944]. 2014-12-25 23:18:01 +03:00
Alexey Arno
ae2fb27f9b dbms: Server: add optimization for UNION ALL queries that do not contain wildcards. [#METR-14099] 2014-12-25 18:27:03 +03:00
Alexey Arno
70d01a1696 dbms: Server: fixed function names according to naming convention, added more comments and functional tests. [#METR-14099] 2014-12-25 13:22:24 +03:00
Alexey Milovidov
33efb971b4 Merge 2014-12-24 22:00:41 +03:00
Alexey Milovidov
32a2ec00d1 dbms: more scalable aggragator: preparation [#METR-2944]. 2014-12-24 22:00:14 +03:00
Alexey Arno
3cc4410c50 dbms: Server: add more optimizations and refactoring in InterpreterSelectQuery initialization. [#METR-14099] 2014-12-24 18:30:15 +03:00
Alexey Arno
b0256d0990 dbms: Server: Remove boilerplate code. [#METR-14099] 2014-12-24 18:30:15 +03:00
Alexey Arno
ece876f05d dbms: Server: add first part of a fix for column renaming in UNION ALL queries. 2014-12-24 18:30:14 +03:00
Alexey Milovidov
10553e7840 dbms: fixed error with views [#METR-14449]. 2014-12-23 23:32:00 +03:00
Alexey Arno
28055dde55 dbms: Server: fixed typo in function declaration [#METR-14408] 2014-12-20 00:19:48 +03:00
Alexey Arno
5d23310cea dbms: Server: execute queries from views with as most parallelism as possible [#METR-14408] 2014-12-19 18:56:12 +03:00
Alexey Arno
84456a08c3 dbms: Server: rewrite expression lists in each SELECT query of the UNION ALL chain, if needed. [#METR-14099] 2014-12-19 16:10:48 +03:00
Alexey Milovidov
a362a666eb dbms: fixed error with JOIN [#METR-14411]. 2014-12-19 05:30:13 +03:00
Alexey Arno
747d2211d6 Remove code that turned out to be redudant. [#METR-14099] 2014-12-17 23:57:21 +03:00
Alexey Arno
d29f019981 Apply required fixes [#METR-14099] 2014-12-17 18:56:52 +03:00
Andrey Mironov
3ebfd2fb7f dbms: pass proper context into Storage::read(). [#METR-14179]
This reverts commit 34b3f738a67432b44f6f69238dd1529535984d1a.
2014-12-17 17:19:07 +03:00
Alexey Arno
8cdc779c9c Add fix: temporarily turn off UNION ALL support for SELECT queries because it breaks functional tests. [#METR-14099] 2014-12-16 15:06:51 +03:00
Alexey Arno
819b3bd6ac Code cleanups [#METR-14099]. 2014-12-15 19:07:50 +03:00
Alexey Arno
9dd48cbf36 Simplify code [#METR-14099]. 2014-12-15 19:07:50 +03:00
Alexey Arno
53318492a0 Add optimization in InterpreterSelectQuery that tries to minimize quantity of stream mergings. 2014-12-15 19:07:50 +03:00
Alexey Arno
dd6ac530f4 Various cleanups 2014-12-15 19:07:49 +03:00
Alexey Arno
8995500f14 Add initial support for SELECT requests chained by UNION ALL. 2014-12-15 19:07:49 +03:00
Alexey Milovidov
f4ea556a30 dbms: lowered memory usage of huge ORDER BY with small LIMIT [#METR-2944]. 2014-12-15 07:13:33 +03:00
Alexey Milovidov
4de26c886c dbms: changed default value of totals_mode [#MOBMET-1139]. 2014-12-05 22:37:23 +03:00
Andrey Mironov
d0971956e0 dbms: add quantile[s]Deterministic, rename stdext:: to ext:: [#METR-13199] 2014-11-21 16:34:37 +03:00
Alexey Milovidov
a7b4903f14 dbms: fixed error with replication when 'interserver_http_port' is not specified [#METR-13831]. 2014-11-19 23:40:51 +03:00
Andrey Mironov
50328d120a Merge 2014-11-12 13:42:04 +03:00
Andrey Mironov
731be3e7cf Merge 2014-11-12 13:37:47 +03:00
Alexey Milovidov
9a9036f217 dbms: added FREEZE PARTITION functionality [#METR-13441]. 2014-11-11 07:11:07 +03:00
Alexey Milovidov
ec08b393de dbms: tiny improvement [#METR-2944]. 2014-11-01 02:20:18 +03:00
Alexey Milovidov
37e599934f dbms: further [#METR-2944]. 2014-10-29 05:35:16 +03:00
Alexey Milovidov
425263970f dbms: improved performance of aggregation by one numeric key (up to: 2x for UInt8, 5x for UInt16, 1.1x for UInt32, UInt64) [#METR-2944]. 2014-10-29 04:18:50 +03:00
Alexey Milovidov
0045133b0e dbms: prepared for fully-functional progress bar [#METR-2944]. 2014-10-25 22:33:52 +04:00
Andrey Mironov
ec5aa734f9 dbms: cut coupling between dbms and dbms_functions. [#METR-12739] 2014-10-24 13:33:31 +04:00
Andrey Mironov
847b91614a dbms: deduce and check types during alter, alteration of defaulted columns. [#METR-12739] 2014-10-21 16:11:20 +04:00
Alexey Milovidov
d3664eac89 dbms: added setting replication_alter_partitions_sync [#METR-13158]. 2014-10-18 23:14:09 +04:00
Andrey Mironov
0bfd35e5c7 dbms: defaulted columns support for ALTER, currently without type deduction and checking. 2014-10-16 17:37:01 +04:00
Alexey Milovidov
c2e4662ad7 Changed boost:: to std:: for bind, ref/cref, thread, shared_ptr [#METR-2807]. 2014-10-16 05:21:03 +04:00
Alexey Milovidov
07ba420b85 dbms: addition to prev. revision; removed support to FETCH UNREPLICATED PARTITION [#METR-13153]. 2014-10-15 23:59:12 +04:00
Andrey Mironov
6f7997ce11 dbms: prohibit inserting materialized columns, support create as and similar queries. [#METR-12739] 2014-10-10 19:45:43 +04:00
Alexey Milovidov
c1601502bd dbms: FETCH PARTITION: parsing and dispatching [#METR-13153]. 2014-10-10 00:28:33 +04:00
Andrey Mironov
f675bed75b dbms: add partial validation of ALTER queries. [#METR-12739] 2014-10-07 13:09:59 +04:00
Alexey Milovidov
a800baba16 dbms: more neat [#METR-2944]. 2014-10-07 02:48:20 +04:00
Alexey Milovidov
2c2d4ea921 dbms: added table system.settings [#METR-2944]. 2014-10-06 06:01:41 +04:00
Andrey Mironov
220ce78326 dbms: support ALIAS in table declaration 2014-10-03 19:30:10 +04:00
Andrey Mironov
468b7af64e Merge 2014-10-03 14:19:34 +04:00
Andrey Mironov
59ae69c5e9 rename optimization setting to optimize_move_to_prewhere 2014-10-02 13:48:53 +04:00
Andrey Mironov
aebc4f0f48 add merge_tree_optimize_where setting, default to false. [#METR-11900] 2014-10-01 17:51:44 +04:00
Andrey Mironov
5f88c8ae81 always show default_type and default_expression columns for DESC TABLE query. [#METR-12739] 2014-10-01 15:17:44 +04:00
Andrey Mironov
34dba980c7 show defaulted columns info in DESC TABLE query output. [#METR-12739] 2014-09-30 07:48:40 +04:00
Andrey Mironov
8052020218 add draft version of DEFAULT, MATERIALIZED/ALIAS currently parsed but not taken into account. [#METR-12739] 2014-09-30 07:08:47 +04:00
Andrey Mironov
3060ba9571 return ColumnDefaults from InterpreterCreateQuery::parseColumns. [#METR-12739] 2014-09-29 18:58:48 +04:00
Andrey Mironov
1d04061a0e implement type-deduction and type-enforcing. [#METR-12739] 2014-09-25 19:01:09 +04:00
Andrey Mironov
f77ef5f84d rename evaluateDatabaseName function and header, add comments 2014-09-24 15:53:41 +04:00
Andrey Mironov
0a4e3f1280 add function currentDatabase(), allow string-expressions in place of database name 2014-09-24 15:53:41 +04:00
Alexey Milovidov
658ab39d41 dbms: removed misleading comment [#METR-12795]. 2014-09-18 22:12:07 +04:00
Andrey Mironov
e954fa6d00 add elapsed and progress rows to system.merges. [#METR-12574]
Fix data-race introduced due to misconception of atomic instructions on integers.
2014-09-18 14:23:12 +04:00
Andrey Mironov
09a570ffc0 Merge 2014-09-12 20:05:29 +04:00
Andrey Mironov
13a77ffaa1 fix DB::ProcessList::Element::Update 2014-09-12 16:50:18 +04:00
Andrey Mironov
e3d8e4e48b initial implementation. [#METR-12574] 2014-09-10 15:34:26 +04:00
Alexey Milovidov
842f04db1f dbms: preparation [#METR-2944]. 2014-08-24 11:17:50 +04:00
Andrey Mironov
09265f50f9 StorageDistributed: write to multiple local replicas, post-review corrections. [#METR-12221] 2014-08-22 18:06:20 +04:00
Alexey Milovidov
5523bdeaca dbms: improved performance on small blocks [#METR-2944]. 2014-08-22 06:31:54 +04:00
Alexey Milovidov
aae80fa8c5 dbms: removed deprecated 'replica_name' configuration parameter [#METR-10202]. 2014-08-22 05:01:28 +04:00
Alexey Milovidov
2b188ba6e0 dbms: improved build time [#METR-2944]. 2014-08-22 04:57:20 +04:00
Andrey Mironov
c6d4fd941f review corrections. [#METR-12221] 2014-08-21 16:15:24 +04:00
Andrey Mironov
269be93cbe write to local nodes, refactor StorageDistributed, extract DirectoryMonitor. [#METR-12221] 2014-08-19 12:33:14 +04:00
Andrey Mironov
ec0cee0afe escape user, password and host. [#METR-12221] 2014-08-19 12:33:14 +04:00