Commit Graph

461 Commits

Author SHA1 Message Date
Alexey Milovidov
9225adb3fc dbms: tiny modifications [#METR-2944]. 2015-01-08 21:52:48 +03:00
Alexey Milovidov
c9950249c1 dbms: additions to prev. revision [#METR-2944]. 2015-01-07 21:07:00 +03:00
Alexey Milovidov
41a7fc50d6 dbms: added support for external sorting [#METR-2944]. 2015-01-07 20:19:23 +03:00
Alexey Milovidov
8620b80d99 dbms: fixed collations; preparation to external sorting [#METR-2944]. 2015-01-07 18:30:11 +03:00
Alexey Milovidov
4eff949e22 dbms: fixed uninitialized memory read [#METR-2944]. 2015-01-03 11:46:57 +03:00
Alexey Milovidov
221efeb82a dbms: more scalable aggregator: development [#METR-2944]. 2015-01-03 06:18:49 +03:00
Alexey Milovidov
7cf0bca8af dbms: more scalable aggregator: development [#METR-2944]. 2015-01-02 08:28:21 +03:00
Alexey Milovidov
acbe19fd84 dbms: more scalable aggregator: development [#METR-2944]. 2015-01-02 06:16:28 +03:00
Alexey Milovidov
e9232fc2fc dbms: more scalable aggregator: development [#METR-2944]. 2014-12-30 21:04:53 +03:00
Alexey Milovidov
da1974bbf3 dbms: more scalable aggregator: development [#METR-2944]. 2014-12-25 23:56:01 +03:00
Alexey Milovidov
10553e7840 dbms: fixed error with views [#METR-14449]. 2014-12-23 23:32:00 +03:00
Alexey Milovidov
41a005ba73 dbms: style [#METR-2944]. 2014-12-19 21:33:30 +03:00
Andrey Mironov
1271af2f09 dbms: create default context for RemoteBlockInputStream only once. [#METR-14403] 2014-12-19 17:56:18 +03:00
Andrey Mironov
3ebfd2fb7f dbms: pass proper context into Storage::read(). [#METR-14179]
This reverts commit 34b3f738a67432b44f6f69238dd1529535984d1a.
2014-12-17 17:19:07 +03:00
Andrey Mironov
49e322a045 Revert "dbms: pass proper context into Storage::read(). [#METR-14179]"
This reverts commit c0800b74a6fa338d29a65111599aa1fe71b67201.
2014-12-16 19:22:57 +03:00
Andrey Mironov
fc9472ba47 dbms: pass proper context into Storage::read(). [#METR-14179] 2014-12-16 15:40:25 +03:00
Andrey Mironov
f92720b41f dbms: fix PushingToViews* behaviour for temporary tables 2014-12-16 15:40:25 +03:00
Alexey Milovidov
9527462193 dbms: fixed memory tracking [#METR-14301]. 2014-12-15 08:23:44 +03:00
Alexey Milovidov
922184e62f dbms: more uniform aggregation: better [#METR-2944]. 2014-12-15 02:07:57 +03:00
Alexey Milovidov
99ba283688 dbms: more uniform aggregation: development [#METR-2944]. 2014-12-14 11:27:22 +03:00
Alexey Milovidov
562e4f3a3e Merge 2014-12-14 08:28:11 +03:00
Andrey Mironov
fae4eb388d dbms: enforce const in CreatingSetsBlockInputStream ctor. 2014-12-02 20:25:09 +03:00
Alexey Milovidov
59f3e9bf17 dbms: more uniform aggregation: development [#METR-2944]. 2014-12-02 03:31:07 +03:00
Alexey Milovidov
da4c4a0566 dbms: more uniform load of threads while aggragation [#METR-2944]. 2014-11-30 21:22:57 +03:00
Alexey Milovidov
92e5793c8e dbms: tiny fix [#METR-2944]. 2014-11-30 09:59:03 +03:00
Alexey Milovidov
d7a1abbbdc Merge 2014-11-22 05:22:30 +03:00
Andrey Mironov
731be3e7cf Merge 2014-11-12 13:37:47 +03:00
Alexey Milovidov
a58104c818 dbms: showing progress for INSERT SELECT query [#METR-13612]. 2014-11-09 02:52:18 +03:00
Alexey Milovidov
0045133b0e dbms: prepared for fully-functional progress bar [#METR-2944]. 2014-10-25 22:33:52 +04:00
Andrey Mironov
ec5aa734f9 dbms: cut coupling between dbms and dbms_functions. [#METR-12739] 2014-10-24 13:33:31 +04:00
Andrey Mironov
1dfcaefc64 Merge 2014-10-16 20:55:23 +04:00
Alexey Milovidov
c2e4662ad7 Changed boost:: to std:: for bind, ref/cref, thread, shared_ptr [#METR-2807]. 2014-10-16 05:21:03 +04:00
Andrey Mironov
43deee45c9 dbms: MATERIALIZED columns evaluation during insert, error handling. #[METR-12739] 2014-10-13 18:35:40 +04:00
Andrey Mironov
6f7997ce11 dbms: prohibit inserting materialized columns, support create as and similar queries. [#METR-12739] 2014-10-10 19:45:43 +04:00
Andrey Mironov
f7ce30aa9d dbms: support AddingDefaultBlock(Input|Output)Stream without ColumnDefaults 2014-10-03 14:25:05 +04:00
Andrey Mironov
8052020218 add draft version of DEFAULT, MATERIALIZED/ALIAS currently parsed but not taken into account. [#METR-12739] 2014-09-30 07:08:47 +04:00
Alexey Milovidov
a81b5d7df9 dbms: additions to prev. revision [#METR-12857]. 2014-09-23 03:21:15 +04:00
Alexey Milovidov
81c268177b dbms: probably fixed error when writeSuffix method wasn't called when writing to table [#METR-12767]. 2014-09-18 23:49:31 +04:00
Andrey Mironov
09a570ffc0 Merge 2014-09-12 20:05:29 +04:00
Alexey Milovidov
d8cad3c79b dbms: slightly improved performance on small blocks; removed unused code [#METR-2944]. 2014-08-22 22:49:51 +04:00
Evgeniy Gatov
bc887b15dd dbms, columnar-sender: development [#METR-12299]. 2014-08-21 16:58:07 +04:00
Alexey Milovidov
65cf115313 dbms: fixed error (progress message in the middle of data, in JSON formats) [#METR-11125]. 2014-08-15 00:27:41 +04:00
Alexey Milovidov
51f73643c6 ███████████: fixed order of rows processing [#METR-12291]. 2014-08-12 04:15:17 +04:00
Michael Kolupaev
40d98ad7a9 dbms: more informative exception message when reading fails during merge (in lucky cases when an exception occurs instead of a segfault). [#METR-11980] 2014-07-21 15:34:43 +04:00
Alexey Milovidov
35e8a15092 dbms: improvement [#METR-11765]. 2014-07-16 06:06:58 +04:00
Alexey Milovidov
cdbff6e120 dbms: fixed race condition (still messy) [#METR-11765]. 2014-07-16 05:36:18 +04:00
Alexey Milovidov
94012f8231 columnar-sender: development [#METR-11888]. 2014-07-11 04:29:59 +04:00
Michael Kolupaev
0a67d151bd dbms: updated all usages of NamesAndTypesPair to new field names. [#METR-10202] 2014-07-09 15:54:26 +04:00
Alexey Milovidov
f107415f75 dbms: fixed error; more diagnostics for GLOBAL subqueries [#METR-11370]. 2014-07-07 01:59:20 +04:00
Alexey Milovidov
8643f02ac0 dbms: reworked GLOBAL subqueries (probably doesn't work) [#METR-11370]. 2014-07-06 23:48:39 +04:00
Pavel Kartavyy
4260d6bf24 RemoteBlockOutputSream: better logging 2014-07-04 17:01:44 +04:00
Michael Kolupaev
1f45a832d9 RemoteBlockOutputStream fix. [#METR-10202] 2014-06-27 21:58:25 +04:00
Michael Kolupaev
2d2634c1e2 fixes. [#METR-10202] 2014-06-27 21:58:25 +04:00
Michael Kolupaev
68f6a9263a Merge 2014-06-27 21:58:25 +04:00
Alexey Milovidov
108a7850a5 dbms: improved performance on short queries [#METR-11571]. 2014-06-26 04:58:14 +04:00
Alexey Milovidov
0ba0894a90 dbms: JOINs: development [#METR-11370]. 2014-06-12 08:04:47 +04:00
Alexey Milovidov
10544c8afc dbms: development [#METR-10894]. 2014-06-09 02:17:44 +04:00
Alexey Milovidov
649114821c dbms: development [#METR-10894]. 2014-06-06 23:35:41 +04:00
Michael Kolupaev
5a8e9a517c Merge 2014-06-06 18:56:57 +04:00
Michael Kolupaev
ac06ebccf6 sqxxl: Shards supports writing to one replica instead of all replicas. [#METR-10202] 2014-06-05 16:02:18 +04:00
Alexey Milovidov
a4fba5c6b1 dbms: fixed error with MemoryTracker and UnionBlockInputStream [#METR-11393]. 2014-05-30 23:22:41 +04:00
Sergey Fedorov
4fe8f37e03 Merge 2014-05-28 19:00:08 +04:00
Sergey Fedorov
8f306f4238 Merge 2014-05-26 20:13:46 +04:00
Michael Kolupaev
c6194d47f4 Merge 2014-05-07 15:44:14 +04:00
Alexey Milovidov
0abc554493 dbms: tracking amount of memory usage per query [#METR-11015]. 2014-05-04 02:57:43 +04:00
Alexey Milovidov
c55c3829f7 dbms: fixed comment [#METR-2944]. 2014-05-03 20:04:15 +04:00
Alexey Milovidov
fc8aa282c0 dbms: lowered default block size; introduced default insert block size [#METR-11014].. 2014-04-30 00:22:57 +04:00
Alexey Milovidov
8232983714 dbms: unified hash tables: development [#METR-2944]. 2014-04-28 05:48:24 +04:00
Alexey Milovidov
554d329064 dbms: fixed WITH TOTALS and LIMIT/DISTINCT [#METR-10705]. 2014-04-21 20:09:04 +04:00
Michael Kolupaev
7fa79382f4 PushingToViewsBlockOutputStream: not calling storage->write() on each block, not copying a block. [#METR-10763] 2014-04-14 14:19:38 +04:00
Michael Kolupaev
b2fa912b2c Merge 2014-04-11 20:56:49 +04:00
Alexey Milovidov
5ca21127c7 Improvement [#METR-2807]. 2014-04-08 11:31:51 +04:00
Michael Kolupaev
7d5429655a Merge 2014-04-07 23:10:14 +04:00
Alexey Milovidov
a3efebda9d dbms: addition to prev. revision [#METR-10500]. 2014-04-07 04:09:19 +04:00
Alexey Milovidov
763f354b3d dbms: probably lowered latency of global distributed queries [#METR-10500]. 2014-04-07 04:00:23 +04:00
Alexey Milovidov
6f12e7f372 dbms: preparation [#METR-10500]. 2014-04-07 03:36:39 +04:00
Alexey Milovidov
312feedecb dbms: removed virtual columns from StorageDistributed [#METR-9172]. 2014-04-07 01:59:27 +04:00
Michael Kolupaev
4a45c7c089 Merge 2014-04-04 21:20:45 +04:00
Michael Kolupaev
d42352149d dbms: DISTINCT before ORDER BY. [#METR-9627] 2014-03-28 20:08:48 +04:00
Sergey Fedorov
a4d4990860 dbms: fixed problem with sending empty tables, few more fixes [METR-10071] 2014-03-27 16:06:45 +04:00
Sergey Fedorov
003c7b30cd dbms: fixes and more comments on 'Global in' and external tables behavior [METR-10071] 2014-03-27 16:06:45 +04:00
Sergey Fedorov
6f85a12692 dbms: fixed variable names, temporary tables are now external tables, in distributed query external table now always will be send to remote servers [METR-10071] 2014-03-27 16:06:45 +04:00
Michael Kolupaev
e10125a052 Using IStorage locks properly in most places. Got rid of StoragePtr and DatabaseDropper. Drops are now synchronous. [#METR-10202] 2014-03-20 14:59:45 +04:00
Michael Kolupaev
67c563a4d3 Added locks to IStorage. Some race conditions are fixed, some are introduced, along with some possible deadlocks. [#METR-10202] 2014-03-19 14:45:13 +04:00
Michael Kolupaev
0faca75b37 Merge 2014-03-17 22:27:43 +04:00
Michael Kolupaev
ba9315d264 Merge 2014-03-14 21:03:52 +04:00
Alexey Milovidov
a4778d81cd dbms: added trivial benchmark tool [#METR-2944]. 2014-03-10 13:36:20 +04:00
Michael Kolupaev
8c48291ecb clickhouse: fixed null pointer when using WITH TOTALS without HAVING. [#METR-9365] 2014-03-07 15:19:37 +04:00
Alexey Milovidov
3dfadb76ff dbms: fixed error with TOTALS and HAVING [#METR-10346]. 2014-03-06 23:27:11 +04:00
Michael Kolupaev
d3874a1202 clickhouse: subqueries in IN update progress and can be cancelled (and added missing files). [#METR-10102] 2014-03-04 21:56:24 +04:00
Michael Kolupaev
73d7353f91 Fixed comments in RemoveColumnsBlockInputStream. [#METR-9750] 2014-03-03 12:29:01 +04:00
Alexey Milovidov
d1aeaedf61 dbms: added totals and extremes to Pretty* and TabSeparated* formats [#METR-9365]. 2014-03-02 23:16:45 +04:00
Michael Kolupaev
b0f079be0d setting for totals threshold with AFTER_HAVING_AUTO. [#METR-10223] 2014-02-27 17:12:56 +04:00
Michael Kolupaev
d83ff9ceb2 clickhouse: totals modes. [#METR-9365] 2014-02-27 16:53:38 +04:00
Michael Kolupaev
04f0056b0a clickhouse: totals mode: development. [#METR-9365] 2014-02-27 16:53:38 +04:00
Michael Kolupaev
647a821822 fixed comment. [#METR-2807] 2014-02-26 13:06:23 +04:00
Alexey Milovidov
9a8e77673d Revert "dbms: Addition to prev. revision [#METR-9750]."
This reverts commit 0c8a6fa068e26accb1467f980d111bfae7215911.
2014-02-23 06:43:53 +04:00
Alexey Milovidov
6a6adc4de0 dbms: Addition to prev. revision [#METR-9750]. 2014-02-23 06:41:02 +04:00
Alexey Milovidov
5c71627f44 dbms: fixed TableFunctionRemote [#METR-9750]. 2014-02-23 06:27:09 +04:00
Alexey Milovidov
8efd6ee42c dbms: sending only set/changed settings [#METR-10087]. 2014-02-17 23:56:45 +00:00
Alexey Milovidov
4cc8906d91 dbms: improvement [#METR-2944]. 2014-02-16 21:02:20 +00:00
Sergey Fedorov
a2aa16b4c1 dbms: empty query_id support [METR-8818] 2014-02-14 15:59:01 +00:00
Sergey Fedorov
b101457183 client: client with string query_id now works with old-versioned server [METR-8818] 2014-02-14 13:22:45 +00:00
Sergey Fedorov
b75fe2f6eb dbms: query Id is String valued now, show process list also shows query_id, query_id is stored in processlist, now query could be replaced [METR-8818] 2014-02-12 17:31:02 +00:00
Sergey Fedorov
45dccb01b7 storages: index on virtual columns, huge optimization in queries like select smth where _host = .. [METR-9750] 2014-02-11 17:10:48 +00:00
Sergey Fedorov
1e220376cd storages: few more comments on virtual columns, couple of code style changes [METR-9172] 2014-01-27 13:52:01 +00:00
Sergey Fedorov
f8b5613b82 storages: Virtual columns for storage distributed + few style fixes [METR-9172] 2014-01-22 14:24:05 +00:00
Sergey Fedorov
14620b3347 Merge 2014-01-22 12:50:19 +00:00
Sergey Fedorov
9cc974568e Merge 2014-01-17 15:19:20 +00:00
Sergey Fedorov
5d00bf81ea streams: adding const column, important for virtual columns [METR-9172] 2014-01-16 15:19:50 +00:00
Sergey Fedorov
91609727a8 Merge 2014-01-10 13:24:50 +00:00
Michael Kolupaev
5ac8541e2b ClickHouse: changed readSuffix calling requirements to match what RemoteBlockInputStream expects; changed some streams to meet that requirements. It fixed segfault with DISTINCT with LIMIT from Distributed table. [#METR-9598] 2013-12-27 13:22:32 +00:00
Sergey Fedorov
1a5f04d3bf Merge 2013-12-26 13:55:19 +00:00
Alexey Milovidov
dac017c03d dbms: fixed error with FINAL [#METR-9514]. 2013-12-16 07:12:30 +00:00
Alexey Milovidov
e5a6cc5436 dbms: fixed error [#METR-9007]. 2013-12-08 05:18:22 +00:00
Alexey Milovidov
ff7cd145ca Merge 2013-11-30 18:43:59 +00:00
Alexey Milovidov
629a224230 dbms: hopefully fixed error [#METR-9342]. 2013-11-29 18:44:02 +00:00
Alexey Milovidov
b3f0d43ba6 dbms: hope fixed error [#METR-9342]. 2013-11-29 15:04:07 +00:00
Michael Kolupaev
812127899d UnionBlockInputStream: fixed possible deadlock. [#METR-9007] 2013-11-29 12:25:54 +00:00
Alexey Milovidov
aa3ed8bc66 dbms: fixed race condition [#METR-9344]. 2013-11-29 08:08:43 +00:00
Michael Kolupaev
606a2ad942 ClickHouse: fixed UnionBlockInputStream freezing interactive queries in some cases. [#METR-9007] 2013-11-25 12:32:43 +00:00
Michael Kolupaev
0bc7b868a1 ClickHouse: fixed UnionBlockInputStream calling readSuffixImpl during a call to readImpl. Better invariant for IBlockInputStream::readSuffix(). [#METR-9007] 2013-11-25 10:46:25 +00:00
Sergey Fedorov
1de8ddb8df dbms: Pushing to Views fixed workflow with constant columns [#METR-9076] 2013-11-20 16:02:45 +00:00
Alexey Milovidov
0dd758d101 dbms: addition to prev. revision [#METR-9007]. 2013-11-20 01:48:23 +00:00
Alexey Milovidov
98bb9bb33e dbms: probably fixed error [#METR-9007]. 2013-11-20 01:42:24 +00:00
Sergey Fedorov
ac21314784 dbms: Couple of unimportant fixes (includes, code simplification) in View and Materialized View [#METR-9076] 2013-11-15 09:43:50 +00:00
Sergey Fedorov
13bd27c498 dbms: View and Materialized View fixes, logic updates, implementation [#METR-9076] 2013-11-13 14:39:48 +00:00
Alexey Milovidov
806fee097b dbms: fixed limits on result data with distributed query processing [#METR-9180]. 2013-11-12 23:15:09 +00:00
Sergey Fedorov
b6b40d4c4e dbms: View and Materialized View implementation [#METR-9076] 2013-11-08 17:43:03 +00:00
Alexey Milovidov
3f2ee82cdc dbms: SplittingAggregator: added support for max_rows_to_group_by [#METR-2944]. 2013-11-04 00:49:37 +00:00
Alexey Milovidov
18a8aa74f8 dbms: merged convertToBlock and finalize aggregation steps whenever possible [#METR-2944]. 2013-11-03 23:35:18 +00:00
Alexey Milovidov
9437657b7b dbms: modified Limits, Quotas, Progress, ProcessList [#METR-8459], [#METR-8894]. 2013-11-03 05:32:42 +00:00
Alexey Milovidov
a3caaef38a dbms: better exception handling [#METR-2944]. 2013-11-02 23:42:10 +00:00
Alexey Milovidov
8fd01c8d7d dbms: better comparison of floating point numbers with NaNs [#METR-9053]. 2013-11-01 20:10:43 +00:00
Alexey Milovidov
a10905163b dbms: fixed error [#METR-8975]. 2013-10-31 18:38:34 +00:00
Michael Kolupaev
bcd3a116be ClickHouse: fixed FINAL behavior with deleted visits; added test for it. [#METR-9072] 2013-10-30 09:15:41 +00:00
Michael Kolupaev
732302c263 Merge 2013-10-30 08:50:58 +00:00
Sergey Fedorov
f7a6316abd dbms: Moved addingDefault logic into the Block class [#METR-9001] 2013-10-28 16:09:42 +00:00
Sergey Fedorov
053eb9adcb dbms: Rename file, Code Style fixes, Rename class [#METR-9001] 2013-10-28 14:15:56 +00:00
Sergey Fedorov
8fd6963212 My latest changes.
REVIEW:new
2013-10-25 14:56:47 +00:00
Alexey Milovidov
da62ed8c6f Merge 2013-10-01 20:38:01 +00:00
Alexey Milovidov
2851e0abcc Merge 2013-10-01 18:09:31 +00:00
Alexey Milovidov
c8193c1618 dbms: fixed 'rows_before_limit_at_least' [#CONV-2944]. 2013-09-19 00:08:49 +00:00
Alexey Milovidov
56d95e4268 dbms: optimized ORDER BY with LIMIT; rows_before_limit_at_least is temporarily broken [#CONV-2944]. 2013-09-16 05:44:47 +00:00
Alexey Milovidov
1aa789831b dbms: Aggregator: fixed error [#CONV-2944]. 2013-09-16 05:33:49 +00:00
Alexey Milovidov
40464a0123 dbms: added new aggregation method [#CONV-2944]. 2013-09-15 10:53:10 +00:00
Alexey Milovidov
717a3fc591 dbms: fixed MergingSortedBlockInputStreams when one of stream is empty [#CONV-2944]. 2013-09-15 03:14:29 +00:00
Alexey Milovidov
40f602ff92 dbms: improvement [#CONV-2944]. 2013-09-14 07:43:45 +00:00
Alexey Milovidov
fd4f4a9a86 dbms: fixed error [#CONV-2944]. 2013-09-14 05:14:22 +00:00
Alexey Milovidov
ca2da37d2e dbms: don't write too many messages about inconsistent data into log [#CONV-8729]. 2013-09-13 22:59:02 +00:00