Commit Graph

2392 Commits

Author SHA1 Message Date
Alexey Milovidov
bcfde7c6c0 Get rid of DataTypeNested, part 2 [#CLICKHOUSE-2]. 2017-12-25 21:58:39 +03:00
Alexey Zatelepin
c3348e27a4 shorter [#CLICKHOUSE-2] 2017-12-25 20:31:14 +03:00
proller
fb7047bfe8 Fix 32bit build 2017-12-25 20:17:32 +03:00
Alexey Zatelepin
b07dbf52c6 remove unused function [#CLICKHOUSE-2] 2017-12-25 14:40:59 +03:00
Alexey Milovidov
8ff93487e3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-25 07:01:46 +03:00
Marek Vavruša
aed35f16ca StorageKafka: move limits to individual Kafka streams instead of UnionBlockInputStream
The UnionBlockInputStream might read an extra block from the asynchronous child streams otherwise,
which will never be used, but offsets for this block would be committed, which would result in
lost messages.
2017-12-24 09:57:20 +03:00
Marek Vavruša
77393287ab StorageKafka: make commit message only if messages are consumed 2017-12-24 09:57:20 +03:00
Alexey Milovidov
b5af4c95bf Using IDataType::equals to compare for type equivalence #1650 2017-12-23 04:55:46 +03:00
Alexey Zatelepin
6d5ce3fa9a revert BackgroundSchedulePool usage in Replicated tables 2017-12-22 21:25:54 +03:00
Alexey Milovidov
5b59a6f4cb Whitespace [#CLICKHOUSE-2]. 2017-12-21 20:43:32 +03:00
Alexey Milovidov
584a263d79 Simplification of aggregate functions: development [#CLICKHOUSE-2]. 2017-12-21 05:08:25 +03:00
Marek Vavruša
3e1ce9bf26 StorageKafka: nicer interface for claiming consumers 2017-12-21 00:46:50 +03:00
Marek Vavruša
9c57def8df StorageKafka: update comments 2017-12-21 00:46:50 +03:00
Marek Vavruša
c6e959d1e9 StorageKafka: extended configuration, parallel consumers, offset tracking
This contains many fixes and corrections for the Kafka engine.
Most notably it now supports extended configuration similarly to GraphiteMergeTree.
Now it also allows specification of consumer count to parallelize consumption of
multiple partitions both in materialized views and in SELECT queries.

The offsets are now committed in the insertSuffix() method after all rows
are successfully read. If an exception is thrown during reading, affected consumer
unsubscribes from all assignments and rejoins the consumer group to rewind offsets.
This means that the consumer won't lose messages in case of write failures.
2017-12-21 00:46:50 +03:00
Marek Vavruša
6d4f106f11 StorageMaterializedView: update dependencies on DETACH TABLE
Previously the dependencies were updated only on DROP TABLE, so
detaching a materialized view and inserting to source table thrown an exception.
2017-12-21 00:46:50 +03:00
Alexey Zatelepin
c422b5b2e4 take PreCommitted parts into account when calculating total merge size [#CLICKHOUSE-3508] 2017-12-20 20:52:28 +03:00
Alexey Zatelepin
835b957e95 add comments [#CLICKHOUSE-3508] 2017-12-20 20:40:36 +03:00
Alexey Zatelepin
d35baafde8 check PreCommitted parts when executing log entries and in PartChecker [#CLICKHOUSE-3508] 2017-12-20 20:04:14 +03:00
Alexey Zatelepin
2340e55d0e revert to old behaviour of getPartIfExists() [#CLICKHOUSE-3508] 2017-12-20 20:04:14 +03:00
Alexey Milovidov
bc160f5e4d Fixed error [#CLICKHOUSE-2]. 2017-12-18 09:49:38 +03:00
Alexey Milovidov
32fcc7b3f0 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 09:23:19 +03:00
Alexey Milovidov
816169a3be Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 08:38:42 +03:00
Alexey Milovidov
11d3b9c710 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 08:37:20 +03:00
Alexey Milovidov
c5d5296889 Miscellaneous [#CLICKHOUSE-2]. 2017-12-18 07:07:26 +03:00
Alexey Milovidov
7c802ee3de Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:37:08 +03:00
Alexey Milovidov
f95ddfce10 Make DataTypes totally immutable [#CLICKHOUSE-2]. 2017-12-18 04:11:48 +03:00
Alexey Milovidov
8484f086a5 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 10:59:14 +03:00
Alexey Milovidov
6ad5be5eee Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 10:15:13 +03:00
Alexey Milovidov
d497d010d7 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 08:21:04 +03:00
Alexey Milovidov
62f7c25522 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 09:19:21 +03:00
Alexey Milovidov
8302769563 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 03:49:03 +03:00
Alexey Milovidov
7284a64740 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:32:25 +03:00
Alexey Milovidov
ecd56de6a8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:11:24 +03:00
Alexey Milovidov
c4bbc1c963 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 23:48:46 +03:00
Alexey Milovidov
8ce60e3af0 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 22:53:11 +03:00
Alexey Milovidov
d0ca8b2533 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 21:23:05 +03:00
Alexey Milovidov
b2aff7521b Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 06:47:43 +03:00
Alexey Milovidov
401fd2d6d8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 05:36:40 +03:00
Alexey Milovidov
fb38ef9a8e Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 06:56:56 +03:00
Alexey Milovidov
bed2d644e6 Merge remote-tracking branch 'origin/master' into cow_columns 2017-12-14 04:44:35 +03:00
Alexey Milovidov
f3bb24a3bf Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 04:43:19 +03:00
Alexey Milovidov
819287b697 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-13 04:27:53 +03:00
alexey-milovidov
62fb610e4e
Merge pull request #1447 from yandex/support-table-functions-for-desc-and-insert
Support table functions for desc and insert
2017-12-11 23:28:10 +03:00
Alexey Milovidov
7d04e67262 Merge branch 'write-buffer-from-arena' 2017-12-11 21:25:03 +03:00
Alexey Milovidov
90848adc6b Fixed translation [#CLICKHOUSE-2]. 2017-12-11 21:19:35 +03:00
Nikolai Kochetov
f71b8bf58f merged with master 2017-12-11 21:13:24 +03:00
Nikolai Kochetov
68ccadfc6c removed owned_cluster_for_insertion from StorageDistributed [#CLICKHOUSE-3397] 2017-12-11 21:09:20 +03:00
Alexey Milovidov
c3015bece3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-11 01:44:04 +03:00
Alexey Milovidov
71116c4d82 Fixed error [#CLICKHOUSE-2]. 2017-12-09 20:16:24 +03:00
Alexey Milovidov
3def5f03f5 Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00