Commit Graph

13384 Commits

Author SHA1 Message Date
Marek Vavruša
c6e959d1e9 StorageKafka: extended configuration, parallel consumers, offset tracking
This contains many fixes and corrections for the Kafka engine.
Most notably it now supports extended configuration similarly to GraphiteMergeTree.
Now it also allows specification of consumer count to parallelize consumption of
multiple partitions both in materialized views and in SELECT queries.

The offsets are now committed in the insertSuffix() method after all rows
are successfully read. If an exception is thrown during reading, affected consumer
unsubscribes from all assignments and rejoins the consumer group to rewind offsets.
This means that the consumer won't lose messages in case of write failures.
2017-12-21 00:46:50 +03:00
Marek Vavruša
6d4f106f11 StorageMaterializedView: update dependencies on DETACH TABLE
Previously the dependencies were updated only on DROP TABLE, so
detaching a materialized view and inserting to source table thrown an exception.
2017-12-21 00:46:50 +03:00
Marek Vavruša
fb1aa84973 Fixed clang build on macOS
- Make sure to use dynamic linking on macOS to avoid OpenSSL static linking bug
- Use -std=c++17 in CFLAGS for files in contrib
- Avoid bad support for thread_local on macOS with clang altogether
2017-12-21 00:46:50 +03:00
Amos Bird
e7af27c4e0 Better iostream debugger with adl.
This patch fixes some issues related to DUMP() debugging. Opening std and
placing all Core related classed inside DB namespace enable proper adl support.
It also adds better sfinae guards to Field constructor which somehow breaks <<
overloads.
2017-12-20 21:44:42 +03:00
Alexey Zatelepin
c422b5b2e4 take PreCommitted parts into account when calculating total merge size [#CLICKHOUSE-3508] 2017-12-20 20:52:28 +03:00
Alexey Zatelepin
835b957e95 add comments [#CLICKHOUSE-3508] 2017-12-20 20:40:36 +03:00
Alexey Zatelepin
d35baafde8 check PreCommitted parts when executing log entries and in PartChecker [#CLICKHOUSE-3508] 2017-12-20 20:04:14 +03:00
Alexey Zatelepin
2340e55d0e revert to old behaviour of getPartIfExists() [#CLICKHOUSE-3508] 2017-12-20 20:04:14 +03:00
Alexey Milovidov
3124ffea67 Fixed error in prev. revision [#CLICKHOUSE-2]. 2017-12-20 02:14:37 +03:00
Alexey Milovidov
6c8a0e70fd Additions after merge [#CLICKHOUSE-2]. 2017-12-19 23:09:15 +03:00
alexey-milovidov
7d08fdf718
Merge pull request #1641 from yandex/CLICKHOUSE-3361
use columns from left block out of columns with same name at Join
2017-12-19 23:07:36 +03:00
alexey-milovidov
7a97d08b04
Merge branch 'master' into CLICKHOUSE-3361 2017-12-19 23:03:17 +03:00
Alexey Milovidov
c8d8016bbb Fixed bad code [#CLICKHOUSE-2]. 2017-12-19 22:56:48 +03:00
Nikolai Kochetov
39ec3f7d74 changed exception message, added comments 2017-12-19 22:51:59 +03:00
Alexey Milovidov
b48d934c3d Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-19 22:46:11 +03:00
Alexey Milovidov
548cb4e658 Fixed bad code in Client.cpp [#CLICKHOUSE-2]. 2017-12-19 22:46:02 +03:00
Silviu Caragea
b08463ed7b Fix for https://github.com/yandex/ClickHouse/issues/1648 2017-12-19 22:41:05 +03:00
Alexey Milovidov
99a19de80e Translated comment [#CLICKHOUSE-2]. 2017-12-19 22:32:13 +03:00
Alexey Milovidov
7dfd3a2c3a Translated comment [#CLICKHOUSE-2]. 2017-12-19 22:30:25 +03:00
Alexey Milovidov
a8e44f34d0 Merge branch 'ks1322-master' 2017-12-19 21:04:40 +03:00
Alexey Milovidov
0d1a285b23 Removed ignoring of EPIPE in WriteBufferFromFileDescriptor [#CLICKHOUSE-2]. 2017-12-19 21:04:14 +03:00
Alexey Milovidov
2ac61adfec Merge branch 'master' into ks1322-master 2017-12-19 20:49:02 +03:00
Alexey Milovidov
1029b2a5ef Fixed warning in SpecializedAggregator.h [#CLICKHOUSE-2]. 2017-12-19 20:48:08 +03:00
alexey-milovidov
34d54ea349 Update CMakeLists.txt 2017-12-19 20:42:35 +03:00
proller
631f307b9f Copy more platform-specific headers 2017-12-19 20:42:35 +03:00
Amos Bird
b61fe07f76 Use NULL to check only realine without c++11
This check always fails on centos 6 with clang 6. c++ standard flag never gets passed into the compilation command.
2017-12-19 20:40:13 +03:00
Alexey Milovidov
1a6f38b27f Merge branch 'master' into ks1322-master 2017-12-19 20:38:29 +03:00
Alexey Milovidov
e25514d28a Addition to the fix of generic variant of topK aggregate function [#CLICKHOUSE-2]. 2017-12-19 20:21:47 +03:00
Alexey Milovidov
a5668a1502 Returned back accidentially modified submodule [#CLICKHOUSE-2]. 2017-12-19 20:05:53 +03:00
Alexey Milovidov
089e78dc16 Clarification [#CLICKHOUSE-2]. 2017-12-19 04:57:06 +03:00
Alexey Milovidov
aba63cc76f Better semantic of sharing columns: fixed error [#CLICKHOUSE-2]. 2017-12-19 04:53:54 +03:00
Alexey Milovidov
50d09f08f5 Updated test [#CLICKHOUSE-2]. 2017-12-19 04:44:05 +03:00
Alexey Milovidov
80e48cc899 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-19 04:42:24 +03:00
Alexey Milovidov
4e8a70a29f Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-19 04:13:20 +03:00
Alexey Milovidov
d9732198ac Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-19 03:51:12 +03:00
Alexey Milovidov
61c2b55a57 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-19 03:43:04 +03:00
Alexey Milovidov
02821f4861 Fixed error [#CLICKHOUSE-2]. 2017-12-19 03:26:16 +03:00
Alexey Milovidov
93a300bea4 Miscellaneous [#CLICKHOUSE-2]. 2017-12-19 00:49:34 +03:00
Alexey Milovidov
521b3aee84 Fixed error found by M.Filimonov (equality of array sizes are not checked in n-ary version of aggregate functions with -Array combinator) [#CLICKHOUSE-2]. 2017-12-19 00:44:18 +03:00
Alexey Milovidov
6c28c72fdc Added test [#CLICKHOUSE-2]. 2017-12-19 00:16:20 +03:00
Alexey Milovidov
b83142ea62 Fixed error found by M.Filimonov (generic implementation of topK aggregate function was totally wrong) [#CLICKHOUSE-2]. 2017-12-19 00:12:15 +03:00
Alexey Milovidov
339e22d014 Fixed error found by M.Filimonov [#CLICKHOUSE-2]. 2017-12-19 00:04:19 +03:00
Alexey Milovidov
d84ef5d8e2 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-18 23:43:19 +03:00
Alexey Milovidov
09fa34c764 Fixed error found by M.Filimonov (missing check for maximum size of FixedString leading to overflow in arithmetic) [#CLICKHOUSE-2]. 2017-12-18 23:43:10 +03:00
proller
ab5cbcc627 Try fix internal compiler [tests run] (#1651)
* Try fic interal compiler

* Debian: depend on tzdata package

* fix order

* Try fix

* fix

* try

* fix

* fix

* fix

* fix
2017-12-18 23:30:19 +03:00
alexey-milovidov
35677e3edd
Merge pull request #1662 from Tri0L/patch-4
Русская документации по Table Engine = Dictionary
2017-12-18 23:23:38 +03:00
Andrey Dudin
7060b8a3d9
Create dictionary.md 2017-12-18 20:54:10 +03:00
proller
bee53d483f Allow run tests without extract-from-config 2017-12-18 15:26:34 +03:00
Alexey Milovidov
bc160f5e4d Fixed error [#CLICKHOUSE-2]. 2017-12-18 09:49:38 +03:00
Alexey Milovidov
84016cc96f Fixed error [#CLICKHOUSE-2]. 2017-12-18 09:39:07 +03:00