Commit Graph

185 Commits

Author SHA1 Message Date
Alexey Milovidov
1fecbc3ef4 Merging [#CLICKHOUSE-3114] 2017-12-28 07:33:35 +03:00
Alexey Milovidov
4448766266 Merging [#CLICKHOUSE-3114] 2017-12-28 07:28:05 +03:00
Alexey Milovidov
104b09604a Merging [#CLICKHOUSE-3114] 2017-12-28 00:45:05 +03:00
Alexey Milovidov
f87761df90 Merged with master; applied clang-format with newer files [#CLICKHOUSE-3114]. 2017-12-26 21:32:17 +03:00
Alexey Milovidov
ec71908b00 Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
This reverts commit fcabe8b888.
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95 Removed questionable code [#CLICKHOUSE-2]. 2017-12-26 00:10:46 +03:00
Marek Vavruša
c6e959d1e9 StorageKafka: extended configuration, parallel consumers, offset tracking
This contains many fixes and corrections for the Kafka engine.
Most notably it now supports extended configuration similarly to GraphiteMergeTree.
Now it also allows specification of consumer count to parallelize consumption of
multiple partitions both in materialized views and in SELECT queries.

The offsets are now committed in the insertSuffix() method after all rows
are successfully read. If an exception is thrown during reading, affected consumer
unsubscribes from all assignments and rejoins the consumer group to rewind offsets.
This means that the consumer won't lose messages in case of write failures.
2017-12-21 00:46:50 +03:00
Alexander Avdonkin
331c5c3db8 Merge branch 'master' of github.com:aavdonkin/ClickHouse 2017-12-13 19:48:27 +03:00
Alexander Avdonkin
d1ee8c5358 Fixed issues 2017-12-13 19:46:57 +03:00
Alexey Milovidov
d2cfda4d9b Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
alexey-milovidov
1d0df29e0f
Merge branch 'master' into master 2017-12-08 11:29:01 +03:00
Alexander Avdonkin
89db5040df Implemented MySQL and ODBC storages and table functions 2017-12-05 16:32:02 +03:00
Alexey Zatelepin
fb9c7ab81d remove experimental_allow_extended_storage_definition_syntax Setting (turn on by default) [#CLICKHOUSE-3000] 2017-12-04 22:45:18 +03:00
Alexey Milovidov
acd78e4891 Better [#CLICKHOUSE-2]. 2017-12-02 00:13:25 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
4e04c4da5f Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2]. 2017-11-04 06:56:31 +03:00
Alexey Zatelepin
f2ebffb7f0 save TO table of a materialized view to the ATTACH query [#CLICKHOUSE-2] 2017-10-30 21:39:39 +03:00
Alexey Zatelepin
141b85189e always allow attaching tables with extended storage definition syntax [#CLICKHOUSE-3000] 2017-10-30 16:44:43 +03:00
Vitaliy Lyudvichenko
51265506f8 Convey session setting up to inner table creation for MV. [#CLICKHOUSE-3381] 2017-10-26 18:39:56 +03:00
Alexey Zatelepin
ec963e3397 save evaluated storage parameters in ATTACH queries [#CLICKHOUSE-3000] 2017-10-26 17:07:15 +03:00
Alexey Zatelepin
01c39dcf1c fix CREATE TABLE bugs and idiosyncrasies: [#CLICKHOUSE-3000]
* fix segfault on ATTACH MATERIALIZED VIEW
* allow only TEMPORARY TABLEs (not databases or views)
* forbid choosing ENGINE for TEMPORARY tables
* fix segfault on CREATE TABLE t1 AS t2 where t2 is a View
2017-10-26 07:53:52 +03:00
Alexey Zatelepin
6bb34a4494 Merge branch 'master' into arbitrary-partitioning
Conflicts:
	dbms/src/Storages/StorageFactory.cpp
2017-10-24 17:23:18 +03:00
Alexey Milovidov
c57a62611b Removed StorageTrivialBuffer because it is underdeveloped [#CLICKHOUSE-2]. 2017-10-23 20:38:56 +03:00
Alexey Zatelepin
dd42d53856 additional help messages for extended syntax [#CLICKHOUSE-3000] 2017-10-20 23:02:55 +03:00
Alexey Zatelepin
a7c85e0c89 save index_granularity to ATTACH query if it wasn't set explicitly [#CLICKHOUSE-3000] 2017-10-20 21:28:44 +03:00
Alexey Zatelepin
75c65c7b59 use extended storage definition syntax for MergeTree engines [#CLICKHOUSE-3000] 2017-10-20 21:28:42 +03:00
Alexey Zatelepin
6b9ead4bd8 parse PARTITION BY, ORDER BY, SAMPLE BY, SETTINGS clauses in a storage definition [#CLICKHOUSE-3000] 2017-10-20 21:28:42 +03:00
Alexey Zatelepin
48dea685d0 use more typesafe AST objects in ASTCreateQuery [#CLICKHOUSE-3000] 2017-10-20 21:28:41 +03:00
Marek Vavruša
927c0f7b74 dbms: Partially revert previous change
Instead of trying to convert long/unsigned long to Poco types, just
don't use them.
2017-10-13 23:46:10 -07:00
Marek Vavruša
8a0571af24 dbms: Better fix for missing unsigned long to Poco::UInt64 alias 2017-10-13 21:39:14 -07:00
Marek Vavruša
70543200be dbms: Fix build with clang after Poco update
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
2017-10-13 18:26:24 -07:00
proller
4c7850fdc2 Optional kafka (#1355)
* Zookeeper include fix

* Update submodule contrib/poco

* Fix zookeeper submodule ho-to-make doc

* Update zookeeper submodule

* Update submodule zookeeper

* Fix compile with external zookeeper

* Optional kafka

* fix

* Fix

* fix
2017-10-14 03:53:01 +03:00
Marek Vavruša
7fc08389c9 Storages: added Kafka table engine (read-only)
Added a new table engine backed by Apache Kafka,
it allows near real-time ingestion or ETL with
exactly-once semantics.

It doesn’t store any data on disk, so data must
be materialized into a physical table to allow
random access.

Currently it only supports reading, no insertion.
2017-10-10 08:33:00 -07:00
Alexey Zatelepin
728a23f60e allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Vadim Skipin
4dc36893d3 Keep config in context to avoid Application singleton usages 2017-08-28 22:19:06 +03:00
Vadim Skipin
61f65e97a8 Fix typo 2017-08-18 22:38:56 +03:00
Alexey Milovidov
e6739cc35d Whitespace [#CLICKHOUSE-2]. 2017-08-10 22:41:21 +03:00
Vitaliy Lyudvichenko
03e5bf9471 Add support of parameters in aggregate function constructors. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Nikolai Kochetov
4c114bc3a1 added DatabaseDictionary 2017-06-22 18:44:19 +03:00
Nikolai Kochetov
bff77d1bae merged with master 2017-06-08 15:00:11 +03:00
Alexey Milovidov
50b84fcc9d Removed duplicate code [#CLICKHOUSE-2]. 2017-06-06 21:48:38 +03:00
Alexey Milovidov
0d7d379b44 Removed duplicate code [#CLICKHOUSE-2]. 2017-06-06 21:36:13 +03:00
Nikolai Kochetov
45c1beca2a Merge branch 'master' into storage-dictionary 2017-05-23 13:44:03 +03:00
Alexander Makarov
55bfaca662 StorageTrivialBuffer: added support for the replication [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexander Makarov
fdd636a785 fixup #2: comments on English, proper classname, StorageFactory update and merging in 'flush' method without lock [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Nikolai Kochetov
16256503ec merged with master 2017-05-16 13:03:06 +03:00
Alexey Milovidov
282a395464 Fixed test [#CLICKHOUSE-2]. 2017-05-13 00:03:01 +03:00
proller
fac00792f9 Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system 2017-05-05 16:59:18 -07:00