alexey-milovidov
7af621f6f7
Merge pull request #3728 from amosbird/join
...
Versatile StorageJoin
2018-12-10 23:16:53 +03:00
Amos Bird
65b654a1b6
Versatile StorageJoin
...
This commit does the following:
1. StorageJoin with simple keys now supports reading
2. StorageJoin can be created with Join settings applied. Syntax is
similar to MergeTree and Kafka
3. Left Any StorageJoin with one simple key can be used as a
dictionary-like structure by function joinGet.
Examples are listed in the related test file.
2018-12-02 16:49:39 +08:00
Alexey Zatelepin
29b34365e6
Merge branch 'master' into alter-order-by
...
Conflicts:
dbms/src/Interpreters/ExpressionAnalyzer.cpp
dbms/src/Storages/MergeTree/MergeTreeData.cpp
dbms/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp
2018-11-13 16:27:19 +03:00
Alexey Zatelepin
580146eedb
add primary key syntax [#CLICKHOUSE-3859]
2018-11-13 16:12:14 +03:00
chertus
d2518fdb3f
more refactoring: funcs to extract database_and_table from AST
2018-10-29 22:04:28 +03:00
Alexey Milovidov
d8ca4345b6
Fixed style violations [#CLICKHOUSE-2]
2018-08-10 04:41:54 +03:00
Alexander Marshalov
154d7e3228
Added SETTINGS clause for Kafka storage engine
2018-08-03 21:51:28 +03:00
Alexey Milovidov
b9b89a5590
Less dependencies [#CLICKHOUSE-2]
2018-06-05 22:46:49 +03:00
Alexey Zatelepin
78d92f6794
add some useful methods, rename for clarity [#CLICKHOUSE-3241]
2018-03-12 22:10:13 +03:00
Alexey Zatelepin
71642b0880
use ColumnsDescription everywhere [#CLICKHOUSE-3241]
2018-03-12 22:07:48 +03:00
Alexey Milovidov
ffca152c45
Inverted dependencies in StorageFactory [#CLICKHOUSE-2].
2017-12-30 07:00:39 +03:00
Alexey Milovidov
7244514859
Less dependencies in StorageFactory: development [#CLICKHOUSE-2].
2017-12-30 07:00:39 +03:00
Alexey Milovidov
fcdd5de47d
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
2017-12-28 07:39:19 +03:00
Alexey Milovidov
798299ba89
Merge branch 'aavdonkin-master'
2017-12-28 07:33:55 +03:00
Alexey Milovidov
1fecbc3ef4
Merging [#CLICKHOUSE-3114]
2017-12-28 07:33:35 +03:00
Alexey Milovidov
4448766266
Merging [#CLICKHOUSE-3114]
2017-12-28 07:28:05 +03:00
Alexey Milovidov
104b09604a
Merging [#CLICKHOUSE-3114]
2017-12-28 00:45:05 +03:00
Alexey Milovidov
f87761df90
Merged with master; applied clang-format with newer files [#CLICKHOUSE-3114].
2017-12-26 21:32:17 +03:00
Alexey Milovidov
c89041ce63
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95
Removed questionable code [#CLICKHOUSE-2].
2017-12-26 00:10:46 +03:00
Marek Vavruša
c6e959d1e9
StorageKafka: extended configuration, parallel consumers, offset tracking
...
This contains many fixes and corrections for the Kafka engine.
Most notably it now supports extended configuration similarly to GraphiteMergeTree.
Now it also allows specification of consumer count to parallelize consumption of
multiple partitions both in materialized views and in SELECT queries.
The offsets are now committed in the insertSuffix() method after all rows
are successfully read. If an exception is thrown during reading, affected consumer
unsubscribes from all assignments and rejoins the consumer group to rewind offsets.
This means that the consumer won't lose messages in case of write failures.
2017-12-21 00:46:50 +03:00
Alexander Avdonkin
331c5c3db8
Merge branch 'master' of github.com:aavdonkin/ClickHouse
2017-12-13 19:48:27 +03:00
Alexander Avdonkin
d1ee8c5358
Fixed issues
2017-12-13 19:46:57 +03:00
Alexey Milovidov
d2cfda4d9b
Cleanup semantics of data types [#CLICKHOUSE-2].
2017-12-09 19:17:37 +03:00
alexey-milovidov
1d0df29e0f
Merge branch 'master' into master
2017-12-08 11:29:01 +03:00
Alexander Avdonkin
89db5040df
Implemented MySQL and ODBC storages and table functions
2017-12-05 16:32:02 +03:00
Alexey Zatelepin
fb9c7ab81d
remove experimental_allow_extended_storage_definition_syntax Setting (turn on by default) [#CLICKHOUSE-3000]
2017-12-04 22:45:18 +03:00
Alexey Milovidov
acd78e4891
Better [#CLICKHOUSE-2].
2017-12-02 00:13:25 +03:00
proller
0d3c4f4d67
Core/FieldVisitors.h -> Common/FieldVisitors.h
...
Core/Progress.h -> IO/Progress.h
tests: sudo --non-interactive
Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
4e04c4da5f
Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2].
2017-11-04 06:56:31 +03:00
Alexey Zatelepin
f2ebffb7f0
save TO table of a materialized view to the ATTACH query [#CLICKHOUSE-2]
2017-10-30 21:39:39 +03:00
Alexey Zatelepin
141b85189e
always allow attaching tables with extended storage definition syntax [#CLICKHOUSE-3000]
2017-10-30 16:44:43 +03:00
Vitaliy Lyudvichenko
51265506f8
Convey session setting up to inner table creation for MV. [#CLICKHOUSE-3381]
2017-10-26 18:39:56 +03:00
Alexey Zatelepin
ec963e3397
save evaluated storage parameters in ATTACH queries [#CLICKHOUSE-3000]
2017-10-26 17:07:15 +03:00
Alexey Zatelepin
01c39dcf1c
fix CREATE TABLE bugs and idiosyncrasies: [#CLICKHOUSE-3000]
...
* fix segfault on ATTACH MATERIALIZED VIEW
* allow only TEMPORARY TABLEs (not databases or views)
* forbid choosing ENGINE for TEMPORARY tables
* fix segfault on CREATE TABLE t1 AS t2 where t2 is a View
2017-10-26 07:53:52 +03:00
Alexey Zatelepin
6bb34a4494
Merge branch 'master' into arbitrary-partitioning
...
Conflicts:
dbms/src/Storages/StorageFactory.cpp
2017-10-24 17:23:18 +03:00
Alexey Milovidov
c57a62611b
Removed StorageTrivialBuffer because it is underdeveloped [#CLICKHOUSE-2].
2017-10-23 20:38:56 +03:00
Alexey Zatelepin
dd42d53856
additional help messages for extended syntax [#CLICKHOUSE-3000]
2017-10-20 23:02:55 +03:00
Alexey Zatelepin
a7c85e0c89
save index_granularity to ATTACH query if it wasn't set explicitly [#CLICKHOUSE-3000]
2017-10-20 21:28:44 +03:00
Alexey Zatelepin
75c65c7b59
use extended storage definition syntax for MergeTree engines [#CLICKHOUSE-3000]
2017-10-20 21:28:42 +03:00
Alexey Zatelepin
6b9ead4bd8
parse PARTITION BY, ORDER BY, SAMPLE BY, SETTINGS clauses in a storage definition [#CLICKHOUSE-3000]
2017-10-20 21:28:42 +03:00
Alexey Zatelepin
48dea685d0
use more typesafe AST objects in ASTCreateQuery [#CLICKHOUSE-3000]
2017-10-20 21:28:41 +03:00
Marek Vavruša
927c0f7b74
dbms: Partially revert previous change
...
Instead of trying to convert long/unsigned long to Poco types, just
don't use them.
2017-10-13 23:46:10 -07:00
Marek Vavruša
8a0571af24
dbms: Better fix for missing unsigned long to Poco::UInt64 alias
2017-10-13 21:39:14 -07:00
Marek Vavruša
70543200be
dbms: Fix build with clang after Poco update
...
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
2017-10-13 18:26:24 -07:00
proller
4c7850fdc2
Optional kafka ( #1355 )
...
* Zookeeper include fix
* Update submodule contrib/poco
* Fix zookeeper submodule ho-to-make doc
* Update zookeeper submodule
* Update submodule zookeeper
* Fix compile with external zookeeper
* Optional kafka
* fix
* Fix
* fix
2017-10-14 03:53:01 +03:00
Marek Vavruša
7fc08389c9
Storages: added Kafka table engine (read-only)
...
Added a new table engine backed by Apache Kafka,
it allows near real-time ingestion or ETL with
exactly-once semantics.
It doesn’t store any data on disk, so data must
be materialized into a physical table to allow
random access.
Currently it only supports reading, no insertion.
2017-10-10 08:33:00 -07:00
Alexey Zatelepin
728a23f60e
allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
