Nikolai Kochetov
34d7873524
Processors support for StorageKafka reading.
2020-02-17 19:08:22 +03:00
Mikhail Filimonov
8c736e6c9f
After review fixes
2020-02-04 22:19:34 +01:00
Mikhail Filimonov
24ff635435
draft implementation, wip
2020-02-03 11:02:52 +01:00
Mikhail Filimonov
a6e3265960
Kafka proper rebalances processing, controlled assignment, faster tests
2020-01-30 20:30:45 +01:00
Maxim Akhmedov
d6f72dc2ce
Specify supported features for each storage engine, expose them via system.table_engines table, properly check feature support in storage factory.
2020-01-25 22:44:52 +03:00
Alexander Tokmakov
250f170a69
Merge branch 'master' into table_name_in_istorage
2019-12-30 14:08:09 +03:00
Alexander Tokmakov
8987b027ba
fixes
2019-12-27 15:18:49 +03:00
alesapin
d341b648d2
Better alter
2019-12-26 21:17:05 +03:00
Alexander Tokmakov
ef129b4b7c
use StorageID in views
2019-12-26 20:59:47 +03:00
Alexander Tokmakov
9319863a59
refactor table dependencies
2019-12-26 20:23:24 +03:00
Alexander Tokmakov
2e5d61cd81
better constructors of storages
2019-12-26 20:04:08 +03:00
Alexander Tokmakov
cf5c998b30
refactor storage name
2019-12-26 19:23:38 +03:00
Alexey Milovidov
41ed1ed471
Added quoting of db and table names where appropriate
2019-12-20 19:53:37 +03:00
Mikhail Filimonov
f3fa71c707
Init query context for Kafka to make subqueries work
2019-12-13 02:21:40 +01:00
Nikolai Kochetov
a80338e066
Merged with master
2019-10-31 14:41:29 +03:00
Ivan
7ba4e36e73
Don't push to MVs when inserting into Kafka table ( #7265 )
...
* Do not insert values into MV when inserting directly to Kafka
* Add method noPushingToViews() to IStorage interface
To separate InterpreterInsertQuery and StorageKafka
2019-10-22 13:31:28 +03:00
Nikolai Kochetov
ef14df4632
Added more comments.
2019-10-10 17:16:15 +03:00
Nikolai Kochetov
95ec0f7c2d
Merged with master.
2019-10-04 20:53:21 +03:00
Nikolai Kochetov
627d48c19a
Added ExecutionSpeedLimits.
2019-10-04 20:49:57 +03:00
Ivan
05b17976d1
Commit to Kafka explicitly after the writing is finalized ( #7175 )
2019-10-03 00:17:19 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole ( #6950 )
...
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
Ivan
6c32fc3fc1
Store offsets manually for each message ( #6872 )
2019-09-09 19:59:51 +03:00
Ivan
ab7df6b6dd
Fix kafka tests ( #6805 )
...
* Commit offsets more precisely
* Get rid of DelimitedReadBuffer since read buffers don't line up well
* Increase timeouts
2019-09-05 00:25:33 +03:00
alesapin
7382a9f3c3
Rename method for settings check
2019-09-01 00:15:40 +03:00
alesapin
2647d4ca15
Rename immutable to readonly
2019-08-30 23:12:26 +03:00
alesapin
6f30338c08
Fixes
2019-08-30 21:31:35 +03:00
alesapin
808f4d0b8a
Intermediate refactoring
2019-08-30 19:50:59 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views ( #6597 )
...
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
2019-08-29 18:36:07 +03:00
Alexey Milovidov
c8798b2ffa
Slightly improve table locks
2019-08-28 02:47:30 +03:00
alesapin
36472b14f9
Defend kafka storage from alters
2019-08-27 12:48:20 +03:00
alesapin
7851d8fe0a
Add ability to alter settings with other types of alter
2019-08-27 12:34:53 +03:00
alesapin
cf31187254
Resolve conflicts
2019-08-26 21:08:58 +03:00
alesapin
0d0ebf885f
Remove two redundant arguments from alter
2019-08-26 17:50:34 +03:00
Alexey Milovidov
60d660e263
Merge branch 'master' into merge-constraints
2019-08-26 16:13:44 +03:00
Alexey Milovidov
3fef8e92ad
Merging CONSTRAINTS support
2019-08-25 00:20:20 +03:00
alesapin
70ca7f4156
Merge with master
2019-08-21 11:57:35 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables ( #6012 )
...
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
alesapin
7b1039568c
Revert old changed
2019-08-13 14:24:18 +03:00
alesapin
428c753ed7
Merge with master
2019-08-13 11:37:47 +03:00
alesapin
2803fcc2ba
Make atomic settings
2019-08-09 16:07:19 +03:00
alesapin
13e4581317
More general
2019-08-07 18:21:45 +03:00
Ivan Lezhankin
b55da1888a
Add "_timestamp" virtual column
2019-08-06 17:18:37 +03:00
Ivan Lezhankin
969cb2f826
Append _partition virtual column
2019-07-22 14:32:11 +03:00
Ivan Lezhankin
0917573493
Merge remote-tracking branch 'upstream/master' into issue-5286
2019-06-24 14:42:58 +03:00
Ivan Lezhankin
61750d09d2
Commit offsets for SELECTing from Kafka table too
2019-06-20 15:34:25 +03:00
Ivan Lezhankin
fdd3f07860
Don't do premature subscription to topics
2019-06-19 19:15:30 +03:00
Ivan Lezhankin
9fd048cdbd
Allow to select virtual columns in materialized view
2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b
Merge branch 'master' into issue-5286
2019-06-18 16:03:29 +03:00
Ivan Lezhankin
d907d8e8ca
Commit offsets for SELECTing from Kafka table too
2019-06-17 19:27:18 +03:00
Alexey Milovidov
c846d0f6af
Namespace comments are unneeded according to the code style.
...
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
2019-06-13 13:43:37 +03:00
