Alexander Tokmakov
8987b027ba
fixes
2019-12-27 15:18:49 +03:00
Alexander Tokmakov
ef129b4b7c
use StorageID in views
2019-12-26 20:59:47 +03:00
Alexander Tokmakov
9319863a59
refactor table dependencies
2019-12-26 20:23:24 +03:00
Alexander Tokmakov
2e5d61cd81
better constructors of storages
2019-12-26 20:04:08 +03:00
Alexander Tokmakov
cf5c998b30
refactor storage name
2019-12-26 19:23:38 +03:00
Alexey Milovidov
41ed1ed471
Added quoting of db and table names where appropriate
2019-12-20 19:53:37 +03:00
Mikhail Filimonov
f3fa71c707
Init query context for Kafka to make subqueries work
2019-12-13 02:21:40 +01:00
Nikolai Kochetov
a80338e066
Merged with master
2019-10-31 14:41:29 +03:00
Ivan
7ba4e36e73
Don't push to MVs when inserting into Kafka table ( #7265 )
...
* Do not insert values into MV when inserting directly to Kafka
* Add method noPushingToViews() to IStorage interface
To separate InterpreterInsertQuery and StorageKafka
2019-10-22 13:31:28 +03:00
Nikolai Kochetov
ef14df4632
Added more comments.
2019-10-10 17:16:15 +03:00
Nikolai Kochetov
95ec0f7c2d
Merged with master.
2019-10-04 20:53:21 +03:00
Nikolai Kochetov
627d48c19a
Added ExecutionSpeedLimits.
2019-10-04 20:49:57 +03:00
Ivan
05b17976d1
Commit to Kafka explicitly after the writing is finalized ( #7175 )
2019-10-03 00:17:19 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole ( #6950 )
...
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
Ivan
6c32fc3fc1
Store offsets manually for each message ( #6872 )
2019-09-09 19:59:51 +03:00
Ivan
ab7df6b6dd
Fix kafka tests ( #6805 )
...
* Commit offsets more precisely
* Get rid of DelimitedReadBuffer since read buffers don't line up well
* Increase timeouts
2019-09-05 00:25:33 +03:00
alesapin
7382a9f3c3
Rename method for settings check
2019-09-01 00:15:40 +03:00
alesapin
2647d4ca15
Rename immutable to readonly
2019-08-30 23:12:26 +03:00
alesapin
6f30338c08
Fixes
2019-08-30 21:31:35 +03:00
alesapin
808f4d0b8a
Intermediate refactoring
2019-08-30 19:50:59 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views ( #6597 )
...
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
2019-08-29 18:36:07 +03:00
Alexey Milovidov
c8798b2ffa
Slightly improve table locks
2019-08-28 02:47:30 +03:00
alesapin
36472b14f9
Defend kafka storage from alters
2019-08-27 12:48:20 +03:00
alesapin
7851d8fe0a
Add ability to alter settings with other types of alter
2019-08-27 12:34:53 +03:00
alesapin
cf31187254
Resolve conflicts
2019-08-26 21:08:58 +03:00
alesapin
0d0ebf885f
Remove two redundant arguments from alter
2019-08-26 17:50:34 +03:00
Alexey Milovidov
60d660e263
Merge branch 'master' into merge-constraints
2019-08-26 16:13:44 +03:00
Alexey Milovidov
3fef8e92ad
Merging CONSTRAINTS support
2019-08-25 00:20:20 +03:00
alesapin
70ca7f4156
Merge with master
2019-08-21 11:57:35 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables ( #6012 )
...
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
alesapin
7b1039568c
Revert old changed
2019-08-13 14:24:18 +03:00
alesapin
428c753ed7
Merge with master
2019-08-13 11:37:47 +03:00
alesapin
2803fcc2ba
Make atomic settings
2019-08-09 16:07:19 +03:00
alesapin
13e4581317
More general
2019-08-07 18:21:45 +03:00
Ivan Lezhankin
b55da1888a
Add "_timestamp" virtual column
2019-08-06 17:18:37 +03:00
Ivan Lezhankin
969cb2f826
Append _partition virtual column
2019-07-22 14:32:11 +03:00
Ivan Lezhankin
0917573493
Merge remote-tracking branch 'upstream/master' into issue-5286
2019-06-24 14:42:58 +03:00
Ivan Lezhankin
61750d09d2
Commit offsets for SELECTing from Kafka table too
2019-06-20 15:34:25 +03:00
Ivan Lezhankin
fdd3f07860
Don't do premature subscription to topics
2019-06-19 19:15:30 +03:00
Ivan Lezhankin
9fd048cdbd
Allow to select virtual columns in materialized view
2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b
Merge branch 'master' into issue-5286
2019-06-18 16:03:29 +03:00
Ivan Lezhankin
d907d8e8ca
Commit offsets for SELECTing from Kafka table too
2019-06-17 19:27:18 +03:00
Alexey Milovidov
c846d0f6af
Namespace comments are unneeded according to the code style.
...
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
2019-06-13 13:43:37 +03:00
Ivan Lezhankin
97558c1b41
Merge remote-tracking branch 'upstream/master' into issue-5286
2019-06-10 14:15:14 +03:00
Ivan
f70eed78d8
Don't do intermediate commits in Kafka tables by default ( #5445 )
...
* Don't do intermediate commits in Kafka tables by default
* Use default settings' values as defaults in code
2019-06-03 19:40:22 +03:00
Ivan Lezhankin
b311984879
Merge remote-tracking branch 'upstream/master' into issue-5286
2019-06-03 17:19:09 +03:00
alexey-milovidov
81ed764d6a
Merge pull request #5285 from abyss7/issue-5085
...
Don't crash the server when Kafka consumers have failed to start
2019-05-25 16:09:26 +03:00
Ivan Lezhankin
dd906eabdc
[WIP] refactoring
2019-05-22 22:38:43 +03:00
Ivan Lezhankin
cf39c4cc47
Embed virtual columns into IStorage
2019-05-21 14:24:32 +03:00
Ivan Lezhankin
a14013dff7
Add setting to regulate Kafka committing policy.
2019-05-16 18:20:30 +03:00
