alesapin
2647d4ca15
Rename immutable to readonly
2019-08-30 23:12:26 +03:00
alesapin
6f30338c08
Fixes
2019-08-30 21:31:35 +03:00
alesapin
808f4d0b8a
Intermediate refactoring
2019-08-30 19:50:59 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views ( #6597 )
...
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
2019-08-29 18:36:07 +03:00
Alexey Milovidov
c8798b2ffa
Slightly improve table locks
2019-08-28 02:47:30 +03:00
alesapin
36472b14f9
Defend kafka storage from alters
2019-08-27 12:48:20 +03:00
alesapin
7851d8fe0a
Add ability to alter settings with other types of alter
2019-08-27 12:34:53 +03:00
alesapin
cf31187254
Resolve conflicts
2019-08-26 21:08:58 +03:00
alesapin
0d0ebf885f
Remove two redundant arguments from alter
2019-08-26 17:50:34 +03:00
Alexey Milovidov
60d660e263
Merge branch 'master' into merge-constraints
2019-08-26 16:13:44 +03:00
Alexey Milovidov
3fef8e92ad
Merging CONSTRAINTS support
2019-08-25 00:20:20 +03:00
alesapin
70ca7f4156
Merge with master
2019-08-21 11:57:35 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables ( #6012 )
...
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
alesapin
7b1039568c
Revert old changed
2019-08-13 14:24:18 +03:00
alesapin
428c753ed7
Merge with master
2019-08-13 11:37:47 +03:00
alesapin
2803fcc2ba
Make atomic settings
2019-08-09 16:07:19 +03:00
alesapin
13e4581317
More general
2019-08-07 18:21:45 +03:00
Ivan Lezhankin
b55da1888a
Add "_timestamp" virtual column
2019-08-06 17:18:37 +03:00
Ivan Lezhankin
969cb2f826
Append _partition virtual column
2019-07-22 14:32:11 +03:00
Ivan Lezhankin
0917573493
Merge remote-tracking branch 'upstream/master' into issue-5286
2019-06-24 14:42:58 +03:00
Ivan Lezhankin
61750d09d2
Commit offsets for SELECTing from Kafka table too
2019-06-20 15:34:25 +03:00
Ivan Lezhankin
fdd3f07860
Don't do premature subscription to topics
2019-06-19 19:15:30 +03:00
Ivan Lezhankin
9fd048cdbd
Allow to select virtual columns in materialized view
2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b
Merge branch 'master' into issue-5286
2019-06-18 16:03:29 +03:00
Ivan Lezhankin
d907d8e8ca
Commit offsets for SELECTing from Kafka table too
2019-06-17 19:27:18 +03:00
Alexey Milovidov
c846d0f6af
Namespace comments are unneeded according to the code style.
...
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
2019-06-13 13:43:37 +03:00
Ivan Lezhankin
97558c1b41
Merge remote-tracking branch 'upstream/master' into issue-5286
2019-06-10 14:15:14 +03:00
Ivan
f70eed78d8
Don't do intermediate commits in Kafka tables by default ( #5445 )
...
* Don't do intermediate commits in Kafka tables by default
* Use default settings' values as defaults in code
2019-06-03 19:40:22 +03:00
Ivan Lezhankin
b311984879
Merge remote-tracking branch 'upstream/master' into issue-5286
2019-06-03 17:19:09 +03:00
alexey-milovidov
81ed764d6a
Merge pull request #5285 from abyss7/issue-5085
...
Don't crash the server when Kafka consumers have failed to start
2019-05-25 16:09:26 +03:00
Ivan Lezhankin
dd906eabdc
[WIP] refactoring
2019-05-22 22:38:43 +03:00
Ivan Lezhankin
cf39c4cc47
Embed virtual columns into IStorage
2019-05-21 14:24:32 +03:00
Ivan Lezhankin
a14013dff7
Add setting to regulate Kafka committing policy.
2019-05-16 18:20:30 +03:00
alexey-milovidov
8e2bdde93b
Update StorageKafka.cpp
2019-05-15 23:57:24 +03:00
Ivan Lezhankin
337ddf5047
Catch cppkafka exceptions about consumer creation failures
2019-05-15 17:23:52 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka ( #5249 )
2019-05-14 18:52:03 +03:00
Ivan Lezhankin
94bba1918f
Do not drop Kafka consumer buffers after closing stream
2019-04-22 16:23:05 +03:00
Ivan Lezhankin
4f6a494af8
Revert references where they were before refactoring.
2019-03-15 19:14:13 +03:00
Ivan Lezhankin
d1ead22073
Rename As<…> → as<…>
2019-03-11 16:22:51 +03:00
Ivan Lezhankin
a7e838e328
Replace all other casts to method IAST::As<Derived>
...
Also remove some redundant methods like IsIdentifier() et. al.
2019-03-11 15:49:39 +03:00
Ivan Lezhankin
0e325c7a4a
Replace const typeid_casts with As<Derived>() method invocations
2019-03-08 12:48:20 +03:00
proller
4078a62573
Fix build without contrib/cppkafka submodule
2019-02-11 19:34:32 +03:00
Ivan Lezhankin
2bd14117f4
Merge remote-tracking branch 'upstream/master' into issue-2675
2019-02-11 13:57:40 +03:00
Alexey Milovidov
58a6accee5
Updated test #4246
2019-02-10 19:55:12 +03:00
Ivan Lezhankin
39e2563f93
Create new consumers on-demand
...
and give them some time for graceful assignment.
2019-01-30 20:58:49 +03:00
Ivan Lezhankin
681266abd0
Poll messages in batches of max_block_size
size.
2019-01-25 15:48:59 +03:00
Ivan Lezhankin
425d483cfb
Add integration tests
2019-01-24 14:58:25 +03:00
Ivan Lezhankin
c8e605327d
Split StorageKafka.cpp on smaller files per class
2019-01-24 14:58:24 +03:00
Ivan Lezhankin
05ab15cc84
Merge IBlockInputStream
and IProfilingBlockInputStream
into one
2019-01-23 17:48:50 +03:00
maiha
6c83beafdd
dbms: Fixed misspells in comments
2019-01-23 04:56:53 +09:00