Maxim Akhmedov
d6f72dc2ce
Specify supported features for each storage engine, expose them via system.table_engines table, properly check feature support in storage factory.
2020-01-25 22:44:52 +03:00
Alexander Tokmakov
250f170a69
Merge branch 'master' into table_name_in_istorage
2019-12-30 14:08:09 +03:00
Alexander Tokmakov
8987b027ba
fixes
2019-12-27 15:18:49 +03:00
alesapin
d341b648d2
Better alter
2019-12-26 21:17:05 +03:00
Alexander Tokmakov
ef129b4b7c
use StorageID in views
2019-12-26 20:59:47 +03:00
Alexander Tokmakov
9319863a59
refactor table dependencies
2019-12-26 20:23:24 +03:00
Alexander Tokmakov
2e5d61cd81
better constructors of storages
2019-12-26 20:04:08 +03:00
Alexander Tokmakov
cf5c998b30
refactor storage name
2019-12-26 19:23:38 +03:00
Alexey Milovidov
41ed1ed471
Added quoting of db and table names where appropriate
2019-12-20 19:53:37 +03:00
Mikhail Filimonov
f3fa71c707
Init query context for Kafka to make subqueries work
2019-12-13 02:21:40 +01:00
alexey-milovidov
ee7d675f86
Update KafkaBlockInputStream.cpp
2019-12-09 00:03:09 +03:00
Mikhail Filimonov
4e4957e052
returning allowNext() to the proper position
2019-12-06 12:22:36 +01:00
Mikhail Filimonov
7d760a964d
Fix for timestamp & style
2019-12-05 22:21:15 +01:00
Mikhail Filimonov
34275626de
Fix for https://github.com/ClickHouse/ClickHouse/issues/8003 : old producers do not write timestamp, but column still should have enough rows
2019-12-03 23:03:43 +01:00
Mikhail Filimonov
3de3ba336a
Fix Native format in Kafka
2019-12-03 22:12:47 +01:00
Mikhail Filimonov
6e426592a7
Make the formats like RowBinaryWithNamesAndTypes work in Kafka & do not try to parse buffer when it at eof
2019-12-03 22:03:22 +01:00
alexey-milovidov
b6edda194f
Update KafkaBlockInputStream.cpp
2019-12-03 03:52:02 +03:00
Mikhail Filimonov
ad136ec62d
get rid of cloneWithColumns in internal loop and some other trash
2019-11-29 11:46:25 +01:00
Mikhail Filimonov
4cc0d0ca5d
make virtual_columns local
2019-11-29 07:21:31 +01:00
Mikhail Filimonov
07722dfa93
more progress - cleanup internal cycles
2019-11-29 00:06:03 +01:00
Mikhail Filimonov
6217cb51f6
Get rid of InputStream layer for Kafka, use InputStream directly. Reopening port during reset.
2019-11-28 17:43:06 +01:00
Mikhail Filimonov
deec48a3e0
attempt to fix kafka parsing performance regression https://github.com/ClickHouse/ClickHouse/issues/7261
2019-11-27 00:46:19 +01:00
Vitaly Baranov
e40c140982
Add the ignorable flag for the settings.
2019-11-17 03:56:18 +03:00
Vitaly Baranov
ff6cba192b
Replace pointer with reference in SettingsCollection<T>::MemberInfos::findStrict().
...
Rename SettingsCommon.h -> SettingsCollection.h for consistency.
2019-11-17 03:51:51 +03:00
Ivan
21db9157f7
Don't initialize some constant blocks in a loop ( #7475 )
2019-11-01 14:34:29 +03:00
Nikolai Kochetov
a80338e066
Merged with master
2019-10-31 14:41:29 +03:00
Ivan
7ba4e36e73
Don't push to MVs when inserting into Kafka table ( #7265 )
...
* Do not insert values into MV when inserting directly to Kafka
* Add method noPushingToViews() to IStorage interface
To separate InterpreterInsertQuery and StorageKafka
2019-10-22 13:31:28 +03:00
Nikolai Kochetov
ef14df4632
Added more comments.
2019-10-10 17:16:15 +03:00
Nikolai Kochetov
9c5ae5f536
Merge branch 'master' into processors-and-storages
2019-10-09 14:12:47 +03:00
Alexander Kuzmenkov
367c537106
Do not include Field.h everywhere through SettingsCommon.h.
...
Move the methods of SettingsCollection<> that are dependent on Field to
a separate file, and include it once for each instantiation. This allows
to work on Field without always recompiling the entire project.
2019-10-07 20:23:05 +03:00
Nikolai Kochetov
95ec0f7c2d
Merged with master.
2019-10-04 20:53:21 +03:00
Nikolai Kochetov
627d48c19a
Added ExecutionSpeedLimits.
2019-10-04 20:49:57 +03:00
Ivan
05b17976d1
Commit to Kafka explicitly after the writing is finalized ( #7175 )
2019-10-03 00:17:19 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole ( #6950 )
...
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
Ivan Lezhankin
c5f1352394
Decide to put delimiter only after polled message
2019-09-11 16:16:43 +03:00
Ivan
6c32fc3fc1
Store offsets manually for each message ( #6872 )
2019-09-09 19:59:51 +03:00
Ivan
ab7df6b6dd
Fix kafka tests ( #6805 )
...
* Commit offsets more precisely
* Get rid of DelimitedReadBuffer since read buffers don't line up well
* Increase timeouts
2019-09-05 00:25:33 +03:00
alesapin
7382a9f3c3
Rename method for settings check
2019-09-01 00:15:40 +03:00
alesapin
2647d4ca15
Rename immutable to readonly
2019-08-30 23:12:26 +03:00
alesapin
6f30338c08
Fixes
2019-08-30 21:31:35 +03:00
alesapin
808f4d0b8a
Intermediate refactoring
2019-08-30 19:50:59 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views ( #6597 )
...
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
2019-08-29 18:36:07 +03:00
alexey-milovidov
44dd3bd792
Merge pull request #6692 from yandex/remove-queue_max_wait_ms
...
Set default value of "queue_max_wait_ms" to zero, because current value makes no sense
2019-08-28 21:06:09 +03:00
Alexey Milovidov
d1c268c2ed
Added setting "kafka_max_wait_ms"
2019-08-28 18:24:23 +03:00
Alexey Milovidov
a1101e5278
Fixed build
2019-08-28 16:21:19 +03:00
Alexey Milovidov
c8798b2ffa
Slightly improve table locks
2019-08-28 02:47:30 +03:00
alesapin
106b9717cd
Refactoring of immutable settings
2019-08-27 16:14:19 +03:00
alexey-milovidov
8db93d392b
Merge pull request #6685 from yandex/merge_tree_settings_alter
...
Alter merge tree settings with other types of alter
2019-08-27 16:07:28 +03:00
alesapin
36472b14f9
Defend kafka storage from alters
2019-08-27 12:48:20 +03:00
alesapin
7851d8fe0a
Add ability to alter settings with other types of alter
2019-08-27 12:34:53 +03:00
