alexey-milovidov
9a362eb02e
Merge pull request #11252 from filimonov/kafka-clientid
...
Kafka clientid (finishing #11073 )
2020-05-31 18:37:30 +03:00
Alexey Milovidov
25f941020b
Remove namespace pollution
2020-05-31 00:57:37 +03:00
Ilya Yatsishin
393db8ff6c
Merge pull request #11261 from filimonov/kafka_log_with_prefix_and_facility
...
Add prefix & facility to librdkafka logs
2020-05-29 23:02:42 +03:00
Mikhail Filimonov
b885337454
Virtual columns for accessing kafka message headers
2020-05-29 10:44:10 +02:00
Alexander Tokmakov
c071e0a473
add context to DatabaseCatalog methods
2020-05-29 02:01:18 +03:00
Mikhail Filimonov
7211af9404
Fixing style
2020-05-28 20:19:10 +02:00
Mikhail Filimonov
b97ff8136b
Make function static
2020-05-28 20:10:54 +02:00
Mikhail Filimonov
16de65a6f0
Add prefix & facility to librdkafka logs
2020-05-28 19:52:59 +02:00
Mikhail Filimonov
e39c4cdf71
Add _timestamp_ms virtual columns to Kafka engine
2020-05-28 19:41:57 +02:00
Mikhail Filimonov
4de1d6d421
Fixing style
2020-05-28 15:53:27 +02:00
Mikhail Filimonov
6b694d54b4
Better kafka client.id
2020-05-28 15:39:55 +02:00
madianjun
e3c7ab2ca7
Add Kafka client.id
2020-05-28 08:32:51 +02:00
Mikhail Filimonov
efc0b97707
Fix Kafka performance issue related to reschedules based on limits, which were always applied.
2020-05-27 07:39:06 +02:00
Alexey Milovidov
4bb3381bc9
Fix build after merge
2020-05-26 00:53:29 +03:00
filimonov
73a0ef6c0e
Fix for the hang during deletion of engine=Kafka (one more time) ( #11145 )
...
* Added flag for safer rdkafka destruction, but more testing detected another hang case, which has no straigt solutions and can be workarounded currenly only by draining the consumer queue, so destructor is back
* After review fixes
* After review fixes2
* After review fixes3
2020-05-26 00:13:10 +03:00
Alexey Milovidov
7e1813825b
Return old names of macros
2020-05-24 01:24:01 +03:00
Alexey Milovidov
af2a59e49b
Progress on task
2020-05-24 00:50:34 +03:00
Alexey Milovidov
85f84550ba
Progress on task
2020-05-23 23:37:37 +03:00
Alexey Milovidov
86b4d5a86f
Remove duplicate whitespaces (preparation)
2020-05-23 22:09:06 +03:00
Alexey Milovidov
a2ad11897f
Remove duplicate whitespaces (preparation)
2020-05-23 21:53:58 +03:00
Alexey Milovidov
1f13515a65
Make all LOG in single line (preparation)
2020-05-23 21:31:37 +03:00
Alexey Milovidov
3a09f9ca1c
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_[^\W_]+\([^,]+, [^<+)"]+\);' | xargs sed -i -r -e 's/(LOG_[^\W_]+)\(([^,]+), ([^<+)"]+)\);/\1_FORMATTED(\2, \3);/'
2020-05-23 20:29:56 +03:00
Alexey Milovidov
d6bc4d2bd0
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, [^<]+ << "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), ([^<]+) << "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "{}\4{}", \3, \5);/'
2020-05-23 20:14:57 +03:00
Alexey Milovidov
8042e5febe
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}\5{}", \4, \6);/'
2020-05-23 19:58:15 +03:00
Alexey Milovidov
e391b77d81
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5", \4);/'
2020-05-23 19:56:05 +03:00
Alexey Milovidov
ee4ffbc332
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/'
2020-05-23 19:47:56 +03:00
Alexey Milovidov
8d2e80a5e2
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+"\)' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+, "[^"]+")\)/\1_FORMATTED(\2)/'
2020-05-23 19:42:39 +03:00
Alexey Milovidov
35d79e1252
fmt-style logging, part 1
2020-05-23 19:33:07 +03:00
Mikhail Filimonov
e8a13842af
Better fix, previous fix was wrong (was leaving the cycle by eof condition)
2020-05-20 11:02:02 +02:00
Mikhail Filimonov
34198336ed
Style
2020-05-19 19:02:37 +02:00
Mikhail Filimonov
b50480cbde
Fixes the potential missed data during termination of Kafka engine table
2020-05-19 18:55:37 +02:00
Azat Khuzhin
e3d69eea88
Configure thread names for librdkafka
...
First of all it is nice to have part of the table name in it.
And secondly, librdkafka uses pthread_setname_np(), but due to
glibc-compatibility it is a noop in clickhouse sources:
# librdkafka uses rdk: prefix for thread names by default
$ grep rdk /proc/$(pgrep clickhouse-serv)/task/*/comm
# just in case:
$ grep rdk /proc/*/task/*/comm
$ grep rdk /proc/*/comm
(gdb) disas pthread_setname_np
Dump of assembler code for function pthread_setname_np:
0x000000000c603250 <+0>: xor %eax,%eax
0x000000000c603252 <+2>: retq
End of assembler dump.
2020-05-17 20:40:18 +03:00
Azat Khuzhin
dbe781451a
Redirect librdkafka logs from stderr to clickhouse logger
2020-05-17 20:27:36 +03:00
Mikhail Filimonov
405cce2c53
Another variant of fix. It looks like we do not need destructor at all
2020-05-15 22:19:21 +02:00
Mikhail Filimonov
6499d702f9
After review fixes
2020-05-14 12:15:38 +02:00
Mikhail Filimonov
a1013f1e71
Fix for the hang during deletion of engine=Kafka
2020-05-14 10:38:02 +02:00
Azat Khuzhin
61c5df5662
Drop claimed from the KafkaBlockInputStream
2020-05-04 17:23:09 +03:00
Azat Khuzhin
a10cfc3ae5
Pass stream_cancelled to the copyData as stub in StorageKafka
2020-05-04 17:23:09 +03:00
Azat Khuzhin
c69217e9f3
Force destrying of kafka buffers from the shutdown in StorageKafka
2020-05-04 17:23:09 +03:00
Azat Khuzhin
9e14db2091
Add missing kafka settings into docs
2020-05-04 17:23:05 +03:00
alesapin
f981649213
Fix pushing to views stream and refactor virtuals
2020-04-28 13:38:57 +03:00
alesapin
4badd0fd28
Better code
2020-04-27 20:46:51 +03:00
alesapin
18c550df15
Better virtuals logic
2020-04-27 16:55:30 +03:00
Alexey Milovidov
be22a4b94e
Checkpoint
2020-04-22 08:39:31 +03:00
Alexey Milovidov
8ad04d4fec
Remove useless code
2020-04-15 00:05:45 +03:00
Ivan Lezhankin
06446b4f08
dbms/ → src/
2020-04-03 18:14:31 +03:00
