János Benjamin Antal
737948470d
Fix syntax
2024-08-12 11:54:34 +00:00
János Benjamin Antal
8f124710ef
Remove Log engine from Kafka integration tests
...
It doesn't work well when `thread_per_consumer` is used as writer can make readers starve when `shared_time_mutex` prefers writes over reads.
2024-08-12 10:27:21 +00:00
robot-clickhouse
94398996b2
Automatic style fix
2024-08-07 17:47:22 +00:00
János Benjamin Antal
d992431f96
Make tests more sturdier for flaky test check
2024-08-07 17:27:24 +00:00
János Benjamin Antal
b3c30b05d6
Make test_kafka_insert repeatable
2024-08-07 13:22:22 +00:00
János Benjamin Antal
139fe624c2
Fix typos
2024-08-07 13:16:47 +00:00
János Benjamin Antal
8b5c8e5361
Merge remote-tracking branch 'origin/master' into kafka-zookeeper
2024-08-07 11:33:21 +00:00
János Benjamin Antal
0e36db5437
Do not check the value of num_messages_read because it is not reliable
...
librdkafka usually polls both messages on the first SELECT, but sometimes only one. If it polls only one message first, then it will read two messages before rebalancing at the second SELECT from the table. This means it usually reads a single message twice (thus num_messages_read = 4 is usually fine as 1 discarded message + 3 actually consumed message). But when only one message is read in the first SELECT, then 2 messages are discarded, thus num_messages_read will be 5 as 2 discarded message + 3 actually consumed messages.
2024-07-31 22:09:04 +00:00
robot-clickhouse
87e9b7c5bb
Automatic style fix
2024-07-15 13:13:56 +00:00
János Benjamin Antal
123fd6b750
Remove seemingly unnecessary nullptr check
2024-07-15 12:40:44 +00:00
János Benjamin Antal
1ecfba837e
Rename experimental flag to allow_experimental_kafka_offsets_storage_in_keeper
2024-07-15 09:03:05 +00:00
robot-clickhouse
f2e4ec28cb
Automatic style fix
2024-06-18 11:51:51 +00:00
János Benjamin Antal
6e1a901510
Make big chunk of integration tests to work with new storage kafka
2024-06-18 11:42:58 +00:00
robot-clickhouse
7b90eccd57
Automatic style fix
2024-06-08 22:26:09 +00:00
János Benjamin Antal
be64d1bd32
Fix tests
2024-06-08 22:16:52 +00:00
János Benjamin Antal
419660d1b0
Fix one more test
2024-06-08 22:00:58 +00:00
robot-clickhouse
26851f1d34
Automatic style fix
2024-06-07 22:56:36 +00:00
János Benjamin Antal
1eec201777
Make most of the tests work
2024-06-07 22:39:17 +00:00
János Benjamin Antal
c0eea71ab3
Make some tests work with the new storage kafka too
2024-06-04 15:52:59 +00:00
Aleksandr Musorin
f9d81bc774
refactore: improve reading several configurations for kafka
...
Simplify and do some refactoring for kafka client settings.
Allows to set up separate
settings for consumer and producer like:
```
<consumer>
...
</consumer>
<producer>
<kafka_topic>
<name>topic_name</name>
...
</kafka_topic>
</producer>
```
Moreover, this fixes warnings from kafka client like:
`Configuration property session.timeout.ms is a consumer property and
will be ignored by this producer instance`
2024-03-27 14:53:33 +01:00
Alexey Milovidov
06a9ac7126
Fix tests
2024-03-24 23:23:13 +01:00
Max Kainov
55737de0e6
disable more hdfs and kafka inttests
...
#ci_set_arm
2024-03-20 17:24:55 +00:00
Kseniia Sumarokova
aec76d6653
Merge pull request #58877 from ClickHouse/multiple-read-file-log-storage-in-mv
...
Multiple read file log storage in mv
2024-01-22 12:02:41 +01:00
Kruglov Pavel
6d064512e1
Merge pull request #58614 from Blargian/58363_disable_ansi_pretty_automatically
...
58363 Automatically disable ANSI escape sequences in Pretty formats if the output is not a terminal
2024-01-17 13:45:41 +01:00
Blargian
1b81efc337
fix failing 02421 stateless and (hopefully) fix failing integration tests
2024-01-16 19:48:23 +02:00
robot-clickhouse
7262e93a27
Automatic style fix
2024-01-16 16:26:28 +00:00
János Benjamin Antal
5a178ce1ef
Add proper cleanup to kafka test
2024-01-16 16:03:44 +00:00
robot-clickhouse
224a58ddc5
Automatic style fix
2024-01-04 10:30:44 +00:00
János Benjamin Antal
1a1fa07128
Add missing asserts
2024-01-04 10:18:04 +00:00
János Benjamin Antal
2517d23e27
Add tests
2024-01-04 10:14:41 +00:00
avogar
f20917048e
Fix kafka tests
2023-12-29 17:02:46 +00:00
Kruglov Pavel
9389ea8745
Fix style
2023-12-28 18:47:57 +00:00
Kruglov Pavel
69f6147499
Fix style
2023-12-28 18:47:57 +00:00
avogar
c6085b3eb9
Fix working with read buffers in StreamingFormatExecutor
2023-12-28 18:47:57 +00:00
Raúl Marín
6c76ad1ea4
Cleanup
2023-08-22 11:57:56 +02:00
Raúl Marín
f2d3c9c281
Merge remote-tracking branch 'blessed/master' into better_zk_retries_on_insert
2023-08-21 12:14:31 +02:00
Ilya Golshtein
978d8bf9a6
system_kafka_consumers: cleanup with exceptions
2023-08-10 22:35:05 +00:00
Ilya Golshtein
7dab2dc041
system_kafka_consumers: exceptions seem to work
2023-08-10 22:35:05 +00:00
Ilya Golshtein
e8b10f0126
system_kafka_consumers: black formatter thing
2023-08-10 22:35:05 +00:00
Ilya Golshtein
80829a6bf7
system_kafka_consumers: no offset_committed, new test with MV
2023-08-10 22:35:05 +00:00
Ilya Golshtein
ae3e6f0fac
system_kafka_consumers: getMemberId introduced to avoid leak
2023-08-10 22:35:05 +00:00
Ilya Golshtein
2cc4bb355c
system_kafka_consumers: make black formatter happy
2023-08-10 22:35:05 +00:00
Ilya Golshtein
46be5e5782
system_kafka_consumers: cleanup, test should be more stable
2023-08-10 22:35:05 +00:00
Ilya Golshtein
1f03e320ee
system_kafka_consumers: test fix + black formatter
2023-08-10 22:35:05 +00:00
Ilya Golshtein
b71c2bedfc
system_kafka_consumers: rebalance test is ok, statistics_interval_ms
2023-08-10 22:35:05 +00:00
Ilya Golshtein
ae6e0469ad
system_kafka_consumers: rdfakfa stat with attempt to use json
2023-08-10 22:35:05 +00:00
Ilya Golshtein
40fd53c3e3
system_kafka_consumers: style check
2023-08-10 22:35:05 +00:00
Ilya Golshtein
88f5dd5db8
system_kafka_consumers: integration tests passed
2023-08-10 22:35:05 +00:00
Ilya Golshtein
5e1c72a0d0
system_kafka_consumers: test with rebalance
2023-08-10 22:35:05 +00:00
Ilya Golshtein
957787d96a
system_kafka_consumers: kind of works, test added
2023-08-10 22:35:05 +00:00
