All Questions
5 questions
1
vote
0
answers
539
views
confluent-kafka-python didn't catch timed out metadatarequest in flight in producer
Hi our kafka has crashed for about 2 days, while that one of our producers using confluent kafka for python still tried producing a messages and while that we received logs that say Timed out ...
- 11
1
vote
1
answer
3k
views
how to configure Kafka-Python client.dns.lookup = "use_all_dns_ips"
I want to configure my python producer/consumer with client.dns.lookup = "use_all_dns_ips"
but none of python kafka clients like kafka-python (2.0.1) and confluent-kafka (1.3.0) support this
This is ...
- 71
0
votes
1
answer
314
views
Use AvroConsumer to get messages in partitions and topics
I want to be able to read messages that come in specific partitions of a topic and also messages in another topic like a I would with a simple Consumer.
self.consumer = AvroConsumer(conf)
parts = [...
- 1,626
0
votes
1
answer
812
views
Apache Kafka: Programmatic monitoring of consumer groups
I would like to monitor the consumer groups (Kafka based groups not ZK) in my Kafka cluster from within a Python application (I am open to using either of the Kafka-python library and the confluent ...
- 2,533
7
votes
1
answer
9k
views
How to get the latest offset value from a confluent_python AVRO consumer
I am pretty new to confluent_kafka but I've gained some experience with kafka-python. What I am trying to do is changing the offset where to start consuming messages. This why I'd like to build a ...
- 465