kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guozhang Wang <wangg...@gmail.com>
Subject Re: error recovery in multiple thread reading from Kafka with HighLevel api
Date Thu, 07 Aug 2014 23:54:36 GMT
Hello Chen,

With high-level consumer, the partition re-assignment is automatic upon
consumer failures.

Guozhang


On Thu, Aug 7, 2014 at 4:41 PM, Chen Wang <chen.apache.solr@gmail.com>
wrote:

> Folks,
>  I have a process started at specific time and read from a specific topic.
> I am currently using the High Level API(consumer group) to read from
> kafka(and will stop once there is nothing in the topic by specifying a
> timeout). i am most concerned about error recovery in multiple thread
> context. If one thread dies, will other running bolt threads picks up the
> failed message? Or I have to start another thread in order to pick up the
> failed message? What would be  a good practice to ensure the message can be
> processed at least once?
>
> Note that all threads are using the same group id.
>
> Thanks,
> Chen
>



-- 
-- Guozhang

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message