kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Navneet Kumar <navneetkumar.in...@gmail.com>
Subject Re: My Use case is I want to delete the records instantly after consuming them
Date Sat, 02 Jul 2016 17:30:34 GMT
Hi All
Is the number of consumer component equal to the number of partitions
created in cluster ?
I have created three  partitions in cluster but I am using only two
consumer poller to subscribe the records. Some time I have noticed
that the messages are polled very late. What should be the good
polling strategy needed. Please suggest me.

/home/kafka/kafka_2.11-0.9.0.0/bin/kafka-topics.sh --create
--zookeeper 172.16.8.216:2181 --replication-factor 3 --partitions 3
--topic EmailOCTracker




Thanks and Regards,
Navneet Kumar


On Sat, Jul 2, 2016 at 10:49 PM, Navneet Kumar
<navneetkumar.india@gmail.com> wrote:
> Thank you so much Ian
>
>
>
>
> Thanks and Regards,
> Navneet Kumar
>
>
> On Sat, Jul 2, 2016 at 9:45 PM, Ian Wrigley <ian@confluent.io> wrote:
>> That’s really not what Kafka was designed to do. You can set a short log retention
period, which will mean messages are deleted relatively soon after they were written to Kafka,
but there’s no mechanism for deleting records on consumption.
>>
>> Ian.
>>
>>
>> ---
>> Ian Wrigley
>> Director, Education Services
>> Confluent, Inc
>>
>>> On Jul 2, 2016, at 11:08 AM, Navneet Kumar <navneetkumar.india@gmail.com>
wrote:
>>>
>>> Hi All
>>> My Use case is I want to delete the records instantly after consuming
>>> them. I am using Kafka 0.90
>>>
>>>
>>>
>>> Thanks and Regards,
>>> Navneet Kumar
>>

Mime
View raw message