kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karthick Kumar <kku...@apptivo.co.in>
Subject Re: Kafka consumer slowly consume the data
Date Tue, 15 May 2018 04:31:25 GMT
Hi Ted,

I'm using kafka_2.11-0.10.2.0 version, I figure out that the issue from the
wildfly node because of each consumed messages are passed by the Tomcat
node and it sends the details to the wildfly node.

When the wildfly node process the details again it will consume the next
offset messages. So it causes the issue

On Fri, May 11, 2018 at 9:07 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> bq. load on the node is increasing tremendously
>
> Can you do some profiling to see where the bottleneck was ?
> You can pastebin some stack traces.
>
> Which Kafka release do you use ?
>
> Thanks
>
> On Fri, May 11, 2018 at 6:41 AM, Karthick Kumar <kkumar@apptivo.co.in>
> wrote:
>
> > Hi,
> >
> > I'm using tomcat nodes for Kafka producer and consumer, Recently I faced
> > some issues with it.
> > Normally the producer and consumer counts matched in the tomcat nodes.
> > After some time the produced data is consumed with delay, I'm not sure
> > where to check.
> >
> > The data which was delayed is dumped over the consumer when it is
> started.
> > At this time, the load on the node is increasing tremendously.
> >
> >
> > So any data that was newly produced at this time is getting lost (it is
> > available on the producer but not on the consumer).
> >
> > --
> > With Regards,
> > Karthick.K
> >
>



-- 
With Regards,
Karthick.K

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message