kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guozhang Wang <wangg...@gmail.com>
Subject Re: Commit in Kafka streams reduces throughput
Date Wed, 18 Apr 2018 17:52:32 GMT
Hello Shivam,

I think your two questions can be answer as one :)

Have just created this FAQ entry for you:
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-WhenIcommitmyprocessstate,whatdoestheStreamslibrarydoandhowitaffectsmyapplication'sperformance
?

Guozhang



On Tue, Apr 17, 2018 at 8:11 AM, Shivam Sharma <28shivamsharma@gmail.com>
wrote:

> Hi All,
>
> I am using processor API in Kafka Streams and I am using context.commit in
> process method of Processor Interface. When I am using commit then my
> application throughput is about 2k/min and when I removes commit then it
> increases to 4k/min.
>
> Two questions I have:
> 1. I need to know how commit is reducing throughput?
>
> 2. What exactly context.commit is doing?
>
> Thanks
>
> --
> Shivam Sharma
> Data Engineer @ Goibibo
> Indian Institute Of Information Technology, Design and Manufacturing
> Jabalpur
> Mobile No- (+91) 8882114744
> Email:- 28shivamsharma@gmail.com
> LinkedIn:-*https://www.linkedin.com/in/28shivamsharma
> <https://www.linkedin.com/in/28shivamsharma>*
>



-- 
-- Guozhang

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message