kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsha <ka...@harsha.io>
Subject Re: High level Consumer API doesnt receive 10MB messages?
Date Tue, 02 Dec 2014 13:56:22 GMT
I was talking about consumer config fetch.message.max.bytes
https://kafka.apache.org/08/configuration.html
by default its 1048576 bytes

On Mon, Dec 1, 2014, at 08:09 PM, Palur Sandeep wrote:
> Yeah I did. I made the following changes to server.config:
> 
> message.max.bytes=10485800
> replica.fetch.max.bytes=104858000
> replica.fetch.wait.max.ms=2000
> 
> 
> On Mon, Dec 1, 2014 at 10:03 PM, Harsha <kafka@harsha.io> wrote:
> 
> > have you set fetch.message.max.bytes to 10mb or more in your consumer
> > config.
> > -Harsha
> >
> > On Mon, Dec 1, 2014, at 07:27 PM, Palur Sandeep wrote:
> > > Hi all,
> > >
> > > Consumer doesnt receive message if it is big:  When the producer sends
> > > 256kb messages to broker, consumer is able to retrieve it, but when
> > > producer sends 10MB messages to the broker, the consumer doesn’t receive
> > > any message.
> > >
> > > Please tell me how to make the consumer receive 10MB messages.
> > > --
> > > Regards,
> > > Sandeep Palur
> > > Data-Intensive Distributed Systems Laboratory, CS/IIT
> > > Department of Computer Science, Illinois Institute of Technology (IIT)
> > > Phone : 312-647-9833
> > > Email : psandeep@hawk.iit.edu <srajasur@hawk.iit.edu>
> >
> 
> 
> 
> -- 
> Regards,
> Sandeep Palur
> Data-Intensive Distributed Systems Laboratory, CS/IIT
> Department of Computer Science, Illinois Institute of Technology (IIT)
> Phone : 312-647-9833
> Email : psandeep@hawk.iit.edu <srajasur@hawk.iit.edu>

Mime
View raw message