kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jiangjie Qin <j...@linkedin.com.INVALID>
Subject Re: High level Consumer API doesnt receive 10MB messages?
Date Tue, 02 Dec 2014 22:58:11 GMT
Has the message successfully produced to broker? You might need to change
producer settings as well. Otherwise the message could have been dropped.

‹Jiangjie (Becket) Qin

On 12/1/14, 8:09 PM, "Palur Sandeep" <psandeep@hawk.iit.edu> wrote:

>Yeah I did. I made the following changes to server.config:
>
>message.max.bytes=10485800
>replica.fetch.max.bytes=104858000
>replica.fetch.wait.max.ms=2000
>
>
>On Mon, Dec 1, 2014 at 10:03 PM, Harsha <kafka@harsha.io> wrote:
>
>> have you set fetch.message.max.bytes to 10mb or more in your consumer
>> config.
>> -Harsha
>>
>> On Mon, Dec 1, 2014, at 07:27 PM, Palur Sandeep wrote:
>> > Hi all,
>> >
>> > Consumer doesnt receive message if it is big:  When the producer sends
>> > 256kb messages to broker, consumer is able to retrieve it, but when
>> > producer sends 10MB messages to the broker, the consumer doesn¹t
>>receive
>> > any message.
>> >
>> > Please tell me how to make the consumer receive 10MB messages.
>> > --
>> > Regards,
>> > Sandeep Palur
>> > Data-Intensive Distributed Systems Laboratory, CS/IIT
>> > Department of Computer Science, Illinois Institute of Technology (IIT)
>> > Phone : 312-647-9833
>> > Email : psandeep@hawk.iit.edu <srajasur@hawk.iit.edu>
>>
>
>
>
>-- 
>Regards,
>Sandeep Palur
>Data-Intensive Distributed Systems Laboratory, CS/IIT
>Department of Computer Science, Illinois Institute of Technology (IIT)
>Phone : 312-647-9833
>Email : psandeep@hawk.iit.edu <srajasur@hawk.iit.edu>


Mime
View raw message