storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From clay teahouse <clayteaho...@gmail.com>
Subject Re: kafkaspout stops fetching
Date Fri, 06 Feb 2015 15:16:45 GMT
Lowering it to a few meg didn't make any difference. Also, I am feeding the
kafka topic, several hundred of thousands of records, but the spout stops
fetching after a couple of hundred tuples.

On Fri, Feb 6, 2015 at 8:58 AM, Harsha <storm@harsha.io> wrote:

>  " My fetch and buffer are set to a couple of hundred meg and the max
> spout pending is 1024"
> your fetch.size probably too large as it trying to fetch 200mb of data at
> a time and your topic might not have sufficient data.
>
>
> On Fri, Feb 6, 2015, at 06:03 AM, clay teahouse wrote:
>
> Hi all,
>
> My kafkaspout stops fetching after the first couple of hundred tuples. My
> fetch and buffer are set to a couple of hundred meg and the max spout
> pending is 1024. I don't see anything unusual in the log. Any idea what
> could be the cause?
>
> thanks
> Clay
>
>
>

Mime
View raw message