kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Evelina <stepanova....@gmail.com>
Subject Re: Kafka 0.8 High-Level Consumer: fetcher threads
Date Tue, 17 Dec 2013 06:01:49 GMT
Hi Jun,

Thank you for the quick feedback!
here is the issue https://issues.apache.org/jira/browse/KAFKA-1184

--
Best Regards,
Evelina

On 12/16/2013 08:18 PM, Jun Rao wrote:
> It's possible to support multi-fetchers per broker in the consumer. Could
> you file a jira to track that? However, typically the bottleneck is not in
> the fetcher, but in decompression, decoding and application logic during
> the consumption.
>
> Thanks,
>
> Jun
>
>
> On Mon, Dec 16, 2013 at 7:33 AM, Evelina <stepanova.e.a@gmail.com> wrote:
>
>> Hi folks!
>>
>> I'm trying High-Level Consumer and wondering why it uses only 1 fetcher
>> per broker?
>> Why can't it be scaled on partition basis?
>>
>> I even see the parameter '/numFetchers/' in /AbstractFetcherManager/ but
>> it explicitly set  to 1 in /ConsumerFetcherManager/.
>>
>> --
>> Very Best Regards,
>> Evelina
>>
>>
>>


Mime
View raw message