kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Englert <jengl...@gilt.com>
Subject Re: Consume from X messages ago
Date Tue, 19 Mar 2013 15:25:44 GMT
I'm still a bit lost.  Where is the offsets API?  I.e. which class?


On Tue, Mar 19, 2013 at 11:16 AM, David Arthur <mumrah@gmail.com> wrote:

> Using the Offsets API, you can get the latest offset by setting time to
> -1. Then you subtract 10000
>
> There is no guarantee that 10k prior messages exist of course, so you'd
> need to handle that case.
>
> -David
>
>
> On 3/19/13 11:04 AM, James Englert wrote:
>
>> Hi,
>>
>> I'm using Kafka 0.8.  I would like to setup a consumer to fetch the last
>> 10,000 messages and then start consuming messages.
>>
>> I see the configuration autooffset.reset, but that isn't quite what I
>> want.  I want only the last 10,000 messages.
>>
>> Is there a good way to achieve this in 0.8, besides just hacking the data
>> in ZK?
>>
>> Thanks,
>> Jim
>>
>>
>


-- 
Jim Englert
Gilt Groupe
2 Park Ave South, 5th Floor
New York, NY 10011
M: 847-707-2942
Please accept my invitation to join Gilt:
http://www.giltgroupe.com/invite/jenglert

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message