kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Timothy Chen <tnac...@gmail.com>
Subject Re: Updated kafka client (producer and consumer)
Date Thu, 05 Dec 2013 23:53:58 GMT
>From the roadmap they published it looks like pipelining as part of the
client rewrite is happening post 0.8.

Tim


On Thu, Dec 5, 2013 at 3:52 PM, Tom Brown <tombrown52@gmail.com> wrote:

> In our environment we use currently use Kafka 0.7.1.
>
> The core features I am looking for in a client are this:
>
> 1. Provide confirmation of produce requests (or notification of
> disconnection during requests).
> 2. Uses asynchronous IO so that:
>   A. Multiple ops can be queued/in-flight at once.
>   B. Fetch #2 can be in-flight while fetch #1 is being processed (without
> requiring an extra thread per consumer)
> 3. Allow precise control of offsets (like the SimpleConsumer).
>
> I have been working on a version of the Kafka client that meets those
> requirements. However, I recall hearing talk of rewriting the client. Did
> this happen as part of 0.8.x? If so, how different is it from the 0.7.x
> clients, and how well would it support the requirements listed above?
>
> Thanks in advance!
>
> --Tom
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message