kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "cacsar@gmail.com" <cac...@gmail.com>
Subject Re: 0.8.1 Java Producer API Callbacks
Date Fri, 02 May 2014 05:25:48 GMT
Thanks, that's quite helpful. According to this post,
http://blog.empathybox.com/ , it looks like it will be beta then which
seems good enough. Assuming that the beta designation is correct, is that
because it won't have as many features/the same flexibility as it's
expected to by 0.9?
Christian


On Thu, May 1, 2014 at 9:19 PM, Neha Narkhede <neha.narkhede@gmail.com>wrote:

> The javadoc of the new producer is here for now -
>
> http://empathybox.com/kafka-javadoc/index.html?kafka/clients/producer/KafkaProducer.html
>
> Thanks,
> Neha
>
>
> On Thu, May 1, 2014 at 9:16 PM, Jun Rao <junrao@gmail.com> wrote:
>
> > The new producer (that supports callbacks) is in trunk. It will be
> released
> > in 0.8.2. You can look at the java doc of KafkaProducer for the api.
> >
> > Thanks
> >
> > Jun
> >
> >
> > On Thu, May 1, 2014 at 8:43 PM, Christian Csar <cacsar@gmail.com> wrote:
> >
> > > On 05/01/2014 07:22 PM, Christian Csar wrote:
> > > > I'm looking at using the java producer api for 0.8.1 and I'm slightly
> > > > confused by this passage from section 4.4 of
> > > > https://kafka.apache.org/documentation.html#theproducer
> > > > "Note that as of Kafka 0.8.1 the async producer does not have a
> > > > callback, which could be used to register handlers to catch send
> > errors.
> > > > Adding such callback functionality is proposed for Kafka 0.9, see
> > > > [Proposed Producer
> > > > API](
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite#ClientRewrite-ProposedProducerAPI
> > )
> > > ."
> > > >
> > > > org.apache.kafka.clients.producer.KafkaProducer in 0.8.1 appears to
> > have
> > > > public Future<RecordMetadata> send(ProducerRecord record, Callback
> > > > callback) which looks like the mentioned callback.
> > > >
> > > > How do the callbacks with the async producer? Is it as described in
> the
> > > > comment on the send method (see
> > > >
> > >
> >
> https://github.com/apache/kafka/blob/0.8.1/clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java#L151
> > > > for reference)?
> > > >
> > > > Looking around it seems plausible the language in the documentation
> > > > might refer to a separate sort of callback that existed in 0.7 but
> not
> > > > 0.8. In our use case we have something useful to do if we can detect
> > > > messages failing to be sent.
> > > >
> > > > Christian
> > > >
> > >
> > > It appears that I was looking at the Java client rather than the Scala
> > > java api referenced by the documentation
> > >
> > >
> >
> https://github.com/apache/kafka/blob/0.8.1/core/src/main/scala/kafka/javaapi/producer/Producer.scala
> > >
> > > Are both of these currently suited for use from java and still
> > > supported? Given the support for callbacks in the event of failure I am
> > > inclined to use the Java one despite the currently limited support for
> > > specifying partitioners (though it supports specifying the partition)
> or
> > > encoders.
> > >
> > > Any guidance on this would be appreciated.
> > >
> > > Christian
> > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message