spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tobias Pfeiffer <...@preferred.jp>
Subject Re: Kafka client - specify offsets?
Date Mon, 16 Jun 2014 06:27:21 GMT
Hi,

there are apparently helpers to tell you the offsets
<https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example#id-0.8.0SimpleConsumerExample-FindingStartingOffsetforReads>,
but I have no idea how to pass that to the Kafka stream consumer. I am
interested in that as well.

Tobias

On Thu, Jun 12, 2014 at 5:53 AM, Michael Campbell
<michael.campbell@gmail.com> wrote:
> Is there a way in the Apache Spark Kafka Utils to specify an offset to start
> reading?  Specifically, from the start of the queue, or failing that, a
> specific point?

Mime
View raw message