spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Diwakar Dhanuskodi <diwakar.dhanusk...@gmail.com>
Subject KafkaUtils.createStream not picking smallest offset
Date Fri, 12 Aug 2016 08:35:02 GMT

Hi,
We are  using  spark  1.6.1 and  kafka 0.9.

KafkaUtils.createStream is  showing strange behaviour. Though  auto.offset.reset is  set
 to  smallest .  Whenever we  need  to  restart  the  stream it  is  picking up
 the  latest  offset which  is not  expected.
Do  we  need  to  set  any  other  properties ?.

createDirectStream works fine  in  this  above  case.


Sent from Samsung Mobile.
Mime
View raw message