storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsha <st...@harsha.io>
Subject Re: Is Storm 1.0.0 compatible with Kafka 0.8.2.x?
Date Sat, 16 Apr 2016 17:29:26 GMT
John,
I think you are asking if you will be able to run 0.8.2 kafka consumer
in storm 1.0.0 . Yes we are shipping storm-kafka-client which uses the
new consumer api in kafka 0.9.0.1 but storm 1.0.0 still ships with storm-
kafka which uses older consumer api which can work with all versions of
kafka including 0.9.0.1.
 
"I checked out the v1.0.0 tag, changed the kafka version to 0.8.2.1,
and I am getting compile errors in storm-kafka-client. I don't have
a problem fixing the errors, but I want to ensure I am not wasting
my time. :)"
 
You shouldn't be changing kafka version. As I said above Kafka
0.9.0.1 contains two kafka apis new ones which will only works with
0.9.0.1 kafka cluster and old consumer apis which can work 0.8.2.
Even though you compile with 0.9.0.1 version it will work with
0.8.2.1 kafka cluster.
 
Let me know if you have any questions.
 
Thanks,
Harsha
 
 
On Fri, Apr 15, 2016, at 11:39 AM, John Yost wrote:
> Hi Everyone,
> I know that Storm 1.0.0 is designed to work with Kafka 0.9.0.1, but is
> it possible for Storm 1.0.0 to work with 0.8.2.1?
>
> I did some integration testing with 0.9.0.1 client with 0.8.2.1
> broker, which is yucky, and it appears this won't work.
>
> I checked out the v1.0.0 tag, changed the kafka version to 0.8.2.1,
> and I am getting compile errors in storm-kafka-client. I don't have a
> problem fixing the errors, but I want to ensure I am not wasting my
> time. :)
>
> Please confirm if it is anticipated that Storm 1.0.0 can be made
> compatible with Kafka 0.8.2.x--thanks!
> --John
 

Mime
View raw message