storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From hokiege...@gmail.com
Subject Re: Is Storm 1.0.0 compatible with Kafka 0.8.2.x?
Date Sun, 17 Apr 2016 02:49:54 GMT
Awesome, thanks Harsha!

--John 

Sent from my iPhone

> On Apr 16, 2016, at 1:28 PM, Harsha <mail@harsha.io> wrote:
> 
> John,
>             I think you are asking if you will be able to run 0.8.2 kafka consumer in
storm 1.0.0 . Yes we are shipping storm-kafka-client which uses the new consumer api in kafka
0.9.0.1 but storm 1.0.0 still ships with storm-kafka which uses older consumer api which can
work with all versions of kafka including 0.9.0.1. 
>  
> "I checked out the v1.0.0 tag, changed the kafka version to 0.8.2.1, and I am getting
compile errors in storm-kafka-client. I don't have a problem fixing the errors, but I want
to ensure I am not wasting my time. :)"
>  
> You shouldn't be changing kafka version. As I said above Kafka 0.9.0.1 contains two kafka
apis new ones which will only works with 0.9.0.1 kafka cluster and old consumer apis which
can work 0.8.2. Even though you compile with 0.9.0.1 version it will work with 0.8.2.1 kafka
cluster.
>  
> Let me know if you have any questions.
>  
> Thanks,
> Harsha
>  
>> On Fri, Apr 15, 2016, at 11:39 AM, John Yost wrote:
>> Hi Everyone,
>> I know that Storm 1.0.0 is designed to work with Kafka 0.9.0.1, but is it possible
for Storm 1.0.0 to work with 0.8.2.1? 
>>  
>> I did some integration testing with 0.9.0.1 client with 0.8.2.1 broker, which is
yucky, and it appears this won't work.
>>  
>> I checked out the v1.0.0 tag, changed the kafka version to 0.8.2.1, and I am getting
compile errors in storm-kafka-client. I don't have a problem fixing the errors, but I want
to ensure I am not wasting my time. :)
>>  
>> Please confirm if it is anticipated that Storm 1.0.0 can be made compatible with
Kafka 0.8.2.x--thanks! 
>> --John
>  

Mime
View raw message