kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eno Thereska <eno.there...@gmail.com>
Subject Re: Kafka Streams input
Date Thu, 04 Aug 2016 16:25:40 GMT
Hi Jeyhun,

You can use Kafka Connect to bring data into Kafka from HDFS then use Kafka Streams as usual.
I believe there is a desire to make the Connect + Streams more integrated so it doesn't feel
like you're running two different things, and hopefully that integration happens soon. 


> On 4 Aug 2016, at 17:11, Jeyhun Karimov <je.karimov@gmail.com> wrote:
> Hi community,
> Can Kafka Streams use input sources other than Kafka? For example can it
> read data from HDFS? You can assume that for each Streams instance
> initiating, I will have separate  partition (in this case file path
> containing data) and each instance will read from one file path.
> Cheers
> Jeyhun
> -- 
> -Cheers
> Jeyhun

View raw message