kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Stevenson <and...@datamountaineer.com>
Subject Re: Kafka and spark integration
Date Fri, 28 Oct 2016 07:52:09 GMT

Spark has a Kafka Integration, if you want to write data from Kafka to HDFS use the HDFS Kafka
Connect Sink from Confluent.

On 27/10/2016, 03:37, "Mohan Nani" <mohan.25feb86@gmail.com> wrote:

    Any body know the end to end hadoop data flow  which has Kafka - spark
    I am primarily concerned on how kafka messages written to kafka partition
    gets captured into files?

View raw message