spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Senthil Kumar <senthilec...@gmail.com>
Subject Spark SQL DataFrame to Kafka Topic
Date Fri, 13 Jan 2017 11:32:09 GMT
Hi Team ,

     Sorry if this question already asked in this forum..

Can we ingest data to Apache Kafka Topic from Spark SQL DataFrame ??

Here is my Code which Reads Parquet File :

*val sqlContext = new org.apache.spark.sql.SQLContext(sc);*

*val df = sqlContext.read.parquet("..../temp/*.parquet")*

*df.registerTempTable("beacons")*


I want to directly ingest df DataFrame to Kafka ! Is there any way to
achieve this ??


Cheers,

Senthil

Mime
View raw message