spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matei Zaharia <matei.zaha...@gmail.com>
Subject Re: Structured Streaming with Kafka Source, does it work??
Date Mon, 07 Nov 2016 02:32:57 GMT
The Kafka source will only appear in 2.0.2 -- see this thread for the current release candidate:
https://lists.apache.org/thread.html/597d630135e9eb3ede54bb0cc0b61a2b57b189588f269a64b58c9243@%3Cdev.spark.apache.org%3E
. You can try that right now if you want from the staging Maven repo shown there. The vote
looks likely to pass so an actual release should hopefully also be out soon.

Matei

> On Nov 6, 2016, at 5:25 PM, shyla deshpande <deshpandeshyla@gmail.com> wrote:
> 
> Hi Jaya!
> 
> Thanks for the reply. Structured streaming works fine for me with socket text stream
. I think structured streaming with kafka source not yet supported.
> 
> Please if anyone has got it working with kafka source, please provide me some sample
code or direction.
> 
> Thanks
> 
> 
> On Sun, Nov 6, 2016 at 5:17 PM, Jayaradha Natarajan <jayaradhaa@gmail.com <mailto:jayaradhaa@gmail.com>>
wrote:
> Shyla!
> 
> Check
> https://databricks.com/blog/2016/07/28/structured-streaming-in-apache-spark.html <https://databricks.com/blog/2016/07/28/structured-streaming-in-apache-spark.html>
> 
> Thanks,
> Jayaradha
> 
> On Sun, Nov 6, 2016 at 5:13 PM, shyla <deshpandeshyla@gmail.com <mailto:deshpandeshyla@gmail.com>>
wrote:
> I am trying to do Structured Streaming with Kafka Source. Please let me know
> where I can find some sample code for this. Thanks
> 
> 
> 
> --
> View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Structured-Streaming-with-Kafka-Source-does-it-work-tp19748.html
<http://apache-spark-developers-list.1001551.n3.nabble.com/Structured-Streaming-with-Kafka-Source-does-it-work-tp19748.html>
> Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
> 
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org <mailto:dev-unsubscribe@spark.apache.org>
> 
> 
> 


Mime
View raw message