spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject Re: Akka Stream as the source for Spark Streaming. Please advice...
Date Sat, 12 Nov 2016 16:42:10 GMT
Hi Luciano,

Mind sharing why to have a structured streaming source/sink for Akka
if Kafka's available and Akka Streams has a Kafka module? #curious

Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark 2.0 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski


On Sat, Nov 12, 2016 at 4:07 PM, Luciano Resende <luckbr1975@gmail.com> wrote:
> If you are interested in Akka streaming, it is being maintained in Apache
> Bahir. For Akka there isn't a structured streaming version yet, but we would
> be interested in collaborating in the structured streaming version for sure.
>
> On Thu, Nov 10, 2016 at 8:46 AM shyla deshpande <deshpandeshyla@gmail.com>
> wrote:
>>
>> I am using Spark 2.0.1. I wanted to build a data pipeline using Kafka,
>> Spark Streaming and Cassandra using Structured Streaming. But the kafka
>> source support for Structured Streaming is not yet available. So now I am
>> trying to use Akka Stream as the source to Spark Streaming.
>>
>> Want to make sure I am heading in the right direction. Please direct me to
>> any sample code and reading material for this.
>>
>> Thanks
>>
> --
> Sent from my Mobile device

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message