spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dean Wampler <deanwamp...@gmail.com>
Subject Re: Akka with Spark
Date Sun, 27 Dec 2015 03:01:21 GMT
Note that Akka is being removed from Spark. Even if it weren't, I would
consider keeping Akka processes separate from Spark processes, so you can
monitor, debug, and scale them independently. So consider streaming data
from Akka to Spark Streaming or go the other way, from Spark to Akka
Streams.

dean

Dean Wampler, Ph.D.
Author: Programming Scala, 2nd Edition
<http://shop.oreilly.com/product/0636920033073.do> (O'Reilly)
Typesafe <http://typesafe.com>
@deanwampler <http://twitter.com/deanwampler>
http://polyglotprogramming.com

On Sat, Dec 26, 2015 at 12:54 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> Do you mind sharing your use case ?
>
> It may be possible to use a different approach than Akka.
>
> Cheers
>
> On Sat, Dec 26, 2015 at 10:08 AM, Disha Shrivastava <dishu.905@gmail.com>
> wrote:
>
>> Hi,
>>
>> I wanted to know how to use Akka framework with Spark starting from
>> basics. I saw online that Spark uses Akka framework but I am not really
>> sure if I can define Actors and use it in Spark.
>>
>> Also, how to integrate Akka with Spark as in how will I know how many
>> Akka actors are running on each of my worker machines? Can I control that?
>>
>> Please help. The only useful resource which I could find online was Akka
>> with Spark Streaming which was also not very clear.
>>
>> Thanks,
>>
>> Disha
>>
>
>

Mime
View raw message