spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike Percy <mpe...@apache.org>
Subject Spark streaming on YARN?
Date Fri, 10 Jan 2014 01:29:53 GMT
After looking through the docs, grepping the commit logs and looking on the
list archives, I have been unable to see an indication or example of Spark
streaming working on YARN. Is this possible yet? So far, I've gotten at
least the Spark Pi example to run on YARN with CDH5 beta 1.

I am about to dig into the code and try to figure out how the batch Yarn
client works, to see how much work it would be to set up an AM to run an
InputDStream, but thought I'd make it easy on myself ask here first before
I got started.

Thanks in advance for any pointers,
Mike

Mime
View raw message