spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Devl Devel <devl.developm...@gmail.com>
Subject Integration with Apache Ignite
Date Fri, 10 Apr 2015 12:21:48 GMT
Hi

Having evaluated the ignite project and it's relationship to spark: Ignite
vs. Spark

https://wiki.apache.org/incubator/IgniteProposal

The scope of the project are defined. However are there any current or
future projects planned to have an Ignite file system RDD (like the Hadoop
RDD) so that Spark can leverage the in-memory file system as an
alternative/complement to Tachyon for example?

The idea being to use MLLib and other Spark components but with the option
to use ignite fs.

I'm not an expert on Ignite FS but would appreciate any comments on the
matter.

Thanks

Devl

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message