spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chanwit Kaewkasi <chan...@gmail.com>
Subject Spark to utilize HDFS's mmap caching
Date Thu, 08 May 2014 11:43:17 GMT
Hi all,

Can Spark (0.9.x) utilize the caching feature in HDFS 2.3 via
sc.textFile() and other HDFS-related APIs?

http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html

Best regards,

-chanwit

--
Chanwit Kaewkasi
linkedin.com/in/chanwit

Mime
View raw message