spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "fightfate@163.com" <fightf...@163.com>
Subject Re: StorageLevel: OFF_HEAP
Date Wed, 18 Mar 2015 01:08:23 GMT
Hi, Ranga

That's true. Typically a version mis-match issue. Note that spark 1.2.1 has tachyon built
in with version 0.5.0 , I think you may need to rebuild spark 
with your current tachyon release. 
We had used tachyon for several of our spark projects in a production environment. 

Thanks,
Sun.



fightfate@163.com
 
From: Ranga
Date: 2015-03-18 06:45
To: user@spark.apache.org
Subject: StorageLevel: OFF_HEAP
Hi

I am trying to use the OFF_HEAP storage level in my Spark (1.2.1) cluster. The Tachyon (0.6.0-SNAPSHOT)
nodes seem to be up and running. However, when I try to persist the RDD, I get the following
error:

ERROR [2015-03-16 22:22:54,017] ({Executor task launch worker-0} TachyonFS.java[connect]:364)
 - Invalid method name: 'getUserUnderfsTempFolder'
ERROR [2015-03-16 22:22:54,050] ({Executor task launch worker-0} TachyonFS.java[getFileId]:1020)
 - Invalid method name: 'user_getFileId'

Is this because of a version mis-match? 

On a different note, I was wondering if Tachyon has been used in a production environment
by anybody in this group? 

Appreciate your help with this.


- Ranga
Mime
View raw message