spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: StorageLevel: OFF_HEAP
Date Wed, 18 Mar 2015 02:24:04 GMT
Ranga:
Take a look at https://github.com/apache/spark/pull/4867

Cheers

On Tue, Mar 17, 2015 at 6:08 PM, fightfate@163.com <fightfate@163.com>
wrote:

> Hi, Ranga
>
> That's true. Typically a version mis-match issue. Note that spark 1.2.1
> has tachyon built in with version 0.5.0 , I think you may need to rebuild
> spark
> with your current tachyon release.
> We had used tachyon for several of our spark projects in a production
> environment.
>
> Thanks,
> Sun.
>
> ------------------------------
> fightfate@163.com
>
>
> *From:* Ranga <sranga@gmail.com>
> *Date:* 2015-03-18 06:45
> *To:* user@spark.apache.org
> *Subject:* StorageLevel: OFF_HEAP
> Hi
>
> I am trying to use the OFF_HEAP storage level in my Spark (1.2.1) cluster.
> The Tachyon (0.6.0-SNAPSHOT) nodes seem to be up and running. However, when
> I try to persist the RDD, I get the following error:
>
> ERROR [2015-03-16 22:22:54,017] ({Executor task launch worker-0}
> TachyonFS.java[connect]:364)  - Invalid method name:
> 'getUserUnderfsTempFolder'
> ERROR [2015-03-16 22:22:54,050] ({Executor task launch worker-0}
> TachyonFS.java[getFileId]:1020)  - Invalid method name: 'user_getFileId'
>
> Is this because of a version mis-match?
>
> On a different note, I was wondering if Tachyon has been used in a
> production environment by anybody in this group?
>
> Appreciate your help with this.
>
>
> - Ranga
>
>

Mime
View raw message