spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From RongGu <...@git.apache.org>
Subject [GitHub] incubator-spark pull request: Adding an option to persist Spark RD...
Date Sun, 16 Feb 2014 12:34:34 GMT
Github user RongGu commented on the pull request:

    https://github.com/apache/incubator-spark/pull/468#issuecomment-35195633
  
    Hey @mateiz, thanks for reviewing the code. I read your comment about the directory's
name on tachyon. Yes, your concern about the driver's directory name is right. We indeed need
a unique top-level directory name here. The reason why I made each executor's directory name
to be the appID is to make it better to be shared across SparkContexts in our future plan.
I will follow the directory organization of your solution  at our current stage.



If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. To do so, please top-post your response.
If your project does not have this feature enabled and wishes so, or if the
feature is enabled but not working, please contact infrastructure at
infrastructure@apache.org or file a JIRA ticket with INFRA.

Mime
View raw message