spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-3801) Make app dir cleanup more efficient
Date Sun, 05 Oct 2014 06:45:34 GMT

    [ https://issues.apache.org/jira/browse/SPARK-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14159458#comment-14159458
] 

Apache Spark commented on SPARK-3801:
-------------------------------------

User 'viirya' has created a pull request for this issue:
https://github.com/apache/spark/pull/2660

> Make app dir cleanup more efficient
> -----------------------------------
>
>                 Key: SPARK-3801
>                 URL: https://issues.apache.org/jira/browse/SPARK-3801
>             Project: Spark
>          Issue Type: Improvement
>            Reporter: Liang-Chi Hsieh
>            Priority: Minor
>
> The newly merged more conservative app directory cleanup can be more efficient. Since
it is not needed to store newer files, using 'exists' instead of 'filter' can be more efficient
because redundant items are skipped.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message