[ https://issues.apache.org/jira/browse/SPARK-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14159561#comment-14159561
]
Liang-Chi Hsieh commented on SPARK-3801:
----------------------------------------
I think so. Thanks.
> Make app dir cleanup more efficient
> -----------------------------------
>
> Key: SPARK-3801
> URL: https://issues.apache.org/jira/browse/SPARK-3801
> Project: Spark
> Issue Type: Improvement
> Reporter: Liang-Chi Hsieh
> Priority: Minor
>
> The newly merged more conservative app directory cleanup can be more efficient. Since
it is not needed to store newer files, using 'exists' instead of 'filter' can be more efficient
because redundant items are skipped.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org
|