spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Davidson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-2545) Add a diagnosis mode for closures to figure out what they're bringing in
Date Tue, 03 Mar 2015 04:40:04 GMT

    [ https://issues.apache.org/jira/browse/SPARK-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14344502#comment-14344502
] 

Aaron Davidson commented on SPARK-2545:
---------------------------------------

Probably especially useful there, yes.

> Add a diagnosis mode for closures to figure out what they're bringing in
> ------------------------------------------------------------------------
>
>                 Key: SPARK-2545
>                 URL: https://issues.apache.org/jira/browse/SPARK-2545
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>            Reporter: Aaron Davidson
>
> Today, it's pretty hard to figure out why your closure is bigger than expected, because
it's not obvious what objects are being included or who is including them. We should have
some sort of diagnosis available to users with very large closures that displays the contents
of the closure.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message