[ https://issues.apache.org/jira/browse/SPARK-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14344502#comment-14344502
]
Aaron Davidson commented on SPARK-2545:
---------------------------------------
Probably especially useful there, yes.
> Add a diagnosis mode for closures to figure out what they're bringing in
> ------------------------------------------------------------------------
>
> Key: SPARK-2545
> URL: https://issues.apache.org/jira/browse/SPARK-2545
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Reporter: Aaron Davidson
>
> Today, it's pretty hard to figure out why your closure is bigger than expected, because
it's not obvious what objects are being included or who is including them. We should have
some sort of diagnosis available to users with very large closures that displays the contents
of the closure.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org
|