spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yin Huai <yh...@databricks.com>
Subject Re: Spark SQL ExternalSorter not stopped
Date Fri, 20 Mar 2015 21:00:27 GMT
Hi Michael,

Thanks for reporting it. Yes, it is a bug. I have created
https://issues.apache.org/jira/browse/SPARK-6437 to track it.

Thanks,

Yin

On Thu, Mar 19, 2015 at 10:51 AM, Michael Allman <michael@videoamp.com>
wrote:

> I've examined the experimental support for ExternalSorter in Spark SQL,
> and it does not appear that the external sorted is ever stopped
> (ExternalSorter.stop). According to the API documentation, this suggests a
> resource leak. Before I file a bug report in Jira, can someone familiar
> with the codebase confirm this is indeed a bug?
>
> Thanks,
>
> Michael
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message