spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Armbrust <mich...@databricks.com>
Subject Re: Hive Query on Spark fails with OOM
Date Mon, 14 Mar 2016 21:01:04 GMT
On Mon, Mar 14, 2016 at 1:30 PM, Prabhu Joseph <prabhujose.gates@gmail.com>
wrote:
>
>     Thanks for the recommendation. But can you share what are the
> improvements made above Spark-1.2.1 and how which specifically handle the
> issue that is observed here.
>

Memory used for query execution is now explicitly accounted for:

https://databricks.com/blog/2015/04/28/project-tungsten-bringing-spark-closer-to-bare-metal.html

Mime
View raw message