spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vinoo Ganesh <>
Subject Closing a SparkSession stops the SparkContext
Date Tue, 02 Apr 2019 14:44:50 GMT
Hi All -
   I’ve been digging into the code and looking into what appears to be a memory leak (
and have noticed something kind of peculiar about the way closing a SparkSession is handled.
Despite being marked as Closeable, closing/stopping a SparkSession simply stops the SparkContext.
This changed happened as a result of one of the PRs addressing

I’m trying to understand why this is the intended behavior – anyone have any knowledge
of why this is the case?

View raw message