Zeppelin keeps the Spark job alive. This is likely a better question for the Zeppelin project.
________________________________
From: Valery Khamenya <khamenya@gmail.com>
Sent: Tuesday, May 1, 2018 4:30:24 AM
To: user@spark.apache.org
Subject: all calculations finished, but "VCores Used" value remains at its max
Hi all
I experience a strange thing: when Spark 2.3.0 calculations started from Zeppelin 0.7.3 are
finished, the "VCores Used" value in resource manager stays at its maximum, albeit nothing
is assumed to be calculated anymore. How come?
if relevant, I experience this issue since AWS EMR 5.13.0
best regards
--
Valery
best regards
--
Valery A.Khamenya
|