spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <kanth...@gmail.com>
Subject Why do we ever run out of memory in Spark Structured Streaming?
Date Wed, 05 Apr 2017 00:17:54 GMT
Why do we ever run out of memory in Spark Structured Streaming especially
when Memory can always spill to disk ? until the disk is full we shouldn't
be out of memory.isn't it? sure thrashing will happen more frequently and
degrades performance but we do we ever run out Memory even in case of
maintaining a state for 6 months or a year?

Thanks!

Mime
View raw message