spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From anna stax <annasta...@gmail.com>
Subject Re: Spark streaming, Storage tab questions
Date Sun, 09 Jul 2017 23:40:44 GMT
On Sun, Jul 9, 2017 at 4:33 PM, anna stax <annastax80@gmail.com> wrote:

> Does each row represent the state of my app at different time?
>
> When the fraction cached is 90% and the size on Disk is 0, does that mean
> 10% of the data is lost. Its neither in memory now disk?
>
> I am running spark streaming standalone mode, and I am using mapWithState.
> It runs fine for several hours and then fails. So trying to debug what is
> causing it to fail.
>
> Please share your thoughts and experiences.
>
> Thanks
>
>

Mime
View raw message