spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yogesh Mahajan <ymaha...@snappydata.io>
Subject Re: [Streaming] textFileStream has no events shown in web UI
Date Mon, 11 Apr 2016 18:10:56 GMT
Yes, this has observed in my case also. The Input Rate is 0 even in case of
rawSocketStream.
Is there a way we can enable the Input Rate for these types of streams ?

Thanks,
http://www.snappydata.io/blog <http://snappydata.io>

On Wed, Mar 16, 2016 at 4:21 PM, Hao Ren <invkrh@gmail.com> wrote:

> Just a quick question,
>
> When using textFileStream, I did not see any events via web UI.
> Actually, I am uploading files to s3 every 5 seconds,
> And the mini-batch duration is 30 seconds.
> On web ui,:
>
>  *Input Rate*
> Avg: 0.00 events/sec
>
> But the schedule time and processing time are correct, and the output of
> the steam is also correct. Not sure why web ui has not detected any events.
>
> Thank you.
>
> --
> Hao Ren
>
> Data Engineer @ leboncoin
>
> Paris, France
>

Mime
View raw message