spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hao Ren <inv...@gmail.com>
Subject [Streaming] textFileStream has no events shown in web UI
Date Wed, 16 Mar 2016 10:51:07 GMT
Just a quick question,

When using textFileStream, I did not see any events via web UI.
Actually, I am uploading files to s3 every 5 seconds,
And the mini-batch duration is 30 seconds.
On web ui,:

 *Input Rate*
Avg: 0.00 events/sec

But the schedule time and processing time are correct, and the output of
the steam is also correct. Not sure why web ui has not detected any events.

Thank you.

-- 
Hao Ren

Data Engineer @ leboncoin

Paris, France

Mime
View raw message