spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kuchekar <kuchekar.nil...@gmail.com>
Subject Spark UI shows Jobs are processing, but the files are already written to S3
Date Wed, 16 Nov 2016 18:00:25 GMT
Hi,

     I am running a spark job, which saves the computed data (massive data)
to S3. On  the Spark Ui I see the some jobs are active, but no activity in
the logs. Also on S3 all the data has be written (verified each bucket -->
it has _SUCCESS file)

Am I missing something?

Thanks.
Kuchekar, Nilesh

Mime
View raw message