spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kuchekar <>
Subject Spark UI shows Jobs are processing, but the files are already written to S3
Date Wed, 16 Nov 2016 18:00:25 GMT

     I am running a spark job, which saves the computed data (massive data)
to S3. On  the Spark Ui I see the some jobs are active, but no activity in
the logs. Also on S3 all the data has be written (verified each bucket -->
it has _SUCCESS file)

Am I missing something?

Kuchekar, Nilesh

View raw message