spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From raman gugnani <ramangugnani....@gmail.com>
Subject event log directory(spark-history) filled by large .inprogress files for spark streaming applications
Date Tue, 16 Jul 2019 10:07:58 GMT
HI ,

I have long running spark streaming jobs.
Event log directories are getting filled with .inprogress files.
Is there fix or work around for spark streaming.

There is also one jira raised for the same by one reporter.

https://issues.apache.org/jira/browse/SPARK-22783

-- 
Raman Gugnani

8588892293
Principal Engineer
*ixigo.com <http://ixigo.com>*

Mime
View raw message