spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Feng Gui (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-19779) structured streaming exist residual tmp file
Date Wed, 01 Mar 2017 04:50:46 GMT
Feng Gui created SPARK-19779:
--------------------------------

             Summary: structured streaming exist residual tmp file 
                 Key: SPARK-19779
                 URL: https://issues.apache.org/jira/browse/SPARK-19779
             Project: Spark
          Issue Type: Bug
          Components: Structured Streaming
    Affects Versions: 2.1.0
            Reporter: Feng Gui
            Priority: Minor


The PR (https://github.com/apache/spark/pull/17012) can to fix restart a Structured Streaming
application using hdfs as fileSystem, but that exist an problem that an tmp file of delta
file is still reserved in hdfs. And Structured Streaming don't delete the tmp file which generated
when restart streaming job.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message