Feng Gui created SPARK-19779:
--------------------------------
Summary: structured streaming exist residual tmp file
Key: SPARK-19779
URL: https://issues.apache.org/jira/browse/SPARK-19779
Project: Spark
Issue Type: Bug
Components: Structured Streaming
Affects Versions: 2.1.0
Reporter: Feng Gui
Priority: Minor
The PR (https://github.com/apache/spark/pull/17012) can to fix restart a Structured Streaming
application using hdfs as fileSystem, but that exist an problem that an tmp file of delta
file is still reserved in hdfs. And Structured Streaming don't delete the tmp file which generated
when restart streaming job.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org
|