flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Till Rohrmann (Jira)" <j...@apache.org>
Subject [jira] [Created] (FLINK-15806) Update recommended way to shut down detached Yarn session cluster
Date Wed, 29 Jan 2020 14:20:00 GMT
Till Rohrmann created FLINK-15806:
-------------------------------------

             Summary: Update recommended way to shut down detached Yarn session cluster
                 Key: FLINK-15806
                 URL: https://issues.apache.org/jira/browse/FLINK-15806
             Project: Flink
          Issue Type: Improvement
          Components: Deployment / YARN
    Affects Versions: 1.10.0
            Reporter: Till Rohrmann
             Fix For: 1.11.0, 1.10.1


When starting a Yarn session cluster in detached mode, then it is printed that one should
shut down the cluster via {{yarn application -kill}}. The problem of this approach is, however,
that temporary files won't be cleaned up which remain on HDFS. Hence, I think a better way
would be to reconnect via the {{yarn-session.sh}} tool and then to stop the cluster gracefully.
This won't leave orphaned files behind.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message