flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Flink Jira Bot (Jira)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-10954) Hardlink from files of previous local stored state might cross devices
Date Thu, 27 May 2021 23:04:03 GMT

     [ https://issues.apache.org/jira/browse/FLINK-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Flink Jira Bot updated FLINK-10954:
-----------------------------------
    Labels: stale-assigned  (was: )

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community
manage its development. I see this issue is assigned but has not received an update in 14,
so it has been labeled "stale-assigned".
If you are still working on the issue, please remove the label and add a comment updating
the community on your progress.  If this issue is waiting on feedback, please consider this
a reminder to the committer/reviewer. Flink is a very active project, and so we appreciate
your patience.
If you are no longer working on the issue, please unassign yourself so someone else may work
on it. If the "warning_label" label is not removed in 7 days, the issue will be automatically
unassigned.


> Hardlink from files of previous local stored state might cross devices
> ----------------------------------------------------------------------
>
>                 Key: FLINK-10954
>                 URL: https://issues.apache.org/jira/browse/FLINK-10954
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / State Backends
>    Affects Versions: 1.6.2
>            Reporter: Yun Tang
>            Assignee: Yun Tang
>            Priority: Critical
>              Labels: stale-assigned
>
> Currently, local recovery's base directories is initialized from '{{io.tmp.dirs}}' if
parameter '{{taskmanager.state.local.root-dirs}}' is not set. For Yarn environment, the tmp
dirs is replaced by its '{{LOCAL_DIRS}}', which might consist of directories from different
devices, such as /dump/1/nm-local-dir, /dump/2/nm-local-dir. The local directory for RocksDB
is initialized from IOManager's spillingDirectories, which might located in different device
from local recovery's folder. However, hard-link between different devices is not allowed,
it will throw exception below:
> {code:java}
> java.nio.file.FileSystemException: target -> souce: Invalid cross-device link
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message