flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9633) Flink doesn't use the Savepoint path's filesystem to create the OuptutStream on Task.
Date Mon, 02 Jul 2018 09:50:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529626#comment-16529626
] 

ASF GitHub Bot commented on FLINK-9633:
---------------------------------------

Github user tillrohrmann commented on a diff in the pull request:

    https://github.com/apache/flink/pull/6194#discussion_r199441573
  
    --- Diff: flink-core/src/main/java/org/apache/flink/core/fs/FileSystem.java ---
    @@ -416,6 +417,12 @@ public static FileSystem getUnguardedFileSystem(final URI fsUri)
throws IOExcept
     		}
     	}
     
    +	@VisibleForTesting
    +	public static void setFsFactories(HashMap<String, FileSystemFactory> fsFactories)
{
    --- End diff --
    
    If we change the test into a unit test for the `FsCheckpointStorage`, then we don't need
this method here.


> Flink doesn't use the Savepoint path's filesystem to create the OuptutStream on Task.
> -------------------------------------------------------------------------------------
>
>                 Key: FLINK-9633
>                 URL: https://issues.apache.org/jira/browse/FLINK-9633
>             Project: Flink
>          Issue Type: Bug
>          Components: State Backends, Checkpointing
>    Affects Versions: 1.5.0
>            Reporter: Sihua Zhou
>            Assignee: Sihua Zhou
>            Priority: Critical
>              Labels: pull-request-available
>             Fix For: 1.6.0, 1.5.1
>
>
> Currently, flink use the Savepoint's filesystem to create the meta output stream in CheckpointCoordinator(JM
side), but in StreamTask(TM side) it uses the Checkpoint's filesystem to create the checkpoint
data output stream. When the Savepoint & Checkpoint in different filesystem this will
lead to problematic.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message