flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1266) Generalize Flink's DistributedFileSystemClass to a Hadoop FileSystem wrapper
Date Wed, 07 Jan 2015 16:52:34 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267856#comment-14267856

ASF GitHub Bot commented on FLINK-1266:

Github user StephanEwen commented on the pull request:

    This pull request moves the hadoop transitive dependency exclusions to the dependency
management. Have you checked that this works properly? I ran into an issue there a while back
where it did not properly work. Cannot quite recall why, though.

> Generalize Flink's DistributedFileSystemClass to a Hadoop FileSystem wrapper
> ----------------------------------------------------------------------------
>                 Key: FLINK-1266
>                 URL: https://issues.apache.org/jira/browse/FLINK-1266
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Robert Metzger
>            Assignee: Robert Metzger
>            Priority: Minor
> Currently, the Hadoop's DistributedFileSystem class is somewhat hardwired into the Flink
DistributedFileSystem class.
> That is actually not necessary because Flink's DistributedFileSystem class is only assuming
Hadoop's FileSystem class.
> By generalizing the Flink DFS class, we can easily support other file systems implementing
the Hadoop FS class, such as the GoogleHadoopFileSystem, Tachyon and others.

This message was sent by Atlassian JIRA

View raw message