flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1266) Generalize Flink's DistributedFileSystemClass to a Hadoop FileSystem wrapper
Date Wed, 07 Jan 2015 16:52:34 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267856#comment-14267856
] 

ASF GitHub Bot commented on FLINK-1266:
---------------------------------------

Github user StephanEwen commented on the pull request:

    https://github.com/apache/flink/pull/268#issuecomment-69051630
  
    This pull request moves the hadoop transitive dependency exclusions to the dependency
management. Have you checked that this works properly? I ran into an issue there a while back
where it did not properly work. Cannot quite recall why, though.


> Generalize Flink's DistributedFileSystemClass to a Hadoop FileSystem wrapper
> ----------------------------------------------------------------------------
>
>                 Key: FLINK-1266
>                 URL: https://issues.apache.org/jira/browse/FLINK-1266
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Robert Metzger
>            Assignee: Robert Metzger
>            Priority: Minor
>
> Currently, the Hadoop's DistributedFileSystem class is somewhat hardwired into the Flink
DistributedFileSystem class.
> That is actually not necessary because Flink's DistributedFileSystem class is only assuming
Hadoop's FileSystem class.
> By generalizing the Flink DFS class, we can easily support other file systems implementing
the Hadoop FS class, such as the GoogleHadoopFileSystem, Tachyon and others.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message