flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1266) Generalize Flink's DistributedFileSystemClass to a Hadoop FileSystem wrapper
Date Thu, 08 Jan 2015 10:16:34 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14269132#comment-14269132

ASF GitHub Bot commented on FLINK-1266:

Github user rmetzger commented on the pull request:

    Update: I fixed a major bug with the "2.0.0-alpha" version on the `master`.
    Currently, the master does not do any dependency exclusions for hadoop. This causes stuff
like two asm versions in the lib path.
    I also verified that the dependency exclusions in the `dependencyManagement` section are
working. (Its also in the official maven documentation .. so it should work).

> Generalize Flink's DistributedFileSystemClass to a Hadoop FileSystem wrapper
> ----------------------------------------------------------------------------
>                 Key: FLINK-1266
>                 URL: https://issues.apache.org/jira/browse/FLINK-1266
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Robert Metzger
>            Assignee: Robert Metzger
>            Priority: Minor
> Currently, the Hadoop's DistributedFileSystem class is somewhat hardwired into the Flink
DistributedFileSystem class.
> That is actually not necessary because Flink's DistributedFileSystem class is only assuming
Hadoop's FileSystem class.
> By generalizing the Flink DFS class, we can easily support other file systems implementing
the Hadoop FS class, such as the GoogleHadoopFileSystem, Tachyon and others.

This message was sent by Atlassian JIRA

View raw message