flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1236) Add support for localization of Hadoop Input Splits
Date Tue, 06 Jan 2015 12:14:34 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266030#comment-14266030

ASF GitHub Bot commented on FLINK-1236:

Github user StephanEwen commented on the pull request:

    Will merge this now...

> Add support for localization of Hadoop Input Splits
> ---------------------------------------------------
>                 Key: FLINK-1236
>                 URL: https://issues.apache.org/jira/browse/FLINK-1236
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Robert Metzger
>            Assignee: Fabian Hueske
>            Priority: Minor
>              Labels: starter
>   Original Estimate: 2h
>  Remaining Estimate: 2h
> Flink is currently not localizing splits created by Hadoop Input formats.
> The getInputSplitAssigner() of the HadoopInputFormat is returning the DefaultInputSplitAssigner
instead of the LocatableInputSplitAssigner().
> It should be possible to make the HadoopInputSplit a LocatableInputSplit, because Hadoop's
InputSplit also contains the hostnames, for exactly this purpose.

This message was sent by Atlassian JIRA

View raw message