flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Felix seibert (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-12550) hostnames with a dot never receive local input splits
Date Sat, 18 May 2019 15:59:00 GMT
Felix seibert created FLINK-12550:

             Summary: hostnames with a dot never receive local input splits
                 Key: FLINK-12550
                 URL: https://issues.apache.org/jira/browse/FLINK-12550
             Project: Flink
          Issue Type: Bug
          Components: API / DataSet
    Affects Versions: 1.8.0
            Reporter: Felix seibert

LocatableInputSplitAssigner (in package api.common.io) fails to assign local input splits
to hosts whose hostname contains a dot ("."). To reproduce add the following test to LocatableSplitAssignerTest
and execute it. It will always fail. In my mind, this is contrary to the expected behaviour,
which is that the host should obtain the one split that is stored on the very same machine.

public void testLocalSplitAssignmentForHostWithDomainName() {
   try {
      String hostNameWithDot = "testhost.testdomain";

      // load one split
      Set<LocatableInputSplit> splits = new HashSet<LocatableInputSplit>();
      splits.add(new LocatableInputSplit(0, hostNameWithDot));

      // get all available splits
      LocatableInputSplitAssigner ia = new LocatableInputSplitAssigner(splits);
      InputSplit is = null;
      ia.getNextInputSplit(hostNameWithDot, 0);

      assertEquals(0, ia.getNumberOfRemoteAssignments());
      assertEquals(1, ia.getNumberOfLocalAssignments());
   catch (Exception e) {
I also experienced this error in practice, and will later today open a pull request to fix


Note: I'm not sure if I selected the correct component category.


This message was sent by Atlassian JIRA

View raw message