hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-9150) Unnecessary DNS resolution attempts for logical URIs
Date Mon, 17 Dec 2012 18:56:22 GMT
Todd Lipcon created HADOOP-9150:

             Summary: Unnecessary DNS resolution attempts for logical URIs
                 Key: HADOOP-9150
                 URL: https://issues.apache.org/jira/browse/HADOOP-9150
             Project: Hadoop Common
          Issue Type: Bug
          Components: ha
    Affects Versions: 2.0.2-alpha, 3.0.0
            Reporter: Todd Lipcon
            Priority: Critical

In the FileSystem code, we accidentally try to DNS-resolve the logical name before it is converted
to an actual domain name. In some DNS setups, this can cause a big slowdown - eg in one misconfigured
cluster we saw a 2-3x drop in terasort throughput, since every task wasted a lot of time waiting
for slow "not found" responses from DNS.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message