hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xi Fang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5224) JobTracker should allow the system directory to be in non-default FS
Date Wed, 08 May 2013 18:43:16 GMT
Xi Fang created MAPREDUCE-5224:
----------------------------------

             Summary: JobTracker should allow the system directory to be in non-default FS
                 Key: MAPREDUCE-5224
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5224
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobtracker
            Reporter: Xi Fang
            Assignee: Xi Fang
            Priority: Minor
             Fix For: 1-win


JobTracker today expects the system directory to be in the default file system
        if (fs == null) {
          fs = mrOwner.doAs(new PrivilegedExceptionAction<FileSystem>() {
            public FileSystem run() throws IOException {
              return FileSystem.get(conf);
          }});
        }


...

  public String getSystemDir() {
    Path sysDir = new Path(conf.get("mapred.system.dir", "/tmp/hadoop/mapred/system"));  
    return fs.makeQualified(sysDir).toString();
  }
In Cloud like Azure the default file system is set as ASV (Windows Azure Blob Storage), but
we would still like the system directory to be in DFS. We should change JobTracker to allow
that.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message