hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adam Antal (Jira)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-7263) Remove obsolete validateTargetPath() from FrameworkUploader
Date Mon, 10 Feb 2020 09:51:00 GMT
Adam Antal created MAPREDUCE-7263:

             Summary: Remove obsolete validateTargetPath() from FrameworkUploader
                 Key: MAPREDUCE-7263
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7263
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: mrv2
    Affects Versions: 3.2.1
            Reporter: Adam Antal
            Assignee: Adam Antal

The following piece of code has been in the FrameworkUploader class for a while:
  private void validateTargetPath() throws UploaderException {
    if (!target.startsWith("hdfs:/") &&
        !target.startsWith("file:/")) {
      throw new UploaderException("Target path is not hdfs or local " + target);

As parts of MR and YARN has evolved, you can run YARN with OzoneFS as storage for instance
- so HDFS (or local) is not a requirement anymore. Also it does not make sense to add other
suitable filesystems when they're tested against the MR framework, so I'm suggesting to remove
the check.

This message was sent by Atlassian Jira

To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org

View raw message