hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sangjin Lee (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-12747) support wildcard in libjars argument
Date Thu, 28 Jan 2016 18:47:39 GMT
Sangjin Lee created HADOOP-12747:

             Summary: support wildcard in libjars argument
                 Key: HADOOP-12747
                 URL: https://issues.apache.org/jira/browse/HADOOP-12747
             Project: Hadoop Common
          Issue Type: New Feature
          Components: util
            Reporter: Sangjin Lee
            Assignee: Sangjin Lee

There is a problem when a user job adds too many dependency jars in their command line. The
HADOOP_CLASSPATH part can be addressed, including using wildcards (\*). But the same cannot
be done with the -libjars argument. Today it takes only fully specified file paths.

We may want to consider supporting wildcards as a way to help users in this situation. The
idea is to handle it the same way the JVM does it: \* expands to the list of jars in that
directory. It does not traverse into any child directory.

Also, it probably would be a good idea to do it only for libjars (i.e. don't do it for -files
and -archives).

This message was sent by Atlassian JIRA

View raw message