sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkat Ranganathan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1260) HADOOP_MAPRED_HOME should be defaulted correctly
Date Wed, 18 Dec 2013 20:07:08 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852099#comment-13852099

Venkat Ranganathan commented on SQOOP-1260:

Added a new patch.   I have tested this patch also.  Thanks for the review [~jarcec].  Very
much appreciated.

> HADOOP_MAPRED_HOME should be defaulted correctly
> ------------------------------------------------
>                 Key: SQOOP-1260
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1260
>             Project: Sqoop
>          Issue Type: Bug
>         Environment: Hadoop 2.x
>            Reporter: Venkat Ranganathan
>            Assignee: Venkat Ranganathan
>         Attachments: SQOOP-1260-2.patch, SQOOP-1260.patch
> When running Sqoop on Hadoop 2.x which has been installed using the BigTop layout (with
a custom hadoop-layout.sh),  we run into issues in a setup where only Hadoop and sqoop are
installed with the failure in the compilation of the generated Java file.
> This is because in Sqoop, the HADOOP_MAPRED_HOME is defaulted  to HADOOP_HOME (/usr/lib/hadoop
by default) when the variable is not set.
> This results in the mapreduce libraries not being added to the classpath and hence the
failure.  If we have HBase installed, then we add the HBase classpath which causes the mapreduce
libraries to be brought into the classpath and hence we don't see the issue.   
> We should default HADOOP_MAPRED_HOME to /usr/lib/hadoop-mapreduce (the BigTop default)
if the directory is present else default to HADOOP_HOME

This message was sent by Atlassian JIRA

View raw message