sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Mackrory" <mackror...@gmail.com>
Subject Re: Review Request: SQOOP-796: Unable to use new Hadoop environment variables
Date Wed, 09 Jan 2013 17:39:13 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated Jan. 9, 2013, 5:39 p.m.)

Review request for Sqoop.


Removed changes to Cloudera namespace (my apologies - the patch was originally written during
a global search - I just replaced every occurence of HADOOP_HOME) and fixed 1 style violation
(a line was longer than 80 characters). I have since done more testing and verified that this
also works in YARN clusters with the proper environment.


See JIRA for full description of the problem and solution.

This addresses bug SQOOP-796.

Diffs (updated)

  bin/configure-sqoop ee1dd7b 
  bin/sqoop bc69083 
  conf/sqoop-env-template.sh 0294f17 
  src/docs/man/common-args.txt 129f5d1 
  src/docs/man/sqoop.txt 44b4f4e 
  src/docs/user/common-args.txt 7c69886 
  src/docs/user/help.txt 11b4f0c 
  src/docs/user/tools.txt ce83a24 
  src/java/org/apache/sqoop/SqoopOptions.java 3e0ec3e 
  src/java/org/apache/sqoop/orm/CompilationManager.java 26adcbf 
  src/java/org/apache/sqoop/tool/BaseSqoopTool.java c0221c9 
  src/scripts/run-perftest.sh 2a4ba21 

Diff: https://reviews.apache.org/r/8685/diff/


Performed an import from MySQL on a pre-YARN MapReduce cluster (with HADOOP_HOME set) and
a YARN cluster (with HADOOP_COMMON_HOME and HADOOP_MAPRED_HOME set). Although the YARN cluster
failed, it appears to be after Sqoop has located all of it's dependencies and that the problem
is with my YARN setup.


Sean Mackrory

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message