sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Omkar Joshi <Omkar.Jo...@lntinfotech.com>
Subject Weird issue during HBase import
Date Tue, 10 Sep 2013 07:05:41 GMT
I have used Sqoop several times before but now I'm facing a weird issue on a 3-node Hadoop/Hbase
cluster.
The .bashrc/.profile file entries are as follows :
export HADOOP_HOME=/home/bigdata/hadoop-1.0.2

# Set JAVA_HOME
export JAVA_HOME=/home/bigdata/jdk1.7.0_21
export PATH=$PATH:$JAVA_HOME/bin

# Add Hadoop bin/ directory to PATH
export PATH=$PATH:$HADOOP_HOME/bin
export HADOOP_CONF_DIR=/home/bigdata/hdconf

#HBase
export HBASE_HOME=/home/bigdata/hadoop_ecosystem/apache_hbase/hbase-0.94.11
export PATH=$PATH:$HBASE_HOME/bin

export SQOOP_HOME=/home/bigdata/hadoop_ecosystem/apache_sqoop/sqoop-1.4.3.bin__hadoop-1.0.0
export PATH=$PATH:$SQOOP_HOME/bin
But when I try to import a MySQL table in HBase, I get this :
bigdata@cldx-1230-1116:~$ sqoop import --connect jdbc:mysql://172.17.89.231/sentimizer_user_db
--username root --password root --table nounphrasesentries --hbase-table nounphrasesentries
--column-family word_attributes --hbase-create-table -m 1
Warning: $HADOOP_HOME is deprecated.

13/09/10 17:09:28 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure.
Consider using -P instead.
13/09/10 17:09:29 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
13/09/10 17:09:29 INFO tool.CodeGenTool: Beginning code generation
13/09/10 17:09:32 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `nounphrasesentries`
AS t LIMIT 1
13/09/10 17:09:32 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `nounphrasesentries`
AS t LIMIT 1
13/09/10 17:09:32 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /home/bigdata/hadoop-1.0.2
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/activemq-core-5.6.0.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/apache-mime4j-core-0.7.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/apache-mime4j-dom-0.7.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/asm-3.1.jar; cannot read zip
file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/boilerpipe-1.1.0.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/commons-beanutils-1.8.0.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/commons-collections-2.1.1.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/commons-compress-1.3.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/commons-dbcp-1.4.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/commons-fileupload-1.2.1.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/commons-io-1.3.2.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/commons-javaflow-20060411.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/commons-logging-1.1.1.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/freemarker-2.3.15.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/geronimo-stax-api_1.0_spec-1.0.1.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/gson-2.2.2.jar; cannot read
zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/gson-2.2.2-javadoc.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/gson-2.2.2-sources.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/httpclient-4.1.2.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/httpcore-4.1.4.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/itextpdf-5.1.0.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/j2ee-1.4.jar; cannot read zip
file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/jaws-bin.jar; cannot read zip
file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/jcommon-1.0.15.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/je-4.0.92.jar; cannot read
zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/jfreechart-1.0.0-rc1.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/jfreechart-1.0.12.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/jgraph.jar; cannot read zip
file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/jsapi.jar; cannot read zip
file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/jsch-0.1.49.jar; cannot read
zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/js.jar; cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/junit.jar; cannot read zip
file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/lingpipe-4.1.0.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/lucene-analyzers-3.1.0.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/lucene-core-3.6.0.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/metadata-extractor-2.4.0-beta-1.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/mysql-connector-java-5.0.8-bin.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/ognl-2.6.11.jar; cannot read
zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/opennlp-maxent-3.0.2-incubating.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/opennlp-tools-1.5.2-incubating.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/opennlp-uima-1.5.2-incubating.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/poi-ooxml-3.6.jar; cannot read
zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/signpost-core-1.1-SNAPSHOT.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/sphinx4.jar; cannot read zip
file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/StemIt.jar; cannot read zip
file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/struts-1.2.7.jar; cannot read
zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/svnant.jar; cannot read zip
file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/svnClientAdapter.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/tagsoup-1.2.1.jar; cannot read
zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/tagsoup-1.2.jar; cannot read
zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/TGGraphLayout.jar; cannot read
zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/tika-core-0.10.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/tika-core-1.0.jar; cannot read
zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/tika-parsers-0.10.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/tika-parsers-1.0.jar; cannot
read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/WSJ_8gau_13dCep_16k_40mel_130Hz_6800Hz.jar;
cannot read zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/xmlunit1.0.jar; cannot read
zip file
error: error reading /home/bigdata/hadoop-1.0.2/libexec/../lib/xwork-2.1.2.jar; cannot read
zip file
Note: /tmp/sqoop-bigdata/compile/939747ca6dab7c25898cd5058e0ed0ab/nounphrasesentries.java
uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.commons.io.FileUtils.moveFile(Ljava/io/File;Ljava/io/File;)V
        at org.apache.sqoop.orm.CompilationManager.compile(CompilationManager.java:228)
        at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:83)
        at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
I'm clueless about why is Sqoop trying to pick a zip(?) file from the libexec folder of Hadoop?


Regards,
Omkar Joshi


________________________________
The contents of this e-mail and any attachment(s) may contain confidential or privileged information
for the intended recipient(s). Unintended recipients are prohibited from taking action on
the basis of information in this e-mail and using or disseminating the information, and must
notify the sender and delete it from their system. L&T Infotech will not accept responsibility
or liability for the accuracy or completeness of, or the presence of any virus or disabling
code in this e-mail"

Mime
View raw message