sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sebastian Gäde <s116...@hft-leipzig.de>
Subject using Sqoop 1.4.4 with Hadoop 2.4.0
Date Fri, 13 Jun 2014 11:15:50 GMT
Hi,

I’d like to export MR result (text) files from HDFS to MySQL. My cluster is
running Hadoop 2.4.0.

When I’m running 
./sqoop export –connect jdbc:mysql://mysqlserver/sqoop –username user
–password pass –table test1 –export-dir /output
I get the below exception. I assume, sqoop is using the old MR API? Can I
change this somehow to use the new API, then I'd be able to point
$HADOOP_MAPRED_HOME to the right position?!

14/06/13 13:06:44 WARN tool.BaseSqoopTool: Setting your password on the
command-line is insecure. Consider using -P instead.
14/06/13 13:06:44 INFO manager.MySQLManager: Preparing to use a MySQL
streaming resultset.
14/06/13 13:06:44 INFO tool.CodeGenTool: Beginning code generation
14/06/13 13:06:50 INFO manager.SqlManager: Executing SQL statement: SELECT
t.* FROM `test1` AS t LIMIT 1
14/06/13 13:06:50 INFO manager.SqlManager: Executing SQL statement: SELECT
t.* FROM `test1` AS t LIMIT 1
14/06/13 13:06:50 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is
/opt/hadoop-2.4.0/share/hadoop/yarn
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/hadoop/mapred/JobConf
        at
org.apache.sqoop.orm.CompilationManager.findHadoopCoreJar(CompilationManager
.java:109)
        at
org.apache.sqoop.orm.CompilationManager.compile(CompilationManager.java:137)
        at
org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:97)
        at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:64)
        at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:100)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:238)

Thanks very much!
Sebastian



Mime
View raw message