sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brenden Cobb <Brenden.C...@humedica.com>
Subject Re: Unable to load native hadoop library
Date Sun, 05 Jan 2014 20:01:55 GMT
Thanks for the tip Abe. I've set bcobb-mbpr.local to 127.0.0.1 and now end up with:

14/01/05 14:51:49 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker,
sessionId=
14/01/05 14:51:49 ERROR security.UserGroupInformation: PriviledgedActionException as:bcobb
(auth:SIMPLE) cause:java.io.IOException: Failed on local exception: java.io.EOFException;
Host Details : local host is: "localhost/127.0.0.1"; destination host is: "localhost":8020;
14/01/05 14:51:49 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException:
Failed on local exception: java.io.EOFException; Host Details : local host is: "localhost/127.0.0.1";
destination host is: "localhost":8020;
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764)


Any tips?

Thanks

-BC

From: Abraham Elmahrek <abe@cloudera.com<mailto:abe@cloudera.com>>
Reply-To: "user@sqoop.apache.org<mailto:user@sqoop.apache.org>" <user@sqoop.apache.org<mailto:user@sqoop.apache.org>>
Date: Thursday, January 2, 2014 11:21 PM
To: "user@sqoop.apache.org<mailto:user@sqoop.apache.org>" <user@sqoop.apache.org<mailto:user@sqoop.apache.org>>
Subject: Re: Unable to load native hadoop library

It seems like your localhost "bcobb-mbpr.local" doesn't loop back. Try using "localhost" in
your configs instead or add "bcobb-mbpr.local" to your /etc/hosts file.

-Abe


On Thu, Jan 2, 2014 at 7:30 PM, rudra tripathy <rudra1in@yahoo.com<mailto:rudra1in@yahoo.com>>
wrote:
Hi Cobb,

Try adding jars to classpath and path and check whether it is working.

Thanks and Regards,
Rudra
--------------------------------------------
On Fri, 3/1/14, Brenden Cobb <Brenden.Cobb@humedica.com<mailto:Brenden.Cobb@humedica.com>>
wrote:

 Subject: Unable to load native hadoop library
 To: "user@sqoop.apache.org<mailto:user@sqoop.apache.org>" <user@sqoop.apache.org<mailto:user@sqoop.apache.org>>
 Date: Friday, 3 January, 2014, 3:37 AM






 Hi-
 I'm just getting started with Sqoop and am running
 some tests against mySQL to get the hang of things.
 Sqoop:  1.4.4
 hadoop: tried both 1.2.1 and 2.2.0
 platform: OS X



 Unfortunately I am hitting the following error when
 trying to import. Appreciate any help!



 -BC




 ==> sqoop import --connect
 jdbc:mysql://localhost/hadoopguide --table widgets -m
 1



 14/01/02 15:57:58 INFO manager.MySQLManager: Preparing
 to use a MySQL streaming resultset.
 14/01/02 15:57:58 INFO tool.CodeGenTool: Beginning code
 generation
 14/01/02 15:57:59 INFO manager.SqlManager: Executing
 SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1
 14/01/02 15:57:59 INFO manager.SqlManager: Executing
 SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1
 14/01/02 15:57:59 INFO orm.CompilationManager:
 HADOOP_MAPRED_HOME is /usr/local
 Note:
 /tmp/sqoop-bcobb/compile/d54504715f779b2aa610a608f51aa56b/widgets.java
 uses or overrides a deprecated API.
 Note: Recompile with -Xlint:deprecation for
 details.
 14/01/02 15:58:00 INFO orm.CompilationManager: Writing
 jar file:
 /tmp/sqoop-bcobb/compile/d54504715f779b2aa610a608f51aa56b/widgets.jar
 ..
 14/01/02 15:58:00 INFO mapreduce.ImportJobBase:
 Beginning import of widgets
 2014-01-02 15:58:00.683 java[60905:1903] Unable to load
 realm info from SCDynamicStore
 ..

 4/01/02 15:58:05 WARN util.NativeCodeLoader: Unable to
 load native-hadoop library for your platform... using
 builtin-java classes where applicable

 14/01/02 15:58:11 INFO mapred.JobClient: Cleaning up
 the staging area
 file:/tmp/hadoop-bcobb/mapred/staging/bcobb678313846/.staging/job_local678313846_0001
 14/01/02 15:58:11 ERROR security.UserGroupInformation:
 PriviledgedActionException as:bcobb
 cause:java.net.UnknownHostException: bcobb-mbpr.local:
 bcobb-mbpr.local: nodename nor servname provided, or not
 known
 14/01/02 15:58:11 ERROR tool.ImportTool: Encountered
 IOException running import job:
 java.net.UnknownHostException: bcobb-mbpr.local:
 bcobb-mbpr.local: nodename nor servname provided, or not
 known
 at
 java.net.InetAddress.getLocalHost(InetAddress.java:1473)
 at
 org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:960)
 at
 org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
 at
 java.security.AccessController.doPrivileged(Native
 Method)
 at
 javax.security.auth.Subject.doAs(Subject.java:415)
 at
 org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
 at
 org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936)
 at
 org.apache.hadoop.mapreduce.Job.submit(Job.java:550)
 at
 org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:580)
 at
 org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:186)
 at
 org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:159)
 at
 org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:239)
 at
 org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:600)
 at
 org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:118)
 at
 org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:413)
 at
 org.apache.sqoop.tool.ImportTool.run(ImportTool.java:502)
 at
 org.apache.sqoop.Sqoop.run(Sqoop.java:145)
 at
 org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at
 org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
 at
 org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
 at
 org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
 at
 org.apache.sqoop.Sqoop.main(Sqoop.java:238)
 Caused by: java.net.UnknownHostException:
 bcobb-mbpr.local: nodename nor servname provided, or not
 known
 at
 java.net.Inet6AddressImpl.lookupAllHostAddr(Native
 Method)
 at
 java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:901)
 at
 java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1293)
 at
 java.net.InetAddress.getLocalHost(InetAddress.java:1469)






Mime
View raw message