sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abraham Elmahrek <...@cloudera.com>
Subject Re: Unable to load native hadoop library
Date Mon, 06 Jan 2014 19:19:03 GMT
Thanks for reporting back Brenden!


On Mon, Jan 6, 2014 at 8:50 AM, Brenden Cobb <Brenden.Cobb@humedica.com>wrote:

>  I did not have the correct path to hadoop in my sqoop conf file. Once I
> fixed that everything was ok.
>
>  -BC
>
>   From: Abraham Elmahrek <abe@cloudera.com>
> Reply-To: "user@sqoop.apache.org" <user@sqoop.apache.org>
> Date: Sunday, January 5, 2014 8:10 PM
>
> To: "user@sqoop.apache.org" <user@sqoop.apache.org>
> Subject: Re: Unable to load native hadoop library
>
>   Brenden,
>
>  Happy to hear things are working. Would you mind posting back what you
> did to get around your latest issue? That way, if someone else runs into
> this problem and they start searching around... they can refer back to this
> post.
>
>  -Abe
>
>
> On Sun, Jan 5, 2014 at 1:00 PM, Brenden Cobb <Brenden.Cobb@humedica.com>wrote:
>
>>  Nevermind! A little more tinkering and I got the basics working. Thanks
>> again for the tip.
>>
>>  -BC
>>
>>
>>   From: Brenden Cobb <brenden.cobb@humedica.com>
>> Reply-To: "user@sqoop.apache.org" <user@sqoop.apache.org>
>> Date: Sunday, January 5, 2014 3:01 PM
>>
>> To: "user@sqoop.apache.org" <user@sqoop.apache.org>
>> Subject: Re: Unable to load native hadoop library
>>
>>   Thanks for the tip Abe. I've set bcobb-mbpr.local to 127.0.0.1 and now
>> end up with:
>>
>>  14/01/05 14:51:49 INFO jvm.JvmMetrics: Initializing JVM Metrics with
>> processName=JobTracker, sessionId=
>> 14/01/05 14:51:49 ERROR security.UserGroupInformation:
>> PriviledgedActionException as:bcobb (auth:SIMPLE)
>> cause:java.io.IOException: Failed on local exception: java.io.EOFException;
>> Host Details : local host is: "localhost/127.0.0.1"; destination host
>> is: "localhost":8020;
>> 14/01/05 14:51:49 ERROR tool.ImportTool: Encountered IOException running
>> import job: java.io.IOException: Failed on local exception:
>> java.io.EOFException; Host Details : local host is: "localhost/127.0.0.1";
>> destination host is: "localhost":8020;
>> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764)
>>
>>
>>  Any tips?
>>
>>  Thanks
>>
>>  -BC
>>
>>   From: Abraham Elmahrek <abe@cloudera.com>
>> Reply-To: "user@sqoop.apache.org" <user@sqoop.apache.org>
>> Date: Thursday, January 2, 2014 11:21 PM
>> To: "user@sqoop.apache.org" <user@sqoop.apache.org>
>> Subject: Re: Unable to load native hadoop library
>>
>>   It seems like your localhost "bcobb-mbpr.local" doesn't loop back. Try
>> using "localhost" in your configs instead or add "bcobb-mbpr.local" to
>> your /etc/hosts file.
>>
>>  -Abe
>>
>>
>> On Thu, Jan 2, 2014 at 7:30 PM, rudra tripathy <rudra1in@yahoo.com>wrote:
>>
>>> Hi Cobb,
>>>
>>> Try adding jars to classpath and path and check whether it is working.
>>>
>>> Thanks and Regards,
>>> Rudra
>>> --------------------------------------------
>>> On Fri, 3/1/14, Brenden Cobb <Brenden.Cobb@humedica.com> wrote:
>>>
>>>  Subject: Unable to load native hadoop library
>>>  To: "user@sqoop.apache.org" <user@sqoop.apache.org>
>>>  Date: Friday, 3 January, 2014, 3:37 AM
>>>
>>>
>>>
>>>
>>>
>>>
>>>  Hi-
>>>  I'm just getting started with Sqoop and am running
>>>  some tests against mySQL to get the hang of things.
>>>  Sqoop:  1.4.4
>>>  hadoop: tried both 1.2.1 and 2.2.0
>>>  platform: OS X
>>>
>>>
>>>
>>>  Unfortunately I am hitting the following error when
>>>  trying to import. Appreciate any help!
>>>
>>>
>>>
>>>  -BC
>>>
>>>
>>>
>>>
>>>  ==> sqoop import --connect
>>>  jdbc:mysql://localhost/hadoopguide --table widgets -m
>>>  1
>>>
>>>
>>>
>>>  14/01/02 15:57:58 INFO manager.MySQLManager: Preparing
>>>  to use a MySQL streaming resultset.
>>>  14/01/02 15:57:58 INFO tool.CodeGenTool: Beginning code
>>>  generation
>>>  14/01/02 15:57:59 INFO manager.SqlManager: Executing
>>>  SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1
>>>  14/01/02 15:57:59 INFO manager.SqlManager: Executing
>>>  SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1
>>>  14/01/02 15:57:59 INFO orm.CompilationManager:
>>>  HADOOP_MAPRED_HOME is /usr/local
>>>  Note:
>>>  /tmp/sqoop-bcobb/compile/d54504715f779b2aa610a608f51aa56b/widgets.java
>>>  uses or overrides a deprecated API.
>>>  Note: Recompile with -Xlint:deprecation for
>>>  details.
>>>  14/01/02 15:58:00 INFO orm.CompilationManager: Writing
>>>  jar file:
>>>  /tmp/sqoop-bcobb/compile/d54504715f779b2aa610a608f51aa56b/widgets.jar
>>>  ..
>>>  14/01/02 15:58:00 INFO mapreduce.ImportJobBase:
>>>  Beginning import of widgets
>>>  2014-01-02 15:58:00.683 java[60905:1903] Unable to load
>>>  realm info from SCDynamicStore
>>>  ..
>>>
>>>  4/01/02 15:58:05 WARN util.NativeCodeLoader: Unable to
>>>  load native-hadoop library for your platform... using
>>>  builtin-java classes where applicable
>>>
>>>  14/01/02 15:58:11 INFO mapred.JobClient: Cleaning up
>>>  the staging area
>>>
>>>  file:/tmp/hadoop-bcobb/mapred/staging/bcobb678313846/.staging/job_local678313846_0001
>>>  14/01/02 15:58:11 ERROR security.UserGroupInformation:
>>>  PriviledgedActionException as:bcobb
>>>  cause:java.net.UnknownHostException: bcobb-mbpr.local:
>>>  bcobb-mbpr.local: nodename nor servname provided, or not
>>>  known
>>>  14/01/02 15:58:11 ERROR tool.ImportTool: Encountered
>>>  IOException running import job:
>>>  java.net.UnknownHostException: bcobb-mbpr.local:
>>>  bcobb-mbpr.local: nodename nor servname provided, or not
>>>  known
>>>  at
>>>  java.net.InetAddress.getLocalHost(InetAddress.java:1473)
>>>  at
>>>  org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:960)
>>>  at
>>>  org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
>>>  at
>>>  java.security.AccessController.doPrivileged(Native
>>>  Method)
>>>  at
>>>  javax.security.auth.Subject.doAs(Subject.java:415)
>>>  at
>>>
>>>  org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>>>  at
>>>  org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936)
>>>  at
>>>  org.apache.hadoop.mapreduce.Job.submit(Job.java:550)
>>>  at
>>>  org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:580)
>>>  at
>>>
>>>  org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:186)
>>>  at
>>>  org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:159)
>>>  at
>>>
>>>  org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:239)
>>>  at
>>>  org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:600)
>>>  at
>>>  org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:118)
>>>  at
>>>  org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:413)
>>>  at
>>>  org.apache.sqoop.tool.ImportTool.run(ImportTool.java:502)
>>>  at
>>>  org.apache.sqoop.Sqoop.run(Sqoop.java:145)
>>>  at
>>>  org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>>>  at
>>>  org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
>>>  at
>>>  org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
>>>  at
>>>  org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
>>>  at
>>>  org.apache.sqoop.Sqoop.main(Sqoop.java:238)
>>>  Caused by: java.net.UnknownHostException:
>>>  bcobb-mbpr.local: nodename nor servname provided, or not
>>>  known
>>>  at
>>>  java.net.Inet6AddressImpl.lookupAllHostAddr(Native
>>>  Method)
>>>  at
>>>  java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:901)
>>>  at
>>>  java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1293)
>>>  at
>>>  java.net.InetAddress.getLocalHost(InetAddress.java:1469)
>>>
>>>
>>>
>>>
>>>
>>
>

Mime
View raw message