sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkat Ranganathan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1334) Sqoop Hcatalog export failed with exception of Failed to load foster storage handler during map reduce
Date Fri, 06 Jun 2014 19:06:02 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020242#comment-14020242
] 

Venkat Ranganathan commented on SQOOP-1334:
-------------------------------------------

The error message is your input format cannot be loaded.    So, you are not providing your
format libraries for hcat to create the foster handler.   What is the output of desc extended
of your table.    That may help you identify what is missing

YOu can ask sqoop-hcat to create the hcatalog table for you as part of import.

And also, I would suggest user list for questions and not create issues for this.   If you
have instalation config issues, you may have to take this to appropriate mailing lists

> Sqoop Hcatalog export failed with exception of Failed to load foster storage handler
during map reduce
> ------------------------------------------------------------------------------------------------------
>
>                 Key: SQOOP-1334
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1334
>             Project: Sqoop
>          Issue Type: Bug
>          Components: hive-integration
>    Affects Versions: 1.4.3
>         Environment: CDH4.4.0 with cloudera manager.
>            Reporter: Souvik Bose
>            Priority: Blocker
>              Labels: hcatalog, sqoop, storage-handler
>         Attachments: Sqoop_Hcatalog_Export_Log_verbose.txt
>
>
> I tried to export a hive external table to mysql using sqoop hcatalog export command.
> sqoop export --connect jdbc:mysql://example.com:3306/demo1 --username demo-password demo1234
bd_sqoop1 --hcatalog-table test_data
> I have set the HCAT_HOME, HADOOP_CLASSPATH, HIVE_HOME and paths of Jars. Now the job
is progressing upto the map reduce stage, but stops at map 0% reduce 0% with an exception
as below:
> 14/06/04 13:27:21 INFO mapred.JobClient: Task Id : attempt_201406021302_0043_m_000002_1,
Status : FAILED
> java.io.IOException: Error initializing HCat record reader
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.initNextRecordReader(SqoopHCatRecordReader.java:146)
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.<init>(SqoopHCatRecordReader.java:57)
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatExportFormat.createRecordReader(SqoopHCatExportFormat.java:128)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:644)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
>         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: java.io.IOException: Failed to load foster storage handler
>         at org.apache.hcatalog.common.HCatUtil.getStorageHandler(HCatUtil.java:416)
>         at org.apache.hcatalog.common.HCatUtil.getStorageHandl



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message