sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkat Ranganathan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1334) Sqoop Hcatalog export failed with exception of Failed to load foster storage handler during map reduce
Date Thu, 05 Jun 2014 23:40:01 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14019409#comment-14019409

Venkat Ranganathan commented on SQOOP-1334:

For whatever reason HCat can't create an outputformat - either the libraries were not available.
  Also, I am not sure why the foster storage handler could not be loaded.   I would suggest
trying to use a standard file format to validate functionality and work the issues on why
your json format is not working with HCat

> Sqoop Hcatalog export failed with exception of Failed to load foster storage handler
during map reduce
> ------------------------------------------------------------------------------------------------------
>                 Key: SQOOP-1334
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1334
>             Project: Sqoop
>          Issue Type: Bug
>          Components: hive-integration
>    Affects Versions: 1.4.3
>         Environment: CDH4.4.0 with cloudera manager.
>            Reporter: Souvik Bose
>            Priority: Blocker
>              Labels: hcatalog, sqoop, storage-handler
>         Attachments: Sqoop_Hcatalog_Export_Log_verbose.txt
> I tried to export a hive external table to mysql using sqoop hcatalog export command.
> sqoop export --connect jdbc:mysql://example.com:3306/demo1 --username demo-password demo1234
bd_sqoop1 --hcatalog-table test_data
> I have set the HCAT_HOME, HADOOP_CLASSPATH, HIVE_HOME and paths of Jars. Now the job
is progressing upto the map reduce stage, but stops at map 0% reduce 0% with an exception
as below:
> 14/06/04 13:27:21 INFO mapred.JobClient: Task Id : attempt_201406021302_0043_m_000002_1,
Status : FAILED
> java.io.IOException: Error initializing HCat record reader
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.initNextRecordReader(SqoopHCatRecordReader.java:146)
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.<init>(SqoopHCatRecordReader.java:57)
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatExportFormat.createRecordReader(SqoopHCatExportFormat.java:128)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:644)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
>         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: java.io.IOException: Failed to load foster storage handler
>         at org.apache.hcatalog.common.HCatUtil.getStorageHandler(HCatUtil.java:416)
>         at org.apache.hcatalog.common.HCatUtil.getStorageHandl

This message was sent by Atlassian JIRA

View raw message