sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Souvik Bose (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1334) Sqoop Hcatalog export failed with exception of Failed to load foster storage handler during map reduce
Date Sun, 08 Jun 2014 20:04:01 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021303#comment-14021303
] 

Souvik Bose commented on SQOOP-1334:
------------------------------------

Hi Venkat,
First of all thanks for looking into this issue for this. If it is not an
issue and if I am missing something, can you please help me little more to
figure this out. As you mentioned I am not providing format libs for hcat.
How can I do that?
The table is not created by swoop hcat. It is a hive external table and on
a hdfs path where few flume event files are there. They are in Json format.
I thought any hive table is readable by hcat. Can you please give me some
more details so that I can found out the problem?
On Jun 7, 2014 12:36 AM, "Venkat Ranganathan (JIRA)" <jira@apache.org>



> Sqoop Hcatalog export failed with exception of Failed to load foster storage handler
during map reduce
> ------------------------------------------------------------------------------------------------------
>
>                 Key: SQOOP-1334
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1334
>             Project: Sqoop
>          Issue Type: Bug
>          Components: hive-integration
>    Affects Versions: 1.4.3
>         Environment: CDH4.4.0 with cloudera manager.
>            Reporter: Souvik Bose
>            Priority: Blocker
>              Labels: hcatalog, sqoop, storage-handler
>         Attachments: Sqoop_Hcatalog_Export_Log_verbose.txt
>
>
> I tried to export a hive external table to mysql using sqoop hcatalog export command.
> sqoop export --connect jdbc:mysql://example.com:3306/demo1 --username demo-password demo1234
bd_sqoop1 --hcatalog-table test_data
> I have set the HCAT_HOME, HADOOP_CLASSPATH, HIVE_HOME and paths of Jars. Now the job
is progressing upto the map reduce stage, but stops at map 0% reduce 0% with an exception
as below:
> 14/06/04 13:27:21 INFO mapred.JobClient: Task Id : attempt_201406021302_0043_m_000002_1,
Status : FAILED
> java.io.IOException: Error initializing HCat record reader
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.initNextRecordReader(SqoopHCatRecordReader.java:146)
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatRecordReader.<init>(SqoopHCatRecordReader.java:57)
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatExportFormat.createRecordReader(SqoopHCatExportFormat.java:128)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:644)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
>         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: java.io.IOException: Failed to load foster storage handler
>         at org.apache.hcatalog.common.HCatUtil.getStorageHandler(HCatUtil.java:416)
>         at org.apache.hcatalog.common.HCatUtil.getStorageHandl



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message