sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raja Sekhar <raja.d.sek...@gmail.com>
Subject Re: Importing BLOB
Date Wed, 17 Sep 2014 00:00:44 GMT
Hi,

I was able to go ahead with --map-column-hive option, but now am seeing
other issues.

my import command:
sqoop import --connect jdbc:oracle:thin:@<DB> --username <username> -P
--table C0.BLOB1 --hive-import --create-hive-table
--hive-drop-import-delims --map-column-hive   ENGINE=String,
--fields-terminated-by '|' --verbose -m 1  --hive-overwrite
--lines-terminated-by '\n' --inline-lob-limit 0 (20)

Error:
14/09/16 19:43:25 INFO hive.HiveImport: Time taken: 2.504 seconds
14/09/16 19:43:25 INFO hive.HiveImport: FAILED: SemanticException Line 2:17
Invalid path ''hdfs://
tbldann01adv-hdp.tdc.vzwcorp.com:8020/user/ambari-qa/C0DUDRA.BLOB1'':
source contains directory: hdfs://
tbldann01adv-hdp.tdc.vzwcorp.com:8020/user/ambari-qa/C0DUDRA.BLOB1/_lob
14/09/16 19:43:25 ERROR tool.ImportTool: Encountered IOException running
import job: java.io.IOException: Hive exited with status 64
        at
org.apache.sqoop.hive.HiveImport.executeExternalHiveScript(HiveImport.java:381)
        at
org.apache.sqoop.hive.HiveImport.executeScript(HiveImport.java:331)
        at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:235)
        at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:415)
        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)

Tried excluding --inline-lob-limit, import went fine, but its failing while
exporting back. ( I found a jira filed for this issue long back, but no fix
is available).

2014-09-16 19:24:58,579 ERROR org.apache.sqoop.mapreduce.TextExportMapper:
Exception: java.io.IOException: Could not buffer record at
org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:218)
at org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write

Thanks
Raja

On Tue, Sep 16, 2014 at 3:13 PM, Rajasekhar <raja.d.sekhar@gmail.com> wrote:

> Hi,
> Any body tried importing BLOB from oracle to hive using sqoop ...??
> I have tried bulkload, and map.java(string) options, which didnt help.
> CLOB data am able to import successfully.
> Please let me know if there is any way to load BLOB data.
>
> Appreciate your help.
>
> Thanks
> Raja
>



-- 
Thanks & Regards
Rajasekhar D

Mime
View raw message