sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "qq" <987626...@qq.com>
Subject 回复: 回复: Sqoop export ORC data
Date Tue, 05 Dec 2017 14:33:40 GMT
If not HCataLog, there is no other way to export ORC data?

------------------ 原始邮件 ------------------
发件人: "Attila Szabó"<maugli@apache.org>; 
发送时间: 2017年12月5日(星期二) 晚上9:15
收件人: "user"<user@sqoop.apache.org>; 
主题: Re: 回复: Sqoop export ORC data


I beg your pardon, but I guess in this situation we're misunderstanding each other ( using
different terms / concepts  / etc. ) 

When you're exporting anything with HCatalog, you're leveraging from the Hive infrastructure,
api, metastore, etc. b/c you're using the Hive capabilities to read /parse/use the ORC files
( ORC backed tables). 

Without this right now ( at least according to my current knowledge), Sqoop is not able to
natively work with orc files stored on HDFS, thus you'll need the Hive capabilities ( thus
Hive metastore as well) 

My 2cents,

On Dec 5, 2017 1:41 PM, "qq" <987626311@qq.com> wrote:
Sqoop export supports ORC. I tested it. First, I need to add a parameter: hcatalog. and then
start remote access Hive Metastore. It needs to start Hive Metastore, but now I want to export
ORC data without starting Hive Metastore. Who knows how to do it?

------------------ 原始邮件 ------------------
发件人: "Attila Szabó";<maugli@apache.org>;
发送时间: 2017年12月5日(星期二) 晚上8:33
收件人: "user"<user@sqoop.apache.org>;

主题: Re: Sqoop export ORC data


AFAIK Sqoop right now sadly does not support the ORC format ( it's on my personal road map,
but not among the highest priorities, so maybe arrives in a year if it will be up to me) 


It's possible some vendors do have custom solution for it. 

On Dec 5, 2017 1:24 PM, "qq" <987626311@qq.com> wrote:
     I met the following problems when I exported the ORC format data in sqoop, and I hope
to get help from everyone!
     When using sqoop to export the data from hive to the Oracle table, how can sqoop export
the ORC format data without starting Hive Metastore?
     I'm looking forward to your reply!
View raw message