sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Attila Szabó <mau...@apache.org>
Subject Re: 回复: Sqoop export ORC data
Date Tue, 05 Dec 2017 13:15:31 GMT

I beg your pardon, but I guess in this situation we're misunderstanding
each other ( using different terms / concepts  / etc. )

When you're exporting anything with HCatalog, you're leveraging from the
Hive infrastructure, api, metastore, etc. b/c you're using the Hive
capabilities to read /parse/use the ORC files ( ORC backed tables).

Without this right now ( at least according to my current knowledge), Sqoop
is not able to natively work with orc files stored on HDFS, thus you'll
need the Hive capabilities ( thus Hive metastore as well)

My 2cents,

On Dec 5, 2017 1:41 PM, "qq" <987626311@qq.com> wrote:

Sqoop export supports ORC. I tested it. First, I need to add a parameter:
hcatalog. and then start remote access Hive Metastore. It needs to start
Hive Metastore, but now I want to export ORC data without starting Hive
Metastore. Who knows how to do it?

------------------ 原始邮件 ------------------
*发件人:* "Attila Szabó";<maugli@apache.org>;
*发送时间:* 2017年12月5日(星期二) 晚上8:33
*收件人:* "user"<user@sqoop.apache.org>;
*主题:* Re: Sqoop export ORC data


AFAIK Sqoop right now sadly does not support the ORC format ( it's on my
personal road map, but not among the highest priorities, so maybe arrives
in a year if it will be up to me)


It's possible some vendors do have custom solution for it.

On Dec 5, 2017 1:24 PM, "qq" <987626311@qq.com> wrote:

     I met the following problems when I exported the ORC format data in
sqoop, and I hope to get help from everyone!
     When using sqoop to export the data from hive to the Oracle table, how
can sqoop export the ORC format data without starting Hive Metastore?
     I'm looking forward to your reply!

View raw message