sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Connell, Chuck" <Chuck.Conn...@nuance.com>
Subject RE: String replace functionality in Sqoop import using Oozie
Date Mon, 04 Feb 2013 20:18:56 GMT
I mean to add a step, putting a Python piped script in the middle. So instead of

RDBMS --> Sqoop --> Hive

You would do

RDBMS --> some file format --> Python (replacing ctrl-a) --> modified files -->
Sqoop --> Hive

Does that help?

Chuck


From: Nitin kak [mailto:nitinkak001@gmail.com]
Sent: Monday, February 04, 2013 2:53 PM
To: user@sqoop.apache.org
Subject: Re: String replace functionality in Sqoop import using Oozie

Didn't get you. Could you please elaborate just a bit?
On Mon, Feb 4, 2013 at 2:43 PM, Connell, Chuck <Chuck.Connell@nuance.com<mailto:Chuck.Connell@nuance.com>>
wrote:
Do it first with Python??


From: Nitin kak [mailto:nitinkak001@gmail.com<mailto:nitinkak001@gmail.com>]
Sent: Monday, February 04, 2013 2:42 PM
To: sqoop-user@incubator.apache.org<mailto:sqoop-user@incubator.apache.org>
Subject: String replace functionality in Sqoop import using Oozie

Hi guys,


     Is there a way to replace (or drop) a character in one of the fields on the fly while
importing data from an RDBMS system? I basically want to replace Ctrl-A characters in the
fields. I know its possible to do that with Sqoop Hive Import(--hive-delims-replacement) but
Hive Sqoop import is know not to work correctly with Oozie(hope this one gets remedied soon).

Regards,
Nitin Kak


Mime
View raw message