sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sethuramaswamy, Suresh " <suresh.sethuramasw...@credit-suisse.com>
Subject RE: Java Client for Sqoop Import
Date Mon, 15 Dec 2014 14:39:14 GMT
Hi Vineet,

Writing the output log to a file and grep for the count  may be an option to try out.

$(grep -oP 'Retrieved \K\d*' <logfileName>)

Suresh Sethuramaswamy

From: Vineet Mishra [mailto:clearmidoubt@gmail.com]
Sent: Monday, December 15, 2014 6:54 AM
To: user@sqoop.apache.org
Subject: Re: Java Client for Sqoop Import

Hi Abe,

Thanks for your mail, well I tried this link and able to make Sqoop invocation possible from
a java code snippet.


I am much looking for some way of getting the number of records processed through sqoop import

INFO mapreduce.ImportJobBase: Retrieved 5 records.

so as to avoid another level of processing getting the import counts, I can get the records
in the console but unfortunately not in the Sqoop.runTool since its not having access to any
possible methods for getting processed result counts.

Looking forward for any workaround to get this hack.


On Mon, Dec 15, 2014 at 7:08 AM, Abraham Elmahrek <abe@cloudera.com<mailto:abe@cloudera.com>>
Hey man,

Have you tried Sqoop2's Java client? It would currently only be useful when transfering data
FROM/TO HDFS. This is changing fast though.


On Sun, Dec 14, 2014 at 1:59 PM, Vineet Mishra <clearmidoubt@gmail.com<mailto:clearmidoubt@gmail.com>>
Has Anyone picked this up!

On Fri, Dec 12, 2014 at 5:06 PM, Vineet Mishra <clearmidoubt@gmail.com<mailto:clearmidoubt@gmail.com>>

I am looking for some client for running sqoop jobs in Java. Although I have easily imported
data through sqoop shell command but looking out for the other alternative through implementing
the same in Java.

On urgent call!

Please access the attached hyperlink for an important electronic communications disclaimer:


View raw message