sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sudeep mishra <sudeepshekh...@gmail.com>
Subject Re: Sqoop Metrics
Date Tue, 12 Jan 2016 04:07:57 GMT
Thanks for your feedback Jarcec.

On Mon, Jan 11, 2016 at 8:29 PM, Jarek Jarcec Cecho <jarcec@apache.org>
wrote:

> Hi Sudeep,
> Sqoop 1 is a command line utility without any permanent storage*, so we’re
> not persisting such metrics anywhere. Having said that you can easily get
> number of records and other metrics from JobTracker/ResourceManager in form
> of mapreduce job counters. Provided the job history wasn’t cleaned up yet.
>
> Jarcec
>
> * The metastore is a small exception, but that is used only to store
> parameters and nothing more.
>
> > On Jan 10, 2016, at 7:49 PM, sudeep mishra <sudeepshekharm@gmail.com>
> wrote:
> >
> > Hi,
> >
> > How can be get the information about the metrics around Sqoop jobs?
> >
> > I am interested in capturing details like number of records processed,
> amount of data transferred, time taken to complete Sqoop job etc. I can see
> that these info is present in the logs generated after running any Sqoop
> command but I am interested to know if this data is saved internally by
> Sqoop or can be triggered after completion of the jobs without actually
> parsing the logs.
> >
> >
> > Thanks & Regards,
> >
> > Sudeep Shekhar Mishra
> >
> >
>
>


-- 
Thanks & Regards,

Sudeep Shekhar Mishra

+91-9167519029
sudeepshekharm@gmail.com

Mime
View raw message