sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abraham Elmahrek <...@cloudera.com>
Subject Re: Sqoop job hanging
Date Tue, 12 May 2015 04:18:38 GMT
Check the corresponding task logs. Maybe it's hung somewhere in the map
phase.

-Abe

On Mon, May 11, 2015 at 8:04 PM, Jagat Singh <jagatsingh@gmail.com> wrote:

> Hi,
>
> Whats the best way to debug Sqoop 1 , job which does not brings any
> records and just sits over there. It will keep on running for hours if we
> don't kill it.
>
> See the screenshot and log attached.
>
> I checked the DB it has about 32k records.
>
> We just tried to give higher memory to see if that works , but still no
> luck.
>
> Sqoop query is
>
> sqoop import -Dmapreduce.map.log.level=DEBUG
> -Dmapreduce.map.java.opts=-Xmx16277m -Dmapreduce.map.memory.mb=20000
> -Dmapreduce.map.speculative=false --verbose \
> --connect jdbc:oracle:thin:@${db} \
> --username "${username}" --password ${password} \
> --table My.CASE_O \
> --columns Hello
> --where "to_char(COPY_DATE,'YYYY-MM-DD') ='`date --date="yesterday" +%F`'"
> -m 1 \
> --fetch-size 500 \
> --target-dir /tmp/dir
>
>
> thanks,
>
> [image: Inline image 2]
>

Mime
View raw message