sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abraham Elmahrek <...@cloudera.com>
Subject Re: Error in Sqoop workflow using Oozie
Date Mon, 06 Apr 2015 20:42:52 GMT
A couple of thoughts:

   1. Oozie will run the sqoop job as the user oozie possibly. So
   "hive-site.xml" won't be picked up. Try putting it in a shared location and
   adding a symlink: <file>/tmp/hive-site.xml#hive-site.xml</file>. The same
   is true for terajdbc4.jar.
   2. The oozie launcher task logs should have more information. It will be
   easier to debug if you drill down into the mapreduce job launching Sqoop.

-Abe

On Mon, Apr 6, 2015 at 7:40 AM, Vishwakarma, Chhaya <
Chhaya.Vishwakarma@teradata.com> wrote:

>  I have written a Sqoop import script to import data from teradata to
> hive. It's working fine when I run it from command line ,but when I put it
> in Oozie workflow and try to execute through oozie I get the below error
>
>
>
>
>
>  2015-04-02 08:50:55,440  INFO ActionEndXCommand:539 - USER[qjdht93]
> GROUP[-TOKEN[] APP[sqoop-shell-wf]
> JOB[0000069-150114201015959-oozie-oozi-W]
> ACTION[0000069-150114201015959-oozie-oozi-W@sqoop-shell] end executor for
> wf action 0000069-150114201015959-oozie-oozi-W with wf job
> 0000069-150114201015959-oozie-oozi-W
>
> 2015-04-02 08:50:55,459  INFO ActionEndXCommand:539 - USER[qjdht93]
> GROUP[-] TOKEN[] APP[sqoop-shell-wf]
> JOB[0000069-150114201015959-oozie-oozi-W]
> ACTION[0000069-150114201015959-oozie-oozi-W@sqoop-shell] ERROR is
> considered as FAILED for SLA
>
> 2015-04-02 08:50:55,505  INFO ActionStartXCommand:539 - USER[qjdht93]
> GROUP[-] TOKEN[] APP[sqoop-shell-wf]
> JOB[0000069-150114201015959-oozie-oozi-W]
> ACTION[0000069-150114201015959-oozie-oozi-W@fail] Start action
> [0000069-150114201015959-oozie-oozi-W@fail] with user-retry state :
> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>
> 2015-04-02 08:50:55,505  WARN ActionStartXCommand:542 - USER[qjdht93]
> GROUP[-] TOKEN[] APP[sqoop-shell-wf]
> JOB[0000069-150114201015959-oozie-oozi-W]
> ACTION[0000069-150114201015959-oozie-oozi-W@fail]
> [***0000069-150114201015959-oozie-oozi-W@fail***]Action status=DONE
>
> 2015-04-02 08:50:55,505  WARN ActionStartXCommand:542 - USER[qjdht93]
> GROUP[-] TOKEN[] APP[sqoop-shell-wf]
> JOB[0000069-150114201015959-oozie-oozi-W]
> ACTION[0000069-150114201015959-oozie-oozi-W@fail]
> [***0000069-150114201015959-oozie-oozi-W@fail***]Action updated in DB!
>
> 2015-04-02 08:50:55,522  INFO ActionEndXCommand:539 - USER[qjdht93]
> GROUP[-] TOKEN[] APP[sqoop-shell-wf]
> JOB[0000069-150114201015959-oozie-oozi-W]
> ACTION[0000069-150114201015959-oozie-oozi-W@fail] end executor for wf
> action 0000069-150114201015959-oozie-oozi-W with wf job
> 0000069-150114201015959-oozie-oozi-W
>
> 2015-04-02 08:50:55,556  WARN CoordActionUpdateXCommand:542 -
> USER[qjdht93] GROUP[-] TOKEN[] APP[sqoop-shell-wf]
> JOB[0000069-150114201015959-oozie-oozi-W] ACTION[-] **E1100: Command
> precondition does not hold before execution, [, coord action is null],
> Error Code: E1100**`
>
>
>
> Below is my workflow.xml
>
> <workflow-app name="sqoop-to-hive" xmlns="uri:oozie:workflow:0.4">
>
>     <start to="sqoop2hive"/>
>
>     <action name="sqoop2hive">
>
>         <sqoop xmlns="uri:oozie:sqoop-action:0.2">
>
>             <job-tracker>${jobTracker}</job-tracker>
>
>             <name-node>${nameNode}</name-node>
>
>             <command>import --connect "jdbc:teradata://server.co/database=TS"-–driver
Com.teradata.jdbc.TeraDriver--username sqoop --password sqoop --table test --hive-import --hive-
 table test</command>
>
>              <archive>tdgssconfig.jar</archive>
>
>             <archive>terajdbc4.jar</archive>
>
>             <file>hive-site.xml</file>
>
>         </sqoop>
>
>         <ok to="end"/>
>
>         <error to="kill"/>
>
>     </action>
>
>     <kill name="kill">
>
>         <message>Action failed</message>
>
>     </kill>
>
>     <end name="end"/>
>
> </workflow-app>
>
>
>
> Please suggest
>
>
>
> Regards,
>
> Chhaya
>

Mime
View raw message