Thanks Abe,
Below is the Error I'm getting in Map Reduce logs
error: error reading /usr/lib/hadoop/lib/smore.jar; /usr/lib/hadoop/lib/smore.jar (Permission
denied)
error: error reading /usr/lib/hadoop/lib/janusclient.jar; /usr/lib/hadoop/lib/janusclient
.jar (Permission denied)
error: error reading /usr/lib/hadoop/lib/aster- networking.jar; /usr/lib/hadoop/lib/aster-networking.jar
(Permission denied)
error: error reading /usr/lib/hadoop/lib/adfs-api-loader.jar; /usr/lib/hadoop/lib/adfs-api-loader.jar
(Permission denied)
error: error reading /usr/lib/hadoop/lib/aftp.jar; /usr/lib/hadoop/lib/aftp.jar (Permission
denied)
error: error reading /usr/lib/hadoop/lib/adfs.jar; /usr/lib/hadoop/lib/adfs.jar (Permission
denied)
Note: /tmp/sqoop yarn/compile/f3aca99f37fa19e505b47bab1499bf5d/EXT_EVNT_ERR_ARC.java uses
or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Intercepting System.exit(1)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code
[1]
che.sqoop.hive.HiveImport - **Caused by: java.io.FileNotFoundException: File does not exist:
hdfs:/user/yarn**`
Please help
________________________________
From: Abraham Elmahrek [abe@cloudera.com]
Sent: Tuesday, April 07, 2015 2:12 AM
To: user@sqoop.apache.org
Subject: Re: Error in Sqoop workflow using Oozie
A couple of thoughts:
1. Oozie will run the sqoop job as the user oozie possibly. So "hive-site.xml" won't be
picked up. Try putting it in a shared location and adding a symlink: <file>/tmp/hive-site.xml#hive-site.xml</file>.
The same is true for terajdbc4.jar.
2. The oozie launcher task logs should have more information. It will be easier to debug
if you drill down into the mapreduce job launching Sqoop.
-Abe
On Mon, Apr 6, 2015 at 7:40 AM, Vishwakarma, Chhaya <Chhaya.Vishwakarma@teradata.com<mailto:Chhaya.Vishwakarma@teradata.com>>
wrote:
I have written a Sqoop import script to import data from teradata to hive. It's working fine
when I run it from command line ,but when I put it in Oozie workflow and try to execute through
oozie I get the below error
2015-04-02 08:50:55,440 INFO ActionEndXCommand:539 - USER[qjdht93] GROUP[-TOKEN[] APP[sqoop-shell-wf]
JOB[0000069-150114201015959-oozie-oozi-W] ACTION[0000069-150114201015959-oozie-oozi-W@sqoop-shell]
end executor for wf action 0000069-150114201015959-oozie-oozi-W with wf job 0000069-150114201015959-oozie-oozi-W
2015-04-02 08:50:55,459 INFO ActionEndXCommand:539 - USER[qjdht93] GROUP[-] TOKEN[] APP[sqoop-shell-wf]
JOB[0000069-150114201015959-oozie-oozi-W] ACTION[0000069-150114201015959-oozie-oozi-W@sqoop-shell]
ERROR is considered as FAILED for SLA
2015-04-02 08:50:55,505 INFO ActionStartXCommand:539 - USER[qjdht93] GROUP[-] TOKEN[] APP[sqoop-shell-wf]
JOB[0000069-150114201015959-oozie-oozi-W] ACTION[0000069-150114201015959-oozie-oozi-W@fail]
Start action [0000069-150114201015959-oozie-oozi-W@fail] with user-retry state : userRetryCount
[0], userRetryMax [0], userRetryInterval [10]
2015-04-02 08:50:55,505 WARN ActionStartXCommand:542 - USER[qjdht93] GROUP[-] TOKEN[] APP[sqoop-shell-wf]
JOB[0000069-150114201015959-oozie-oozi-W] ACTION[0000069-150114201015959-oozie-oozi-W@fail]
[***0000069-150114201015959-oozie-oozi-W@fail***]Action status=DONE
2015-04-02 08:50:55,505 WARN ActionStartXCommand:542 - USER[qjdht93] GROUP[-] TOKEN[] APP[sqoop-shell-wf]
JOB[0000069-150114201015959-oozie-oozi-W] ACTION[0000069-150114201015959-oozie-oozi-W@fail]
[***0000069-150114201015959-oozie-oozi-W@fail***]Action updated in DB!
2015-04-02 08:50:55,522 INFO ActionEndXCommand:539 - USER[qjdht93] GROUP[-] TOKEN[] APP[sqoop-shell-wf]
JOB[0000069-150114201015959-oozie-oozi-W] ACTION[0000069-150114201015959-oozie-oozi-W@fail]
end executor for wf action 0000069-150114201015959-oozie-oozi-W with wf job 0000069-150114201015959-oozie-oozi-W
2015-04-02 08:50:55,556 WARN CoordActionUpdateXCommand:542 - USER[qjdht93] GROUP[-] TOKEN[]
APP[sqoop-shell-wf] JOB[0000069-150114201015959-oozie-oozi-W] ACTION[-] **E1100: Command precondition
does not hold before execution, [, coord action is null], Error Code: E1100**`
Below is my workflow.xml
<workflow-app name="sqoop-to-hive" xmlns="uri:oozie:workflow:0.4">
<start to="sqoop2hive"/>
<action name="sqoop2hive">
<sqoop xmlns="uri:oozie:sqoop-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<command>import --connect "jdbc:teradata://server.co/database=TS<http://server.co/database=TS>"-–driver
Com.teradata.jdbc.TeraDriver--username sqoop --password sqoop --table test --hive-import --hive-
table test</command>
<archive>tdgssconfig.jar</archive>
<archive>terajdbc4.jar</archive>
<file>hive-site.xml</file>
</sqoop>
<ok to="end"/>
<error to="kill"/>
</action>
<kill name="kill">
<message>Action failed</message>
</kill>
<end name="end"/>
</workflow-app>
Please suggest
Regards,
Chhaya
|