falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peeyush Bishnoi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1038) Log mover fails for map-reduce action
Date Thu, 04 Jun 2015 09:09:38 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14572415#comment-14572415
] 

Peeyush Bishnoi commented on FALCON-1038:
-----------------------------------------

Patch is attached that will now copy the job logs for Oozie actions (mapreduce,java,pig,hive)
to staging directory on HDFS. To get the job logs for Pig and Hive action, getId() need to
be used instead of getExternalId() which is for Oozie engine. Please review.

> Log mover fails for map-reduce action
> -------------------------------------
>
>                 Key: FALCON-1038
>                 URL: https://issues.apache.org/jira/browse/FALCON-1038
>             Project: Falcon
>          Issue Type: Improvement
>          Components: common
>    Affects Versions: 0.7
>         Environment: QA
>            Reporter: Pragya Mittal
>            Assignee: Peeyush Bishnoi
>
> For workflow containing map-reduce actions, log mover fails to create success file in
staging directory.
> {code}
> 00,499 INFO [uber-SubtaskRunner] org.apache.falcon.logging.JobLogMover: Ignoring hadoop
TT log for non-pig and non-java action: :start:
> 2015-02-18 07:19:00,499 INFO [uber-SubtaskRunner] org.apache.falcon.logging.JobLogMover:
Ignoring hadoop TT log for non-pig and non-java action: aggregator
> 2015-02-18 07:19:00,499 INFO [uber-SubtaskRunner] org.apache.falcon.logging.JobLogMover:
Ignoring hadoop TT log for non-pig and non-java action: end
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message