tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhiyuan Yang (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (TEZ-3869) Analyzer: Fix VertexInfo::getLastTaskToFinish comparison
Date Fri, 05 Jan 2018 00:18:24 GMT

     [ https://issues.apache.org/jira/browse/TEZ-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhiyuan Yang closed TEZ-3869.
-----------------------------

> Analyzer: Fix VertexInfo::getLastTaskToFinish comparison
> --------------------------------------------------------
>
>                 Key: TEZ-3869
>                 URL: https://issues.apache.org/jira/browse/TEZ-3869
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Minor
>             Fix For: 0.9.1
>
>         Attachments: TEZ-3869.1.patch, TEZ-3869.2.patch
>
>
> {{VertexInfo::getLastTaskToFinish}} incorrectly compares with getStartTimeInterval. This
needs to be fixed. Observed timsort exceptions when analyzing some dag zips. 
> {code}
> java.lang.IllegalArgumentException: Comparison method violates its general contract!
> 	at java.util.TimSort.mergeHi(TimSort.java:895)
> 	at java.util.TimSort.mergeAt(TimSort.java:512)
> 	at java.util.TimSort.mergeForceCollapse(TimSort.java:453)
> 	at java.util.TimSort.sort(TimSort.java:250)
> 	at java.util.Arrays.sort(Arrays.java:1435)
> 	at java.util.Collections.sort(Collections.java:230)
> 	at org.apache.tez.history.parser.datamodel.VertexInfo.getLastTaskToFinish(VertexInfo.java:542)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message