hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siyao Meng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-16264) [JDK11] Track failing Hadoop unit tests
Date Wed, 01 May 2019 17:09:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-16264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831134#comment-16831134
] 

Siyao Meng commented on HADOOP-16264:
-------------------------------------

Due to [~knanasi]'s finding in HDFS-13933 that OpenJDK 11.0.2 bug have contributed to some
of the test failures, I've run 3.1.2 (+ HADOOP-12760 + HADOOP-15783 + HDFS-13932 + HADOOP-15775
+ HADOOP-16016) unit tests on newer OpenJDK 11.0.3 under Ubuntu 19.04.
There are only 9 maven projects having unit test failures now:
{code}
[INFO] Apache Hadoop Common ............................... FAILURE [23:51 min]
[INFO] Apache Hadoop HDFS ................................. FAILURE [  1.404 s]
[INFO] Apache Hadoop HDFS-RBF ............................. FAILURE [12:10 min]
[INFO] Apache Hadoop YARN NodeManager ..................... FAILURE [15:28 min]
[INFO] Apache Hadoop YARN ResourceManager ................. FAILURE [55:09 min]
[INFO] Apache Hadoop YARN Client .......................... FAILURE [21:17 min]
[INFO] Apache Hadoop YARN TimelineService HBase tests ..... FAILURE [08:26 min]
[INFO] Apache Hadoop MapReduce Core ....................... FAILURE [03:04 min]
[INFO] Apache Hadoop MapReduce JobClient .................. FAILURE [  01:55 h]
{code}
Full log:  [^test-run3-openjdk11.0.3u7-ubuntu19.04.log] 

> [JDK11] Track failing Hadoop unit tests
> ---------------------------------------
>
>                 Key: HADOOP-16264
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16264
>             Project: Hadoop Common
>          Issue Type: Task
>    Affects Versions: 3.1.2
>            Reporter: Siyao Meng
>            Assignee: Siyao Meng
>            Priority: Major
>         Attachments: test-run1.tgz, test-run2.log, test-run2.log.gz
>
>
> Although there are still a lot of work before we could compile Hadoop with JDK 11 (HADOOP-15338),
it is possible to compile Hadoop with JDK 8 and run (e.g. HDFS NN/DN,YARN NM/RM) on JDK 11
at this moment.
> But after compiling branch-3.1.2 with JDK 8, I ran unit tests with JDK 11 and there are
a LOT of unit test failures (44 out of 96 maven projects contain at least one unit test failures
according to maven reactor summary). This may well indicate some functionalities are actually
broken on JDK 11. Some of them already have a jira number. Some of them might have been fixed
in 3.2.0. Some of them might share the same root cause.
> By definition, this jira should be part of HADOOP-15338. But the goal of this one is
just to keep track of unit test failures and (hopefully) resolve all of them soon.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message