hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Íñigo Goiri (JIRA) <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15475) Fix broken unit tests on Windows
Date Thu, 24 May 2018 16:38:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489337#comment-16489337

Íñigo Goiri commented on HADOOP-15475:

{quote}My ASF volunteer time is almost exclusively for other projects. As a result, Hadoop
builds are pretty much off my radar entirely. Sorry.
Sure, I'll work with [~chris.douglas] on checking the build.
 Feel free to provide feedback in this thread too.

Funny, enough the daily Windows build worked [yesterday|https://builds.apache.org/job/hadoop-trunk-win/476/testReport/].
This includes a couple big fixes like HDFS-13586 which reduced the number of failed unit tests
from 516 to 446.
Internally our errors in branch-2.9 on Windows are 239.
The evolution is as follows:


The unit tests with the most failures at this point are:
 * TestHDFSFileSystemContract 44 failures: issues and deleting paths, I'm guessing a failed
unit test locks it
 * TestAuditLoggerWithCommands 40 failures: I think this must be line separator on Windows
 * TestRawLocalFileSystemContract 21 failures: related to the path
 * TestMetadataStore 18 failures

> Fix broken unit tests on Windows
> --------------------------------
>                 Key: HADOOP-15475
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15475
>             Project: Hadoop Common
>          Issue Type: Test
>            Reporter: Anbang Hu
>            Assignee: Anbang Hu
>            Priority: Minor
> There are hundreds of unit tests that fail on Windows. This JIRA tracks the effort to
fix them.
> The main reasons for unit test failures on Windows are:
> * Windows/Linux path formats (e.g., HDFS-10256).
> * Line separator.
> * Locked files: Windows locks files when opening them.
> ** The typical trigger is not cleaning MiniDFSCluster leaves files locked when a test
times out; they need to be cleaned using After.
> * Memory lock size.
> * Slow DNS resolution (e.g., HDFS-13569).
> * Locked ports (e.g., HDFS-11700)

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message