hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Swapnil Daingade (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11044) FileSystem counters can overflow for large number of readOps, largeReadOps, writeOps
Date Fri, 05 Sep 2014 18:36:29 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123342#comment-14123342

Swapnil Daingade commented on HADOOP-11044:

Looked at the test failures. Not sure if these are directly related to the fix. I had submitted
the exact same patch earlier. The two tests that had failed earlier org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract
and org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover have now passed and a
test that had passed earlier org.apache.hadoop.ipc.TestFairCallQueue has now failed. I still
cannot access the diffJavacWarnings.txt from the testReport to fix the increase in the number
of warnings.
It would be great if someone can take a look at this. Please let me know if there is something
more that I can do to help with the patch.

> FileSystem counters can overflow for large number of readOps, largeReadOps, writeOps
> ------------------------------------------------------------------------------------
>                 Key: HADOOP-11044
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11044
>             Project: Hadoop Common
>          Issue Type: Improvement
>    Affects Versions: 2.5.0, 2.4.1
>            Reporter: Swapnil Daingade
>            Priority: Minor
>         Attachments: 11044.patch4
> The org.apache.hadoop.fs.FileSystem.Statistics.StatisticsData class defines readOps,
largeReadOps, writeOps as int. Also the The org.apache.hadoop.fs.FileSystem.Statistics class
has methods like getReadOps(), getLargeReadOps() and getWriteOps() that return int. These
int values can overflow if the exceed 2^31-1 showing negative values. It would be nice if
these can be changed to long.

This message was sent by Atlassian JIRA

View raw message