commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Neidhart (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (MATH-1070) Incorrect rounding of float
Date Thu, 09 Jan 2014 13:18:54 GMT

     [ https://issues.apache.org/jira/browse/MATH-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Thomas Neidhart resolved MATH-1070.
-----------------------------------

    Resolution: Fixed

Could you please create a different issue for this problem.

Calling Precision.round(x, y) will use the rounding mode ROUND_HALF_UP thus is it different
to the problem reported before.

> Incorrect rounding of float
> ---------------------------
>
>                 Key: MATH-1070
>                 URL: https://issues.apache.org/jira/browse/MATH-1070
>             Project: Commons Math
>          Issue Type: Bug
>    Affects Versions: 3.2
>         Environment: Windows 7, IntelliJ IDEA 10.5.4.
>            Reporter: Oleksandr Muliarevych
>            Priority: Critical
>             Fix For: 3.3
>
>
> package org.apache.commons.math3.util 
> example of usage of round functions of Precision class:
> Precision.round(0.0f, 2, BigDecimal.ROUND_UP) = 0.01
> Precision.round((float)0.0, 2, BigDecimal.ROUND_UP) = 0.01
> Precision.round((float) 0.0, 2) = 0.0
> Precision.round(0.0, 2, BigDecimal.ROUND_UP) = 0.0
> Seems the reason is usage of extending float to double inside round functions and getting
influence of memory trash as value.
> I think, same problem will be found at usage of other round modes.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message