jmeter-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Sitnikov <sitnikov.vladi...@gmail.com>
Subject Re: [GitHub] jmeter issue #296: Bug 61078 - Percentile calculation error
Date Wed, 31 May 2017 12:54:38 GMT
Philippe>- switch everywhere to R1 (also in commons-math)

Can you please clarify why do you prefer R1?

I'm inclined to R8 (as it is recommended by R for sample quantile
calculation).

1) I think interpolation would reduce run-to-run variance.
2) Interpolation-like estimation is easier to implement. For instance, if
HdrHistogram estimator is added, then its result would be closer to R8
rather than to R1.

I don't think "the result of 90% is one of the sample response times" is
important. The important stuff is how system under test behaves, and it is
not something tied to a single execution. What I mean is R8 kind of
computation should better approximate the true percentile value than R1
would, and it is the true value that is important to compare and report as
a test result.

Vladimir

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message