commons-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gilles <gil...@harfang.homelinux.org>
Subject [rng] Usefulness of benchmarks
Date Fri, 02 Sep 2016 22:36:50 GMT
Hi.

This page
   
http://commons.apache.org/proper/commons-rng/userguide/rng.html#a3._Performance
presents two sets of benchmarks.

For a long time, I've raised the issue that it might be important
to understand why they don't seem to agree.

Eventually, it seems that performance is not such a great concern
as was made to believe when I initially questioned a few statements
of the then Commons Math code.

The discrepancy between "PerfTestUtils" and JMH could be a bug (in
"PerfTestUtils" of course!) or ... measuring different use-cases:
Use of several RNGs at the same time vs using a single one; the
latter could allow for more aggressive optimizations.

Lacking input as to what the benchmarks purport to demonstrate, I'm
about to simply delete the "PerfTestUtils" column.
The result will be a simplified (maybe simplistic) view of the
relative performance of the RNGs in the "single use" use-case.

Any comment, objection, explanation, suggestion?
[E.g. set up JMH to benchmark the other use case, or a reason why
this is in fact not necessary.]


Thanks,
Gilles


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
For additional commands, e-mail: dev-help@commons.apache.org


Mime
View raw message