spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shivaram Venkataraman <>
Subject Re: SizeEstimator.scala
Date Tue, 01 Oct 2013 18:10:34 GMT

As far as I can tell compressed strings just use a byte[] instead of a
char[] to store data. So I think SizeEstimator just estimates the size
of the byte[] correctly and doesn't need to use any reflection for


On Tue, Oct 1, 2013 at 9:42 AM, Jakub Liska <> wrote:
> Hi,
> I'm using SizeEstimator and I'm wondering how it is possible that it is able
> to reflect -XX:+UseCompressedStrings JVM option into the estimation ? I
> don't see anything that would take this into consideration but the estimate
> is still accurate. Thanks

View raw message