spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shivaram Venkataraman <shivaram.venkatara...@gmail.com>
Subject Re: SizeEstimator.scala
Date Tue, 01 Oct 2013 18:10:34 GMT
Hi

As far as I can tell compressed strings just use a byte[] instead of a
char[] to store data. So I think SizeEstimator just estimates the size
of the byte[] correctly and doesn't need to use any reflection for
this.

Thanks
Shivaram

On Tue, Oct 1, 2013 at 9:42 AM, Jakub Liska <liska.jakub@gmail.com> wrote:
> Hi,
>
> I'm using SizeEstimator and I'm wondering how it is possible that it is able
> to reflect -XX:+UseCompressedStrings JVM option into the estimation ? I
> don't see anything that would take this into consideration but the estimate
> is still accurate. Thanks

Mime
View raw message