hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kevin Apte <technicalarchitect2...@gmail.com>
Subject Re: client side bloom filters
Date Tue, 04 Jan 2011 06:45:42 GMT
How often does the set of keys change ?  The Bloom filter needs to be
recalculated as the set changes.

But although  Bloom filters have about 1 %  false positive rate-they do not
cause inconsistency...  1 % of the time you will search the Base when the
key is absent.....

 On Jan 3, 2011 4:40 PM, "Ryan Rawson" <ryanobjc@gmail.com> wrote:
> bloom filters are a feature of the hfile, so it might not make a lot
> of direct sense to expose them. However they should accelerate
> requests when there is nothing there.
>
> -ryan
>
> On Mon, Jan 3, 2011 at 1:36 PM, Abhijit Pol <apol@rocketfuel.com> wrote:
>> Is there any work done or thoughts went into exposing bloom filters on
>> client side?
>>
>> We have use case where 40-50% of lookup keys don't exists in HBase (new
keys
>> or keys we don't care to store). We don't have strong
>> consistency requirements and seems like avoiding these ~40% requests
going
>> to HBase server should help.
>>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message