lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yonik Seeley <ysee...@gmail.com>
Subject Re: What's the purpose of the bits option in compositeId (Solr 4.5)?
Date Tue, 08 Oct 2013 22:45:47 GMT
On Tue, Oct 8, 2013 at 6:29 PM, Brett Hoerner <brett@bretthoerner.com> wrote:
> I'm curious what the later "shard-local" bits do, if anything?
>
> I have a very large cluster (256 shards) and I'm sending most of my data
> with a single "composite", e.g. 1234!<unique_id>, but I'm noticing the data
> is being split among many of the shards.

That shouldn't be the case.  All of your shards should have a lower
hash value with all 0 bits and an upper hash value of all 1s (i.e.
0x????0000 to 0x????ffff)
So you see any shards where that's not true?

Also, is the router set to compositeId?

-Yonik

> My guess right now is that since I'm only using the default 16 bits my data
> is being split across multiple shards (because of my high # of shards).
>
> Thanks,
> Brett

Mime
View raw message