lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Markus Jelsma <markus.jel...@openindex.io>
Subject RE: Distributed IDF performance
Date Wed, 18 Mar 2015 22:55:47 GMT
Anshum, Jack - don't any of you have a cluster at hand to get some real results on this? After
testing the actual functionality for a quite some time while the final patch was in development,
we have not had the change to work on performance tests. We are still on Solr 4.10 and have
to port lots of Lucene stuff to 5. I would sure like to see some numbers from any of you :)

Markus
 
 
-----Original message-----
> From:Anshum Gupta <anshum@anshumgupta.net>
> Sent: Friday 13th March 2015 23:33
> To: solr-user@lucene.apache.org
> Subject: Re: Distributed IDF performance
> 
> np!
> 
> I forgot to mention that I didn't notice any considerable performance hit
> in my tests. The QTimes were barely off by 5%.
> 
> On Fri, Mar 13, 2015 at 3:13 PM, Jack Krupansky <jack.krupansky@gmail.com>
> wrote:
> 
> > Oops... I said "StatsInfo" and that should have been "StatsCache"
> > ("<statsCache .../>").
> >
> > -- Jack Krupansky
> >
> > On Fri, Mar 13, 2015 at 6:04 PM, Anshum Gupta <anshum@anshumgupta.net>
> > wrote:
> >
> > > There's no rough formula or performance data that I know of at this
> > point.
> > > About he guidance, if you want to use Global stats, my obvious choice
> > would
> > > be to use the LRUStatsCache.
> > > Before committing, I did run some tests on my macbook but as I said back
> > > then, they shouldn't be totally taken at face value. The tests didn't
> > > involve any network and were just about 20mn docs and synthetic queries.
> > >
> > > On Fri, Mar 13, 2015 at 2:08 PM, Jack Krupansky <
> > jack.krupansky@gmail.com>
> > > wrote:
> > >
> > > > Does anybody have any actual performance data or even a rough formula
> > for
> > > > calculating the overhead for using the new Solr 5.0 Distributed IDF (
> > > > SOLR-1632 <https://issues.apache.org/jira/browse/SOLR-1632>)?
> > > >
> > > > And any guidance as far as which StatsInfo plugin is best to use?
> > > >
> > > > Are many people now using Distributed IDF as their default?
> > > >
> > > > I'm not currently using this, but the existing doc and Jira is too
> > > minimal
> > > > to offer guidance as requested above. Mostly I'm just curious.
> > > >
> > > > Thanks.
> > > >
> > > > -- Jack Krupansky
> > > >
> > >
> > >
> > >
> > > --
> > > Anshum Gupta
> > >
> >
> 
> 
> 
> -- 
> Anshum Gupta
> 

Mime
View raw message