lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Markus Jelsma <markus.jel...@openindex.io>
Subject Re: Using multiple CPUs for a single document base?
Date Tue, 31 May 2011 19:44:51 GMT
I haven't given it a try but perhaps opening multiple HTTP connections to the 
update handler will end up in multiple threads thus better CPU utilization. 

Would be nice if someone can prove it here, i'm not in `the lab` right now ;)

> You say it like it's something you have control over; how would one
> choose to use more than one thread when indexing? I guess maybe it
> depends on how you're indexing of course; I guess if you're using SolrJ
> it's straightforward. What if you're using the ordinary HTTP Post
> interface, or DIH?
> 
> On 5/31/2011 3:35 PM, Markus Jelsma wrote:
> > If you use only one thread when indexing then one one core is going to be
> > used.
> > 
> >> On May 31, 2011, at 11:29 AM, Jonathan Rochkind wrote:
> >>> I kind of think you should get multi-CPU use 'for free' as a Java app
> >>> too.
> >> 
> >> Ah, probably experimental error? If I apply a stress load consisting
> >> only of queries, I get automatic multi-core use as expected. I could
> >> see where indexing new dox could tend toward synchronization and
> >> uniprocessing. Perhaps my original test load was too add-centric, does
> >> that make sense?
> >> 
> >> -==-
> >> Jack Repenning
> >> Technologist
> >> Codesion Business Unit
> >> CollabNet, Inc.
> >> 8000 Marina Boulevard, Suite 600
> >> Brisbane, California 94005
> >> office: +1 650.228.2562
> >> twitter: http://twitter.com/jrep

Mime
View raw message