lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jayendra patil <jayendra.pa...@gmail.com>
Subject Re: Solrj ContentStreamUpdateRequest Slow
Date Thu, 05 Aug 2010 03:11:30 GMT
ContentStreamUpdateRequest seems to read the file contents and transfer it
over http, which slows down the indexing.

Try Using StreamingUpdateSolrServer with stream.file param @
http://wiki.apache.org/solr/SolrPerformanceFactors#Embedded_vs_HTTP_Post

e.g.

SolrServer server = new StreamingUpdateSolrServer("Solr Server URL",20,8);
UpdateRequest req = new UpdateRequest("/update/extract");
ModifiableSolrParams params = null ;
params = new ModifiableSolrParams();
params.add("stream.file", new String[]{"local file path"});
params.set("literal.id", value);
req.setParams(params);
server.request(req);
server.commit();

Regards,
Jayendra

On Wed, Aug 4, 2010 at 3:01 PM, Tod <listacctc@gmail.com> wrote:

> I'm running a slight variation of the example code referenced below and it
> takes a real long time to finally execute.  In fact it hangs for a long time
> at solr.request(up) before finally executing.  Is there anything I can look
> at or tweak to improve performance?
>
> I am also indexing a local pdf file, there are no firewall issues, solr is
> running on the same machine, and I tried the actual host name in addition to
> localhost but nothing helps.
>
>
> Thanks - Tod
>
> http://wiki.apache.org/solr/ContentStreamUpdateRequestExample
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message