lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paras Lehana <paras.leh...@indiamart.com>
Subject Re: Atomic solrj update
Date Mon, 16 Dec 2019 06:45:01 GMT
Hi Prem,

Using HTTPClient to establish connection and also i am *validating* whether
> the particular document is *available* in collection or not and after that
> updating the document.


 Why do you need to validate the particular document before updating.
Atomic updates either update the document if it's already available or
create the document if it's not. I guess you don't want to create the
document if it doesn't exist, right?



On Fri, 13 Dec 2019 at 11:42, Shawn Heisey <apache@elyograg.org> wrote:

> On 12/12/2019 10:00 PM, Prem wrote:
> > I am trying to partially update of 50M data in a collection from CSV
> using
> > Atomic script(solrj).But it is taking 2 hrs for 1M records.is there
> anyway i
> > can speed up my update.
>
> How many documents are you sending in one request?
>
> > Using HTTPClient to establish connection and also i am validating whether
> > the particular document is available in collection or not and after that
> > updating the document.
>
> I thought you were using SolrJ ... but here you say you're using
> HTTPClient.
>
> Can you share your code?  What Solr server version? If you're using
> SolrJ, what version of that?
>
> If your program checks whether every single document already exists
> before sending an update, that is going to be quite slow.
>
> Thanks,
> Shawn
>


-- 
-- 
Regards,

*Paras Lehana* [65871]
Development Engineer, Auto-Suggest,
IndiaMART Intermesh Ltd.

8th Floor, Tower A, Advant-Navis Business Park, Sector 142,
Noida, UP, IN - 201303

Mob.: +91-9560911996
Work: 01203916600 | Extn:  *8173*

-- 
*
*

 <https://www.facebook.com/IndiaMART/videos/578196442936091/>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message