manifoldcf-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ameya Aware <ameya.aw...@gmail.com>
Subject Performance issues
Date Thu, 17 Jul 2014 15:26:46 GMT
Hi

I have millions of documents to crawl and send them to Solr.

But when i run it for thousands documents, it takes too much time for it or
sometimes it even hangs up.

So what could be the way to reduce the performance time?

Also, i do not need content of the documents, i just need metadata, so can
i skip content part from reading and fetching and will that improve
performance time?


Thanks,
Ameya

Mime
View raw message