manifoldcf-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karl Wright <daddy...@gmail.com>
Subject Re: Performance issues
Date Thu, 17 Jul 2014 16:10:51 GMT
Yes.  Also have a look at the how-to-build-and-deploy page for hints on how
to configure PostgreSQL for maximum performance.

ManifoldCF's performance is almost entirely based on the database.  If you
are using PostgreSQL, which is the fastest ManifoldCF choice, you should be
able to see in the logs when queries take a long time, or when indexes are
automatically rebuilt.  Could you provide any information as to what your
overall system setup looks like?

Karl



On Thu, Jul 17, 2014 at 11:32 AM, Ameya Aware <ameya.aware@gmail.com> wrote:

> http://manifoldcf.apache.org/release/trunk/en_US/performance-tuning.html
>
> This page?
>
> Ameya
>
>
> On Thu, Jul 17, 2014 at 11:28 AM, Karl Wright <daddywri@gmail.com> wrote:
>
>> Hi Ameya,
>>
>> Have you read the performance page?
>>
>> Karl
>>
>> Sent from my Windows Phone
>> ------------------------------
>> From: Ameya Aware
>> Sent: 7/17/2014 11:27 AM
>> To: user@manifoldcf.apache.org
>> Subject: Performance issues
>>
>> Hi
>>
>> I have millions of documents to crawl and send them to Solr.
>>
>> But when i run it for thousands documents, it takes too much time for it
>> or sometimes it even hangs up.
>>
>> So what could be the way to reduce the performance time?
>>
>> Also, i do not need content of the documents, i just need metadata, so
>> can i skip content part from reading and fetching and will that improve
>> performance time?
>>
>>
>> Thanks,
>> Ameya
>>
>
>

Mime
View raw message