incubator-droids-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thorsten Scherler (JIRA)" <j...@apache.org>
Subject [jira] Closed: (DROIDS-47) SimpleTaskQueue is very slow to init when there is a large number of seed URLs
Date Thu, 07 May 2009 22:58:45 GMT

     [ https://issues.apache.org/jira/browse/DROIDS-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Thorsten Scherler closed DROIDS-47.
-----------------------------------

    Resolution: Fixed
      Assignee:     (was: Thorsten Scherler)

Committed revision 772801.


Thanks Mingfai Ma keep up the good work.

> SimpleTaskQueue is very slow to init when there is a large number of seed URLs
> ------------------------------------------------------------------------------
>
>                 Key: DROIDS-47
>                 URL: https://issues.apache.org/jira/browse/DROIDS-47
>             Project: Droids
>          Issue Type: Improvement
>          Components: core
>    Affects Versions: 0.01
>            Reporter: Mingfai Ma
>         Attachments: DROIDS-47.patch, DROIDS-47_profile-after.png, DROIDS-47_profile.png
>
>
> when i put 300,000 seeds url to CrawlingDroid with SimpleTaskQueueWithHistory and init()
it, it takes an hour to complete on my Quad core server.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message