incubator-droids-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ryan McKinley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (DROIDS-46) MultiThreadedTaskMaster (WorkRunner) memory leak
Date Wed, 22 Apr 2009 19:08:47 GMT

    [ https://issues.apache.org/jira/browse/DROIDS-46?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12701654#action_12701654
] 

Ryan McKinley commented on DROIDS-46:
-------------------------------------

this patch merges The SimpleTaskMaster with the MultiThreadedTaskMaster.

The big change is that the loop in MultiThreadedTaskMaster#processAllTasks() happens in its
own thread.  This gives the same behavior as the existing implementation.

> MultiThreadedTaskMaster (WorkRunner) memory leak
> ------------------------------------------------
>
>                 Key: DROIDS-46
>                 URL: https://issues.apache.org/jira/browse/DROIDS-46
>             Project: Droids
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.01
>            Reporter: Mingfai Ma
>            Priority: Blocker
>         Attachments: DROIDS-46-MultiThreadedTaskMaster.patch, DROIDS-46-SimpleTaskMaster-GC.png,
SimpleTaskMaster.java
>
>
> In a Droids job that has been run for around 6 hours, it eats a lot of memory that cannot
be free by the GC. with "jmap -histo", the report shows there are 1.5m instance of MultiThreadedTaskMaster$WorkerRunner
and LinkedBlockingQueue$Node that consumes 594+475m memory. The instance cannot be free by
any full GC (and they reside in tenured generation of the heap)
>  num     #instances         #bytes  class name
> ----------------------------------------------
>    1:        957740     1007648216  [C
>    2:      14874175      594967000  org.apache.droids.impl.MultiThreadedTaskMaster$WorkerRunner
>    3:      14873977      475967264  java.util.concurrent.LinkedBlockingQueue$Node
> For #1, I'm not use what's that but that may be a problem with my own program. But #2
and #3 shall come from Droids. I haven't checked the source of MultiThreadedTaskMaster yet
and it would be great if the original developer could take a quick look to see if there are
any chance that the WorkRunner may be referenced.
> Besides, there is another issue related to MultiThreadedTaskMaster DROIDS-43

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message