incubator-droids-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mingfai Ma (JIRA)" <j...@apache.org>
Subject [jira] Commented: (DROIDS-46) MultiThreadedTaskMaster (WorkRunner) memory leak
Date Wed, 15 Apr 2009 14:25:15 GMT

    [ https://issues.apache.org/jira/browse/DROIDS-46?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699215#action_12699215
] 

Mingfai Ma commented on DROIDS-46:
----------------------------------

with some investigation and research, it seems the problem come from LinkedBlockingQueue.
we are not alone in getting memory leak for using LinkedBlockingQueue, 
http://cs.oswego.edu/pipermail/concurrency-interest/2005-January/001319.html
http://cs.oswego.edu/pipermail/concurrency-interest/2009-February/005829.html | http://thread.gmane.org/gmane.comp.java.jsr.166-concurrency/5758

There is at least one open bug:
http://bugs.sun.com/view_bug.do?bug_id=6805775

My case seems to be different from the jdk bug above. I found that the WorkerRunner reside
in tenured cannot be clear even with a full GC. 

> MultiThreadedTaskMaster (WorkRunner) memory leak
> ------------------------------------------------
>
>                 Key: DROIDS-46
>                 URL: https://issues.apache.org/jira/browse/DROIDS-46
>             Project: Droids
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.01
>            Reporter: Mingfai Ma
>            Priority: Blocker
>
> In a Droids job that has been run for around 6 hours, it eats a lot of memory that cannot
be free by the GC. with "jmap -histo", the report shows there are 1.5m instance of MultiThreadedTaskMaster$WorkerRunner
and LinkedBlockingQueue$Node that consumes 594+475m memory. The instance cannot be free by
any full GC (and they reside in tenured generation of the heap)
>  num     #instances         #bytes  class name
> ----------------------------------------------
>    1:        957740     1007648216  [C
>    2:      14874175      594967000  org.apache.droids.impl.MultiThreadedTaskMaster$WorkerRunner
>    3:      14873977      475967264  java.util.concurrent.LinkedBlockingQueue$Node
> For #1, I'm not use what's that but that may be a problem with my own program. But #2
and #3 shall come from Droids. I haven't checked the source of MultiThreadedTaskMaster yet
and it would be great if the original developer could take a quick look to see if there are
any chance that the WorkRunner may be referenced.
> Besides, there is another issue related to MultiThreadedTaskMaster DROIDS-43

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message