incubator-droids-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mingfai Ma (JIRA)" <>
Subject [jira] Commented: (DROIDS-46) MultiThreadedTaskMaster (WorkRunner) memory leak
Date Wed, 15 Apr 2009 14:25:15 GMT


Mingfai Ma commented on DROIDS-46:

with some investigation and research, it seems the problem come from LinkedBlockingQueue.
we are not alone in getting memory leak for using LinkedBlockingQueue, |

There is at least one open bug:

My case seems to be different from the jdk bug above. I found that the WorkerRunner reside
in tenured cannot be clear even with a full GC. 

> MultiThreadedTaskMaster (WorkRunner) memory leak
> ------------------------------------------------
>                 Key: DROIDS-46
>                 URL:
>             Project: Droids
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.01
>            Reporter: Mingfai Ma
>            Priority: Blocker
> In a Droids job that has been run for around 6 hours, it eats a lot of memory that cannot
be free by the GC. with "jmap -histo", the report shows there are 1.5m instance of MultiThreadedTaskMaster$WorkerRunner
and LinkedBlockingQueue$Node that consumes 594+475m memory. The instance cannot be free by
any full GC (and they reside in tenured generation of the heap)
>  num     #instances         #bytes  class name
> ----------------------------------------------
>    1:        957740     1007648216  [C
>    2:      14874175      594967000  org.apache.droids.impl.MultiThreadedTaskMaster$WorkerRunner
>    3:      14873977      475967264  java.util.concurrent.LinkedBlockingQueue$Node
> For #1, I'm not use what's that but that may be a problem with my own program. But #2
and #3 shall come from Droids. I haven't checked the source of MultiThreadedTaskMaster yet
and it would be great if the original developer could take a quick look to see if there are
any chance that the WorkRunner may be referenced.
> Besides, there is another issue related to MultiThreadedTaskMaster DROIDS-43

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message