uima-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dennis Bauer (JIRA)" <...@uima.apache.org>
Subject [jira] [Commented] (UIMA-5306) Memory Improvement - Unnecessary leaks
Date Fri, 10 Feb 2017 09:35:41 GMT

    [ https://issues.apache.org/jira/browse/UIMA-5306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860985#comment-15860985

Dennis Bauer commented on UIMA-5306:

Another question in this context is, as we understand this part of code, that with increasing
size of the typesystem the array-sizes grow up.
How is it about the import algorithm of these typesystems, are they recognized as duplicated
if I would try to add two times the same, so that only the first will be added?
Or does it behave the other way, that all typesystems were added without any check?

> Memory Improvement - Unnecessary leaks
> --------------------------------------
>                 Key: UIMA-5306
>                 URL: https://issues.apache.org/jira/browse/UIMA-5306
>             Project: UIMA
>          Issue Type: Improvement
>          Components: Ruta
>    Affects Versions: 2.3
>         Environment: Windows 10, JVM with -Xmx 1024, Java JDK 1.8., 16gb memory
>            Reporter: Dennis Bauer
>            Assignee: Peter Kl├╝gl
> In a productive setup we figured out, that there is a huge memory usage of Ruta itself.
With JVisualVM it's easy to see, that there is a relative small amount of arrays of Arraylists
but with a high memory consumption (250k instances result in 243 000 000 byte memory that
are reserved)
> The problem is, that in a clustered SaaS environment with less memory, these arrays block
relevant space in memory. A deeper look into these Arrays of Arraylist let suggest the class
> A look at this class show three arrays that are instanced with the max. possible value,
that can be returned by the typesystem of CAS. 
> {code:Java}
>   private int[] partOf = new int[((TypeSystemImpl) getCAS().getTypeSystem()).getLargestTypeCode()];
>   private Collection<?>[] beginMap = new ArrayList<?>[((TypeSystemImpl) getCAS().getTypeSystem())
>           .getLargestTypeCode()];
>   private Collection<?>[] endMap = new ArrayList<?>[((TypeSystemImpl) getCAS().getTypeSystem())
>           .getLargestTypeCode()];
> {code}
> In this improvement should be done an dynamic allocation of memory usage for these arrays,
so the total memory consumption would be reduced.

This message was sent by Atlassian JIRA

View raw message