maven-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tamás Cservenák (JIRA) <j...@codehaus.org>
Subject [jira] Issue Comment Edited: (MINDEXER-18) Indexer is OOM prone while indexing large ZIP files
Date Thu, 31 Mar 2011 12:40:22 GMT

    [ http://jira.codehaus.org/browse/MINDEXER-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=262076#action_262076
] 

Tamás Cservenák edited comment on MINDEXER-18 at 3/31/11 7:38 AM:
------------------------------------------------------------------

While Maven Indexer runs on Java 1.5, this change made it build-able with Java 1.6 only, since
TrueZip library is Java6.

Meaning, while running Maven Indexer on Java 1.5, this fix is not usable, since JVM will refuse
to load TrueZip classes but the library will work as expected. Build now contains animal sniffer
plugin to ensure JVM 1.5 compatibility.

      was (Author: cstamas):
    While Maven Indexer runs on Java 1.5, this change made it build-able with Java 1.6 only,
since TrueZip library is Java6.

Meaning, while running Maven Indexer on Java 1.5, this fix is not usable, since JVM will refuse
to load TrueZip classes.
  
> Indexer is OOM prone while indexing large ZIP files
> ---------------------------------------------------
>
>                 Key: MINDEXER-18
>                 URL: http://jira.codehaus.org/browse/MINDEXER-18
>             Project: Maven Indexer
>          Issue Type: Improvement
>    Affects Versions: 4.0.0
>            Reporter: Tamás Cservenák
>            Assignee: Tamás Cservenák
>             Fix For: 4.1.0
>
>
> Indexer is OOM prone while indexing large ZIP files.
> Users reported that indexer tends to OOM while indexing huge (400MB+) WAR and other ZIP
packed files.
> This is most likely related to JVM NIO bug:
> http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6280693
> Doing ZIP bencharks, searching for alternative ZIP solutions
> https://github.com/cstamas/zip-benchmarks
> More details:
> https://issues.sonatype.org/browse/NEXUS-4100
> Solution: Indexer accesses ZIP files over newly introduced ZipFacade, not directly using
Java's ZipFile anymore. This facade "decides" what implementation should be used. Benchmarking
showed Java's ZipFile as the fastest one, but is OOM prone.
> Next one by speed is TrueZip, but is slower since it's pure java.
> The facade on ZIP files bigger than 100MB will use TrueZip, and on smaller Java's ZIP
solution, the threshold is configurable. See NEXUS-4100 for more.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message