tika-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TIKA-2330) Prevent preventable OOM in CompressorInputStream
Date Thu, 20 Apr 2017 01:49:04 GMT

    [ https://issues.apache.org/jira/browse/TIKA-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975913#comment-15975913
] 

Hudson commented on TIKA-2330:
------------------------------

SUCCESS: Integrated in Jenkins build Tika-trunk #1242 (See [https://builds.apache.org/job/Tika-trunk/1242/])
TIKA-2330 -- prevent preventable ooms in both detecting and parsing (tallison: [https://github.com/apache/tika/commit/75eea6e5502f4f5a2edf5ab459b4c369d33f66e5])
* (edit) tika-parsers/src/main/java/org/apache/tika/parser/pkg/ZipContainerDetector.java
* (edit) tika-parsers/src/test/java/org/apache/tika/parser/pkg/CompressParserTest.java
* (add) tika-core/src/main/java/org/apache/tika/exception/TikaMemoryLimitException.java
* (edit) tika-parsers/src/test/java/org/apache/tika/detect/TestContainerAwareDetector.java
* (edit) tika-parent/pom.xml
* (add) tika-parsers/src/test/resources/test-documents/testLZMA_oom
* (edit) tika-parsers/pom.xml
* (edit) tika-parsers/src/main/java/org/apache/tika/parser/pkg/CompressorParser.java
* (add) tika-parsers/src/test/resources/test-documents/testZ_oom.Z
* (add) tika-parsers/src/main/java/org/apache/tika/parser/pkg/TikaCompressorStreamFactory.java


> Prevent preventable OOM in CompressorInputStream
> ------------------------------------------------
>
>                 Key: TIKA-2330
>                 URL: https://issues.apache.org/jira/browse/TIKA-2330
>             Project: Tika
>          Issue Type: Improvement
>            Reporter: Tim Allison
>            Priority: Minor
>             Fix For: 1.15
>
>
> On TIKA-1631, users noted that merely detecting an {{x-compress}} file could cause an
OOM because we were instantiating the stream as part of detection. 
> On COMPRESS-382, [~lfcnassif] noted that something similar happens with LZMA.
> Let's work with the Compress project to:
> 1) add a static {{detect}} that doesn't instantiate the streams (COMPRESS-385)
> 2) allow a parameterizable limit on the amount of allocated space for {{x-compress}}
(COMPRESS-386) and {{LZMA}} (COMPRESS-382)
> Until we have a chance to make these changes in the compress project, let's temporarily
copy/paste/update from Compress to fix these within Tika.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message