tika-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Allison (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TIKA-2645) Reuse SAXParsers where possible
Date Mon, 21 May 2018 19:00:00 GMT

    [ https://issues.apache.org/jira/browse/TIKA-2645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482909#comment-16482909
] 

Tim Allison commented on TIKA-2645:
-----------------------------------

For posterity, some points before I forget:

1) we should figure out how to autosize thread count
2) I did a dodgy copy/paste into MimeTypesReader for a separate pool because the SAXParser
used there has to be namespace unaware in contrast to the one we use with our regular parsers.
 We should refactor to make this cleaner.

> Reuse SAXParsers where possible
> -------------------------------
>
>                 Key: TIKA-2645
>                 URL: https://issues.apache.org/jira/browse/TIKA-2645
>             Project: Tika
>          Issue Type: Task
>            Reporter: Tim Allison
>            Assignee: Tim Allison
>            Priority: Major
>             Fix For: 1.19, 2.0.0
>
>
> [~wastl-nagel] pointed out on the [user list|https://lists.apache.org/thread.html/54913f29cd83bba175f77a2d6a4902bb3a5cba2fa495bbfd6012024a@%3Cuser.tika.apache.org%3E]
that there can be thread contention when creating SAXParsers.  [~jukkaz] recommended pooling
SAXParsers.
> I noticed a modest improvement in speed when parsing docx files with our SAX based parser,
and I suspect that [~wastl-nagel] will find an even greater improvement during detection because
we're currently creating a new SAXParser on every call to detect an XML root.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message