tika-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Allison (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TIKA-2180) Multiple requests on Tika to extract text slows down
Date Thu, 08 Dec 2016 19:07:58 GMT

    [ https://issues.apache.org/jira/browse/TIKA-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15733119#comment-15733119
] 

Tim Allison commented on TIKA-2180:
-----------------------------------

Further smallish tests...

New parser via tika-server (20 copies of War and Peace):
||Number of Threads||Seconds||
|1|75|
|5|22|
|10|20|

New parser via tika-app (20 copies of War and Peace)

||Number of Threads||Seconds||
|1|60|
|5|22|
|10|19|

I've been worried about overhead with tika-server.  This suggests that they are roughly equivalent.

Tika-app took 228 seconds with -Xmx6g with the DOM docx parser for the 20 copies of War and
Peace.  I couldn't do multi-threading because of memory limits.

These are not definitive performance tests, I'd want multiple runs to establish confidence
intervals, and I'd want to run on a broader set of documents.  War and Peace is an outlier,
no doubt...

YMMV...

> Multiple requests on Tika to extract text slows down
> ----------------------------------------------------
>
>                 Key: TIKA-2180
>                 URL: https://issues.apache.org/jira/browse/TIKA-2180
>             Project: Tika
>          Issue Type: Bug
>          Components: server
>    Affects Versions: 1.13, 1.14
>         Environment: Windows OS, Open JDK, 4 core 32 GB RAM
>            Reporter: Ashish Basran
>         Attachments: screenshot-1.png, screenshot-2.png, screenshot-3.png, with new experimental
SAX docx parser.png
>
>
> I observed that if I send multiple requests to Tika (eg. http://localhost:8080/tika)
with around 5MB files, Tika is very slow in completing the action. I tried with ~20 random
files, it took 170 seconds to process all the files in sequence. If I pass all files in parallel,
it took around 780 seconds to process same set of files. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message