tika-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Basran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TIKA-2180) Multiple requests on Tika to extract text slows down
Date Thu, 01 Dec 2016 22:05:58 GMT

    [ https://issues.apache.org/jira/browse/TIKA-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15713218#comment-15713218
] 

Ashish Basran commented on TIKA-2180:
-------------------------------------

With 100 documents it look like following. I aborted after waiting for ~25 minutes.

BatchProcess:The directory crawler has considered 100 files, and it has added 100 files.
BatchProcess:
BatchProcess:The directory crawler has completed its crawl.
BatchProcess:
BatchProcess:Processed 0 documents in 20 minutes, 40 seconds (0 docs per sec).
BatchProcess:There have been 0 handled exceptions.
BatchProcess:A thread has been working on Document (68).docx for 1488.018 seconds.
BatchProcess:A thread has been working on Document (41).docx for 1496.067 seconds.
BatchProcess:A thread has been working on Document (91).docx for 1498.749 seconds.
BatchProcess:A thread has been working on Document (45).docx for 1514.794 seconds.
BatchProcess:There are 0 file processors still active.

Command used: 
.\java.exe -jar D:\Tika\Tika\tika-app-1.14.jar -i D:\Tika\Tika\Process -o D:\Tika\Tika\Output
-numConsumers 4

> Multiple requests on Tika to extract text slows down
> ----------------------------------------------------
>
>                 Key: TIKA-2180
>                 URL: https://issues.apache.org/jira/browse/TIKA-2180
>             Project: Tika
>          Issue Type: Bug
>          Components: server
>    Affects Versions: 1.13, 1.14
>         Environment: Windows OS, Open JDK, 4 core 32 GB RAM
>            Reporter: Ashish Basran
>
> I observed that if I send multiple requests to Tika (eg. http://localhost:8080/tika)
with around 5MB files, Tika is very slow in completing the action. I tried with ~20 random
files, it took 170 seconds to process all the files in sequence. If I pass all files in parallel,
it took around 780 seconds to process same set of files. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message