tika-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matt Sheppard (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TIKA-911) Converted PDF document contains question marks in place of spaces and inconsistent case
Date Wed, 02 May 2012 04:36:49 GMT
Matt Sheppard created TIKA-911:
----------------------------------

             Summary: Converted PDF document contains question marks in place of spaces and
inconsistent case
                 Key: TIKA-911
                 URL: https://issues.apache.org/jira/browse/TIKA-911
             Project: Tika
          Issue Type: Bug
    Affects Versions: 1.1
            Reporter: Matt Sheppard


The PDF document at http://www.grdc.com.au/uploads/documents/Rust%20Biosecurity%20Brochure.pdf,
when converted with tika v1.1 using

{code}
$ java -jar tika-app-1.1.jar Rust\ Biosecurity\ Brochure.pdf
{code}

Produces substantially worse output than xpdf's pdftotext program.

Specifically, we see...

Some 'spaces' replaced with question marks

{noformat}
...
<body><div class="page"><p/>
<p>How can I help?
When you're overseas:
• ?wherever?possible,?don't?visit?crops?—?contact?with?
</p>
<p>growing?crops?greatly?increases?the?risk?of?contaminating?
footwear?or?clothing;?
...
{noformat}

and some odd case conversions

{noformat}
<p>stem rust in wheat.  
 (soURce: BRAd collIs)</p>
<p/>
</div>
{noformat}

(The original document seems to contain "SOURCE: BRAD COLLIS" all in upper case.


To compare that with pdftotext

{code}
$ ./xpdfbin-linux-3.03/bin32/pdftotext -enc UTF-8 -q ~/Rust\ Biosecurity\ Brochure.pdf
{code}

This does not output the question marks, and produces "Source: BRAD COLLIS" at the end there,
both of which seem to be improvements. Note that it does, however, produce a number of ^G
characters which are not desireable.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message