[ https://issues.apache.org/jira/browse/TIKA-867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jukka Zitting resolved TIKA-867.
--------------------------------
Resolution: Not A Problem
The rationale why we did TIKA-324 is that the default platform encoding as reported by the
JVM on Mac OS X is different than what the console is using.
AFAICT this is not the case on Windows. The reason you're seeing a problem here is that you're
explicitly parsing the output as UTF-8 instead of using the default platform encoding. Using
UTF-8 is fine, but as you say, you'll then want to explicitly tell Tika with the -e option
to encode its output as UTF-8 instead of using the default encoding.
To see the difference and the rationale for why Tika uses the platform default encoding instead
of always UTF-8 for the --text output, try running {{java -jar tika-app-1.1.jar test.doc}}
in a Windows command prompt using a document that contains non-ASCII content. By default the
output is correct, but if you explicitly set the encoding to UTF-8, the output gets garbled
by the command prompt window.
> UTF-8 encoding does not work on windows
> ---------------------------------------
>
> Key: TIKA-867
> URL: https://issues.apache.org/jira/browse/TIKA-867
> Project: Tika
> Issue Type: Bug
> Components: cli
> Affects Versions: 1.0
> Environment: Windows 7 Enterprise (Java 1.6.0_31) and MAC OS X 10.7.3 (Java 1.6.0_30)
> Reporter: Wolfgang Außerlechner
> Attachments: TIKA-867.patch
>
>
> When calling tika as command line tool from within java and parsing the output buffer
with UTF-8 (e.g. new String(buffer, 0, len, Charset.forName("UTF-8"));) behaviour on windows
is different than on mac os.
> On windows the encoding seems to be wrong (Währung vs. W?hrung). Other tools like exiftool
work as expected.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
|