Enhance content-type detector to recognize almost plain text
------------------------------------------------------------
Key: TIKA-688
URL: https://issues.apache.org/jira/browse/TIKA-688
Project: Tika
Issue Type: Improvement
Components: mime
Affects Versions: 0.9
Reporter: Chris Lott
Priority: Minor
Fix For: 1.0
I am using TIKA to convert a collection of documents that includes files named something.txt.
I use the Tika#parse(InputStream) interface to get a parser that auto detects content. The
files are almost plain text -- the documents have a scattering of control characters in them.
On these text files the reader given to me by the Tika#parse() method immediately returns
null. After some experimentation I found that a single control K character early in the file
will cause the mime type detector to give up and label it application/octet-stream. Please
consider adding a recognizer because it would be great if Tika could clean up these files
by dropping text characters. I note that if I drop this file into the Tika GUI, or if I invoke
Tika on the command line it does well, and I think this behavior is obtained by using the
file name as a hint. I probably should be using a different Tika method, trying to figure
that out next. Thanks for listening.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
|