tika-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Allison (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (TIKA-2833) Add a CSV/TSV detector
Date Thu, 28 Feb 2019 19:32:00 GMT

    [ https://issues.apache.org/jira/browse/TIKA-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780851#comment-16780851
] 

Tim Allison edited comment on TIKA-2833 at 2/28/19 7:31 PM:
------------------------------------------------------------

The newer reports on csvs alone look decent.  There are some files that now cause parse exceptions
because they have malformed encapsulation.

The most common:
{noformat}
"the","quick"brown"fox","jumped"
{noformat}

{noformat}
"the","quick","
"brown fox","jumped"
{noformat}


was (Author: tallison@mitre.org):
This newer reports on csvs alone look decent.  There are some files that now cause parse exceptions
because they have malformed encapsulation.

The most common:
{noformat}
"the","quick"brown"fox","jumped"
{noformat}

{noformat}
"the","quick","
"brown fox","jumped"
{noformat}

> Add a CSV/TSV detector
> ----------------------
>
>                 Key: TIKA-2833
>                 URL: https://issues.apache.org/jira/browse/TIKA-2833
>             Project: Tika
>          Issue Type: Task
>            Reporter: Tim Allison
>            Priority: Minor
>         Attachments: csv_reports.zip
>
>
> Given initial experimentation, I think we can fairly easily add a fairly robust CSV/TSV
detector that will identify well-formed (ha!) csvs and return the charset encoding and the
delimiter.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message