tika-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nick C (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TIKA-1513) Add mime detection and parsing for dbf files
Date Wed, 20 Apr 2016 02:13:25 GMT

    [ https://issues.apache.org/jira/browse/TIKA-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249129#comment-15249129
] 

Nick C commented on TIKA-1513:
------------------------------

Sounds good. I'll be running this on more files this week and will report back if I notice
any false positives. If you want you can make the field type check stricter which would possibly
prevent other false positives (Replace \[A-Z\@\+\] with \[BCDFGILMNOPQTVWXY\@\+\])

||Details||Regex
|Enable dotall mode (so dots match new lines)|(?s)
|Signature/Version|^\[\x02\x03\x30\x31\x32\x43\x63\x83\x8B\xCB\xF5\xE5\xFB]
|Year (no check)|.
|Month (1-12)|\[\x01-\x0C]
|Day (1-31)|\[\x01-\x1F]
|Record count (uint32, no check)|.\{4}
|Header length (ushort) greater than 65|(.\[^\x00]\|\[\x41-\xFF].)
|Record length (ushort) greater than 1|(\[\^\x00\x01].\|.\[^\x00])
|Skip to first field header|.\{31}
|Make sure field name is null terminated (regex zero-width lookbehind)|(?<=\[\x00]\[^\x00]\{0,10})
|Field type|\[BCDFGILMNOPQTVWXY@+]

Full Regex
{code}
(?s)^[\x02\x03\x30\x31\x32\x43\x63\x83\x8B\xCB\xF5\xE5\xFB].[\x01-\x0C][\x01-\x1F].{4}(?:.[^\x00]|[\x41-\xFF].)(?:[^\x00\x01].|.[^\x00]).{31}(?<=[\x00][^\x00]{0,10})[BCDFGILMNOPQTVWXY@+]
{code}

> Add mime detection and parsing for dbf files
> --------------------------------------------
>
>                 Key: TIKA-1513
>                 URL: https://issues.apache.org/jira/browse/TIKA-1513
>             Project: Tika
>          Issue Type: Improvement
>            Reporter: Tim Allison
>            Priority: Minor
>             Fix For: 1.13
>
>
> I just came across an Apache licensed dbf parser that is available on [maven|https://repo1.maven.org/maven2/org/jamel/dbf/dbf-reader/0.1.0/dbf-reader-0.1.0.pom].
> Let's add dbf parsing to Tika.
> Any other recommendations for alternate parsers?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message