tika-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Markus Jelsma (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (TIKA-1599) Switch from TagSoup to JSoup
Date Thu, 10 Dec 2015 10:11:11 GMT

     [ https://issues.apache.org/jira/browse/TIKA-1599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Markus Jelsma updated TIKA-1599:
--------------------------------
    Attachment: TIKA-1599-crazy-files.tar.gz

Here are some crazy files from our tests :

* maszol - no title reported in characters() method
* newyorker - incorrectly closes a DIV tag and therefore misses the closing NAV tag. See line
~249
* rtlnieuws-emptystackexception - our content handler trips over something, causing ESE in
endElement()
* techhive - some date block is not reported in SAX events
* aljazeera2 - there is no title because the div in the head
* assemblydems - moved the title tag from the head section to the bottom of the page
* events - title text not reported in the content handler's characters() method
* greenenergy4us - page actually manages to have two bodies AND and  DOCTYPE on top of every
article

> Switch from TagSoup to JSoup
> ----------------------------
>
>                 Key: TIKA-1599
>                 URL: https://issues.apache.org/jira/browse/TIKA-1599
>             Project: Tika
>          Issue Type: Improvement
>          Components: parser
>    Affects Versions: 1.7, 1.8
>            Reporter: Ken Krugler
>            Assignee: Ken Krugler
>            Priority: Minor
>         Attachments: TIKA-1599-crazy-files.tar.gz, tagsoup_vs_jsoup_reports.zip
>
>
> There are several Tika issues related to how TagSoup cleans up HTML ([TIKA-381], [TIKA-985],
maybe [TIKA-715]), but TagSoup doesn't seem to be under active development.
> On the other hand I know of several projects that are now using [JSoup|https://github.com/jhy/jsoup],
which is an active project (albeit only one main contributor) under the MIT license.
> I haven't looked into how hard it would be to switch this dependency.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message