nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julien Nioche (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-887) Delegate parsing of feeds to Tika
Date Mon, 09 May 2011 07:48:03 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13030639#comment-13030639
] 

Julien Nioche commented on NUTCH-887:
-------------------------------------

This issue is about parse-feeds and it requires some changes to the way Nutch 2.0 works (compound
docs - see comments above). Let's leave it open for now

> Delegate parsing of feeds to Tika
> ---------------------------------
>
>                 Key: NUTCH-887
>                 URL: https://issues.apache.org/jira/browse/NUTCH-887
>             Project: Nutch
>          Issue Type: Wish
>          Components: parser
>    Affects Versions: 2.0
>            Reporter: Julien Nioche
>             Fix For: 2.0
>
>
> [Starting a new thread from https://issues.apache.org/jira/browse/NUTCH-874]
> One of the plugins which hasn't been ported yet is the feed parser. We could rely on
the one we recently added to Tika, knowing that there is a substantial difference in the sense
that the Tika feed parser generates a simple XHTML representation of the document where the
feeds are simply represented as anchors whereas the Nutch version created new documents for
each feed.
> There is also the parse-rss plugin in Nutch which is quite similar - what's the difference
with the feed one again? Since the Tika parser would handle all sorts of feed formats why
not simply rely on it? 
> Any thoughts on this?

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message