nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kaidul Islam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2389) Precise data parsing using Jsoup CSS selectors
Date Wed, 07 Jun 2017 11:37:18 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040739#comment-16040739
] 

Kaidul Islam commented on NUTCH-2389:
-------------------------------------

Hi [~lewismc] I've re-designed significantly and opened a pull request #192. Thank you.

> Precise data parsing using Jsoup CSS selectors
> ----------------------------------------------
>
>                 Key: NUTCH-2389
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2389
>             Project: Nutch
>          Issue Type: New Feature
>          Components: parser
>    Affects Versions: 2.3
>            Reporter: Kaidul Islam
>            Assignee: Kaidul Islam
>             Fix For: 2.4
>
>   Original Estimate: 0.05h
>  Remaining Estimate: 0.05h
>
> As far as I know, currently Nutch 1.x and 2.x has no features to extract/parse exact
contents for specific websites. I've developed a plugin {{parse-jsoup}} using Jsoup for my
current project to extract precise content for site specific crawling using detailed XML configuration(field
name, CSS-selector, attribute, extraction rules, data-type, default-value etc).
> Please let me know if this feature seems relevant and currently not present in Nutch.
I have also plan to export it into Nutch 1.x.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message