nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "kiran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-1467) nutch 1.5.1 not able to parse mutliValued metatags
Date Sat, 02 Mar 2013 22:23:13 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13591547#comment-13591547
] 

kiran commented on NUTCH-1467:
------------------------------

Sebastian,

I am working on your suggestions and i have a small doubt. 

Aren't we using generalTags in HTMLMetaTags.java because we want to control through the MetaTagsParser.java
in parse-metatags plugin which metatags go in to metadata ?

If i replace generalTags with metadata.add(name,value) in HTMLMetaProcessor in parse-html
and parse-tika, won't I be adding the tags directly to the metadata which won't serve the
purpose of controlling what metaTags be added to metadata through MetaTagsParser.java ? 

Please correct me if i am wrong.

                
> nutch 1.5.1 not able to parse mutliValued metatags
> --------------------------------------------------
>
>                 Key: NUTCH-1467
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1467
>             Project: Nutch
>          Issue Type: Bug
>    Affects Versions: 1.5.1
>            Reporter: kiran
>            Priority: Minor
>             Fix For: 1.7
>
>         Attachments: NUTCH-1467-TEST-1.patch, NUTCH-1467-trunk.patch, NUTCH-1467-trunk_v1.patch,
Patch_HTMLMetaProcessor.patch, Patch_HTMLMetaTags.patch, Patch_MetadataIndexer.patch, Patch_MetaTagsParser.patch,
patch.txt
>
>
> Hi,
> I have been able to parse metatags in an html page using http://wiki.apache.org/nutch/IndexMetatags.
It does not work quite well when there are two metatags with same name but two different contents.

> Does anyone encounter this kind of issue ?  
> Are there any changes that need to be made to the config files to make it work ?
> When there are two tags with same name and different content, it takes the value of the
later tag and saves it rather than creating a multiValue field.
> Edit: I have attached the patch for the file and it is provided by DLA (Digital Library
and Archives) http://scholar.lib.vt.edu/ of Virginia Tech. 
> Many Thanks,

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message