nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "kiran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-1467) nutch 1.5.1 not able to parse mutliValued metatags
Date Sat, 02 Mar 2013 00:03:13 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13591123#comment-13591123
] 

kiran commented on NUTCH-1467:
------------------------------

Hi Sebastian,

Thanks for reminding! I forgot about this since i was working on 2.x for last few months.


I am back to 1.x now and the unit test looks good except that you might need to update expectedValues2
of line 97 in TestMetatagParser.java to three values since you gave three values to keywords
in the sample html file.

I did not work on your suggestions yet ( Using metadata class ) but i will soon and update
the patch. I have modified HTMLMetaProcessor in tika plugin and i have updated the new patch
as NUTCH-1467-trunk_v1.patch 

By using the metadata object in HTMLMetaTags.java, won't we be getting rid of the whole generalTags
thing in the program ? It would shorten the code as you said :)

                
> nutch 1.5.1 not able to parse mutliValued metatags
> --------------------------------------------------
>
>                 Key: NUTCH-1467
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1467
>             Project: Nutch
>          Issue Type: Bug
>    Affects Versions: 1.5.1
>            Reporter: kiran
>            Priority: Minor
>             Fix For: 1.7
>
>         Attachments: NUTCH-1467-TEST-1.patch, NUTCH-1467-trunk.patch, NUTCH-1467-trunk_v1.patch,
Patch_HTMLMetaProcessor.patch, Patch_HTMLMetaTags.patch, Patch_MetadataIndexer.patch, Patch_MetaTagsParser.patch,
patch.txt
>
>
> Hi,
> I have been able to parse metatags in an html page using http://wiki.apache.org/nutch/IndexMetatags.
It does not work quite well when there are two metatags with same name but two different contents.

> Does anyone encounter this kind of issue ?  
> Are there any changes that need to be made to the config files to make it work ?
> When there are two tags with same name and different content, it takes the value of the
later tag and saves it rather than creating a multiValue field.
> Edit: I have attached the patch for the file and it is provided by DLA (Digital Library
and Archives) http://scholar.lib.vt.edu/ of Virginia Tech. 
> Many Thanks,

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message