nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sebastian Nagel (JIRA)" <>
Subject [jira] [Commented] (NUTCH-1638) SolrWriter Bad String comparision
Date Tue, 10 Sep 2013 07:12:52 GMT


Sebastian Nagel commented on NUTCH-1638:

In default {{solrindex-mapping.xml}} only field "url" is used with copyField:            
<field dest="id" source="url"/>
<copyField source="url" dest="url"/>
The url value is indexed primarily as Sorl-field "id", then it is copied to Solr-field "url".
Here mapCopyKey(key) returns a different String object (but with same value "url"). All other
NutchFields are (per default) not copied: their keys are not contained in copyMap (because
there is no copyField statement in index mapping), hence mapCopyKey(key) returns key (same
object), and (solrMapping.mapCopyKey(key) != key) is false. To my understanding that's still
correct. But: mapCopyKey(key) could return null if no key exists in copyMap. That would be
more verbose (and still short).
> SolrWriter Bad String comparision
> ---------------------------------
>                 Key: NUTCH-1638
>                 URL:
>             Project: Nutch
>          Issue Type: Bug
>          Components: indexer
>    Affects Versions: 1.7, 2.2.1
>            Reporter: Aaron Scheffel
>            Priority: Minor
>              Labels: patch
>         Attachments: NUTCH-1638.patch
>   Original Estimate: 1h
>  Remaining Estimate: 1h
> In version 2.2.1 and 1.7
> Class org.apache.nutch.indexer.solr.SolrWriter
> Line 66
> inputDoc.addField(solrMapping.mapKey(e.getKey()), val2);
> String sCopy = solrMapping.mapCopyKey(e.getKey());
> if (sCopy != e.getKey()) {
> inputDoc.addField(sCopy, val2);
> }
> There is a string comparison "sCopy != e.getKey()" with a != and not an
> equals. It basically never works right. Not sure if someone was trying to
> be clever but even if those strings are the same they happen to be
> different objects. Which I'm assuming is due to how the strings are
> serialized in from the config files.
> Suggest its updated to
> String sCopy = solrMapping.mapCopyKey(e.getKey());
> if (!sCopy.equals(solrMapping.mapKey(e.getKey()))) {
>        inputDoc.addField(sCopy, val2);
> }
> -Aaron

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message