nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lewis John McGibbney (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (NUTCH-992) SolrDedup is broken in 2.x
Date Wed, 16 Apr 2014 22:24:17 GMT

     [ https://issues.apache.org/jira/browse/NUTCH-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lewis John McGibbney updated NUTCH-992:
---------------------------------------

    Fix Version/s:     (was: 2.4)
                   2.3

> SolrDedup is broken in 2.x
> --------------------------
>
>                 Key: NUTCH-992
>                 URL: https://issues.apache.org/jira/browse/NUTCH-992
>             Project: Nutch
>          Issue Type: Bug
>          Components: indexer
>    Affects Versions: nutchgora
>            Reporter: Markus Jelsma
>             Fix For: 2.3
>
>
> SolrDedup seems to have been broken for at least a few months, perhaps more. It does
fetch the documents from Solr but when processing the rows we get the following exception:
> Exception in thread "main" java.lang.NullPointerException
>         at org.apache.hadoop.io.serializer.SerializationFactory.getSerializer(SerializationFactory.java:73)
>         at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:899)
>         at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
>         at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
>         at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
>         at org.apache.nutch.indexer.solr.SolrDeleteDuplicates.dedup(SolrDeleteDuplicates.java:350)
>         at org.apache.nutch.indexer.solr.SolrDeleteDuplicates.run(SolrDeleteDuplicates.java:360)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.nutch.indexer.solr.SolrDeleteDuplicates.main(SolrDeleteDuplicates.java:370)



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message