nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sebastian Nagel (JIRA)" <>
Subject [jira] [Commented] (NUTCH-2706) -addBinaryContent flag can cause "String length must be a multiple of four" error in IndexingJob
Date Tue, 09 Apr 2019 19:14:00 GMT


Sebastian Nagel commented on NUTCH-2706:

Hi [~pemanuel], can you share the document which causes the issue. I've tried hard to reproduce
this issue (resp. NUTCH-2650) there must be some edge condition which is responsible for this
bug. Thanks!

> -addBinaryContent flag can cause "String length must be a multiple of four" error in
> ------------------------------------------------------------------------------------------------
>                 Key: NUTCH-2706
>                 URL:
>             Project: Nutch
>          Issue Type: Bug
>          Components: indexer
>    Affects Versions: 1.15
>         Environment: Solr:7.3.1
> Nutch: 1.15
>            Reporter: Prajeeth Emanuel
>            Priority: Major
> When using the following crawling command:
> bin/crawl -i -s /user/neutron_proactive_sourcing/seed /user/neutron_proactive_sourcing/test-crawl-8
> with the index command in the crawl script with -addBinaryContent and -base64.
> The error I get is:
> 2019-04-04 04:10:43,702 svnNumber= clientHw="" userId="" actionKpi="" [main] WARN org.apache.hadoop.mapred.YarnChild
- Exception running child : org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:
Error from server at
Error from server at
ERROR: [doc=73ad5e05e49054efa258e7c54ae9b9ee] Error adding field 'binaryContent'='PCFET0NUWVBFIGh0bWw+DQo8aHRtbCBsYW5nPSJlbiI+DQo8aGVhZD4NCgk8bWV0YSBodHRwLWVx...
> ...
> msg=String length must be a multiple of four. at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(
at org.apache.solr.client.solrj.impl.HttpSolrClient.request( at org.apache.solr.client.solrj.impl.HttpSolrClient.request(
at org.apache.solr.client.solrj.SolrRequest.process( at
at org.apache.nutch.indexer.IndexWriters.commit( at org.apache.nutch.indexer.IndexerOutputFormat$1.close(
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.close(
at org.apache.hadoop.mapred.ReduceTask.runNewReducer( at
at org.apache.hadoop.mapred.YarnChild$ at
Method) at at
at org.apache.hadoop.mapred.YarnChild.main(
> I see this as well. Opening a new
ticket as mentioned in the comments because I have a different environment.

This message was sent by Atlassian JIRA

View raw message