nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Ciborowski (JIRA)" <>
Subject [jira] [Commented] (NUTCH-1517) CloudSearch indexer
Date Wed, 11 Sep 2013 17:12:51 GMT


Daniel Ciborowski commented on NUTCH-1517:

Current Error Message Split metadata size exceeded 10000000. Aborting job job_201309111525_0003
	at org.apache.hadoop.mapreduce.split.SplitMetaInfoReader.readSplitMetaInfo(
	at org.apache.hadoop.mapred.JobInProgress.createSplits(
	at org.apache.hadoop.mapred.JobInProgress.initTasks(
	at org.apache.hadoop.mapred.JobTracker.initJob(
	at org.apache.hadoop.mapred.EagerTaskInitializationListener$
	at java.util.concurrent.ThreadPoolExecutor.runWorker(
	at java.util.concurrent.ThreadPoolExecutor$

13/09/11 17:10:46 ERROR indexer.IndexingJob: Indexer: Job failed!
	at org.apache.hadoop.mapred.JobClient.runJob(
	at org.apache.nutch.indexer.IndexingJob.index(
	at org.apache.nutch.indexer.IndexingJob.main(
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(
	at java.lang.reflect.Method.invoke(
	at org.apache.hadoop.util.RunJar.main(

> CloudSearch indexer
> -------------------
>                 Key: NUTCH-1517
>                 URL:
>             Project: Nutch
>          Issue Type: New Feature
>          Components: indexer
>            Reporter: Julien Nioche
>             Fix For: 1.9
>         Attachments: 0023883254_1377197869_indexer-cloudsearch.patch
> Once we have made the indexers pluggable, we should add a plugin for Amazon CloudSearch.
See Apparently it uses a JSON based representation Search
Data Format (SDF), which we could reuse for a file based indexer.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message