lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rick Leir <rl...@leirtech.com>
Subject Re: Solr Input and Output format
Date Thu, 03 Aug 2017 08:22:49 GMT
Ranganath,

I googled 'getRecordWriter solr' and came up with (among 446 results) 
this partial stack trace:


at 
org.apache.solr.handler.component.HttpShardHandlerFactory.init(HttpShardHandlerFactory.java:168)


at 
org.apache.solr.handler.component.ShardHandlerFactory.newInstance(ShardHandlerFactory.java:49)


at org.apache.solr.core.CoreContainer.load(CoreContainer.java:236)
at 
org.apache.solr.hadoop.SolrRecordWriter.createEmbeddedSolrServer(SolrRecordWriter.java:163)


at 
org.apache.solr.hadoop.SolrRecordWriter.<init>(SolrRecordWriter.java:119)
at 
org.apache.solr.hadoop.SolrOutputFormat.getRecordWriter(SolrOutputFormat.java:163) 

at 
org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.<init>(ReduceTask.java:540)


at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:614)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614) 

at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)

  org.apache.solr.hadoop.SolrRecordWriter extends FileOutputFormat

https://github.com/apache/lucene-solr/blob/releases/lucene-solr/6.4.0/solr/contrib/map-reduce/src/java/org/apache/solr/hadoop/SolrOutputFormat.java

cheers -- Rick



On 2017-08-02 04:04 AM, Ranganath B N wrote:
> Hi,
>
>
>
>
>
>
>    I am not asking about the file formats. Rather, It is about SolrInputFormat and SolrOutputFormat
interfaces which deal with getsplit(), getRecordReader() and getRecordWriter() methods. Are
there any Implementations for these interfaces?
>
>
>
>
>
> Thanks,
>
> Ranganath B. N.
>
>
>
>
>
>
>
>
> From: Ranganath B N
> Sent: Monday, July 31, 2017 6:33 PM
> To: 'solr-user@lucene.apache.org'
> Cc: Vadiraj Muradi
> Subject: Solr Input and Output format
>
>
> Hi All,
>
>       Can you point me to some of the implementations  of Solr Input and Output format?
I wanted to know them to  understand the distributed implementation approach.
>
>
> Thanks,
> Ranganath B. N.
>
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message