lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter Szantai-Kis (JIRA)" <>
Subject [jira] [Created] (SOLR-11194) Suggester BlendedInfixLookupFactory to support HDFS store for indexwriter
Date Fri, 04 Aug 2017 11:53:01 GMT
Peter Szantai-Kis created SOLR-11194:

             Summary: Suggester BlendedInfixLookupFactory to support HDFS store for indexwriter
                 Key: SOLR-11194
             Project: Solr
          Issue Type: Improvement
      Security Level: Public (Default Security Level. Issues are Public)
          Components: Suggester
    Affects Versions: 6.6
            Reporter: Peter Szantai-Kis
            Priority: Minor

When relative path is used for indexPath in the LookupFactory, the solr cores DataDir is used
as a prefix, but still will be created in the working directory of the process. Unfortunately
both the BlendedInfixLookupFactory and it's parent AnalyzingInfixLookupFactory uses a store
implementation that does not support HDFS. So in case the data dir is on hdfs then the "hdfs:/"
prefix will be ignored and because of the missing leading forward slash it will be treated
as a relative path. It seems hdfs wasn't really considered as an option when these Suggesters
were implemented.

One possible solution is to  use the SolrCores' own DirectoryFactory to lookup the data dir
which dynamically will return the proper store in case of HDFS is used

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message