lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allison, Timothy B." <talli...@mitre.org>
Subject RE: Solr Wildcard Search
Date Thu, 30 Nov 2017 13:24:51 GMT
The initial question wasn't about a phrasal search, but I largely agree that diff q parsers
handle the analysis chain differently for multiterms.

Yes, Porter is crazily aggressive. USE WITH CAUTION!  

As has been pointed out, use the Solr admin window and the "debug" in the query option to
see what's going on.

Use the Solr admin Analysis feature to see how your tokens are being modified by each step
in the analysis chain.

If you use solr admin and debug the query for "shipping", you see that it is stemmed to "ship"...hence
all of your matches work.  Porter doesn't have rules for words ending in "pp", so it doesn't
stem "shipp" to "ship".  So, your wildcard query is looking for words that start with "shipp",
and given that "shipping" was stemmed to "ship", it won't find it.  It would find "shippqrs"
because porter wouldn't know what to do with that 😊

Again, Porter can be very dangerous if it doesn't align with user expectations.



-----Original Message-----
From: Atita Arora [mailto:atitaarora@gmail.com] 
Sent: Thursday, November 30, 2017 8:16 AM
To: solr-user@lucene.apache.org
Subject: Re: Solr Wildcard Search

As Rick raised the most important aspect here , that the phrase is broken into multiple terms
ORed together , I believe if the use case requires to perform wildcard search on phrases ,
we would need to store the entire phrase as a single term in the index which probably is not
happening right now and hence are not found when sent across as phrases.
I tried this on my local Solr 7.1 without phrase this works as expected , however as soon
as I do phrase search it fails for the reason as i mentioned above.

Let me know if I can clarify further.

On Thu, Nov 30, 2017 at 6:31 PM, Georgy Nevsky <gnevsky.cnslt@thomasnet.com>
wrote:

> I wish to understand if I can do something to get in result term "shipping"
> when search for "shipp*"?
>
> Here field definition:
> <field name="name_en-us" type="text_en" indexed="true" stored="true"
> multiValued="false"/>
>
> <fieldType name="text_en" class="solr.TextField"
> positionIncrementGap="100">
>       <analyzer type="index">
>         <tokenizer class="solr.StandardTokenizerFactory"/>
>         <filter class="solr.StopFilterFactory"
>                 ignoreCase="true"
>                 words="lang/stopwords_en.txt"
>             />
>         <filter class="solr.LowerCaseFilterFactory"/>
>         <filter class="solr.EnglishPossessiveFilterFactory"/>
>         <filter class="solr.KeywordMarkerFilterFactory"
> protected="protwords.txt"/>
>         <filter class="solr.PorterStemFilterFactory"/>
>       </analyzer>
>
> Anything else can be important? Most configuration parameters are 
> default to Apache Solr 7.1.0.
>
> In the best we trust
> Georgy Nevsky
>
>
> -----Original Message-----
> From: Rick Leir [mailto:rleir@leirtech.com]
> Sent: Thursday, November 30, 2017 7:32 AM
> To: solr-user@lucene.apache.org
> Subject: Re: Solr Wildcard Search
>
> George,
> When you get those results it could be due to stemming.
>
> Wildcard processing expands your term to multiple terms, OR'd 
> together. It also takes you down a different analysis pathway, as many 
> analysis components do not work with multiple terms. Look into the 
> SolrAdmin console, and use the analysis tab to understand what is 
> going on.
>
> If you still have doubts, tell us more about your config.
> Cheers --Rick
>
>
> On November 30, 2017 7:06:42 AM EST, Georgy Nevsky 
> <gnevsky.cnslt@thomasnet.com> wrote:
> >Can somebody help me understand how Solr Wildcard Search is working?
> >
> >If I’m doing search for “ship*” term I’m getting in result many 
> >strings, like “Shipping Weight”, “Ship From”, “Shipping Calculator”,

> >etc.
> >
> >But if I’m searching for “shipp*” I don’t get any result.
> >
> >
> >
> >In the best we trust
> >
> >Georgy Nevsky
>
> --
> Sorry for being brief. Alternate email is rickleir at yahoo dot com
>
Mime
View raw message