lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sambhav Kothari (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SOLR-13143) Output from ExplainAugmenterFactory and DebugQuery for rerank queries is not same
Date Thu, 17 Jan 2019 13:22:00 GMT

     [ https://issues.apache.org/jira/browse/SOLR-13143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sambhav Kothari updated SOLR-13143:
-----------------------------------
    Description: 
Currently, if we use the ExplainAugmenterFactory with LtR, instead of using the 
 model/re-rankers explain method, it uses the default query explain (tf-idf 
 explanation). This happens because the BasicResultContext doesn't wrap the 
 query([https://github.com/apache/lucene-solr/blob/1d85cd783863f75cea133fb9c452302]
 214165a4d/solr/core/src/java/org/apache/solr/response/BasicResultContext.java#L6
 7) with the RankQuery when its set to context's query, which is then used by 
 the ExplainAugmenterFactory. 
 ([https://github.com/apache/lucene-solr/blob/1d85cd783863f75cea133fb9c45230221416]
 5a4d/solr/core/src/java/org/apache/solr/response/transform/ExplainAugmenterFacto
 ry.java#L111).

As a result there are discrepancies between queries like -

[http://localhost:8983/solr/collection1/select?q=*:*&collection=collectionName&wt]
 =json&fl=[explain style=nl],score&rq=\{!ltr model=linear-model}

[http://localhost:8983/solr/collection1/select?q=*:*&collection=collectionName&wt]
 =json&fl=score&rq=\{!ltr model=linear-model}&debugQuery=true

the former outputs the explain from the SimilarityScorer's explain while the 
 latter uses the correct LtR ModelScorer's explain.

There are a few other problems with the explain augmenter - for eg. it doesn't 
 work with grouping (although the other doc transformers like LtR's 
 LTRFeatureLoggerTransformerFactory work with grouping)

Mailing List - 

 

http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201901.mbox/%3C5C3879D702C30144003902B0_0_18802%40msllnjpmsgsv06%3E

  was:
Currently, if we use the ExplainAugmenterFactory with LtR, instead of using the 
model/re-rankers explain method, it uses the default query explain (tf-idf 
explanation). This happens because the BasicResultContext doesn't wrap the 
query(https://github.com/apache/lucene-solr/blob/1d85cd783863f75cea133fb9c452302
214165a4d/solr/core/src/java/org/apache/solr/response/BasicResultContext.java#L6
7) with the RankQuery when its set to context's query, which is then used by 
the ExplainAugmenterFactory. 
(https://github.com/apache/lucene-solr/blob/1d85cd783863f75cea133fb9c45230221416
5a4d/solr/core/src/java/org/apache/solr/response/transform/ExplainAugmenterFacto
ry.java#L111).

As a result there are discrepancies between queries like -


http://localhost:8983/solr/collection1/select?q=*:*&collection=collectionName&wt
=json&fl=[explain style=nl],score&rq=\{!ltr model=linear-model}


http://localhost:8983/solr/collection1/select?q=*:*&collection=collectionName&wt
=json&fl=score&rq=\{!ltr model=linear-model}&debugQuery=true

the former outputs the explain from the SimilarityScorer's explain while the 
latter uses the correct LtR ModelScorer's explain.

There are a few other problems with the explain augmenter - for eg. it doesn't 
work with grouping (although the other doc transformers like LtR's 
LTRFeatureLoggerTransformerFactory work with grouping)


> Output from ExplainAugmenterFactory and DebugQuery for rerank queries is not same
> ---------------------------------------------------------------------------------
>
>                 Key: SOLR-13143
>                 URL: https://issues.apache.org/jira/browse/SOLR-13143
>             Project: Solr
>          Issue Type: Bug
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: search
>    Affects Versions: 7.5
>            Reporter: Sambhav Kothari
>            Priority: Minor
>         Attachments: bug.patch
>
>
> Currently, if we use the ExplainAugmenterFactory with LtR, instead of using the 
>  model/re-rankers explain method, it uses the default query explain (tf-idf 
>  explanation). This happens because the BasicResultContext doesn't wrap the 
>  query([https://github.com/apache/lucene-solr/blob/1d85cd783863f75cea133fb9c452302]
>  214165a4d/solr/core/src/java/org/apache/solr/response/BasicResultContext.java#L6
>  7) with the RankQuery when its set to context's query, which is then used by 
>  the ExplainAugmenterFactory. 
>  ([https://github.com/apache/lucene-solr/blob/1d85cd783863f75cea133fb9c45230221416]
>  5a4d/solr/core/src/java/org/apache/solr/response/transform/ExplainAugmenterFacto
>  ry.java#L111).
> As a result there are discrepancies between queries like -
> [http://localhost:8983/solr/collection1/select?q=*:*&collection=collectionName&wt]
>  =json&fl=[explain style=nl],score&rq=\{!ltr model=linear-model}
> [http://localhost:8983/solr/collection1/select?q=*:*&collection=collectionName&wt]
>  =json&fl=score&rq=\{!ltr model=linear-model}&debugQuery=true
> the former outputs the explain from the SimilarityScorer's explain while the 
>  latter uses the correct LtR ModelScorer's explain.
> There are a few other problems with the explain augmenter - for eg. it doesn't 
>  work with grouping (although the other doc transformers like LtR's 
>  LTRFeatureLoggerTransformerFactory work with grouping)
> Mailing List - 
>  
> http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201901.mbox/%3C5C3879D702C30144003902B0_0_18802%40msllnjpmsgsv06%3E



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message