lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-1253) LengthFilter and other TokenFilters that skip tokens ignore relative positionIncrement
Date Sun, 30 Jan 2011 17:06:44 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12988609#action_12988609
] 

Robert Muir commented on LUCENE-1253:
-------------------------------------

+1, this looks really good.

I looked for other filters, the only other one this could apply to is ChineseFilter, but this
one is deprecated
and we should just leave it alone (it exists for index backwards compatibility only).

> LengthFilter and other TokenFilters that skip tokens ignore relative positionIncrement
> --------------------------------------------------------------------------------------
>
>                 Key: LUCENE-1253
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1253
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/analyzers
>    Affects Versions: 2.3.1
>            Reporter: Walter Ferrara
>            Assignee: Uwe Schindler
>            Priority: Minor
>             Fix For: 3.1, 4.0
>
>         Attachments: LUCENE-1253-3x.patch, LUCENE-1253-3x.patch
>
>
> See for reference:
> http://www.nabble.com/WordDelimiterFilter%2BLenghtFilter-results-in-termPosition%3D%3D-1-td16306788.html
> and http://www.nabble.com/Lucene---Java-f24284.html
> It seems that LengthFilter (at least) could produce a stream in which the first Token
has a positionIncrement of 0, which make CheckIndex and Luke function "Reconstruct&Edit"
to generate exception.
> Should something be done to avoid this situation, or could the error be ignored (by allowing
Term with a position of -1, and relaxing CheckIndex checks?)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message