lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael McCandless <>
Subject Re: Incorrect Token Offset when using multiple fieldable instance
Date Wed, 02 Jul 2008 17:22:11 GMT

Toph wrote:

> Michael McCandless-2 wrote:
>> We could alternatively extend TokenStream so you could query it for
>> the final offset, then fix indexing to use that value instead of the
>> endOffset of the last token that it saw.
> Querying the tokenstream for the final offset would good, but then  
> would the
> change be put into the DocumentWriter directly or available as an  
> option?

I would put the change into DocumentsWriter directly (ie running by  
default) with an option to enable the old (buggy) behavior for those  
apps that have workarounds and want to get back to the back-compatible  


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message