lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Grant Ingersoll <gsing...@apache.org>
Subject Re: DocumentsWriter.checkMaxTermLength issues
Date Mon, 31 Dec 2007 16:59:21 GMT

On Dec 31, 2007, at 11:44 AM, Yonik Seeley wrote:

> On Dec 31, 2007 11:37 AM, Doron Cohen <cdoronc@gmail.com> wrote:
>>
>> On Dec 31, 2007 6:10 PM, Yonik Seeley <yonik@apache.org> wrote:
>>
>> I think I like the 3'rd option - is this what you meant?
>
> I meant (1)... it leaves the core smaller.
> I don't see any reason to have logic to truncate or discard tokens in
> the core indexing code (except to handle tokens >16k as an error
> condition).

I would agree here, with the exception that I want the option for it  
to be treated as an error.  In some cases, I would be just as happy  
for it to silently ignore the token, or to log it.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message