lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Angel Todorov <attodo...@gmail.com>
Subject FreeTextSuggester throwing error "token must not contain separator byte"
Date Mon, 24 Jul 2017 20:27:00 GMT
Hi guys,

I am trying to setup the FreeTextSuggester/ Lookup Factory in a suggester
definition in SOLR. Unfortunately while the index is building, I am
encountering the following errors:

*"msg":"tokens must not contain separator byte; got token=[30 20 30 20 32
20 72 20 61 6c 6c 65 6e 20 72] but gramCount=6, which is greater than
expected max ngram size=5","trace":"java.lang.IllegalArgumentException:
tokens must not contain separator byte; got token=[30 20 30 20 32 20 72 20
61 6c 6c 65 6e 20 72] but gramCount=6, which is greater than expected max
ngram size=5\r\n\tat
org.apache.lucene.search.suggest.analyzing.FreeTextSuggester.build(FreeTextSuggester.java:362)\r\n\tat
*

I've also opened the following issue, because i don't think it's right not
to handle this exception:

https://issues.apache.org/jira/browse/SOLR-11139

But my question is about the error in general - why is it occurring? I only
have English text, nothing special.

Thanks,
Angel

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message