lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uwe Schindler" <>
Subject RE: StandardTokenizerImpl generation question
Date Sat, 25 Apr 2015 08:34:22 GMT

the documentation is this file is not really up-to-date.

If you want to regenerate the jflex files, it is recommended to use the build script of Lucene.
If you type "ant regenerate" or "ant jflex" (in the folder of the analysis module), the build
system will download the correct version of JFlex and regenerate the scripts. Currently this
is version 1.6.0. The warning was primarily there because of older versions of JFlex that
used the Unicode version of  the JVM which is no longer the case.

Could you may be open an issue to update the documentation in the files?


Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen

> -----Original Message-----
> From: Youngho Cho []
> Sent: Saturday, April 25, 2015 4:40 AM
> To:
> Subject: StandardTokenizerImpl generation question
> Hello,
> I would like to generate my own tokenizer which is slightly modify the
> StandardTokenizerImpl*.jflex.
> But I read the READ_BEFORE_GENERATING.txt.
> Currently, the jflex version is 1.6.1. but the document recommend to use
> jflex 1.5 only.
> Still this message is valid and do I have to generate a tokenizer using old
> version of jflex ?
> Thanks,
> Youngho
> ---------------------------------------------------------------------
> To unsubscribe, e-mail:
> For additional commands, e-mail:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message