lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rob Audenaerde <rob.audenae...@gmail.com>
Subject Re: Slower document retrieval in 8.7.0 comparing to 7.5.0
Date Thu, 21 Jan 2021 18:21:36 GMT
There is no attachment in the previous email that I can see? Maybe you can
post it online?

On Thu, Jan 21, 2021 at 4:54 PM Martynas L <martynas.sub@gmail.com> wrote:

> Hello,
>
> Are there any comments on this issue?
> If there is no workaround, we will be forced to rollback to the 7.5.0
> version.
>
> Best regards,
> Martynas
>
> On Tue, Jan 12, 2021 at 12:27 PM Martynas L <martynas.sub@gmail.com>
> wrote:
>
> > Hi,
> >
> > Please see attached sample.
> > IndexGenerator - creates a dummy index.
> > IndexReader - retrieves documents - duration time with 7.5.0 version is
> > ~2s, while ~6s with 8.7.0
> >
> > Regards,
> > Martynas
> >
> > On Tue, Dec 22, 2020 at 3:23 PM Vincenzo D'Amore <v.damore@gmail.com>
> > wrote:
> >
> >> I think it would be useful to have an example of a document and, if
> >> possible, an example of query that takes too long.
> >>
> >> On Mon, Dec 21, 2020 at 1:47 PM Martynas L <martynas.sub@gmail.com>
> >> wrote:
> >>
> >> > Hello,
> >> >
> >> > I am sorry for the delay.
> >> >
> >> > Not sure what you mean by "workload". We have a performance tests,
> which
> >> > started failing after upgrading to 8.7.0.
> >> > So I just tried to query the index (built form the same source) to get
> >> all
> >> > documents and compare the performance with 7.5.0.
> >> >
> >> > Document "size" is a sum of all stored string lengths (3402519
> >> documents):
> >> >
> >> > doc size 903 - 88s vs 22s
> >> >
> >> > doc size 36 (only one field loaded, used searcher.doc(docID,
> >> > Collections.singleton("fieldName"))) - 78s vs 16s
> >> >
> >> > doc size 439 (some fields made not stored) - 46s vs 14.5s
> >> >
> >> > Best regards,
> >> > Martynas
> >> >
> >> > On Fri, Dec 4, 2020 at 12:06 AM Adrien Grand <jpountz@gmail.com>
> wrote:
> >> >
> >> > > Hello Martynas,
> >> > >
> >> > > There have indeed been changes related to stored fields in 8.7. What
> >> does
> >> > > your workload look like and how large are your documents on average?
> >> > >
> >> > > On Thu, Dec 3, 2020 at 3:04 PM Martynas L <martynas.sub@gmail.com>
> >> > wrote:
> >> > >
> >> > > > Hi,
> >> > > > We've migrated from 7.5.0 to 8.7.0 and find out that the index
> >> > > "searching"
> >> > > > is significantly (4-5 times) slower in the latest version.
> >> > > > It seems that
> >> > > > org.apache.lucene.search.IndexSearcher#doc(int)
> >> > > > is slower.
> >> > > >
> >> > > > Is it possible to have similar performance with 8.7.0?
> >> > > >
> >> > > > Best regards,
> >> > > > Martynas
> >> > > >
> >> > >
> >> > >
> >> > > --
> >> > > Adrien
> >> > >
> >> >
> >>
> >>
> >> --
> >> Vincenzo D'Amore
> >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message