lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vaibhav Bhandari <vaibhav.bhandar...@gmail.com>
Subject Re: High memory usage while querying with sort using cursor
Date Wed, 18 Mar 2015 23:23:50 GMT
Thanks Chris, that makes a lot of sense.



On Wed, Mar 18, 2015 at 3:16 PM, Chris Hostetter <hossman_lucene@fucit.org>
wrote:

>
> : A simple query on the collection: ../select?q=*:* works perfectly fine.
> :
> : But as soon as i add sorting, it crashes the nodes with OOM:
> : .../select?q=*:*&sort=unique_id asc&rows=0.
>
> if you don't have docValues="true" on your unique_id field, then sorting
> rquires it to build up a large in memory data strucutre (formally known as
> "FieldCache", now just an on the fly DocValues structure)
>
> With explicit docValues constructed at index time, a lot of that data can
> just live in the operating system's filesystem cache, and lucene only has
> to load a small potion of it into the heap.
>
>
>
> -Hoss
> http://www.lucidworks.com/
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message