lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Hostetter <hossman_luc...@fucit.org>
Subject Re: High memory usage while querying with sort using cursor
Date Wed, 18 Mar 2015 22:16:07 GMT

: A simple query on the collection: ../select?q=*:* works perfectly fine.
: 
: But as soon as i add sorting, it crashes the nodes with OOM:
: .../select?q=*:*&sort=unique_id asc&rows=0.

if you don't have docValues="true" on your unique_id field, then sorting 
rquires it to build up a large in memory data strucutre (formally known as 
"FieldCache", now just an on the fly DocValues structure)

With explicit docValues constructed at index time, a lot of that data can 
just live in the operating system's filesystem cache, and lucene only has 
to load a small potion of it into the heap.



-Hoss
http://www.lucidworks.com/

Mime
View raw message