lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yonik Seeley <yo...@lucidworks.com>
Subject Re: paging vs streaming. spawn from (Processing a lot of results in Solr)
Date Sat, 27 Jul 2013 21:25:48 GMT
On Sat, Jul 27, 2013 at 5:05 PM, Mikhail Khludnev
<mkhludnev@griddynamics.com> wrote:
> anyway, even if writer pulls docs one by one, it doesn't allow to stream a
> billion of them. Solr writes out DocList, which is really problematic even
> in deep-paging scenarios.

Which part is problematic... the creation of the DocList (the search),
or it's memory requirements (an int per doc)?

-Yonik
http://lucidworks.com

Mime
View raw message