nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "DS jha" <aeds...@gmail.com>
Subject Re: updating index without refitting
Date Tue, 28 Nov 2006 15:47:56 GMT
new field's data is also stored as a meta data - value is assigned during
parse process and then during index, it reads meta-data field value and adds
it to an index. Looks like, I will have to run parse and index again.

Thanks much.


On 11/28/06, Gal Nitzan <gnitzan@usa.net> wrote:
>
> Hi,
>
> You do not mention if the new field's data is stored as a metadata? Does
> the
> value data being created during parse or is it added only during the index
> phase?
>
> If your new field is created during the parse process than you could
> delete
> only the parse folders and run the parse process i.e. (delete
> segment/crawl
> parse , segment/parse data , segment/parse text) and run bin/nutch parse
> segment
>
> Or if your field data is added during the index process than re-create
> your
> index.
>
> In any case it doesn't seem to me you would need to re-fetch.
>
> HTH
>
> Gal
>
> -----Original Message-----
> From: DS jha [mailto:aedsjha@gmail.com]
> Sent: Tuesday, November 28, 2006 4:11 PM
> To: nutch-dev@lucene.apache.org
> Subject: updating index without refetching
>
> Hi All,
>
> Is it possible to update the index without refetching everything?  I have
> changed logic of one of my plugins (which also sets a custom field in the
> index) - and I would like this field to get updated without refetching
> everything - is it doable?
>
>
> Thanks,
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message