lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zheng Lin Edwin Yeo <edwinye...@gmail.com>
Subject Re: Queries on SynonymFilterFactory
Date Fri, 08 May 2015 16:14:17 GMT
Thank you for your suggestions.

I can't do a proper testing on that yet as I'm currently using a 4GB RAM
normal PC machine, and all these probably requires more RAM that what I
have.
I've tried running the setup with 20 synonyms file, and the system went Out
of Memory before I could test anything.

For your option 2), do you mean that I'll need to download a synonym
database (like the one with over 20MB in size which I have), and index them
into an Ad Hoc Solr Core to manage them?

I probably can only try them out properly when I can get the server machine
with more RAM.

Regards,
Edwin


On 8 May 2015 at 22:16, Alessandro Benedetti <benedetti.alex85@gmail.com>
wrote:

> This is a quite big Sinonym corpus !
> If it's not feasible to have only 1 big synonym file ( I haven't checked,
> so I assume the 1 Mb limit is true, even if strange)
> I would do an experiment :
> 1) testing query time with a Solr Classic config
> 2) Use an Ad Hoc Solr Core to manage Synonyms ( in this way we can keep it
> updated and use it with a custom version of the Sysnonym filter that will
> get the Synonyms directly from another Solr instance).
> 2b) develop a Solr plugin to provide this approach
>
> If the synonym thesaurus is really big, I guess managing them through
> another Solr Core ( or something similar) locally , will be better than
> managing it with an external web service.
>
> Cheers
>
> 2015-05-08 12:16 GMT+01:00 Zheng Lin Edwin Yeo <edwinyeozl@gmail.com>:
>
> > So it means like having more than 10 or 20 synonym files locally will
> still
> > be faster than accessing external service?
> >
> > As I found out that zookeeper only allows the synonym.txt file to be a
> > maximum of 1MB, and as my potential synonym file is more than 20MB, I'll
> > need to split the file to more than 20 of them.
> >
> > Regards,
> > Edwin
> >
>
>
>
> --
> --------------------------
>
> Benedetti Alessandro
> Visiting card : http://about.me/alessandro_benedetti
>
> "Tyger, tyger burning bright
> In the forests of the night,
> What immortal hand or eye
> Could frame thy fearful symmetry?"
>
> William Blake - Songs of Experience -1794 England
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message