lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis_gospodne...@yahoo.com>
Subject Re: Solr (text) <> RDMBS (dynamic data) - best practies?
Date Wed, 07 May 2008 03:08:33 GMT
AideRSS, eh, nice, welcome :)

Since for 1) you will have to go to your DB, why not just store the retrieved data somewhere
(JVM, memcached...) and simply re-use it for 2?
* get query
* get data from DB for filtering
* store data from DB in cache
* run query
* write response using.... custom response writer? (this may not be right, I'd have to check)....
that grabs the extra data from cache and includes it with each hit

Maybe I'm over-simplifying something...

Otis 

--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch

----- Original Message ----
> From: igrigorik <ilya@aiderss.com>
> To: solr-user@lucene.apache.org
> Sent: Tuesday, May 6, 2008 8:26:17 PM
> Subject: Solr (text) <> RDMBS (dynamic data) - best practies?
> 
> 
> We're investigating migrating from an RDMBS to Solr to add text search
> support, as well as, offload the text storage from our RDMBS (which is
> arguably not designed for this kind of stuff).. While whiteboarding the
> basic requirements, we realized that we have some 'special' requirements:
> 
> Basic setup:
>  - A subset of data is immutable and is perfectly suited to be stored in
> Solr
>  - A subset of data is dynamic and changes frequently (should still be
> stored in an RDBMS)
> 
> Question:
>  1) We need access to dynamic data stored in our RDBMS to perform filtering
>  2) When Solr returns its result set, we need to augment the results with
> meta-data from our RDMBS
> 
> For (1), based on my research we're in fairly standard territory: implement
> a custom Filter, or a ChainedFilter to return a bitmask based on an RDBMS
> query. However, can this step be somehow coupled with (2), where the data we
> retrieved in (1) is also appended to the result set?
> 
> With proper caching policies, I don't think this implementation will be all
> that painful. (Sanity check?)
> 
> So having said that, are there any features or mechanisms in Solr/Lucene
> that you would recommend / are there any best practices we should be aware
> of to help us with the migration?
> 
> Appreciate the help.
> 
> ig
> -- 
> View this message in context: 
> http://www.nabble.com/Solr-%28text%29-%3C%3E-RDMBS-%28dynamic-data%29---best-practies--tp17093678p17093678.html
> Sent from the Solr - User mailing list archive at Nabble.com.
> 
> 



Mime
View raw message