lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vikram kamath <kmar...@gmail.com>
Subject Re: NRT or similar for Solr 3.5?
Date Sun, 18 Dec 2011 15:19:31 GMT
I followed the steps and they worked fine for me ...
On further investigation I found that I had not changed the *solr.war* file
in myapp/*webapps* folder to the *solr.war* with ranking algorithm ..

@Steven check that out

Thanks Nagendra

Regards
Vikram Kamath



On 17 December 2011 22:35, Nagendra Nagarajayya <
nnagarajayya@transaxtions.com> wrote:

>
> Regarding docs not showing up, can you try adding docs to the demo index
> (MBArtists that is available with the download).
> The start_solr.sh points to the index, which is under solr under the
> examples directory. start solr with the start_solr.sh script and add a
> document to the index using the load (download from here:
> http://tgels.org/load_test_**nrt.sh <http://tgels.org/load_test_nrt.sh>)
> script as follows:
>
> Before your run the load script:
>
> try:
> http://localhost:8983/solr/**select/?q=*:*&rows=0<http://localhost:8983/solr/select/?q=*:*&rows=0>
> (Should show numFound="439213")
>
> http://localhost:8983/solr/**select/?q=nrt&fl=score<http://localhost:8983/solr/select/?q=nrt&fl=score>
> (Should not find John nrt27 Davis but will list other records like nrt,
> etc.)
>
> Now run:
> bash -x /tmp/load_test_nrt.sh
>
> (You will see INFO: newest commit = 1287674272560 or similar)
>
> try:
> http://localhost:8983/solr/**select/?q=*:*&rows=0<http://localhost:8983/solr/select/?q=*:*&rows=0>
> (Should show numFound="439214")
>
> http://localhost:8983/solr/**select/?q=nrt&fl=score<http://localhost:8983/solr/select/?q=nrt&fl=score>
> (Should show John nrt27 Davis as the second search result)
>
> http://localhost:8983/solr/**select/?q=nrt27&fl=score<http://localhost:8983/solr/select/?q=nrt27&fl=score>
> (Should show John nrt27 Davis as the first search result)
>
>
> To duplicate this, I downloaded a bundle version, changed to examples
> directory, started solr with start_solr.sh, and did the above steps to make
> sure the results change when a new doc is added.
>
> To add more documents, just open load_test_nrt.sh with an editor, and
> change x and y variables at the top of the script by incrementing them by
> 1. Run the script again, and you should see one more doc added, also be
> able to search nrt28, and so on ...
>
> Let me know if you have problems duplicating this.
>
> Regards,
> - NN
>
>
>
> On 12/17/2011 12:34 AM, vikram kamath wrote:
>
>> @Steven even I have done the same thing....Even I am user btw
>>
>> @Nagendra I have an index on about 15 million mysql records. I am using
>> the
>> solr-ra
>> Solr 3.5 (NRT support) with RankingAlgorithm 1.3 (bundle 118MB)
>> <http://solr-ra.tgels.com/**solr-ra.jsp<http://solr-ra.tgels.com/solr-ra.jsp>
>> >
>>
>>
>> and have added my index (indexed using solr 3.4) to the same ..
>>
>> I have added
>> <realtime visible="1">true</realtime>
>>  <library>rankingalgorithm</**library>
>> <rankingalgorithm>
>> <algorithm>simple</algorithm>
>>  </rankingalgorithm>
>>
>> to /apache-solr-ra-3.5.0/myapp/**solr/conf/solrconfig.xml
>>
>> Querying seems faster but it takes about 2 mins to be able to  search for
>> a
>> record added
>> I don't do an commit after adding the documents
>>
>> upon seeing the solr logs I see that ...
>>
>> *Dec 17, 2011 12:08:32 AM org.apache.solr.update.**DirectUpdateHandler2
>> commit
>> *
>>
>> *INFO: start
>> commit(optimize=false,**waitFlush=true,waitSearcher=**
>> true,expungeDeletes=false)
>>
>> *
>> .... is called after a while(abt 2 mins)  and the records become visible
>>
>> Could you please help me out?
>>
>> I have removed filtercache and even tried searching with&cache=true but
>>
>> the record is visible only after the automatic commit
>>
>> [image: twitter]<http://twitter.com/**kmarkiv<http://twitter.com/kmarkiv>
>> >[image:
>> facebook]<http://facebook.com/**kmarkiv <http://facebook.com/kmarkiv>
>> >[image:
>> google-buzz]<http://profiles.**google.com/kmarkiv#buzz<http://profiles.google.com/kmarkiv#buzz>
>> >[**image:
>> linkedin]<http://linkedin.com/**in/vikramkamathc<http://linkedin.com/in/vikramkamathc>
>> >
>>
>> Regards
>> Vikram Kamath
>>
>>
>>
>> On 17 December 2011 05:10, Steven Ou<stevenou@gmail.com>  wrote:
>>
>>  Hey Vikram,
>>>
>>> I finally got around to getting Solr-RA installed but I'm having trouble
>>> getting the NRT to work. Could you help me out?
>>>
>>> I added these four lines immediately after<config>  in solrconfig.xml:
>>>
>>>  <realtime visible="200">true</realtime>
>>>
>>>  <library>rankingalgorithm</**library>
>>>
>>>  <realtime visible="200" facet="true">true</realtime>
>>>
>>>  <library>rankingalgorithm</**library>
>>>
>>> Is that correct? I also read something about disabling caching, so I took
>>> out the queryResultCache. Is that right?
>>>
>>> What else do I need to do to get NRT working? Do I need to switch some
>>> engine to Solr-RA? If so, how do I do that? Are there other caches I need
>>> to disable?
>>>
>>> Any help appreciated. Thanks.
>>> --
>>> Steven Ou | 歐偉凡
>>>
>>> *ravn.com* | Chief Technology Officer
>>> stevenou@gmail.com | +1 909-569-9880
>>>
>>>
>>> 2011/12/12 vikram kamath<kmarkiv@gmail.com>
>>>
>>>  @Steven .. try some alternate email address(besides google/yahoo)  and
>>>> check your spam
>>>>
>>>> [image: twitter]<http://twitter.com/**kmarkiv<http://twitter.com/kmarkiv>
>>>> >[image:
>>>> facebook]<http://facebook.com/**kmarkiv <http://facebook.com/kmarkiv>
>>>> >[image:
>>>> google-buzz]<http://profiles.**google.com/kmarkiv#buzz<http://profiles.google.com/kmarkiv#buzz>
>>>> >[**image:
>>>> linkedin]<http://linkedin.com/**in/vikramkamathc<http://linkedin.com/in/vikramkamathc>
>>>> >
>>>>
>>>> Regards
>>>> Vikram Kamath
>>>>
>>>>
>>>>
>>>> 2011/12/13 Steven Ou<stevenou@gmail.com>
>>>>
>>>>  Yeah, running Chrome on OSX and doesn't do anything.
>>>>>
>>>>> Just switched to Firefox and it works. *But*, also don't seem to be
>>>>> receiving confirmation email.
>>>>> --
>>>>> Steven Ou | 歐偉凡
>>>>>
>>>>> *ravn.com* | Chief Technology Officer
>>>>> stevenou@gmail.com | +1 909-569-9880
>>>>>
>>>>>
>>>>> 2011/12/12 vikram kamath<kmarkiv@gmail.com>
>>>>>
>>>>>  The Onclick handler does not seem to be called on google chrome
>>>>>>
>>>>> (Ubuntu
>>>
>>>> ).
>>>>>
>>>>>> Also , I dont seem to receive the email with the confirmation link
on
>>>>>> registering (I have checked my spam)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Regards
>>>>>> Vikram Kamath
>>>>>>
>>>>>>
>>>>>>
>>>>>> 2011/12/12 Nagendra Nagarajayya<nnagarajayya@**transaxtions.com<nnagarajayya@transaxtions.com>
>>>>>> >
>>>>>>
>>>>>>  Steven:
>>>>>>>
>>>>>>> There is an onclick handler that allows you to download the src.
>>>>>>>
>>>>>> BTW,
>>>
>>>> an
>>>>>
>>>>>> early access Solr 3.5 with RankingAlgorithm 1.3 (NRT) release is
>>>>>>> available for download. So please give it a try.
>>>>>>>
>>>>>>> Regards,
>>>>>>>
>>>>>>> - Nagendra Nagarajayya
>>>>>>> http://solr-ra.tgels.org
>>>>>>> http://rankingalgorithm.tgels.**org<http://rankingalgorithm.tgels.org>
>>>>>>>
>>>>>>>
>>>>>>> On 12/10/2011 11:18 PM, Steven Ou wrote:
>>>>>>>
>>>>>>>> All the links on the download section link to
>>>>>>>>
>>>>>>> http://solr-ra.tgels.org/#
>>>>>>
>>>>>>> --
>>>>>>>> Steven Ou | 歐偉凡
>>>>>>>>
>>>>>>>> *ravn.com* | Chief Technology Officer
>>>>>>>> stevenou@gmail.com | +1 909-569-9880
>>>>>>>>
>>>>>>>>
>>>>>>>> 2011/12/11 Nagendra Nagarajayya<nnagarajayya@**transaxtions.com<nnagarajayya@transaxtions.com>
>>>>>>>> >
>>>>>>>>
>>>>>>>>  Steven:
>>>>>>>>>
>>>>>>>>> Not sure why you had problems, #downloads (
>>>>>>>>> http://solr-ra.tgels.org/#**downloads<http://solr-ra.tgels.org/#downloads>)
should point you to the
>>>>>>>>>
>>>>>>>> downloads
>>>>>>
>>>>>>> section showing the different versions available for download
?
>>>>>>>>>
>>>>>>>> Please
>>>>>
>>>>>>  share if this is not so ( there were downloads yesterday with no
>>>>>>>>>
>>>>>>>> problems )
>>>>>>>
>>>>>>>> Regarding NRT, you can switch between RA and Lucene at query
>>>>>>>>>
>>>>>>>> level
>>>
>>>> or
>>>>>
>>>>>> at
>>>>>>
>>>>>>> config level; in the current version with RA, NRT is in effect
>>>>>>>>>
>>>>>>>> while
>>>>
>>>>>  with lucene, it is not, you can get more information from here:
>>>>>>>>>
>>>>>>>>>  http://solr-ra.tgels.org/**papers/Solr34_with_**
>>>> RankingAlgorithm13.pdf<http://solr-ra.tgels.org/papers/Solr34_with_RankingAlgorithm13.pdf>
>>>>
>>>>>  Solr 3.5 with RankingAlgorithm 1.3 should be available next
>>>>>>>>>
>>>>>>>> week.
>>>
>>>>  Regards,
>>>>>>>>>
>>>>>>>>> - Nagendra Nagarajayya
>>>>>>>>> http://solr-ra.tgels.org
>>>>>>>>> http://rankingalgorithm.tgels.**org<http://rankingalgorithm.tgels.org>
>>>>>>>>>
>>>>>>>>> On 12/9/2011 4:49 PM, Steven Ou wrote:
>>>>>>>>>
>>>>>>>>>> Hey Nagendra,
>>>>>>>>>>
>>>>>>>>>> I took a look and Solr-RA looks promising - but:
>>>>>>>>>>
>>>>>>>>>>    - I could not figure out how to download it. It
seems like
>>>>>>>>>>
>>>>>>>>> all
>>>
>>>> the
>>>>>
>>>>>>     download links just point to "#"
>>>>>>>>>>    - I wasn't looking for another ranking algorithm,
so would
>>>>>>>>>>
>>>>>>>>> it
>>>
>>>> be
>>>>
>>>>>     possible for me to use NRT but *not* RA (i.e. just use the
>>>>>>>>>>
>>>>>>>>> normal
>>>>>
>>>>>>  Lucene
>>>>>>>>>
>>>>>>>>>>    library)?
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Steven Ou | 歐偉凡
>>>>>>>>>>
>>>>>>>>>> *ravn.com* | Chief Technology Officer
>>>>>>>>>> stevenou@gmail.com | +1 909-569-9880
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Sat, Dec 10, 2011 at 5:13 AM, Nagendra Nagarajayya<
>>>>>>>>>> nnagarajayya@transaxtions.com>  wrote:
>>>>>>>>>>
>>>>>>>>>>  Steven:
>>>>>>>>>>>
>>>>>>>>>>> Please take a look at Solr  with RankingAlgorithm.
It offers
>>>>>>>>>>>
>>>>>>>>>> NRT
>>>
>>>>  functionality. You can set your autoCommit to about 15 mins.
>>>>>>>>>>>
>>>>>>>>>> You
>>>
>>>> can
>>>>>
>>>>>> get
>>>>>>>
>>>>>>>>  more information from here:
>>>>>>>>>>>
>>>>>>>>>>>  http://solr-ra.tgels.com/wiki/****en/Near_Real_Time_Search_**
>>>>> ver_**3.x<http://solr-ra.tgels.com/wiki/**en/Near_Real_Time_Search_ver_**3.x>
>>>>> <
>>>>>
>>>>>>  http://solr-ra.tgels.com/wiki/**en/Near_Real_Time_Search_ver_**3.x<http://solr-ra.tgels.com/wiki/en/Near_Real_Time_Search_ver_3.x>
>>>>>>>>> >
>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>>>
>>>>>>>>>>> - Nagendra Nagarajayya
>>>>>>>>>>> http://solr-ra.tgels.org
>>>>>>>>>>> http://rankingalgorithm.tgels.****org<
>>>>>>>>>>>
>>>>>>>>>> http://rankingalgorithm.tgels.**org<http://rankingalgorithm.tgels.org>
>>>>>>> >
>>>>>>>
>>>>>>>>
>>>>>>>>>>> On 12/8/2011 9:30 PM, Steven Ou wrote:
>>>>>>>>>>>
>>>>>>>>>>>  Hi guys,
>>>>>>>>>>>>
>>>>>>>>>>>> I'm looking for NRT functionality or similar
in Solr 3.5. Is
>>>>>>>>>>>>
>>>>>>>>>>> that
>>>>
>>>>>  possible?
>>>>>>>>>>>>
>>>>>>>>>>>>>  From what I understand there's NRT in
Solr 4, but I can't
>>>>>>>>>>>>>
>>>>>>>>>>>> figure
>>>>
>>>>> out
>>>>>>
>>>>>>>  whether or not 3.5 can do it as well?
>>>>>>>>>>>>
>>>>>>>>>>>> If not, is it feasible to use an autoCommit
every 1000ms? We
>>>>>>>>>>>>
>>>>>>>>>>> don't
>>>>>
>>>>>>  currently process *that* much data so I wonder if it's OK to
>>>>>>>>>>>>
>>>>>>>>>>> just
>>>>
>>>>>  commit
>>>>>>>>>
>>>>>>>>>> very often? Obviously not scalable on a large scale,
but it
>>>>>>>>>>>>
>>>>>>>>>>> is
>>>
>>>>  feasible
>>>>>>>
>>>>>>>>  for
>>>>>>>>>>>> a relatively small amount of data?
>>>>>>>>>>>>
>>>>>>>>>>>> I recently upgraded from Solr 1.4 to 3.5.
I had a hard time
>>>>>>>>>>>>
>>>>>>>>>>> getting
>>>>>
>>>>>>  everything working smoothly and the process ended up taking
>>>>>>>>>>>>
>>>>>>>>>>> my
>>>
>>>> site
>>>>>
>>>>>>  down
>>>>>>>>>
>>>>>>>>>> for a couple hours. I am very hesitant to upgrade
to Solr 4
>>>>>>>>>>>>
>>>>>>>>>>> if
>>>
>>>> it's
>>>>>
>>>>>> not
>>>>>>>
>>>>>>>>  necessary to get some sort of NRT functionality.
>>>>>>>>>>>>
>>>>>>>>>>>> Can anyone help me? Thanks!
>>>>>>>>>>>> --
>>>>>>>>>>>> Steven Ou | 歐偉凡
>>>>>>>>>>>>
>>>>>>>>>>>> *ravn.com* | Chief Technology Officer
>>>>>>>>>>>> stevenou@gmail.com | +1 909-569-9880
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message