nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mattmann, Chris A (388J)" <chris.a.mattm...@jpl.nasa.gov>
Subject Re: Nutch Web Interface - not anymore in 1.3
Date Tue, 03 May 2011 04:08:07 GMT
Hi Markus,

If one committer is willing to maintain something and use it that's probably good enough.
I'm not saying it's going to be me (b/c something is done when it's actually done and produced
and I haven't produced it yet :) ), but I'm at least going to try. Plus if one of the members
of the Nutch community is willing to put it together I'll sign up to help it get committed
to the sources. 

Note the Nutch 1.4+ UI could simply be an extension of the Solr VelocityResponseWriter if
that makes sense. No problem there from me. What I kind of *do* have a problem with is that
we removed existing functionality that has been present for all prior Nutch releases and our
alternative is telling someone to go figure out another software product and how to whip up
a UI for it, and in doing so we're telling people to not develop UI stuff in Nutch and splintering
that part of our community. That probably wasn't the best idea. I mentioned this when it was
happening, but because I didn't have time to provide an alternative, I didn't stand in the
way for it to block the progress at the time.

Cheers,
Chris



On May 2, 2011, at 6:09 PM, Markus Jelsma wrote:

> Chris,
> 
> An  immediate available search interface is indeed a very good idea but i'd 
> rather delegate it to Solr and any future supporting back end instead of also 
> maintaining it in Nutch. I'd be a lot of work for few busy committers.
> 
> Using AjaxSolr, in my opinion, is also not that good an idea because it needs 
> a separate webserver and needs more custom coding than Solr's 
> VelocityResponseWriter. And, it requires Solr and won't work with any future 
> back end.
> 
> There is an issue for bundling a Solr instance with Nutch which we can 
> configure to our data. With VelocityResponseWriter we can make an interface 
> available, instantly. Quite useful for testing since we now have to do 
> everything by hand.
> 
> By the way, i'd appreciate a 1.4 in Jira after the coming release. There are 
> some new features i'd love see it incorporated, perhaps a bundles Solr 
> instance with a preconfigured and useful interface ;)
> 
> Cheers,
> 
>> Hi Gabriele,
>> 
>> I would have loved to have done this myself but haven't had the time. I
>> also favored having a web interface still included as well.
>> 
>> If you find time to port it to the 1.3 branch/framework I can tell you I'd
>> happily devote my time towards a 1.4 release that includes it.
>> 
>> Cheers,
>> Chris
>> 
>> On May 2, 2011, at 10:54 AM, Gabriele Kahlout wrote:
>>> The reason I'm asking is because I had found the nutch webapp pretty neet
>>> for a prototype interface (it even did highlighting).
>>> I'm thinking of changing it so that it pulls the data from solr index,
>>> updating this part in search.jsp:
>>> 
>>> // perform query
>>> 
>>>   // NOTE by Dawid Weiss:
>>>   // The 'clustering' window actually moves with the start
>>>   // position.... this is good, bad?... ugly?....
>>> 
>>>  Hits hits;
>>>  try{
>>> 
>>>     query.getParams().initFrom(start + hitsToRetrieve, hitsPerSite,
>>> 
>>> "site", sort, reverse);
>>> 
>>>    hits = bean.search(query);
>>> 
>>>  } catch (IOException e){
>>> 
>>>    hits = new Hits(0,new Hit[0]);
>>> 
>>>  }
>>> 
>>> Has someone gone through that already? Are there other alternatives you
>>> have taken? I stumbled upon (w/o stumbledupon.com)
>>> http://evolvingweb.github.com/ajax-solr/examples/reuters/index.html which
>>> is quite sophisticated and doesn't do the highlighting!
>>> 
>>> On Mon, May 2, 2011 at 4:45 PM, Markus Jelsma 
> <markus.jelsma@openindex.io>wrote:
>>>> Yes. It was removed. Indexing and searching is delegated to Solr for
>>>> now.
>>>> 
>>>> On Monday 02 May 2011 16:41:32 Gabriele Kahlout wrote:
>>>>> Hello,
>>>>> 
>>>>> Some time ago I was trying to use nutch/search.jsp to search my Solr
>>>>> indexes. Trying to do that again I've noticed that in nutch-1.3 there
>>>>> is
>>>> 
>>>> no
>>>> 
>>>>> support for a Nutch web querying interface (presumably in favor of
>>>>> solr's own). Is it?
>>>> 
>>>> --
>>>> Markus Jelsma - CTO - Openindex
>>>> http://www.linkedin.com/in/markus17
>>>> 050-8536620 / 06-50258350
>> 
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW:   http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++


Mime
View raw message