lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ahmet Arslan <iori...@yahoo.com>
Subject RE: Solr Terms and Date field issues
Date Fri, 06 May 2011 01:08:45 GMT


It is okey to see weird things in admin/schema.jsp or terms component with trie based types.
Please see http://search-lucene.com/m/WEfSI1Yi4562/

If you really need terms component, consider using copyField (tdate to string type)



 
Please find attached the schema and some test data (test.xml).

Thanks for looking this.
Viswa


> Date: Thu, 5 May 2011 19:08:31 -0400
> Subject: Re: Solr Terms and Date field issues
> From: erickerickson@gmail.com
> To: solr-user@lucene.apache.org
> 
> Hmmmm, this is puzzling. If you could come up with a couple of xml
> files and a schema
> that illustrate this, I'll see what I can see...
> 
> Thanks,
> Erick
> 
> On Wed, May 4, 2011 at 7:05 PM, Viswa S <sviswap@hotmail.com> wrote:
> >
> > Erik,
> >
> > I suspected the same, and setup a test instance to reproduce this. The date field
I used is setup to capture indexing time, in other words the schema has a default value of
"NOW". However, I have reproduced this issue with fields which do no have defaults too.
> >
> > On the second one, I did a delete->commit (with expungeDeletes=true) and then
a optimize. All other fields show updated terms except the date fields. I have also double
checked to see if the Luke handler has any different terms, and it did not.
> >
> >
> > Thanks
> > Viswa
> >
> >
> >> Date: Wed, 4 May 2011 08:17:39 -0400
> >> Subject: Re: Solr Terms and Date field issues
> >> From: erickerickson@gmail.com
> >> To: solr-user@lucene.apache.org
> >>
> >> Hmmm, this *looks* like you've changed your schema without
> >> re-indexing all your data so you're getting old (string?) values in
> >> that field, but that's just a guess. If this is really happening on a
> >> clean index it's a problem.
> >>
> >> I'm also going to guess that you're not really deleting the documents
> >> you think. Are you committing after the deletes?
> >>
> >> Best
> >> Erick
> >>
> >> On Wed, May 4, 2011 at 2:18 AM, Viswa S <sviswap@hotmail.com> wrote:
> >> >
> >> > Hello,
> >> >
> >> > The terms query for a date field seems to get populated with some weird
dates, many of these dates (1970,2009,2011-04-23) are not present in the indexed data.  Please
see sample data below
> >> >
> >> > I also notice that a delete and optimize does not remove the relevant terms
for date fields, the string fields seems work fine.
> >> >
> >> > Thanks
> >> > Viswa
> >> >
> >> > Results from Terms component:
> >> >
> >> >
> >> > <int name="2011-05-04T02:01:32.928Z">3479</int>
> >> >
> >> > <int name="2011-05-04T02:00:19.2Z">3479</int>
> >> >
> >> > <int name="2011-05-03T22:34:58.432Z">3479</int>
> >> >
> >> > <int name="2011-04-23T01:36:14.336Z">3479</int>
> >> >
> >> > <int name="2009-03-13T13:23:01.248Z">3479</int>
> >> >
> >> > <int name="1970-01-01T00:00:00Z">3479</int>
> >> >
> >> > <int name="1970-01-01T00:00:00Z">3479</int>
> >> >
> >> > <int name="1970-01-01T00:00:00Z">3479</int>
> >> >
> >> > <int name="1970-01-01T00:00:00Z">3479</int>
> >> >
> >> > <int name="2011-05-04T02:01:34.592Z">265</int>
> >> >
> >> >
> >> > Result from facet component, rounded by seconds.:
> >> >
> >> > <lst name="InsertTime">
> >> > <int name="2011-05-04T02:01:32Z">1</int>
> >> >
> >> > <int name="2011-05-04T02:01:33Z">1148</int>
> >> >
> >> > <int name="2011-05-04T02:01:34Z">2333</int>
> >> >
> >> > <str name="gap">+1SECOND</str>
> >> >
> >> > <date name="start">2011-05-03T06:14:14Z</date>
> >> >
> >> > <date name="end">2011-05-04T06:14:14Z</date></lst>
> >> >
> >
 		 	   		  


Mime
View raw message