lens-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tao Yan <t...@linkedin.com>
Subject Re: Exception While Purging Query
Date Wed, 03 Aug 2016 17:00:28 GMT
Hi Amareshwari,

1. How do I clear lens persist state?
2. Which DB and which table stores the query handles?

Thanks,

On Tue, Aug 2, 2016 at 10:37 PM, amareshwarisr . <amareshwari@gmail.com>
wrote:

> Tao,
>
> Seems the issue is not with new query having same handle. But the other
> values seem to differ - esp. driverEndTime.
>
> Couple of options for you not to see the exception any more :
> 1. Clear lens server persist state and restart. or
> 2. Remove the entry from DB corresponding to the problematic query handle.
>
> Can you raise a bug with the above exception to get it fixed properly?
>
> Thanks
> Amareshwari
>
> On Wed, Aug 3, 2016 at 9:42 AM, Tao Yan <tyan@linkedin.com> wrote:
>
>> Hi Lens Developers,
>>
>> I run the example queries in the '20 minutes demo' page for several
>> times, and a query failed many time before it succeeded:
>>
>> lens-shell>query execute cube select product_id, store_sales from sales
>> where time_range_in(order_time, '2015-04-11-00', '2015-04-13-00')
>>
>> Then, I found the Lens server keeps printing the following error log:
>> 03 Aug 2016 03:59:04 [b9bd9e01-d2e9-448e-9045-d329fb86be34] [QueryPurger]
>> WARN  org.apache.lens.server.query.LensServerDAO - Re insert happening in
>> purge: [Ljava.lang.StackTraceElement;@354862c
>> 03 Aug 2016 03:59:04 [b9bd9e01-d2e9-448e-9045-d329fb86be34] [QueryPurger]
>> WARN  *org.apache.lens.server.query.QueryExecutionServiceImpl -
>> Exception while purging query 27be8f4d-9d9a-43da-9c10-710ef0734ab3*
>> java.sql.SQLException: Found different value pre-existing in DB while
>> trying to insert finished query.* Old =* FinishedLensQuery(
>> *handle=27be8f4d-9d9a-43da-9c10-710ef0734ab3*, userQuery=cube select
>> product_id, store_sales from sales where time_range_in(order_time,
>> '2015-04-11-00', '2015-04-13-00'), submitter=anonymous,
>> submissionTime=1470184239496, startTime=1470184243802,
>> endTime=1470184289999, result=null, status=FAILED, metadata=null,
>> rows=null, fileSize=null, errorMessage=Stage-0(MOVE):Stage-0: has failed! ,
>> driverStartTime=1470184239666, driverEndTime=1470184289989, queryName=,
>> driverName=hive/hive1, selectedDriver=null)
>> *New =* FinishedLensQuery(*handle=27be8f4d-9d9a-43da-9c10-710ef0734ab3*,
>> userQuery=cube select product_id, store_sales from sales where
>> time_range_in(order_time, '2015-04-11-00', '2015-04-13-00'),
>> submitter=anonymous, submissionTime=1470184239496, startTime=1470184243802,
>> endTime=1470184608172, result=null, status=FAILED, metadata=null,
>> rows=null, fileSize=null, errorMessage=Error getting query status,
>> driverStartTime=1470184239666, driverEndTime=0, queryName=,
>> driverName=hive/hive1, selectedDriver=hive/hive1)
>>         at
>> org.apache.lens.server.query.LensServerDAO.insertFinishedQuery(LensServerDAO.java:133)
>> ~[classes/:na]
>>         at
>> org.apache.lens.server.query.QueryExecutionServiceImpl$QueryPurger.run(QueryExecutionServiceImpl.java:1007)
>> ~[classes/:na]
>>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_31]
>>
>>
>> It looks that the new query has the same handle as the old query. So,
>> Lens servers complains about it. It seems other queries are not impacted,
>> but this Warning messages are really annoying and impacting regular logs.
>>
>> Thanks,
>> --
>>
>> *Tao Yan*
>> Software Engineer
>> Data Analytics Infrastructure Tools and Services
>>
>>
>>
>> 206.250.5345
>> tyan@linkedin.com
>> https://www.linkedin.com/in/taousc
>>
>
>


-- 

*Tao Yan*
Software Engineer
Data Analytics Infrastructure Tools and Services



206.250.5345
tyan@linkedin.com
https://www.linkedin.com/in/taousc

Mime
View raw message