hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dima Spivak <dspi...@cloudera.com>
Subject Re: How to deal OutOfOrderScannerNextException
Date Wed, 31 Aug 2016 07:31:28 GMT
:) Glad it got sorted out.

On Wednesday, August 31, 2016, Kang Minwoo <minwoo.kang@outlook.com> wrote:

> Hi, I found what is problem.
>
>
> In my case, I use "hbase.client.rpc.compressor=
> org.apache.hadoop.io.compress.SnappyCodec" option.
>
> While "org.apache.hadoop.hbase.client.ResultScanner" called next()
> method, IPC Client occured "java.lang.UnsatisfiedLinkError:
> org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z" Exception.
>
>
> But HBase wrap that exception. So I saw "java.lang.RuntimeException:
> org.apache.hadoop.hbase.DoNotRetryIOException: Failed after retry of
> OutOfOrderScannerNextException: was there a rpc timeout?" error.
>
>
> I set unable "hbase.client.rpc.compressor" option.
>
> My hbase java client works well.
>
>
> Thanks alot for your comment, It is helpful for debug.
>
>
> I have a suggestion. If hbase show raw exception (not wrap), it is more
> helpful for debug.
>
>
> Yours sincerely,
>
> Minwoo
>
> ________________________________
> 보낸 사람: Kang Minwoo <minwoo.kang@outlook.com <javascript:;>>
> 보낸 날짜: 2016년 8월 31일 수요일 오전 9:48:07
> 받는 사람: user@hbase.apache.org <javascript:;>
> 제목: RE: How to deal OutOfOrderScannerNextException
>
> Thanks for your help.
>
> I have to upgrade my client dependencies.
>
>
> I will try!
>
> ________________________________
> 보낸 사람: Dima Spivak <dspivak@cloudera.com <javascript:;>>
> 보낸 날짜: 2016년 8월 31일 수요일 오전 9:43:42
> 받는 사람: user@hbase.apache.org <javascript:;>
> 제목: Re: How to deal OutOfOrderScannerNextException
>
> Hey Minwoo,
>
> Gotcha. Unfortunately, we don't guarantee compatibility between that client
> and the HBase server you're running, so the only way to solve the issue
> will probably be to upgrade your client dependencies.
>
> On Tuesday, August 30, 2016, Kang Minwoo <minwoo.kang@outlook.com
> <javascript:;>> wrote:
>
> > Because I have a number of hbase cluster.
> >
> > They are different version.
> >
> >
> > Legacy Hbase cluster version is 0.96.2-hadoop2.
> >
> > So I have to maintain 0.96.2-hadoop2.
> >
> > ________________________________
> > 보낸 사람: Dima Spivak <dspivak@cloudera.com <javascript:;> <javascript:;>>
> > 보낸 날짜: 2016년 8월 31일 수요일 오전 9:32:59
> > 받는 사람: user@hbase.apache.org <javascript:;> <javascript:;>
> > 제목: Re: How to deal OutOfOrderScannerNextException
> >
> > Any reason to not use the 1.2.2 client library? You're likely hitting a
> > compatibility issue.
> >
> > On Tuesday, August 30, 2016, Kang Minwoo <minwoo.kang@outlook.com
> <javascript:;>
> > <javascript:;>> wrote:
> >
> > > Hi Dima Spivak,
> > >
> > >
> > > Thanks for interesting my problem.
> > >
> > >
> > > Hbase server version is 1.2.2
> > >
> > > Java Hbase library version is 0.96.2-hadoop2 at hbase-client,
> > > 0.96.2-hadoop2 at hbase-hadoop-compat.
> > >
> > >
> > > Here is an excerpt of the code.
> > >
> > > ------------------------------------------------------------
> > > --------------------------------
> > >
> > > <HBaseReader.java>
> > >
> > > ResultScanner rs = keyTable.getScanner(scan); ==> Exception is here.
> > > List<Result> list = new ArrayList<Result>();
> > > try {
> > >     for (Result r : rs) {
> > >         list.add(r);
> > >     }
> > > } finally {
> > >     rs.close();
> > > }
> > > return list;
> > > ------------------------------------------------------------
> > > --------------------------------
> > >
> > >
> > > Here is a stacktrace.
> > > ------------------------------------------------------------
> > > --------------------------------
> > > org.apache.hadoop.hbase.DoNotRetryIOException: Failed after retry of
> > > OutOfOrderScannerNextException: was there a rpc timeout?
> > >     at org.apache.hadoop.hbase.client.ClientScanner.next(
> > > ClientScanner.java:384)
> > >     at org.apache.hadoop.hbase.client.MetaScanner.metaScan(
> > > MetaScanner.java:177)
> > >     at org.apache.hadoop.hbase.client.HConnectionManager$
> > > HConnectionImplementation.prefetchRegionCache(
> > > HConnectionManager.java:1107)
> > >     at org.apache.hadoop.hbase.client.HConnectionManager$
> > > HConnectionImplementation.locateRegionInMeta(
> > HConnectionManager.java:1167)
> > >     at org.apache.hadoop.hbase.client.HConnectionManager$
> > > HConnectionImplementation.locateRegion(HConnectionManager.java:1059)
> > >     at org.apache.hadoop.hbase.client.HConnectionManager$
> > > HConnectionImplementation.locateRegion(HConnectionManager.java:1016)
> > >     at org.apache.hadoop.hbase.client.HConnectionManager$
> > > HConnectionImplementation.getRegionLocation(
> HConnectionManager.java:857)
> > >     at org.apache.hadoop.hbase.client.RegionServerCallable.
> > > prepare(RegionServerCallable.java:72)
> > >     at org.apache.hadoop.hbase.client.ScannerCallable.
> > > prepare(ScannerCallable.java:118)
> > >     at org.apache.hadoop.hbase.client.RpcRetryingCaller.
> callWithRetries(
> > > RpcRetryingCaller.java:119)
> > >     at org.apache.hadoop.hbase.client.RpcRetryingCaller.
> callWithRetries(
> > > RpcRetryingCaller.java:96)
> > >     at org.apache.hadoop.hbase.client.ClientScanner.
> > > nextScanner(ClientScanner.java:264)
> > >     at org.apache.hadoop.hbase.client.ClientScanner.
> > > initializeScannerInConstruction(ClientScanner.java:169)
> > >     at org.apache.hadoop.hbase.client.ClientScanner.<init>(
> > > ClientScanner.java:164)
> > >     at org.apache.hadoop.hbase.client.ClientScanner.<init>(
> > > ClientScanner.java:107)
> > >     at org.apache.hadoop.hbase.client.HTable.getScanner(
> HTable.java:720)
> > >     at com.my.app.reader.hbase.HBaseReader.getResult(
> HBaseReader.java:1)
> > > ------------------------------------------------------------
> > > --------------------------------
> > >
> > > Yours sincerely,
> > > Minwoo
> > >
> > >
> > > ________________________________
> > > 보낸 사람: Dima Spivak <dspivak@cloudera.com <javascript:;>
> <javascript:;> <javascript:;>>
> > > 보낸 날짜: 2016년 8월 30일 화요일 오후 11:58:12
> > > 받는 사람: user@hbase.apache.org <javascript:;> <javascript:;>
> <javascript:;>
> > > 제목: Re: How to deal OutOfOrderScannerNextException
> > >
> > > Hey Minwoo,
> > >
> > > What version of HBase are you running? Also, can you post an excerpt of
> > the
> > > code you're trying to run when you get this Exception?
> > >
> > > On Tuesday, August 30, 2016, Kang Minwoo <minwoo.kang@outlook.com
> <javascript:;>
> > <javascript:;>
> > > <javascript:;>> wrote:
> > >
> > > > Hello Hbase users.
> > > >
> > > >
> > > > While I used hbase client libarary in JAVA, I got
> > > > OutOfOrderScannerNextException.
> > > >
> > > > Here is stacktrace.
> > > >
> > > >
> > > > ------
> > > >
> > > > java.lang.RuntimeException: org.apache.hadoop.hbase.
> > > DoNotRetryIOException:
> > > > Failed after retry of OutOfOrderScannerNextException: was there a
> rpc
> > > > timeout?
> > > > org.apache.hadoop.hbase.client.AbstractClientScanner$1.hasNext(
> > > > AbstractClientScanner.java:94)
> > > > ------
> > > >
> > > > This error was ocured by using scan method.
> > > > When I used Hbase shell, it is no any exception.
> > > > But In java client It is occured OutOfOrderScannerNextException when
> > > using
> > > > scan. (get method is find.)
> > > >
> > > > If someone know how to deal OutOfOrderScannerNextException, Please
> > share
> > > > your knowledge.
> > > > It would be very helpful.
> > > >
> > > > Yours sincerely,
> > > > Minwoo
> > > >
> > > >
> > >
> > > --
> > > -Dima
> > >
> >
> >
> > --
> > -Dima
> >
>
>
> --
> -Dima
>


-- 
-Dima

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message