hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashish Shinde <ash...@strandls.com>
Subject Exception reading from Hbase table with LZO compression
Date Thu, 03 Feb 2011 15:46:25 GMT
Hi,

I get the following exception when reading from a table with LZO
compression (using a M/R job as well as shell) on hbase 0.90.0. 

Is this hbase related of is there a big in hadoop-gpl-compression. 

Thanks and regards,
 - Ashish


java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException at
org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:988)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:976)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1767)
at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597) at
org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570) at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1036)
Caused by: java.lang.IllegalArgumentException at
java.nio.Buffer.limit(Buffer.java:249) at
com.hadoop.compression.lzo.LzoDecompressor.decompress(LzoDecompressor.java:289)
at
org.apache.hadoop.io.compress.BlockDecompressorStream.decompress(BlockDecompressorStream.java:74)
at
org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:74)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:256) at
java.io.BufferedInputStream.read(BufferedInputStream.java:317) at
org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:100) at
org.apache.hadoop.hbase.io.hfile.HFile$Reader.decompress(HFile.java:1094)
at
org.apache.hadoop.hbase.io.hfile.HFile$Reader.readBlock(HFile.java:1036)
at
org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.seekTo(HFile.java:1433)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:139)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(Storenner.java:96)
at
org.apache.hadoop.hbase.regionserver.StoreScanner.<init>(StoreScanner.java:77)
at
org.apache.hadoop.hbase.regionserver.Store.getScanner(Store.java:1338)
at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.<init>(HRegion.java:2229)
at
org.apache.hadoop.hbase.regionserver.HRegion.instantiateInternalScanner(HRegion.java:1119)
at
org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1111)
at
org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1095)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1765) ...
5 more


Mime
View raw message