phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chunhui Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-877) Snappy native library is not available
Date Fri, 28 Mar 2014 04:51:14 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950371#comment-13950371
] 

Chunhui Liu commented on PHOENIX-877:
-------------------------------------

1. run snappy test on cluster
sudo -u hdfs HBASE_CONF_DIR="/home/hbase" hbase org.apache.hadoop.hbase.util.CompressionTest
hdfs://sc-nn:8020/output/part-r-00000 snappy
14/03/28 12:10:46 WARN conf.Configuration: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
14/03/28 12:10:47 INFO util.ChecksumType: Checksum using org.apache.hadoop.util.PureJavaCrc32
14/03/28 12:10:47 INFO util.ChecksumType: Checksum can use org.apache.hadoop.util.PureJavaCrc32C
14/03/28 12:10:47 ERROR metrics.SchemaMetrics: Inconsistent configuration. Previous configuration
for using table name in metrics: true, new configuration: false
14/03/28 12:10:47 INFO compress.CodecPool: Got brand-new compressor [.snappy]
14/03/28 12:10:47 INFO compress.CodecPool: Got brand-new decompressor [.snappy]
SUCCESS

2. distinct count in sqlline.sh
java.lang.RuntimeException: native snappy library not available
	at org.apache.hadoop.io.compress.SnappyCodec.getDecompressorType(SnappyCodec.java:189)
	at org.apache.hadoop.io.compress.CodecPool.getDecompressor(CodecPool.java:125)
	at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm.getDecompressor(Compression.java:331)
	at org.apache.phoenix.expression.aggregator.DistinctValueWithCountClientAggregator.aggregate(DistinctValueWithCountClientAggregator.java:60)
	at org.apache.phoenix.expression.aggregator.ClientAggregators.aggregate(ClientAggregators.java:63)
	at org.apache.phoenix.iterate.GroupedAggregatingResultIterator.next(GroupedAggregatingResultIterator.java:75)
	at org.apache.phoenix.iterate.UngroupedAggregatingResultIterator.next(UngroupedAggregatingResultIterator.java:39)
	at org.apache.phoenix.jdbc.PhoenixResultSet.next(PhoenixResultSet.java:731)
	at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2429)
	at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2074)
	at sqlline.SqlLine.print(SqlLine.java:1735)
	at sqlline.SqlLine$Commands.execute(SqlLine.java:3683)
	at sqlline.SqlLine$Commands.sql(SqlLine.java:3584)
	at sqlline.SqlLine.dispatch(SqlLine.java:821)
	at sqlline.SqlLine.begin(SqlLine.java:699)
	at sqlline.SqlLine.mainWithInputRedirection(SqlLine.java:441)
	at sqlline.SqlLine.main(SqlLine.java:424)

> Snappy native library is not available
> --------------------------------------
>
>                 Key: PHOENIX-877
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-877
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 3.0.0, 4.0.0
>            Reporter: alex kamil
>            Assignee: Mujtaba Chohan
>            Priority: Minor
>
> still getting this error with the most recent phoenix v3.0  (i think it has been fixed
in 2.2.3)
> "Snappy native library is not available" when running SELECT DISTINCT on large table
(>300k rows) in sqlline, on linux 64bit (intel) 
> in order to fix had to add to incubator-phoenix/bin/sqlline.py:
>     ' -Djava.library.path= /var/lib/hadoop/lib/native/Linux-amd64-64'+\
> snappy binaries were installed 
> sudo yum install snappy snappy-devel
> ln -sf /usr/lib64/libsnappy.so /var/lib/hadoop/lib/native/Linux-amd64-64/.
> ln -sf /usr/lib64/libsnappy.so /var/lib/hbase/lib/native/Linux-amd64-64/.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message