phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chunhui Liu (JIRA)" <>
Subject [jira] [Commented] (PHOENIX-877) Snappy native library is not available
Date Fri, 28 Mar 2014 04:51:14 GMT


Chunhui Liu commented on PHOENIX-877:

1. run snappy test on cluster
sudo -u hdfs HBASE_CONF_DIR="/home/hbase" hbase org.apache.hadoop.hbase.util.CompressionTest
hdfs://sc-nn:8020/output/part-r-00000 snappy
14/03/28 12:10:46 WARN conf.Configuration: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
14/03/28 12:10:47 INFO util.ChecksumType: Checksum using org.apache.hadoop.util.PureJavaCrc32
14/03/28 12:10:47 INFO util.ChecksumType: Checksum can use org.apache.hadoop.util.PureJavaCrc32C
14/03/28 12:10:47 ERROR metrics.SchemaMetrics: Inconsistent configuration. Previous configuration
for using table name in metrics: true, new configuration: false
14/03/28 12:10:47 INFO compress.CodecPool: Got brand-new compressor [.snappy]
14/03/28 12:10:47 INFO compress.CodecPool: Got brand-new decompressor [.snappy]

2. distinct count in
java.lang.RuntimeException: native snappy library not available
	at org.apache.phoenix.expression.aggregator.DistinctValueWithCountClientAggregator.aggregate(
	at org.apache.phoenix.expression.aggregator.ClientAggregators.aggregate(
	at sqlline.SqlLine$IncrementalRows.hasNext(
	at sqlline.SqlLine$TableOutputFormat.print(
	at sqlline.SqlLine.print(
	at sqlline.SqlLine$Commands.execute(
	at sqlline.SqlLine$Commands.sql(
	at sqlline.SqlLine.dispatch(
	at sqlline.SqlLine.begin(
	at sqlline.SqlLine.mainWithInputRedirection(
	at sqlline.SqlLine.main(

> Snappy native library is not available
> --------------------------------------
>                 Key: PHOENIX-877
>                 URL:
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 3.0.0, 4.0.0
>            Reporter: alex kamil
>            Assignee: Mujtaba Chohan
>            Priority: Minor
> still getting this error with the most recent phoenix v3.0  (i think it has been fixed
in 2.2.3)
> "Snappy native library is not available" when running SELECT DISTINCT on large table
(>300k rows) in sqlline, on linux 64bit (intel) 
> in order to fix had to add to incubator-phoenix/bin/
>     ' -Djava.library.path= /var/lib/hadoop/lib/native/Linux-amd64-64'+\
> snappy binaries were installed 
> sudo yum install snappy snappy-devel
> ln -sf /usr/lib64/ /var/lib/hadoop/lib/native/Linux-amd64-64/.
> ln -sf /usr/lib64/ /var/lib/hbase/lib/native/Linux-amd64-64/.

This message was sent by Atlassian JIRA

View raw message