spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <van...@cloudera.com>
Subject Re: How to avoid use snappy compression when saveAsSequenceFile?
Date Thu, 06 Nov 2014 03:10:54 GMT
On Mon, Oct 27, 2014 at 7:37 PM, buring <qyqbird@gmail.com> wrote:
> Here is error log,I abstract as follows:
>     INFO [binaryTest---main]: before first
>     WARN [org.apache.spark.scheduler.TaskSetManager---Result resolver
> thread-0]: Lost task 0.0 in stage 0.0 (TID 0, spark-dev136):
> org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
>         org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:236)
>         org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)

Which OS are you running? The snappy version shipped with Spark has
some issues with older OSes (like CentOS 5; I think SLES11 has the
same problem).

-- 
Marcelo

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message