spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Taka Shinagawa <taka.epsi...@gmail.com>
Subject libgfortran Dependency
Date Thu, 10 Jul 2014 02:35:02 GMT
Hi,

After testing Spark 1.0.1-RC2 on EC2 instances from the standard Ubuntu and
Amazon Linux AMIs,
I've noticed the MLlib's dependancy on gfortran library (libgfortran.so.3).

"sbt assembly" succeeds without this library installed, but "sbt test"
fails as follows.

I'm wondering if documenting this dependency in README and online doc might
a good idea.

-------------
[info] ALSSuite:
-- org.jblas ERROR Couldn't load copied link file:
java.lang.UnsatisfiedLinkError:
/tmp/jblas8312335435391185287libjblas_arch_flavor.so: libgfortran.so.3:
cannot open shared object file: No such file or directory.

On Linux 64bit, you need additional support libraries.
You need to install libgfortran3.

For example for debian or Ubuntu, type "sudo apt-get install libgfortran3"

For more information, see
https://github.com/mikiobraun/jblas/wiki/Missing-Libraries
[info] Exception encountered when attempting to run a suite with class
name: org.apache.spark.mllib.recommendation.ALSSuite *** ABORTED ***
[info]   java.lang.UnsatisfiedLinkError:
org.jblas.NativeBlas.dgemm(CCIIID[DII[DIID[DII)V
[info]   at org.jblas.NativeBlas.dgemm(Native Method)
[info]   at org.jblas.SimpleBlas.gemm(SimpleBlas.java:251)
[info]   at org.jblas.DoubleMatrix.mmuli(DoubleMatrix.java:1697)
[info]   at org.jblas.DoubleMatrix.mmul(DoubleMatrix.java:3054)
[info]   at
org.apache.spark.mllib.recommendation.ALSSuite$.generateRatings(ALSSuite.scala:67)
[info]   at
org.apache.spark.mllib.recommendation.ALSSuite.testALS(ALSSuite.scala:167)
[info]   at
org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply$mcV$sp(ALSSuite.scala:83)
[info]   at
org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply(ALSSuite.scala:83)
[info]   at
org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply(ALSSuite.scala:83)
[info]   at
org.scalatest.Transformer$$anonfun$apply$1.apply(Transformer.scala:22)
[info]   ...

-------------

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message