spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Xiangrui Meng <men...@gmail.com>
Subject Re: libgfortran Dependency
Date Thu, 10 Jul 2014 02:45:26 GMT
It is documented in the official doc:
http://spark.apache.org/docs/latest/mllib-guide.html

On Wed, Jul 9, 2014 at 7:35 PM, Taka Shinagawa <taka.epsilon@gmail.com> wrote:
> Hi,
>
> After testing Spark 1.0.1-RC2 on EC2 instances from the standard Ubuntu and
> Amazon Linux AMIs,
> I've noticed the MLlib's dependancy on gfortran library (libgfortran.so.3).
>
> "sbt assembly" succeeds without this library installed, but "sbt test"
> fails as follows.
>
> I'm wondering if documenting this dependency in README and online doc might
> a good idea.
>
> -------------
> [info] ALSSuite:
> -- org.jblas ERROR Couldn't load copied link file:
> java.lang.UnsatisfiedLinkError:
> /tmp/jblas8312335435391185287libjblas_arch_flavor.so: libgfortran.so.3:
> cannot open shared object file: No such file or directory.
>
> On Linux 64bit, you need additional support libraries.
> You need to install libgfortran3.
>
> For example for debian or Ubuntu, type "sudo apt-get install libgfortran3"
>
> For more information, see
> https://github.com/mikiobraun/jblas/wiki/Missing-Libraries
> [info] Exception encountered when attempting to run a suite with class
> name: org.apache.spark.mllib.recommendation.ALSSuite *** ABORTED ***
> [info]   java.lang.UnsatisfiedLinkError:
> org.jblas.NativeBlas.dgemm(CCIIID[DII[DIID[DII)V
> [info]   at org.jblas.NativeBlas.dgemm(Native Method)
> [info]   at org.jblas.SimpleBlas.gemm(SimpleBlas.java:251)
> [info]   at org.jblas.DoubleMatrix.mmuli(DoubleMatrix.java:1697)
> [info]   at org.jblas.DoubleMatrix.mmul(DoubleMatrix.java:3054)
> [info]   at
> org.apache.spark.mllib.recommendation.ALSSuite$.generateRatings(ALSSuite.scala:67)
> [info]   at
> org.apache.spark.mllib.recommendation.ALSSuite.testALS(ALSSuite.scala:167)
> [info]   at
> org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply$mcV$sp(ALSSuite.scala:83)
> [info]   at
> org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply(ALSSuite.scala:83)
> [info]   at
> org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply(ALSSuite.scala:83)
> [info]   at
> org.scalatest.Transformer$$anonfun$apply$1.apply(Transformer.scala:22)
> [info]   ...
>
> -------------

Mime
View raw message