spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Taka Shinagawa <taka.epsi...@gmail.com>
Subject Re: libgfortran Dependency
Date Thu, 10 Jul 2014 02:57:35 GMT
Thanks for point me to the MLlib guide. I was looking at only README and
Spark docs.

Also found it's already filed in JIRA
https://spark-project.atlassian.net/browse/SPARK-797


On Wed, Jul 9, 2014 at 7:45 PM, Xiangrui Meng <mengxr@gmail.com> wrote:

> It is documented in the official doc:
> http://spark.apache.org/docs/latest/mllib-guide.html
>
> On Wed, Jul 9, 2014 at 7:35 PM, Taka Shinagawa <taka.epsilon@gmail.com>
> wrote:
> > Hi,
> >
> > After testing Spark 1.0.1-RC2 on EC2 instances from the standard Ubuntu
> and
> > Amazon Linux AMIs,
> > I've noticed the MLlib's dependancy on gfortran library
> (libgfortran.so.3).
> >
> > "sbt assembly" succeeds without this library installed, but "sbt test"
> > fails as follows.
> >
> > I'm wondering if documenting this dependency in README and online doc
> might
> > a good idea.
> >
> > -------------
> > [info] ALSSuite:
> > -- org.jblas ERROR Couldn't load copied link file:
> > java.lang.UnsatisfiedLinkError:
> > /tmp/jblas8312335435391185287libjblas_arch_flavor.so: libgfortran.so.3:
> > cannot open shared object file: No such file or directory.
> >
> > On Linux 64bit, you need additional support libraries.
> > You need to install libgfortran3.
> >
> > For example for debian or Ubuntu, type "sudo apt-get install
> libgfortran3"
> >
> > For more information, see
> > https://github.com/mikiobraun/jblas/wiki/Missing-Libraries
> > [info] Exception encountered when attempting to run a suite with class
> > name: org.apache.spark.mllib.recommendation.ALSSuite *** ABORTED ***
> > [info]   java.lang.UnsatisfiedLinkError:
> > org.jblas.NativeBlas.dgemm(CCIIID[DII[DIID[DII)V
> > [info]   at org.jblas.NativeBlas.dgemm(Native Method)
> > [info]   at org.jblas.SimpleBlas.gemm(SimpleBlas.java:251)
> > [info]   at org.jblas.DoubleMatrix.mmuli(DoubleMatrix.java:1697)
> > [info]   at org.jblas.DoubleMatrix.mmul(DoubleMatrix.java:3054)
> > [info]   at
> >
> org.apache.spark.mllib.recommendation.ALSSuite$.generateRatings(ALSSuite.scala:67)
> > [info]   at
> >
> org.apache.spark.mllib.recommendation.ALSSuite.testALS(ALSSuite.scala:167)
> > [info]   at
> >
> org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply$mcV$sp(ALSSuite.scala:83)
> > [info]   at
> >
> org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply(ALSSuite.scala:83)
> > [info]   at
> >
> org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply(ALSSuite.scala:83)
> > [info]   at
> > org.scalatest.Transformer$$anonfun$apply$1.apply(Transformer.scala:22)
> > [info]   ...
> >
> > -------------
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message