spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nick Pentreath <nick.pentre...@gmail.com>
Subject MLlib linking error Mac OS X
Date Thu, 16 Jan 2014 12:10:09 GMT
Hi

I am running into a linking error on Mac OS X for MLlib jblas:

java.lang.UnsatisfiedLinkError: Couldn't find the resource
libjblas_arch_flavor.*dylib*.

at org.jblas.util.LibraryLoader.loadLibrary(LibraryLoader.java:94)
~[graphflow-spark-jobs-0.2.2-SNAPSHOT.jar:0.2.2-SNAPSHOT]

at org.jblas.util.ArchFlavor.<clinit>(ArchFlavor.java:50)
~[graphflow-spark-jobs-0.2.2-SNAPSHOT.jar:0.2.2-SNAPSHOT]

at org.jblas.util.LibraryLoader.loadLibrary(LibraryLoader.java:75)
~[graphflow-spark-jobs-0.2.2-SNAPSHOT.jar:0.2.2-SNAPSHOT]

at org.jblas.NativeBlas.<clinit>(NativeBlas.java:84)
~[graphflow-spark-jobs-0.2.2-SNAPSHOT.jar:0.2.2-SNAPSHOT]

at org.jblas.SimpleBlas.gemm(SimpleBlas.java:245)
~[graphflow-spark-jobs-0.2.2-SNAPSHOT.jar:0.2.2-SNAPSHOT]

at org.jblas.DoubleMatrix.mmuli(DoubleMatrix.java:1675)
~[graphflow-spark-jobs-0.2.2-SNAPSHOT.jar:0.2.2-SNAPSHOT]

at org.jblas.DoubleMatrix.mmul(DoubleMatrix.java:3006)
~[graphflow-spark-jobs-0.2.2-SNAPSHOT.jar:0.2.2-SNAPSHOT]

at
org.apache.spark.mllib.recommendation.ALS$$anonfun$computeYtY$1$$anonfun$apply$7.apply(ALS.scala:215)
~[spark-assembly-0.8.1-incubating-hadoop1.0.4.jar:0.8.1-incubating]


Problem is that I can see within the JBLAS jar a file called: lib/static/Mac\
OS\ X/x86_64/libjblas_arch_flavor.jnilib which seems to be what it should
look for, but it is looking for .dylib instead.

Running on Linux with "sudo apt-get install libgfortran3" works fine.

I have installed gfortran latest via Homebrew (even uninstalled and
reinstalled with --multilib option to try that out). I can't seem to find
an answer to this specific issue via Google. Anyone else ran into a similar
issue? Worst case do i need to build gfortran from source perhaps? It's
quite annoying since I can't do local development


N

Mime
View raw message