spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lev <>
Subject Using native blas with mllib
Date Thu, 15 Jan 2015 12:41:52 GMT
I'm trying to use the native blas, and I followed all the threads I saw here
and I still can't get rid of those warning:
WARN netlib.BLAS: Failed to load implementation from:
WARN netlib.BLAS: Failed to load implementation from:

I'm using:
Centos 6.5
java 1.7.0_71
spark 1.1.0
running on yarn cluster

and the things I done so far are:

- install those packeges:
  - lapack-devel
  - blas-devel
  - atlas-devel
  - openblas-devel
  - gcc-gfortran.x86_64
  - libgfortran.x86_64 

- added those dependencies to mllib pom.xml:

	(I know that the -Pnetlib-lgpl flag shloud have take care of the netlib
dependency, but for some reason it didn't work)
- build spark with the command: mvn -Pyarn -Phive -Phadoop-2.5 -Pnetlib-lgpl
-Dhadoop.version=2.5.0-cdh5.2.0 -DskipTests clean package
(I'm building it on windows if it makes any difference)

And I did the follwing checks:
	sudo /sbin/ldconfig -p | grep (libc6,x86-64) => /usr/lib64/

	sudo /sbin/ldconfig -p | grep (libc6,x86-64) => /usr/lib64/ (libc6,x86-64) => /usr/lib64/atlas/
	jar tf
| grep ""

Anything else I can try?


View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message