spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tomas Hudik <xhu...@gmail.com>
Subject MLLIB and Openblas library in non-default dir
Date Fri, 02 Jan 2015 11:41:17 GMT
Hi
I have compiled OpenBlas library into nonstandard directory and I want to
inform Spark app about it via:
-Dcom.github.fommil.netlib.NativeSystemBLAS.natives=/usr/local/lib/libopenblas.so


I tried 2 ways:
1. via --conf parameter
bin/spark-submit -v  --class
org.apache.spark.examples.mllib.LinearRegression --conf
"-Dcom.github.fommil.netlib.NativeSystemBLAS.natives=/usr/local/lib/libopenblas.so"
examples/target/scala-2.10/spark-examples-1.3.0-SNAPSHOT-hadoop1.0.4.jar
data/mllib/sample_libsvm_data.txt

2. via --driver-java-options parameter
bin/spark-submit -v --driver-java-options
"-Dcom.github.fommil.netlib.NativeSystemBLAS.natives=/usr/local/lib/libopenblas.so"
--class org.apache.spark.examples.mllib.LinearRegression
examples/target/scala-2.10/spark-examples-1.3.0-SNAPSHOT-hadoop1.0.4.jar
data/mllib/sample_libsvm_data.txt

How can I force spark-submit to propagate info about non-standard placement
to netlob-java lib?

-Dcom.github.fommil.netlib.NativeSystemBLAS.natives=/usr/local is standard
option in netlib-java (https://github.com/fommil/netlib-java)


thanks, Tomas

Mime
View raw message