spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Xiangrui Meng <men...@gmail.com>
Subject Re: Turn BLAS on MacOSX
Date Mon, 12 May 2014 14:38:23 GMT
Those are warning messages instead of errors. You need to add
netlib-java:all to use native BLAS/LAPACK. But it won't work if you
include netlib-java:all in an assembly jar. It has to be a separate
jar when you submit your job. For SGD, we only use level-1 BLAS, so I
don't think native code is called. -Xiangrui

On Sun, May 11, 2014 at 9:32 AM, DB Tsai <dbtsai@stanford.edu> wrote:
> Hi Debasish,
>
> In https://github.com/apache/spark/blob/master/docs/mllib-guide.md
> Dependencies section, the document talks about the native blas dependencies
> issue.
>
> For netlib which breeze uses internally, if the native library isn't found,
> the jblas implementation will be used.
>
> Here is more detail about how to install native library in different
> platform.
> https://github.com/fommil/netlib-java/blob/master/README.md#machine-optimised-system-libraries
>
>
> Sincerely,
>
> DB Tsai
> -------------------------------------------------------
> My Blog: https://www.dbtsai.com
> LinkedIn: https://www.linkedin.com/in/dbtsai
>
>
> On Wed, May 7, 2014 at 10:52 AM, Debasish Das <debasish.das83@gmail.com>
> wrote:
>>
>> Hi,
>>
>> How do I load native BLAS libraries on Mac ?
>>
>> I am getting the following errors while running LR and SVM with SGD:
>>
>> 14/05/07 10:48:13 WARN BLAS: Failed to load implementation from:
>> com.github.fommil.netlib.NativeSystemBLAS
>>
>> 14/05/07 10:48:13 WARN BLAS: Failed to load implementation from:
>> com.github.fommil.netlib.NativeRefBLAS
>>
>> centos it was fine...but on mac I am getting these warnings..
>>
>> Also when it fails to run native blas does it use java code for BLAS
>> operations ?
>>
>> May be after addition of breeze, we should add these details on a page as
>> well so that users are aware of it before they report any performance
>> results..
>>
>> Thanks.
>>
>> Deb
>
>

Mime
View raw message