spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Demi Marie Obenour (JIRA)" <>
Subject [jira] [Closed] (SPARK-19744) Find a better alternative to netlib-java
Date Tue, 28 Feb 2017 01:49:45 GMT


Demi Marie Obenour closed SPARK-19744.

This report is bogus.  I reported it out of frustration.  Adding {{com.github.fommil:jniloader:1.1}}
(along with {{com.github.fommil.netlib:all:1.1.2}}) as dependencies does make the {{NativeSystemBLAS}},
{{NativeSystemLAPACK}}, and {{NativeSystemARPACK}} implementations visible, so this bug is
invalid.  I will file a bug about the missing dependency.

> Find a better alternative to netlib-java
> ----------------------------------------
>                 Key: SPARK-19744
>                 URL:
>             Project: Spark
>          Issue Type: New Feature
>          Components: Build, ML, MLlib
>    Affects Versions: 2.1.0
>         Environment: Fedora 25 Linux on x86-64
>            Reporter: Demi Marie Obenour
> netlib-java is, by the author's own admission, [hard to build with native BLAS and LAPACK
support|].  For licensing
reasons, Spark cannot build with native BLAS and LAPACK support by default.  This means that
MLlib is very slow.
> A better solution would be to fork netlib-java (and make it easier to build) or to create
an alternative that is easier to build.  Ideally, the native component should be as easy to
build as {{./configure && make && make install}}, and the Java component should
be a standard Maven build.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message