spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Demi Marie Obenour (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (SPARK-19744) Find a better alternative to netlib-java
Date Tue, 28 Feb 2017 01:49:45 GMT

     [ https://issues.apache.org/jira/browse/SPARK-19744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Demi Marie Obenour closed SPARK-19744.
--------------------------------------

This report is bogus.  I reported it out of frustration.  Adding {{com.github.fommil:jniloader:1.1}}
(along with {{com.github.fommil.netlib:all:1.1.2}}) as dependencies does make the {{NativeSystemBLAS}},
{{NativeSystemLAPACK}}, and {{NativeSystemARPACK}} implementations visible, so this bug is
invalid.  I will file a bug about the missing dependency.

> Find a better alternative to netlib-java
> ----------------------------------------
>
>                 Key: SPARK-19744
>                 URL: https://issues.apache.org/jira/browse/SPARK-19744
>             Project: Spark
>          Issue Type: New Feature
>          Components: Build, ML, MLlib
>    Affects Versions: 2.1.0
>         Environment: Fedora 25 Linux on x86-64
>            Reporter: Demi Marie Obenour
>
> netlib-java is, by the author's own admission, [hard to build with native BLAS and LAPACK
support|https://github.com/fommil/netlib-java/issues/83#issuecomment-114014185].  For licensing
reasons, Spark cannot build with native BLAS and LAPACK support by default.  This means that
MLlib is very slow.
> A better solution would be to fork netlib-java (and make it easier to build) or to create
an alternative that is easier to build.  Ideally, the native component should be as easy to
build as {{./configure && make && make install}}, and the Java component should
be a standard Maven build.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message