spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From MLnick <...@git.apache.org>
Subject [GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...
Date Tue, 18 Feb 2014 22:27:33 GMT
Github user MLnick commented on the pull request:

    https://github.com/apache/incubator-spark/pull/575#issuecomment-35443064
  
    @mengxr <https://github.com/mengxr> ok, that is interesting. I have always
    advocated for Breeze, but was told 6 months ago that it was a non-starter
    due to these performance overheads. If that has changed I'm super happy.
    Given that all we need for MLlib (for now anyway) is sparse vectors, I am
    still in favour of Breeze. Since I believe breeze-math has great potential
    to become the de facto numpy of Scala (is already really), I believe we
    should rather spend resources making Breeze better where necessary, which
    benefits Spark as well as the rest of the (growing) Scala scientific
    computing community.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. To do so, please top-post your response.
If your project does not have this feature enabled and wishes so, or if the
feature is enabled but not working, please contact infrastructure at
infrastructure@apache.org or file a JIRA ticket with INFRA.
---

Mime
View raw message