spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From MLnick <...@git.apache.org>
Subject [GitHub] incubator-spark pull request: [Proposal] Adding sparse data suppor...
Date Tue, 18 Feb 2014 21:49:53 GMT
Github user MLnick commented on the pull request:

    https://github.com/apache/incubator-spark/pull/575#issuecomment-35438611
  
    @mengxr <https://github.com/mengxr> at the risk of adding to your
    workload... I think (license issues aside since I suppose both Breeze and
    MTJ are affected in the same way), that it would be great to get a sense of
    MTJ performance (which should in theory be as good as or better than
    Breeze).
    
    One issue that came up with MLlib developers initially was that Breeze
    performance suffered due to heavy implicit use / object creation. It would
    be good to know if this is not the case anymore (ie if recent dev had fixed
    this). If not, MTJ would be a good alternative (again, wrapped in a
    lightweight DSL if we wish).
    
    
    On Tue, Feb 18, 2014 at 11:46 PM, Sam Halliday <notifications@github.com>wrote:
    
    > @mengxr <https://github.com/mengxr> no MTJ in the benchmarks? ;-) Given
    > that it has the most mature sparse library on the JVM, I am surprised that
    > you omitted it.
    >
    > --
    > Reply to this email directly or view it on GitHub<https://github.com/apache/incubator-spark/pull/575#issuecomment-35438198>
    > .
    >


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. To do so, please top-post your response.
If your project does not have this feature enabled and wishes so, or if the
feature is enabled but not working, please contact infrastructure at
infrastructure@apache.org or file a JIRA ticket with INFRA.
---

Mime
View raw message