spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wei Tan <>
Subject Re: sparse x sparse matrix multiplication
Date Thu, 06 Nov 2014 07:48:34 GMT

I think Xiangrui's ALS code implement certain aspect of it. You may want to
check it out.
Best regards,

Wei Tan, PhD
Research Staff Member
IBM T. J. Watson Research Center

From:	Xiangrui Meng <>
To:	Duy Huynh <>
Cc:	user <>
Date:	11/05/2014 01:13 PM
Subject:	Re: sparse x sparse matrix multiplication

You can use breeze for local sparse-sparse matrix multiplication and
then define an RDD of sub-matrices

RDD[(Int, Int, CSCMatrix[Double])] (blockRowId, blockColId, sub-matrix)

and then use join and aggregateByKey to implement this feature, which
is the same as in MapReduce.


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message