spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wei Tan <w...@us.ibm.com>
Subject Re: sparse x sparse matrix multiplication
Date Thu, 06 Nov 2014 07:48:34 GMT

I think Xiangrui's ALS code implement certain aspect of it. You may want to
check it out.
Best regards,
Wei

---------------------------------
Wei Tan, PhD
Research Staff Member
IBM T. J. Watson Research Center




From:	Xiangrui Meng <mengxr@gmail.com>
To:	Duy Huynh <duy.huynh.uiv@gmail.com>
Cc:	user <user@spark.incubator.apache.org>
Date:	11/05/2014 01:13 PM
Subject:	Re: sparse x sparse matrix multiplication



You can use breeze for local sparse-sparse matrix multiplication and
then define an RDD of sub-matrices

RDD[(Int, Int, CSCMatrix[Double])] (blockRowId, blockColId, sub-matrix)

and then use join and aggregateByKey to implement this feature, which
is the same as in MapReduce.

-Xiangrui

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message