spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew A <>
Subject Graphx
Date Thu, 10 Mar 2016 21:44:05 GMT
Hi, is there anyone who use graphx in production? What maximum size of
graphs did you process by spark and what cluster are you use for it?

i tried calculate pagerank for 1 Gb edges LJ - dataset for
LiveJournalPageRank from spark examples and i faced with large volume
shuffles produced by spark which fail my spark job.

Thank you,

View raw message