spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew A <andrew.a...@gmail.com>
Subject Graphx
Date Thu, 10 Mar 2016 21:44:05 GMT
Hi, is there anyone who use graphx in production? What maximum size of
graphs did you process by spark and what cluster are you use for it?

i tried calculate pagerank for 1 Gb edges LJ - dataset for
LiveJournalPageRank from spark examples and i faced with large volume
shuffles produced by spark which fail my spark job.


Thank you,
Andrew

Mime
View raw message