spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From dash <b...@nd.edu>
Subject Re: Pregel runs slower and slower when each Pregel has data dependency
Date Fri, 05 Jun 2015 18:05:41 GMT
Hi Heather,

Please check this issue https://issues.apache.org/jira/browse/SPARK-4672. I think you can
solve this problem by checkpointing your data every several iterations.

Hope that helps.

Best regards,

Baoxu(Dash) Shi
Computer Science and Engineering Department
University of Notre Dame




> On Jun 2, 2015, at 10:13 PM, heather [via Apache Spark User List] <ml-node+s1001560n23120h50@n3.nabble.com>
wrote:
> 
> hello,have you solved your problem yet? I met this problem too. 
> 
> If you reply to this email, your message will be added to the discussion below:
> http://apache-spark-user-list.1001560.n3.nabble.com/Pregel-runs-slower-and-slower-when-each-Pregel-has-data-dependency-tp7648p23120.html
> To unsubscribe from Pregel runs slower and slower when each Pregel has data dependency,
click here.
> NAML





--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Pregel-runs-slower-and-slower-when-each-Pregel-has-data-dependency-tp7648p23181.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Mime
View raw message