spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Keith Massey <keith.mas...@digitalreasoning.com>
Subject Re: TriangleCount & Shortest Path under Spark
Date Thu, 13 Mar 2014 15:29:22 GMT
The triangle count failed for me when I ran it on more than one node. There
was this assertion in TriangleCount.scala:
         // double count should be even (divisible by two)
        assert((dblCount & 1) == 0)
That did not hold true when I ran this on multiple nodes, even when
following the guidelines to make sure that all source ids are greater than
destination ids and partitioning the graph using RandomVertexCut. I didn't
dig into the code to see why this assertion was failing, but commenting
that line out allowed the code to run. I'm not sure how much I can trust
the results, but they looked generally right. Not sure if this is the
failure you are talking about or not.

As far as shortest path, the programming guide had an example that worked
well for me under
https://spark.incubator.apache.org/docs/latest/graphx-programming-guide.html#pregel-api
.

Keith


On Sun, Mar 9, 2014 at 5:52 PM, yxzhao <yxzhao@ualr.edu> wrote:

> Hi All,
>
> I have already set up Spark-0.9.0-incubating on our school's cluster. I
> successfully run the Spark PageRank demo located in
> /spark-0.9.0-incubating/examples/src/main/scala/org/apache/spark/examples.
>
> Problem 1. I want to run the TriangleCount whose source code located
>
> in/spark-0.9.0-incubating/graphx/src/main/scala/org/apache/spark/graphx/lib.
> I used the following command.
> ./bin/run-example org.apache.spark.graphx.GraphOps.TriangleCount
> spark://10.1.255.206:7077
>  But it did not work. Is there any mistake in my command line? Could
> anybody
> let me know how to correctly run the TriangleCount demo. Thanks very much.
>
> Problem 2.  Does anybody have shortest path implementation code under
> Spark?
> If so could you share it with me?
>
> Thanks in advance,
> Regards,
> Joey
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/TriangleCount-Shortest-Path-under-Spark-tp2438.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>

Mime
View raw message