spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James <>
Subject Why a program would receive null from send message of mapReduceTriplets
Date Thu, 12 Feb 2015 14:26:50 GMT

When I am running the code on a much bigger size graph, I met

I found that is because the sendMessage() function receive a triplet that
edge.srcAttr or edge.dstAttr is null. Thus I wonder why it will happen as I
am sure every vertices have a attr.

Any returns is appreciated.


2015-02-11 19:30 GMT+08:00 James <>:

> Hello,
> Recently  I am trying to estimate the average distance of a big graph
> using spark with the help of [HyperAnf](
> It works like Connect Componenet algorithm, while the attribute of a
> vertex is a HyperLogLog counter that at k-th iteration it estimates the
> number of vertices it could reaches less than k hops.
> I have successfully run the code on a graph with 20M vertices. But I still
> need help:
> *I think the code could work more efficiently especially the "Send
> message" function, but I am not sure about what will happen if a vertex
> receive no message at a iteration.*
> Here is my code:
> Any returns is appreciated.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message