spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James <alcaid1...@gmail.com>
Subject Why a program would receive null from send message of mapReduceTriplets
Date Thu, 12 Feb 2015 14:26:50 GMT
Hello,

When I am running the code on a much bigger size graph, I met
NullPointerException.

I found that is because the sendMessage() function receive a triplet that
edge.srcAttr or edge.dstAttr is null. Thus I wonder why it will happen as I
am sure every vertices have a attr.

Any returns is appreciated.

Alcaid


2015-02-11 19:30 GMT+08:00 James <alcaid1801@gmail.com>:

> Hello,
>
> Recently  I am trying to estimate the average distance of a big graph
> using spark with the help of [HyperAnf](
> http://dl.acm.org/citation.cfm?id=1963493).
>
> It works like Connect Componenet algorithm, while the attribute of a
> vertex is a HyperLogLog counter that at k-th iteration it estimates the
> number of vertices it could reaches less than k hops.
>
> I have successfully run the code on a graph with 20M vertices. But I still
> need help:
>
>
> *I think the code could work more efficiently especially the "Send
> message" function, but I am not sure about what will happen if a vertex
> receive no message at a iteration.*
>
> Here is my code: https://github.com/alcaid1801/Erdos
>
> Any returns is appreciated.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message