hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mahesh Babu <jmb...@gmail.com>
Subject Re: Error - Messages must never be behind the vertex in ID! Current Message ID: 2 vs. 20
Date Wed, 21 Aug 2013 10:40:36 GMT
Thanks to Suraj. This problem is resolved.

My input data file didnot have line for few vertices. Hence vertex reader
did not create the vertex object too.

So modified my input file to contain vertex line: for example:
0       1:41    2:18    3:83    4:58    5:97    6:53    7:45    8:51
9:21    10:34
2       *<<<<<<<<----- added such lines where nodes do not have outgoing
edges*
3       540:29  581:72  1009:46 1356:62 1544:15 2044:70 2045:78 2046:44
2047:53 2048:50

Regards,
Mahesh Babu




On Mon, Aug 19, 2013 at 10:15 AM, Mahesh Babu <jmbabu@gmail.com> wrote:

> Hi Suraj,
>
> Also to say that.. your email text was the clue in case Hama reader is
> expecting one line per vertex. irrespective of adjacencies.
>
> Thanks,
> Mahesh Babu
>
>
> On Mon, Aug 19, 2013 at 10:11 AM, Mahesh Babu <jmbabu@gmail.com> wrote:
>
>> Hi Suraj,
>>
>> Great to hear from you.
>>
>> Figured that 2 vs 20 problem is because I am not creating a vertex from
>> the reader class. That is because my INPUT file doesnot have a separate
>> line for vertex 2 and its adjacencies. I assumed that even though I do not
>> have an "INPUT" file line for vertex 2.. it will work. because I create
>> Edge<> object that terminates on vertex 2 in other INPUT text file lines.
>>
>> Close inspection of my code revealed me the same.
>>
>> Also I am not sure if order of lines is still applicable.. as of now it
>> seems to work..
>>
>> I will run few more tests before I update status back to the list.
>>
>> Thanks,
>> Mahesh Babu
>>
>>
>> On Sun, Aug 18, 2013 at 12:51 AM, Suraj Menon <menonsuraj5@gmail.com>wrote:
>>
>>> Hi can you send me your input if it is not too large file? And is both 2
>>> and 20 a part of your graph?
>>> Please reply to me with attachment, you cannot send attachment to
>>> mailing list.
>>>
>>> Thanks,
>>> Suraj
>>>
>>>
>>> On Wed, Aug 14, 2013 at 2:47 AM, Mahesh Babu <jmbabu@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Yes. Integer or String type the the errors come. Small examples work,
>>>> but
>>>> when it comes to large input it is hitting at this problem.
>>>>
>>>> I guess I am in a dead lock,
>>>>
>>>> Any hint where I should be looking / debugging ?
>>>>
>>>> Regards,
>>>> Mahesh Babu
>>>>
>>>>
>>>>
>>>>
>>>> On Fri, Aug 9, 2013 at 5:35 PM, Edward J. Yoon <edwardyoon@apache.org
>>>> >wrote:
>>>>
>>>> > Hi,
>>>> >
>>>> > Integer ID (1, 2, ..) should be fine. As other people said, I think
>>>> > you need to check the input graph type.
>>>> >
>>>> > On Fri, Aug 9, 2013 at 8:50 PM, Mahesh Babu <jmbabu@gmail.com>
wrote:
>>>> > > Hi Edward,
>>>> > >
>>>> > > I replaced node names from 1 to "one", 6288 to
>>>> > > "sixthousandtwohundredeightyeight", etc.
>>>> > > I am not getting the error now. so it may be something to do with
>>>> number
>>>> > > itself being the name.
>>>> > >
>>>> > > Will monitor if I hit at this error once again. For now it is
>>>> working.
>>>> > > Proceeding with some more code changes.
>>>> > >
>>>> > > Thanks,
>>>> > > Mahesh Babu
>>>> > >
>>>> > >
>>>> > > On Fri, Aug 9, 2013 at 2:38 PM, Mahesh Babu <jmbabu@gmail.com>
>>>> wrote:
>>>> > >
>>>> > >> Hi Edward,
>>>> > >>
>>>> > >> In my case vertices are named with numbers. like 1,2,3...etc
>>>> itself. No
>>>> > >> alphabets in the vertex name, it is just 1 to 10000+ nodes
>>>> identified by
>>>> > >> the number itself.
>>>> > >>
>>>> > >> You think that could be reason ?
>>>> > >>
>>>> > >> Regards,
>>>> > >> Mahesh Babu
>>>> > >>
>>>> > >>
>>>> > >> On Fri, Aug 9, 2013 at 1:58 PM, Edward J. Yoon <
>>>> edwardyoon@apache.org
>>>> > >wrote:
>>>> > >>
>>>> > >>> It occurs when the vertices are unsorted.
>>>> > >>>
>>>> > >>> Please check whether your vertex parser reads correctly,
and
>>>> > >>> partitioning job was run before the graph job.
>>>> > >>>
>>>> > >>> On Fri, Aug 9, 2013 at 3:43 PM, Mahesh Babu <jmbabu@gmail.com>
>>>> wrote:
>>>> > >>> > Hi,
>>>> > >>> >
>>>> > >>> > adding more details about the environment.
>>>> > >>> >
>>>> > >>> > When I run hama-examples-0.6.2.jar with tutorial example/input
>>>> > (berlin
>>>> > >>> > example) file it works without any error.
>>>> > >>> >
>>>> > >>> > Now when I try my own input file which has approximately
10k
>>>> nodes
>>>> >  and
>>>> > >>> 39k
>>>> > >>> > edges but it fails with:
>>>> > >>> >
>>>> > >>> >        java.lang.IllegalArgumentException: Messages
must never
>>>> be
>>>> > >>> behind the
>>>> > >>> > vertex in ID! Current Message ID: 2 vs. 20
>>>> > >>> >
>>>> > >>> > What am I doing wrong ?
>>>> > >>> >
>>>> > >>> > Any help/explanation is appreciated.
>>>> > >>> >
>>>> > >>> > Regards,
>>>> > >>> > Mahesh Babu
>>>> > >>> >
>>>> > >>> >
>>>> > >>> >
>>>> > >>> >
>>>> > >>> > On Thu, Aug 8, 2013 at 4:25 PM, Mahesh Babu <jmbabu@gmail.com>
>>>> > wrote:
>>>> > >>> >>
>>>> > >>> >> Hi,
>>>> > >>> >>
>>>> > >>> >> I followed the SSSP example, GraphJob example
and getting
>>>> following
>>>> > >>> error:
>>>> > >>> >>
>>>> > >>> >> 13/08/08 16:01:57 INFO bsp.BSPJobClient: Current
supersteps
>>>> number:
>>>> > 0
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
>>>> > mortbay.log:
>>>> > >>> >> Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log)
>>>> via
>>>> > >>> >> org.mortbay.log.Slf4jLog
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
>>>> > >>> >> sync.ZKSyncClient: Initializing ZK Sync Client
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
>>>> > >>> >> sync.ZooKeeperSyncClientImpl: Start connecting
to Zookeeper! At
>>>> > >>> >> localhost/127.0.0.1:61001
>>>> > >>> >>
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
>>>> > >>> >> message.MessageTransferQueueFactory: Message queue
is
>>>> configured on
>>>> > >>> >> deprecated parameter:hama.messenger.queue.class
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
>>>> > >>> >> message.MessageTransferQueueFactory: Message queue
is
>>>> configured on
>>>> > >>> >> deprecated parameter:hama.messenger.queue.class
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
>>>> > ipc.Server:
>>>> > >>> >> Starting SocketReader
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
>>>> > ipc.Server:
>>>> > >>> IPC
>>>> > >>> >> Server Responder: starting
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
>>>> > ipc.Server:
>>>> > >>> IPC
>>>> > >>> >> Server listener on 61001: starting
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
>>>> > >>> >> message.HadoopMessageManagerImpl:  BSPPeer address:localhost
>>>> > port:61001
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
>>>> > ipc.Server:
>>>> > >>> IPC
>>>> > >>> >> Server handler 0 on 61001: starting
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
>>>> > >>> >> graph.GraphJobRunner: 4935 vertices are loaded
into
>>>> localhost:61001
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
>>>> > >>> >> message.MessageTransferQueueFactory: Message queue
is
>>>> configured on
>>>> > >>> >> deprecated parameter:hama.messenger.queue.class
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
>>>> > >>> >> message.MessageTransferQueueFactory: Message queue
is
>>>> configured on
>>>> > >>> >> deprecated parameter:hama.messenger.queue.class
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
>>>> > >>> >> message.MessageTransferQueueFactory: Message queue
is
>>>> configured on
>>>> > >>> >> deprecated parameter:hama.messenger.queue.class
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
>>>> > >>> >> message.MessageTransferQueueFactory: Message queue
is
>>>> configured on
>>>> > >>> >> deprecated parameter:hama.messenger.queue.class
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
>>>> > >>> >> message.MessageTransferQueueFactory: Message queue
is
>>>> configured on
>>>> > >>> >> deprecated parameter:hama.messenger.queue.class
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
ERROR
>>>> > >>> bsp.BSPTask:
>>>> > >>> >> Error running bsp setup and bsp function.
>>>> > >>> >> attempt_201308081548_0005_000000_0:
>>>> > java.lang.IllegalArgumentException:
>>>> > >>> >> Messages must never be behind the vertex in ID!
Current
>>>> Message ID:
>>>> > 2
>>>> > >>> vs. 20
>>>> > >>> >> attempt_201308081548_0005_000000_0:     at
>>>> > >>> >>
>>>> > org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284)
>>>> > >>> >> attempt_201308081548_0005_000000_0:     at
>>>> > >>> >>
>>>> > >>>
>>>> >
>>>> org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229)
>>>> > >>> >> attempt_201308081548_0005_000000_0:     at
>>>> > >>> >>
>>>> org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:133)
>>>> > >>> >> attempt_201308081548_0005_000000_0:     at
>>>> > >>> >> org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:177)
>>>> > >>> >> attempt_201308081548_0005_000000_0:     at
>>>> > >>> >> org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
>>>> > >>> >> attempt_201308081548_0005_000000_0:     at
>>>> > >>> >>
>>>> > >>>
>>>> >
>>>> org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1262)
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
>>>> > >>> >> message.MessageTransferQueueFactory: Message queue
is
>>>> configured on
>>>> > >>> >> deprecated parameter:hama.messenger.queue.class
>>>> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
>>>> > ipc.Server:
>>>> > >>> >> Stopping server on 61001
>>>> > >>> >>
>>>> > >>> >>
>>>> > >>> >> What could be the reason I am getting this error.
>>>> > >>> >>
>>>> > >>> >> I am able to run the code in eclipse/standalong
environment.
>>>> > However,
>>>> > >>> when
>>>> > >>> >> I try to run with hama/hadoop pseudo distribution
mode it
>>>> fails.
>>>> > >>> >>
>>>> > >>> >> Thanks,
>>>> > >>> >> Mahesh Babu
>>>> > >>> >>
>>>> > >>> >
>>>> > >>>
>>>> > >>>
>>>> > >>>
>>>> > >>> --
>>>> > >>> Best Regards, Edward J. Yoon
>>>> > >>> @eddieyoon
>>>> > >>>
>>>> > >>
>>>> > >>
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > Best Regards, Edward J. Yoon
>>>> > @eddieyoon
>>>> >
>>>>
>>>
>>>
>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message