flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andra Lungu <lungu.an...@gmail.com>
Subject Re: Gelly EOFException
Date Thu, 16 Jul 2015 17:33:44 GMT
For now, there is a validator that checks whether the vertex ids correspond
to the target/src ids in the edges. If you want to check for vertex ID
uniqueness, you'll have to implement your own custom validator... I know
people with the same error outside Gelly, so I doubt that the lack of
unique ids triggered the exception :)

On Thu, Jul 16, 2015 at 6:14 PM, Flavio Pompermaier <pompermaier@okkam.it>
wrote:

> I thought a bit about this error..in my job I was generating multiple
> vertices with the same id.
> Could this cause such errors? Maybe there could be a check about such
> situations in Gelly..
>
> On Tue, Jul 14, 2015 at 10:00 PM, Andra Lungu <lungu.andra@gmail.com>
> wrote:
>
>> Hello,
>>
>> Sorry for the delay. The bug is not in Gelly, but is, as hinted in the
>> exception and as can be seen in the logs, in Flink's Runtime. Mihail may
>> actually be on to something. The bug is actually very similar to the one
>> described in FLINK-1916.
>>
>> However, as can be seen in the discussion thread there, it's a bit
>> difficult to fix it without some steps to reproduce. I unfortunately
>> managed to reproduce it and have opened a Jira... FLINK-2360
>> <https://issues.apache.org/jira/browse/FLINK-2360>. It's a similar delta
>> iteration setting. Hope we can get some help with this.
>>
>> Thanks!
>> Andra
>>
>> On Tue, Jul 14, 2015 at 2:12 PM, Mihail Vieru <
>> vieru@informatik.hu-berlin.de> wrote:
>>
>>>  Hi,
>>>
>>> looks very similar to this bug:
>>> https://issues.apache.org/jira/browse/FLINK-1916
>>>
>>> Best,
>>> Mihail
>>>
>>>
>>> On 14.07.2015 14:09, Andra Lungu wrote:
>>>
>>> Hi Flavio,
>>>
>>> Could you also show us a code snippet?
>>>
>>> On Tue, Jul 14, 2015 at 2:06 PM, Flavio Pompermaier <
>>> pompermaier@okkam.it> wrote:
>>>
>>>> Hi to all,
>>>> in my vertex centric iteration I get the following exception, am I
>>>> doing something wrong or is it a bug of Gelly?
>>>>
>>>>  starting iteration [1]:  CoGroup (Messaging) (6/8)
>>>> IterationHead(WorksetIteration (Vertex-centric iteration
>>>> (test.gelly.functions.VUpdateFunction@1814786f
>>>> | test.gelly.functions.VMessagingFunction@67eecbc2))) (4/8) switched
>>>> to FAILED with exception.
>>>> java.io.EOFException
>>>>  at
>>>> org.apache.flink.runtime.operators.hash.InMemoryPartition$WriteView.nextSegment(InMemoryPartition.java:333)
>>>>  at
>>>> org.apache.flink.runtime.memorymanager.AbstractPagedOutputView.advance(AbstractPagedOutputView.java:140)
>>>>  at
>>>> org.apache.flink.runtime.memorymanager.AbstractPagedOutputView.write(AbstractPagedOutputView.java:201)
>>>>  at
>>>> org.apache.flink.api.java.typeutils.runtime.DataOutputViewStream.write(DataOutputViewStream.java:39)
>>>>  at com.esotericsoftware.kryo.io.Output.flush(Output.java:163)
>>>>  at
>>>> org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.serialize(KryoSerializer.java:187)
>>>>  at
>>>> org.apache.flink.api.java.typeutils.runtime.PojoSerializer.serialize(PojoSerializer.java:372)
>>>>  at
>>>> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:116)
>>>>  at
>>>> org.apache.flink.api.java.typeutils.runtime.TupleSerializer.serialize(TupleSerializer.java:30)
>>>>  at
>>>> org.apache.flink.runtime.operators.hash.InMemoryPartition.appendRecord(InMemoryPartition.java:219)
>>>>  at
>>>> org.apache.flink.runtime.operators.hash.CompactingHashTable.insertOrReplaceRecord(CompactingHashTable.java:536)
>>>>  at
>>>> org.apache.flink.runtime.operators.hash.CompactingHashTable.buildTableWithUniqueKey(CompactingHashTable.java:347)
>>>>  at
>>>> org.apache.flink.runtime.iterative.task.IterationHeadPactTask.readInitialSolutionSet(IterationHeadPactTask.java:209)
>>>>  at
>>>> org.apache.flink.runtime.iterative.task.IterationHeadPactTask.run(IterationHeadPactTask.java:270)
>>>>  at
>>>> org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362)
>>>>  at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
>>>>  at java.lang.Thread.run(Thread.java:745)
>>>>
>>>>
>>>>  Best,
>>>> Flavio
>>>>
>>>
>>>
>>>
>>
>
>

Mime
View raw message