flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gábor Hermann (JIRA) <j...@apache.org>
Subject [jira] [Commented] (FLINK-1239) Fix iteration example getting stuck with large input
Date Wed, 01 Apr 2015 13:47:54 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390564#comment-14390564
] 

Gábor Hermann commented on FLINK-1239:
--------------------------------------

The IterationExample runs and terminates. The bug cannot be reproduced the above mentioned
way, because the user is not allowed to set buffer timeout to 0 at the tail of the iteration.
But if it is allowed and set to 0, we get an other problem might be worth investigating:

15:37:45.064 [Map (1/8)] ERROR org.apache.flink.streaming.api.collector.StreamOutput  - Emit
failed due to: java.lang.NullPointerException
	at org.apache.flink.runtime.io.network.api.serialization.SpanningRecordSerializer.setNextBuffer(SpanningRecordSerializer.java:93)
	at org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit(RecordWriter.java:92)
	at org.apache.flink.streaming.api.collector.StreamOutput.collect(StreamOutput.java:66)
	at org.apache.flink.streaming.api.collector.CollectorWrapper.collect(CollectorWrapper.java:39)
	at org.apache.flink.streaming.api.invokable.operator.MapInvokable.callUserFunction(MapInvokable.java:42)
	at org.apache.flink.streaming.api.invokable.StreamInvokable.callUserFunctionAndLogException(StreamInvokable.java:139)
	at org.apache.flink.streaming.api.invokable.operator.MapInvokable.invoke(MapInvokable.java:36)
	at org.apache.flink.streaming.api.streamvertex.StreamVertex.invoke(StreamVertex.java:171)
	at org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:217)
	at java.lang.Thread.run(Thread.java:745)

> Fix iteration example getting stuck with large input
> ----------------------------------------------------
>
>                 Key: FLINK-1239
>                 URL: https://issues.apache.org/jira/browse/FLINK-1239
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming
>            Reporter: Gábor Hermann
>            Assignee: Gábor Hermann
>
> When running the streaming iteration example with buffer timeout set to 0 (meaning the
StreamRecorWriter gets flushed after every emit in every task), the iteration gets stuck at
flushing the output after emitting a record. This happens only on larger number of inputs
(eg. 1000 record to iterate on).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message