flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gyula Fora (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (FLINK-2589) Threads created in TimeTriggerPolicy don't end properly
Date Wed, 21 Oct 2015 21:29:27 GMT

     [ https://issues.apache.org/jira/browse/FLINK-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Gyula Fora resolved FLINK-2589.
-------------------------------
    Resolution: Not A Problem

> Threads created in TimeTriggerPolicy don't end properly
> -------------------------------------------------------
>
>                 Key: FLINK-2589
>                 URL: https://issues.apache.org/jira/browse/FLINK-2589
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming
>            Reporter: Arnaud Linz
>            Priority: Minor
>
> TimeTriggerPolicy uses a thread (TimeCheck) to push fake events in case of time out.
However, this threads implements a infinite loop and ignore InterruptExceptions : it never
ends properly.
> Once created, it continues to push fake events even if the execution is over, polluting
the standard error with stacktraces because the fake element post fails. This  especially
occurs in unit tests using local clusters, because the JVM does not end.
> Stack trace extract :
> java.lang.RuntimeException: Could not forward element to next operator
> 	at org.apache.flink.streaming.runtime.tasks.OutputHandler$ChainingOutput.collect(OutputHandler.java:291)
> 	at org.apache.flink.streaming.runtime.tasks.OutputHandler$ChainingOutput.collect(OutputHandler.java:276)
> 	at org.apache.flink.streaming.runtime.io.CollectorWrapper.collect(CollectorWrapper.java:50)
> 	at org.apache.flink.streaming.runtime.io.CollectorWrapper.collect(CollectorWrapper.java:30)
> 	at org.apache.flink.streaming.api.windowing.windowbuffer.BasicWindowBuffer.emitWindow(BasicWindowBuffer.java:44)
> 	at org.apache.flink.streaming.api.operators.windowing.StreamWindowBuffer.handleWindowEvent(StreamWindowBuffer.java:57)
> 	at org.apache.flink.streaming.api.operators.windowing.StreamWindowBuffer.handleWindowEvent(StreamWindowBuffer.java:62)
> 	at org.apache.flink.streaming.api.operators.windowing.StreamWindowBuffer.processElement(StreamWindowBuffer.java:47)
> 	at org.apache.flink.streaming.runtime.tasks.OutputHandler$ChainingOutput.collect(OutputHandler.java:288)
> 	... 9 more
> Caused by: java.lang.RuntimeException: Could not forward element to next operator
> 	at org.apache.flink.streaming.runtime.tasks.OutputHandler$ChainingOutput.collect(OutputHandler.java:291)
> 	at org.apache.flink.streaming.runtime.tasks.OutputHandler$ChainingOutput.collect(OutputHandler.java:276)
> 	at org.apache.flink.streaming.runtime.io.CollectorWrapper.collect(CollectorWrapper.java:50)
> 	at org.apache.flink.streaming.runtime.io.CollectorWrapper.collect(CollectorWrapper.java:30)
> 	at org.apache.flink.streaming.api.operators.StreamMap.processElement(StreamMap.java:37)
> 	at org.apache.flink.streaming.runtime.tasks.OutputHandler$ChainingOutput.collect(OutputHandler.java:288)
> 	... 17 more
> Caused by: java.lang.RuntimeException: Buffer pool is destroyed.
> 	at org.apache.flink.streaming.runtime.io.RecordWriterOutput.collect(RecordWriterOutput.java:78)
> 	at org.apache.flink.streaming.runtime.io.RecordWriterOutput.collect(RecordWriterOutput.java:37)
> 	at org.apache.flink.streaming.runtime.io.CollectorWrapper.collect(CollectorWrapper.java:50)
> 	at org.apache.flink.streaming.runtime.io.CollectorWrapper.collect(CollectorWrapper.java:30)
> 	at org.apache.flink.streaming.api.operators.windowing.WindowFlattener.processElement(WindowFlattener.java:43)
> 	at org.apache.flink.streaming.runtime.tasks.OutputHandler$ChainingOutput.collect(OutputHandler.java:288)
> 	... 22 more
> Caused by: java.lang.IllegalStateException: Buffer pool is destroyed.
> 	at org.apache.flink.runtime.io.network.buffer.LocalBufferPool.requestBuffer(LocalBufferPool.java:144)
> 	at org.apache.flink.runtime.io.network.buffer.LocalBufferPool.requestBufferBlocking(LocalBufferPool.java:133)
> 	at org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit(RecordWriter.java:92)
> 	at org.apache.flink.streaming.runtime.io.StreamRecordWriter.emit(StreamRecordWriter.java:84)
> 	at org.apache.flink.streaming.runtime.io.RecordWriterOutput.collect(RecordWriterOutput.java:75)
> 	... 27 more



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message