nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bryan Bende <bbe...@gmail.com>
Subject Re: QueryRecord not closing stream before committing session
Date Wed, 13 Sep 2017 14:07:43 GMT
Neil,

Thanks for providing the full error.

Just to confirm, you encountered this running the 1.3.0 release?

Thanks,

Bryan

On Wed, Sep 13, 2017 at 10:01 AM, Neil Derraugh
<neil.derraugh@intellifylearning.com> wrote:
> Seeing this warning and the subsequent error in a dataflow we recently
> authored.  Bryan, looks like the same thing you were asking details of on
> Hortonworks Community Connection.
>
> This is a QueryRecord processor consuming a schema in the Schema Registry
> using a CSVReader and CSVRecordSetWriter.  Cache Schema and Include Zero
> Record FlowFiles are set to false.
>
> 2017-09-13 09:54:42,628 WARN [Timer-Driven Process Thread-7]
> o.a.n.c.r.StandardProcessSession StandardProcessSession[id=36915342] closing
> ErrorHandlingInputStream[FlowFile=StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
> [resourceClaim=StandardResourceClaim[id=1505264918993-2878,
> container=default, section=830], offset=0,
> length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]]
> for
> StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
> [resourceClaim=StandardResourceClaim[id=1505264918993-2878,
> container=default, section=830], offset=0,
> length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]
> because the session was committed without the stream being closed.
>
> 2017-09-13 09:54:42,628 ERROR [Timer-Driven Process Thread-7]
> o.a.nifi.processors.standard.QueryRecord
> QueryRecord[id=57303d34-015e-1000-0000-0000032f37b4]
> QueryRecord[id=57303d34-015e-1000-0000-0000032f37b4] failed to process
> session due to java.lang.IllegalStateException:
> StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
> [resourceClaim=StandardResourceClaim[id=1505264918993-2878,
> container=default, section=830], offset=0,
> length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]
> already in use for an active callback or an InputStream created by
> ProcessSession.read(FlowFile) has not been closed: {}
> java.lang.IllegalStateException:
> StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
> [resourceClaim=StandardResourceClaim[id=1505264918993-2878,
> container=default, section=830], offset=0,
> length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]
> already in use for an active callback or an InputStream created by
> ProcessSession.read(FlowFile) has not been closed
> at
> org.apache.nifi.controller.repository.StandardProcessSession.validateRecordState(StandardProcessSession.java:3018)
> at
> org.apache.nifi.controller.repository.StandardProcessSession.validateRecordState(StandardProcessSession.java:3013)
> at
> org.apache.nifi.controller.repository.StandardProcessSession.transfer(StandardProcessSession.java:1815)
> at
> org.apache.nifi.processors.standard.QueryRecord.onTrigger(QueryRecord.java:355)
> at
> org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
> at
> org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120)
> at
> org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
> at
> org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
> at
> org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:748)

Mime
View raw message