nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uwe Geercken" <uwe.geerc...@web.de>
Subject Aw: Re: Nifi 1.4: problem with QueryRecord Precessor
Date Wed, 04 Oct 2017 15:22:38 GMT
<html><head></head><body><div style="font-family: Verdana;font-size:
12.0px;"><div>&nbsp;
<div>
<div>Mark,</div>

<div>&nbsp;</div>

<div>I stopped 1.4 and started 1.3 and created the same flow. And in 1.3 it works without
a problem.</div>

<div>&nbsp;</div>

<div>And I looked into the 1.4 log (I should have looked before, but only looked at
the processor&#39;s tooltip). You are right, it&#39;s a problem with the schema. Here
is the real error:</div>

<div>&nbsp;</div>

<div>
<div>2017-10-04 16:01:16,640 ERROR [Timer-Driven Process Thread-10] o.a.nifi.processors.standard.QueryRecord
QueryRecord[id=e798adc7-015e-1000-a43d-68a02b5d425a] Unable to qu&#36;<br/>
org.apache.nifi.processor.exception.ProcessException: IOException thrown from QueryRecord[id=e798adc7-015e-1000-a43d-68a02b5d425a]:
java.io.IOException: org.apache.nifi.&#36;<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2589)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.processors.standard.QueryRecord.onTrigger(QueryRecord.java:284)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent&#36;1.run(TimerDrivenSchedulingAgent.java:128)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at java.util.concurrent.Executors&#36;RunnableAdapter.call(Executors.java:511)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at java.util.concurrent.ScheduledThreadPoolExecutor&#36;ScheduledFutureTask.access&#36;301(ScheduledThreadPoolExecutor.java:180)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at java.util.concurrent.ScheduledThreadPoolExecutor&#36;ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at java.util.concurrent.ThreadPoolExecutor&#36;Worker.run(ThreadPoolExecutor.java:624)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at java.lang.Thread.run(Thread.java:748)<br/>
Caused by: java.io.IOException: org.apache.nifi.schema.access.SchemaNotFoundException: Cannot
write Schema Name As Attribute because the Schema Name is not known<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.processors.standard.QueryRecord&#36;1.process(QueryRecord.java:302)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2570)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ... 13 common frames
omitted<br/>
Caused by: org.apache.nifi.schema.access.SchemaNotFoundException: Cannot write Schema Name
As Attribute because the Schema Name is not known<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.schema.access.SchemaNameAsAttribute.validateSchema(SchemaNameAsAttribute.java:53)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.serialization.SchemaRegistryRecordSetWriter.getSchemaAccessWriter(SchemaRegistryRecordSetWriter.java:137)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.nifi.csv.CSVRecordSetWriter.createWriter(CSVRecordSetWriter.java:72)<br/>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)</div>

<div>&nbsp;</div>
</div>

<div>&nbsp;</div>

<div>&nbsp;</div>

<div>I am using an AvroReader using the embedded schema. Maybe this helps.</div>

<div>&nbsp;</div>

<div>Rgds,</div>

<div>&nbsp;</div>

<div>Uwe</div>

<div>&nbsp;</div>

<div>&nbsp;</div>

<div name="quote" style="margin:10px 5px 5px 10px; padding: 10px 0 10px 10px; border-left:2px
solid #C3D9E5; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">
<div style="margin:0 0 10px 0;"><b>Gesendet:</b>&nbsp;Mittwoch, 04.
Oktober 2017 um 16:55 Uhr<br/>
<b>Von:</b>&nbsp;&quot;Mark Payne&quot; &lt;markap14@hotmail.com&gt;<br/>
<b>An:</b>&nbsp;&quot;users@nifi.apache.org&quot; &lt;users@nifi.apache.org&gt;<br/>
<b>Betreff:</b>&nbsp;Re: Nifi 1.4: problem with QueryRecord Precessor</div>

<div name="quoted-content">
<div>
<div>Dan, Uwe,</div>

<div>&nbsp;</div>

<div>This is something that I will be looking into shortly. It is a known issue that
exists in both 1.3</div>

<div>and 1.4. This occurs whenever there is some other sort of failure, when the processor
attempts</div>

<div>to route the FlowFile to &#39;failure&#39;. This occurs most often when
there is a problem obtaining the</div>

<div>schema for the Record. Can you check your logs and see what other error may be
present</div>

<div>in the logs?</div>

<div>&nbsp;</div>

<div>Thanks</div>

<div>-Mark</div>

<div>&nbsp;</div>
&nbsp;

<div>
<blockquote>
<div>On Oct 4, 2017, at 10:39 AM, dan young &lt;<a href="mailto:danoyoung@gmail.com"
onclick="parent.window.location.href=&#39;danoyoung@gmail.com&#39;; return false;"
target="_blank">danoyoung@gmail.com</a>&gt; wrote:</div>
&nbsp;

<div>
<p>It might be...maybe others can share experience with 1.4...</p>
&nbsp;

<div class="gmail_quote">
<div>On Wed, Oct 4, 2017, 8:37 AM Uwe Geercken &lt;<a href="mailto:uwe.geercken@web.de"
onclick="parent.window.location.href=&#39;uwe.geercken@web.de&#39;; return false;"
target="_blank">uwe.geercken@web.de</a>&gt; wrote:</div>

<blockquote class="gmail_quote" style="margin: 0 0 0 0.8ex;border-left: 1.0px rgb(204,204,204)
solid;padding-left: 1.0ex;">
<div>
<div style="font-family: Verdana;font-size: 12.0px;">
<div>
<div>thanks Dano.</div>

<div>&nbsp;</div>

<div>Any other comments? Is this a bug in 1.4 then?</div>

<div>&nbsp;</div>

<div>Rgds,</div>

<div>&nbsp;</div>

<div>Uwe</div>

<div>&nbsp;
<div style="margin: 10.0px 5.0px 5.0px 10.0px;padding: 10.0px 0 10.0px 10.0px;border-left:
2.0px solid rgb(195,217,229);">
<div style="margin: 0 0 10.0px 0;"><b>Gesendet:</b>&nbsp;Mittwoch, 04.
Oktober 2017 um 16:33 Uhr<br/>
<b>Von:</b>&nbsp;&quot;dan young&quot; &lt;<a href="mailto:danoyoung@gmail.com"
onclick="parent.window.location.href=&#39;danoyoung@gmail.com&#39;; return false;"
target="_blank">danoyoung@gmail.com</a>&gt;<br/>
<b>An:</b>&nbsp;nifi &lt;<a href="mailto:users@nifi.apache.org" onclick="parent.window.location.href=&#39;users@nifi.apache.org&#39;;
return false;" target="_blank">users@nifi.apache.org</a>&gt;<br/>
<b>Betreff:</b>&nbsp;Re: Nifi 1.4: problem with QueryRecord Precessor</div>
</div>
</div>
</div>
</div>
</div>

<div>
<div style="font-family: Verdana;font-size: 12.0px;">
<div>
<div>
<div style="margin: 10.0px 5.0px 5.0px 10.0px;padding: 10.0px 0 10.0px 10.0px;border-left:
2.0px solid rgb(195,217,229);">
<div>
<p>We&#39;re seeing the same thing. Works fine in 1.3</p>

<p>Dano</p>
&nbsp;

<div class="gmail_quote">
<div>On Wed, Oct 4, 2017, 8:13 AM Uwe Geercken &lt;<a href="mailto:uwe.geercken@web.de"
onclick="parent.window.location.href=&#39;uwe.geercken@web.de&#39;; return false;"
target="_blank">uwe.geercken@web.de</a>&gt; wrote:</div>

<blockquote class="gmail_quote" style="margin: 0 0 0 0.8ex;border-left: 1.0px rgb(204,204,204)
solid;padding-left: 1.0ex;">
<div>
<div style="font-family: Verdana;font-size: 12.0px;">
<div>Hello,</div>

<div>&nbsp;</div>

<div>I have created a flow: GetFile &gt;&gt; QueryRecord &gt;&gt; Putfile.
GetFile reads an avro file. QueryRecord has one property/sql and the result is routed to PutFile.</div>

<div>&nbsp;</div>

<div>When I run the processor, I get following error:</div>

<div>&nbsp;</div>

<div>failed to process session due to java.lang.IllegalStateException</div>

<div>....</div>

<div>&lt;filename here&gt; already in use or an active callback or an inputstream
created by ProcessSession.read(FlowFile) has not been closed.</div>

<div>....</div>

<div>&nbsp;</div>

<div>Can somebody help?</div>

<div>&nbsp;</div>

<div>Rgds,</div>
</div>
</div>

<div>
<div style="font-family: Verdana;font-size: 12.0px;">
<div>&nbsp;</div>

<div>Uwe</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div></div></body></html>

Mime
View raw message