nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andy LoPresto <alopre...@apache.org>
Subject Re: Secured NIFI (clustered) error on ListFile viewstate
Date Thu, 08 Nov 2018 23:40:55 GMT
There was an issue with malformed replicated requests causing a timeout [1] in previous versions,
and this was resolved in 1.8.0. Could you try against 1.8.0? This issue had nothing to do
with ZK though, so if the only difference between working/failing is whether ZK is secured,
I think the problem is there. Are you sure that your ZK configs are correct?

[1] https://github.com/apache/nifi/commit/748cf745628dab20b7e71f12b5dcfe6ed0bbf134

 
Andy LoPresto
alopresto@apache.org
alopresto.apache@gmail.com
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69

> On Nov 9, 2018, at 10:35 AM, Milan Das <mdas@interset.com> wrote:
> 
> Hi Andy,
> Thanks for your response.
> I have tested it with 1.4 , 1.6 and 1.7.1 .
> It is external zookeeper .
> It works when zookeeper is not secured.
> Zookeeper is up and running. Otherwise NIFI cluster state will not show running.
> 
> Thanks,
> Milan Das
> 
> 
> 
> ´╗┐On 11/8/18, 6:32 PM, "Andy LoPresto" <alopresto@apache.org> wrote:
> 
>    Hi Milan,
> 
>    What version of NiFi are you using? Are you using the internal ZK instance or a standalone
instance? Did this work before/without ZK JaaS?
> 
>    It appears the error is on request replication to another node, and the node is not
listening/responding to the request. 
> 
>    Andy LoPresto
>    alopresto@apache.org
>    alopresto.apache@gmail.com
>    PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69
> 
>> On Nov 9, 2018, at 2:07 AM, Milan Das <mdas@interset.com> wrote:
>> 
>> Hello Nifi team,
>> 
>> Wondering if it is something more I need to do.
>> 
>> Otherwise I am planning to log a defect in Jira
>> 
>> 
>> 
>> Thanks,
>> 
>> Milan
>> 
>> 
>> 
>> From: Milan Das <mdas@interset.com>
>> Date: Friday, November 2, 2018 at 10:08 AM
>> To: "dev@nifi.apache.org" <dev@nifi.apache.org>
>> Subject: Secured NIFI (clustered) error on ListFile viewstate
>> 
>> 
>> 
>> I have a (Kerberos) secured NIFI running and it is connecting to secured SASL secured
zookeeper.   Zookeeper-jaas is configured in bootstrap. Cluster starts clean
>> 
>> Not sure, if there is something else need to be done. 
>> 
>> 
>> 
>> Configuratons are as below:
>> 
>> 
>> 
>> conf/state-management.xml
>> 
>>   <cluster-provider>
>> 
>>       <id>zk-provider</id>
>> 
>>       <class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class>
>> 
>>       <property name="Connect String"></property>
>> 
>>       <property name="Root Node">/nifi</property>
>> 
>>       <property name="Session Timeout">10 seconds</property>
>> 
>>       <property name="Access Control">Open</property>
>> 
>>   </cluster-provider>
>> 
>> 
>> 
>> 
>> 
>> conf/bootstrap.conf
>> 
>> java.arg.16=-Djava.security.auth.login.config=./conf/zookeeper-jaas.conf
>> 
>> 
>> 
>> 
>> 
>> Error Message:
>> 
>> 
>> 
>> 2018-11-02 13:58:22,829 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator
Failed to replicate request GET /nifi-api/processors/cc7b96b9-0166-1000-ffff-ffff87736df4/state
to hdp265-secured-i56.interset.com:9443 due to javax.ws.rs.ProcessingException: java.net.SocketTimeoutException:
Read timed out
>> 
>> 2018-11-02 13:58:22,831 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator
>> 
>> javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out
>> 
>>               at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:284)
>> 
>>               at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:278)
>> 
>>               at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$0(JerseyInvocation.java:753)
>> 
>>               at org.glassfish.jersey.internal.Errors.process(Errors.java:316)
>> 
>>               at org.glassfish.jersey.internal.Errors.process(Errors.java:298)
>> 
>>               at org.glassfish.jersey.internal.Errors.process(Errors.java:229)
>> 
>>               at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414)
>> 
>>               at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:752)
>> 
>>               at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator.replicateRequest(ThreadPoolRequestReplicator.java:661)
>> 
>>               at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator$NodeHttpRequest.run(ThreadPoolRequestReplicator.java:875)
>> 
>>               at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>> 
>>               at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> 
>>               at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> 
>>               at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> 
>>               at java.lang.Thread.run(Thread.java:748)
>> 
>> Caused by: java.net.SocketTimeoutException: Read timed out
>> 
>>               at java.net.SocketInputStream.socketRead0(Native Method)
>> 
>>               at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
>> 
>>               at java.net.SocketInputStream.read(SocketInputStream.java:171)
>> 
>>               at java.net.SocketInputStream.read(SocketInputStream.java:141)
>> 
>>               at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
>> 
>>               at sun.security.ssl.InputRecord.read(InputRecord.java:503)
>> 
>>               at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
>> 
>>               at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
>> 
>>               at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
>> 
>>               at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>> 
>>               at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
>> 
>>               at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
>> 
>>               at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:735)
>> 
>>               at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
>> 
>>               at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)
>> 
>>               at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
>> 
>>               at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
>> 
>>               at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
>> 
>>               at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:390)
>> 
>>               at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:282)
>> 
>>               ... 14 common frames omitted
>> 
> 
> 
> 
> 


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message