nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Milan Das <m...@interset.com>
Subject Re: Secured NIFI (clustered) error on ListFile viewstate
Date Sat, 15 Dec 2018 02:58:36 GMT
Hi Andy,
I have tested it with NIFI 1.8.0
I get the a diferent error.

Unable to get the state for the specified component afc9148c-0167-1000-ffff-ffffa97bf4b6:
java.io.IOException: Failed to obtain value from ZooKeeper for component with ID afc9148c-0167-1000-ffff-ffffa97bf4b6
with exception code CONNECTIONLOSS



Thanks,
Milan Das

On 11/8/18, 6:41 PM, "Andy LoPresto" <alopresto@apache.org> wrote:

    There was an issue with malformed replicated requests causing a timeout [1] in previous
versions, and this was resolved in 1.8.0. Could you try against 1.8.0? This issue had nothing
to do with ZK though, so if the only difference between working/failing is whether ZK is secured,
I think the problem is there. Are you sure that your ZK configs are correct?
    
    [1] https://github.com/apache/nifi/commit/748cf745628dab20b7e71f12b5dcfe6ed0bbf134
    
     
    Andy LoPresto
    alopresto@apache.org
    alopresto.apache@gmail.com
    PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69
    
    > On Nov 9, 2018, at 10:35 AM, Milan Das <mdas@interset.com> wrote:
    > 
    > Hi Andy,
    > Thanks for your response.
    > I have tested it with 1.4 , 1.6 and 1.7.1 .
    > It is external zookeeper .
    > It works when zookeeper is not secured.
    > Zookeeper is up and running. Otherwise NIFI cluster state will not show running.
    > 
    > Thanks,
    > Milan Das
    > 
    > 
    > 
    > On 11/8/18, 6:32 PM, "Andy LoPresto" <alopresto@apache.org> wrote:
    > 
    >    Hi Milan,
    > 
    >    What version of NiFi are you using? Are you using the internal ZK instance or
a standalone instance? Did this work before/without ZK JaaS?
    > 
    >    It appears the error is on request replication to another node, and the node is
not listening/responding to the request. 
    > 
    >    Andy LoPresto
    >    alopresto@apache.org
    >    alopresto.apache@gmail.com
    >    PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69
    > 
    >> On Nov 9, 2018, at 2:07 AM, Milan Das <mdas@interset.com> wrote:
    >> 
    >> Hello Nifi team,
    >> 
    >> Wondering if it is something more I need to do.
    >> 
    >> Otherwise I am planning to log a defect in Jira
    >> 
    >> 
    >> 
    >> Thanks,
    >> 
    >> Milan
    >> 
    >> 
    >> 
    >> From: Milan Das <mdas@interset.com>
    >> Date: Friday, November 2, 2018 at 10:08 AM
    >> To: "dev@nifi.apache.org" <dev@nifi.apache.org>
    >> Subject: Secured NIFI (clustered) error on ListFile viewstate
    >> 
    >> 
    >> 
    >> I have a (Kerberos) secured NIFI running and it is connecting to secured SASL
secured zookeeper.   Zookeeper-jaas is configured in bootstrap. Cluster starts clean
    >> 
    >> Not sure, if there is something else need to be done. 
    >> 
    >> 
    >> 
    >> Configuratons are as below:
    >> 
    >> 
    >> 
    >> conf/state-management.xml
    >> 
    >>   <cluster-provider>
    >> 
    >>       <id>zk-provider</id>
    >> 
    >>       <class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class>
    >> 
    >>       <property name="Connect String"></property>
    >> 
    >>       <property name="Root Node">/nifi</property>
    >> 
    >>       <property name="Session Timeout">10 seconds</property>
    >> 
    >>       <property name="Access Control">Open</property>
    >> 
    >>   </cluster-provider>
    >> 
    >> 
    >> 
    >> 
    >> 
    >> conf/bootstrap.conf
    >> 
    >> java.arg.16=-Djava.security.auth.login.config=./conf/zookeeper-jaas.conf
    >> 
    >> 
    >> 
    >> 
    >> 
    >> Error Message:
    >> 
    >> 
    >> 
    >> 2018-11-02 13:58:22,829 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator
Failed to replicate request GET /nifi-api/processors/cc7b96b9-0166-1000-ffff-ffff87736df4/state
to hdp265-secured-i56.interset.com:9443 due to javax.ws.rs.ProcessingException: java.net.SocketTimeoutException:
Read timed out
    >> 
    >> 2018-11-02 13:58:22,831 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator
    >> 
    >> javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed
out
    >> 
    >>               at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:284)
    >> 
    >>               at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:278)
    >> 
    >>               at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$0(JerseyInvocation.java:753)
    >> 
    >>               at org.glassfish.jersey.internal.Errors.process(Errors.java:316)
    >> 
    >>               at org.glassfish.jersey.internal.Errors.process(Errors.java:298)
    >> 
    >>               at org.glassfish.jersey.internal.Errors.process(Errors.java:229)
    >> 
    >>               at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414)
    >> 
    >>               at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:752)
    >> 
    >>               at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator.replicateRequest(ThreadPoolRequestReplicator.java:661)
    >> 
    >>               at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator$NodeHttpRequest.run(ThreadPoolRequestReplicator.java:875)
    >> 
    >>               at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    >> 
    >>               at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    >> 
    >>               at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    >> 
    >>               at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    >> 
    >>               at java.lang.Thread.run(Thread.java:748)
    >> 
    >> Caused by: java.net.SocketTimeoutException: Read timed out
    >> 
    >>               at java.net.SocketInputStream.socketRead0(Native Method)
    >> 
    >>               at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
    >> 
    >>               at java.net.SocketInputStream.read(SocketInputStream.java:171)
    >> 
    >>               at java.net.SocketInputStream.read(SocketInputStream.java:141)
    >> 
    >>               at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
    >> 
    >>               at sun.security.ssl.InputRecord.read(InputRecord.java:503)
    >> 
    >>               at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
    >> 
    >>               at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
    >> 
    >>               at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
    >> 
    >>               at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
    >> 
    >>               at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
    >> 
    >>               at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
    >> 
    >>               at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:735)
    >> 
    >>               at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
    >> 
    >>               at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)
    >> 
    >>               at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
    >> 
    >>               at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
    >> 
    >>               at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
    >> 
    >>               at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:390)
    >> 
    >>               at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:282)
    >> 
    >>               ... 14 common frames omitted
    >> 
    > 
    > 
    > 
    > 
    
    



Mime
View raw message