nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andy LoPresto <alopre...@apache.org>
Subject Re: Unable to use Github as flowPersistenceProvider for NiFi Registry
Date Thu, 07 Mar 2019 00:39:40 GMT
Remember to re-enable TLS verification on your git clients if you disabled it during debugging.


Andy LoPresto
alopresto@apache.org
alopresto.apache@gmail.com
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69

> On Mar 6, 2019, at 8:43 AM, S Bhandiwad, Satwik (Nokia - IN/Bangalore) <satwik.s_bhandiwad@nokia.com>
wrote:
> 
> Hi all,
> 
> I hosted registry on my windows machine and connected to my home network and the flows
are getting saved in github. 
> I ran service firewalld status and it showed inactive on office vms. Looks like there
is some issue in office network. 
> Thank you all for replying.
> 
> Regards,
> Satwik
> 
> -----Original Message-----
> From: Kevin Doran <kdoran@apache.org> 
> Sent: Wednesday, March 6, 2019 8:36 PM
> To: dev@nifi.apache.org
> Subject: Re: Unable to use Github as flowPersistenceProvider for NiFi Registry
> 
> What platform are you running on? I've heard of some issues when trying to use the GitFLowPersistenceProvider
on Windows. Technically, only Linux is a supported platform for NiFi Registry.
> 
> On Wed, Mar 6, 2019 at 7:57 AM Denes Arvay <denes@apache.org> wrote:
>> 
>> Hi Satwik,
>> 
>> Don't you have a firewall running which doesn't let the http requests 
>> through from java processes?
>> 
>> Denes
>> 
>> On Wed, Mar 6, 2019 at 1:35 PM S Bhandiwad, Satwik (Nokia - 
>> IN/Bangalore) < satwik.s_bhandiwad@nokia.com> wrote:
>> 
>>> Hi Mike,
>>> 
>>> Tried the command that you mentioned and restarted the nifi 
>>> registry. I am getting the same error.
>>> 
>>> My .git/config file:
>>> 
>>> [core]
>>>        repositoryformatversion = 0
>>>        filemode = true
>>>        bare = false
>>>        logallrefupdates = true
>>> [remote "origin"]
>>>        url = https://github.com/satwikb321/versioned_nifi_flow.git
>>>        fetch = +refs/heads/*:refs/remotes/origin/*
>>> [branch "master"]
>>> [branch "master"]
>>>        remote = origin
>>>        merge = refs/heads/master
>>> [http]
>>>        sslVerify = false
>>> 
>>> Thanks,
>>> Satwik
>>> 
>>> 
>>> 
>>> -----Original Message-----
>>> From: Mike Thomsen <mikerthomsen@gmail.com>
>>> Sent: Wednesday, March 6, 2019 5:52 PM
>>> To: dev@nifi.apache.org
>>> Subject: Re: Unable to use Github as flowPersistenceProvider for 
>>> NiFi Registry
>>> 
>>> Try running this to see if it resolves the underlying ConnectException:
>>> 
>>>> git config http.sslVerify false
>>> 
>>> On Wed, Mar 6, 2019 at 7:15 AM S Bhandiwad, Satwik (Nokia - 
>>> IN/Bangalore) < satwik.s_bhandiwad@nokia.com> wrote:
>>> 
>>>> Hi Denes,
>>>> 
>>>> I tried pushing from command line and it works.
>>>> 
>>>> Below are the error logs:
>>>> 019-03-06 06:06:32,110 ERROR [GitFlowMetaData Push thread] 
>>>> o.a.n.r.p.flow.git.GitFlowMetaData Failed to push commits to 
>>>> origin due to
>>>> org.eclipse.jgit.api.errors.TransportException:
>>>> https://github.com/satwikb321/versioned_nifi_flow.git: cannot open 
>>>> git-receive-pack
>>>> org.eclipse.jgit.api.errors.TransportException:
>>>> https://github.com/satwikb321/versioned_nifi_flow.git: cannot open 
>>>> git-receive-pack
>>>>        at 
>>>> org.eclipse.jgit.api.PushCommand.call(PushCommand.java:180)
>>>> ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>        at
>>>> org.apache.nifi.registry.provider.flow.git.GitFlowMetaData.lambda$
>>>> star
>>>> tPushThread$1(GitFlowMetaData.java:220)
>>>> ~[nifi-registry-framework-0.3.0.jar:0.3.0]
>>>>        at
>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java
>>>> :511
>>>> )
>>>> ~[na:1.8.0_65]
>>>>        at
>>>> java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
>>>> ~[na:1.8.0_65]
>>>>        at
>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa
>>>> sk.a
>>>> ccess$301(ScheduledThreadPoolExecutor.java:180)
>>>> ~[na:1.8.0_65]
>>>>        at
>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTa
>>>> sk.r
>>>> un(ScheduledThreadPoolExecutor.java:294)
>>>> ~[na:1.8.0_65]
>>>>        at
>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecut
>>>> or.j
>>>> ava:1142)
>>>> ~[na:1.8.0_65]
>>>>        at
>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
>>>> java:617)
>>>> ~[na:1.8.0_65]
>>>>        at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_65] 
>>>> Caused
>>>> by: org.eclipse.jgit.errors.TransportException:
>>>> https://github.com/satwikb321/versioned_nifi_flow.git: cannot open 
>>>> git-receive-pack
>>>>        at
>>>> org.eclipse.jgit.transport.TransportHttp.connect(TransportHttp.jav
>>>> a:58
>>>> 4) ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>        at
>>>> org.eclipse.jgit.transport.TransportHttp.openPush(TransportHttp.ja
>>>> va:4
>>>> 35)
>>>> ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>        at
>>>> org.eclipse.jgit.transport.PushProcess.execute(PushProcess.java:16
>>>> 0) 
>>>> ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>        at
>>>> org.eclipse.jgit.transport.Transport.push(Transport.java:1344)
>>>> ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>        at 
>>>> org.eclipse.jgit.api.PushCommand.call(PushCommand.java:169)
>>>> ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>        ... 8 common frames omitted Caused by: 
>>>> java.net.ConnectException: Connection timed out github.com
>>>>        at
>>>> org.eclipse.jgit.util.HttpSupport.response(HttpSupport.java:213)
>>>> ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>        at
>>>> org.eclipse.jgit.transport.TransportHttp.connect(TransportHttp.jav
>>>> a:49
>>>> 8) ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>        ... 12 common frames omitted
>>>> 
>>>> Thanks,
>>>> Satwik
>>>> 
>>>> 
>>>> 
>>>> -----Original Message-----
>>>> From: Denes Arvay <denes@apache.org>
>>>> Sent: Wednesday, March 6, 2019 4:07 PM
>>>> To: dev@nifi.apache.org
>>>> Subject: Re: Unable to use Github as flowPersistenceProvider for 
>>>> NiFi Registry
>>>> 
>>>> Hi Satwik,
>>>> 
>>>> Have you tried pushing from command line? Does it work?
>>>> Aren't there more lines in the stack trace, one more "caused by" section?
>>>> It could contain more hints to identify the root cause.
>>>> 
>>>> Best,
>>>> denes
>>>> 
>>>> On Wed, Mar 6, 2019 at 7:47 AM S Bhandiwad, Satwik (Nokia -
>>>> IN/Bangalore) < satwik.s_bhandiwad@nokia.com> wrote:
>>>> 
>>>>> Hi,
>>>>> 
>>>>> I am trying to use Github as flowPersistenceProvider for NiFi Registry.
>>>>> I've cloned my github repo inside nifi registry directory and 
>>>>> changed the following lines in providers.xml
>>>>> 
>>>>>    <flowPersistenceProvider>
>>>>> 
>>>>> 
>>>> <class>org.apache.nifi.registry.provider.flow.git.GitFlowPersisten
>>>> cePr
>>>> ovider</class>
>>>>>        <property name="Flow Storage 
>>>>> Directory">./versioned_nifi_flow</property>
>>>>>        <property name="Remote To Push">origin</property>
>>>>>        <property name="Remote Access User">satwikb321</property>
>>>>>        <property name="Remote Access Password">my personal 
>>>>> access token </property>
>>>>>    </flowPersistenceProvider>
>>>>> 
>>>>> Below is the error that I am seeing in the logs:
>>>>> 
>>>>> 2019-03-05 06:49:32,885 INFO [NiFi Registry Web Server-30] 
>>>>> o.a.n.r.w.m.IllegalStateExceptionMapper
>>> java.lang.IllegalStateException:
>>>>> Access tokens are only issued over HTTPS. Returning Conflict response.
>>>>> 2019-03-05 06:54:32,874 ERROR [GitFlowMetaData Push thread] 
>>>>> o.a.n.r.p.flow.git.GitFlowMetaData Failed to push commits to 
>>>>> origin due to
>>>>> org.eclipse.jgit.api.errors.TransportException:
>>>>> https://github.com/satwikb321/versioned_nifi_flow.git: cannot 
>>>>> open git-receive-pack
>>>>> org.eclipse.jgit.api.errors.TransportException:
>>>>> https://github.com/satwikb321/versioned_nifi_flow.git: cannot 
>>>>> open git-receive-pack
>>>>>        at
>>>>> org.eclipse.jgit.api.PushCommand.call(PushCommand.java:180)
>>>>> ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>>        at
>>>>> org.apache.nifi.registry.provider.flow.git.GitFlowMetaData.lambd
>>>>> a$st
>>>>> ar
>>>>> tPushThread$1(GitFlowMetaData.java:220)
>>>>> ~[nifi-registry-framework-0.3.0.jar:0.3.0]
>>>>>        at
>>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.ja
>>>>> va:5
>>>>> 11
>>>>> )
>>>>> ~[na:1.8.0_65]
>>>>>        at
>>>>> java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
>>>>> ~[na:1.8.0_65]
>>>>>        at
>>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFuture
>>>>> Task
>>>>> .a
>>>>> ccess$301(ScheduledThreadPoolExecutor.java:180)
>>>>> ~[na:1.8.0_65]
>>>>>        at
>>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFuture
>>>>> Task
>>>>> .r
>>>>> un(ScheduledThreadPoolExecutor.java:294)
>>>>> ~[na:1.8.0_65]
>>>>>        at
>>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec
>>>>> utor
>>>>> .j
>>>>> ava:1142)
>>>>> ~[na:1.8.0_65]
>>>>>        at
>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
>>>>> java:617)
>>>>> ~[na:1.8.0_65]
>>>>>        at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_65] 
>>>>> Caused
>>>>> by: org.eclipse.jgit.errors.TransportException:
>>>>> https://github.com/satwikb321/versioned_nifi_flow.git: cannot 
>>>>> open git-receive-pack
>>>>>        at
>>>>> org.eclipse.jgit.transport.TransportHttp.connect(TransportHttp.java:
>>>>> 58
>>>>> 4) ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>>        at
>>>>> org.eclipse.jgit.transport.TransportHttp.openPush(TransportHttp.
>>>>> java
>>>>> :4
>>>>> 35)
>>>>> ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>>        at
>>>>> org.eclipse.jgit.transport.PushProcess.execute(PushProcess.java:
>>>>> 160) 
>>>>> ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>>        at
>>>>> org.eclipse.jgit.transport.Transport.push(Transport.java:1344)
>>>>> ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>>        at
>>>>> org.eclipse.jgit.api.PushCommand.call(PushCommand.java:169)
>>>>> ~[org.eclipse.jgit-4.11.0.201803080745-r.jar:4.11.0.201803080745-r]
>>>>>        ... 8 common frames omitted
>>>>> 
>>>>> 
>>>>> The flows are not getting pushed to github. Please help.
>>>>> 
>>>>> Thanks,
>>>>> Satwik
>>>>> 
>>>>> 
>>>> 
>>> 


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message