nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan H <ryan.howell.developm...@gmail.com>
Subject Error Reference When Creating Template From PG Under NiFi Registry Version Control
Date Mon, 07 May 2018 01:05:16 GMT
Hi All,

We have found what seems to be an issue when creating a template of a
Process Group that is under version control with NiFi Registry. What seems
to happen is that there is a hard reference to the Registry Instance from
the Env that the template was created from within the template xml file.
When importing the template into a new Env the reference to the registry
goes with the template and looks to stay with the new process group, is
written to the flow.xml.gz, and causes an issue when clustered (the nodes
end up not being able to sync after a while because of the error and goes
into a disconnected state).

I'll say upfront that this somewhat defeats the purpose of having the
registry and I'm guessing that there will be suggestions that we should
either go the template FLDC route or go the registry FLDC route. For this
purpose we cannot share the registry instance between the two environments
and may be the case that we should not use the registry at this time.

Should this be an error? Is a better way other than going in a
searching/destroying all the old registry references out of the template
and flow xml files? Should we manually change the registry instances in
each of the environments to be the same guid id?


As always any help or direction is greatly appreciated.


Cheers,

Ryan Howell



template.xml snippet (created template to download, which will then be
uploaded into new env) (seems that the error is automatically created
knowing that it is going to be a problem importing):
...
<versionControlInformation>

<bucketId>1f26b7fd-8987-491d-a2ac-4f87292ab29b</bucketId>
                        <bucketName>Dev-Test</bucketName>
                        <flowDescription></flowDescription>

<flowId>c8e54d77-ce35-4be7-aff6-339a96b58e7d</flowId>
                        <flowName>MySuperCoolFlow</flowName>

<registryId>4ee39816-0161-1000-ffff-ffffc4085349</registryId>

<registryName>4ee39816-0161-1000-ffff-ffffc4085349</registryName>
                        <state>SYNC_FAILURE</state>
                        <stateExplanation>Unable to synchronize Process
Group with Flow Registry because Process Group was placed under Version
Control using Flow Registry with identifier
4ee39816-0161-1000-ffff-ffffc4085349 but cannot find any Flow Registry with
this identifier</stateExplanation>
                        <version>1</version>
                    </versionControlInformation>
                </processGroups>
                <processGroups>
                    <id>9d90f6ea-f2a1-3d65-0000-000000000000</id>

<parentGroupId>d8cf7c44-48c7-3c7d-0000-000000000000</parentGroupId>
                    <position>
                        <x>422.23612851041094</x>
                        <y>-1527.1966721061617</y>
                    </position>

<versionedComponentId>322cb8f0-cec6-30f9-9565-6948120c96d6</versionedComponentId>
                    <comments></comments>
                    <contents>
                        <connections>
                            <id>80c3a35a-27ec-33a2-0000-000000000000</id>

<parentGroupId>9d90f6ea-f2a1-3d65-0000-000000000000</parentGroupId>

<versionedComponentId>d77ff912-6127-39f2-9c7a-2eb3c7dde817</versionedComponentId>
                            <backPressureDataSizeThreshold>1
GB</backPressureDataSizeThreshold>

<backPressureObjectThreshold>10000</backPressureObjectThreshold>
                            <destination>
<groupId>9d90f6ea-f2a1-3d65-0000-000000000000</groupId>
<id>14b964e1-0775-3e6f-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>66873d14-b329-3322-b845-d144571ac93e</versionedComponentId>
                            </destination>
                            <flowFileExpiration>0 sec</flowFileExpiration>
                            <labelIndex>1</labelIndex>
                            <name></name>

<selectedRelationships>success</selectedRelationships>
                            <source>
<groupId>9d90f6ea-f2a1-3d65-0000-000000000000</groupId>
<id>f26999d5-adbe-33ea-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>c928e355-f4b0-3673-ba8e-9d7f0cf57d5f</versionedComponentId>
                            </source>

Mime
View raw message