nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joe Witt <joe.w...@gmail.com>
Subject Re: Version Control on NiFi flow.xml
Date Wed, 17 Feb 2016 22:07:18 GMT
Jeff

I think what you're doing is just fine for now.  To Oleg's point we
should make it better.

We do also have a database where each flow change is being written to
from a audit perspective and so we can show in the UI who made what
changes last.  That is less about true CM and more about providing a
meaningful user experience.

The biggest knock for CM of our current flow.xml.gz and for the
templates is that the order in which their components are serialized
is not presently guaranteed so it means diff won't be meaningful.  But
as far as capturing at specific intervals and storing the flow you
should be in good shape with your approach.

Thanks
Joe

On Wed, Feb 17, 2016 at 4:52 PM, Jeff - Data Bean Australia
<databean.au@gmail.com> wrote:
> Thanks Oleg for sharing this. They are definitely useful.
>
> By my question focused more on keeping the data flow definition files'
> versions, so that Data Flow Developers, or NiFi Cluster Manager in NiFi's
> term can keep track of our work.
>
> Currently I am using the following command line to generate a formatted XML
> to put it into our Git repository:
>
> cat conf/flow.xml.gz | gzip -dc | xmllint --format -
>
>
>
>
> On Thu, Feb 18, 2016 at 10:01 AM, Oleg Zhurakousky
> <ozhurakousky@hortonworks.com> wrote:
>>
>> Jeff, what you are describing is in works and actively discussed
>> https://cwiki.apache.org/confluence/display/NIFI/Extension+Registry
>> and
>>
>> https://cwiki.apache.org/confluence/display/NIFI/Component+documentation+improvements
>>
>> The last one may not directly speaks to the “ExtensionRegistry”, but if
>> you look through he comments there is a whole lot about it since it is
>> dependent.
>> Feel free to participate, but I can say for now that it is slated for 1.0
>> release.
>>
>> Cheers
>> Oleg
>>
>> On Feb 17, 2016, at 3:08 PM, Jeff - Data Bean Australia
>> <databean.au@gmail.com> wrote:
>>
>> Hi,
>>
>> As my NiFi data flow becomes more and more serious, I need to put on
>> Version Control. Since flow.xml.gz is generated automatically and it is
>> saved in a compressed file, I am wondering what would be the best practice
>> regarding version control?
>>
>> Thanks,
>> Jeff
>>
>> --
>> Data Bean - A Big Data Solution Provider in Australia.
>>
>>
>
>
>
> --
> Data Bean - A Big Data Solution Provider in Australia.

Mime
View raw message