nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Giovanni Lanzani <giovannilanz...@godatadriven.com>
Subject RE: Nifi deployment versioning and automation
Date Mon, 19 Jun 2017 21:03:28 GMT
Also super interested in this one if anyone knows!

Giovanni Lanzani
Chief Science Officer GoDataDriven
T: @gglanzani
M: +31 6 5120 6163

From: Maciej Strzelecki<mailto:maciej.strzelecki@crealytics.com>
Sent: Monday, June 19, 2017 12:42 PM
To: users@nifi.apache.org<mailto:users@nifi.apache.org>
Subject: Nifi deployment versioning and automation


Hello, while it is certainly possible to automate the workflow deployment in nifi using the
exposed API it is a non-trivial and lengthy process.


  *   Versioning the workflows (process groups)
  *   deployment itself
     *   managing staging/production promotion
     *   gracefully stopping (and flushing the processors (e.g have one that waits for 16MB
chunks before writing it to google storage, how to tell it "write-everything-you-have-now-and-shut-down)
     *   starting the new flow and checking for errors
     *   removing the old, stopped, flow
     *   optional - doing a failover back to the old workflow, if errors spotted

What is the most mature nifi deployment tool on the market? So far i have just seen very basic
scripted solution that are not production and definitely not something i want to use in production
and stick my neck up for.


Maciej Strzelecki
Senior Operations Engineer

crealytics GmbH – Semantic Advertising Technology

Brunngasse 1 • 94032 Passau • Germany

Oranienstraße 185 • 10999 Berlin • Germany
1 Bath Street · EC1V 9LB London · United Kingdom

Managing directors: Andreas Reiffen, Dr. Markus Kurch
Register court: Amtsgericht Passau, HRB 7466

Mime
View raw message