nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike Drob <md...@apache.org>
Subject Re: [DISCUSS] Feature proposal: "Function Groups" and wormholes
Date Mon, 10 Aug 2015 14:36:05 GMT
Wormholes sounds functionally similar to JMS Queues with topic
subscriptions? Function groups are something I've wished for before but
didn't think it was possible.

On Sun, Aug 9, 2015 at 8:27 AM, Joe Witt <joe.witt@gmail.com> wrote:

> Toivo
>
> I think from your response you did understand it quite well.  I'll try
> to turn this and a series of other features/concepts into a series of
> wiki pages so it can be more readily consumed, improved, and commented
> on.
>
> Thanks
> Joe
>
> On Sun, Aug 9, 2015 at 8:04 AM, Toivo Adams <toivo.adams@gmail.com> wrote:
> > Not sure I understand 'wormhole' concept correctly.
> >
> > We use a lot of request-response type of processing.
> > Processing pipeline contain several processors.
> > Processing is done mostly sequentially (and same parts parallel).
> > During processing anything can happen. But our goal is to send always
> > responds back.
> > In case of errors response contains errors data.
> >
> > There can be different types of problems; some are warnings, some
> notices,
> > some errors and some fatal errors.
> >
> > In case of fatal errors we stop processing automatically and jump
> directly
> > to so called ‘error flow’. (subflow)
> > Error flow responsibility is to create response which contains errors and
> > send response back to requestor.
> > Error flow may also contain some special purpose processors – collect
> some
> > data for report, alert monitoring, etc.
> >
> > Now 'wormhole' is very helpful. It’s annoying to add explicit
> connections to
> > all business processors. Also this reduces readability.
> > For us flow should readable and understandable from business point of
> view.
> > And low level technical behavior should be handled ‘behind the scenes’.
> > Ideally business processors should not have ‘redirect to error flow’
> output
> > (relationship) at all.
> >
> > At the same time I think 'wormhole' should be used very carefully. Only
> when
> > really needed.
> > Otherwise it may be source of weird bugs and it is hard to follow what is
> > going on.
> >
> >
> > Thanks
> > toivo
> >
> >
> >
> >
> > --
> > View this message in context:
> http://apache-nifi-incubating-developer-list.39713.n7.nabble.com/DISCUSS-Feature-proposal-Function-Groups-and-wormholes-tp2381p2391.html
> > Sent from the Apache NiFi (incubating) Developer List mailing list
> archive at Nabble.com.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message