Good day,

I would like to know the possibilities of NIFI in real time processing; 

I'm thinking of a simple application of messaging, 
1. A processor will accept messages and do a simple mapping of its
attributes to database, i.e. if message_body.startsWith("123") then get data
from table with ID = 123 and add the value as new attribute
2. A processor will act as a router
3. Two processors will accept act as dispatcher 
In simple illustration,

|RECEIVER| -- |ROUTER| -- |DISPATCHER A|
                                     -- |DISPATCHER B|


Now my questions are:
1. What is the best practice / proper way to do database mapping with
complex criteria?, in my experience, the best way to do this in Java is to
fetch the data in specific table (let's say Table A) into a collection (Map)
in regular schedule (per 5 mins or so); The reason i'm doing this is to
reduce the connection thingy when querying. Imagine if for each message we
have to open connection, query, close connection. I've tested this approach
and it was much faster, even with connection pooling. The downside is i need
space in my memory which grow along with my database size. I use MySQL and
haven't tested in memory database, i just want to know the common and fast
approach to do this. If there is no other way, i might create a standalone
module using spring boot to handle this stuffs and communicating with NIFI
processor using REST API
2. Is it OK to use one flow file for one message?
3. Is it possible and recommended to use dependency injection library like
Spring?

Thank you,


Bobby



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/