nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sudeep mishra <sudeepshekh...@gmail.com>
Subject How to validate records in Hadoop using NiFi?
Date Thu, 07 Jan 2016 06:56:41 GMT
Hi,

I am pushing some database records into HDFS using Sqoop.

I want to perform some validations on each record in the HDFS data. Which
NiFi processor can I use to split each record (separated by a new line
character) and perform validations?

For validations I want to verify a particular column value for each record
using a SQL query. I can see an ExecuteQuery processor. How can I
dynamically pass query parameters to it. Also is there a way to execute the
queries in bulk rather for each record.

Kindly suggest.

Apprecuate your help.


Thanks & Regards,

Sudeep Shekhar Mishra

Mime
View raw message