nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From prabhu Mahendran <prabhuu161...@gmail.com>
Subject How to count the number of lines in csv?
Date Fri, 09 Jun 2017 07:32:20 GMT
Hi All,

i try to count the number of lines in csv.

Following Reference,
https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#count

with help of below method.I have stored the entire flow file in "input"
attribute and then delimited by using LineFeed character.

${allDelineatedValues(${input}, "\n"):count()}

i have used extracttext processor for store entire flowfile into those
attribute.

I can able to get number of lines in smaller csv files only it cannot work
for huge files(10 GB files) due to extract text only holds 2147463746 bytes
in Buffer size only.it leads wrong number of count stored in attribute.

*Is there is any other way to count number of lines in csv without use
Script?*

Mime
View raw message