nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Charlie Frasure <charliefras...@gmail.com>
Subject archive files
Date Mon, 23 Nov 2015 15:54:39 GMT
Use case: Archive and compress files by category and month, store like
files in a common directory.

I'm already processing the files, and have extracted the interesting
attributes from each.  I ran them through MergeContent, but have not been
able to produce a logical directory structure to store the results.  I
would prefer something like archive/categoryA/201511/somefilename.tar.gz
where somefilename is made up of all the categoryA files received in
November 2015.

I switched gears, and used PutFile to store the files in the preferred
directory structure, but at a loss of how to archive them within their
folders given hundreds of dynamic categories, and date additions every
month.

I'm playing with MergeContent's Correlation Attribute Name, but am also
considering trying the "Degfragment" merge strategy by correlating the
files earlier in the process.

Any suggestions would be appreciated.

Mime
View raw message