nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joe Witt <joe.w...@gmail.com>
Subject Re: ListFile is slow when it scan NFS mount
Date Thu, 20 Sep 2018 18:58:56 GMT
If you look at https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.7.1/org.apache.nifi.processors.standard.ListFile/index.html

The property 'List File Attributes' should be false or else
performance will be slow.  If that wasn't in NiFi 1.5 you'll want to
upgrade.

Thanks
On Thu, Sep 20, 2018 at 2:48 PM Milan Das <mdas@interset.com> wrote:
>
> Hello All,
>
> We are using NIFI 1.5 for one of the client. Seems like Listfile is super slow when it
scan a directory hosted on NFS mount.
>
> Performance on `ls` seems to be around 200 files/sec. But Listfile takes 20 mins to list
200 files.
>
>
>
> Is there any known issue or custom settings need to be conjured on ListS3 ?
>
>
>
> Thanks,
>
> Milan Das
>
>
>
>
>

Mime
View raw message