nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Wing <jvw...@gmail.com>
Subject Re: ListS3 question
Date Tue, 08 Aug 2017 16:13:58 GMT
Laurens,

ListS3 tracks S3 object keys within your bucket+prefix.  ListS3 primarily
works on a last read timestamp, but tracks multiple keys when the
timestamps are equal.  Directories are something of a hazy concept in S3.

Thanks,

James

On Tue, Aug 8, 2017 at 8:22 AM, Laurens Vets <laurens@daemon.be> wrote:

> Hi list,
>
> Does the ListS3 processor keep state of multiple directories in a bucket?
>
> For instance, suppose I have a directory "logs" with subdirectories
> "host1", "host2" & "host3". Each directory contains logfiles which are
> added dailty.
>
> Will ListS3 keep state correctly here for all 3 subdirectories?
>
> Thanks in advance.
>
> Laurens
>

Mime
View raw message