nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Wing <>
Subject Re: S3 Cloudtrail log ingestion to Kafka via NiFi
Date Wed, 07 Jun 2017 17:29:55 GMT
Are you seeing errors, or just unexpected results?  ListS3 only returns
references to objects on S3, but FetchS3Object should return the object
content.  I recommend looking at the output of FetchS3Object to make sure
it is right (in size and content type) before trying to unzip it.



On Wed, Jun 7, 2017 at 9:56 AM, Laurens Vets <> wrote:

> Hello,
> Has anyone been able to ingest S3 Cloudtrail logs into Kafka with NiFi? I
> got as far ListS3 -> FetchS3Object -> Gunzip, but I'm stuck here. It seems
> I'm not actually unzipping the logs, but references to the S3 objects?
> Any help would be appreciated.

View raw message