nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Wing <jvw...@gmail.com>
Subject Re: S3 Cloudtrail log ingestion to Kafka via NiFi
Date Wed, 07 Jun 2017 17:29:55 GMT
Are you seeing errors, or just unexpected results?  ListS3 only returns
references to objects on S3, but FetchS3Object should return the object
content.  I recommend looking at the output of FetchS3Object to make sure
it is right (in size and content type) before trying to unzip it.

Thanks,

James

On Wed, Jun 7, 2017 at 9:56 AM, Laurens Vets <laurens@daemon.be> wrote:

> Hello,
>
> Has anyone been able to ingest S3 Cloudtrail logs into Kafka with NiFi? I
> got as far ListS3 -> FetchS3Object -> Gunzip, but I'm stuck here. It seems
> I'm not actually unzipping the logs, but references to the S3 objects?
>
> Any help would be appreciated.
>

Mime
View raw message