kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Aggregating tomcat, log4j, other logs in realtime
Date Thu, 29 Sep 2011 17:48:36 GMT

Yes, Kafka will be a good fit for that.



On Thu, Sep 29, 2011 at 10:12 AM, Jeremy Hanna

> We have a number of web servers in ec2 and periodically we just blow them
> away and create new ones.  That makes keeping logs problematic.  We're
> looking for a way to stream the logs from those various sources directly to
> a central log server - either just a single server or hdfs or something like
> that.
> My question is whether kafka is a good fit for that or should I be looking
> more along the lines of flume or scribe?
> Many thanks.
> Jeremy

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message