kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeremy Hanna <jeremy.hanna1...@gmail.com>
Subject Aggregating tomcat, log4j, other logs in realtime
Date Thu, 29 Sep 2011 17:12:58 GMT
We have a number of web servers in ec2 and periodically we just blow them away and create new
ones.  That makes keeping logs problematic.  We're looking for a way to stream the logs from
those various sources directly to a central log server - either just a single server or hdfs
or something like that.

My question is whether kafka is a good fit for that or should I be looking more along the
lines of flume or scribe?

Many thanks.

Jeremy
Mime
View raw message