kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Dynamic weblog processing
Date Wed, 04 Apr 2012 14:31:08 GMT
Navneet,

Either way is fine. At LinkedIn, each app directly writes log data to a
kafka cluster using the producer api.

Thanks,

Jun

On Wed, Apr 4, 2012 at 2:20 AM, navneet sharma
<navneetsharma0505@gmail.com>wrote:

> Hi,
>
> I am new to kafka. If i have an application which is generating logs and i
> need to read and do some CEP on these logs.
>
> For CEP, we are planning to use Esper and for reading weblogs, we are
> examining Kafka. I have few questions:
> 1) What will be a producer in this case. Will it be an external
> entity(standalone program) which will do file I/o and send weblogs to kafka
> broker?
> 2) Or will it be part of application itself, so that it can read logs in
> parallel with the logging utility?
>
> Any pointers will be helpful...
>
> Thanks,
> Navneet
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message