kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jay Kreps <jay.kr...@gmail.com>
Subject Re: Kafka's agent sit on localhost to forward message to broker?
Date Wed, 10 Oct 2012 15:23:01 GMT
Yes, perhaps the existing console consumer could be modified to do this?

-Jay

On Tue, Oct 9, 2012 at 10:05 PM, howard chen <howachen@gmail.com> wrote:

> Hi,
>
> On Wed, Oct 10, 2012 at 12:20 AM, Jay Kreps <jay.kreps@gmail.com> wrote:
> > I am not aware of anyone having open sourced what you describe. If anyone
> > is interested one nice way to implement this would be to implement a
> daemon
> > that could interact with the syslogd protocol over a unix domain socket.
> > Many scripting languages have good syslogd integration and this would
> > probably be a good strategy for supporting logging from this kind of
> > process.
> >
>
> In the simplest way, able to tail a file would be enough for this purpose.
>
> Existing app keep writing to local log file, no any blocking and not
> affected by network connection, and another process tail the file and
> send the changes to broker.
>
> Scribe and Flume also have this build in, would be nice if Kafka also
> support this out of the box.
>
> (From old posts it was said that Window does not have tail...well, I
> think most people run on Linux anyway..)
>
> Thanks.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message