kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bao Thai Ngo <baothai...@gmail.com>
Subject Re: Tail or stdin producer?
Date Fri, 30 Sep 2011 05:41:11 GMT
Jay,

Does the patch already support log rotation (file rolling)?

Also, I wonder if there is any documentation about how to write a plug-in
for Kafka.

Thanks,
~Thai

On Mon, Sep 12, 2011 at 10:17 AM, Jay Kreps <jay.kreps@gmail.com> wrote:

> I added a patch for this:
> https://issues.apache.org/jira/browse/KAFKA-130
>
> Felix, if you are still interested in this, let me know if it works for
> you.
>
> -Jay
>
> On Thu, Sep 1, 2011 at 1:22 PM, Felix Giguere Villegas <
> felix.giguere@mate1inc.com> wrote:
>
> > Hi :)
> >
> > Thanks for the reply :) . I have created
> > KAFKA-130<https://issues.apache.org/jira/browse/KAFKA-130>
> > .
> >
> > I'm not sure I have respected the proper standard for JIRA issues. Please
> > let me know if I haven't.
> >
> > --
> > Felix
> >
> >
> >
> > On Thu, Sep 1, 2011 at 4:04 PM, Jun Rao <junrao@gmail.com> wrote:
> >
> > > Hi, Felix,
> > >
> > > Currently, we don't have a util to pipe data from a file to a producer.
> I
> > > agree that it's a very convenient tool to have. Could you open a jira
> for
> > > that?
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > > On Thu, Sep 1, 2011 at 12:20 PM, Felix Giguere Villegas <
> > > felix.giguere@mate1inc.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > We are currently evaluating Kafka, so I'm trying to get one of our
> > simple
> > > > use case working. I have read the design paper and most of everything
> > > else
> > > > I
> > > > could find about Kafka, but I'm not sure how to set up a producer
> that
> > > > tails
> > > > files or that reads from STDIN.
> > > >
> > > > Do I have to write custom code just for that? It seems like a pretty
> > > > simple/common use case, so I would think it already exists out of the
> > > box.
> > > >
> > > > I guess I could pipe a tail command into bin/kafka-producer-shell.sh
> ??
> > > >
> > > > This kind of stuff is relatively easy to set up with Flume, but we
> like
> > > the
> > > > persistence and replay capabilities of Kafka, which is why we are
> > trying
> > > it
> > > > out.
> > > >
> > > > Thanks in advance for helping out a newb ;) !
> > > >
> > > > --
> > > > Felix
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message