kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Milind Vaidya <kava...@gmail.com>
Subject Re: Fast way search data in kafka
Date Thu, 23 Mar 2017 20:28:53 GMT
That looks like a faster option.

Now the thing is --file requires list of comma separated files. Is there
any way to look at all files in a directory ?


I tried *log but did not work or I will have to script something to do that
?

On Sat, Mar 4, 2017 at 9:04 PM, Guozhang Wang <wangguoz@gmail.com> wrote:

> Hi Milind,
>
> You can try the DumpSegmentTool to read the logs at broker machines
> directly as well:
>
> https://cwiki.apache.org/confluence/display/KAFKA/
> System+Tools#SystemTools-DumpLogSegment
>
> Guozhang
>
> On Sat, Mar 4, 2017 at 9:48 AM, Anish Mashankar <anish@systeminsights.com>
> wrote:
>
> > Try Presto https://prestodb.io. It may solve your problem.
> >
> > On Sat, 4 Mar 2017, 03:18 Milind Vaidya, <kavadsa@gmail.com> wrote:
> >
> > > I have 6 broker kafka setup.
> > >
> > > I have retention period of  48 hrs.
> > >
> > > To debug if certain data has reached kafka or not I am using command
> line
> > > consumer to then piping to grep. But it will take huge amount of time
> and
> > > may not succeed as well.
> > >
> > > Is there an other way to search something in kafka without using
> > consumer?
> > >
> > --
> >
> > Regards,
> > Anish Samir Mashankar
> > R&D Engineer
> > System Insights
> > +91-9789870733
> >
>
>
>
> --
> -- Guozhang
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message