kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guozhang Wang <wangg...@gmail.com>
Subject Re: Fast way search data in kafka
Date Sun, 05 Mar 2017 05:04:00 GMT
Hi Milind,

You can try the DumpSegmentTool to read the logs at broker machines
directly as well:

https://cwiki.apache.org/confluence/display/KAFKA/System+Tools#SystemTools-DumpLogSegment

Guozhang

On Sat, Mar 4, 2017 at 9:48 AM, Anish Mashankar <anish@systeminsights.com>
wrote:

> Try Presto https://prestodb.io. It may solve your problem.
>
> On Sat, 4 Mar 2017, 03:18 Milind Vaidya, <kavadsa@gmail.com> wrote:
>
> > I have 6 broker kafka setup.
> >
> > I have retention period of  48 hrs.
> >
> > To debug if certain data has reached kafka or not I am using command line
> > consumer to then piping to grep. But it will take huge amount of time and
> > may not succeed as well.
> >
> > Is there an other way to search something in kafka without using
> consumer?
> >
> --
>
> Regards,
> Anish Samir Mashankar
> R&D Engineer
> System Insights
> +91-9789870733
>



-- 
-- Guozhang

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message