kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ewen Cheslack-Postava <e...@confluent.io>
Subject Re: Reg: Need info on Kafka Brokers
Date Wed, 04 Jan 2017 06:37:15 GMT
Unfortunately, I don't think it has been open sourced (it doesn't seem to
be available on https://github.com/paypal).

-Ewen

On Tue, Jan 3, 2017 at 5:54 PM, Jhon Davis <jhon.dav.send@gmail.com> wrote:

> Found an interesting Kafka monitoring tool but no information on whether
> it's not open sourced or not.
>
> https://medium.com/@rrsingh.send/monitoring-kafka-at-scale-
> paypal-254238f6022d
>
> Best,
> J.D.
>
> On Mon, Jan 2, 2017 at 11:01 PM, Sreejith S <srssreejith@gmail.com> wrote:
>
> > Hi Sumit,
> >
> > JMX Metrics will give you lot of in depth information on Kafka.
> >
> > Just try this.
> > https://github.com/srijiths/kafka-connectors/tree/master/kaf
> ka-connect-jmx
> >
> > If you use above , then you should have a custom UI to show the metrics.
> >
> > Also you can try open source kafka monitoring tool
> >
> > https://github.com/yahoo/kafka-manager
> >
> > You can find lot of other open source kafka monitoring tools as well.
> >
> > Regards,
> > Srijith
> >
> > On Mon, Jan 2, 2017 at 6:13 PM, Stevo Slavić <sslavic@gmail.com> wrote:
> >
> > > Hello Sumit,
> > >
> > > Not yet. AFAIK few topic management requests got introduced in broker
> > side
> > > (see https://issues.apache.org/jira/browse/KAFKA-2229 ) but not yet in
> > > client APIs. Querying/listing topics request doesn't seem even to be
> > > planned yet.
> > >
> > > AdminUtils which talks with ZooKeeper via ZkClient is Kafka client API
> > one
> > > can use to retrieve some information, if you're building your own
> > > monitoring tools or reporting custom metrics. There are already
> multiple
> > > OSS and closed source commercial products for monitoring Kafka which
> have
> > > this functionality.
> > >
> > > Kind regards,
> > > Stevo Slavic.
> > >
> > > On Mon, Jan 2, 2017 at 1:23 PM, Sumit Maheshwari <
> sumitm.iiit@gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I am looking to get information about individual brokers in kafka
> > > cluster.
> > > > The information that I am looking for is:
> > > >
> > > >    - List of topics in a broker
> > > >    - Partitions for each topic in a broker
> > > >    - Metrics like BytesIn/Out Per min, Messages In/Min per topic
> > > >    - ...
> > > >
> > > > I have tried looking into the JMX metrics seems but they does not
> > provide
> > > > the above information.
> > > > Is it possible to get these information from the broker itself
> without
> > > > contacting zookeeper?
> > > >
> > > > Thanks,
> > > > Sumit
> > > >
> > >
> >
> >
> >
> > --
> >
> >
> > *Sreejith.S*
> > https://github.com/srijiths/
> > http://srijiths.wordpress.com/
> > tweet2sree@twitter <http://tweet2Sree <http://tweet2sree/>>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message