kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sumit Maheshwari <sumitm.i...@gmail.com>
Subject Re: Reg: Need info on Kafka Brokers
Date Wed, 04 Jan 2017 06:47:56 GMT
@Jhon, thanks for pointing that out. I was looking for something like that.
But as Ewen pointed out, its not open sourced.

Thanks,
Sumit

On Wed, Jan 4, 2017 at 12:07 PM, Ewen Cheslack-Postava <ewen@confluent.io>
wrote:

> Unfortunately, I don't think it has been open sourced (it doesn't seem to
> be available on https://github.com/paypal).
>
> -Ewen
>
> On Tue, Jan 3, 2017 at 5:54 PM, Jhon Davis <jhon.dav.send@gmail.com>
> wrote:
>
> > Found an interesting Kafka monitoring tool but no information on whether
> > it's not open sourced or not.
> >
> > https://medium.com/@rrsingh.send/monitoring-kafka-at-scale-
> > paypal-254238f6022d
> >
> > Best,
> > J.D.
> >
> > On Mon, Jan 2, 2017 at 11:01 PM, Sreejith S <srssreejith@gmail.com>
> wrote:
> >
> > > Hi Sumit,
> > >
> > > JMX Metrics will give you lot of in depth information on Kafka.
> > >
> > > Just try this.
> > > https://github.com/srijiths/kafka-connectors/tree/master/kaf
> > ka-connect-jmx
> > >
> > > If you use above , then you should have a custom UI to show the
> metrics.
> > >
> > > Also you can try open source kafka monitoring tool
> > >
> > > https://github.com/yahoo/kafka-manager
> > >
> > > You can find lot of other open source kafka monitoring tools as well.
> > >
> > > Regards,
> > > Srijith
> > >
> > > On Mon, Jan 2, 2017 at 6:13 PM, Stevo Slavić <sslavic@gmail.com>
> wrote:
> > >
> > > > Hello Sumit,
> > > >
> > > > Not yet. AFAIK few topic management requests got introduced in broker
> > > side
> > > > (see https://issues.apache.org/jira/browse/KAFKA-2229 ) but not yet
> in
> > > > client APIs. Querying/listing topics request doesn't seem even to be
> > > > planned yet.
> > > >
> > > > AdminUtils which talks with ZooKeeper via ZkClient is Kafka client
> API
> > > one
> > > > can use to retrieve some information, if you're building your own
> > > > monitoring tools or reporting custom metrics. There are already
> > multiple
> > > > OSS and closed source commercial products for monitoring Kafka which
> > have
> > > > this functionality.
> > > >
> > > > Kind regards,
> > > > Stevo Slavic.
> > > >
> > > > On Mon, Jan 2, 2017 at 1:23 PM, Sumit Maheshwari <
> > sumitm.iiit@gmail.com>
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I am looking to get information about individual brokers in kafka
> > > > cluster.
> > > > > The information that I am looking for is:
> > > > >
> > > > >    - List of topics in a broker
> > > > >    - Partitions for each topic in a broker
> > > > >    - Metrics like BytesIn/Out Per min, Messages In/Min per topic
> > > > >    - ...
> > > > >
> > > > > I have tried looking into the JMX metrics seems but they does not
> > > provide
> > > > > the above information.
> > > > > Is it possible to get these information from the broker itself
> > without
> > > > > contacting zookeeper?
> > > > >
> > > > > Thanks,
> > > > > Sumit
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > >
> > >
> > > *Sreejith.S*
> > > https://github.com/srijiths/
> > > http://srijiths.wordpress.com/
> > > tweet2sree@twitter <http://tweet2Sree <http://tweet2sree/>>
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message