samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rad Gruchalski <>
Subject Re: Forward JMX Metrics to New Relic?
Date Thu, 21 Jan 2016 23:45:27 GMT

You can make samza publish metrics to a kafka topic using your own serdes ->
From there it should be rather straightforward to consume and put stuff in NR.

Kind regards,

Radek Gruchalski (
 ( (

This communication is intended for the above-named person and may be confidential and/or legally
If it has come to you in error you must take no action based on it, nor must you copy or show
it to anyone; please delete/destroy and inform the sender immediately.

On Thursday, 21 January 2016 at 23:02, Avi Flax wrote:

> Hello all,
> I’m new to Samza and I’m going to be implementing some stream
> processing jobs for a client who is also new to Samza. My client uses
> New Relic (NR) for metrics and I’d like to get Samza’s metrics
> forwarding over to their NR account if possible. I’m just posting here
> to get a quick sanity check from someone on what I have in mind. I
> don’t really get YARN yet so I could be just completely off in my
> thinking.
> It’s my understanding that YARN will start a JVM for each
> SamzaContainer, which is essentially the application which actually
> does most of the processing work. I’m thinking therefore that maybe
> each SamzaContainer JVM could load the NR Java Agent[1] via the
> `-javaagent` argument, then each job/task (not sure) would publish
> metrics via JMX which will then be forwarded to NR as specified in a
> local YAML file [2].
> Does that make any sense? Does it seems reasonable? Is there a better way?
> I’d really appreciate any help with this!
> Thanks,
> Avi
> [1]
> [2]

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message