samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rad Gruchalski <ra...@gruchalski.com>
Subject Re: Forward JMX Metrics to New Relic?
Date Thu, 21 Jan 2016 23:45:27 GMT
Avi,  

You can make samza publish metrics to a kafka topic using your own serdes -> https://samza.apache.org/learn/documentation/0.9/container/metrics.html
 
From there it should be rather straightforward to consume and put stuff in NR.










Kind regards,

Radek Gruchalski

radek@gruchalski.com (mailto:radek@gruchalski.com)
 (mailto:radek@gruchalski.com)
de.linkedin.com/in/radgruchalski/ (http://de.linkedin.com/in/radgruchalski/)

Confidentiality:
This communication is intended for the above-named person and may be confidential and/or legally
privileged.
If it has come to you in error you must take no action based on it, nor must you copy or show
it to anyone; please delete/destroy and inform the sender immediately.



On Thursday, 21 January 2016 at 23:02, Avi Flax wrote:

> Hello all,
>  
> I’m new to Samza and I’m going to be implementing some stream
> processing jobs for a client who is also new to Samza. My client uses
> New Relic (NR) for metrics and I’d like to get Samza’s metrics
> forwarding over to their NR account if possible. I’m just posting here
> to get a quick sanity check from someone on what I have in mind. I
> don’t really get YARN yet so I could be just completely off in my
> thinking.
>  
> It’s my understanding that YARN will start a JVM for each
> SamzaContainer, which is essentially the application which actually
> does most of the processing work. I’m thinking therefore that maybe
> each SamzaContainer JVM could load the NR Java Agent[1] via the
> `-javaagent` argument, then each job/task (not sure) would publish
> metrics via JMX which will then be forwarded to NR as specified in a
> local YAML file [2].
>  
> Does that make any sense? Does it seems reasonable? Is there a better way?
>  
> I’d really appreciate any help with this!
>  
> Thanks,
> Avi
>  
> [1] https://docs.newrelic.com/docs/agents/java-agent/getting-started/new-relic-java
>  
> [2] https://docs.newrelic.com/docs/agents/java-agent/custom-instrumentation/custom-jmx-instrumentation-yaml
 


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message