spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erik Erlandson <...@redhat.com>
Subject An Apache Spark metric sink for Kafka
Date Tue, 18 Apr 2017 19:40:33 GMT

I wrote up a simple metric sink for Spark that publishes metrics to a Kafka broker.
Each metric is published as a message (in json format), with the metric name as the message
key.

https://github.com/erikerlandson/spark-kafka-sink

Build with "(x)sbt assembly" and make sure the resulting jar file is available on the classpath
for the relevant spark components.
A quick-start demo is included on the readme file.

Cheers!
Erik

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message