samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yi Pan <nickpa...@gmail.com>
Subject Re: No Metrics Emitted in new High-Level API
Date Sat, 27 Jan 2018 02:49:22 GMT
Hi, Srujun,

I did not see the container logs in the attachment. Is it too big? Can you
send it to my personal email yipan@linkedin.com?

Thanks!

-Yi

On Fri, Jan 26, 2018 at 5:23 PM, Srujun Thanmay Gupta <sgupta80@illinois.edu
> wrote:

> Hello,
>
> I have attached the container log and the job coordinator logs for the two
> samples I ran, and the .properties configuration files used. The
> wikipedia-feed and wikipedia-application code are exactly the same as in
> the master branch on hello-samza. The only change is that I added the
> metrics config to the wikipedia-feed.properties file.
>
> ubuntu@ubuntu-xenial /vagrant/hello-samza % git status
> On branch master
> Your branch is up-to-date with 'origin/master'.
> Changes not staged for commit:
>   (use "git add <file>..." to update what will be committed)
>   (use "git checkout -- <file>..." to discard changes in working directory)
>
>         modified:   src/main/config/wikipedia-feed.properties
>
> no changes added to commit (use "git add" and/or "git commit -a")
>
> ubuntu@ubuntu-xenial /vagrant/hello-samza % git rev-parse HEAD
> f48892747dea196ab80eb0c76081efa86f0ba00c
>
> I scanned through the log files but I do not see anything alarming. The
> MetricsSnapshotReporter is being invoked in both places, but I only see
> messages in the Kafka metrics stream for the wikipedia-feed job, not
> wikipedia-application.
>
> Is there anything else I can try? Thank you!
>
> On Fri, Jan 26, 2018 at 6:32 PM, Jagadish Venkatraman <
> jagadish1989@gmail.com> wrote:
>
>> Hi Srujun,
>>
>> Metrics reporting should be supported independent of the deployment model.
>> Can you please attach your container log file?
>>
>> Are you seeing log lines from MetricsSnapshotReporter:
>> https://github.com/apache/samza/blob/master/samza-core/src/
>> main/scala/org/apache/samza/metrics/reporter/MetricsSnapsh
>> otReporter.scala
>> ?
>> Alternately, you could also set your log-level to DEBUG and verify if the
>> snapshot reporter is being invoked.
>>
>> Best,
>> Jagdish
>>
>
>
>
> --
> Srujun Thanmay Gupta
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message