kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guozhang Wang <wangg...@gmail.com>
Subject Re: Total metrics are broken in Kafka streams 2.0.0
Date Fri, 03 Aug 2018 16:02:06 GMT
Thank you Sam!

On Wed, Aug 1, 2018 at 11:39 PM, Sam Lendle <slendle@pandora.com> wrote:

> The problem is that the total metrics in streams are implemented using a
> Count, which is a SampledStat, so the value it reports is the count over
> recent time windows, not all of time. The behavior I was seeing was when a
> window is purged, the reported total decreases.  I’ll open a JIRA tomorrow.
>
> On 8/1/18, 4:50 PM, "Guozhang Wang" <wangguoz@gmail.com> wrote:
>
>     Hello Sam,
>
>     Your uploaded snapshot was rejected by apache mailing list, could you
>     upload it somewhere else, and share the link with us?
>
>
>     Guozhang
>
>
>     On Wed, Aug 1, 2018 at 4:37 PM, Sam Lendle <slendle@pandora.com>
> wrote:
>
>     > Is this a known issue? If not I can create a JIRA.
>     >
>     >
>     >
>     > For example, here’s a screenshot of the process-total metric for one
>     > processor node and task under stream-processor-node-metrics.
>     > Processor-total goes down over time when it shouldn’t. Same thing
> for total
>     > metrics under stream-metrics, stream-*-state-metrics,
> stream-task-metrics.
>     > Total metrics look okay for producer and consumers that I’ve looked
> at.
>     >
>     >
>     >
>     > Technically most streams total metrics aren’t documented (
>     > https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.
> confluent.io_current_streams_monitoring.html&d=DwIFaQ&c=
> gFTBenQ7Vj71sUi1A4CkFnmPzqwDo07QsHw-JRepxyw&r=
> BNCekDhngyXB6C2Ag7PIfHotiuqjAVwLOZLQHB7fyOM&m=zq-Fk2clMlUfF7RbFuEZnUqnn4o_
> 8U0Jlz0X8RLkWEQ&s=dOQW97fklwzcYf8pBFafKmtiKkbDUwkKa9gL2eXfvLM&e=), so
> maybe
>     > they’re not officially supported but they are mentioned in KIP 187
>     > https://urldefense.proofpoint.com/v2/url?u=https-3A__cwiki.
> apache.org_confluence_display_KAFKA_KIP-2D&d=DwIFaQ&c=
> gFTBenQ7Vj71sUi1A4CkFnmPzqwDo07QsHw-JRepxyw&r=
> BNCekDhngyXB6C2Ag7PIfHotiuqjAVwLOZLQHB7fyOM&m=zq-Fk2clMlUfF7RbFuEZnUqnn4o_
> 8U0Jlz0X8RLkWEQ&s=VxM4uo16_sukXVcW8ztzNnydCzoK568paxsrxfhPkEY&e=
>     > 187+-+Add+cumulative+count+metric+for+all+Kafka+rate+metrics.
>     >
>     >
>     >
>     > [image: cid:image001.png@01D429B1.2CED5AD0]
>     >
>
>
>
>     --
>     -- Guozhang
>
>
>


-- 
-- Guozhang

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message