nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Bean <mark.o.b...@gmail.com>
Subject high task count
Date Wed, 16 Oct 2019 20:27:28 GMT
We have a PostHTTP with the failure relationship going to a downstream
processor. The downstream processor has a huge task count - over 100
million tasks across the cluster in the 5-minute stats window. Yet, there
are only between 4,000-18,000 FlowFiles that are processed in that same
time.

The exact downstream processor does not change the behavior. Three separate
processor types were added as the next downstream processor to the original
PostHTTP - one of them a simple UpdateAttribute that did not update any
attributes - and each downstream processor exhibited the same unusually
high task count.

Any ideas on why there are so many tasks executing for this particular
connection?

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message