nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <>
Subject Re: NiFi backpressure not work
Date Wed, 16 Oct 2019 06:17:30 GMT
Hi Lei

I assume it’s the same as for the ListSFTP. As I don’t know the CaptureChangeMySQLSelf
processor I try to explain it for the ListSFTP. There with one single execution of the processor
you get as much flowfiles as you have files on your disk. If it finds 1000 it sends out 1000
flowfiles. If it finds 1’000’000 it sends out 1’000’000 flowfiles. The processor can’t
hold back some flows and knows nothing about your queue, so it sends out everything in one
“batch” per execution – even if it is more than the queue size. Hope this explains the
behavior a bit.


From: "" <>
Reply to: "" <>
Date: Wednesday, 16 October 2019 at 08:10
To: users <>, dev <>
Subject: NiFi backpressure not work

As the picture shows.
I have set the backpressure object threshold to 10000, but picture shows there's more than
1,000,000. Why this happens?


Thanks, Lei
View raw message