kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dmitry Minkovsky <dminkov...@gmail.com>
Subject MAX_TASK_IDLE_MS_CONFIG not working?
Date Thu, 13 Dec 2018 21:53:44 GMT
I just discovered that 2.1.0 included MAX_TASK_IDLE_MS_CONFIG and dropped
everything to play with it! Exciting!

I built the following topology, attempting to synchronize two
topic-partitions:
https://gist.github.com/dminkovsky/45aa29aefefad564f9663cd36ad21ce1.

However, I keep failing at
https://gist.github.com/dminkovsky/45aa29aefefad564f9663cd36ad21ce1#file-gistfile1-txt-L42.
Am I misunderstanding how this feature works? The two topic-partitions
appear to be grouped together in a single task:

[2018-12-13 16:38:29,082] DEBUG
(org.apache.kafka.streams.processor.internals.TaskManager:120)
stream-thread
[migration-fed2f8fa-150e-494c-b1c8-0594f6d52a29-StreamThread-1] Adding
assigned tasks as active: {0_0=[join-requests-0,
settings-update-requests-0],
1_0=[migration-KSTREAM-AGGREGATE-STATE-STORE-0000000008-repartition-0]}


So shouldn't this new config enable effectively synchronizing them?


Thank you,

Dmitry

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message