kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Damian Guy <damian....@gmail.com>
Subject Re: Problem with processor API partition assignments
Date Thu, 05 Jan 2017 12:37:50 GMT
Hi Brian,

It might be helpful if you provide some code showing your Topology.

Thanks,
Damian

On Thu, 5 Jan 2017 at 10:59 Brian Krahmer <bkrahmer@krahmer.com> wrote:

> Hey guys,
>
>    I'm fighting an issue where I can currently only run one instance of
> my streams application because when other instances come up, the
> partition reassignment (looks to me) to be incorrect.
>
> I'm testing with docker-compose at the moment.  When I scale my
> application to 3 instances and the 2nd and 3rd connect to kafka, causing
> a rebalance, I get the following assignment on one of my instances:
>
> FleetData-0
> FleetData-1
> VehicleJourneyMapData-0
> VehicleJourneyMapData-1
> JourneyStarted-0
> VehicleStateChanged-1
> VehicleIgnitionData-0
> VinVehicleMapData-1
>
> As you can see, the assignments are clearly not symmetric, which causes
> problems, as I'm essentially doing join operations.  All topics have 3
> partition in this testing scenario.  I'm using version 0.10.1.0.  Any
> ideas?
>
> thanks,
> brian
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message