kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stevo Slavić <ssla...@gmail.com>
Subject Re: Database Replication Question
Date Tue, 03 Mar 2015 23:27:07 GMT
Have you considered including order information in messages that are sent
to Kafka, and then restoring order in logic that is processing messages
consumed from Kafka?
http://www.enterpriseintegrationpatterns.com/Resequencer.html

Kind regards,
Stevo Slavic.

On Wed, Mar 4, 2015 at 12:15 AM, Josh Rader <jrader940@gmail.com> wrote:

> Hi Kafka Experts,
>
>
>
> We have a use case around RDBMS replication where we are investigating
> Kafka.  In this case ordering is very important.  Our understanding is
> ordering is only preserved within a single partition.  This makes sense as
> a single thread will consume these messages, but our question is can we
> somehow parallelize this for better performance?   Is there maybe some
> partition key strategy trick to have your cake and eat it too in terms of
> keeping ordering, but also able to parallelize the processing?
>
>
>
> I am sorry if this has already been asked, but we tried to search through
> the archives and couldn’t find this response.
>
>
>
> Thanks,
>
> Josh
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message