kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryanne Dolan <ryannedo...@gmail.com>
Subject Re: Dynamic Partitioning
Date Tue, 08 Jan 2019 17:12:41 GMT
Just key your messages by user ID and they'll be processed in sequence.
Every message with the same key will go to the same partition, regardless
of how many partitions there are.

Ryanne

On Tue, Jan 8, 2019, 8:57 AM marimuthu eee <marimuthueee76@gmail.com wrote:

> Hi Ryanne Dolan,
>
> My requirement is to process notification messages in parallel.So i have
> an idea to pick kafka as a messaging system.But i need dynamic partitioning*
> to handle individual user notification messages in serial manner*.Is it
> possible to create dynamic partition creation for a particular topic.
>
>
>
> On Tue, Jan 8, 2019 at 8:20 PM Ryanne Dolan <ryannedolan@gmail.com> wrote:
>
>> Can you explain why you think you need dynamic partitioning? Maybe we can
>> help you design without it.
>>
>> Ryanne
>>
>> On Tue, Jan 8, 2019, 4:04 AM marimuthu eee <marimuthueee76@gmail.com
>> wrote:
>>
>> > Hi,
>> >
>> > My requirement is to process notification messages in parallel.So i
>> have an
>> > idea to pick kafka as a messaging system.But i need dynamic
>> partitioning to
>> > handle individual user notification messages.Is it possible to create
>> > dynamic partition creation for a particular topic.
>> >
>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message