samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Riccomini <criccom...@apache.org>
Subject Re: Kafka topic naming conventions
Date Thu, 19 Mar 2015 01:08:29 GMT
Hey Jakob,

> Yeah, but then if you change the partition count later on, you've got incorrect
information forever.

You're right. But IMO this further reinforces that you *can't* change
partition counts on a topic that you're using for a JOIN. This completely
breaks the operation.

Agree that it's just best effort, and kind of hacky. Was just a thought. I
haven't seen anyone actually do this.

Cheers,
Chris

On Wed, Mar 18, 2015 at 5:59 PM, Jakob Homan <jghoman@gmail.com> wrote:

> On 18 March 2015 at 17:48, Chris Riccomini <criccomini@apache.org> wrote:
> > One thing I haven't seen, but might be relevant, is including partition
> > counts in the topic.
>
> Yeah, but then if you change the partition count later on, you've got
> incorrect information forever. Or you need to create a new stream,
> which might be a nice forcing function to make sure your join isn't
> screwed up.  There'd need to be something somewhere to enforce that
> though.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message