kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alex Good <A...@makerlabs.co.uk>
Subject Re: GlobalKTable never finishes restoring
Date Tue, 07 Nov 2017 18:01:57 GMT
Disabling transactions doesn't seem to have changed anything. I've had a
read through the kafka streams source code, specifically the parts relating
to the restoration of the global stores and I can't see anything obvious I
should look at.

@Ted will do, here's a pastebin of the most recent run
https://pastebin.com/rw2WbFyt

Thanks
Alex

On Tue, Nov 7, 2017 at 5:12 PM Ted Yu <yuzhihong@gmail.com> wrote:

> Alex:
> In the future, please use pastebin if the log is not too large.
>
> When people find this thread in mailing list archive, the attachment
> wouldn't be there.
>
> Thanks
>
> On Tue, Nov 7, 2017 at 8:32 AM, Matthias J. Sax <matthias@confluent.io>
> wrote:
>
> > Alex,
> >
> > I am not sure, but maybe it's a bug. I noticed that you read transaction
> > data. Can you try to write to the topic without using transactions
> > and/or set the consumer into READ_UNCOMMITTED mode to verify? It only a
> > guess that it might be related to transactions and it would be great to
> > verify or rule it out.
> >
> > Thanks a lot!
> >
> > -Matthias
> >
> >
> > On 11/7/17 3:15 PM, Alex Good wrote:
> > > Hi All,
> > >
> > > I have a simple kafka streams app that seems to hang when restoring
> > > state for a GlobalKTable. We're running in a test environment at the
> > > moment and the topic it is loading from only has two messages in it, I
> > > don't know if the very low volume of messages would affect the restore?
> > >
> > > I've attached a log, the topic in question is invoices-state. As you
> can
> > > see the GlobalStreamThread appears to load the two messages in the
> topic
> > > and then continues to send read requests to the topic despite having
> > > caught up. Any tips on debugging this would be very welcome.
> > >
> > > Thanks
> > > Alex
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message