kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ian Duffy <...@ianduffy.ie>
Subject Re: Kafka Streams 0.10.2.1 client crash - .checkpoint.tmp (No such file or directory)
Date Thu, 06 Jul 2017 14:50:51 GMT
Hi Damian,

Sorry for the delayed reply have been out of office.

I'm afraid I cannot check. We have alarms on our auto scaling groups for
stream instances to kill them should the CPU utilization be < 1 for 30
mins.

On Fri 30 Jun 2017 at 5:05 p.m., Damian Guy <damian.guy@gmail.com> wrote:

> Hi Ian,
>
> Can you check if the file exists and it is indeed a file rather then a
> directory?
>
> Thanks,
> Damian
>
> On Fri, 30 Jun 2017 at 16:45 Damian Guy <damian.guy@gmail.com> wrote:
>
> > Hi Ian,
> >
> > We had another report of what looks like the same issue. Will look into
> it.
> >
> > Thanks,
> > Damian
> >
> > On Fri, 30 Jun 2017 at 16:38 Ian Duffy <ian@ianduffy.ie> wrote:
> >
> >> Hi All,
> >>
> >> I was wondering if any of those who know stream internals should shed
> any
> >> light on the following exception:
> >>
> >> org.apache.kafka.streams.errors.ProcessorStateException: Error while
> >> closing the state manager at
> >>
> >>
> org.apache.kafka.streams.processor.internals.AbstractTask.closeStateManager(AbstractTask.java:133)
> >> at
> >>
> >>
> org.apache.kafka.streams.processor.internals.StreamThread.closeNonAssignedSuspendedTasks(StreamThread.java:898)
> >> at
> >>
> >>
> org.apache.kafka.streams.processor.internals.StreamThread.access$500(StreamThread.java:69)
> >> at
> >>
> >>
> org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:233)
> >> at
> >>
> >>
> org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259)
> >> at
> >>
> >>
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352)
> >> at
> >>
> >>
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303)
> >> at
> >>
> >>
> org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290)
> >> at
> >>
> >>
> org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029)
> >> at
> >>
> >>
> org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995)
> >> at
> >>
> >>
> org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592)
> >> at
> >>
> >>
> org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361)
> >> Caused by: java.io.FileNotFoundException:
> >> /data/kafka-streams-freshness/freshness-id-prod/2_46/.checkpoint.tmp (No
> >> such file or directory) at java.io.FileOutputStream.open0(Native Method)
> >> at
> >> java.io.FileOutputStream.open(FileOutputStream.java:270) at
> >> java.io.FileOutputStream.<init>(FileOutputStream.java:213) at
> >> java.io.FileOutputStream.<init>(FileOutputStream.java:162) at
> >>
> >>
> org.apache.kafka.streams.state.internals.OffsetCheckpoint.write(OffsetCheckpoint.java:71)
> >> at
> >>
> >>
> org.apache.kafka.streams.processor.internals.ProcessorStateManager.close(ProcessorStateManager.java:386)
> >> at
> >>
> >>
> org.apache.kafka.streams.processor.internals.AbstractTask.closeStateManager(AbstractTask.java:131)
> >> ... 11 common frames omitted
> >>
> >> Thanks,
> >> Ian.
> >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message