nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joe Witt <joe.w...@gmail.com>
Subject Re: GetKafka blowing up with assertion error in Kafka client code
Date Thu, 14 Apr 2016 20:20:02 GMT
As with any system to system interaction things can happen.  All
systems, including Kafka provide facilities to allow systems writing
to or consuming from it, to recover from failure cases.  So let's just
focus on what the config/environment is and do our best to provide
ways to work past these issues.  It doesn't help us or anyone else to
highlight frequent deadlocks so let's just stay focused on what we can
do to help.

On Thu, Apr 14, 2016 at 4:13 PM, Oleg Zhurakousky
<ozhurakousky@hortonworks.com> wrote:
> Chris
> That is correct and for a change I am pretty happy to see this stack trace as it clearly
shows the problem and validates the approach we have.
> So here are more details. . .
>
> The root failure is in Kafka (as you can see from the stack trace). All we are doing
is encapsulating interaction with Kafka into cancelable Future so we can cancel if and when
Kafka deadlocks (which we noticed happens rather often)
> When we execute Future.get() it results in ExecutionException which caries the original
Kafka exception (AssertionError).
> Now I am not sure what that assertion error really means in the context of what you are
trying to do but its clearly a problem originated in Kafka.
> Could you share your config or whatever other details?
>
> Cheers
> Oleg
>
>> On Apr 14, 2016, at 4:00 PM, McDermott, Chris Kevin (MSDU - STaTS/StorefrontRemote)
<chris.mcdermott@hpe.com> wrote:
>>
>> I’m running based of of 0.7.0 Snapshot.  The GetKafka config is pretty generic.
 Batch size 1, 1 concurrent task.
>>
>>
>> 2016-04-14 19:27:23,204 ERROR [Timer-Driven Process Thread-9] o.apache.nifi.processors.kafka.GetKafka
>> java.lang.IllegalStateException: java.util.concurrent.ExecutionException: java.lang.AssertionError:
assertion failed
>>        at org.apache.nifi.processors.kafka.GetKafka.onTrigger(GetKafka.java:355)
~[na:na]
>>        at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
~[nifi-api-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT]
>>        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1059)
[nifi-framework-core-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT]
>>        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136)
[nifi-framework-core-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT]
>>        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
[nifi-framework-core-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT]
>>        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:123)
[nifi-framework-core-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT]
>>        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[na:1.8.0_45]
>>        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_45]
>>        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_45]
>>        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
[na:1.8.0_45]
>>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_45]
>>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_45]
>>        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
>> Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError: assertion
failed
>>        at java.util.concurrent.FutureTask.report(FutureTask.java:122) [na:1.8.0_45]
>>        at java.util.concurrent.FutureTask.get(FutureTask.java:206) [na:1.8.0_45]
>>        at org.apache.nifi.processors.kafka.GetKafka.onTrigger(GetKafka.java:348)
~[na:na]
>>        ... 12 common frames omitted
>> Caused by: java.lang.AssertionError: assertion failed
>>        at scala.Predef$.assert(Predef.scala:165) ~[na:na]
>>        at kafka.consumer.TopicCount$$anonfun$makeConsumerThreadIdsPerTopic$2.apply(TopicCount.scala:51)
~[na:na]
>>        at kafka.consumer.TopicCount$$anonfun$makeConsumerThreadIdsPerTopic$2.apply(TopicCount.scala:49)
~[na:na]
>>        at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
~[na:na]
>>        at scala.collection.immutable.Map$Map1.foreach(Map.scala:109) ~[na:na]
>>        at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771)
~[na:na]
>>        at kafka.consumer.TopicCount$.makeConsumerThreadIdsPerTopic(TopicCount.scala:49)
~[na:na]
>>        at kafka.consumer.StaticTopicCount.getConsumerThreadIdsPerTopic(TopicCount.scala:113)
~[na:na]
>>        at kafka.consumer.ZookeeperConsumerConnector.consume(ZookeeperConsumerConnector.scala:226)
~[na:na]
>>        at kafka.javaapi.consumer.ZookeeperConsumerConnector.createMessageStreams(ZookeeperConsumerConnector.scala:85)
~[na:na]
>>        at kafka.javaapi.consumer.ZookeeperConsumerConnector.createMessageStreams(ZookeeperConsumerConnector.scala:97)
~[na:na]
>>        at org.apache.nifi.processors.kafka.GetKafka.createConsumers(GetKafka.java:281)
~[na:na]
>>        at org.apache.nifi.processors.kafka.GetKafka$1.call(GetKafka.java:343) ~[na:na]
>>        at org.apache.nifi.processors.kafka.GetKafka$1.call(GetKafka.java:340) ~[na:na]
>>        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_45]
>>        ... 3 common frames omitted
>

Mime
View raw message