From dev-return-16897-apmail-atlas-dev-archive=atlas.apache.org@atlas.apache.org Wed Aug 16 04:07:08 2017 Return-Path: X-Original-To: apmail-atlas-dev-archive@minotaur.apache.org Delivered-To: apmail-atlas-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 137391AB28 for ; Wed, 16 Aug 2017 04:07:08 +0000 (UTC) Received: (qmail 9606 invoked by uid 500); 16 Aug 2017 04:07:08 -0000 Delivered-To: apmail-atlas-dev-archive@atlas.apache.org Received: (qmail 9429 invoked by uid 500); 16 Aug 2017 04:07:07 -0000 Mailing-List: contact dev-help@atlas.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@atlas.apache.org Delivered-To: mailing list dev@atlas.apache.org Received: (qmail 9414 invoked by uid 99); 16 Aug 2017 04:07:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Aug 2017 04:07:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 6821818072F for ; Wed, 16 Aug 2017 04:07:06 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id CJzLEal8svcx for ; Wed, 16 Aug 2017 04:07:04 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 112AB5FDFA for ; Wed, 16 Aug 2017 04:07:04 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 99E8AE002B for ; Wed, 16 Aug 2017 04:07:02 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 18B3A2140A for ; Wed, 16 Aug 2017 04:07:00 +0000 (UTC) Date: Wed, 16 Aug 2017 04:07:00 +0000 (UTC) From: "Ayub Pathan (JIRA)" To: dev@atlas.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (ATLAS-633) "kafka.common.NoReplicaOnlineException" exception on atlas startup MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/ATLAS-633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128277#comment-16128277 ] Ayub Pathan commented on ATLAS-633: ----------------------------------- [~bill] This issue is seen in embedded mode of Atlas and I believe this is a limitation from ATlas-Kafka integration. Since I am using non-embedded mode of Atlas, I didn't pursue on this route. > "kafka.common.NoReplicaOnlineException" exception on atlas startup > ------------------------------------------------------------------ > > Key: ATLAS-633 > URL: https://issues.apache.org/jira/browse/ATLAS-633 > Project: Atlas > Issue Type: Bug > Affects Versions: trunk > Reporter: Ayub Pathan > > "kafka.common.NoReplicaOnlineException" exception on atlas startup > {noformat} > 2016-04-05 11:01:54,811 INFO - [main:] ~ [Socket Server on Broker 1], Started 1 acceptor threads (SocketServer:68) > 2016-04-05 11:01:54,828 INFO - [ExpirationReaper-1:] ~ [ExpirationReaper-1], Starting (DelayedOperationPurgatory$ExpiredOperationReaper:68) > 2016-04-05 11:01:54,828 INFO - [ExpirationReaper-1:] ~ [ExpirationReaper-1], Starting (DelayedOperationPurgatory$ExpiredOperationReaper:68) > 2016-04-05 11:01:54,852 INFO - [main:] ~ [Controller 1]: Controller starting up (KafkaController:68) > 2016-04-05 11:01:54,862 INFO - [main:] ~ Creating /controller (is it secure? false) (ZKCheckedEphemeral:68) > 2016-04-05 11:01:54,867 INFO - [main:] ~ Result of znode creation is: OK (ZKCheckedEphemeral:68) > 2016-04-05 11:01:54,868 INFO - [main:] ~ 1 successfully elected as leader (ZookeeperLeaderElector:68) > 2016-04-05 11:01:54,868 INFO - [main:] ~ [Controller 1]: Broker 1 starting become controller state transition (KafkaController:68) > 2016-04-05 11:01:54,870 INFO - [main:] ~ [Controller 1]: Initialized controller epoch to 1 and zk version 0 (KafkaController:68) > 2016-04-05 11:01:54,872 INFO - [main:] ~ [Controller 1]: Controller 1 incremented epoch to 2 (KafkaController:68) > 2016-04-05 11:01:54,939 INFO - [main:] ~ [Controller 1]: Partitions undergoing preferred replica election: (KafkaController:68) > 2016-04-05 11:01:54,939 INFO - [main:] ~ [Controller 1]: Partitions that completed preferred replica election: (KafkaController:68) > 2016-04-05 11:01:54,940 INFO - [main:] ~ [Controller 1]: Resuming preferred replica election for partitions: (KafkaController:68) > 2016-04-05 11:01:54,943 INFO - [main:] ~ [Controller 1]: Partitions being reassigned: Map() (KafkaController:68) > 2016-04-05 11:01:54,944 INFO - [main:] ~ [Controller 1]: Partitions already reassigned: List() (KafkaController:68) > 2016-04-05 11:01:54,945 INFO - [main:] ~ [Controller 1]: Resuming reassignment of partitions: Map() (KafkaController:68) > 2016-04-05 11:01:54,949 INFO - [main:] ~ [Controller 1]: List of topics to be deleted: (KafkaController:68) > 2016-04-05 11:01:54,949 INFO - [main:] ~ [Controller 1]: List of topics ineligible for deletion: ATLAS_HOOK,ATLAS_ENTITIES (KafkaController:68) > 2016-04-05 11:01:54,951 INFO - [main:] ~ [Controller 1]: Currently active brokers in the cluster: Set() (KafkaController:68) > 2016-04-05 11:01:54,952 INFO - [main:] ~ [Controller 1]: Currently shutting brokers in the cluster: Set() (KafkaController:68) > 2016-04-05 11:01:54,952 INFO - [main:] ~ [Controller 1]: Current list of topics in the cluster: Set(ATLAS_ENTITIES, ATLAS_HOOK) (KafkaController:68) > 2016-04-05 11:01:54,956 INFO - [main:] ~ [Replica state machine on controller 1]: Started replica state machine with initial state -> Map([Topic=ATLAS_ENTITIES,Partition=0,Replica=1] -> ReplicaDeletionIneligible, [Topic=ATLAS_HOOK,Partition=0,Replica=1] -> ReplicaDeletionIneligible) (ReplicaStateMachine:68) > 2016-04-05 11:01:54,977 ERROR - [main:] ~ Controller 1 epoch 2 initiated state change for partition [ATLAS_HOOK,0] from OfflinePartition to OnlinePartition failed (logger:103) > kafka.common.NoReplicaOnlineException: No replica for partition [ATLAS_HOOK,0] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1)] > at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) > at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) > at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) > at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) > at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) > at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772) > at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:98) > at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:98) > at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:226) > at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39) > at scala.collection.mutable.HashMap.foreach(HashMap.scala:98) > at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771) > at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) > at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) > at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) > at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) > at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) > at kafka.server.ZookeeperLeaderElector$$anonfun$startup$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:50) > at kafka.server.ZookeeperLeaderElector$$anonfun$startup$1.apply(ZookeeperLeaderElector.scala:48) > at kafka.server.ZookeeperLeaderElector$$anonfun$startup$1.apply(ZookeeperLeaderElector.scala:48) > at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) > at kafka.server.ZookeeperLeaderElector.startup(ZookeeperLeaderElector.scala:48) > at kafka.controller.KafkaController$$anonfun$startup$1.apply$mcV$sp(KafkaController.scala:681) > at kafka.controller.KafkaController$$anonfun$startup$1.apply(KafkaController.scala:677) > at kafka.controller.KafkaController$$anonfun$startup$1.apply(KafkaController.scala:677) > at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) > at kafka.controller.KafkaController.startup(KafkaController.scala:677) > at kafka.server.KafkaServer.startup(KafkaServer.scala:188) > at org.apache.atlas.kafka.KafkaNotification.startKafka(KafkaNotification.java:313) > at org.apache.atlas.kafka.KafkaNotification.start(KafkaNotification.java:137) > at org.apache.atlas.service.Services.start(Services.java:45) > at org.apache.atlas.web.listeners.GuiceServletConfig.startServices(GuiceServletConfig.java:157) > at org.apache.atlas.web.listeners.GuiceServletConfig.contextInitialized(GuiceServletConfig.java:151) > at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800) > at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444) > at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791) > at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294) > at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349) > at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342) > at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741) > at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505) > at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132) > at org.eclipse.jetty.server.Server.start(Server.java:387) > at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114) > at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61) > at org.eclipse.jetty.server.Server.doStart(Server.java:354) > at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:93) > at org.apache.atlas.Atlas.main(Atlas.java:109) > 2016-04-05 11:01:54,991 ERROR - [main:] ~ Controller 1 epoch 2 initiated state change for partition [ATLAS_ENTITIES,0] from OfflinePartition to OnlinePartition failed (logger:103) > kafka.common.NoReplicaOnlineException: No replica for partition [ATLAS_ENTITIES,0] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1)] > at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) > at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) > at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) > at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) > at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) > at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772) > at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:98) > at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:98) > at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:226) > at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39) > at scala.collection.mutable.HashMap.foreach(HashMap.scala:98) > at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771) > at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) > at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) > at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) > at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) > at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) > at kafka.server.ZookeeperLeaderElector$$anonfun$startup$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:50) > at kafka.server.ZookeeperLeaderElector$$anonfun$startup$1.apply(ZookeeperLeaderElector.scala:48) > at kafka.server.ZookeeperLeaderElector$$anonfun$startup$1.apply(ZookeeperLeaderElector.scala:48) > at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) > at kafka.server.ZookeeperLeaderElector.startup(ZookeeperLeaderElector.scala:48) > at kafka.controller.KafkaController$$anonfun$startup$1.apply$mcV$sp(KafkaController.scala:681) > at kafka.controller.KafkaController$$anonfun$startup$1.apply(KafkaController.scala:677) > at kafka.controller.KafkaController$$anonfun$startup$1.apply(KafkaController.scala:677) > at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) > at kafka.controller.KafkaController.startup(KafkaController.scala:677) > at kafka.server.KafkaServer.startup(KafkaServer.scala:188) > at org.apache.atlas.kafka.KafkaNotification.startKafka(KafkaNotification.java:313) > at org.apache.atlas.kafka.KafkaNotification.start(KafkaNotification.java:137) > at org.apache.atlas.service.Services.start(Services.java:45) > at org.apache.atlas.web.listeners.GuiceServletConfig.startServices(GuiceServletConfig.java:157) > at org.apache.atlas.web.listeners.GuiceServletConfig.contextInitialized(GuiceServletConfig.java:151) > at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800) > at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444) > at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791) > at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294) > at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349) > at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342) > at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741) > at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505) > at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132) > at org.eclipse.jetty.server.Server.start(Server.java:387) > at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114) > at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61) > at org.eclipse.jetty.server.Server.doStart(Server.java:354) > at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:93) > at org.apache.atlas.Atlas.main(Atlas.java:109) > 2016-04-05 11:01:54,996 INFO - [main:] ~ [Partition state machine on Controller 1]: Started partition state machine with initial state -> Map([ATLAS_HOOK,0] -> OfflinePartition, [ATLAS_ENTITIES,0] -> OfflinePartition) (PartitionStateMachine:68 > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)