kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashish Singh <asi...@cloudera.com>
Subject Re: Delete topic using kafka-topics.sh also not working (or takes forever)
Date Fri, 17 Jul 2015 05:44:05 GMT
Hi Marina,

Is this reproducible? Can you reproduce this with a smaller number of
events? Did you see any error in broker /server logs?

On Thu, Jul 16, 2015 at 5:42 PM, Marina <ppine7@yahoo.com.invalid> wrote:

> A variation on the posted question - as a new thread so that not to
> high-jack the original one...
> How long does it usually take to finally delete the topic? I tried to
> delete the topic via
> /bin/kafka-topics.sh --delete --zookeeper localhost:2181 --topic mytopic
> and saw that it was "marked for deletion". However,  about 30 hours later,
> the topic is still showing up in the list of topics:
> => bin/kafka-topics.sh --list --zookeeper localhost:2181
> __consumer_offsets
> mytopic
>
> The topic did have about 150 million events as Log size, but none were
> unprocessed (Lag == 0).
> As a test , I tried to create a new topic , and delete it right away with
> no events posted - and in that case it was deleted for good right away.
> I'm using kafka 1.8.2.1
> thanks!MArina
>
>       From: Stevo Slavić <sslavic@gmail.com>
>  To: users@kafka.apache.org
>  Sent: Thursday, July 16, 2015 6:56 PM
>  Subject: Re: Delete topic using Admintools is not working
>
> Hello Sivananda,
>
> Calling AdminUtils.deleteTopic just requests topic to be deleted - it does
> not actually delete topic immediately. Requests for topic deletion get
> saved in ZooKeeper as a node (named by topic name), under
> /admin/delete_topics node.
>
> If brokers in the cluster are configured with topic deletion enabled, and
> if they are running, they will notice requests to delete the topic, perform
> actual deletion (all partitions on all brokers, lead and replicas, as well
> as deletion of topic metadata in zookeeper), and also delete saved request
> for topic deletion (that node under /admin/delete_topics). This broker side
> part of topic deletion process is only working in Kafka 0.8.2.x.
>
> From your stack trace it seems you've requested topic deletion at least
> twice, while topic has not been deleted yet, so zk client used by admin
> utils, throws exception signalling that the node (request for topic
> deletion) already exists.
>
> If topic is not getting deleted even after a while I'd suggest that you
> check version, configuration and running status of your Kafka cluster.
>
> Kind regards,
> Stevo Slavic.
>
>
>
> On Fri, Jul 17, 2015 at 12:40 AM, Sivananda Reddy <sivananda2510@gmail.com
> >
> wrote:
>
> > Hi,
> >
> > As per the jira https://issues.apache.org/jira/browse/KAFKA-1737, I have
> > set ZKStringSerializer, while creating the ZkClient and still the delete
> > topic function call is not working:
> >
> > Version: kafka_2.11-0.8.2.1
> >
> > *My code looks like this*:
> > ZkClient zkClient = new ZkClient("localhost:2181", 6000, 6000,
> > ZKStringSerializer$.MODULE$);
> > AdminUtils.deleteTopic(zkClient, "testTopic17");
> >
> > *I am getting the following exception's*:
> > Exception in thread "main"
> > org.I0Itec.zkclient.exception.ZkNodeExistsException:
> > org.apache.zookeeper.KeeperException$NodeExistsException:
> KeeperErrorCode =
> > NodeExists for /admin/delete_topics/testTopic17
> >    at
> > org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:55)
> >    at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)
> >    at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304)
> >    at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:243)
> >    at kafka.utils.ZkUtils$.createPersistentPath(ZkUtils.scala:306)
> >    at kafka.admin.AdminUtils$.deleteTopic(AdminUtils.scala:159)
> >    at kafka.admin.AdminUtils.deleteTopic(AdminUtils.scala)
> >    at Test.deleteTopic(Test.java:98)
> >    at Test.main(Test.java:76)
> > Caused by: org.apache.zookeeper.KeeperException$NodeExistsException:
> > KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> >    at
> > org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> >    at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> >    at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
> >    at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87)
> >    at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308)
> >    at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304)
> >    at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
> >    ... 7 more
> >
> > *The corresponding zookeeper logs*:
> > [2015-07-16 15:31:14,383] INFO Accepted socket connection from /
> > 127.0.0.1:23363 (org.apache.zookeeper.server.NIOServerCnxnFactory)
> > [2015-07-16 15:31:14,385] INFO Client attempting to establish new session
> > at /127.0.0.1:23363 (org.apache.zookeeper.server.ZooKeeperServer)
> > [2015-07-16 15:31:14,391] INFO Established session 0x14e98d2ce98000c with
> > negotiated timeout 6000 for client /127.0.0.1:23363
> > (org.apache.zookeeper.server.ZooKeeperServer)
> > [2015-07-16 15:31:14,510] INFO Got user-level KeeperException when
> > processing sessionid:0x14e98d2ce98000c type:create cxid:0x1 zxid:0x963
> > txntype:-1 reqpath:n/a Error Path:/admin/delete_topics/testTopic17
> > Error:KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> > (org.apache.zookeeper.server.PrepRequestProcessor)
> > [2015-07-16 15:31:14,842] WARN caught end of stream exception
> > (org.apache.zookeeper.server.NIOServerCnxn)
> > EndOfStreamException: Unable to read additional data from client
> sessionid
> > 0x14e98d2ce98000c, likely client has closed socket
> >    at
> > org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> >    at
> >
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> >    at java.lang.Thread.run(Thread.java:744)
> > [2015-07-16 15:31:14,843] INFO Closed socket connection for client /
> > 127.0.0.1:23363 which had sessionid 0x14e98d2ce98000c
> > (org.apache.zookeeper.server.NIOServerCnxn)
> > [2015-07-16 15:31:21,000] INFO Expiring session 0x14e98d2ce98000c,
> timeout
> > of 6000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
> > [2015-07-16 15:31:21,001] INFO Processed session termination for
> sessionid:
> > 0x14e98d2ce98000c (org.apache.zookeeper.server.PrepRequestProcessor)
> >
> > Could someone please let me know if I am missing anything?
> >
> > Thank you,
> > Siva.
> >
>
>
>




-- 

Regards,
Ashish

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message