kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: delete a topic
Date Sat, 24 Aug 2013 04:15:34 GMT
Search for *-ConsumerLag under kafka.server. There is a jmx bean per
partition in the follower.

Thanks,

Jun


On Fri, Aug 23, 2013 at 7:59 PM, Vadim Keylis <vkeylis2009@gmail.com> wrote:

> Hi Neha. What are jmx properties to monitor for lag and progress of
> replica, until you release the tool?
>
> Sent from my iPhone
>
> On Aug 23, 2013, at 8:32 AM, Neha Narkhede <neha.narkhede@gmail.com>
> wrote:
>
> > By that, I meant bringing down all brokers, deleting zookeeper data and
> > kafka data and restarting the brokers. I suspect attempting a delete
> topic
> > might have caused something bad to happen on the ISR side. It will be
> great
> > if you can start clean and then see if the ISR is still an issue.
> >
> > Also, I filed a bug to include a tool that makes it easy to check the
> > replica lag and progress, while troubleshooting ISR membership issues -
> > https://issues.apache.org/jira/browse/KAFKA-1021
> >
> > Thanks,
> > Neha
> >
> >
> > On Fri, Aug 23, 2013 at 6:34 AM, Yu, Libo <libo.yu@citi.com> wrote:
> >
> >> Hi Neha,
> >>
> >> "Wipe out the cluster" Do you mean you uninstall the cluster and
> reinstall
> >> it?
> >> Or you just delete all kafka data and zookeeper data for the cluster?
> >> This is not a blocking issue for us. Our blocking issue is that some
> >> broker will
> >> fall out of ISR and never get back to it. We have observed that from
> more
> >> that one clusters. I am not sure if it is related to the deleting issue.
> >>
> >> Regards,
> >>
> >> Libo
> >>
> >>
> >> -----Original Message-----
> >> From: Neha Narkhede [mailto:neha.narkhede@gmail.com]
> >> Sent: Thursday, August 22, 2013 5:01 PM
> >> To: users@kafka.apache.org
> >> Subject: Re: delete a topic
> >>
> >> In production, we are not deleting topics yet. In test environments, if
> we
> >> have to delete topics, we wipe out the cluster. If this is a feature
> that
> >> most users are blocked on, I think it makes sense to prioritize
> >> https://issues.apache.org/jira/browse/KAFKA-330.
> >>
> >> Thanks,
> >> Neha
> >>
> >>
> >> On Thu, Aug 22, 2013 at 1:01 PM, Vadim Keylis <vkeylis2009@gmail.com>
> >> wrote:
> >>
> >>> How do you guys delete a topic if such need arise?
> >>>
> >>>
> >>> On Thu, Aug 22, 2013 at 12:29 PM, Neha Narkhede
> >>> <neha.narkhede@gmail.com
> >>>> wrote:
> >>>
> >>>> I mentioned this in a different thread. I think the
> >>> 0.8.0-beta1-candidate1
> >>>> includes the script, but we have removed it later. I think when we
> >>> publish
> >>>> 0.8-final, this should be resolved.
> >>>>
> >>>> Thanks,
> >>>> Neha
> >>>>
> >>>>
> >>>> On Thu, Aug 22, 2013 at 12:24 PM, Neha Narkhede
> >>>> <neha.narkhede@gmail.com
> >>>>> wrote:
> >>>>
> >>>>> Vadim,
> >>>>>
> >>>>> The JIRA tracking this feature is
> >>>>> https://issues.apache.org/jira/browse/KAFKA-330.
> >>>>> Until we have this feature, we should remove any scripts that give
> >>>>> the impression of deleting a topic, as Jay suggested. I tried
> >>>>> looking under bin/ but couldn't find any delete topic or partition
> >> script.
> >>>>>
> >>>>> Can you tell us which script you are using?
> >>>>>
> >>>>> Thanks,
> >>>>> Neha
> >>>>>
> >>>>>
> >>>>> On Thu, Aug 22, 2013 at 11:40 AM, Vadim Keylis
> >>>>> <vkeylis2009@gmail.com
> >>>>> wrote:
> >>>>>
> >>>>>> Jay or Neha. What is the process of deleting the topic if the
> >>>>>> script included in the repository creates false impression?
> >>>>>>
> >>>>>> Thanks,
> >>>>>> Vadim
> >>>>>>
> >>>>>>
> >>>>>> On Thu, Aug 22, 2013 at 11:14 AM, Jay Kreps <jay.kreps@gmail.com>
> >>>> wrote:
> >>>>>>
> >>>>>>> We should really remove the delete script from 0.8 if we
plan
> >>>>>>> to
> >>>> release
> >>>>>>> without delete support. Right now it appears to work but
> >>>>>>> doesn't
> >>> which
> >>>>>> is
> >>>>>>> clearly not good.
> >>>>>>>
> >>>>>>> -Jay
> >>>>>>>
> >>>>>>>
> >>>>>>> On Thu, Aug 22, 2013 at 10:57 AM, Neha Narkhede <
> >>>>>> neha.narkhede@gmail.com
> >>>>>>>> wrote:
> >>>>>>>
> >>>>>>>> We currently don't have the delete topic feature in
Kafka
> >>>>>>>> 0.8. So
> >>>> any
> >>>>>>>> manual attempts to do so might have a negative impact
on
> >>>>>> functionality.
> >>>>>>>>
> >>>>>>>> Thanks,
> >>>>>>>> Neha
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On Thu, Aug 22, 2013 at 10:30 AM, Yu, Libo <libo.yu@citi.com>
> >>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi team,
> >>>>>>>>>
> >>>>>>>>> When I delete a topic, the topic is deleted from
zookeeper
> >>>>>>>>> but
> >>> its
> >>>>>> log
> >>>>>>>>> files are not deleted from
> >>>>>>>>> Brokers.
> >>>>>>>>>
> >>>>>>>>> When I restart a  broker, the broker will try to
sync the
> >>>>>>>>> log
> >>>> files
> >>>>>>> whose
> >>>>>>>>> topic has been deleted.
> >>>>>>>>> Manually deleting the log files will resolve the
issue.
> >>>>>>>>> Should
> >>>>>> broker
> >>>>>>>>> ignore log files whose topic has been deleted?
> >>>>>>>>>
> >>>>>>>>> Regards,
> >>>>>>>>>
> >>>>>>>>> Libo
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message