Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Re: delete a topic


Copy link to this message
-
Re: delete a topic
Vadim Keylis 2013-08-24, 03:00
Hi Neha. What are jmx properties to monitor for lag and progress of
replica, until you release the tool?

Sent from my iPhone

On Aug 23, 2013, at 8:32 AM, Neha Narkhede <[EMAIL PROTECTED]> wrote:

> By that, I meant bringing down all brokers, deleting zookeeper data and
> kafka data and restarting the brokers. I suspect attempting a delete topic
> might have caused something bad to happen on the ISR side. It will be great
> if you can start clean and then see if the ISR is still an issue.
>
> Also, I filed a bug to include a tool that makes it easy to check the
> replica lag and progress, while troubleshooting ISR membership issues -
> https://issues.apache.org/jira/browse/KAFKA-1021
>
> Thanks,
> Neha
>
>
> On Fri, Aug 23, 2013 at 6:34 AM, Yu, Libo <[EMAIL PROTECTED]> wrote:
>
>> Hi Neha,
>>
>> "Wipe out the cluster" Do you mean you uninstall the cluster and reinstall
>> it?
>> Or you just delete all kafka data and zookeeper data for the cluster?
>> This is not a blocking issue for us. Our blocking issue is that some
>> broker will
>> fall out of ISR and never get back to it. We have observed that from more
>> that one clusters. I am not sure if it is related to the deleting issue.
>>
>> Regards,
>>
>> Libo
>>
>>
>> -----Original Message-----
>> From: Neha Narkhede [mailto:[EMAIL PROTECTED]]
>> Sent: Thursday, August 22, 2013 5:01 PM
>> To: [EMAIL PROTECTED]
>> Subject: Re: delete a topic
>>
>> In production, we are not deleting topics yet. In test environments, if we
>> have to delete topics, we wipe out the cluster. If this is a feature that
>> most users are blocked on, I think it makes sense to prioritize
>> https://issues.apache.org/jira/browse/KAFKA-330.
>>
>> Thanks,
>> Neha
>>
>>
>> On Thu, Aug 22, 2013 at 1:01 PM, Vadim Keylis <[EMAIL PROTECTED]>
>> wrote:
>>
>>> How do you guys delete a topic if such need arise?
>>>
>>>
>>> On Thu, Aug 22, 2013 at 12:29 PM, Neha Narkhede
>>> <[EMAIL PROTECTED]
>>>> wrote:
>>>
>>>> I mentioned this in a different thread. I think the
>>> 0.8.0-beta1-candidate1
>>>> includes the script, but we have removed it later. I think when we
>>> publish
>>>> 0.8-final, this should be resolved.
>>>>
>>>> Thanks,
>>>> Neha
>>>>
>>>>
>>>> On Thu, Aug 22, 2013 at 12:24 PM, Neha Narkhede
>>>> <[EMAIL PROTECTED]
>>>>> wrote:
>>>>
>>>>> Vadim,
>>>>>
>>>>> The JIRA tracking this feature is
>>>>> https://issues.apache.org/jira/browse/KAFKA-330.
>>>>> Until we have this feature, we should remove any scripts that give
>>>>> the impression of deleting a topic, as Jay suggested. I tried
>>>>> looking under bin/ but couldn't find any delete topic or partition
>> script.
>>>>>
>>>>> Can you tell us which script you are using?
>>>>>
>>>>> Thanks,
>>>>> Neha
>>>>>
>>>>>
>>>>> On Thu, Aug 22, 2013 at 11:40 AM, Vadim Keylis
>>>>> <[EMAIL PROTECTED]
>>>>> wrote:
>>>>>
>>>>>> Jay or Neha. What is the process of deleting the topic if the
>>>>>> script included in the repository creates false impression?
>>>>>>
>>>>>> Thanks,
>>>>>> Vadim
>>>>>>
>>>>>>
>>>>>> On Thu, Aug 22, 2013 at 11:14 AM, Jay Kreps <[EMAIL PROTECTED]>
>>>> wrote:
>>>>>>
>>>>>>> We should really remove the delete script from 0.8 if we plan
>>>>>>> to
>>>> release
>>>>>>> without delete support. Right now it appears to work but
>>>>>>> doesn't
>>> which
>>>>>> is
>>>>>>> clearly not good.
>>>>>>>
>>>>>>> -Jay
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Aug 22, 2013 at 10:57 AM, Neha Narkhede <
>>>>>> [EMAIL PROTECTED]
>>>>>>>> wrote:
>>>>>>>
>>>>>>>> We currently don't have the delete topic feature in Kafka
>>>>>>>> 0.8. So
>>>> any
>>>>>>>> manual attempts to do so might have a negative impact on
>>>>>> functionality.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Neha
>>>>>>>>
>>>>>>>>
>>>>>>>> On Thu, Aug 22, 2013 at 10:30 AM, Yu, Libo <[EMAIL PROTECTED]>
>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi team,
>>>>>>>>>
>>>>>>>>> When I delete a topic, the topic is deleted from zookeeper
>>>>>>>>> but
>>> its
>>>>>> log
>>>>>>>>> files are not deleted from