atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Mestry (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ATLAS-2047) NotificationHookConsumer: Exception Thrown by Kafka Consumer Ends up Filling Logs Due to Incorrect Handling
Date Tue, 15 Aug 2017 16:53:00 GMT

    [ https://issues.apache.org/jira/browse/ATLAS-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16127514#comment-16127514
] 

Ashutosh Mestry commented on ATLAS-2047:
----------------------------------------

CC: [~nixonrodrigues]
CC: [~madhan.neethiraj]

> NotificationHookConsumer: Exception Thrown by Kafka Consumer Ends up Filling Logs Due
to Incorrect Handling 
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: ATLAS-2047
>                 URL: https://issues.apache.org/jira/browse/ATLAS-2047
>             Project: Atlas
>          Issue Type: Bug
>          Components:  atlas-core
>    Affects Versions: trunk, 0.8-incubating
>            Reporter: Ashutosh Mestry
>            Assignee: Ashutosh Mestry
>             Fix For: trunk
>
>         Attachments: ATLAS-2047-HookConsumer-ExceptionHandling.patch
>
>
> *Background*
> _KafkaConsumer_ is abstracted by _AtlasKafkaConsumer_. This is run using _HookConsumer_
which is derived from _kafka.utils.ShutdownableThread_.
> The _ShutdownableThread_ manages the thread. It handles exceptions thrown in the _doWork_
method and logs them.
> *Problem*
> Exception reported in the bug is thrown by _KafkaConsumer_ is handed by _HookConsumer_.
Exception is logged but the thread keeps running. In cases where Kafa is in irrecoverable
state, this behavior ends up filling up logs and providing no value in return.
> *Solution*
> Let _ShutdownableThread_ hand exceptions thrown by _KafkaConsumer_. Stop the thread if
_KafkaConsumer_ suffers from irrecoverable error. This will avoid the situation described
in the problem section.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message