metron-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (METRON-1501) Parser messages that fail to validate are dropped silently
Date Tue, 03 Apr 2018 14:31:00 GMT

    [ https://issues.apache.org/jira/browse/METRON-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424096#comment-16424096
] 

ASF GitHub Bot commented on METRON-1501:
----------------------------------------

Github user asfgit closed the pull request at:

    https://github.com/apache/metron/pull/972


> Parser messages that fail to validate are dropped silently
> ----------------------------------------------------------
>
>                 Key: METRON-1501
>                 URL: https://issues.apache.org/jira/browse/METRON-1501
>             Project: Metron
>          Issue Type: Bug
>            Reporter: Casey Stella
>            Priority: Major
>
> Currently we have two concepts of dealing with messages that are not going to be passed
through:
>  * Messages that fail global validation
>  * Messages that fail the parser's validation function
>  * Messages that are filtered out
>  
> Currently in the case of messages that fail global validation, we send them to the error
queue.
> In the case of messages that fail the parser's validation function, we drop them silently.
> In the case of messages that are filtered out, we drop them silently as well.
>  
> Given the use-cases behind filtering (e.g. a kafka topic with multiple types of messages
where we want to pass along only one type), it makes sense to drop them silently.  However,
in the case of the messages that fail the parser's validation function, we should like to
know that and treat those similarly to those messages that fail global validation.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message