metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otto Fowler <>
Subject Re: Request for Comment on new Syslog 5424 Parsing library
Date Mon, 21 May 2018 11:03:40 GMT
Thanks Ahmed. At the moment, I’m only concerned with RFC 5424 formatted
syslog <>, especially the structured
data ( the data in the []).

Such as:

<14>1 2014–06–20T09:14:07+00:00 loggregator
d0602076-b14a–4c55–852a–981e7afeed38 DEA MSG–01 [exampleSDID@32473 iut=“3”
eventSource=“Application” eventID=“1011”][exampleSDID@32480 iut=4
eventSource=Other Application eventID=2022] Removing instance

On May 20, 2018 at 19:03:29, Ahmed Shah ( wrote:


If needed this is what our syslog config files look like and our GROK
statement (used with Metron 0.4.2)

Server side syslog config files (messages sent to syslog are passed on to

Client/honeypot side config file:

GROK Statement:

Ahmed Shah (PMP, M. Eng.)
Cybersecurity Analyst & Developer
GCR - Cybersecurity Operations Center
Carleton University -<>

From: Casey Stella <>
Sent: May 18, 2018 10:59 AM
Subject: Re: Request for Comment on new Syslog 5424 Parsing library

Cool! I'd welcome a syslog parser!

On Fri, May 18, 2018 at 10:02 AM Otto Fowler <>

> There have been some issues and talk about they way we parse syslog, and
> the deficiencies of our grok and regex based approaches, mainly not
> supporting structured data as I recall.
> I played around with it some and decided to try to write an Antlr grammar
> based on the RFC 5424 spec BNF to parse valid syslogs.
> I have chosen to create this in my own github org, and will be
> through bintray/mvn central down the line. I *may* end up doing PR’s to
> Metron and Nifi around this but that is not definite.
> If anyone is interested, I would really appreciate any review or
> Also, if anyone has any ‘clean’ 5424 logs that they can safely contribute
> to expand my test set, that would be much appreciated.
> thanks
> ottO

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message