metron-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Casey Stella (JIRA)" <>
Subject [jira] [Updated] (METRON-33) Execute Enrichments in parallel
Date Tue, 16 Feb 2016 22:11:18 GMT


Casey Stella updated METRON-33:
    Labels: Metron_0.1BETA  (was: )

> Execute Enrichments in parallel
> -------------------------------
>                 Key: METRON-33
>                 URL:
>             Project: Metron
>          Issue Type: Improvement
>            Reporter: Ryan Merriman
>            Assignee: Ryan Merriman
>              Labels: Metron_0.1BETA
> Currently enrichments are done serially which is not efficient and will not scale well
as more enrichments are added.  To solve this we need a new pair of bolts that will split
messages, send to enrichment bolts, and join enriched messages back together.  Parsers for
all sources must also be refactored into the same general pattern to facilitate reuse of these
new split/join bolts.

This message was sent by Atlassian JIRA

View raw message