metron-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ryan Merriman (JIRA)" <j...@apache.org>
Subject [jira] [Created] (METRON-33) Execute Enrichments in parallel
Date Wed, 10 Feb 2016 18:23:18 GMT
Ryan Merriman created METRON-33:
-----------------------------------

             Summary: Execute Enrichments in parallel
                 Key: METRON-33
                 URL: https://issues.apache.org/jira/browse/METRON-33
             Project: Metron
          Issue Type: Improvement
            Reporter: Ryan Merriman
            Assignee: Ryan Merriman


Currently enrichments are done serially which is not efficient and will not scale well as
more enrichments are added.  To solve this we need a new pair of bolts that will split messages,
send to enrichment bolts, and join enriched messages back together.  Parsers for all sources
must also be refactored into the same general pattern to facilitate reuse of these new split/join
bolts.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message