metron-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Justin Leet (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (METRON-1614) Create job status abstraction
Date Wed, 05 Sep 2018 15:18:00 GMT

     [ https://issues.apache.org/jira/browse/METRON-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Justin Leet updated METRON-1614:
--------------------------------
    Fix Version/s: 0.6.0

> Create job status abstraction
> -----------------------------
>
>                 Key: METRON-1614
>                 URL: https://issues.apache.org/jira/browse/METRON-1614
>             Project: Metron
>          Issue Type: Sub-task
>            Reporter: Ryan Merriman
>            Assignee: Michael Miklavcic
>            Priority: Major
>             Fix For: 0.6.0
>
>
> It is possible to use different job engines such as MR or Spark. There should be an abstraction
that allows us to track status independent of the underlying job engine. Initially we will
use YARN/MR to run pcap query jobs. We will also need a way to persist this information.
> Pcap job submission should be asynchronous. Some kind of id should be returned upon successful
job submission rather than blocking and waiting on the job to complete.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message