chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <>
Subject [jira] Updated: (CHUKWA-348) SALSA State-machine Generation Driver
Date Mon, 10 May 2010 21:08:49 GMT


Ari Rabkin updated CHUKWA-348:

    Fix Version/s: 0.5.0
                       (was: 0.4.0)

> SALSA State-machine Generation Driver
> -------------------------------------
>                 Key: CHUKWA-348
>                 URL:
>             Project: Hadoop Chukwa
>          Issue Type: New Feature
>          Components: Data Processors
>    Affects Versions: 0.3.0
>            Reporter: Jiaqi Tan
>            Assignee: Jiaqi Tan
>            Priority: Critical
>             Fix For: 0.5.0
>   Original Estimate: 504h
>  Remaining Estimate: 504h
> Currently the state-machine generation can be run only via a standalone call to bin/
The plan is to subclass the AbstractDataLoader to automatically call the state-machine generation
when new data is available, and for this driver to automatically create output directories,
and decide which FSMBuilder mapper class to call (based on the log type). Then, the state-machine
records generated will be written to SeqFiles of ChukwaRecords that will get automatically
routed to the correct repos/ directory (by the PostProcessManager), and the MDL will automatically
load that to the database.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message