falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Srikanth Sundarrajan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-2182) Add support for Falcon user extensions
Date Wed, 16 Nov 2016 06:53:58 GMT

    [ https://issues.apache.org/jira/browse/FALCON-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669640#comment-15669640

Srikanth Sundarrajan commented on FALCON-2182:

Thanks [~pallavi.rao]. Have a few questions on the design proposal.

1. Noted that the User Parameter Template returns a collection of properties. Is this fixed
to be a collection of properties ? If it merely a illustrative example and is not meant to
be a collection of properties then it looks alright. There may be issues in fixing this to
be a collection of properties, as it may be restrictive.

2. Why is preparation & submission separated out ? This might lead to users tampering
with the output of the prepared entities and may produce undesirable results. It might be
better to keep them locked down IMHO. I can see the need for some parameterization, which
can be supported through config overlays.

3. Can extensions be removed while being referred to ? I am guessing it should have an option
to be disabled without being removed. As documentation will go missing if removed completely.

4. Are we thinking of extensions as a convenient way for generating entities or are we thinking
of extensions as a atomic unit of reusable functionality? In other words, Is extensions role
is to only generate the entities and from there on we simply allow the processes & feeds
created to be managed individually or Are we looking at them as a functional capability and
the parts that make them (collection of processes & feeds) are inseparable ?

> Add support for Falcon user extensions
> --------------------------------------
>                 Key: FALCON-2182
>                 URL: https://issues.apache.org/jira/browse/FALCON-2182
>             Project: Falcon
>          Issue Type: New Feature
>          Components: extensions
>            Reporter: Pallavi Rao
>         Attachments: FalconUserExtensions.pdf
> Currently server-side trusted extensions are supported (see FALCON-634 for more details).
> Need to extend the Falcon Extensions to support extensions built by users. For example,
lets say a user wants to add an extension for "data-quality check". This shouldn't require
it to be compiled and tested with Falcon build. User should be able to add it on-the-fly (while
the Falcon Server is running) and other users should be able to discover it, and "instantiate"
this new extension.

This message was sent by Atlassian JIRA

View raw message