falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1627) Provider integration with Azure Data Factory pipelines
Date Thu, 04 Feb 2016 23:17:39 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15133295#comment-15133295

ASF GitHub Bot commented on FALCON-1627:

GitHub user yzheng-hortonworks opened a pull request:


    FALCON-1627 Provider integration with Azure Data Factory pipelines

    This integration allows Microsoft Azure Data Factory pipelines to invoke Falcon activities
(i.e. replication, hive and pig proessing work), so the user can build a hybrid Hadoop data
pipelines leveraging on-premises Hadoop clusters and cloud based Cortana Analytics services
like HDInsight Hadoop clusters and Azure Machine Learning.
    Incorporated review comments from Balu on apache review board:

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/yzheng-hortonworks/falcon FALCON-1627

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #27
commit 4c5f2b2dd2971946e8b46f7d804a6bfde7071334
Author: yzheng-hortonworks <yzheng@hortonworks.com>
Date:   2016-02-04T21:56:40Z

    FALCON-1627 Provider integration with Azure Data Factory pipelines


> Provider integration with Azure Data Factory pipelines
> ------------------------------------------------------
>                 Key: FALCON-1627
>                 URL: https://issues.apache.org/jira/browse/FALCON-1627
>             Project: Falcon
>          Issue Type: New Feature
>    Affects Versions: 0.8
>            Reporter: Venkat Ranganathan
>            Assignee: Ying Zheng
>             Fix For: trunk
>         Attachments: ADF JSON Message Definition.pdf, ADFTutorial.pdf, FALCON-1627.patch
> Micrsosoft Azure Data Factory is Data processing service available on Microsoft Azure
environment which allows users to  compose, orchestrate and manage  data pipelines somewhat
similar to Falcon on the azure environment.   
> The integration will allow ADF to invoke a Falcon activity (replication, hive or pig
proessing work) from the Azure Data Factory data pipeline so that Azure cloud and Hadoop onprem
processing can be realized.
> The integration work has a few steps and will also be enhanced when ADF V3 protocol is

This message was sent by Atlassian JIRA

View raw message