atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Madhan Neethiraj (Jira)" <j...@apache.org>
Subject [jira] [Resolved] (ATLAS-161) How does atlas capture lineage
Date Sun, 17 May 2020 23:40:00 GMT

     [ https://issues.apache.org/jira/browse/ATLAS-161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Madhan Neethiraj resolved ATLAS-161.
------------------------------------
    Resolution: Information Provided

Atlas uses entity-types {{Process}} and {{DataSet}} to record lineage, using {{inputs}} and
{{outputs}} attributes of {{Process}}. Here is an example of lineage between 2 Hive tables
(table1 & table2) and a Hive view (view1) in Atlas:

{noformat}
entity-1: type=hive_table, qualifidName=default.table1@cl1
entity-2: type=hive_table, qualifiedName=default.table2@cl1
entity-3: type=hive_table, qualifiedName=default.view1@cl1
entity-4: type=hive_process, qualifiedName=default.view1@cl1:1589758349,
          queryText="create view view1 as select * from table1, table2", 
          inputs=[ { type=hive_table, qualifiedName=default.table1@cl1 },
                   { type=hive_table, qualifiedName=default.table2@cl1 } ],
          outputs=[ type=hive_table, qualifiedName=default.view1@cl1 ]
{noformat}


> How does atlas capture lineage
> ------------------------------
>
>                 Key: ATLAS-161
>                 URL: https://issues.apache.org/jira/browse/ATLAS-161
>             Project: Atlas
>          Issue Type: Wish
>            Reporter: Jason Xing
>            Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message