Sarath Subramanian created ATLAS-3148:
-----------------------------------------
Summary: Implement Hive Metastore hook for Atlas
Key: ATLAS-3148
URL: https://issues.apache.org/jira/browse/ATLAS-3148
Project: Atlas
Issue Type: New Feature
Components: atlas-core
Affects Versions: 1.1.0
Reporter: Sarath Subramanian
Assignee: Sarath Subramanian
Fix For: 2.0.0, trunk
Atlas has [hive hook|[http://atlas.apache.org/Hook-Hive.html]] which registers with HiveServer2
process to listen for create/update/delete operations and updates the metadata in Atlas.
If hive metastore is accessed using other clients like Impala shell, Hue or other JDBC/ODBC
client apps there is no way to capture the events in Atlas.
This Jira will create a new atlas hook for Hive Metastore - stores the metadata for Hive
tables and partitions in a relational database, and provides clients (including Hive) access
to this information using the metastore service API.
This hook is registered as post-listener (hive.metastore.event.listeners) and DDL operations
are captured and send to atlas kafka topic for processing by Atlas server.
The following DDL operations are captured:
* CreateDatabaseEvent
* DropDatabaseEvent
* AlterDatabaseEvent
* CreateTableEvent
* DropTableEvent
* AlterTableEvent
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
|