atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shwetha G S (JIRA)" <>
Subject [jira] [Commented] (ATLAS-58) Make hive hook reliable
Date Wed, 16 Sep 2015 08:36:45 GMT


Shwetha G S commented on ATLAS-58:

Bug for making service/listener configurable using - ATLAS-103

> Make hive hook reliable
> -----------------------
>                 Key: ATLAS-58
>                 URL:
>             Project: Atlas
>          Issue Type: Sub-task
>            Reporter: Shwetha G S
>            Assignee: Shwetha G S
>              Labels: incompatible
>             Fix For: trunk
>         Attachments: ATLAS-58-v2.patch, ATLAS-58.patch
> Currently, hive hook executes in background thread pool and is an best effort approach
to register entities. But this needs to be reliable for data governance to be effective
> One way is - in hive hook, add the entities to some messaging framework and atlas server
can read the entities from the message and register in atlas. Since, posting message is faster,
we can do it synchronously and hence reliable entity registration.
> We can start with kafka for messaging, but any other messaging framework should be pluggable

This message was sent by Atlassian JIRA

View raw message