atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ATLAS-346) Atlas server loses messages sent from Hive hook if restarted after unclean shutdown
Date Tue, 01 Dec 2015 07:12:11 GMT
Hemanth Yamijala created ATLAS-346:
--------------------------------------

             Summary: Atlas server loses messages sent from Hive hook if restarted after unclean
shutdown
                 Key: ATLAS-346
                 URL: https://issues.apache.org/jira/browse/ATLAS-346
             Project: Atlas
          Issue Type: Bug
            Reporter: Hemanth Yamijala
            Priority: Critical


* Start Atlas server pointed to an external Kafka instance
* Configure HiveServer2 with Atlas hook pointing to the same Kafka instance.
* Run a hive DDL script like 
{code}
for i in `seq 1 25`; do ./bin/beeline -u jdbc:hive2://localhost:10000 -n ${user} -p ${pass}
-e "create table tbl${i} (col${i}1 int, col${i}2 string);"; done
{code}
* While the script is executing, kill -9 the Atlas server
* Let the script complete.
* Verify that all the events are added to the ATLAS_HOOK topic.
* Verify if the tables are added to Atlas.

The observation is that the Kafka topic has all relevant messages, but the tables aren't added
to Atlas.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message