hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <>
Subject [jira] [Commented] (HIVE-18661) CachedStore: Use metastore notification log events to update cache
Date Thu, 13 Dec 2018 16:46:00 GMT


Hive QA commented on HIVE-18661:

Here are the results of testing the latest attachment:

{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 15626 tests executed
*Failed tests:*
org.apache.hadoop.hive.ql.parse.TestReplAcidTablesWithJsonMessage.testOpenTxnEvent (batchId=248)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcidTables.testOpenTxnEvent (batchId=245)
org.apache.hive.hcatalog.listener.TestDbNotificationListener.sqlCTAS (batchId=264)
org.apache.hive.hcatalog.listener.TestDbNotificationListener.sqlInsertPartition (batchId=264)
org.apache.hive.hcatalog.listener.TestDbNotificationListener.sqlInsertTable (batchId=264)

Test results:
Console output:
Test logs:

Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed

This message is automatically generated.

ATTACHMENT ID: 12951650 - PreCommit-HIVE-Build

> CachedStore: Use metastore notification log events to update cache
> ------------------------------------------------------------------
>                 Key: HIVE-18661
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Metastore
>            Reporter: Vaibhav Gumashta
>            Assignee: mahesh kumar behera
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: HIVE-18661.02.patch, HIVE-18661.03.patch, HIVE-18661.04.patch, HIVE-18661.05.patch,
HIVE-18661.06.patch, HIVE-18661.07.patch, HIVE-18661.08.patch
> Currently, a background thread updates the entire cache which is pretty inefficient.
We capture the updates to metadata in NOTIFICATION_LOG table which is getting used in the
Replication work. We should have the background thread apply these notifications to incrementally
update the cache.

This message was sent by Atlassian JIRA

View raw message