hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sushanth Sowmyan (JIRA)" <>
Subject [jira] [Updated] (HIVE-10227) Concrete implementation of Export/Import based ReplicationTaskFactory
Date Fri, 17 Apr 2015 21:17:59 GMT


Sushanth Sowmyan updated HIVE-10227:
    Attachment: HIVE-10227.2.patch

Updating patch after initial feedback from Mithun on adding HCatClient.getConfVal, and using
that to change how ReplicationTask.create and its factory loading works, instead of statically
initializing a HiveConf.

Also, added batching semantics for HCatReplicationTaskIterator so that even if a user specifies
-1 as their max_events, we should not have OOM issues. In addition, HCatReplicationTaskIterator
always returns max_events entries if available, irrespective of whether or not there are max_events
relevant events in the next eventFrom+max_events events(old behaviour was that it'd return
at-most max_events events as it simply passed these parameters to the metastore). Basically,
HCatReplicationTaskIterator has been made more robust, and is now the primary interface point
to its users.

> Concrete implementation of Export/Import based ReplicationTaskFactory
> ---------------------------------------------------------------------
>                 Key: HIVE-10227
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Import/Export
>            Reporter: Sushanth Sowmyan
>            Assignee: Sushanth Sowmyan
>         Attachments: HIVE-10227.2.patch, HIVE-10227.patch

This message was sent by Atlassian JIRA

View raw message