hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun Suresh (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-5501) Container Pooling in YARN
Date Tue, 09 Aug 2016 23:46:20 GMT
Arun Suresh created YARN-5501:

             Summary: Container Pooling in YARN
                 Key: YARN-5501
                 URL: https://issues.apache.org/jira/browse/YARN-5501
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Arun Suresh

This JIRA proposes a method for reducing the container launch latency in YARN. It introduces
a notion of pooling *Unattached Pre-Initialized Containers*.

Proposal in brief:
* Have a *Pre-Initialized Container Factory* service within the NM to create these unattached
* The NM would then advertise these containers as special resource types (this should be possible
via YARN-3926).
* When a start container request is received by the node manager for launching a container
requesting this specific type of resource, it will take one of these unattached pre-initialized
containers from the pool, and use it to service the container request.
* Once the request is complete, the pre-initialized container would be released and ready
to serve another request.

This capability would help reduce container launch latencies and thereby allow for development
of more interactive applications on YARN.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org

View raw message