libcloud-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LIBCLOUD-527) GCE Libcloud Driver list_nodes and list_volumes Scaling Improvement
Date Thu, 20 Mar 2014 17:56:44 GMT

    [ https://issues.apache.org/jira/browse/LIBCLOUD-527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13942053#comment-13942053
] 

ASF GitHub Bot commented on LIBCLOUD-527:
-----------------------------------------

GitHub user wrigri opened a pull request:

    https://github.com/apache/libcloud/pull/267

    Gce auto create disk

    This adds support for the automatic creation and deletion of boot disks when creating/deleting
instances.
    
    It also deals with some inefficient code and should address most of the problems raised
in LIBCLOUD-527
    
    /cc @RussellSpitzer

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/wrigri/libcloud GCE_auto_create_disk

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/libcloud/pull/267.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #267
    
----
commit bae3e7586234f958e6451fc284d4a34600acb7c2
Author: Rick Wright <rickw@google.com>
Date:   2014-03-17T18:23:55Z

    Add support for auto-created boot disks and auto-delete disks.
    Also eliminate the call to ex_get_volume() in _to_node()

commit aecaf6759e08c0963b872adf66a916eaec4294ce
Author: Rick Wright <rickw@google.com>
Date:   2014-03-17T18:23:55Z

    Add support for auto-created boot disks and auto-delete disks.
    Also eliminate the call to ex_get_volume() in _to_node()

commit 03f19cda860d95c624909de51ecafa510bc5f623
Author: Rick Wright <rickw@google.com>
Date:   2014-03-20T17:38:09Z

    Merge branch 'GCE_auto_create_disk' of https://github.com/wrigri/libcloud into GCE_auto_create_disk
    
    Conflicts:
    	libcloud/compute/drivers/gce.py

----


> GCE Libcloud Driver list_nodes and list_volumes Scaling Improvement
> -------------------------------------------------------------------
>
>                 Key: LIBCLOUD-527
>                 URL: https://issues.apache.org/jira/browse/LIBCLOUD-527
>             Project: Libcloud
>          Issue Type: Improvement
>    Affects Versions: 0.14.0-beta3
>            Reporter: Russell Alexander Spitzer
>
> The current code for the GCE Driver has two significant bottle necks in the list_nodes
and list_volumes code. In both cases the slowdown can be traced to the response to object
methods _to_node and _to_storage_volume. These methods are called in serial from both list_node
and list_volume methods and each call to one of these methods requires an additional http
request. For list_nodes the price is doubled since each _to_node request requires a _to_storage_volume
request.
> Basically, list_nodes and list_volumes require 1 + 2 * Nodes and 1 + Volumes requests
to complete. I've found that at large numbers of nodes this is a considerable pain point.
> I've been working on a branch at
> https://github.com/RussellSpitzer/libcloud/tree/GCE_perf_to_node
> that I would be happy to contribute upstream if there is any desire for it.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message