jclouds-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (JCLOUDS-1371) LocalBlobStore.list enumerates entire container
Date Wed, 30 Jan 2019 01:48:00 GMT

    [ https://issues.apache.org/jira/browse/JCLOUDS-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16755565#comment-16755565

ASF subversion and git services commented on JCLOUDS-1371:

Commit 7bf9c474c656926203a9ac34a1ed27db35c8515d in jclouds's branch refs/heads/2.1.x from
Andrew Gaul
[ https://gitbox.apache.org/repos/asf?p=jclouds.git;h=7bf9c47 ]

JCLOUDS-1371: JCLOUDS-1488: list optimize prefix

Previously getBlobKeysInsideContainer returned all keys and filtered
in LocalBlobStore.  Now getBlobKeysInsideContainer filters via prefix
which can dramatically decrease the number of keys returned,
especially for the filesystem provider.  Further optimizations are
possible for delimiter.

> LocalBlobStore.list enumerates entire container
> -----------------------------------------------
>                 Key: JCLOUDS-1371
>                 URL: https://issues.apache.org/jira/browse/JCLOUDS-1371
>             Project: jclouds
>          Issue Type: Improvement
>          Components: jclouds-blobstore
>    Affects Versions: 2.0.3
>            Reporter: Andrew Gaul
>            Priority: Major
>              Labels: filesystem
> {{LocalBlobStore.list}} with the filesystem blobstore enumerates the entire container
even when prefix and delimiter set.  The File API does not provide a way to list a subset
of files except for those within a specific directory and the underlying filesystem makes
no guarantees about enumeration order.  We can still optimize the case where prefix is set
and delimiter is /.  Reference:
> https://lists.apache.org/thread.html/72e8a101d8a8f99b6f728336633db2cecae1dc443e4c5b195eee8f0d@%3Cuser.jclouds.apache.org%3E

This message was sent by Atlassian JIRA

View raw message