jclouds-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (JCLOUDS-1371) LocalBlobStore.list enumerates entire container
Date Wed, 30 Jan 2019 06:00:00 GMT

    [ https://issues.apache.org/jira/browse/JCLOUDS-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16755714#comment-16755714
] 

ASF subversion and git services commented on JCLOUDS-1371:
----------------------------------------------------------

Commit aad98e6f9660fd7a4dd30fa72a2c16a41e1d8584 in jclouds-labs's branch refs/heads/master
from Andrew Gaul
[ https://gitbox.apache.org/repos/asf?p=jclouds-labs.git;h=aad98e6 ]

JCLOUDS-1371: JCLOUDS-1488: list optimize prefix

Previously getBlobKeysInsideContainer returned all keys and filtered
in LocalBlobStore.  Now getBlobKeysInsideContainer filters via prefix
which can dramatically decrease the number of keys returned,
especially for the filesystem provider.  Further optimizations are
possible for delimiter.


> LocalBlobStore.list enumerates entire container
> -----------------------------------------------
>
>                 Key: JCLOUDS-1371
>                 URL: https://issues.apache.org/jira/browse/JCLOUDS-1371
>             Project: jclouds
>          Issue Type: Improvement
>          Components: jclouds-blobstore
>    Affects Versions: 2.0.3
>            Reporter: Andrew Gaul
>            Priority: Major
>              Labels: filesystem
>
> {{LocalBlobStore.list}} with the filesystem blobstore enumerates the entire container
even when prefix and delimiter set.  The File API does not provide a way to list a subset
of files except for those within a specific directory and the underlying filesystem makes
no guarantees about enumeration order.  We can still optimize the case where prefix is set
and delimiter is /.  Reference:
> https://lists.apache.org/thread.html/72e8a101d8a8f99b6f728336633db2cecae1dc443e4c5b195eee8f0d@%3Cuser.jclouds.apache.org%3E



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message