commons-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sebastian Skoglund (JIRA)" <>
Subject [jira] Commented: (VFS-161) Minimize using of LIST command in the FTP provider
Date Tue, 03 Jul 2007 09:28:05 GMT


Sebastian Skoglund commented on VFS-161:

This is a major performance problem when handling many tasks in a "batch-job".
If I for instance want to create a numerous of files, rename and delete some others it can
take several minutes for a fairly small amount of operations. I have done some testing and
measurments regarding this matter and if I want to create, rename and delete only 22 files
(with a total size of ~300kB) it takes as long as 72 seconds, which is unacceptable in my

> Minimize using of LIST command in the FTP provider
> --------------------------------------------------
>                 Key: VFS-161
>                 URL:
>             Project: Commons VFS
>          Issue Type: Improvement
>    Affects Versions: 1.1
>            Reporter: Alex Crane
>            Priority: Minor
> I have a big bis storage of files (about 10 TBytes). 
> Path to file looks like /storage/storage1/node1/76423fds7g78df6gdf7hdfh/2384dg7sdfg8dfh.dat
> Existance checking and deleteing of files takes very looooooooong time because of LIST
> LIST /storage
> ...
> LIST /storage/storage1
> ...
> LIST /storage/storage1/node1
> ....
> LIST /storage/storage1/node1/76423fds7g78df6gdf7hdfh
> and so on.
> For example, there is no need to perform LIST command to delete file. I`m using FTPClients
from and it works 1000x faster. 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message