hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [hadoop] mukund-thakur opened a new pull request #2354: HADOOP-17281 Implement FileSystem.listStatusIterator() in S3AFileSystem
Date Thu, 01 Oct 2020 06:56:35 GMT

mukund-thakur opened a new pull request #2354:
URL: https://github.com/apache/hadoop/pull/2354


   Ran the new test using ap-south-1 bucket. 
   
   O/P- 
   `(ContractTestUtils.java:end(1847)) - Duration of listing 1000 files using listFiles()
api with batch size of 10 including 10ms of processing time for each file: 12,223,848,028
nS
   2020-10-01 12:19:28,811 [JUnit-testMultiPagesListingPerformanceAndCorrectness] INFO  contract.ContractTestUtils
(ContractTestUtils.java:end(1847)) - Duration of listing 1000 files using listStatus() api
with batch size of 10 including 10ms of processing time for each file: 15,988,037,357 nS
   2020-10-01 12:19:41,050 [JUnit-testMultiPagesListingPerformanceAndCorrectness] INFO  contract.ContractTestUtils
(ContractTestUtils.java:end(1847)) - Duration of listing 1000 files using listStatusIterator()
api with batch size of 10 including 10ms of processing time for each file: 12,214,813,052
nS`
   
   From the logs we can see that time taken using listStatusIterator() and listFiles() matches
and is less than listStatus().


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message