hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [hadoop] steveloughran opened a new pull request #565: HADOOP-16058 S3A tests to include Terasort
Date Wed, 06 Mar 2019 21:29:58 GMT
steveloughran opened a new pull request #565: HADOOP-16058 S3A tests to include Terasort 
URL: https://github.com/apache/hadoop/pull/565
 
 
   HADOOP-16058. Add S3A tests to run terasort for the magic and directory committers.
   
   Contributed by Steve Loughran.
   
   Contains:
   
   MAPREDUCE-7090. BigMapOutput example doesn't work with paths off cluster fs
   
   MAPREDUCE-7091. Terasort on S3A to switch to new committers
   
   MAPREDUCE-7092. MR examples to work better against cloud stores
   
   Bonus feature: prints the results to see which committers are faster in the specific test
setup. As that's a function of latency to the store, bandwidth and size of jobs, it's not
at all meaningful, just interesting.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message