hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Leonidas Fegaras <fega...@cse.uta.edu>
Subject Question about FileInputFormat splits
Date Fri, 04 Jan 2013 19:59:53 GMT
Dear Hama developers,
It seems that the splits generated by the FileInputFormat in Hama 0.6.0 
cannot be smaller than a block. In Hama 0.5.0, I could set any split 
size using  job.set("bsp.min.split.size",...) and set the task numbers 
using job.setNumBspTask(...). This is ignored by Hama 0.6.0 for a split 
smaller than a block. But if you have more nodes in your cluster than 
data blocks, you may get faster execution if you allow splits smaller 
than a block. Is there any way to use splits smaller than a block in 
Hama 0.6.0?
Thanks for your help,
Leonidas


Mime
View raw message