hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ramkumar Vadali (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-2436) RAID block fixer should prioritize block fix operations
Date Wed, 13 Apr 2011 19:16:05 GMT
RAID block fixer should prioritize block fix operations

                 Key: MAPREDUCE-2436
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2436
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: contrib/raid
    Affects Versions: 0.20.2, 0.20.3
            Reporter: Ramkumar Vadali
            Assignee: Ramkumar Vadali

The RAID block fixer submits mapreduce jobs to fix corrupt files. This is OK for XOR RAID,
but with Reed-Solomon RAID, there can be large number of corrupt files when even a single
datanode goes dead. With Reed-SOlomon RAID, it is better to categorize corrupt files based
on urgency. Files with only one corrupt block can be treated as lower priority than those
with more number of corrupt blocks.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message