hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-7177) Disable speculative execution in TestDFSIO
Date Wed, 16 Jan 2019 22:45:00 GMT
Kihwal Lee created MAPREDUCE-7177:

             Summary: Disable speculative execution in TestDFSIO
                 Key: MAPREDUCE-7177
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7177
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 2.8.5, 3.2.0
            Reporter: Kihwal Lee

When TestDFSIO runs in a certain environment where a subset of mappers are slow, the speculative
execution can start.  In the write phase, this will make existing mapper to fail in next addBlock()
since the output files are overwritten.

To make the benchmark more predictable and repeatable, speculation must be implicitly disabled
in TestDFSIO itself. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org

View raw message