hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "SammiChen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11798) Native raw erasure coder in XOR codes
Date Mon, 17 Oct 2016 07:41:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581500#comment-15581500

SammiChen commented on HADOOP-11798:

Hi Wei-Chiu, thank you so much for reviewing the code! Talking about documentation, one thing
comes to my mind is we can add notes in HDFSErasureCoding.md, use different values of key
"io.erasurecode.codec.xor.rawcoder" to switch between native v.s. Java-based codec. 
If only HDFSErasureCoding.md need to be updated, I will upload a new patch including this
document update later. 

> Native raw erasure coder in XOR codes
> -------------------------------------
>                 Key: HADOOP-11798
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11798
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: io
>            Reporter: Kai Zheng
>            Assignee: SammiChen
>              Labels: hdfs-ec-3.0-must-do
>             Fix For: HDFS-7285
>         Attachments: HADOOP-11798-v1.patch, HADOOP-11798-v2.patch, HADOOP-11798-v3.patch,
> Raw XOR coder is utilized in Reed-Solomon erasure coder in an optimization to recover
only one erased block which is in most often case. It can also be used in HitchHiker coder.
Therefore a native implementation of it would be deserved for performance gain.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message