hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "SammiChen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11798) Native raw erasure coder in XOR codes
Date Mon, 17 Oct 2016 07:41:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581500#comment-15581500
] 

SammiChen commented on HADOOP-11798:
------------------------------------

Hi Wei-Chiu, thank you so much for reviewing the code! Talking about documentation, one thing
comes to my mind is we can add notes in HDFSErasureCoding.md, use different values of key
"io.erasurecode.codec.xor.rawcoder" to switch between native v.s. Java-based codec. 
If only HDFSErasureCoding.md need to be updated, I will upload a new patch including this
document update later. 


> Native raw erasure coder in XOR codes
> -------------------------------------
>
>                 Key: HADOOP-11798
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11798
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: io
>            Reporter: Kai Zheng
>            Assignee: SammiChen
>              Labels: hdfs-ec-3.0-must-do
>             Fix For: HDFS-7285
>
>         Attachments: HADOOP-11798-v1.patch, HADOOP-11798-v2.patch, HADOOP-11798-v3.patch,
HADOOP-11798-v4.patch
>
>
> Raw XOR coder is utilized in Reed-Solomon erasure coder in an optimization to recover
only one erased block which is in most often case. It can also be used in HitchHiker coder.
Therefore a native implementation of it would be deserved for performance gain.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message