hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7445) Implement bulk checksum verification using efficient native code
Date Thu, 28 Jul 2011 14:40:09 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072379#comment-13072379
] 

Kihwal Lee commented on HADOOP-7445:
------------------------------------

+1 

This is a minor point. Do you think we need to expose crc32c_sb8() and crc32c_zlib_sb8()?
If not, why don't we move these to bulk_crc32.c and get rid of crc32.h? I thought the bulk
verification API is all we need to make available, but I may be wrong. If you believe it is
better as is, that's fine too.



> Implement bulk checksum verification using efficient native code
> ----------------------------------------------------------------
>
>                 Key: HADOOP-7445
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7445
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: native, util
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: hadoop-7445.txt, hadoop-7445.txt, hadoop-7445.txt
>
>
> Once HADOOP-7444 is implemented ("bulk" API for checksums), good performance gains can
be had by implementing bulk checksum operations using JNI. This JIRA is to add checksum support
to the native libraries. Of course if native libs are not available, it will still fall back
to the pure-Java implementations.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message