hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-7445) Implement bulk checksum verification using efficient native code
Date Thu, 28 Jul 2011 06:37:10 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-7445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Todd Lipcon updated HADOOP-7445:

    Attachment: hadoop-7445.txt

Finally snuck some time to update this based on your feedback. How does this look? I split
up the code into the following files:
- NativeCrc32c: just JNI wrappers
- bulk_crc32.{c,h}: a "C style" API for bulk checksum verification
- crc32.h: the actual implementations (to be inlined)
- gcc_optimizations.h: the macros for builtin_expect, now used from multiple spots

I ran TestDataChecksum with native code built, and with -Xcheck:jni enabled, and it passes.

> Implement bulk checksum verification using efficient native code
> ----------------------------------------------------------------
>                 Key: HADOOP-7445
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7445
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: native, util
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: hadoop-7445.txt, hadoop-7445.txt, hadoop-7445.txt
> Once HADOOP-7444 is implemented ("bulk" API for checksums), good performance gains can
be had by implementing bulk checksum operations using JNI. This JIRA is to add checksum support
to the native libraries. Of course if native libs are not available, it will still fall back
to the pure-Java implementations.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message