hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "William Kinney (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6349) Implement FastLZCodec for fastlz/lzo algorithm
Date Tue, 05 Jan 2010 05:16:55 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796528#action_12796528
] 

William Kinney commented on HADOOP-6349:
----------------------------------------

Todd found my issue, no -O flag for gcc. Results:

File 1 - 152MB text:
Pack:
  java/jfastlz: 2.616 s
  c/fastlz: 0.973 s
Unpack:
  java/jfastlz: 1.710 s
  c/fastlz: 0.901 s

File 2 - 511MB binary:
Pack:
  java/jfastlz: 3.221 s
  c/fasltz: 1.644 s
Unpack:
  java/jfastlz: 3.611 s
  c/fastlz: 2.121 s


> Implement FastLZCodec for fastlz/lzo algorithm
> ----------------------------------------------
>
>                 Key: HADOOP-6349
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6349
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: io
>            Reporter: William Kinney
>         Attachments: HADOOP-6349-TestFastLZCodec.patch, HADOOP-6349.patch, TestCodecPerformance.java,
testCodecPerfResults.tsv
>
>
> Per  [HADOOP-4874|http://issues.apache.org/jira/browse/HADOOP-4874], FastLZ is a good
(speed, license) alternative to LZO. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message