hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (Jira)" <j...@apache.org>
Subject [jira] [Work logged] (HADOOP-17464) Create hadoop-compression module
Date Fri, 02 Apr 2021 21:54:00 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=576335&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-576335
]

ASF GitHub Bot logged work on HADOOP-17464:
-------------------------------------------

                Author: ASF GitHub Bot
            Created on: 02/Apr/21 21:53
            Start Date: 02/Apr/21 21:53
    Worklog Time Spent: 10m 
      Work Description: sunchao commented on pull request #2611:
URL: https://github.com/apache/hadoop/pull/2611#issuecomment-812730610


   > I think so. Previously people may include hadoop-common and expect snappy/lz4 codec
there. Where should we notify the people? release-note?
   
   Perhaps we should create a page for compression codecs, under "Tools" category of https://hadoop.apache.org/docs/current/index.html.
This can be done separately though after this is merged. We also need release notes I assume.
   
   > You mean to let codec loader to report what codecs there are?
   
   I think maybe some informative error message that users should have `hadoop-compression`
jar in their classpath or project dependencies, when the class loader fail to find the codec
class.
   
   @steveloughran do you still think this is a worthwhile thing to do? and I assume this targets
Hadoop 3.4.x, not 3.3.x, is that correct?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 576335)
    Time Spent: 4h 20m  (was: 4h 10m)

> Create hadoop-compression module
> --------------------------------
>
>                 Key: HADOOP-17464
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17464
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: L. C. Hsieh
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 4h 20m
>  Remaining Estimate: 0h
>
> We added lz4-java, snappy-java dependencies to replace native libs. As per the suggestion
from the review comments, we better add a hadoop module to have these extra dependencies,
to avoid messing up the dependencies of user application.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message