hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-12853) Change WASB documentation regarding page blob support
Date Tue, 01 Mar 2016 19:59:18 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chris Nauroth updated HADOOP-12853:
-----------------------------------
    Description: 
WASB page blob support documentation in Features list at the top:

Supports both page blobs (suitable for most use cases, such as MapReduce) and block blobs
(suitable for continuous write use cases, such as an HBase write-ahead log).
Which is actually the opposite. Block blobs are better for typical big data use cases, and
page blobs were implemented to support the HBase WAL.

It is also mentioned that
"Page blobs can be used for other purposes beyond just HBase log files though."
This is not strong enough because page blob has been tested only in context of HBase write
ahead logs. They have not been broadly certified for use across the Hadoop ecosystem, hence
is not recommended for use as a general purpose file-system via Hadoop cluster

  was:
WASB page blob support documentation in Features list at the top:

Supports both page blobs (suitable for most use cases, such as MapReduce) and block blobs
(suitable for continuous write use cases, such as an HBase write-ahead log).
Which is actually the opposite. Block blobs are better for typical big data use cases, and
page blobs were implemented to support the HBase WAL.

It is also mentioned that
"Page blobs can be used for other purposes beyond just HBase log files though."
This is not strong enough because page blob has been tested only in context of HBase write
ahead logs. They have not been broadly certified for use across the HDP stack, hence is not
recommended for use as a general purpose file-system via Hadoop cluster


> Change WASB documentation regarding page blob support
> -----------------------------------------------------
>
>                 Key: HADOOP-12853
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12853
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/azure
>            Reporter: madhumita chakraborty
>            Assignee: madhumita chakraborty
>            Priority: Minor
>         Attachments: HADOOP-12853.001.patch
>
>
> WASB page blob support documentation in Features list at the top:
> Supports both page blobs (suitable for most use cases, such as MapReduce) and block blobs
(suitable for continuous write use cases, such as an HBase write-ahead log).
> Which is actually the opposite. Block blobs are better for typical big data use cases,
and page blobs were implemented to support the HBase WAL.
> It is also mentioned that
> "Page blobs can be used for other purposes beyond just HBase log files though."
> This is not strong enough because page blob has been tested only in context of HBase
write ahead logs. They have not been broadly certified for use across the Hadoop ecosystem,
hence is not recommended for use as a general purpose file-system via Hadoop cluster



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message