hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaoyu Yao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-11577) Need document for storage type label of data node storage locations under dfs.data.dir
Date Tue, 10 Feb 2015 20:20:11 GMT
Xiaoyu Yao created HADOOP-11577:
-----------------------------------

             Summary: Need document for storage type label of data node storage locations
under dfs.data.dir
                 Key: HADOOP-11577
                 URL: https://issues.apache.org/jira/browse/HADOOP-11577
             Project: Hadoop Common
          Issue Type: Improvement
    Affects Versions: 2.6.0
            Reporter: Xiaoyu Yao
            Assignee: Xiaoyu Yao


HDFS-2832 enable support for heterogeneous storages in HDFS, which allows DN as a collection
of storages with different types. However, I can't find document on how to label different
storage types from the following two documents. I found the information from the design spec.It
will be good we document this for admins and users to use the related Archival storage and
storage policy features. 

http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html

http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml

This JIRA is opened to add document for the new storage type labels. I propose to add an example
under ArchivalStorage.html#Configuration section:

{code}
  <property>
    <name>dfs.data.dir</name>
    <value>[DISK]file:///hddata/dn/disk0,  [SSD]file:///hddata/dn/ssd0,[ARCHIVAL]file:///hddata/dn/archival0</value>,
  </property>
{code}

Also add a short description of [DISK/SSD/ARCHIVAL/RAM_DISK] options in hdfs-default.xml#dfs.data.dir
and document DISK as storage type if no storage type is labeled in the data node storage location
configuration. 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message