ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-10143) DataNode fails to start because of lowercase conversion of data dir path in data_dir_mount_file.
Date Fri, 20 Mar 2015 23:06:38 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-10143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14372287#comment-14372287
] 

Hudson commented on AMBARI-10143:
---------------------------------

ABORTED: Integrated in Ambari-trunk-Commit #2087 (See [https://builds.apache.org/job/Ambari-trunk-Commit/2087/])
AMBARI-10143. DataNode fails to start because of lowercase conversion of data dir path in
data_dir_mount_file (Paulo Tioseco via alejandro) (afernandez: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=6655d9886503066e0ff61c66bba8d1dd9f71c64a)
* ambari-common/src/main/python/resource_management/libraries/functions/dfs_datanode_helper.py
* ambari-common/src/main/python/resource_management/libraries/functions/file_system.py


> DataNode fails to start because of lowercase conversion of data dir path in data_dir_mount_file.
> ------------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-10143
>                 URL: https://issues.apache.org/jira/browse/AMBARI-10143
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-agent
>    Affects Versions: 1.7.0
>         Environment: Ubuntu 12.04 x64
>            Reporter: Paulo Tioseco
>            Assignee: Alejandro Fernandez
>             Fix For: 2.1.0
>
>         Attachments: AMBARI-10143.patch
>
>
> The code that handles creating the data dir and reading data_dir_mount_file explicitly
converts the data dir paths to lower case.
> This behavior is undesired because when the value of dfs.datanode.data.dir contains one
or more uppercase characters, it won't be able to match any item in the data_dir_mount_file
since Linux file paths are case sensitive.
> The issue may be reproduced by creating a single node cluster and setting the value of
the "DataNode directories" in "CLUSTER INSTALL WIZARD > Customize Services > HDFS >
DataNode" to: /UPPER_CASE_DIR/data
> Continue to the next step and the "DataNode start" task will fail with the following
exception (from /var/log/hadoop/hdfs/hadoop-hdfs-datanode-*.log):
> {code}
> datanode.DataNode (DataNode.java:checkStorageLocations(2284)) - Invalid dfs.datanode.data.dir
/UPPER_CASE_DIR/data :
> java.io.FileNotFoundException: File file:/UPPER_CASE_DIR/data does not exist
> {code}
> The checkStorageLocations function won't be able to find the directory because the directory
name was created with all lower case characters (from /var/lib/ambari-agent/data/output-9.txt):
> {code}
> Forcefully creating directory: /upper_case_dir/data
> {code}
> The data_dir_mount_file and hdfs-site.xml also shows the case mismatch of the data dir
path:
> {code}
> $ grep -rni UPPER_CASE_DIR /etc/hadoop/
> /etc/hadoop/conf.empty/hdfs-site.xml:46:      <value>/UPPER_CASE_DIR/data</value>
> /etc/hadoop/conf.empty/dfs_data_dir_mount.hist:7:/upper_case_dir/data,/
> /etc/hadoop/conf/hdfs-site.xml:46:      <value>/UPPER_CASE_DIR/data</value>
> /etc/hadoop/conf/dfs_data_dir_mount.hist:7:/upper_case_dir/data,/
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message