hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8970) Need a different environment variable or configuration that states where local temporary files are stored than hadoop.tmp.dir
Date Fri, 12 May 2017 09:41:04 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007876#comment-16007876
] 

Steve Loughran commented on HADOOP-8970:
----------------------------------------

maybe now {{mapreduce.task.tmp.dir}}

> Need a different environment variable or configuration that states where local temporary
files are stored than hadoop.tmp.dir
> -----------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-8970
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8970
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: conf
>            Reporter: Robert Justice
>
> I'm finding that hadoop.tmp.dir is used for a base directory in configuration of working
directories for many other hadoop sub components (mapred, hdfs, hue, etc) and that it directs
where the Hadoop client stores some local temporary files, as well as temporary files on HDFS.
 
> Users may be dealing with tight space in /tmp.  In order to move where job setup files,
hive, hue files, etc, are locally stored, they have to create a new directory on HDFS (i.e.
/temp) and local directories on another filesystem and make sure permissions are setup properly
in HDFS and for the local filesystem across all the nodes across the cluster.
> I'm wondering if it would be better to have a hadoop.local.tmp.dir that is configurable
at the client level to say where local files are kept, and break that out from hadoop.tmp.dir?
 Know this is a major change, but thought I would suggest it.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message