hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-16312) Remove dumb-init from hadoop-runner image
Date Fri, 17 May 2019 22:09:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842649#comment-16842649
] 

Eric Yang commented on HADOOP-16312:
------------------------------------

{quote}Do you suggest to keep dumb-init and use exec?{quote}

Dumb-init only works one way to push container into background execution.  To improve debug
experience in YARN, Kitematic and K8s, it is better to start the execution in foreground.
 This allows log aggregators to collect script output.  If user really want to demonize the
container, use docker -d option explicitly.

> Remove dumb-init from hadoop-runner image
> -----------------------------------------
>
>                 Key: HADOOP-16312
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16312
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Elek, Marton
>            Priority: Major
>
> This issue is reported by [~eyang] in HDDS-1495.
> I think it's better to discuss under a separated issue as it's unrelated to HDDS-1495.
> The original problem description from [~eyang]
> {quote}Dumb-init  is one way to always run contaized program in the background and respawn
the program when program fails. This is poor man’s solution for keeping program alive.
> Cluster management software like Kubernetes or YARN have additional policy and logic
to start the same docker container on a different node. Therefore, Dumb-init is not recommended
for future Hadoop daemons instead allow cluster management software to make decision where
to start the container. Dumb-init for demonize docker container will be removed, and change
to use entrypoint.sh Docker provides -d flag to demonize foreground process. Most of the management
system built on top of Docker, (ie. Kitematic, Apache YARN, and Kubernetes) integrates with
Docker container at foreground to  aggregate stdout and stderr output of the containerized
program.
> {quote}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message