hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (YARN-4481) negative pending resource of queues lead to applications in accepted status inifnitly
Date Thu, 18 May 2017 00:24:04 GMT

     [ https://issues.apache.org/jira/browse/YARN-4481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Wangda Tan resolved YARN-4481.
    Resolution: Duplicate

This should be fixed by YARN-4844. Closing as dup.

> negative pending resource of queues lead to applications in accepted status inifnitly
> -------------------------------------------------------------------------------------
>                 Key: YARN-4481
>                 URL: https://issues.apache.org/jira/browse/YARN-4481
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacity scheduler
>    Affects Versions: 2.7.2
>            Reporter: gu-chi
>            Priority: Critical
>         Attachments: jmx.txt
> Met a scenario of negative pending resource with capacity scheduler, in jmx, it shows:
> {noformat}
>     "PendingMB" : -4096,
>     "PendingVCores" : -1,
>     "PendingContainers" : -1,
> {noformat}
> full jmx infomation attached.
> this is not just a jmx UI issue, the actual pending resource of queue is also negative
as I see the debug log of
> bq. DEBUG | ResourceManager Event Processor | Skip this queue=root, because it doesn't
need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= | ParentQueue.java
> this lead to the {{NULL_ASSIGNMENT}}
> The background is submitting hundreds of applications and consume all cluster resource
and reservation happen. While running, network fault injected by some tool, injection types
are delay,jitter
> ,repeat,packet loss and disorder. And then kill most of the applications submitted.
> Anyone also facing negative pending resource, or have idea of how this happen?

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org

View raw message