spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Benoy Antony (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-3287) When ResourceManager High Availability is enabled, ApplicationMaster webUI is not displayed.
Date Thu, 28 Aug 2014 20:13:08 GMT

     [ https://issues.apache.org/jira/browse/SPARK-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Benoy Antony updated SPARK-3287:
--------------------------------

    Attachment: SPARK-3287.patch

In the attached patch, the resource manager list is read using new API. The Filter parameter
which accept multiple hosts (PROXY_HOSTS instead of PROXY_HOST) and URL bases are used.
Since the parameter values use comma as separator, they are url-encoded so that it won’t
clash with separator for filter parameters.

The unit tests need to be used.


> When ResourceManager High Availability is enabled, ApplicationMaster webUI is not displayed.
> --------------------------------------------------------------------------------------------
>
>                 Key: SPARK-3287
>                 URL: https://issues.apache.org/jira/browse/SPARK-3287
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core, YARN
>    Affects Versions: 1.0.2
>            Reporter: Benoy Antony
>         Attachments: SPARK-3287.patch
>
>
> When ResourceManager High Availability is enabled, there will be multiple resource managers
and each of them could act as a proxy.
> AmIpFilter is modified to accept multiple proxy hosts. But Spark ApplicationMaster fails
read the ResourceManager IPs properly from the configuration.
> So AmIpFilter is initialized with an empty set of proxy hosts. So any access to the ApplicationMaster
WebUI will be redirected to port RM port on the local host. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message