spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maciej Bryński (JIRA) <>
Subject [jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished
Date Wed, 05 Oct 2016 11:29:20 GMT


Maciej Bryński commented on SPARK-17707:

I have similar problem with Spark Submit.
I'm not sure if it's connected with Web UI.

As a workaround I'm trying to use sc.stop() in application.

> Web UI prevents spark-submit application to be finished
> -------------------------------------------------------
>                 Key: SPARK-17707
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>    Affects Versions: 2.0.0
>            Reporter: Nick Orka
> Here are re-production steps:
> 1. create any scala spark application which will work long enough to open the application
details in Web UI
> 2. run spark-submit command for standalone cluster, like: --master spark:\\localhost:7077
> 3. open running application details in Web UI, like: localhost:4040
> 4. spark-submit will never finish, you will have to kill the process
> Cause: The application creates a thread with infinite loop for web UI communication 
and never stops it. The application is waiting for the thread to be finished instead, even
if you close the web page.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message