spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Pavey" <mark.pa...@thefilter.com>
Subject RE: Can't view executor logs in web UI on Windows
Date Tue, 09 Feb 2016 15:58:36 GMT
I have submitted a pull request: https://github.com/apache/spark/pull/11135.

Mark


-----Original Message-----
From: Mark Pavey [mailto:mark.pavey@thefilter.com] 
Sent: 05 February 2016 17:09
To: 'Ted Yu'
Cc: user@spark.apache.org
Subject: RE: Can't view executor logs in web UI on Windows

We have created JIRA ticket
https://issues.apache.org/jira/browse/SPARK-13142 and will submit a pull
request next week.

Mark


-----Original Message-----
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: 01 February 2016 14:24
To: Mark Pavey
Cc: user@spark.apache.org
Subject: Re: Can't view executor logs in web UI on Windows

I did a brief search but didn't find relevant JIRA either. 

You can create a JIRA and submit pull request for the fix. 

Cheers

> On Feb 1, 2016, at 5:13 AM, Mark Pavey <mark.pavey@thefilter.com> wrote:
> 
> I am running Spark on Windows. When I try to view the Executor logs in 
> the UI I get the following error:
> 
> HTTP ERROR 500
> 
> Problem accessing /logPage/. Reason:
> 
>    Server Error
> Caused by:
> 
> java.net.URISyntaxException: Illegal character in path at index 1:
> .\work/app-20160129154716-0038/2/
>    at java.net.URI$Parser.fail(Unknown Source)
>    at java.net.URI$Parser.checkChars(Unknown Source)
>    at java.net.URI$Parser.parseHierarchical(Unknown Source)
>    at java.net.URI$Parser.parse(Unknown Source)
>    at java.net.URI.<init>(Unknown Source)
>    at org.apache.spark.deploy.worker.ui.LogPage.getLog(LogPage.scala:141)
>    at org.apache.spark.deploy.worker.ui.LogPage.render(LogPage.scala:78)
>    at org.apache.spark.ui.WebUI$$anonfun$2.apply(WebUI.scala:79)
>    at org.apache.spark.ui.WebUI$$anonfun$2.apply(WebUI.scala:79)
>    at org.apache.spark.ui.JettyUtils$$anon$1.doGet(JettyUtils.scala:69)
>    at javax.servlet.http.HttpServlet.service(HttpServlet.java:735)
>    at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>    at
>
org.spark-project.jetty.servlet.ServletHolder.handle(ServletHolder.java:684)
>    at
>
org.spark-project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:
501)
>    at
>
org.spark-project.jetty.server.handler.ContextHandler.doHandle(ContextHandle
r.java:1086)
>    at
>
org.spark-project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:4
28)
>    at
>
org.spark-project.jetty.server.handler.ContextHandler.doScope(ContextHandler
.java:1020)
>    at
>
org.spark-project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.ja
va:135)
>    at
>
org.spark-project.jetty.server.handler.GzipHandler.handle(GzipHandler.java:2
64)
>    at
>
org.spark-project.jetty.server.handler.ContextHandlerCollection.handle(Conte
xtHandlerCollection.java:255)
>    at
>
org.spark-project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.
java:116)
>    at org.spark-project.jetty.server.Server.handle(Server.java:370)
>    at
>
org.spark-project.jetty.server.AbstractHttpConnection.handleRequest(Abstract
HttpConnection.java:494)
>    at
>
org.spark-project.jetty.server.AbstractHttpConnection.headerComplete(Abstrac
tHttpConnection.java:971)
>    at
>
org.spark-project.jetty.server.AbstractHttpConnection$RequestHandler.headerC
omplete(AbstractHttpConnection.java:1033)
>    at
org.spark-project.jetty.http.HttpParser.parseNext(HttpParser.java:644)
>    at
>
org.spark-project.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>    at
>
org.spark-project.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnectio
n.java:82)
>    at
>
org.spark-project.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEnd
Point.java:667)
>    at
>
org.spark-project.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndP
oint.java:52)
>    at
>
org.spark-project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool
.java:608)
>    at
>
org.spark-project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.
java:543)
>    at java.lang.Thread.run(Unknown Source)
> 
> 
> 
> Looking at the source code for
> org.apache.spark.deploy.worker.ui.LogPage.getLog reveals the following:
> - At line 141 the constructor of java.net.URI is called with the path 
> to the log directory as a String argument. This string 
> (".\work/app-20160129154716-0038/2/" in example above) contains a 
> backslash, which is an illegal character for the URI constructor.
> - The component of the path containing the backslash is created at 
> line 71 by calling the getPath method on a java.io.File object.
> Because it is running on Windows it uses the default Windows file 
> separator, which is a backslash.
> 
> I am using Spark 1.5.1 but the source code appears unchanged in 1.6.0.
> 
> I haven't been able to find an open issue for this but if there is one 
> could possibly submit a pull request for it.
> 
> 
> 
> 
> --
> View this message in context: 
> http://apache-spark-user-list.1001560.n3.nabble.com/Can-t-view-executo
> r-logs-in-web-UI-on-Windows-tp26122.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For 
> additional commands, e-mail: user-help@spark.apache.org
> 



---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message