spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Hamstra <m...@clearstorydata.com>
Subject Re: Purpose of the HTTP Server?
Date Mon, 27 Jan 2014 16:02:33 GMT
Used for broadcast variables and to distribute files or jars to worker
nodes.  See HttpBroadcast.scala<https://github.com/apache/incubator-spark/blob/master/core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala>and
SparkContext.scala<https://github.com/apache/incubator-spark/blob/master/core/src/main/scala/org/apache/spark/SparkContext.scala>


On Mon, Jan 27, 2014 at 7:03 AM, Heiko Braun <ike.braun@googlemail.com>wrote:

> Yes, I've seen the one used for the UI. But there is also the HttpServer
> and HttpFileServer. Those are the ones I was wondering about.
>
> /Heiko
>
> On 27 Jan 2014, at 15:18, Cheng Lian <rhythm.mail@gmail.com> wrote:
>
> It's used for the Web UI.  By default, you may access
> http://localhost:8080 to view the cluster information as well as
> individual job details.
>
>
> On Mon, Jan 27, 2014 at 10:15 PM, Heiko Braun <ike.braun@googlemail.com>wrote:
>
>>
>>
>> Can someone briefly explain the the purpose of the HTTP server in spark?
>> Is it related to shipping the jars around in a cluster?
>>
>> Regards, Heiko
>
>
>
>

Mime
View raw message