spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacob Eisinger <>
Subject Re: Comprehensive Port Configuration reference?
Date Tue, 06 May 2014 13:09:49 GMT

Howdy Scott,

Please see the discussions about securing the Spark network [1] [2].

In a nut shell, Spark opens up a couple of well known ports.  And,then the
workers and the shell open up dynamic ports for each job.  These dynamic
ports make securing the Spark network difficult.



Jacob D. Eisinger
IBM Emerging Technologies - (512) 286-6075

From:	Scott Clasen <>
Date:	05/05/2014 11:39 AM
Subject:	Comprehensive Port Configuration reference?

Is there somewhere documented how one would go about configuring every open
port a spark application needs?

This seems like one of the main things that make running spark hard in
places like EC2 where you arent using the canned spark scripts.

Starting an app looks like you'll see ports open for

Local port to get callbacks from mesos master..

What else?

How do I configure all of these?

View this message in context:

Sent from the Apache Spark User List mailing list archive at

View raw message