spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akhil Das <>
Subject Re: Spark Driver "behind" NAT
Date Mon, 05 Jan 2015 13:28:28 GMT
You can have a look at this discussion

Best Regards

On Mon, Jan 5, 2015 at 6:11 PM, Aaron <> wrote:

> Hello there, I was wondering if there is a way to have the spark-shell (or
> pyspark) sit behind a NAT when talking to the cluster?
> Basically, we have OpenStack instances that run with internal IPs, and we
> assign floating IPs as needed.  Since the workers make direct TCP
> connections back, the spark-shell is binding to the internal IP..not the
> "floating."  Our other use case is running Vagrant VMs on our local
> machines..but, we don't have those VMs' NICs setup in "bridged"
> too has an "internal" IP.
> I tried using the SPARK_LOCAL_IP, and the various --conf
> parameters...but it still get's "angry."
> Any thoughts/suggestions?
> Currently our work around is to VPNC connection from inside the vagrant
> VMs or Openstack instances...but, that doesn't seem like a long term plan.
> Thanks in advance!
> Cheers,
> Aaron

View raw message