spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anant Chintamaneni <>
Subject Multi-node Docker based *Spark 1.3.1* clusters on VirtualBox(Mac)/EC2 instance
Date Fri, 05 Jun 2015 21:02:29 GMT
Hi All

If you are interested in getting fully configured multi-node distributed
Spark clusters up and running in minutes on VirtualBox (Mac) or a single
Amazon EC2 instance, there is a way. Not only that, you can run Spark jobs
against your local files, any HDFS or even NFS data

Perfect for experimentation and learning Spark. You can create and delete a
cluster, ssh into the nodes (Docker Containers), install you software
packages etc.

Here are some screenshots



View raw message